Sistema FMUSP-HC: Faculdade de Medicina da Universidade de São Paulo (FMUSP) e Hospital das Clínicas da FMUSPV, Thiago CardosoMICHELASSI, Gabriel C.FRANCO, Felipe O.SUMIYA, Fernando M.PORTOLESE, JoanaBRENTANI, HelenaMACHADO-LIMA, ArianeNUNES, Fatima L. S.2022-11-252022-11-2520212021 IEEE 34TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS (CBMS), p.50-55, 2021978-1-6654-4121-62372-9198https://observatorio.fm.usp.br/handle/OPI/50272The use of Eye Tracking (ET) has been investigated as an auxiliary mechanism to diagnose Autism Spectrum Disorder (ASD). One of the paradigms investigated using ET is Joint Attention (JA), which refers to moments when two individuals are focused on the same object/event so that both are aware that the focus of attention is shared. The computational tools that assist in the diagnosis of ASD have used Image Processing and Machine Learning techniques to process images, videos and ET signals. However, the JA paradigm is still little explored and presents challenges, as it requires analyzing the gaze trajectory and needs innovative approaches. The purpose of this article is to propose a model capable of extracting features from a video used as a stimulus to capture ET signals in order to verify JA and classify individuals as belonging to the ASD or Typical Development (TD) group. The main differential in relation to the approaches in the literature is the definition and implementation of the concept of floating Regions of Interest, which allows monitoring the gaze in relation to an object, considering its semantics, even if the object presents different characteristics throughout the video. A model based on ensembles of Random Forest classifiers was implemented to classify individuals as ASD or TD using the trajectory features extracted from the ET signals. The method reached 0.75 accuracy and 0.82 F1-score, indicating that the proposed approach, based on trajectory and JA, has the potential to be applied to assist in the diagnosis of ASD.engrestrictedAccessAutism Spectrum DisorderEnsemble MethodEye trackingImage processingJoint attentionMachine LearningRandom ForestTrajectoryTypical DevelopmentconferenceObjectCopyright IEEE10.1109/CBMS52027.2021.00016Computer Science, Interdisciplinary ApplicationsEngineering, BiomedicalMedical Informatics