Abstract

Background: Recent advances in data-driven computational approaches have been helpful in devising tools to objectively diagnose psychiatric disorders. However, current machine learning studies limited to small homogeneous samples, different methodologies, and different imaging collection protocols, limit the ability to directly compare and generalize their results. Here we aimed to classify individuals with PTSD versus controls and assess the generalizability using a large heterogeneous brain datasets from the ENIGMA-PGC PTSD Working group. Methods: We analyzed brain MRI data from 3,477 structural-MRI; 2,495 resting state-fMRI; and 1,952 diffusion-MRI. First, we identified the brain features that best distinguish individuals with PTSD from controls using traditional machine learning methods. Second, we assessed the utility of the denoising variational autoencoder (DVAE) and evaluated its classification performance. Third, we assessed the generalizability and reproducibility of both models using leave-one-site-out cross-validation procedure for each modality. Results: We found lower performance in classifying PTSD vs. controls with data from over 20 sites (60 % test AUC for s-MRI, 59 % for rs-fMRI and 56 % for D-MRI), as compared to other studies run on single-site data. The performance increased when classifying PTSD from HC without trauma history in each modality (75 % AUC). The classification performance remained intact when applying the DVAE framework, which reduced the number of features. Finally, we found that the DVAE framework achieved better generalization to unseen datasets compared with the traditional machine learning frameworks, albeit performance was slightly above chance. Conclusion: These results have the potential to provide a baseline classification performance for PTSD when using large scale neuroimaging datasets. Our findings show that the control group used can heavily affect classification performance. The DVAE framework provided better generalizability for the multi-site data. This may be more significant in clinical practice since the neuroimaging-based diagnostic DVAE classification models are much less site-specific, rendering them more generalizable.

Original languageEnglish
Article number120412
JournalNeuroImage
Volume283
DOIs
Publication statusPublished - 1 Dec 2023

Bibliographical note

Publisher Copyright:
© 2023 The Author(s)

Funding

Dr. Thompson received partial grant support from Biogen, Inc., and Amazon, Inc., for work unrelated to the current study; Dr. Lebois reports unpaid membership on the Scientific Committee for International Society for the Study of Trauma and Dissociation (ISSTD), grant support from the National Institute of Mental Health, K01 MH118467 and the Julia Kasparian Fund for Neuroscience Research, McLean Hospital. Dr. Lebois also reports spousal IP payments from Vanderbilt University for technology licensed to Acadia Pharmaceuticals unrelated to the present work. ISSTD and NIMH were not involved in the analysis or preparation of the manuscript; Dr. Etkin reports salary and equity from Alto Neuroscience, equity from Mindstrong Health and Akili Interactive. Other authors have no conflicts of interest to declare.Dr. Zhu is supported by NIH K01MH122774 and by a NARSAD Young Investigator Grant from the Brain & Behavior Research Foundation 27040; Dr. Dennis is supported by NIH R61NS120249; Dr. Jahanshad is supported by NIH R01MH117601; Dr. Thompson is supported by NIH U54 EB020403; Dr. Fani is supported by NIH AT011267 and MH111671; Dr. Bomyea is suppprted by NIH R61MH127005 and CX001600; Dr. Lebois is supported by NIH K01MH118467; Dr. Daniels is supported by German Research Foundation DA 1222/4–1; Dr. Disner is supported by VA RR&D Award IK2RX002922; Dr. Bruce is supported by NIH K23 MH090366; Dr. Bryant is supported by National Health and Medical Research Council #1073041; Dr. Ross is supported by the NIH T32MH018931, F31MH122047 and T32GM007507; Dr. Cisler is supported by NIMH MH119132 and MH097784; Dr. Morey is supported by NIMH MH111671 and MH129832. Dr. Zhu is supported by NIH K01MH122774 and by a NARSAD Young Investigator Grant from the Brain & Behavior Research Foundation 27040 ; Dr. Dennis is supported by NIH R61NS120249 ; Dr. Jahanshad is supported by NIH R01MH117601 ; Dr. Thompson is supported by NIH U54 EB020403 ; Dr. Fani is supported by NIH AT011267 and MH111671 ; Dr. Bomyea is suppprted by NIH R61MH127005 and CX001600 ; Dr. Lebois is supported by NIH K01MH118467 ; Dr. Daniels is supported by German Research Foundation DA 1222/4–1 ; Dr. Disner is supported by VA RR&D Award IK2RX002922 ; Dr. Bruce is supported by NIH K23 MH090366 ; Dr. Bryant is supported by National Health and Medical Research Council #1073041 ; Dr. Ross is supported by the NIH T32MH018931 , F31MH122047 and T32GM007507 ; Dr. Cisler is supported by NIMH MH119132 and MH097784 ; Dr. Morey is supported by NIMH MH111671 and MH129832 .

FundersFunder number
Amazon, Inc.
Biogen, Inc.
Mindstrong Health and Akili Interactive
National Institutes of HealthK01MH122774
National Institute of Mental HealthK01 MH118467
Vanderbilt University
National Alliance for Research on Schizophrenia and DepressionK01MH118467, R61NS120249, MH111671, R01MH117601, U54 EB020403, R61MH127005, 27040, CX001600, AT011267
ACADIA Pharmaceuticals Inc.
National Health and Medical Research CouncilMH097784, T32MH018931, F31MH122047, MH119132, MH129832, 1073041, T32GM007507
the Deutsche ForschungsgemeinschaftDA 1222/4–1, K23 MH090366, IK2RX002922

    Keywords

    • Classification
    • Deep learning
    • Machine learning
    • Multimodal MRI
    • Posttraumatic stress disorder

    Fingerprint

    Dive into the research topics of 'Neuroimaging-based classification of PTSD using data-driven computational approaches: A multisite big data study from the ENIGMA-PGC PTSD consortium'. Together they form a unique fingerprint.

    Cite this