Abstract
Background: Recent advances in data-driven computational approaches have been helpful in devising tools to objectively diagnose psychiatric disorders. However, current machine learning studies limited to small homogeneous samples, different methodologies, and different imaging collection protocols, limit the ability to directly compare and generalize their results. Here we aimed to classify individuals with PTSD versus controls and assess the generalizability using a large heterogeneous brain datasets from the ENIGMA-PGC PTSD Working group. Methods: We analyzed brain MRI data from 3,477 structural-MRI; 2,495 resting state-fMRI; and 1,952 diffusion-MRI. First, we identified the brain features that best distinguish individuals with PTSD from controls using traditional machine learning methods. Second, we assessed the utility of the denoising variational autoencoder (DVAE) and evaluated its classification performance. Third, we assessed the generalizability and reproducibility of both models using leave-one-site-out cross-validation procedure for each modality. Results: We found lower performance in classifying PTSD vs. controls with data from over 20 sites (60 % test AUC for s-MRI, 59 % for rs-fMRI and 56 % for D-MRI), as compared to other studies run on single-site data. The performance increased when classifying PTSD from HC without trauma history in each modality (75 % AUC). The classification performance remained intact when applying the DVAE framework, which reduced the number of features. Finally, we found that the DVAE framework achieved better generalization to unseen datasets compared with the traditional machine learning frameworks, albeit performance was slightly above chance. Conclusion: These results have the potential to provide a baseline classification performance for PTSD when using large scale neuroimaging datasets. Our findings show that the control group used can heavily affect classification performance. The DVAE framework provided better generalizability for the multi-site data. This may be more significant in clinical practice since the neuroimaging-based diagnostic DVAE classification models are much less site-specific, rendering them more generalizable.
| Original language | English |
|---|---|
| Article number | 120412 |
| Journal | NeuroImage |
| Volume | 283 |
| DOIs | |
| Publication status | Published - 1 Dec 2023 |
Bibliographical note
Publisher Copyright:© 2023 The Author(s)
Funding
Dr. Thompson received partial grant support from Biogen, Inc., and Amazon, Inc., for work unrelated to the current study; Dr. Lebois reports unpaid membership on the Scientific Committee for International Society for the Study of Trauma and Dissociation (ISSTD), grant support from the National Institute of Mental Health, K01 MH118467 and the Julia Kasparian Fund for Neuroscience Research, McLean Hospital. Dr. Lebois also reports spousal IP payments from Vanderbilt University for technology licensed to Acadia Pharmaceuticals unrelated to the present work. ISSTD and NIMH were not involved in the analysis or preparation of the manuscript; Dr. Etkin reports salary and equity from Alto Neuroscience, equity from Mindstrong Health and Akili Interactive. Other authors have no conflicts of interest to declare.Dr. Zhu is supported by NIH K01MH122774 and by a NARSAD Young Investigator Grant from the Brain & Behavior Research Foundation 27040; Dr. Dennis is supported by NIH R61NS120249; Dr. Jahanshad is supported by NIH R01MH117601; Dr. Thompson is supported by NIH U54 EB020403; Dr. Fani is supported by NIH AT011267 and MH111671; Dr. Bomyea is suppprted by NIH R61MH127005 and CX001600; Dr. Lebois is supported by NIH K01MH118467; Dr. Daniels is supported by German Research Foundation DA 1222/4–1; Dr. Disner is supported by VA RR&D Award IK2RX002922; Dr. Bruce is supported by NIH K23 MH090366; Dr. Bryant is supported by National Health and Medical Research Council #1073041; Dr. Ross is supported by the NIH T32MH018931, F31MH122047 and T32GM007507; Dr. Cisler is supported by NIMH MH119132 and MH097784; Dr. Morey is supported by NIMH MH111671 and MH129832. Dr. Zhu is supported by NIH K01MH122774 and by a NARSAD Young Investigator Grant from the Brain & Behavior Research Foundation 27040 ; Dr. Dennis is supported by NIH R61NS120249 ; Dr. Jahanshad is supported by NIH R01MH117601 ; Dr. Thompson is supported by NIH U54 EB020403 ; Dr. Fani is supported by NIH AT011267 and MH111671 ; Dr. Bomyea is suppprted by NIH R61MH127005 and CX001600 ; Dr. Lebois is supported by NIH K01MH118467 ; Dr. Daniels is supported by German Research Foundation DA 1222/4–1 ; Dr. Disner is supported by VA RR&D Award IK2RX002922 ; Dr. Bruce is supported by NIH K23 MH090366 ; Dr. Bryant is supported by National Health and Medical Research Council #1073041 ; Dr. Ross is supported by the NIH T32MH018931 , F31MH122047 and T32GM007507 ; Dr. Cisler is supported by NIMH MH119132 and MH097784 ; Dr. Morey is supported by NIMH MH111671 and MH129832 .
| Funders | Funder number |
|---|---|
| Amazon, Inc. | |
| Biogen, Inc. | |
| Mindstrong Health and Akili Interactive | |
| National Institutes of Health | K01MH122774 |
| National Institute of Mental Health | K01 MH118467 |
| Vanderbilt University | |
| National Alliance for Research on Schizophrenia and Depression | K01MH118467, R61NS120249, MH111671, R01MH117601, U54 EB020403, R61MH127005, 27040, CX001600, AT011267 |
| ACADIA Pharmaceuticals Inc. | |
| National Health and Medical Research Council | MH097784, T32MH018931, F31MH122047, MH119132, MH129832, 1073041, T32GM007507 |
| the Deutsche Forschungsgemeinschaft | DA 1222/4–1, K23 MH090366, IK2RX002922 |
Keywords
- Classification
- Deep learning
- Machine learning
- Multimodal MRI
- Posttraumatic stress disorder