TY - JOUR
T1 - Deep Learning Algorithms to Detect Murmurs Associated With Structural Heart Disease
AU - Prince, John
AU - Maidens, John
AU - Kieu, Spencer
AU - Currie, Caroline
AU - Barbosa, Daniel
AU - Hitchcock, Cody
AU - Saltman, Adam
AU - Norozi, Kambiz
AU - Wiesner, Philipp
AU - Slamon, Nicholas
AU - Grippo, Erica Del
AU - Padmanabhan, Deepak
AU - Subramanian, Anand
AU - Manjunath, Cholenahalli
AU - Chorba, John
AU - Venkatraman, Subramaniam
N1 - Publisher Copyright:
© 2023 The Authors and Eko Devices, Inc.
PY - 2023/10/17
Y1 - 2023/10/17
N2 - BACKGROUND: The success of cardiac auscultation varies widely among medical professionals, which can lead to missed treatments for structural heart disease. Applying machine learning to cardiac auscultation could address this problem, but despite recent interest, few algorithms have been brought to clinical practice. We evaluated a novel suite of Food and Drug Administration-cleared algorithms trained via deep learning on >15 000 heart sound recordings. METHODS AND RESULTS: We validated the algorithms on a data set of 2375 recordings from 615 unique subjects. This data set was collected in real clinical environments using commercially available digital stethoscopes, annotated by board-certified cardiologists, and paired with echocardiograms as the gold standard. To model the algorithm in clinical practice, we compared its performance against 10 clinicians on a subset of the validation database. Our algorithm reliably detected structural murmurs with a sensitivity of 85.6% and specificity of 84.4%. When limiting the analysis to clearly audible murmurs in adults, performance improved to a sensitivity of 97.9% and specificity of 90.6%. The algorithm also reported timing within the cardiac cycle, differentiating between systolic and diastolic murmurs. Despite optimizing acoustics for the clinicians, the algorithm substantially outperformed the clinicians (average clinician accuracy, 77.9%; algorithm accuracy, 84.7%.) CONCLUSIONS: The algorithms accurately identified murmurs associated with structural heart disease. Our results illustrate a marked contrast between the consistency of the algorithm and the substantial interobserver variability of clinicians. Our results suggest that adopting machine learning algorithms into clinical practice could improve the detection of structural heart disease to facilitate patient care.
AB - BACKGROUND: The success of cardiac auscultation varies widely among medical professionals, which can lead to missed treatments for structural heart disease. Applying machine learning to cardiac auscultation could address this problem, but despite recent interest, few algorithms have been brought to clinical practice. We evaluated a novel suite of Food and Drug Administration-cleared algorithms trained via deep learning on >15 000 heart sound recordings. METHODS AND RESULTS: We validated the algorithms on a data set of 2375 recordings from 615 unique subjects. This data set was collected in real clinical environments using commercially available digital stethoscopes, annotated by board-certified cardiologists, and paired with echocardiograms as the gold standard. To model the algorithm in clinical practice, we compared its performance against 10 clinicians on a subset of the validation database. Our algorithm reliably detected structural murmurs with a sensitivity of 85.6% and specificity of 84.4%. When limiting the analysis to clearly audible murmurs in adults, performance improved to a sensitivity of 97.9% and specificity of 90.6%. The algorithm also reported timing within the cardiac cycle, differentiating between systolic and diastolic murmurs. Despite optimizing acoustics for the clinicians, the algorithm substantially outperformed the clinicians (average clinician accuracy, 77.9%; algorithm accuracy, 84.7%.) CONCLUSIONS: The algorithms accurately identified murmurs associated with structural heart disease. Our results illustrate a marked contrast between the consistency of the algorithm and the substantial interobserver variability of clinicians. Our results suggest that adopting machine learning algorithms into clinical practice could improve the detection of structural heart disease to facilitate patient care.
KW - Adult
KW - Algorithms
KW - Deep Learning
KW - Heart Auscultation
KW - Heart Diseases/diagnostic imaging
KW - Heart Murmurs/diagnosis
KW - Humans
UR - https://www.scopus.com/pages/publications/85175455004
U2 - 10.1161/JAHA.123.030377
DO - 10.1161/JAHA.123.030377
M3 - Article
C2 - 37830333
AN - SCOPUS:85175455004
SN - 2047-9980
VL - 12
SP - e030377
JO - Journal of the American Heart Association
JF - Journal of the American Heart Association
IS - 20
M1 - e030377
ER -