{"id":13165,"date":"2023-01-23T00:00:00","date_gmt":"2023-01-23T05:00:00","guid":{"rendered":"https:\/\/icesontario.wpengine.com\/publications\/journal-articles\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\/"},"modified":"2023-11-22T15:07:00","modified_gmt":"2023-11-22T20:07:00","slug":"can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing","status":"publish","type":"journal_article","link":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\/","title":{"rendered":"Can patients with dementia be identified in primary care electronic medical records using natural language processing?"},"content":{"rendered":"<p>Dementia and mild cognitive impairment can be underrecognized in primary care practice and research. Free-text fields in electronic medical records (EMRs) are a rich source of information which might support increased detection and enable a better understanding of populations at risk of dementia. We used natural language processing (NLP) to identify dementia-related features in EMRs and compared the performance of supervised machine learning models to classify patients with dementia. We assembled a cohort of primary care patients aged 66 + years in Ontario, Canada, from EMR notes collected until December 2016: 526 with dementia and 44,148 without dementia. We identified dementia-related features by applying published lists, clinician input, and NLP with word embeddings to free-text progress and consult notes and organized features into thematic groups. Using machine learning models, we compared the performance of features to detect dementia, overall and during time periods relative to dementia case ascertainment in health administrative databases. Over 900 dementia-related features were identified and grouped into eight themes (including symptoms, social, function, cognition). Using notes from all time periods, LASSO had the best performance (F1 score: 77.2%, sensitivity: 71.5%, specificity: 99.8%). Model performance was poor when notes written before case ascertainment were included (F1 score: 14.4%, sensitivity: 8.3%, specificity 99.9%) but improved as later notes were added. While similar models may eventually improve recognition of cognitive issues and dementia in primary care EMRs, our findings suggest that further research is needed to identify which additional EMR components might be useful to promote early detection of dementia.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Dementia and mild cognitive impairment can be underrecognized in primary care practice and research. Free-text fields in electronic medical records (EMRs) are a rich source of information which might support increased detection and enable a better understanding of populations at risk of dementia. We used natural language processing (NLP) to identify dementia-related features in EMRs [&hellip;]<\/p>\n","protected":false},"template":"","migration-helper-automated":[],"migration-manual":[],"topic":[],"migration-helper-qa-sample-set":[],"class_list":["post-13165","journal_article","type-journal_article","status-publish","hentry"],"acf":{"citation":"Maclagan LC, Abdalla M, Harris DA, Stukel TA, Chen B, Candido E, Swartz RH, Iaboni A, Jaakkimainen RL, Bronskill SE. <em>J Healthc Inform Res<\/em>. 2023; 7(1):42-58. Epub 2023 Jan 23.","source_url":"https:\/\/doi.org\/10.1007\/s41666-023-00125-6","ices_scientist":[1159,1188,1372,1354,1283],"site":[6733],"research_program":[6740],"news_release":"","journal_article":"","atlas":"","research_report":"","infographic":"","video":"","downloads":null,"links":null,"sitecore_item_id":"7495C7CE-4210-4DB1-A8FC-4576814B95A0","sitecore_item_name":"Can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records","sitecore_field_values":"{\n  \"Title\": \"Can patients with dementia be identified in primary care electronic medical records using natural language processing?\",\n  \"Short title\": \"Can patients with dementia be identified\",\n  \"Summary\": \"The study findings suggest that further research is needed to identify which additional electronic medical records components might be useful to promote early detection of dementia.\",\n  \"Citation\": \"<p>Maclagan LC, Abdalla M, Harris DA, Stukel TA, Chen B, Candido E, Swartz RH, Iaboni A, Jaakkimainen RL, Bronskill SE. <em>J Healthc Inform Res<\/em>. 2023; Jan 23 [Epub ahead of print]. DOI: <a href=\"https:\/\/doi.org\/10.1007\/s41666-023-00125-6\" title=\"opens external link\">https:\/\/doi.org\/10.1007\/s41666-023-00125-6<\/a><\/p>\",\n  \"Abstract\": \"<p>Dementia and mild cognitive impairment can be underrecognized in primary care practice and research. Free-text fields in electronic medical records (EMRs) are a rich source of information which might support increased detection and enable a better understanding of populations at risk of dementia. We used natural language processing (NLP) to identify dementia-related features in EMRs and compared the performance of supervised machine learning models to classify patients with dementia. We assembled a cohort of primary care patients aged 66 + years in Ontario, Canada, from EMR notes collected until December 2016: 526 with dementia and 44,148 without dementia. We identified dementia-related features by applying published lists, clinician input, and NLP with word embeddings to free-text progress and consult notes and organized features into thematic groups. Using machine learning models, we compared the performance of features to detect dementia, overall and during time periods relative to dementia case ascertainment in health administrative databases. Over 900 dementia-related features were identified and grouped into eight themes (including symptoms, social, function, cognition). Using notes from all time periods, LASSO had the best performance (F1 score: 77.2%, sensitivity: 71.5%, specificity: 99.8%). Model performance was poor when notes written before case ascertainment were included (F1 score: 14.4%, sensitivity: 8.3%, specificity 99.9%) but improved as later notes were added. While similar models may eventually improve recognition of cognitive issues and dementia in primary care EMRs, our findings suggest that further research is needed to identify which additional EMR components might be useful to promote early detection of dementia.<\/p>\",\n  \"Research Programs\": \"{46DF28D2-EDE8-4DF2-8CC0-87CEF464E435}\",\n  \"ICES Locations\": \"{4FCAABBA-14A5-42E6-8F33-BC6C2F1D9908}\",\n  \"ICES Scientists\": \"{68FD9EE5-974B-4CED-A597-82186232FF1D}|{8450FA48-5F0D-48C7-91C5-4BCB0CC0CE1A}|{A0978F87-1C10-4E62-A833-89616146CA59}|{4C3F4B6A-C20D-4BE7-A615-5559DF810FC4}|{D4F4F5B9-0B0A-48C9-A2E9-761818E1B404}\",\n  \"Posted Date\": \"20230123T000000\",\n  \"Show on Publications Landing Page\": \"1\"\n}","previous_url":"https:\/\/www.ices.on.ca\/Publications\/Journal-Articles\/2023\/January\/Can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records"},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>ICES | Can patients with dementia be identified in primary care electronic medical records using natural language processing?<\/title>\n<meta name=\"description\" content=\"Dementia and mild cognitive impairment can be underrecognized in primary care practice and research. Free-text fields in electronic medical records (EMRs)\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ICES | Can patients with dementia be identified in primary care electronic medical records using natural language processing?\" \/>\n<meta property=\"og:description\" content=\"Dementia and mild cognitive impairment can be underrecognized in primary care practice and research. Free-text fields in electronic medical records (EMRs)\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\/\" \/>\n<meta property=\"og:site_name\" content=\"ICES\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ICESOntario\/\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-22T20:07:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ices.on.ca\/wp-content\/uploads\/2024\/11\/ic-es-data-discovery-better-health-logo.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"675\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\\\/\",\"url\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\\\/\",\"name\":\"ICES | Can patients with dementia be identified in primary care electronic medical records using natural language processing?\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#website\"},\"datePublished\":\"2023-01-23T05:00:00+00:00\",\"dateModified\":\"2023-11-22T20:07:00+00:00\",\"description\":\"Dementia and mild cognitive impairment can be underrecognized in primary care practice and research. Free-text fields in electronic medical records (EMRs)\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\\\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Journal Articles\",\"item\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Can patients with dementia be identified in primary care electronic medical records using natural language processing?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#website\",\"url\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/\",\"name\":\"ICES\",\"description\":\"POPULATION-BASED HEALTH RESEARCH THAT MAKES A DIFFERENCE\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#organization\"},\"alternateName\":\"Institute for Clinical Evaluative Sciences\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#organization\",\"name\":\"ICES\",\"alternateName\":\"Institute for Clinical Evaluative Sciences\",\"url\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.ices.on.ca\\\/wp-content\\\/uploads\\\/2023\\\/04\\\/ices-logo.png\",\"contentUrl\":\"https:\\\/\\\/www.ices.on.ca\\\/wp-content\\\/uploads\\\/2023\\\/04\\\/ices-logo.png\",\"width\":\"676\",\"height\":\"618\",\"caption\":\"ICES\"},\"image\":{\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/ICESOntario\\\/\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/ices-research-institute\\\/\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ICES | Can patients with dementia be identified in primary care electronic medical records using natural language processing?","description":"Dementia and mild cognitive impairment can be underrecognized in primary care practice and research. Free-text fields in electronic medical records (EMRs)","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\/","og_locale":"fr_FR","og_type":"article","og_title":"ICES | Can patients with dementia be identified in primary care electronic medical records using natural language processing?","og_description":"Dementia and mild cognitive impairment can be underrecognized in primary care practice and research. Free-text fields in electronic medical records (EMRs)","og_url":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\/","og_site_name":"ICES","article_publisher":"https:\/\/www.facebook.com\/ICESOntario\/","article_modified_time":"2023-11-22T20:07:00+00:00","og_image":[{"width":1200,"height":675,"url":"https:\/\/www.ices.on.ca\/wp-content\/uploads\/2024\/11\/ic-es-data-discovery-better-health-logo.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\/","url":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\/","name":"ICES | Can patients with dementia be identified in primary care electronic medical records using natural language processing?","isPartOf":{"@id":"https:\/\/www.ices.on.ca\/fr\/#website"},"datePublished":"2023-01-23T05:00:00+00:00","dateModified":"2023-11-22T20:07:00+00:00","description":"Dementia and mild cognitive impairment can be underrecognized in primary care practice and research. Free-text fields in electronic medical records (EMRs)","breadcrumb":{"@id":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/can-patients-with-dementia-be-identified-in-primary-care-electronic-medical-records-using-natural-language-processing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ices.on.ca\/fr\/"},{"@type":"ListItem","position":2,"name":"Journal Articles","item":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/"},{"@type":"ListItem","position":3,"name":"Can patients with dementia be identified in primary care electronic medical records using natural language processing?"}]},{"@type":"WebSite","@id":"https:\/\/www.ices.on.ca\/fr\/#website","url":"https:\/\/www.ices.on.ca\/fr\/","name":"ICES","description":"POPULATION-BASED HEALTH RESEARCH THAT MAKES A DIFFERENCE","publisher":{"@id":"https:\/\/www.ices.on.ca\/fr\/#organization"},"alternateName":"Institute for Clinical Evaluative Sciences","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ices.on.ca\/fr\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/www.ices.on.ca\/fr\/#organization","name":"ICES","alternateName":"Institute for Clinical Evaluative Sciences","url":"https:\/\/www.ices.on.ca\/fr\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/www.ices.on.ca\/fr\/#\/schema\/logo\/image\/","url":"https:\/\/www.ices.on.ca\/wp-content\/uploads\/2023\/04\/ices-logo.png","contentUrl":"https:\/\/www.ices.on.ca\/wp-content\/uploads\/2023\/04\/ices-logo.png","width":"676","height":"618","caption":"ICES"},"image":{"@id":"https:\/\/www.ices.on.ca\/fr\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/ICESOntario\/","https:\/\/www.linkedin.com\/company\/ices-research-institute\/"]}]}},"_links":{"self":[{"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/journal_article\/13165","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/journal_article"}],"about":[{"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/types\/journal_article"}],"acf:post":[{"embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/research_program\/6740"},{"embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/site\/6733"},{"embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/ices_scientist\/1283"},{"embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/ices_scientist\/1354"},{"embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/ices_scientist\/1372"},{"embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/ices_scientist\/1188"},{"embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/ices_scientist\/1159"}],"wp:attachment":[{"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/media?parent=13165"}],"wp:term":[{"taxonomy":"migration-helper-automated","embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/migration-helper-automated?post=13165"},{"taxonomy":"migration-manual","embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/migration-manual?post=13165"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/topic?post=13165"},{"taxonomy":"migration-helper-qa-sample-set","embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/migration-helper-qa-sample-set?post=13165"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}