{"id":1766,"date":"2022-11-11T00:00:00","date_gmt":"2022-11-11T05:00:00","guid":{"rendered":"https:\/\/icesontario.wpengine.com\/journal-articles\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\/"},"modified":"2023-11-30T14:12:32","modified_gmt":"2023-11-30T19:12:32","slug":"developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data","status":"publish","type":"journal_article","link":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\/","title":{"rendered":"Developing a reference standard for pertussis by applying a stratified sampling strategy to electronic medical record data"},"content":{"rendered":"<p><strong>Objective<\/strong> &#x2014; Pertussis surveillance remains essential in Canada, but ascertainment bias limits the accuracy of surveillance data. Introducing other sources to improve detection has highlighted the importance of validation. However, challenges arise due to low prevalence, and oversampling suspected cases can introduce partial verification bias. The aim of this study was to build a reference standard for pertussis validation studies that provides adequate analytic precision and minimizes bias.<\/p>\n<p><strong>Study Design and Setting<\/strong> &#x2014; We used a stratified strategy to sample the reference standard from a primary care electronic medical record cohort. We incorporated abstractor notes into definite, possible, ruled-out, and no mention of pertussis classifications which were based on surveillance case definitions.<\/p>\n<p><strong>Results<\/strong> &#x2014; We abstracted eight hundred records from the cohort of 404,922. There were 208 (26.0%) definite and 261 (32.6%) possible prevalent pertussis cases. Classifications demonstrated a wide variety of case severities. Abstraction reliability was moderate to substantial based on Cohen&apos;s kappa and raw percent agreement.<\/p>\n<p><strong>Conclusion<\/strong> &#x2014; When conducting validation studies for pertussis and other low prevalence diseases, this stratified sampling strategy can be used to develop a reference standard using limited resources. This approach mitigates verification and spectrum bias while providing sufficient precision and incorporating a range of case severities.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Objective &#x2014; Pertussis surveillance remains essential in Canada, but ascertainment bias limits the accuracy of surveillance data. Introducing other sources to improve detection has highlighted the importance of validation. However, challenges arise due to low prevalence, and oversampling suspected cases can introduce partial verification bias. The aim of this study was to build a reference [&hellip;]<\/p>\n","protected":false},"template":"","migration-helper-automated":[],"migration-manual":[],"topic":[],"migration-helper-qa-sample-set":[],"class_list":["post-1766","journal_article","type-journal_article","status-publish","hentry"],"acf":{"citation":"McBurney SH, Kwong JC, Brown KA, Rudzicz F, Chen B, Candido E, Crowcroft NS. <em>Ann Epidemiol<\/em>. 2023; 77:53-60. Epub 2022 Nov 11.","source_url":"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S1047279722002794","ices_scientist":[1149,1181,1188],"site":[6735],"research_program":"","news_release":"","journal_article":"","atlas":"","research_report":"","infographic":"","video":"","downloads":null,"links":null,"sitecore_item_id":"AA48D476-08AE-4DC0-934B-158A7F64DD12","sitecore_item_name":"Developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy","sitecore_field_values":"{\n  \"Title\": \"Developing a reference standard for pertussis by applying a stratified sampling strategy to electronic medical record data\",\n  \"Short title\": \"Developing a reference standard for\",\n  \"Summary\": \"The aim of this study was to build a reference standard for pertussis validation studies that provides adequate analytic precision and minimizes bias.\",\n  \"Citation\": \"<p>McBurney SH, Kwong JC, Brown KA, Rudzicz F, Chen B, Candido E, Crowcroft NS. <em>Ann Epidemiol<\/em>. 2022; Nov 11 [Epub ahead of print]. DOI: <a href=\"https:\/\/doi.org\/10.1016\/j.annepidem.2022.11.002\" title=\"opens external link\">https:\/\/doi.org\/10.1016\/j.annepidem.2022.11.002<\/a><\/p>\",\n  \"Abstract\": \"<p><strong>Objective<\/strong> &mdash; Pertussis surveillance remains essential in Canada, but ascertainment bias limits the accuracy of surveillance data. Introducing other sources to improve detection has highlighted the importance of validation. However, challenges arise due to low prevalence, and oversampling suspected cases can introduce partial verification bias. The aim of this study was to build a reference standard for pertussis validation studies that provides adequate analytic precision and minimizes bias.<\/p>n<p><span class=\"bold\">Study Design and Setting<\/span> &mdash; We used a stratified strategy to sample the reference standard from a primary care electronic medical record cohort. We incorporated abstractor notes into definite, possible, ruled-out, and no mention of pertussis classifications which were based on surveillance case definitions.<\/p>n<p><strong>Results<\/strong> &mdash; We abstracted eight hundred records from the cohort of 404,922. There were 208 (26.0%) definite and 261 (32.6%) possible prevalent pertussis cases. Classifications demonstrated a wide variety of case severities. Abstraction reliability was moderate to substantial based on Cohen's kappa and raw percent agreement.<\/p>n<p><strong>Conclusion<\/strong> &mdash; When conducting validation studies for pertussis and other low prevalence diseases, this stratified sampling strategy can be used to develop a reference standard using limited resources. This approach mitigates verification and spectrum bias while providing sufficient precision and incorporating a range of case severities.<\/p>n<p><a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S1047279722002794\" title=\"opens external link\">View full text<\/a><\/p>\",\n  \"Research Programs\": \"{5B1AF319-EC9B-4BF0-A9CD-D066ABE49D71}\",\n  \"ICES Locations\": \"{FBE2D1B1-C0BA-423F-8D16-39466B6C1424}\",\n  \"ICES Scientists\": \"{14489280-87E2-4E37-BCF5-35BDF557014F}|{49600D34-E937-4577-AEE0-21FD95500AA4}|{8450FA48-5F0D-48C7-91C5-4BCB0CC0CE1A}|{7325515F-322B-448F-B845-746353A3DD14}\",\n  \"Posted Date\": \"20221111T000000\",\n  \"Show on Publications Landing Page\": \"1\"\n}","previous_url":"https:\/\/www.ices.on.ca\/Publications\/Journal-Articles\/2022\/November\/Developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy"},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>ICES | Developing a reference standard for pertussis by applying a stratified sampling strategy to electronic medical record data<\/title>\n<meta name=\"description\" content=\"Objective &#x2014; Pertussis surveillance remains essential in Canada, but ascertainment bias limits the accuracy of surveillance data. Introducing other\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\/\" \/>\n<meta property=\"og:locale\" content=\"fr_FR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ICES | Developing a reference standard for pertussis by applying a stratified sampling strategy to electronic medical record data\" \/>\n<meta property=\"og:description\" content=\"Objective &#x2014; Pertussis surveillance remains essential in Canada, but ascertainment bias limits the accuracy of surveillance data. Introducing other\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\/\" \/>\n<meta property=\"og:site_name\" content=\"ICES\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ICESOntario\/\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-30T19:12:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.ices.on.ca\/wp-content\/uploads\/2024\/11\/ic-es-data-discovery-better-health-logo.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"675\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\\\/\",\"url\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\\\/\",\"name\":\"ICES | Developing a reference standard for pertussis by applying a stratified sampling strategy to electronic medical record data\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#website\"},\"datePublished\":\"2022-11-11T05:00:00+00:00\",\"dateModified\":\"2023-11-30T19:12:32+00:00\",\"description\":\"Objective &#x2014; Pertussis surveillance remains essential in Canada, but ascertainment bias limits the accuracy of surveillance data. Introducing other\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\\\/#breadcrumb\"},\"inLanguage\":\"fr-FR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Journal Articles\",\"item\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/publications\\\/journal-articles\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Developing a reference standard for pertussis by applying a stratified sampling strategy to electronic medical record data\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#website\",\"url\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/\",\"name\":\"ICES\",\"description\":\"POPULATION-BASED HEALTH RESEARCH THAT MAKES A DIFFERENCE\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#organization\"},\"alternateName\":\"Institute for Clinical Evaluative Sciences\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-FR\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#organization\",\"name\":\"ICES\",\"alternateName\":\"Institute for Clinical Evaluative Sciences\",\"url\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-FR\",\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.ices.on.ca\\\/wp-content\\\/uploads\\\/2023\\\/04\\\/ices-logo.png\",\"contentUrl\":\"https:\\\/\\\/www.ices.on.ca\\\/wp-content\\\/uploads\\\/2023\\\/04\\\/ices-logo.png\",\"width\":\"676\",\"height\":\"618\",\"caption\":\"ICES\"},\"image\":{\"@id\":\"https:\\\/\\\/www.ices.on.ca\\\/fr\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/ICESOntario\\\/\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/ices-research-institute\\\/\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ICES | Developing a reference standard for pertussis by applying a stratified sampling strategy to electronic medical record data","description":"Objective &#x2014; Pertussis surveillance remains essential in Canada, but ascertainment bias limits the accuracy of surveillance data. Introducing other","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\/","og_locale":"fr_FR","og_type":"article","og_title":"ICES | Developing a reference standard for pertussis by applying a stratified sampling strategy to electronic medical record data","og_description":"Objective &#x2014; Pertussis surveillance remains essential in Canada, but ascertainment bias limits the accuracy of surveillance data. Introducing other","og_url":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\/","og_site_name":"ICES","article_publisher":"https:\/\/www.facebook.com\/ICESOntario\/","article_modified_time":"2023-11-30T19:12:32+00:00","og_image":[{"width":1200,"height":675,"url":"https:\/\/www.ices.on.ca\/wp-content\/uploads\/2024\/11\/ic-es-data-discovery-better-health-logo.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\/","url":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\/","name":"ICES | Developing a reference standard for pertussis by applying a stratified sampling strategy to electronic medical record data","isPartOf":{"@id":"https:\/\/www.ices.on.ca\/fr\/#website"},"datePublished":"2022-11-11T05:00:00+00:00","dateModified":"2023-11-30T19:12:32+00:00","description":"Objective &#x2014; Pertussis surveillance remains essential in Canada, but ascertainment bias limits the accuracy of surveillance data. Introducing other","breadcrumb":{"@id":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\/#breadcrumb"},"inLanguage":"fr-FR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/developing-a-reference-standard-for-pertussis-by-applying-a-stratified-sampling-strategy-to-electronic-medical-record-data\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ices.on.ca\/fr\/"},{"@type":"ListItem","position":2,"name":"Journal Articles","item":"https:\/\/www.ices.on.ca\/fr\/publications\/journal-articles\/"},{"@type":"ListItem","position":3,"name":"Developing a reference standard for pertussis by applying a stratified sampling strategy to electronic medical record data"}]},{"@type":"WebSite","@id":"https:\/\/www.ices.on.ca\/fr\/#website","url":"https:\/\/www.ices.on.ca\/fr\/","name":"ICES","description":"POPULATION-BASED HEALTH RESEARCH THAT MAKES A DIFFERENCE","publisher":{"@id":"https:\/\/www.ices.on.ca\/fr\/#organization"},"alternateName":"Institute for Clinical Evaluative Sciences","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ices.on.ca\/fr\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-FR"},{"@type":"Organization","@id":"https:\/\/www.ices.on.ca\/fr\/#organization","name":"ICES","alternateName":"Institute for Clinical Evaluative Sciences","url":"https:\/\/www.ices.on.ca\/fr\/","logo":{"@type":"ImageObject","inLanguage":"fr-FR","@id":"https:\/\/www.ices.on.ca\/fr\/#\/schema\/logo\/image\/","url":"https:\/\/www.ices.on.ca\/wp-content\/uploads\/2023\/04\/ices-logo.png","contentUrl":"https:\/\/www.ices.on.ca\/wp-content\/uploads\/2023\/04\/ices-logo.png","width":"676","height":"618","caption":"ICES"},"image":{"@id":"https:\/\/www.ices.on.ca\/fr\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/ICESOntario\/","https:\/\/www.linkedin.com\/company\/ices-research-institute\/"]}]}},"_links":{"self":[{"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/journal_article\/1766","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/journal_article"}],"about":[{"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/types\/journal_article"}],"acf:post":[{"embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/site\/6735"},{"embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/ices_scientist\/1188"},{"embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/ices_scientist\/1181"},{"embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/ices_scientist\/1149"}],"wp:attachment":[{"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/media?parent=1766"}],"wp:term":[{"taxonomy":"migration-helper-automated","embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/migration-helper-automated?post=1766"},{"taxonomy":"migration-manual","embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/migration-manual?post=1766"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/topic?post=1766"},{"taxonomy":"migration-helper-qa-sample-set","embeddable":true,"href":"https:\/\/www.ices.on.ca\/fr\/wp-json\/wp\/v2\/migration-helper-qa-sample-set?post=1766"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}