{"id":88,"date":"2024-06-11T10:39:19","date_gmt":"2024-06-11T14:39:19","guid":{"rendered":"https:\/\/ag.purdue.edu\/ads\/?p=88"},"modified":"2025-05-19T10:50:08","modified_gmt":"2025-05-19T14:50:08","slug":"precision-dairy-group","status":"publish","type":"post","link":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/","title":{"rendered":"Enhancing data quality and usability"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/ag.purdue.edu\/department\/ansc\/directory.html#\/jboerma\" data-type=\"link\" data-id=\"https:\/\/ag.purdue.edu\/department\/ansc\/directory.html#\/jboerma\">Dr. Jackie Boerman<\/a> and <a href=\"https:\/\/ag.purdue.edu\/department\/ansc\/directory.html#\/britol\" data-type=\"link\" data-id=\"https:\/\/ag.purdue.edu\/department\/ansc\/directory.html#\/britol\">Dr. Luiz Britol<\/a> wanted to analyze data produced at dairy farms. Dairy producers are utilizing multiple software programs and sensors on their farms to assist with the management of their farms. A challenge to fully utilizing the data generated on dairy farms is the lack of data interoperability across data sources, which results in challenges associated with integrating data.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Along with our IT partners, we have developed a research data ecosystem that allows Dr. Boerman, Dr. Luiz, and their graduate students to analyze messy and dissimilar data in a custom-curated environment. Working with this much data on individual computers would not be as effective or, in some cases, even possible.<\/p>\n\n\n<div  class=\"section has-padding-top-none has-padding-bottom-none  page-layout-wide\">\n    <div class=\"container\">\n                <div class=\"tagged-header-container tagged-header-container--content-block tagged-header-container-gold\">\n            <h2 class=\"tagged-header tagged-header--gold\">Challenges we faced<\/h2>\n        <\/div>\n                \n\n<div class=\"wp-block-columns py-0 my-0 is-layout-flex wp-container-core-columns-is-layout-8f761849 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column py-0 my-0 is-layout-flow wp-block-column-is-layout-flow\">\n<ul class=\"wp-block-list\">\n<li>On-farm data that needed to be brought to Purdue<\/li>\n\n\n\n<li>Poor internet connectivity<\/li>\n\n\n\n<li>Lack of common data structure<\/li>\n\n\n\n<li>Inconsistent data quality<\/li>\n\n\n\n<li>Diverse data sets\n<ul class=\"wp-block-list\">\n<li>Parlor management<\/li>\n\n\n\n<li>Farm management<\/li>\n\n\n\n<li>Genetic data<\/li>\n\n\n\n<li>Weather<\/li>\n\n\n\n<li>Feed management<\/li>\n\n\n\n<li>Environmental sensors<\/li>\n\n\n\n<li>Automated milking robots<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/div>\n<\/div>\n\n    <\/div>\n<\/div>\n\n<div  class=\"section has-padding-top-none has-padding-bottom-none has-border-bottom  page-layout-wide\">\n    <div class=\"container\">\n                <div class=\"tagged-header-container tagged-header-container--content-block tagged-header-container-gold\">\n            <h2 class=\"tagged-header tagged-header--gold\">Some of the methods and processes implemented<\/h2>\n        <\/div>\n                \n\n<div class=\"wp-block-columns page-layout-columns columns is-multiline is-layout-flex wp-container-core-columns-is-layout-8f761849 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column column is-full-tablet page-layout-main is-layout-flow wp-block-column-is-layout-flow\">\n<ul class=\"wp-block-list\">\n<li>Automated data retrieval<\/li>\n\n\n\n<li>Automated quality control<\/li>\n\n\n\n<li>Automated data cleaning and transformation<\/li>\n\n\n\n<li>Data conversion<\/li>\n\n\n\n<li>Process documentation<\/li>\n\n\n\n<li>Data description (metadata generation)<\/li>\n\n\n\n<li>Storage optimization<\/li>\n<\/ul>\n<\/div>\n<\/div>\n\n    <\/div>\n<\/div>","protected":false},"excerpt":{"rendered":"<p>Dr. Jackie Boerman and Dr. Luiz Britol wanted to analyze data produced at dairy farms. Dairy producers are utilizing multiple software programs and sensors on their farms to assist with the management of their farms. A challenge to fully utilizing<\/p>\n","protected":false},"author":1,"featured_media":89,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[13,12,14],"tags":[18,19,20],"class_list":["post-88","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-assist","category-augment","category-maximize","tag-data-quality","tag-data-stewardship","tag-process-automation"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.7 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Enhancing data quality and usability - Research Services<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Enhancing data quality and usability - Research Services\" \/>\n<meta property=\"og:description\" content=\"Dr. Jackie Boerman and Dr. Luiz Britol wanted to analyze data produced at dairy farms. Dairy producers are utilizing multiple software programs and sensors on their farms to assist with the management of their farms. A challenge to fully utilizing\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/\" \/>\n<meta property=\"og:site_name\" content=\"Research Services\" \/>\n<meta property=\"article:published_time\" content=\"2024-06-11T14:39:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-19T14:50:08+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/ag.purdue.edu\/researchservices\/wp-content\/uploads\/2024\/06\/rde-flow-2.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"719\" \/>\n\t<meta property=\"og:image:height\" content=\"454\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Kirby Kalbaugh\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kirby Kalbaugh\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/\"},\"author\":{\"name\":\"Kirby Kalbaugh\",\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/#\\\/schema\\\/person\\\/d2873a13f228802a710dc15275f3a34e\"},\"headline\":\"Enhancing data quality and usability\",\"datePublished\":\"2024-06-11T14:39:19+00:00\",\"dateModified\":\"2025-05-19T14:50:08+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/\"},\"wordCount\":177,\"publisher\":{\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/wp-content\\\/uploads\\\/2024\\\/06\\\/rde-flow-2.jpg\",\"keywords\":[\"Data Quality\",\"Data Stewardship\",\"Process Automation\"],\"articleSection\":[\"Assist\",\"Augment\",\"Maximize\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/\",\"url\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/\",\"name\":\"Enhancing data quality and usability - Research Services\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/wp-content\\\/uploads\\\/2024\\\/06\\\/rde-flow-2.jpg\",\"datePublished\":\"2024-06-11T14:39:19+00:00\",\"dateModified\":\"2025-05-19T14:50:08+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/#primaryimage\",\"url\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/wp-content\\\/uploads\\\/2024\\\/06\\\/rde-flow-2.jpg\",\"contentUrl\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/wp-content\\\/uploads\\\/2024\\\/06\\\/rde-flow-2.jpg\",\"width\":719,\"height\":454},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/precision-dairy-group\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Enhancing data quality and usability\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/#website\",\"url\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/\",\"name\":\"Research Services\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/#organization\",\"name\":\"Research Services\",\"url\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/wp-content\\\/uploads\\\/2024\\\/12\\\/cropped-ARGE_H-Full-RGB_1.png\",\"contentUrl\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/wp-content\\\/uploads\\\/2024\\\/12\\\/cropped-ARGE_H-Full-RGB_1.png\",\"width\":834,\"height\":100,\"caption\":\"Research Services\"},\"image\":{\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/#\\\/schema\\\/person\\\/d2873a13f228802a710dc15275f3a34e\",\"name\":\"Kirby Kalbaugh\",\"sameAs\":[\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\"],\"url\":\"https:\\\/\\\/ag.purdue.edu\\\/researchservices\\\/author\\\/kkalbaug\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Enhancing data quality and usability - Research Services","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/","og_locale":"en_US","og_type":"article","og_title":"Enhancing data quality and usability - Research Services","og_description":"Dr. Jackie Boerman and Dr. Luiz Britol wanted to analyze data produced at dairy farms. Dairy producers are utilizing multiple software programs and sensors on their farms to assist with the management of their farms. A challenge to fully utilizing","og_url":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/","og_site_name":"Research Services","article_published_time":"2024-06-11T14:39:19+00:00","article_modified_time":"2025-05-19T14:50:08+00:00","og_image":[{"width":719,"height":454,"url":"https:\/\/ag.purdue.edu\/researchservices\/wp-content\/uploads\/2024\/06\/rde-flow-2.jpg","type":"image\/jpeg"}],"author":"Kirby Kalbaugh","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Kirby Kalbaugh","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/#article","isPartOf":{"@id":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/"},"author":{"name":"Kirby Kalbaugh","@id":"https:\/\/ag.purdue.edu\/researchservices\/#\/schema\/person\/d2873a13f228802a710dc15275f3a34e"},"headline":"Enhancing data quality and usability","datePublished":"2024-06-11T14:39:19+00:00","dateModified":"2025-05-19T14:50:08+00:00","mainEntityOfPage":{"@id":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/"},"wordCount":177,"publisher":{"@id":"https:\/\/ag.purdue.edu\/researchservices\/#organization"},"image":{"@id":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/#primaryimage"},"thumbnailUrl":"https:\/\/ag.purdue.edu\/researchservices\/wp-content\/uploads\/2024\/06\/rde-flow-2.jpg","keywords":["Data Quality","Data Stewardship","Process Automation"],"articleSection":["Assist","Augment","Maximize"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/","url":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/","name":"Enhancing data quality and usability - Research Services","isPartOf":{"@id":"https:\/\/ag.purdue.edu\/researchservices\/#website"},"primaryImageOfPage":{"@id":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/#primaryimage"},"image":{"@id":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/#primaryimage"},"thumbnailUrl":"https:\/\/ag.purdue.edu\/researchservices\/wp-content\/uploads\/2024\/06\/rde-flow-2.jpg","datePublished":"2024-06-11T14:39:19+00:00","dateModified":"2025-05-19T14:50:08+00:00","breadcrumb":{"@id":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/#primaryimage","url":"https:\/\/ag.purdue.edu\/researchservices\/wp-content\/uploads\/2024\/06\/rde-flow-2.jpg","contentUrl":"https:\/\/ag.purdue.edu\/researchservices\/wp-content\/uploads\/2024\/06\/rde-flow-2.jpg","width":719,"height":454},{"@type":"BreadcrumbList","@id":"https:\/\/ag.purdue.edu\/researchservices\/precision-dairy-group\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ag.purdue.edu\/researchservices\/"},{"@type":"ListItem","position":2,"name":"Enhancing data quality and usability"}]},{"@type":"WebSite","@id":"https:\/\/ag.purdue.edu\/researchservices\/#website","url":"https:\/\/ag.purdue.edu\/researchservices\/","name":"Research Services","description":"","publisher":{"@id":"https:\/\/ag.purdue.edu\/researchservices\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ag.purdue.edu\/researchservices\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/ag.purdue.edu\/researchservices\/#organization","name":"Research Services","url":"https:\/\/ag.purdue.edu\/researchservices\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/ag.purdue.edu\/researchservices\/#\/schema\/logo\/image\/","url":"https:\/\/ag.purdue.edu\/researchservices\/wp-content\/uploads\/2024\/12\/cropped-ARGE_H-Full-RGB_1.png","contentUrl":"https:\/\/ag.purdue.edu\/researchservices\/wp-content\/uploads\/2024\/12\/cropped-ARGE_H-Full-RGB_1.png","width":834,"height":100,"caption":"Research Services"},"image":{"@id":"https:\/\/ag.purdue.edu\/researchservices\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ag.purdue.edu\/researchservices\/#\/schema\/person\/d2873a13f228802a710dc15275f3a34e","name":"Kirby Kalbaugh","sameAs":["https:\/\/ag.purdue.edu\/researchservices"],"url":"https:\/\/ag.purdue.edu\/researchservices\/author\/kkalbaug\/"}]}},"_links":{"self":[{"href":"https:\/\/ag.purdue.edu\/researchservices\/wp-json\/wp\/v2\/posts\/88","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ag.purdue.edu\/researchservices\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ag.purdue.edu\/researchservices\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ag.purdue.edu\/researchservices\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ag.purdue.edu\/researchservices\/wp-json\/wp\/v2\/comments?post=88"}],"version-history":[{"count":14,"href":"https:\/\/ag.purdue.edu\/researchservices\/wp-json\/wp\/v2\/posts\/88\/revisions"}],"predecessor-version":[{"id":907,"href":"https:\/\/ag.purdue.edu\/researchservices\/wp-json\/wp\/v2\/posts\/88\/revisions\/907"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ag.purdue.edu\/researchservices\/wp-json\/wp\/v2\/media\/89"}],"wp:attachment":[{"href":"https:\/\/ag.purdue.edu\/researchservices\/wp-json\/wp\/v2\/media?parent=88"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ag.purdue.edu\/researchservices\/wp-json\/wp\/v2\/categories?post=88"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ag.purdue.edu\/researchservices\/wp-json\/wp\/v2\/tags?post=88"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}