{"id":10311,"date":"2012-04-18T05:31:07","date_gmt":"2012-04-18T05:31:07","guid":{"rendered":"https:\/\/www.subex.com\/blog\/?p=166"},"modified":"2012-04-18T05:31:07","modified_gmt":"2012-04-18T05:31:07","slug":"data-discrepancies-dont-matter","status":"publish","type":"post","link":"https:\/\/dev.enki.studio\/test\/?p=10311","title":{"rendered":"Data Discrepancies Don&#8217;t Matter"},"content":{"rendered":"<p style=\"text-align: justify;\">Now, referring to the title, you may be thinking: That\u2019s a rather cheeky thing to say given the high direct and indirect costs of errant data incurred by virtually all operators.\u00a0\u00a0 You might cite the significant Opex penalty related to reworking designs and to service activation fallout.\u00a0\u00a0 I get that.\u00a0 What about the millions of USD in stranded Capex most operators have in their networks?\u00a0 Check.\u00a0 My personal favorite comes from Larry English, a leading expert on information quality, who has <a href=\"https:\/\/www.b-eye-network.com\/view\/4423\">ranked poor quality information<\/a> as the second biggest threat to mankind after global warming.\u00a0 And here I was worried about a looming global economic collapse!<\/p>\n<p style=\"text-align: justify;\">My point is actually that the discrepancies <em>themselves<\/em> have no business value.\u00a0\u00a0 They are simply an indicator of things gone bad.\u00a0 The canary in the coal mine.\u00a0\u00a0\u00a0 These \u201cthings\u201d are likely some combination of people, processes and system transactions, of course.\u00a0 Yet many operators make finding and reporting discrepancies the primary focus of their data quality efforts.\u00a0 Let\u2019s face it, anyone with modest Excel skills can bash two data sets together with MATCH and VLOOKUP functions\u00a0 and bask in the glow of everything that doesn\u2019t line up.\u00a0 Sound familiar?<\/p>\n<p style=\"text-align: justify;\">For context, I am mostly referring to mismatches between the network and how the network is represented in back-office systems like Inventory\u2014but the observations I will share can be applied to other domains.\u00a0 \u00a0Data anomalies, for example, are all too common when attempting to align subscriber orders and billing records in the Revenue Assurance domain.<\/p>\n<p style=\"text-align: justify;\">Too often, Data Integrity Management (DIM) programs start with gusto and end with a fizzle, placed on a shelf so that shinier (and easier!) objects can be chased.\u00a0 Why is this?\u00a0 Understanding that I am now on the spot to answer my own rhetorical question, let me give it a go.<\/p>\n<ul style=\"text-align: justify;\">\n<li><strong><em>The scourge of false positives:<\/em><\/strong> There are few things as frustrating as chasing one\u2019s tail.\u00a0 Yet that is the feeling when you find that a high percentage of your \u201cdiscrepancies\u201d are not material discrepancies (i.e. an object in the Network but not in Inventory) but simply mismatches in naming conventions.\u00a0\u00a0 A DIM solution must profile and normalize the data that are compared so as not to spew out a lot of noise.<\/li>\n<\/ul>\n<ul style=\"text-align: justify;\">\n<li>\u00a0<strong><em>The allure of objects in the mirror that are closer than they appear:<\/em><\/strong>\u00a0 OK, not sure this aphorism works but I trust you to hang with me.\u00a0\u00a0 I am referring to misplaced priorities\u2014 paying attention to one (closer, easier) set of discrepancies while ignoring another set that might yield a bigger business impact once corrected.\u00a0\u00a0\u00a0 Data quality issues must be prioritized, with priorities established based upon clear and measurable KPI targets.\u00a0 If you wish to move the needle on service activation fallout rates, for example, you need to understand the underlying root causes and be deliberate about going after those for correction.\u00a0 Clearly, you should not place as much value on finding \u2018stranded\u201d common equipment cards as on recovering high-value optics that can be provisioned for new services.<\/li>\n<\/ul>\n<ul>\n<li><strong><em>The tyranny of haphazard correction:<\/em><\/strong> I\u2019m alluding here to the process and discipline of DIM.\u00a0 Filtered and prioritized discrepancies should be wrapped with workflow and case management in a repeatable and efficient manner.\u00a0 The goals are to reduce the cost and time related to correction of data quality issues.\u00a0 If data cleanse activities are unstructured and not monitored by rigorous reporting, the business targets for your DIM program are unlikely to be met.<\/li>\n<\/ul>\n<ul>\n<li><strong><em>The failure to toot one\u2019s own horn:<\/em><\/strong> Let\u2019s say that your data integrity efforts have met with some success.\u00a0 Do you have precise measurements of that success?\u00a0 What is the value of recovered assets?\u00a0 How many hours have been saved in reduced truck rolls related to on-demand audits?\u00a0 Have order cycle times improved?\u00a0 By how much?\u00a0\u00a0 Ideally, can you show how your DIM program has improved metrics that appear on the enterprise scorecard? \u00a0\u00a0It is critical that the business stakeholders and the executive team have visibility to the value returned by the DIM program.\u00a0 Not only does this enable continued funding but it could set the stage for \u201cself-funding\u201d using a portion of the cost savings.<\/li>\n<\/ul>\n<ul>\n<li><strong><em>The bane of \u201cone and done\u201d:<\/em><\/strong>\u00a0 For a DIM program to succeed in the long run, I suggest drawing from forensic science and tracing bad data to underlying pathologies\u2026 i.e. people, process and\/or system breakdowns.\u00a0\u00a0 A formal data governance program that harnesses analytics to spotlight these breakdowns and foster preventive measures is highly recommended. The true power of DIM is in prevention of future data issues so that the current efforts to cleanse data will not simply be erased by the passage of time.<\/li>\n<\/ul>\n<p style=\"text-align: justify;\">Identifying data discrepancies is a good first step.\u00a0 Correcting and preventing them is even better.\u00a0\u00a0\u00a0 Institutionalizing DIM via continuously measuring and reporting your successes\u2026 well, you get the idea.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Now, referring to the title, you may be thinking: That\u2019s a rather cheeky thing to say given the high direct and indirect costs of errant data incurred by virtually all operators.\u00a0\u00a0 You might cite the significant Opex penalty related to reworking designs and to service activation fallout.\u00a0\u00a0 I get that.\u00a0 What about the millions of [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":15093,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"categories":[5],"tags":[43,44,6,45],"class_list":["post-10311","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-general","tag-bss","tag-data-integrity","tag-network","tag-oss"],"acf":[],"_links":{"self":[{"href":"https:\/\/dev.enki.studio\/test\/index.php?rest_route=\/wp\/v2\/posts\/10311","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dev.enki.studio\/test\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dev.enki.studio\/test\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dev.enki.studio\/test\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dev.enki.studio\/test\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=10311"}],"version-history":[{"count":0,"href":"https:\/\/dev.enki.studio\/test\/index.php?rest_route=\/wp\/v2\/posts\/10311\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dev.enki.studio\/test\/index.php?rest_route=\/wp\/v2\/media\/15093"}],"wp:attachment":[{"href":"https:\/\/dev.enki.studio\/test\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=10311"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dev.enki.studio\/test\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=10311"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dev.enki.studio\/test\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=10311"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}