Organisations wrestling with staggering levels of unknown, unused ‘dark data’
Data quality has overtaken data security as the top driver of data governance initiatives, with 41% of those surveyed agreeing that their business decision-making relies fundamentally on trustworthy, quality data.
That’s according to a study undertaken by Quest Software, and the Enterprise Strategy Group (ESG), published in their 2022 State of Data Governance and Empowerment Report, which highlights the top challenges and innovations in data governance, data management and DataOps.
At the same time, however, 45% of IT leaders say that data quality is the biggest detractor from ROI in data governance efforts. While they recognise its importance, they’re struggling to improve the quality of their data, and thus the ability to strategically and maximally leverage data in practice.
“Business users at all technical levels have an edge when they have full visibility into, control over and confidence in their data,” said Patrick Nichols, CEO of Quest Software. “Trustworthy data and efficient data operations have never been more influential in determining the success or failure of business goals. When people lack access to high-quality data and the confidence and guidance to use it properly, it’s virtually impossible for them to reach their desired outcomes.”
The report also revealed that business leaders struggle not only to make sense of their data, but to locate it and use it in the first place, with 42% of survey respondents saying at least half of their data was “dark data” – retained by the organization, but unused, unmanageable and unfindable. An influx in dark data and a lack of data visibility often leads to downstream bottlenecks, impeding the accuracy and effectiveness of operational data.
“Businesses can’t utilize data, much less optimize it for the benefit of their organization, if they can’t actually see it,” said Nichols. “IT leaders must make data empowerment their first priority, enabling their organizations to leverage business intelligence, creating a single source of the truth to succeed in today’s data-driven world.”
While the challenges of data visibility and observability differ across industries, DataOps was overwhelmingly recognized as the primary solution to drive forward data empowerment. 9 in 10 people surveyed agreed that strengthening DataOps capabilities improves data quality, visibility and access issues across their businesses. The biggest opportunities to improve DataOps accuracy and efficiency lie in investing in automated technologies and deployment of time-saving tools, such as metadata management. Currently, only 37% of respondents describe their DataOps processes as automated, and a similarly small proportion report having automated data cataloging and mapping today (36% and 35% respectively).
“Today’s businesses are all but forced to be data-driven and evidence-based in their strategies, yet still face significant obstacles that prevent their people from being fully empowered to bring data to every decision,” said Mike Leone, senior analyst at Enterprise Strategy Group. “Organizations that invest in building a data-first culture – fueled by automation in DataOps processes, high-quality data, holistic governance, and enterprise-wide accessibility – to drive business success, will have the advantage.”
Download the full 2022 Quest State of Data Governance and Data Empowerment Report here.