How to make progress on managing unstructured data

We asked a veteran CIO and a leading analyst whether organizations today are getting results that matter from all their data, and the conversation was illuminating. 

Less than 20% of enterprise data is finding its way into applications that provide actionable insights for businesses, estimates guest Boris Evelson, vice president and principal analyst at Forrester. There are “a lot of opportunities for all of us,” he said. 

A recent study of technology leaders conducted by Forrester Consulting and commissioned by Elastic found that managing unstructured data was respondents’ top challenge that they are trying to address with search-powered technology today.

Evelson and Matthew Minetola, a CIO for 20+ years, now at Elastic, recommended three strategies to make progress in addressing this challenge. By applying search-powered technology to unify, visualize, and scale data, organizations can start to tap into that data opportunity.

Unify data

For 77% of survey respondents, information silos prevent using data to accelerate business growth. Organizations with structured data in data warehouses and unstructured data in data lakes may require different tools for analyzing and managing data. Search-powered technology can offer a unifying layer that brings structured and unstructured data together.

“As the CIO, your job is to be able to provide the information a business needs in order to make decisions,” Minetola said. “The ability to now see into that 80% of the data and now make decisions based off that…is significant.”

Unifying data can help accelerate digital transformation — an objective for which 84% of organizations say they rely on search-powered technology. When thinking about all the data sources an organization needs to grapple with as part of transformation, it makes sense. For instance, consider a bank with thousands of computer systems in over a hundred countries. “You need technologies that close silos,” Evelson said. “Whenever we talk about digital transformation, data and analytics platforms that unify everything that I just talked about, like search powered-technologies, are at the top of everyone's minds.”

Visualize and take action

Search-powered technology should bring two critical capabilities to the table: a visualization layer and machine learning. Visualization improves the ability to extract insights from large volumes of data. “It’s one thing to be able to have data,” Minetola said. “It’s another thing to understand it.” Furthermore, machine learning such as natural language processing or vector search can help join data sources to create more relevance and context. 

Together, these capabilities can help organizations be more adaptive and responsive in real-time, as opposed to pre-defining database queries up front and relying on historical views. Minetola describes the change as progressing from looking at data “in the rear view mirror to looking at it through the front windshield.”

“Without the ability to be able to link that data, to see that data, and understand it in real time and action it and be able to make insights and create relevance, I don’t know how in today’s world, let alone tomorrow’s world, a company is going to be able to survive,” Minetola said.

[Related article: Why observability can break through top challenges to digital transformation]

Scale with cloud

Cloud, as Minetola said, enables “the ability to scale up…and not worry about where a limit is” when it comes to storing and managing data. When asked which features are most important to the success of their next search-powered solution, 85% of respondents named high storage capacity and a cloud-based platform. 

McKinsey identifies the potential value of innovation driven by cloud computing at $770 billion, including faster product development and hyper-scalability. Imagine being able to see telemetry data on what people are doing on a website, and then tying that to product data, and then being able to see product utilization over time. By massively scaling with search-powered technology on cloud, there are ways to better understand patterns of behavior and apply those insights to product innovation.

[Related article: Customer trust relies on building IT systems that scale]

Aspiring to insights-driven business

Using search-powered technology to grasp the 80% of data just beyond our fingertips can help organizations be more insights-driven. Evelson explained that being an insights-driven business goes even further than being data-driven. 

A data-driven business transforms data into metrics and indicators. An insights-driven business makes decisions based on those indicators. For 83% of organizations, search-powered technology delivers important insights that improve the speed of decision making. From those decisions stem actions.

“And then, hopefully,” Evelson said, “those actions are affecting tangible business outcomes.”

Register to watch the full conversation on managing data and driving digital transformation with search-powered technology.