Confluent survey: 45% of EMEA respondents say data streaming platforms have led to more product and service innovation in AI and ML development
Confluent unveiled its 2024 Data Streaming Report: Breaking Down the Barriers to Business Agility & Innovation. The report dives into how organizations use data streaming to innovate, accelerate AI adoption, improve business agility, power customer experiences, and overcome data accessibility and management challenges. Based on a survey of 4,110 IT leaders across 12 countries, including the UAE, the report shows the pivotal role data streaming plays in helping businesses maximize the full potential of their data.
Responsiveness is the key to success in today’s dynamic business landscape – slow, inconsistent, outdated, or ungoverned data is detrimental to success because it’s unreliable and can lead to bad decision-making. It’s imperative to leverage continuously streaming data to discover customer learnings, improve business operations, and find insights so organizations can act efficiently and quickly. In fact, 82% of EMEA respondents cite data streaming as a strategic or important priority in IT investments this year.
“Many organizations have data siloed away in different systems and applications, making it impossible to find and benefit from one of their most critical business assets – their data,” said Shaun Clowes, Chief Product Officer at Confluent. “Data streaming acts as the central nervous system for businesses by connecting systems and applications so real-time data can be easily accessed for decision making and improving business processes and customer experiences.”
Key takeaways for the EMEA region from the report include:
Data Streaming Platforms Power Faster AI Adoption
GenAI is top of mind for many companies, but for AI models to generate accurate and relevant results, the data must be trustworthy, in the right format, and as real-time as possible. Retrieval augmented generation (RAG) has emerged as a common pattern for building GenAI-enabled applications by connecting general-purpose LLM models to domain-specific data while allowing granular access controls and minimizing hallucinations. Data streaming enriches RAG-enabled workloads with trustworthy and contextual data by tapping into a continuous stream of real-time data from systems that power the business. Data streaming efficiently transforms data into the right format to be used by vector databases for AI applications.
- 68% state investments in GenAI will trend up in the coming two years.
- 59% cite data streaming platforms extensively or significantly fuel AI progress by building the real-time data foundation needed to propel these initiatives.
- 91% note data streaming platforms keep track of data fed into models for governance purposes.
Data Streaming Simplifies the Development of Data Products and Encourages Reusability and Cost Savings
As organizations look to broaden and simplify data access and reusability, more are thinking about organizing their data into data products. Data products are live, refined, fully governed, and ready-to-use data assets that are instantly discoverable, contextualized, trustworthy, and reusable for many use cases. Data products allow organizations to reuse data across a variety of use cases to save costs and time.
- 91% of IT leaders are investing in data streaming platforms to drive their data goals, which include data product creation.
- 72% cite significant benefits from embracing a data product approach.
- Notable benefits of data products are:
- 97% cite data products as compelling or worthwhile in enabling more confident data sharing across business units.
- 89% note more meaningful cost allocation or charging based on usage metrics.
- 89% state more robust risk management.
Data Streaming Platforms Prevent Data Silos and Solve Data Accessibility Challenges
Tackling data access and management challenges head-on is crucial for businesses to maximize success in a data-driven world. The 2024 Data Streaming Report shows that data streaming platforms help organizations address many data accessibility challenges, including uncovering siloed data, that hinder real-time, data-driven operations. As the central nervous system for businesses, data streaming platforms connect applications and systems to ensure data is available in real-time, everywhere it’s needed. This allows companies to focus on accelerating innovation instead of navigating the maze of point-to-point connections.
- 79% of EMEA IT leaders cite three or more data-related challenges impacting their organizations, including siloed data and governance-related problems.
- The most common problems data streaming can solve include:
- 92% say data streaming helps break down data silos
- 85% note data streaming helps to access existing data
- 84% cite data streaming helps discover existing data
- 82% state data streaming helps address governance-related problems
Data Streaming Delivers Significant Benefits for Business Investments
As businesses learn to do more with less, proving the ROI of tech investments has become even more critical. This report shows that data streaming pays off across every industry and that organizations of all sizes are achieving value, despite limited resources.
- 77% of EMEA IT leaders cite 2x to 10x return on data streaming investments.
- 61% stated that data streaming improved cybersecurity and data-driven operations.
- 45% enabled product and service innovation when using AI/ML.
