Dataiku, the Universal AI Platform, today released survey findings that uncover a gap in businesses investments in Generative AI and the ability for senior IT professionals to operationalize investments at scale. Senior IT leaders will be bold with their Generative AI initiatives over the next 12 months, as nearly three quarters (73%) plan to spend more than $500,000 and around half (46%) will spend over $1 million. Findings also confirm IT stacks across organizations are not comparable to modern infrastructure standards to maximize effectiveness and manage runaway costs. 

Dataiku surveyed 200 senior analytics and IT leaders at enterprise companies across the globe in April 2024 to explore enablement against execution of Generative AI. Most agreed the proliferation of disconnected tools, lack of tech optionality, and outdated processes will intensify current challenges, such as data quality, governance, and risk management:

  • Nearly half of respondents (44%) indicated that their current data tools do not fit their analytics and AI needs, and 43% reported that their current data analytics stack does not meet modern infrastructure standards. Another 88% do not have specific tools or processes for managing LLMs. 
  • Over three quarters of IT leaders agree that to modernize their data stack it means adding AI capabilities, followed by tool consolidation (65%).
  • A majority of IT leaders (60%) said they use more than five tools to perform each step in the analytics process, from data ingestion to MLOps and LLMOps. Another 71% want five or less tools to reduce the burden of scaling projects with cobbled-together systems. 
  • Lack of governance and usage control can lead to compounding operational risk with a worrying portion of respondents (74%) still relying on spreadsheets for quick analyses, even as 62% have faced serious issues due to spreadsheet errors.
  • Data quality and usability remains the biggest data infrastructure challenge that IT leaders face (45%), even with the high number of tools in their data stack. Together with data access issues, which were cited by 27% of respondents, organizations still have not solved the data quality problem.  

“The reality is that Generative AI will continue to shift and evolve, with different technologies and providers coming and going. How can IT leaders get in the game while also staying agile to what’s next?,” said Conor Jensen, Field CDO of Dataiku “All eyes are on whether this challenge — in addition to spiraling costs and other risks — will eclipse the value production of Generative AI. Our survey reveals most data stacks are not built to meet these needs.”

Simplify Data Stack Complexities

The process to reshape the data and analytics stack within enterprises is a complex change that has compounded with the introduction of Generative AI. As a next step to extending its Unified AI Platform, Dataiku recently launched embedded, as-you-go data quality infrastructure to allow everyone within an organization the ability to more effectively operationalize data quality across the analytics and AI lifecycle. Together with the expansion of its LLM Mesh, with a Generative AI cost monitoring solution and a way to build tailored conversational AI chatbots, Dataiku continues to evolve the platform to enable AI transformation across organizations responsibly, and at scale. 

Dataiku was named a Leader in the Gartner® 2024 Magic Quadrant™ for Data Science and Machine Learning Platforms as well as in the IDC MarketScape: Worldwide AI Governance Platforms 2023 Vendor Assessment. 

  • Download the comprehensive report to understand the full scope of today’s operational IT challenges. 
  • Learn how you can leverage Dataiku, a single AI platform to maintain control over all data, analytics, and AI work to empower enterprise-wide transformation. 

Gartner does not endorse any vendor, product or service depicted in its research publications and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner’s research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. GARTNER is a registered trademark and service mark of Gartner and Magic Quadrant is a registered trademark of Gartner, Inc. and/or its affiliates in the U.S. and internationally and are used herein with permission. All rights reserved.

About Dataiku

Dataiku is the Universal AI Platform, uniting the technology, teams, and operations needed for companies to build intelligence into their daily operations, from modern analytics to Generative AI. Together, they design, develop and deploy new AI capabilities, at all scales and in all industries. Organizations that use Dataiku enable their people to be extraordinary, creating the AI that will power their company into the future. 

Founded in 2013, Dataiku has proven its ability to continue to develop its founding vision for Everyday AI, and to execute on its growth. 

Connect with Dataiku through their blog, Twitter/X, LinkedIn, and YouTube.

Alex Nickols
Dataiku
press@dataiku.com