AI Solution Speeds GPT and LLMs Adoption, Maintains Data Control
Nutanix Introduces GPT-in-a-Box for Fast AI and ML Innovation. The new offering includes a full-stack software-defined AI platform, aiding in hardware and software setup for deploying large language models using open source AI frameworks on Nutanix Cloud Platform. Customers can conveniently acquire AI-ready infrastructure to optimize and operate generative pre-trained transformers (GPT), including at the edge or in their datacenter.
Many enterprises are grappling with how to quickly, efficiently and securely take advantage of the power of generative AI and AI/ML applications, especially for use cases that cannot be run in the public cloud because of data sovereignty, governance and privacy concerns. New use cases emerge every day as organizations look to leverage generative AI to improve customer service, developer productivity, operational efficiency and more. From automated transcription of internal documents, to high-speed search of multimedia contents, and automated analysis, many organizations see the opportunity with AI but are struggling with growing concerns regarding intellectual property leakage, compliance and privacy. Additionally, organizations looking to build an AI-ready stack often struggle with how to best support ML administrators and data scientists, while the prospect of large AI investment costs has enterprises stalled in their AI and ML strategy.
Nutanix GPT-in-a-Box is an opinionated AI-ready stack that aims to solve the key challenges with generative AI adoption and help jump-start AI innovation.”
Thomas Cornely, SVP, Product Management at Nutanix
“As customers look to design and deploy generative AI solutions, they find themselves struggling with balancing the deep expertise required to install, configure, and run these workloads with concerns around their data security and protecting company IP – all while controlling costs,” said Greg Macatee, Senior Research Analyst, Infrastructure Systems, Platforms and Technologies Group at IDC.
“With GPT-in-a-Box, Nutanix offers customers a turnkey, easy-to-use solution for their AI use cases, offering enterprises struggling with generative AI adoption an easier on-ramp to deployment.”
The Nutanix GPT-in-a-Box solution delivers ready-to-use customer-controlled AI infrastructure for the edge or the core data center and allows customers to run and fine-tune AI and GPT models while maintaining control over their data. Nutanix provides a full complement of security and data protection offerings ideal for AI data protection.
“Helping customers tackle the biggest challenges they face in IT is at the core of what we do, from managing increasing multicloud complexity, to data protection challenges, and now adoption of generative AI solutions while keeping control over data privacy and compliance,” said Thomas Cornely, SVP, Product Management at Nutanix.
This new solution includes:
- The Industry-leading Nutanix Cloud Infrastructure™ platform, with the Nutanix Files Storage™ and Objects Storage™ solutions, the Nutanix AHV® hypervisor and Kubernetes, along with NVIDIA GPU acceleration, which can be sized for large to small scale.
- Nutanix services to help customers size their cluster and deploy an opinionated stack with the leading open source deep learning and MLOps frameworks, inference server, and a curated set of large language models such as Llama2, Falcon and MPT.
- Ability for data scientists and ML administrators to immediately consume these models with their choice of applications, enhanced terminal UI, or standard CLI.
- The platform can also be leveraged to run other GPT models, as well as fine tune these models leveraging internal data, hosted on included Nutanix Files or Objects Storage services.
“Leveraging AI to more efficiently and effectively help our customers is a top priority for us but, as a regulated financial services organization, maintaining full control over our data is necessary,”
Jon Cosson, CISO at JM Finn.
