Zoho Corporation, the Indian-based global technology giant, is expanding its capabilities in artificial intelligence (AI) with NVIDIA’s advanced AI accelerated computing platform.
It’s a strategic partnership which aims to integrate Zoho’s large language models (LLMs) within its SaaS applications to serve over 700,000 customers across Zoho.com and ManageEngine worldwide.
The announcement, made at the NVIDIA AI Summit in Mumbai, outlined Zoho’s plan to invest an additional $10 million in NVIDIA’s AI technology and GPU resources in the coming year, building on an earlier $10 million investment.
The deal leverages NVIDIA’s cutting-edge NeMo technology, part of the NVIDIA AI Enterprise suite, designed to support large-scale LLMs, multimodal, vision, and speech AI applications.
Era of AI for Business Use Cases
While many LLMs on the market are designed with a broad consumer focus, Ramprakash Ramamoorthy, Director of AI at Zoho said the company aims to develop tailored models to address specific business needs.
“Owning our entire tech stack, with products spanning various business functions, allows us to integrate the essential element that makes AI truly effective: context,” he said.
Also Read: Zoho Unveils Zoho IoT Platform to Revolutionize Business Automation and Connectivity
Zoho’s extensive experience with AI over the past decade allows it to bring contextual intelligence to a portfolio of over 100 products.
By adopting a multi-modal approach, Zoho’s AI strategy addresses varied business functions, enabling companies with even limited data resources to leverage small and medium-sized models for effective, cost-efficient decision-making.
Privacy-Centric AI Development
Zoho says privacy remains its central AI development philosophy. It has built its AI models to comply with privacy regulations from inception, instead of retrofitting them post-development. Unlike some LLM models that rely on customer data for training, Zoho’s LLMs maintain data independence, ensuring a secure AI-driven experience for businesses.
The deal with US-based NVIDIA allows it to harness NVIDIA’s advanced Hopper GPUs and TensorRT-LLM to optimize AI model deployment. Preliminary testing has shown a 60% increase in throughput and a 35% reduction in latency compared to previous open-source solutions.
Zoho’s commitment to efficiency extends to additional AI-driven tasks like speech-to-text conversion, enabled by NVIDIA’s accelerated computing infrastructure.
Balancing Performance and Cost-Effectiveness
Vishal Dhupar, Managing Director of Asia South at NVIDIA, said that “with NVIDIA’s AI software and accelerated computing platform, Zoho is building a broad range of models to help serve the diverse needs of its business customers.”
Zoho’s efforts to deploy scalable, privacy-focused AI solutions position it as a leader in AI-driven SaaS applications.
Dhupar said that as AI adoption becomes crucial for competitive advantage, Zoho’s innovations could redefine how businesses leverage AI, empowering organizations worldwide to improve efficiency and enhance decision-making processes with tailored, context-driven models.
