GenAI Companies Embrace Open-Source Models for AI Agents
In the realm of Generative AI (genAI), companies are increasingly turning to a diverse array of open-source and smaller language models to enhance specialized task automation. Major players like HubSpot, Microsoft, and ServiceNow are actively exploring open-source models to tailor-make AI agents that precisely align with customer requirements.
Forrester Research’s Vice President, Craig LeClair, predicts a future where companies will deploy numerous domain-specific models rapidly, highlighting the surge in model diversity. The adoption of open-source AI models by service providers offers benefits such as flexibility, customization, reduced footprint, and lower computational expenses.
Microsoft, for instance, is crafting a suite of compact AI tools, incorporating open-source models into Microsoft 365 for offline functionality. Aparna Chennapragada, Microsoft’s Chief Product Officer, elaborates on the development of these smaller models to cater to offline M365 users, focusing on tasks like writing, analysis, and image creation.
HubSpot, on the other hand, recently expanded its Breeze AI platform with a host of open-source models, including Mistral AI LLM and Stability Diffusion 3 Large, to streamline sales, marketing, and support operations. Nicholas Holland, Head of AI at HubSpot, emphasizes the strategic use of open-source models to address diverse customer needs effectively.
Moreover, ServiceNow’s collaboration with Nvidia resulted in the creation of Apriel, a lean genAI model with 15 billion parameters optimized for reasoning in functions like IT support and customer service. Dorit Zilbershot, ServiceNow’s Group Vice President, underscores the efficiency and cost-effectiveness of Apriel in accelerating inferencing tasks.
As companies prioritize governance and data security, Forrester’s LeClair underscores a shift towards on-premise AI models to safeguard proprietary information. The control afforded by on-premise environments offers an added layer of security against data leaks, aligning with evolving AI policies and regulations.
In conclusion, the strategic integration of open-source and specialized AI models by genAI companies heralds a new era of tailored AI solutions. By leveraging these models effectively, organizations can enhance operational efficiency, bolster customer experiences, and navigate the evolving landscape of AI technologies with confidence.