FEDML Empowers On-Premise AI Innovation at DENSO

FEDML, the company providing "Your Generative AI Platform at Scale," today announced its partnership with DENSO, one of the largest automotive suppliers in the world, to empower fully on-premise training, development, and deployment of AI models and applications via FEDML Nexus AI platform.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20240430680814/en/

Figure 1: FEDML Nexus AI On-Premise Deployment. (Graphic: Business Wire)

As enterprises and organizations move fast toward bringing AI into their products and services, the need for privacy, security, full control, and ownership of the entire AI software stack becomes a critical requirement. This is especially true with the emergence of Generative AI models and applications, as data and AI models have become essential assets for any organization to obtain their competitive advantage.

Your Generative AI Platform at Scale – this is the mission that defines FEDML and its commitment to helping enterprises navigate the AI revolution with full ownership and control. By deploying FEDML Nexus AI platform on their own infrastructure (whether private cloud, on-premise servers, or hybrid), companies can provide their employees and customers with scalable, state-of-the-art GenAI capabilities, while giving them full control over their data, models, and computing resources.

Dr. Toru Hirano, Vice President of DENSO’s Silicon Valley Innovation Center, recently highlighted the complexities associated with training AI models across diverse geographic regions and internal business units. "Due to increasingly stringent data regulations and internal confidentiality policies, federated learning has emerged as an ideal solution by leveraging edge computing," Dr. Hirano stated. He further noted the limitations of existing methodologies: "Sometimes, even sharing local models with differential privacy and secure aggregation is prohibited, necessitating a purely on-premises solution." Through a partnership with DENSO, FEDML has successfully implemented such a solution, addressing the specific requirements of secure, decentralized data handling. This solution is being utilized by DENSO in such projects as creating ADAS features and developing AI applications designed to safeguard vulnerable road users (VRUs) in smart cities.

FEDML Nexus AI Key Features. FEDML Nexus is an all-in-one powerful AI platform that provides the foundation to build and commercialize any AI application easily, scalably, privately, and economically. The platform offers several key features:

1. GenAI Studio empowers companies to create advanced AI agents using models from the GenAI Model Hub, with a seamless Retrieval-Augmented Generation pipeline and connectivity to external APIs.
2. Deploy, Serve, and Scale allows the creation of dedicated or serverless endpoints for proprietary or third-party models, with features like autoscaling, batch-job scheduling, failover mechanisms, and comprehensive monitoring.
3. Launch enables orchestration of AI jobs across decentralized GPU resources effortlessly with auto-provisioning, batch-job scheduling, and cluster management
4. Train provides integrated support for distributed training frameworks like DeepSpeed and Megatron-LM, with advanced observability and debugging tools.
5. Federate enables zero-code, secure federated learning, and analytics within a company's infrastructure, allowing model training from decentralized data without requiring centralization.

According to Salman Avestimehr, CEO and Co-founder of FEDML, “In the last decade, many enterprises evolved into data-centric organizations. Now, with Generative AI advancing rapidly, these companies are transforming into AI powerhouses. FEDML Nexus AI facilitates this transition, offering full ownership and control. Our partnership with DENSO exemplifies how companies can maintain control over their data, models, and computing resources, leading the AI revolution.”

FEDML Nexus AI On-Premise Deployment. Deploying FEDML Nexus AI on-premise enables any enterprise to operate its own AI platform on its infrastructure, ensuring maximum privacy, ownership, and control. An engineer or developer simply needs to download the Nexus AI platform from FEDML’s private repository and install it on a node inside the enterprise’s private network. Once the Nexus AI web platform is online, enterprise users can login to the platform, register their private computing nodes, and execute different jobs, such as AI model training or deployment, to their private computing cluster.

FEDML Federate. One of the core components of the Nexus AI Platform is FEDML Federate, a state-of-the-art Federated Learning Operations (FLOps) platform for managing the end-to-end development lifecycle of Federated Learning jobs. FEDML Federate seamlessly orchestrates all operations with respect to the coordination, execution, and monitoring of a federated learning job. Through FEDML Federate, enterprises can federatedely train, deploy and monitor any AI model across their own private compute nodes (servers, devices, smartphones), enhancing their data privacy and security compliance. At the same time, through the advanced capabilities offered by FEDML Federate for easily experimenting with different federated learning algorithms and training policies, A/B model testing and group management features, enterprises can iterate faster and optimize their development costs.

In the figure 2, we provide a representative example of the execution flow of a federated learning job deployed on-premise through FEDML Federate within an enterprise’s private network. FEDML Federate will spawn and manage the required master and client processes at the registered computing nodes and provide advanced job, model and system monitoring capabilities through the on-premise deployed FEDML Nexus AI Platform.

About FEDML, Inc.

FEDML is your generative AI platform at scale to enable developers and enterprises to build and commercialize their own generative AI applications easily, scalably, and economically. Its flagship product, FEDML Nexus AI, provides unique features in enterprise AI platforms, model deployment, model serving, AI agent APIs, launching training/Inference jobs on serverless/decentralized GPU cloud, experimental tracking for distributed training, federated learning, security, and privacy. FEDML, Inc. was founded in February 2022. With over 5000 platform users from 500+ universities and 100+ enterprises, FEDML is enabling organizations of all sizes to build, deploy, and commercialize their own LLMs and Al agents.

View source version on businesswire.com: https://www.businesswire.com/news/home/20240430680814/en/

[email protected]