Hewlett Packard expands AI-at-scale offerings with Pachyderm acquisition

Hewlett Packard Enterprise (HPE) has acquired Pachyderm, a US-based open-source data science platform, to automate reproducible machine learning pipelines for large-scale artificial intelligence (AI) applications.

The terms of the transaction were not disclosed.

As part of the transaction, Hewlett Packard Enterprise will integrate Pachyderm’s software with its own existing supercomputing and AI software solutions for data lineage, data versioning, and incremental data processing.

The combined solutions of Hewlett Packard Enterprise and Pachyderm will deliver an integrated machine learning pipeline and platform to fast-track enterprises’ AI journey from POC to production with higher efficiency and lower costs.

Hewlett Packard Enterprise anticipates combining Pachyderm with future versions of the former’s machine learning development system to build and train AI models.

Hewlett Packard Enterprise acquires Pachyderm to expand AI-at-scale offerings. Photo courtesy of Hewlett Packard Enterprise Development LP.

Justin Hotard — Hewlett Packard Enterprise HPC and AI executive vice president and general manager, said: “As AI projects become larger and increasingly involve complex data sets, data scientists will need reproducible AI solutions to efficiently maximize their machine learning initiatives, optimize their infrastructure cost, and ensure data is reliable and safe no matter where they are in their AI journey.

“Pachyderm’s unique reproducible AI software augments HPE’s existing AI-at-scale offerings to automate and accelerate AI and unlock greater opportunities in image, video, and text analysis, generative AI, and other emerging large-language-model needs to realize transformative outcomes.”

Using combined Hewlett Packard Enterprise and Pachyderm solution, Lockheed Martin has deployed AI at-scale solutions for mission-critical applications to maximize performance, and standardize AI technologies across the national security missions.

Pachyderm will join Hewlett Packard Enterprise HPC & AI Global Business Unit and the company’s product will be part of unit’s AI at Scale platform.

In February 2022, Hewlett Packard Enterprise through its venture capital arm, Hewlett Packard Pathfinder invested in Pachyderm.

The transaction is not conditional on any regulatory approvals and is likely to close this month.

In June 2021, Hewlett Packard Enterprise acquired Determined AI, a platform for building and retraining machine learning models.