Solution Benefits
- Unify Siloed Data into a Global Namespace that spans server-local NVMe to tape
- Make Files Stored on Tape Visible and Accessible without migrating data
- Optimize Performance for AI and HPC Workloads by keeping active data on high-performance storage and automatically archiving cold data
- Reduce Storage Costs and Power Usage by intelligently archiving inactive data to low-cost storage
- Reduce Administrative Overhead with seamless data management across the lifecycle
- Eliminate Archive Vendor Lock-In with open-source data formats and industry-standard protocols across the entire stack
- Protect Data for the Long Term with policy-driven multi-copy archiving and durable, recoverable storage formats
Unify Active Data and Archive Data in a Global Namespace
Many organizations already have massive archives of unstructured data stored on tape. However, these archives are often operationally disconnected from modern compute environments such as AI pipelines and HPC clusters. Much of this data must be preserved and remain accessible for long periods of time so storing all of it on expensive high-performance storage is not economically sustainable.
Hammerspace and Versity deliver a joint solution that combines the high-performance parallel global file system and automated data orchestration capabilities of the Hammerspace Data Platform with Versity’s ScoutAM to preserve exabyte-scale unstructured data on tape and other mass storage systems. All data is unified in a Global Namespace so organizations can seamlessly access, manage, and preserve data across the entire lifecycle.
The combined solution allows active data to remain accessible for AI and HPC workloads while intelligently moving inactive data to a low-cost, power-efficient tape archive. By making archived data visible through the Hammerspace global namespace, organizations can treat large tape archives as an extension of their active data environment, enabling AI and HPC workflows to easily access archived datasets when needed.
This solution is ideally suited for organizations managing tens to hundreds of Petabytes of data, especially if the inactive data is stored on a large tape archive and must be preserved for many years.
Solution Architecture
In the joint solution, each platform performs complementary roles within the unstructured data stack.
Hammerspace Data Platform
Hammerspace provides the high-performance data platform that:
- Creates a global namespace across storage systems and locations
- Delivers parallel file system performance for AI and HPC workloads using industry-standard protocols (NFS, SMB, S3)
- Provides automated data orchestration services that intelligently tier data between server-local NVMe storage, tier 1 storage (NAS), object storage, and Versity ScoutAM for archival storage
- Makes files stored on tape visible in the global namespace using Data-in-Place Assimilation, without migrating data. Files remain on tape and are recalled only when accessed
Versity ScoutAM
Versity ScoutAM is a scalable archive management platform designed to preserve exabyte-scale unstructured data. With a policy-driven approach, it eliminates risk and complexity by automating data placement across configurable storage pools, including disk, hybrid object storage, cloud, and tape.
Optimized for efficient data transfers, it offers unparalleled scalability and cost-effectiveness for long-term preservation, enabling organizations to securely store huge volumes of cold data while minimizing total ownership costs. Versity’s ScoutAM platform also supports in-place upgrades from legacy archive platforms, including HPE DMF, IBM HPSS, and Oracle HSM, eliminating data migration when modernizing existing archives.
How It Works
- Versity ScoutAM serves as the archive storage tier within the Hammerspace global file system and is added to a new or existing Hammerspace Share.
- For Versity customers with an existing large tape archive, Hammerspace can assimilate metadata from Versity’s ScoutAM platform while the data on tape stays in place. This means the files that are stored on tape become visible and accessible via Hammerspace, without migrating data or recalling all the files from tape.
- For writing new data to a tape archive, Hammerspace Data Orchestration policies can be configured to move inactive data to Versity ScoutAM, which then manages data in the archive, including how data is written to tape. Versity’s ScoutAM platform delivers high-performance parallel data transfer through multiple nodes simultaneously.
- When files need to be retrieved from the archive, they are accessed through the Hammerspace file system and Versity’s ScoutAM transparently retrieves and re-assembles them from tape.
Ideal Use Cases
The Hammerspace and Versity solution is well suited for environments with large volumes of unstructured data and long-term retention requirements, including:
- AI training datasets and model archives
- High-performance computing (HPC) research environments
- Media and entertainment content archives
- Scientific and genomics research data
- Satellite, geospatial, and sensor data repositories
About Hammerspace
Hammerspace is the data platform for AI-ready data. It enables organizations to unify and orchestrate unstructured data across on-premises infrastructure, cloud environments, and distributed storage systems. By creating a global data environment with high-performance access and automated data orchestration, the Hammerspace Data Platform makes data immediately accessible wherever it is needed—accelerating AI, HPC, and enterprise data workflows without copying or migrating data into new silos.
About Versity
Versity is a leading technology company focused on delivering innovative storage and data management solutions. With a commitment to performance, scalability, and open-source collaboration, Versity empowers organizations to efficiently manage their exabyte-scale data for AI, HPC, and enterprise in a rapidly evolving digital landscape.