Unify Active Data and Archive Data in a Global Namespace
Many organizations already have massive archives of unstructured data stored on tape. However, these archives are often operationally disconnected from modern compute environments such as AI pipelines and HPC clusters. Much of this data must be preserved and remain accessible for long periods of time so storing all of it on expensive high-performance storage is not economically sustainable.
Hammerspace and Versity deliver a joint solution that combines the high-performance parallel global file system and automated data orchestration capabilities of the Hammerspace Data Platform with Versity’s ScoutAM to preserve exabyte-scale unstructured data on tape and other mass storage systems. All data is unified in a Global Namespace so organizations can seamlessly access, manage, and preserve data across the entire lifecycle.
The combined solution allows active data to remain accessible for AI and HPC workloads while intelligently moving inactive data to a low-cost, power-efficient tape archive. By making archived data visible through the Hammerspace global namespace, organizations can treat large tape archives as an extension of their active data environment, enabling AI and HPC workflows to easily access archived datasets when needed.
This solution is ideally suited for organizations managing tens to hundreds of Petabytes of data, especially if the inactive data is stored on a large tape archive and must be preserved for many years.
Solution Architecture
In the joint solution, each platform performs complementary roles within the unstructured data stack.
Hammerspace Data Platform
Hammerspace provides the high-performance data platform that:
- Creates a global namespace across storage systems and locations
- Delivers parallel file system performance for AI and HPC workloads using industry-standard protocols (NFS, SMB, S3)
- Provides automated data orchestration services that intelligently tier data between server-local NVMe storage, tier 1 storage (NAS), object storage, and Versity ScoutAM for archival storage
- Makes files stored on tape visible in the global namespace using Data-in-Place Assimilation, without migrating data. Files remain on tape and are recalled only when accessed
Versity ScoutAM
Versity ScoutAM is a scalable archive management platform designed to preserve exabyte-scale unstructured data. With a policy-driven approach, it eliminates risk and complexity by automating data placement across configurable storage pools, including disk, hybrid object storage, cloud, and tape.
Optimized for efficient data transfers, it offers unparalleled scalability and cost-effectiveness for long-term preservation, enabling organizations to securely store huge volumes of cold data while minimizing total ownership costs. Versity’s ScoutAM platform also supports in-place upgrades from legacy archive platforms, including HPE DMF, IBM HPSS, and Oracle HSM, eliminating data migration when modernizing existing archives.
Ideal Use Cases
The Hammerspace and Versity solution is well suited for environments with large volumes of unstructured data and long-term retention requirements, including:
- AI training datasets and model archives
- High-performance computing (HPC) research environments
- Media and entertainment content archives
- Scientific and genomics research data
- Satellite, geospatial, and sensor data repositories