February 14, 2024
Accelerated Datasets
Pre-load static, read-only datasets into compute nodes and reuse them to reduce a major part of the overhead incurred by using ephemeral compute resources.
Accelerated datasets bring together the competing requirements to unlock the cost savings that ephemeral compute provides, with close to native disk performance. The on node caching mechanism is great for tasks requiring access to large and sometimes static datasets. Accelerated datasets are ideal for long running, high volume, homogenous workflows.
Read our blog post “Reduce the Runtime & Memory Requirements of your Workloads by more than 50% with Accelerated Datasets”
Learn more in our docs: docs.union.ai/byoc/data-input-output/accelerated-datasets#accelerated-datasets