Hi

Start with UltiHash Serverless for free with our 7-day free trial - no matter the cluster size you need, from 200GB, 1TB, 5TB or even 10TB. You can always upgrade your cluster size later on if needed.

Click here to start your free trial.

Next step



Get started with Serverless



15 mins for you

Wait for delivery

Sweet, now that you’ve got your subscription, we’re setting up your cluster - we’ll email you when it’s ready to use! In the meantime, you can already check our integrations hub where you have access to the scripts to connect your entire stack.

Next step



Get started with Serverless



15 mins for you

Connect + create bucket

Your cluster is setup, and ready to use! You can fetch your credentials and cluster name in the credentials section on your dashboard.

You can also create your first bucket with the command shown here.

aws s3api create-bucket --bucket <your-bucket-name> --endpoint-url https://

Next step



Get started with Serverless



15 mins for you

Write first data

Fantastic! You’re ready to start writing to your bucket. Use the command shown here to execute your first write operation and get on with your project. You can find the most frequent commands on our cheatsheet.

‍

aws s3 cp <./path/to/your-file.txt> s3://<your-bucket-name/> --endpoint-url https://

Complete tutorial



Get started with Serverless



15 mins for you

You've set up UltiHash Serverless!

Now you can connect the rest of your stack with our range of integrations.

Check out the documentation



RESTART



Thanks! We'll be in touch soon.

Oops! Something went wrong while submitting the form.



Cloud flexibility for low latency

Selected your preferred cloud provider, and keep data next to your workloads for low latency.

S3-compatible API

Connect tools using our REST API, which is fully compatible with the S3 protocol.

See all integrations in our documentation



Dashboard

for

User

ID:

Generating...

Serverless

Self-Hosted

NEXT STEP



Install a test cluster with Docker

The easiest way to get started is to test UltiHash with Docker locally with your own datasets.

Start tutorial





15 min

Install prerequisites

Install UltiHash with Docker

Write data to bucket

See space savings

Install prerequisites

Make sure you have install the required tools to run UltiHash locally:

Docker Engine
AWS CLI
Python packages boto3 and tqdm

You can use the command here to install everything easily.

# Install Docker
sudo apt-get update
sudo apt-get install ca-certificates curl
sudo install -m 0755 -d /etc/apt/keyrings
sudo curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
sudo chmod a+r /etc/apt/keyrings/docker.asc
echo \
"deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
$(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
sudo apt-get update
sudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin

# Add user to docker group
sudo usermod -aG docker $USER

# Install AWS CLI
curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip"
unzip awscliv2.zip
sudo ./aws/install

# Install Python packages
sudo apt install python3-boto3 python3-tqdm

Next step



Install a test cluster with Docker



15 min

Install UltiHash with Docker

Download this Docker Compose file, then use the command to log into the container registry, export your credentials, and start the services.

Your registry password is:

compose.yaml

# Log in to the UltiHash registry
docker login registry.ultihash.io -u 

# Set environment variables for authentication
export AWS_ACCESS_KEY_ID="TEST-USER"
export AWS_SECRET_ACCESS_KEY="SECRET"
export UH_CUSTOMER_ID=""
export UH_ACCESS_TOKEN=""
export UH_MONITORING_TOKEN=""

# Change to the directory with your compose.yml file
cd ~/Downloads

# Start the UltiHash cluster
docker compose up -d

Next step



Install a test cluster with Docker



15 min

Write data to bucket

To evaluate how UltiHash handles real-world files locally, create a test bucket using the command shown here. Then upload your dataset with the the helper script we've created - it uses the S3 Python SDK to provide high-throughput uploads with progress tracking and multipart support.

Make sure to replace the orange placeholders with your chosen bucket name and dataset path.

uh-upload.py

# Create a bucket
aws s3api create-bucket --bucket <bucket-name> --endpoint-url http://127.0.0.1:8080

# Upload your dataset
python3 uh-upload.py --url http://127.0.0.1:8080 --bucket <bucket-name> <dataset-path>

# Verify contents
aws s3api list-objects --endpoint-url http://127.0.0.1:8080 --bucket <bucket-name> --output text | cat

Next step



Install a test cluster with Docker



15 min

See space savings

Download this script, and then run the command to see how much space UltiHash is saving by deduplicating your dataset.

uh-see-space-savings.py

python3 uh-see-space-savings.py --url http://127.0.0.1:8080

Complete tutorial



Install a test cluster with Docker



15 min

UltiHash test cluster installed!

You've now got a cluster installed with Docker that you can use to test. Next step: deploy for production use with Kubernetes.

Check out the documentation



RESTART



NEXT STEP



Deploy with Kubernetes

Want to use UltiHash in production? Check out our documentation about deploying with Kubernetes.

Start walkthrough



This is step 1

Docker provides a containerized virtual environment for UltiHash to run on.

You can find general instructions for installing Docker Engine at docs.docker.com/engine/install.

To quickly install, run:

# Linux installation: Update package index, install prerequisites, and set up Docker’s GPG keysudo apt-get updatesudo apt-get install ca-certificates curlsudo install -m 0755 -d /etc/apt/keyringssudo curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.ascsudo chmod a+r /etc/apt/keyrings/docker.asc# Add the Docker repository to Apt sources and update package indexecho \  "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \  $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \  sudo tee /etc/apt/sources.list.d/docker.list > /dev/nullsudo apt-get update# Install Docker Engine, CLI, and related pluginssudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin

Next step



Deploy with Kubernetes



1 hour

This is Step 2

Docker provides a containerized virtual environment for UltiHash to run on.

You can find general instructions for installing Docker Engine at docs.docker.com/engine/install.

To quickly install, run:

# Linux installation: Update package index, install prerequisites, and set up Docker’s GPG keysudo apt-get updatesudo apt-get install ca-certificates curlsudo install -m 0755 -d /etc/apt/keyringssudo curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.ascsudo chmod a+r /etc/apt/keyrings/docker.asc# Add the Docker repository to Apt sources and update package indexecho \  "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \  $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \  sudo tee /etc/apt/sources.list.d/docker.list > /dev/nullsudo apt-get update# Install Docker Engine, CLI, and related pluginssudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin

Next step



Deploy with Kubernetes



1 hour

This is step 3

Docker provides a containerized virtual environment for UltiHash to run on.

You can find general instructions for installing Docker Engine at docs.docker.com/engine/install.

To quickly install, run:

# Linux installation: Update package index, install prerequisites, and set up Docker’s GPG keysudo apt-get updatesudo apt-get install ca-certificates curlsudo install -m 0755 -d /etc/apt/keyringssudo curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.ascsudo chmod a+r /etc/apt/keyrings/docker.asc# Add the Docker repository to Apt sources and update package indexecho \  "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \  $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \  sudo tee /etc/apt/sources.list.d/docker.list > /dev/nullsudo apt-get update# Install Docker Engine, CLI, and related pluginssudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin

Next step



Deploy with Kubernetes



1 hour

This is step 4

Docker provides a containerized virtual environment for UltiHash to run on.

You can find general instructions for installing Docker Engine at docs.docker.com/engine/install.

To quickly install, run:

# Linux installation: Update package index, install prerequisites, and set up Docker’s GPG keysudo apt-get updatesudo apt-get install ca-certificates curlsudo install -m 0755 -d /etc/apt/keyringssudo curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.ascsudo chmod a+r /etc/apt/keyrings/docker.asc# Add the Docker repository to Apt sources and update package indexecho \  "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \  $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \  sudo tee /etc/apt/sources.list.d/docker.list > /dev/nullsudo apt-get update# Install Docker Engine, CLI, and related pluginssudo apt-get install docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin