Course contentsShow
← Machine Learning and Deep Learning
Lesson 2841 of 3,53861. Experiment Tracking and Model ManagementFree lesson

DVC Remote Storage Configuration

Setting up and using remote storage backends (S3, GCS, Azure) to store versioned data outside the Git repository.

DVC Remote Storage Configuration

What You'll Learn

You'll learn how to configure DVC to store your versioned datasets and models on cloud storage backends instead of bloating your Git repository.

The Problem DVC Remote Storage Solves

DVC tracks data versions using content-addressable storage locally, but storing gigabytes or terabytes of ML data on your laptop isn't scalable. Git repositories should remain lightweight—they're designed for code, not multi-GB dataset files. DVC's remote storage feature lets you keep the metadata (hashes, references) in Git while pushing the actual data to cloud storage backends like AWS S3, Google Cloud Storage (GCS), or Azure Blob Storage.

Think of it like Git remotes: your .git folder tracks commits locally, but you push/pull from GitHub. Similarly, DVC tracks data locally in .dvc/cache, but you push/pull from a remote storage backend.

Configuring a Remote

DVC supports multiple storage backends. Here's the basic workflow:

# Add an S3 remote named "myremote"
dvc remote add -d myremote s3://my-bucket/dvc-storage

# For GCS
dvc remote add -d myremote gs://my-bucket/dvc-storage

# For Azure
dvc remote add -d myremote azure://mycontainer/path

The -d flag sets this remote as the default. This configuration is saved in .dvc/config (which you commit to Git):

['remote "myremote"']
    url = s3://my-bucket/dvc-storage
[core]
    remote = myremote

Authenticating and Pushing Data

After configuring credentials (AWS CLI, gcloud, or Azure credentials), push your tracked data:

# Push all tracked data to remote
dvc push

# Pull data from remote (useful for teammates or new environments)
dvc pull

Key Takeaway: DVC remote storage separates lightweight metadata (committed to Git) from heavy data files (stored in scalable cloud backends), enabling team collaboration and reproducible ML workflows without repository bloat.