Course contentsShow
← System Design
Lesson 447 of 1,91912. NoSQL: Wide-Column StoresFree lesson

Master Server and Metadata Management

How the master assigns tablets to servers and manages metadata without being in the data path.

Master Server and Metadata Management

You'll learn: How BigTable's master server orchestrates tablet assignments and tracks metadata without slowing down actual data operations.

The Master's Role

In BigTable, the master server acts like a central coordinator—think of it as a warehouse manager who assigns workers to different storage areas but doesn't personally move boxes. The master's job is to:

  • Assign tablets to tablet servers: When a tablet server starts up or fails, the master decides which server should handle which tablet
  • Track metadata: Keep records of where each tablet lives and which tablet servers are active
  • Monitor health: Detect when tablet servers fail and reassign their tablets to healthy servers
  • Handle schema changes: Coordinate table creation, deletion, and column family modifications

Staying Out of the Data Path

The critical design insight is that the master is not in the data path. Clients don't go through the master for reads or writes. Instead:

  1. Clients cache tablet location information (learned from the master once)
  2. They communicate directly with tablet servers for data operations
  3. Only when locations change or caches expire do clients contact the master again

This separation prevents the master from becoming a bottleneck. Imagine if every library patron had to ask the librarian before picking up each book—the librarian would be overwhelmed! Instead, BigTable's master just maintains the card catalog while readers go straight to the shelves.

Metadata Storage

The master stores tablet locations in a special metadata table (itself stored as tablets), creating a three-level lookup hierarchy for scalability.

Key Takeaway: BigTable's master assigns tablets and manages metadata centrally but stays out of the data path, allowing clients to read and write directly to tablet servers for high throughput.