This lesson is for subscribers
You've completed the free preview. Subscribe to unlock every lesson in every course.
Lesson 1849 of 1,919·44. Real-World System: Web CrawlerPro lesson
URL Frontier Persistence and Recovery
Persisting frontier state to disk or distributed storage to recover from failures without losing discovered URLs.