This lesson is for subscribers
You've completed the free preview. Subscribe to unlock every lesson in every course.
Lesson 1873 of 1,919·44. Real-World System: Web CrawlerPro lesson
Handling Recrawls and Freshness
Scheduling periodic recrawls of important pages while maintaining politeness and managing distributed state.