Burp Scanner Configuration and Crawling
You'll learn how to configure Burp's automated scanner and understand the difference between crawling strategies and scanning phases.
What Is Burp Scanner?
Burp Scanner automates the discovery and testing of web vulnerabilities. Think of it as sending a tireless assistant to systematically explore your target application and probe for weaknesses while you focus on manual testing. The scanner operates in two distinct phases: crawling (mapping the application) and scanning (testing for vulnerabilities).
Crawling: Mapping the Terrain
Before testing anything, Burp must understand your application's structure. Crawling (or spidering) automatically follows links, submits forms, and discovers content—building a comprehensive site map. You configure crawl depth, which pages to follow, and whether to respect robots.txt. Set crawl limits carefully: too shallow misses hidden functionality, too deep wastes time on irrelevant paths.
Configuration options include maximum link depth, request throttling, and handling of out-of-scope items. Smart crawling uses your authenticated session to discover protected pages.
Passive vs Active Scanning
Passive scanning analyzes responses already captured (from proxy traffic or crawling) without sending additional requests. It's safe and unobtrusive—looking for issues like missing security headers, verbose error messages, or unencrypted transmission of sensitive data.
Active scanning sends crafted malicious payloads to test for exploitable vulnerabilities like SQL injection or XSS. This generates significant traffic and may trigger security controls or cause application disruption. Always ensure you have authorization before active scanning.
Scan Coverage and Configuration
Configure what the scanner tests: injection flaws, XSS, path traversal, or all checks. Balance thoroughness against time—comprehensive scans on large applications can run for hours. Use the audit optimization settings to focus on specific vulnerability classes relevant to your engagement scope.
Key Takeaway: Burp Scanner automates vulnerability discovery through crawling (mapping) and scanning (testing), with passive scanning being safe for analysis and active scanning requiring authorization to send exploit attempts.