Burp Spider
Burp Spider is a tool for mapping web applications. It automates the laborious task of cataloging an application's content and functionality, and lets you:
Work manually via your browser, by passively inspecting traffic passing through Burp Proxy and cataloging everything that this identifies.
Actively crawl the application, by automatically following links, submitting forms, and parsing responses for new content.
Browse a detailed site map of discovered content, in tree and table form.
Retain full control of all spidering actions, with fine-grained scope definition, automatic or user-guided submission of forms, and detailed configuration of the spidering engine.
Send interesting items to other Burp Suite tools with a single click.
Deal with complex applications, with automatic handling of login credentials and session cookies, and detection of custom "not found" responses.
Save all of your work, and resume working later.