Clickduck Control Center

Crawler Configuration (.env)

Synced with .env

Start Target URL *

🌐

The root URL where the crawler begins crawling and finding internal/external links.

Concurrent Tabs: 5

Iterations

🎯 Iteration Scope & Website Visits

🌐 All Websites

Crawl all discovered internal/external links per iteration

🎯 Limit Visits

Visit up to N pages before starting next iteration

Headless Mode Run browser in background without visible window

Accept Cookie Banners Auto-clicks "Accept All", "Allow", "Agree" dialogs

Tor Proxy Routing Route all Chromium traffic through SOCKS5 127.0.0.1:9050

Randomize Queue Pick random URLs from queue instead of FIFO order

⚙️ Advanced Crawler Options ▼

Browser User-Agent Rotates real modern Chrome, Firefox, Safari & Edge headers to avoid WAF rate-limiting and bot blocks (HTTP 503/429/403).

Timeout (ms)

Slow-Mo Delay (ms)

Tor SOCKS Port

Tor Control Port

Live Session Metrics

⏱ 00:00:00

Ready to start crawl Iteration 1 / 1

📊 All Iterations Cumulative

🌐

0

Total Websites Visited

⚠️

0

Total Errors Seen

🔄 Current Iteration

📄

0

Pages Visited

🔗

0

Internal Pages

🌐

0

External Pages

🍪

0

Cookies Accepted

📥

0

Queue Backlog

⚠️

0

Failed Websites

Tor Network Identity & Geolocation

Tor Inactive

Queried once per circuit on start/rotation

Tor Exit IP

--

Country & Region

--

City

--

ISP / Organization

--

Rotation Strategy

Per Iteration

Circuits Rotated

0

Exit Node Filter

Global (Any)

Websites with Errors & Broken Links

0

#	Failed / Broken URL	Error Reason	Found On (Source URL)	Time	Action
✨ No website errors recorded yet. Broken links or HTTP error codes will appear here.

Live Crawl Logs

0 lines

[00:00:00] [SYSTEM] Websurfer dashboard initialized. Configure parameters and click Start Crawling.