About SiteCrawl

Overview

SiteCrawl is a service that automatically detects and records changes to website content. Just register a URL and we handle everything from scheduled fetching and diff detection to email notifications.

Features

• ✓Scraping — Fetch any web page by URL. Saved in HTML, Markdown, and plain text formats.
• ✓Diff Detection — Automatically compute diffs from the previous fetch. Added and removed sections are highlighted.
• ✓Scheduler — Automate periodic fetching at intervals from 5 minutes to 24 hours. Stay up to date without manual checks.
• ✓Email Notifications — Receive email when changes are detected. Notification frequency is configurable per job.
• ✓API Access — Full programmatic access via API keys.

Contact