Post daily scraper health
Connect
SPIRITT
Web ScraperWeb Scraper
Scrapers that maintain themselves
SPIRITT designs your Web Scraper Cloud sitemaps, sets their schedules, watches every job and rewrites selectors when sites change, so your data collection keeps running.
What you can do with Web Scraper.
Sitemaps written for you
SPIRITT studies the target site and writes start URLs and selector rules for the data you want.
Schedules that fit the site
Cron timing, timezones, request intervals and proxies are set per sitemap and paused when needed.
Jobs watched every day
SPIRITT checks job status and credits and repairs sitemaps before gaps grow.
Works with your other apps.
Get started in three steps.
01
Open your workspace
Start a SPIRITT workspace for the sites and data you collect.
02
Connect Web Scraper
Connect Web Scraper so SPIRITT can manage sitemaps, schedules and jobs.
03
Delegate an outcome
Name the site and fields. SPIRITT builds, schedules and maintains the scraper.
Hand over a mission.
Choose a mission. Make it yours.
Put Web Scraper to work.
Keep the data flowing
Questions
Web Scraper, with SPIRITT.
01What can SPIRITT do with Web Scraper?+
Create, update and delete sitemaps, set or pause their schedules, list scraping jobs and check your account's page credits.
02Does it write the selectors?+
Yes. SPIRITT reads the target pages and writes start URLs and selector rules for the fields you name.
03How are schedules set?+
With cron fields, timezone, request interval, page load delay, driver and optional proxy for each sitemap.
04What happens when a site changes?+
SPIRITT spots failing jobs, inspects the new layout and updates the sitemap's selectors.
05Can it manage many clients' scrapers?+
Yes. Sitemaps and jobs filter by tag, so each client's portfolio is reported separately.
06How do I get started with Web Scraper?+
Open a SPIRITT workspace, connect Web Scraper and name the site and fields you want. SPIRITT builds the first sitemap.