Settings

Scraper Settings

Global scraper configuration

Limits

Maximum number of assets to scrape per day across all sites. Per-site limits can be set in Sites Config.

Humanization

Settings to make scraper behavior look more human-like and avoid detection.

30%

Random variation added to delays between requests. Higher = more random.

15%

Chance of taking a random pause between scraping actions.

Current Configuration

Preview
{
  "daily_limit": 150,
  "humanization": {
    "delay_variance_percent": 30,
    "pause_probability_percent": 15
  }
}

Per-site schedules

Individual site schedules (time, timezone, daily limit) are configured in Sites Config.