Skip to content

Batch Scrape

Last updated: Jan 3, 2026

Batch scraping is a powerful tool to fetch raw content from external sites in bulk, creating Draft chapters that are ready for analysis or translation. For a step-by-step guide, see Batch Jobs.

Prerequisites

WARNING

This feature requires the OmniTranslate Extension.

You must have the OmniTranslate extension installed in your browser. If you haven't installed it yet, please follow the guide on Installing the Extension.

Limits & Properties

  • Maximum Chapters: You can scrape up to 200 chapters in a single batch job.
  • Tab Requirement: As mentioned in the general guide, you must keep the tab open for the scraper to function, although you can switch to other tabs.
  • Site Support:
    • Not all sites are supported.
    • Some sites have strong protections that may prevent full batch scraping.
    • If a job fails partway due to protection, you may need to wait and try running it again later.

Scrape Modes

When you start a batch scrape, you have two options for how the scraper finds the next chapter: Auto and Links.

1. Scrape Auto

Auto mode attempts to automatically detect the "Next Chapter" button or link on the source page to continue scraping.

Scrape Auto

  • Best for: Standard sites with clear navigation (Next/Previous buttons).
  • Skip First Link: Enable this if you provided a link to a chapter you already have or don't want to scrape. The scraper will start from the next chapter after the link you provided.

Links mode allows you to provide a specific list of URLs. The scraper will visit exactly the links you provide, in order.

Scrape Links

  • Best for: Sites where auto-navigation fails, or when you want to scrape specific, non-sequential chapters.
  • Input: Paste your list of URLs (one per line).