Workflow tutorials
JavaScript-rendered sites
Pages whose data appears after load, on scroll, or on click.
Symptom: the fetcher’s output has an empty shell, or only the first batch of items.
| Content appears… | Use |
|---|---|
| after a moment | wait_for: "css:.item" |
| as you scroll | scan_full_page: true (tune scroll_delay, max_scroll_steps) |
| in a virtualized list | virtual_scroll_config |
| after clicking “Load more” or a pager | js_code that clicks, with session_id and max_pages: 1 |
| behind a banner | remove_consent_popups, remove_overlay_elements |
Test on one page first (depth: 0) and read the fetcher’s output before building the rest.