Crawl Pagination Audit
Walk an entered cursor chain and compare page counts with item IDs to flag missing pages, cycles, duplicates and unsupported termination claims.
Loading tool…
How to use Crawl Pagination Audit
A successful first scrape does not establish that later pages were captured. Reconcile minimal page and item identifiers under an explicit termination rule before promising dataset coverage.
- Record request and next-cursor labels, actual page outcomes and explicit termination evidence.
- List item IDs per page so declared counts and repeated items can be checked.
- Resolve missing cursors and count discrepancies, then verify source coverage and collection permission independently.
Good to know
- No website is fetched. A consistent supplied chain is not proof of complete real-world data, authorization or source accuracy. Item identities must use one consistent scope.
- Explicit termination requires a successful declared terminal with no next cursor. Empty termination also requires zero items. Duplicate item IDs are reported separately; unreachable extra pages hold the chain.
- Each input field is limited to 8,000 UTF-16 characters. CSV needs the exact displayed header and at most 100 data rows. Quoted commas, doubled quotes and quoted newlines are supported. Duplicate identities are refused unless the tool explicitly reports them as findings.
- Markdown and CSV are editable review artifacts, not certificates. Spreadsheet-like text is apostrophe-prefixed in CSV to reduce formula execution risk; check the actual importer before sharing. Decimal ratios are rounded to at most 12 places.
- Runs only on the records you enter, locally in your browser. No AI call, provider connection, account inspection, upload, automatic outreach or saved input. Use neutral identifiers rather than personal or secret content.
Research behind this workbench
These cases explain the business mechanism. The workbench is ToolJovia's independent adaptation, not a claim about the company's internal workflow or an endorsement.
Common questions
Are repeated item IDs always a pagination failure?
No. Sources can repeat items. The report identifies repeats and counts unique supplied IDs while preserving separate chain-termination findings.
Why is a missing next cursor still unverified?
It may represent a truncated export or failure. An explicit successful terminal record is required under this contract.
Keep going with related tools
All data →Document Chunk Source Coverage
Reconcile document elements with chunk membership to expose missing sources, repeated elements, reversed order and declared size overruns.
DataSpreadsheet Fixture Comparator
Compare expected and actual CSV fixtures by a unique ID, preserving missing rows, extra rows, exact text changes and bounded numeric tolerance.
DataActor Earnings and Payout Ledger
Reconcile entered actor statement charges, refunds, costs, approval states and actual settlements while separating unknown balances from received cash.