Premip
← All guides

Tasks

Collect ecommerce catalog data

A collector that survives production is slow to scale and strict about location tags. Keep parsers in your repo. Premip only terminates the proxy.

Golden samples

Save HTML for one PDP per market. Parser tests should fail when the storefront redesigns.

Session policy

Stay sticky through a category walk. Rotate after the batch if the next cycle should use a new IP.

Politeness

Cap concurrency. Treat block pages as stop-the-line events, not as empty prices.

Instructions

  1. 1. Canary PDP

    Fetch through the chosen product and location.

  2. 2. Lock the parser

    Commit tests against the sample.

  3. 3. Walk one category

    Confirm row counts and miss rates.

  4. 4. Clone markets

    New location, same spider, tagged output.

Related sections

If you still need help, message us on Telegram or email. Include your account email and, if you have one, your order ID.