Resumable Scraping with Checkpoints

Why use `INSERT OR IGNORE` when seeding a scrape queue from a list of URLs?

• ASpeed
• BIdempotency, restarting the seeding step doesn't error out or duplicate rows for URLs already in the queue
• CIt's required by SQLite
• DIt enables retries