Analyze your jobs on Scrapy Cloud.

The tool is hosted on Github Pages: https://zytedata.github.io/sctools/

• Screenshots
  • Display multiple jobs stats as a table
  • Sort jobs by some metric
  • Filter jobs by spider args
  • Customize which stats to show
  • Select which scrapy stats to show
  • Reorder the columns by drag and drop
  • Visualizing the Jobs stats
• License

Drag and drop to reorder the columns:

Number of items crawled over time:

curl -fsSL https://get.pnpm.io/install.sh | sh -

Follow this document.

pnpm watch

It could take a while running for the first time.

In another terminal:

pnpm watch-css

Now visit http://127.0.0.1:3345 in a web browser.

Copyright © 2021 Lucy Wang

Distributed under the the Apache License, Version 2.0.