Jqueue: A job queue that runs on a single JSON file
SMRTR summary
jqueue is a Python job queue that runs on object storage (S3, GCS, local files) without requiring message brokers or databases. It uses compare-and-swap writes for exactly-once delivery and includes two implementations: DirectQueue for simple use cases and BrokerQueue with group commit for higher throughput. The system provides automatic stale job recovery and heartbeat management.
SMRTR provides this summary for quick context. The original article belongs to Hacker News.
Read the original article