Skip to main content

A Celery Beat Scheduler using Redis for persistent storage

Project description

PyPI Circle CI ReadTheDocs

RedBeat is a Celery Beat Scheduler that stores the scheduled tasks and runtime metadata in Redis.

Why RedBeat?

  1. Dynamic live task creation and modification, without lengthy downtime

  2. Externally manage tasks from any language with Redis bindings

  3. Shared data store; Beat isn’t tied to a single drive or machine

  4. Fast startup even with a large task count

  5. Prevent accidentally running multiple Beat servers

For more background on the genesis of RedBeat see this blog post

Getting Started

Install with pip:

pip install celery-redbeat

Configure RedBeat settings in your Celery configuration file:

redbeat_redis_url = "redis://localhost:6379/1"

Then specify the scheduler when running Celery Beat:

celery beat -S redbeat.RedBeatScheduler

RedBeat uses a distributed lock to prevent multiple instances running. To disable this feature, set:

redbeat_lock_key = None

More details available on Read the Docs

Development

RedBeat is available on GitHub

Once you have the source you can run the tests with the following commands:

pip install -r requirements.dev.txt
py.test tests

You can also quickly fire up a sample Beat instance with:

celery beat --config exampleconf

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

celery-redbeat-meideng-0.0.3.dev0.tar.gz (14.9 kB view hashes)

Uploaded Source

Supported by

AWSAWS Cloud computing and Security Sponsor DatadogDatadog Monitoring FastlyFastly CDN GoogleGoogle Download Analytics MicrosoftMicrosoft PSF Sponsor PingdomPingdom Monitoring SentrySentry Error logging StatusPageStatusPage Status page