Helper processes

Magpie runs some additional processes in order to run tasks asynchronously in the background.

They are launched automatically but you can disable that behavior in case you want to control those separately.

You might want to do this when developing, to have a worker always running (faster startup/shutdown of the app/tests when you don’t have to manage a worker cluster). It also helps to have them separate so logs from the workers do not get mangled with those from the app.

Running the Celery worker process

To run the worker separately, set WORKER_START = False in config.py and run the following:

just worker

Tip

You can also run it directly:

uv run celery -A magpie.task.queue worker -E --loglevel=INFO

If you want to run a worker for running the tests that includes test tasks, you should use this instead:

just test-worker

Running the flower monitoring process

To run the task monitoring interface separately, set FLOWER_START = False in config.py and run the following:

just flower

Tip

You can also run it directly:

uv run celery -A magpie.task.queue flower

The interface is then available at http://localhost:5555/