How to implement several asynchronous task queues using the Python multiprocessing library and Redis.
Task queues manage background work asynchronously outside of a user request. With regard to web development, they are used to process tasks outside the typical request/response cycle. They are quite popular in microservice architectures for inter-microservice communication. Celery and RQ are the two most popular Python-based task queues.
The tutorials and articles on TestDriven.io focus on setting up and configuring task queues to work with Docker and various Python web Frameworks like Django, Flask, and FastAPI.
Latest Posts (11)
This tutorial looks at how to configure Celery to handle long-running tasks in a FastAPI app.
This article looks at where potential performance issues can occur in a Django application and how to address them in order to speed up your app.
This article looks at how to configure Celery to handle long-running tasks in a Django app.
This tutorial shows how to integrate Celery into the Python-based Falcon web framework.
Looks at how to configure Celery to handle long-running tasks in a Flask app.
Looks at how to configure Redis Queue (RQ) to handle long-running tasks in a Flask app.
Making Celery work nicely with Django Database Transactions.
Automatically retry failed Celery tasks.
Send confirmation emails to newly registered users with Flask, Redis Queue, and Amazon SES.
This post looks at how to manage periodic tasks with Django, Celery, and Docker.