Michael Yin
In this course, you will learn how to add Celery to a Django application, allowing you to handle asynchronous tasks, which is vital for smooth user experiences. With this powerful combo, you will be able to do things like:
- Run machine learning models
- Send bulk emails
- Process images or PDFs
- Generate exports of user data
- Perform backups
These functions are increasingly common in modern web applications, but with Celery they are easy to implement. Because so many of these activities may be critical to the operation of your application, this course will walk you through configuring, testing, deploying, and monitoring of Celery tasks. With this setup, you can be assured that your tasks are firing and working as expected, outside the HTTP request/response flow.
What will you learn?
Select a Part
In this first part, you'll learn how to configure Celery to work with Django and Docker in order to process tasks in the background asynchronously. We'll then look at how to retry failed tasks, debug tasks, and ensure tasks work with Django database transactions correctly. Finally, we'll add WebSocket support to Django with Django Channels.
Learning Objectives
- Containerize Django, Celery, and Redis with Docker
- Ensure Celery tasks execute correctly with validation and debugging
- Create and manage Celery tasks
- Configure Django Channels to add WebSocket support to a Django application
In part 2, we'll dive into testing with the standard Django testing framework and pytest. We'll also look at a Test-Driven Development (TDD) workflow. You'll then deploy the application to DigitalOcean and learn how to properly monitor Celery tasks with Flower, Container Advisor, and Prometheus. Finally, we'll look at some Celery best practices and tips for performance tuning.
Learning Objectives
- Setup logging with Papertrail
- Practice Test-Driven Development
- Deploy Django, Celery, and RabbitMQ to DigitalOcean
- Configure monitoring
What do you need to know?
This course is targeted at advanced-beginners -- someone with at least 6 months of web development experience. Before beginning, you should have some familiarity with the following topics:
Docker and Docker Compose
Django
- Test-Driven Development with Python, Django, and Docker
- Looking for a solid introduction to Django? Check out Django for Beginners. Highly recommended!
Meet the Author
What developers are saying
The Developing Web Applications with Python and Flask course was absolutely amazing, I learned best practices for Flask development and Test-Driven Development in general. I work as an ML engineer and decided to take this course as I wanted to learn more about web development. Although the work that I do during the day is much different from web development, I learned a number of things that I can use in that context. I recommend this course to not only those wanting to learn Flask, but for those who want to incorporate Test-Driven Development into their everyday development workflow in general.
I'm enjoying Patrick Kennedy's Developing Web Applications with Python and Flask course. I love the in-depth explanations of how Flask works under the hood, and I'm switching from unittest to Pytest as well. TestDriven.io is definitely the best site for teaching unit/integration/functional testing.
The TestDriven.io courses are some of the best courses I've ever done for any language, any platform, any price range... just some of the most thorough and well-sourced courses around.
Just a word of thanks for doing such a great job with these training courses. The thorough, entire-lifecycle approach -- from implementation through test, coverage, quality, CI/CD, and all the rest -- is what separates these courses from other training material that I've completed. I'll be able to walk away from here with knowledge and skills that I can apply immediately at work -- and for that I'm grateful. It's a rare gift in an environment where so much 'training' is really just lightweight treatment that doesn't begin to scratch the surface of real, end-to-end software development. Really well done!
I am very much into buying and purchasing any course by you and your team. I've never felt like a better programmer ready to show my coding chops to the world.
Frequently Asked Questions
What tools and technologies are used in this course?
This course covers a variety of technologies and services:
Core
- Python
- Django
- Celery
- Django Channels
- Flower
- Docker
- Postgres
- Redis
- RabbitMQ
- Gunicorn
- Uvicorn
Testing and Monitoring
- pytest
- factory_boy
- Coverage.py
- Container Advisor
- Prometheus
Services
- Papertrail
- DigitalOcean
What can I learn to build with Django and Celery?
Celery is perfect for managing background and periodic tasks. In Django applications, it's commonly used for:
- Performing long running tasks, like processing image uploads such as cropping, resizing, compressing, or building various thumbnails.
- Similarly, generating PDFs of large datasets, perhaps as part of an export.
- Sending bulk emails to users, perhaps as part of a mailing list, email-based game, or facilitating redundancy in forum software. Performing tasks on a schedule, such as a regular backups, generating activity digests, or scraping web content during low traffic periods.
Celery is a must-have for many Django web applications because of these common use cases.
What support does TestDriven.io offer?
Since the courses mimic real-world development, support is provided via Stack Overflow. Helpful users, including the developers of the courses, read and respond to messages on Stack Overflow. If you get stuck and you can't find an answer via Stack Overflow, feel free to reach out via email directly. Just be sure to detail what you've tried. For more, review Support and Consulting.
How long does it take to complete the course?
It's dependent on your current skill level. On average, it takes approximately 12 hours to complete.