pytasks is a complete and customizable microservice for running computational tasks on remote machines and viewing its results through an API.
⚠ Notice: this is only an introduction README. For full documentation, visit the pytasks documentation page.
The project is currently on release 3.
You can view the source code and contribute by creating a pull request with your modifications or opening an issue.
The microservice has two instances, an api exposed on the web, where users can send task requests to a queue, and a handler, which listens to the queue and execute the tasks.
To run pytasks with all of its dependencies in a testing environment, ensure you have docker and docker compose installed and then run the following command:
git clone https://github.com/brenopelegrin/pytasks.git &&
cd pytasks &&
export JWT_PRIVATE_PEM=$(cat ./examples/keys/jwtRS256.key) &&
export JWT_PUBLIC_PEM=$(cat ./examples/keys/jwtRS256.key.pub) &&
docker compose up -d⚠ This command uses the example RSA keypair stored in the repository and default passwords for PostgreSQL and RabbitMQ. You MUST setup your own RSA keypair and credentials in production to avoid security issues. See the Setting up section for more informations.
After the containers start, the API will be available at http://localhost:8080.
💡 For more instructions on how to customize your pytasks containers and how to run them, see Setting up.
The project's main goal is to make cloud computing more accessible and facilitate its implementation.
pytasks provides a complete and customizable backend so that developers only have to worry about developing the tasks, not the backend that runs them.
It is based on solid and robust technologies, packages and frameworks. The API is built with Flask and served with gunicorn. The handler is built on top of Celery, enabling it to use various backends for the queue, such as Redis and RabbitMQ and various database backends for storing task results, such as PostgreSQL.
