Selecting multiple lines PyCharm - Mac
I would suggest this small video for PyCharm users. These shortcuts can simplify life a lot.
Posts
Good articles on Celery groups, and chords
The first article gives deep and profound explanation how groups and chords can be handled. What is the most valuable, from my point of view, are database models implemented in Django-ORM to embody tasks persistence. I recommend it to read. The second article is more of introductory level. Good to read, but I would not expect to much.
Authorisation frameworks for a project
This is a list of promising authorisation frameworks. I like Casbin because of it simplicity of installation and usage.
SQLAlchemy role model
There are interesting articles: 1. Role model implementation using SQLAlchemy and Cerbos
Run ML pipeline on AWS ECS
In our project we have a ML pipeline which is suppressed to be run just a few times a year. Our stakeholders requested pipeline to be not expensive and simple to execute., that's why we decided to utilise AWS ACS. In out pipeline with have only 2 steps. The first is data preprocessing, second is inference. Both are computational heavy and require GPUs. This was an obstacle for us, because we wanted to use ECS without managing underlying EC2 infrastructure. Fortunately for us, we had opportunity to ask for advice AWS Support. Guys were kind to explain us that ECS service has a feature called Capacity Providers. It is possible to specify EC2 as capacity provider and select instances with GPU to be provided on demand, like on the picture below we we selected EC2 Capacity Provider for our cluster. We can select desired AMI and instance type. It is quite important to specify desired capacity. As we do not have streaming tasks and our customer can wait until cluster is provi...