Python Data Engineer
F
FlatgigsOperations Management
Sri Lanka. India. PakistanFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5 or more years of Python backend or data engineering experience
- Required Skills
- PythonSQLAzureRedisPandasRESTful APIs
Requirements
- 5 or more years of Python backend or data engineering experience.
- Experience with constraint solving, optimization, or scheduling algorithms such as OR-Tools or PuLP.
- Strong data processing experience with large datasets using Polars, pandas, or Apache Spark.
- Experience with task queues and async processing frameworks like Celery or RQ.
- Familiarity with Microsoft Azure services.
- Proficiency with SQL databases and writing performant queries.
- Experience consuming REST APIs and message queues.
- Preferred: Experience with Azure Functions or serverless compute.
- Preferred: Knowledge of scikit-learn or ML model integration (ONNX, Azure ML).
- Preferred: Experience with Pydantic for data validation.
Responsibilities
- Design and maintain the planning engine using Celery, Polars, and OR-Tools to process large volumes of operational schedule data.
- Develop the rostering engine as an Azure Function App to solve constraint problems for staff scheduling.
- Build the real-time dispatch engine for task assignment using proximity scoring against live location and attendance data.
- Implement the performance engine for scheduled KPI aggregation and SLA scoring.
- Ensure clean, reliable output persistence to Azure SQL and Redis.
View Full Description & ApplyYou'll be redirected to the employer's site
