- Design and maintain scalable batch and near-real-time data pipelines across mobile, transaction, and ERP systems.
- Create clean, reusable data models for core business entities such as customers, transactions, and vehicles.
- Implement data validation, lineage, observability, and alerting to ensure business-critical data accuracy.
- Partner with cross-functional teams to deliver self-service datasets, metrics layers, and well-documented data marts.
- Optimize query performance, storage layouts, and cloud infrastructure costs.
- Apply data access controls, PII handling, and compliance-aware engineering patterns.
- Build robust ingestion patterns for APIs, webhooks, CDC, and event streams.
- Manage CI/CD, version control, automated testing, and infrastructure-as-code for data platforms.
- Troubleshoot incidents, conduct root-cause analysis, and mentor junior team members.
PythonSQLCloud Computing+5 more