- Design, develop, and maintain scalable, reliable data pipelines and ETL processes.
- Partner with data engineers, analysts, data scientists, and cross-functional teams to support data infrastructure.
- Assist data science and backend services teams with robust data pipelines.
- Design, deploy, and maintain machine learning and AI infrastructure.
- Implement data validation, transformation, and cleaning processes to ensure data quality and consistency.
- Develop and maintain data warehousing solutions for storing, retrieving, and analyzing large datasets.
- Monitor and improve database systems and pipeline performance, availability, and responsiveness.
- Use agentic tooling and modern LLM software to produce code and architecture, with monitoring and oversight.
PythonSQLApache Airflow+4 more