Senior Data Engineer (Python)
New
P
ProxifyData Engineering
Discover exclusive long-term remote positions at the world's most exciting companies.Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- PythonSQLApache AirflowGitSnowflakePandasBigQuerydbtPySpark
Requirements
- 5+ years of experience building complex data processing applications using Python (Pandas, PySpark, or Dask).
- Advanced SQL skills for complex transformations, window functions, and query optimization in cloud warehouses.
- Deep experience with dbt (data build tool) for managing the T in ELT, including documentation and testing.
- Proven experience with Apache Airflow, Prefect, or Dagster for managing complex dependency graphs.
- Hands-on experience with Snowflake, BigQuery, or AWS Redshift.
- Strong understanding of Dimensional Modeling (Star/Snowflake schema) and Data Vault 2.0.
- Experience with Git, Docker, and implementing CI/CD for data pipelines.
Responsibilities
- Build and maintain scalable, automated ELT/ETL pipelines that provide a 'single source of truth' for the organization.
- Implement rigorous automated testing and monitoring to ensure data integrity and reliability.
- Optimize warehouse storage and compute costs while reducing pipeline latency.
- Partner with Data Scientists and Product Managers to translate business requirements into technical data models.
- Promote a 'DataOps' culture within the team, conducting code reviews and sharing best practices.
View Full Description & ApplyYou'll be redirected to the employer's site
