Senior Data Engineer
New
I
Inallmedia.comData Engineering
Remote from LATAM, EST (±2 hours overlap); flexibility to overlap a minimum of 4 core working hours with US time zones is expected.ContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Advanced/Fluent English
- Experience
- 5+ years
- Required Skills
- AWSPythonSQLApache AirflowSnowflakeTerraformdbtPySpark
Requirements
- 5+ years of dedicated, hands-on data engineering experience.
- Deep expertise in Snowflake data modeling, datamarts, and warehouse design.
- Proficiency in Google BigQuery querying and optimization.
- Expertise in dbt for data transformations.
- Strong object-oriented Python scripting capabilities.
- Hands-on experience with REST API integrations and real-time data ingestion.
- Proficiency in Apache Airflow for pipeline orchestration.
- Advanced, highly optimized SQL writing skills.
- Demonstrated experience in secure handling of large-scale sensitive data (PII).
- Ability to write comprehensive technical documentation.
- Experience working in Agile teams and remote, distributed environments.
- Advanced/Fluent English communication skills.
Responsibilities
- Develop, optimize, and maintain secure data pipelines using dbt, PySpark, Python, and Apache Airflow to ingest HR data sources.
- Provision, configure, and maintain scalable infrastructure for ETL processes utilizing Terraform, AWS Glue, AWS EMR, and AWS S3.
- Design and maintain optimized data models, data marts, and warehouse structures across Snowflake and Google BigQuery.
- Build semantic views and ontology layers on top of dbt models to provide business-friendly abstractions for BI tools and LLM agents.
- Configure and deploy generative AI query agents using Snowflake Cortex and maintain Model Context Protocol (MCP) connections.
- Monitor pipelines for 99.5% uptime, build automated tests for data quality, ensure PII compliance, and produce technical documentation.
View Full Description & ApplyYou'll be redirected to the employer's site
