Senior Data Engineer
New
M
MinderaData engineering
Choose a remote setup that works for you. As long as you are based in Portugal :)Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluent English
- Required Skills
- AWSPythonSQLApache AirflowGCPMicrosoft Azure
Requirements
- Have proven production experience building and running data pipelines.
- Use advanced, production-grade SQL and Python.
- Have production depth in at least one major cloud provider: AWS, GCP, or Azure.
- Understand principles for moving between cloud platforms.
- Have production experience with an orchestrator such as Airflow, Dagster, or Azure Data Factory, or an equivalent.
- Be fluent in English.
- Be comfortable working directly with customer teams.
- Integrate AI tooling into daily work and verify generated output before it ships.
- Cost engineering experience, including quantifying pipeline savings, is valued.
- Exposure to regulated environments, including GDPR obligations, access control, and auditable lineage, is valued.
Responsibilities
- Build and operate batch and streaming ingestion pipelines from databases, event streams, and third-party APIs.
- Own storage architecture across the lake, lakehouse, and warehouse.
- Optimize partitioning, cost efficiency, and query speed.
- Implement orchestration, automated testing, and alerting to keep pipelines observable and restartable.
- Ensure clean recovery when pipelines break.
- Implement infrastructure as code and CI/CD for data workloads.
- Conduct code reviews and maintain strict version control.
- Agree on data contracts with data-producing teams to manage schema drift.
- Manage data access, retention, and lineage.
- Produce clear and comprehensive documentation.
View Full Description & ApplyYou'll be redirected to the employer's site
