Senior DataOps Engineer
New
I
IRIUMData Infrastructure
PortugalFull-TimeSenior
Salary3,571 - 4,100 EUR per month
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years in data engineering
- Required Skills
- AWSPythonSQLKafkaSnowflakeAirflowSparkCI/CDdbt
Requirements
- 5+ years in data engineering, with solid DevOps/platform engineering exposure.
- Strong SQL and data modelling skills (dimensional, normalised, lakehouse).
- Proficient in Python; working knowledge of Scala, Java, or Go.
- Hands-on experience with data pipeline/orchestration tools (Airflow, DBT).
- Experience with distributed processing frameworks (Spark, Flink, or similar).
- Advanced AWS expertise (Glue, EMR, Redshift, Athena, S3, Lambda, Kinesis).
- Experience with CI/CD tools (GitHub Actions, GitLab CI, Jenkins, CircleCI).
- Experience with Infrastructure as Code (CDK, CloudFormation).
- Experience with streaming/event-driven architecture (Kafka, Kinesis, Apache Flink, or Pub/Sub).
- Familiarity with observability tools: Grafana, CloudWatch.
- Expertise with data warehouse platforms (Redshift, Snowflake).
Responsibilities
- Design, build, and maintain scalable, reliable data pipelines (batch and streaming).
- Develop and optimise data models, warehouses, and lakehouse architectures.
- Build and automate CI/CD pipelines for data workflows and deployments.
- Ensure data quality, integrity, lineage, and governance across environments.
- Implement proactive monitoring and alerting for pipelines and data infrastructure.
- Manage IaC for consistent, reliable data infrastructure.
- Troubleshoot and optimise pipeline and query performance across environments.
- Lead incident resolution and root cause analysis for data systems.
- Collaborate with analysts, data scientists, and engineering teams to translate data requirements into technical solutions.
- Document data architecture, lineage, and workflows.
View Full Description & ApplyYou'll be redirected to the employer's site
