Senior Data Engineer
New
O
OportunFinancial services
Remote - MXFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years of experience in data engineering
- Required Skills
- PythonSQLApache AirflowETLHadoopJavaApache KafkaSparkScalaPySpark
Requirements
- Bring 8+ years of experience in data engineering, including data architecture, ETL, and database management.
- Have strong programming skills in Python or PySpark, plus experience with Java or Scala.
- Have experience building complex end-to-end data pipelines and data integration solutions.
- Have strong SQL knowledge and experience with relational and NoSQL databases.
- Have experience with big data technologies such as Spark, Kafka, Hadoop, or similar platforms.
- Have experience with orchestration and scheduling tools such as Airflow, Databricks, Jenkins, or similar technologies.
- Have experience designing and operating scalable, reliable, and secure data systems.
- Be familiar with cloud platforms such as AWS, Azure, or GCP and their data services.
- Have experience working in Agile environments such as Scrum, Lean, or Kanban.
- Have experience mentoring junior engineers and contributing to technical leadership.
- Have strong problem-solving and decision-making skills and written and verbal communication skills.
Responsibilities
- Design and implement scalable, efficient, and reliable data architectures for business and analytical needs.
- Build and maintain data pipelines, ETL processes, and integration solutions for structured and unstructured data.
- Optimize data pipelines, databases, data warehouses, and data lakes for performance, reliability, scalability, and security.
- Translate stakeholder data requirements and business needs into data models and solutions.
- Establish data quality standards, validation rules, documentation, and governance practices.
- Implement monitoring and observability practices to identify bottlenecks and improve platform reliability.
- Lead and contribute to code reviews and provide technical leadership on architecture and platform design.
- Mentor junior engineers and lead features and projects across engineering teams.
- Troubleshoot production issues, perform root-cause analysis, and drive long-term resolutions.
View Full Description & ApplyYou'll be redirected to the employer's site
