Senior Data Engineer
New
O
OportunFinancial Services
Remote - MXFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- PythonSQLHadoopJavaKafkaAirflowSparkScalaDatabricksPySpark
Requirements
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- 5+ years of experience in data engineering, with a focus on data architecture, ETL, and database management.
- Proficiency in programming languages like Python/PySpark and Java or Scala.
- Expertise in big data technologies such as Hadoop, Spark, Kafka, etc.
- In-depth knowledge of SQL and experience with various database technologies (e.g., PostgreSQL, MariaDB, NoSQL databases).
- Experience and expertise in building complex end-to-end data pipelines.
- Experience with orchestration and designing job schedules using CI/CD tools like Jenkins, Airflow, or Databricks.
- Ability to work in an Agile environment (Scrum, Lean, Kanban, etc.).
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
- Strong leadership, problem-solving, and decision-making skills.
- Excellent communication and collaboration abilities.
Responsibilities
- Lead the design and implementation of scalable, efficient, and robust data architectures.
- Design and develop data pipelines, ETL processes, and data integration solutions for structured and unstructured data.
- Oversee the management and maintenance of databases, data warehouses, and data lakes.
- Establish and enforce data quality standards, validation rules, and governance practices.
- Provide technical leadership and mentorship to junior team members.
- Collaborate with cross-functional stakeholders to define data requirements and translate them into technical solutions.
- Implement monitoring systems to track data pipeline performance and optimize for efficiency.
View Full Description & ApplyYou'll be redirected to the employer's site
