Senior Data Engineer
New
I
InMarketMarketing Technology
Location: RemoteFull-TimeSenior
Salary$140,000 to $175,000
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 4 years of software engineering experience
- Required Skills
- DockerPythonSQLApache AirflowETLHadoopJavaKubernetesSparkBigQuery
Requirements
- At least 4 years of software engineering experience, ideally in data engineering.
- Strong SQL experience.
- Expertise in at least one data pipelining orchestration framework (e.g., Airflow, Luigi).
- Experience building ETL pipelines.
- Strong software engineering skills in an object-oriented language such as Java or Python.
- Experience building and optimizing a data warehouse on a major cloud platform.
- Deep understanding of Big Data technologies such as Hadoop and Spark.
- Knowledge of Kubernetes, Docker, Git, and CI/CD best practices.
- Strong collaboration and communication skills.
- B.S. or M.S. in Computer Science or a related technical field.
Responsibilities
- Design and implement ETL pipelines in Apache Airflow, BigQuery, Python, and Spark to transform upstream source data into curated data assets.
- Architect and plan projects involving highly distributed, high-performance data platform systems.
- Identify areas for improvement in existing pipelines and processes.
- Understand business requirements and convert them into technical solutions.
- Provide technical guidance to other engineers to help grow their knowledge and technical capabilities.
- Lead fellow engineers in defining technical solutions to business problems.
- Collaborate with end users to define key business questions and work with Product Managers to build datasets that answer those questions.
View Full Description & ApplyYou'll be redirected to the employer's site
