Software Engineer - Data Engineering
New
USAFull-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- AWSPythonSQLData modelingdbtDatabricks
Requirements
- Bachelor’s degree in Computer Science, Data Science, Engineering, or a related technical field.
- 7+ years of progressive experience in data or software engineering.
- Advanced programming skills in Python and SQL.
- Experience building globally distributed data systems and real-time pipelines.
- Hands-on experience with orchestration/stream processing tools like Temporal, Dagster, Airflow, Spark, or Kafka.
- Strong knowledge of relational and NoSQL databases (e.g., Postgres, MySQL, MongoDB, ElasticSearch, Cassandra).
- Familiarity with data warehousing and cloud computing (Databricks and AWS preferred).
- Experience mentoring engineers and providing architectural direction.
- Experience with both OLTP and OLAP data processing systems.
Responsibilities
- Design and implement the long-term data architecture using modern technologies and frameworks.
- Build and maintain scalable ETL/ELT pipelines in Python, SQL, and dbt.
- Develop and operate data pipelines using orchestration frameworks such as Temporal and Dagster.
- Design data models and schemas for our cloud warehouse (Databricks) and relational databases.
- Optimize workflows for performance and cost efficiency.
- Drive large, cross-functional data initiatives from planning to execution.
- Partner with AI and engineering teams to ensure high-quality datasets for machine learning and analytics.
- Collaborate with product managers, scientists, and engineers to gather requirements.
- Mentor other engineers in best practices for data ingestion and pipeline design.
View Full Description & ApplyYou'll be redirected to the employer's site
