Mid-Level Data Engineer, Databricks

J
JobgetherData engineering
Fully remote position within the United States.Full-TimeMiddle
SalaryAnnual compensation range of $100,000–$140,000 USD.
Apply NowOpens the employer's application page

Job Details

Experience
At least 5 years of experience in data engineering, data analysis, or a related technical field.
Required Skills
PythonSQLData modelingDatabricksPySpark

Requirements

  • Bachelor's degree in computer science, data science, information systems, engineering, or a related discipline, or equivalent professional experience.
  • At least 5 years of experience in data engineering, data analysis, or a related technical field.
  • Hands-on experience building and supporting Databricks data pipelines, including notebooks, PySpark or Spark SQL, and Delta tables.
  • Proficiency in Python and SQL for data transformation, querying, validation, and troubleshooting.
  • Understanding of ETL/ELT processes, data modeling, data integration, and data quality practices.
  • Ability to investigate data discrepancies, identify root causes, and implement solutions.
  • Strong documentation, communication, and problem-solving skills, including explaining technical issues and collaborating with technical and non-technical stakeholders.
  • Ability to take ownership of assigned work, manage time, adapt to shifting priorities, and keep stakeholders informed.
  • Experience integrating data through APIs is a nice-to-have.
  • Familiarity with Databricks Unity Catalog, Databricks Jobs or Workflows, and CI/CD deployment practices is a nice-to-have.
  • Experience with Google Cloud Platform (GCP) or federal government clients or projects is a nice-to-have.

Responsibilities

  • Design, develop, test, and maintain Databricks pipelines using Python, PySpark, and SQL.
  • Ingest, transform, and organize data from source systems into layered, reusable tables.
  • Build and maintain data products for analytics, reporting, and automation.
  • Validate datasets against source systems, investigate discrepancies, and correct data quality issues.
  • Apply ETL/ELT practices, data modeling principles, and quality controls.
  • Document pipelines, table definitions, transformation logic, and business rules.
  • Own assigned engineering tasks from development through delivery and production support.
  • Collaborate with engineers, data scientists, government stakeholders, and other team members to clarify requirements and deliver solutions.
  • Contribute to improvements in data engineering workflows, pipeline reliability, and shared dataset usability.
View Full Description & ApplyYou'll be redirected to the employer's site
Annual compensation range of $100,000–$140,000 USD.
Apply Now