Senior Data Engineer II

New
This role is open to candidates residing in the US and Canada except the San Francisco Bay Area and New York Metro City.Full-TimeSenior
Salary$134,470—$203,400 USD
Apply NowOpens the employer's application page

Job Details

Experience
10+ years of work experience as a Software Engineer with data focus or as Data Engineer.
Required Skills
AWSPythonSQLFastAPISparkData modelingDatabricksPySpark

Requirements

  • Bachelor's degree in computer science, data engineering, data science, information technology, or an equivalent engineering program.
  • 10+ years of work experience as a Software Engineer with data focus or as Data Engineer.
  • 8+ years of experience building and maintaining large-scale, production-grade end-to-end data pipelines, including Data Modeling.
  • 5+ years of hands-on Spark / PySpark in a production environment, including job optimization.
  • 3+ years of hands-on experience developing and managing APIs, preferably in Python.
  • Strong programming capabilities in Python and SQL.
  • Experience with cloud data warehouse/lakehouse platforms (e.g., Snowflake, Google BigQuery, Databricks, or Apache Iceberg).
  • Familiarity with ETL tools such as Fivetran or dbt.
  • Experience with RDBMS such as MySQL, AWS RDS/Aurora, PostgreSQL, Oracle, or MS SQL Server.
  • Experience working within AWS, Azure, or GCP cloud environments.

Responsibilities

  • Develop and maintain end-to-end data pipelines and backend ingestion workflows.
  • Participate in the build of the Data Platform to enable advanced automation and analytics.
  • Design, build, and operate large-scale Spark and PySpark workflows for batch and streaming data processing.
  • Design, build, and manage data APIs in Python using frameworks such as FastAPI.
  • Build and maintain MCP servers that expose data assets and engineering workflows to AI models.
  • Define and enforce data engineering standards, patterns, and best practices.
  • Provide mentorship to junior team members and deliver technical guidance.
  • Engage with cross-functional stakeholders to design scalable data solutions.
View Full Description & ApplyYou'll be redirected to the employer's site
$134,470—$203,400 USD
Apply Now