Senior Data Platform Engineer
New
P
PeratonData platforms
United StatesFull-TimeSenior
Salary$112,000 - $179,000
Apply NowOpens the employer's application page
Job Details
- Experience
- 4 years building and maintaining production data pipelines. Minimum of 8 years with BS/BA; Minimum of 6 years with MS/MA
- Required Skills
- AWSPythonSQLETLGCPAzureCI/CDTerraform
Requirements
- Have 4 years of experience building and maintaining production data pipelines.
- Demonstrate strong proficiency in Python and SQL.
- Have hands-on experience with ETL and data pipeline development and sound analytical data modeling.
- Have working familiarity with cloud data platforms; Azure is preferred, while AWS or GCP are also acceptable.
- Have familiarity with version control and CI/CD workflows.
- Meet the experience requirement of at least 8 years with a BS/BA or at least 6 years with an MS/MA.
- Databricks or a comparable lakehouse stack such as Spark, Delta, dbt, or Snowflake is preferred.
- Exposure to Terraform and CI/CD for data workloads is preferred.
- Experience in regulated or accredited environments, including FedRAMP, NIST 800-171, CMMC, or CUI handling, is preferred.
- Familiarity with data governance or cataloging tools and orchestration tools such as Airflow or dbt is preferred.
Responsibilities
- Build, test, and maintain data ingestion, transformation, and pipeline code that turns raw and synthetic data into governed, analysis-ready data products.
- Extend the platform using the architecture, patterns, and standards set by the lead platform engineer.
- Contribute to Terraform infrastructure-as-code and CI/CD pipelines that promote work into the accredited production environment.
- Monitor data quality, pipeline reliability, and performance; troubleshoot and resolve issues.
- Apply data governance, cataloging, and access-control practices within the established framework.
- Deliver governed datasets and tooling to support the data science and ML team.
- Operate within FedRAMP Moderate, NIST 800-171, and CUI constraints in day-to-day engineering.
- Collaborate with the engineering team and document pipelines and processes.
View Full Description & ApplyYou'll be redirected to the employer's site
