Sr. Data Platform Engineer
New
Remote/Work from anywhere work environment within the United States.Full-TimeSenior
SalaryCompetitive base salary
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of professional experience in data engineering or software engineering roles
- Required Skills
- AWSPostgreSQLPythonSQLETLMicrosoft SQL ServerC#TerraformData modelingPySpark
Requirements
- 5+ years of professional experience in data engineering or software engineering roles.
- Advanced skills with Python and PySpark for large-scale data processing.
- Strong SQL development experience, including query tuning and ETL/ELT design.
- Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC).
- Experience with Terraform/Terragrunt for AWS infrastructure automation.
- Familiarity with SQL Server and PostgreSQL, including database optimization and migration patterns.
- Working knowledge of C# for application/data integrations.
- Strong grasp of data modeling, architecture, and governance best practices.
- Bachelor’s degree required.
- Excellent problem-solving skills, ability to self-manage, and comfort working in environments with changing priorities.
- Excellent verbal, written, and presentation skills.
Responsibilities
- Design, build, and optimize data pipelines (batch and streaming) using PySpark, Python, and SQL.
- Lead and support SQL Server to PostgreSQL migration efforts, including schema translation, performance tuning, and data validation.
- Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.).
- Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements.
- Develop frameworks for data quality, monitoring, and reconciliation.
- Collaborate with business stakeholders and other engineers to translate requirements into scalable solutions.
- Apply software engineering best practices to data engineering workflows.
- Contribute to standards, best practices, and technical mentorship across the team.
- Participate in a rotating on-call schedule to provide production support.
View Full Description & ApplyYou'll be redirected to the employer's site
