Sr. Data Platform Engineer
New
R
Real TimeHealthcare Analytics
Remote/Work from anywhere work environment within the United States.Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- AWSPostgreSQLPythonSQLETLMicrosoft SQL ServerC#CI/CDTerraformPySpark
Requirements
- 5+ years of professional experience in data engineering or software engineering roles.
- Advanced skills with Python and PySpark for large-scale data processing.
- Strong SQL development experience, including query tuning and ETL/ELT design.
- Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC).
- Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation.
- Familiarity with SQL Server and PostgreSQL, including database optimization and migration patterns.
- Working knowledge of C# for application/data integrations.
- Strong grasp of data modeling, architecture, and governance best practices.
- Bachelor’s degree required.
- Excellent problem-solving skills and ability to self-manage.
- Strong verbal, written, and presentation skills.
Responsibilities
- Design, build, and optimize data pipelines (batch and streaming) using PySpark, Python, and SQL.
- Lead and support SQL Server → PostgreSQL migration efforts, including schema translation, performance tuning, and data validation.
- Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.).
- Conduct performance and cost optimization reviews of AWS workloads.
- Develop frameworks for data quality, monitoring, and reconciliation.
- Collaborate with business stakeholders to translate requirements into scalable solutions.
- Apply software engineering best practices including version control, CI/CD, testing, and code reviews.
- Participate in a rotating on-call schedule to provide production support.
View Full Description & ApplyYou'll be redirected to the employer's site
