Sr. Data Platform Engineer
New
R
Real TimeHealthcare Analytics
Remote/Work from anywhere work environment within the United States.Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- AWSPostgreSQLPythonSQLETLMicrosoft SQL ServerC#TerraformData modelingPySpark
Requirements
- 5+ years of professional experience in data engineering or software engineering.
- Advanced proficiency with Python and PySpark for large-scale data processing.
- Strong SQL development, ETL/ELT design, and query tuning expertise.
- Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC).
- Experience with Terraform or Terragrunt for infrastructure as code.
- Practical knowledge of SQL Server and PostgreSQL migration patterns.
- Working knowledge of C# for application and data integrations.
- Strong grasp of data modeling, architecture, and governance.
- Bachelor’s degree.
- Ability to work independently and manage priorities in a remote environment.
Responsibilities
- Design, build, and optimize batch and streaming data pipelines using PySpark, Python, and SQL.
- Lead SQL Server to PostgreSQL migration efforts, including schema translation and performance tuning.
- Implement and maintain Terraform infrastructure for AWS services like S3, Glue, and Redshift.
- Perform AWS workload optimization and cost analysis.
- Develop frameworks for data quality, monitoring, and reconciliation.
- Apply software engineering best practices, including version control and CI/CD.
- Provide technical mentorship and participate in a rotating on-call schedule.
View Full Description & ApplyYou'll be redirected to the employer's site
