Senior Data Engineer
New
V
Veeva SystemsLife Sciences SaaS
As a Work Anywhere company, we support your flexibility to work from home or in the officeFull-TimeSenior
SalaryBase pay: $115,000 - $175,000
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- PythonSQLApache AirflowSparkData modelingDatabricks
Requirements
- 5+ years of experience building data models and pipelines.
- 2+ years of production Airflow experience.
- 2+ years of experience with Spark at scale handling multi-TB datasets.
- Hands-on experience with AWS Glue.
- Strong proficiency in Python and SQL.
- Fluency in AWS services including S3, ECS/Fargate, Glue, IAM, and Secrets Manager.
- Strong communication skills with the ability to teach others and build team capability.
- Experience working with privacy-sensitive or governed data (nice to have).
- Experience with Databricks (nice to have).
- Familiarity with data science workflows or ML pipeline tooling (nice to have).
Responsibilities
- Own the Airflow codebase end-to-end, building reusable templates and scaling patterns.
- Act as the go-to expert for delivery teams regarding pipeline architecture and troubleshooting.
- Manage data onboarding, including connection setup, schema discovery, and initial pipeline design.
- Operate and extend large-scale Spark pipelines on AWS Glue and support migration to Databricks.
- Drive improvements in data models for patient claims, KOL, HCP, and CRM data with a focus on lineage and structure.
- Maintain the internal Python package used across the data team.
View Full Description & ApplyYou'll be redirected to the employer's site
