Senior Data Engineer
New
C
Care AccessClinical research
Remote within the United States.Full-TimeSenior
Salary120,000 - 160,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of experience in data engineering
- Required Skills
- PythonSQLAirflowAzureData engineeringCI/CDdbtDatabricks
Requirements
- Bachelor’s or master’s degree in computer science, Information Systems, Engineering, or a related field.
- 5+ years of experience in data engineering.
- Proven track record of building cloud-based, production-grade data pipelines.
- Strong expertise in Databricks, SQL, dbt, and Python.
- Experience with cloud data ecosystems such as Azure.
- Experience working with structured and semi-structured data from diverse domains.
- Familiarity with CI/CD pipelines and orchestration tools such as Airflow and Azure Data Factory.
- Familiarity with modern software engineering practices.
- Strong analytical and problem-solving skills.
Responsibilities
- Design and implement scalable, reliable data pipelines for clinical, operational, and business needs.
- Develop and maintain architecture standards, reusable frameworks, and data engineering best practices.
- Build automated systems for data ingestion, transformation, and orchestration.
- Optimize data storage and processing in data lakes and cloud data warehouses, including Azure and Databricks.
- Develop and monitor batch and streaming processes for data accuracy, consistency, and timeliness.
- Maintain documentation and lineage tracking across datasets and pipelines.
- Integrate APIs, structured and unstructured data sources, and third-party systems into centralized data platforms.
- Collaborate with analysts, data scientists, software engineers, and business stakeholders to deliver data solutions.
- Review team members’ work, provide technical mentorship, and collaborate with contractors and vendors.
- Evaluate technologies and propose improvements to scalability, observability, automation, efficiency, and performance.
View Full Description & ApplyYou'll be redirected to the employer's site