Apply

Sr. Data Engineer

Posted 4 months agoViewed

View full description

💎 Seniority level: Senior, 5+ years

📍 Location: United States

💸 Salary: 150000.0 - 165000.0 USD per year

🔍 Industry: Healthcare

🏢 Company: Transcarent👥 251-500💰 $126,000,000 Series D about 1 year agoPersonal HealthHealth CareSoftware

⏳ Experience: 5+ years

🪄 Skills: PythonSQLApache AirflowETLKafkaSnowflakeData engineering

Requirements:
  • You are entrepreneurial and mission-driven and can present your ideas with clarity and confidence.
  • You are a high-agency person. You refuse to accept undue constraints and the status quo and will not rest until you figure things out.
  • Advanced expertise in python and dbt for data pipelines.
  • Advanced working SQL knowledge and experience working with relational databases.
  • Experience building and optimizing big data pipelines, architectures, and data sets. A definite plus with healthcare experience.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • A successful history of manipulating, processing, and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
  • Strong project management and organizational skills.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
Responsibilities:
  • Be a data champion and seek to empower others to leverage the data to its full potential.
  • Create and maintain optimal data pipeline architecture with high observability and robust operational characteristics.
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal data extraction, transformation, and loading using SQL, python, and dbt from various sources.
  • Work with stakeholders, including the Executive, Product, Clinical, Data, and Design teams, to assist with data-related technical issues and support their data infrastructure needs.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Apply

Related Jobs

Apply
🔥 Sr. Data Engineer
Posted 25 days ago

📍 United States

🧭 Full-Time

💸 140000.0 - 175000.0 USD per year

🔍 Software Development

🏢 Company: InMarket👥 251-500💰 $11,500,000 Debt Financing about 4 years agoDigital MarketingAdvertisingMobile AdvertisingMarketing

  • Strong SQL experience
  • Expert in at least one data pipelining orchestration framework (Airflow, Luigi, etc.)
  • Experience building ETL pipelines
  • Strong software engineering skills in an Object Oriented language such as Java or Python
  • Experience building and optimizing a data warehouse on a major cloud platform (Big Query preferred but not required)
  • Experience and deep understanding of Big Data Technologies such as Hadoop and Spark
  • Experience with building and optimizing large scale and high-performance systems
  • Extensive knowledge of data related tools and architecture concepts in a major cloud platform
  • Knowledge of Kubernetes, Docker, Airflow, Git, and CD/CI best practices
  • Strong collaboration and communication skills within and across teams
  • B.S. or M.S. in Computer Science or a related technical field
  • At least 4 years of software engineering experience, ideally in data engineering
  • Design and implement ETL pipelines in Apache Airflow, Big Query, Python, and Spark to transform various upstream sources data into curated data assets for use across InMarket’s vast array of data driven products
  • Stay up to date with and advocate internally for Data Engineering best practices, technologies, and testing frameworks that will help shape InMarket’s technical future
  • Architect and plan projects involving highly distributed and high performance data platform systems
  • Provide technical guidance to other engineers in order to help promote the growth of their knowledge and technical capabilities
  • Communicate complex concepts and the results of the analyses in a clear and effective manner to Product and Engineering Managers
  • Identify areas for improvement in existing pipelines and processes
  • Understand business requirements and convert them to technical solutions

DockerPythonSQLApache AirflowETLGitHadoopKubernetesData engineeringSparkCI/CD

Posted 25 days ago
Apply
Apply
🔥 Sr. Data Engineer
Posted 2 months ago

📍 United States

🧭 Full-Time

💸 175000.0 - 220000.0 USD per year

🔍 Healthcare

🏢 Company: Motion MSK

  • 4+ years of experience working with big data processing frameworks, such as Apache Spark (Scala or PySpark).
  • Hands-on experience building ETL pipelines for structured and semi-structured healthcare claims data.
  • Proficient in SQL and have experience working with distributed databases and data lakes (e.g., Delta Lake, Redshift, Snowflake).
  • Experience orchestrating workflows using Apache Airflow and managing data processing on AWS Glue or EMR.
  • Comfortable working in a cloud-native environment (AWS preferred) and using infrastructure-as-code tools like Terraform.
  • Design, build, and maintain scalable data pipelines to process claims data efficiently using Spark (Scala/PySpark), AWS Glue, and Airflow.
  • Work closely with analysts, backend engineers, and other stakeholders to ensure high data quality, reliability, and accessibility.
  • Optimize and tune distributed data processing workflows for performance and cost efficiency.
  • Develop and enforce best practices for data governance, schema evolution, and pipeline observability while understanding the nuances of security and compliance.
  • Implement automated testing, monitoring, and alerting for data workflows to ensure operational excellence.
  • Collaborate with stakeholders to define and implement data models that support analytics and business intelligence initiatives.

AWSSQLApache AirflowETLSnowflakeData engineeringTerraformScalaData visualizationData modelingData management

Posted 2 months ago
Apply
Apply
🔥 Sr. Data Engineer
Posted 7 months ago

📍 United States

🧭 Contract

🏢 Company: Two95 International Inc.

  • Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Statistics, or a closely related field (foreign education equivalent accepted).
  • Experience with AWS services for data and analytics.
  • 5 years of experience in data ingestion, extraction, and integration.
  • 5+ years of hands-on experience with the Mark Logic framework.
  • The role focuses on data ingestion, extraction, and integration.
  • Utilizing AWS services for data and analytics.
  • Implementing solutions using the Mark Logic framework.

AWSAmazon Web ServicesData engineering

Posted 7 months ago
Apply