Senior Data Engineer

Posted about 2 months agoViewed

View full description

💎 Seniority level: Senior, 5+ years

📍 Location: United States

💸 Salary: 100000.0 - 120000.0 USD per year

🔍 Industry: Healthcare Technology

🏢 Company: Found👥 51-100💰 $45,999,997 Series C 9 months agoFinancial Services Banking FinTech

🗣️ Languages: English

⏳ Experience: 5+ years

🪄 Skills: PythonSQLApache AirflowETLSnowflakePandasSpark

Requirements:

Bachelor’s or Master’s degree in Computer Science or related field
5+ years of experience in data engineering
Expertise in SQL and data manipulation languages
Proficiency in data pipeline tools (Airflow, AWS Glue, Spark/PySpark, Pandas)
Strong programming skills in Python
Experience with Snowflake, Redshift, Databricks, Glue Catalog/S3

Responsibilities:

Design, implement, and manage data pipelines
Develop and maintain data models
Design and implement data warehousing solutions
Develop and optimize ETL processes
Implement data quality checks
Monitor and optimize data pipelines and queries
Collaborate with data analysts and stakeholders
Create and maintain documentation

Apply

Related Jobs

Apply

🔥 Senior Data Engineer

Posted 2 days ago

📍 United States, Canada

🧭 Full-Time

🔍 B2B SaaS

🏢 Company: Sanity

🔧 Requirements

4+ years of experience building data pipelines at scale
Deep expertise in SQL, Python, and Node.js/TypeScript
Production experience with Airflow and RudderStack
Track record of building reliable data infrastructure

💡 Responsibilities

Design, develop, and maintain scalable ETL/ELT pipelines
Collaborate to implement and scale product telemetry
Establish best practices for data ingestion and transformation
Monitor and optimize data pipeline performance

Node.jsPythonSQLApache AirflowETLTypeScript

Posted 2 days ago

Apply

🔥 Senior Data Engineer

Posted 3 days ago

📍 United States, Canada

🧭 Full-Time

🔍 E-commerce

🔧 Requirements

Bachelor's or Master's degree in Computer Science or related field
5+ years of experience in data engineering
Strong proficiency in SQL and database technologies
Experience with data pipeline orchestration tools
Proficiency in programming languages like Python and Scala
Hands-on experience with AWS cloud data services
Familiarity with big data frameworks like Apache Spark
Knowledge of data modeling and warehousing
Experience implementing CI/CD for data pipelines
Real-time data processing architectures experience

💡 Responsibilities

Design, develop, and maintain ETL/ELT pipelines
Optimize data architecture and storage solutions
Work with AWS for scalable data solutions
Ensure data quality, integrity, and security
Collaborate with cross-functional teams
Monitor and troubleshoot data workflows
Create APIs for analytical information

AWSPostgreSQLPythonSQLApache AirflowETLKafkaMySQLSnowflakeCI/CDScala

Posted 3 days ago

Apply

🔥 Senior Data Engineer

Posted 6 days ago

📍 United States, Canada

🧭 Full-Time

🔍 Software Development

🏢 Company: BioRender👥 101-250💰 $15,319,133 Series A almost 2 years agoLife Science Graphic Design Software

🔧 Requirements

7+ years of data engineering experience of relevant industry experience
Expertise working with Data Warehousing platforms (AWS RedShift or Snowflake preferred) and data lake / lakehouse architectures
Experience with Data Streaming platforms (AWS Kinesis / Firehose preferred)
Expertise with SQL and programming languages commonly used in data platforms (Python, Spark, etc)
Experience with data pipeline orchestration (e.g., Airflow) and data pipeline integrations (e.g. Airbyte, Stitch)

💡 Responsibilities

Building and maintaining the right architecture and tooling to support our data science, analytics, product, and machine learning initiatives.
Solve complex architectural problems
Translate deeply technical designs into business appropriate representations as well as analyze business needs and requirements ensuring implementation of data services directly correlates to the strategy and growth of the business

AWSPythonSQLApache AirflowSnowflakeData engineeringSparkData modeling

Posted 6 days ago

Apply

🔥 Senior Data Engineer, Capacity Systems & Analytics

Posted 12 days ago

📍 United States

🧭 Full-Time

💸 175000.0 - 205000.0 USD per year

🔍 Software Development

🏢 Company: CoreWeave💰 $642,000,000 Secondary Market about 1 year agoCloud Computing Machine Learning Information Technology Cloud Infrastructure

🔧 Requirements

Hands-on experience applying Kimball Dimensional Data Modeling principles to large datasets.
Expertise in working with analytical table/file formats, including Iceberg, Parquet, Avro, and ORC.
Proven experience optimizing MPP databases (StarRocks, Snowflake, BigQuery, Redshift).
Minimum 5+ years of programming experience in Python or Scala.
Advanced SQL skills, with a strong ability to write, optimize, and debug complex queries.
Hands-on experience with Airflow for batch orchestration distributed computing frameworks like Spark or Flink.

💡 Responsibilities

Develop and maintain data models, including star and snowflake schemas, to support analytical needs across the organization.
Establish and enforce best practices for dimensional modeling in our Lakehouse.
Engineer and optimize data storage using analytical table/file formats (e.g., Iceberg, Parquet, Avro, ORC).
Partner with BI, analytics, and data science teams to design datasets that accurately reflect business metrics.
Tune and optimize data in MPP databases such as StarRocks, Snowflake, BigQuery, or Redshift.
Collaborate on data workflows using Airflow, building and managing pipelines that power our analytical infrastructure.
Ensure efficient processing of large datasets through distributed computing frameworks like Spark or Flink.

AWSDockerPythonSQLCloud ComputingETLKubernetesSnowflakeAirflowAlgorithmsApache KafkaData engineeringData StructuresREST APISparkCommunication SkillsAnalytical SkillsCollaborationCI/CDRESTful APIsDevOpsTerraformProblem-solving skillsJSONScalaData visualizationAnsibleData modelingData analyticsDebugging

Posted 12 days ago

Apply

🔥 Senior Data Engineer - Contract to Hire (REMOTE)

Posted 17 days ago

📍 OR, WA, CA, CO, TX, IL

🧭 Contract

💸 65.0 - 75.0 USD per hour

🔍 Music industry

🏢 Company: Discogs👥 51-100💰 $2,500,000 about 7 years agoDatabase Communities Music

🔧 Requirements

Proficiency in data integration and ETL processes.
Knowledge of programming languages such as Python, Java, or Javascript.
Familiarity with cloud platforms and services (e.g., AWS, GCP, Azure).
Understanding of data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake).
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills to work effectively with cross-functional teams.
Experience with marketing automation platforms.
Experience with data warehouses in a marketing context.
Knowledge of API integration and data exchange formats such as JSON, XML, and CSV.

💡 Responsibilities

Design, develop, and maintain data pipelines to ingest, process, and store data.
Implement data validation and quality checks to maintain the integrity of incoming data.
Optimize and automate data workflows to improve efficiency and reduce manual intervention.
Work closely with the product, engineering, marketing and analytics teams to support data-driven decision-making.
Develop and maintain documentation related to data processes, workflows, and system architecture.
Troubleshoot and resolve data-related issues promptly to minimize disruptions.
Monitor and enhance the performance of data infrastructure, ensuring scalability and reliability.
Stay updated with industry trends and best practices in data engineering to apply improvements.

AWSPythonApache AirflowETLGCPMySQLSnowflakeApache KafkaAzureJSON

Posted 17 days ago

Apply

🔥 Senior Data Engineer

Posted 21 days ago

📍 United States

💸 104981.0 - 157476.0 USD per year

🔍 Mental healthcare

🏢 Company: Headspace👥 11-50 Wellness Health Care Child Care

🔧 Requirements

7+ years of proven success designing and implementing large-scale enterprise data systems.
Deep experience with industry-leading tools such as Databricks, Snowflake, and Redshift.
Demonstrated expertise in architectural patterns for building high-volume real-time and batch ETL pipelines.
Proven ability to partner effectively with product teams to drive alignment and deliver solutions.
Exceptional oral and written communication abilities.
Experience in coaching and mentoring team members.

💡 Responsibilities

Architect and implement robust data pipelines to ingest, aggregate, and index diverse data sources into the organization’s data lake.
Lead the creation of a secure, compliant, and privacy-focused data warehousing solution tailored to healthcare industry requirements.
Partner with the data analytics team to deliver a data platform that supports accurate reporting on business metrics.
Collaborate with data science and machine learning teams to build tools for rapid experimentation and innovation.
Mentor and coach data engineers while promoting a culture valuing data as a strategic asset.

AWSETLSnowflakeData engineeringData modeling

Posted 21 days ago

Apply

🔥 Senior Data Engineer

Posted 24 days ago

📍 United States, Canada

🧭 Regular

💸 125000.0 - 160000.0 USD per year

🔍 Digital driver assistance services

🏢 Company: Agero👥 1001-5000💰 $4,750,000 over 2 years agoAutomotive InsurTech Information Technology Insurance

🔧 Requirements

Bachelor's degree in a technical field and 5+ years or Master's degree with 3+ years of industry experience.
Extensive experience with Snowflake or other cloud-based data warehousing solutions.
Expertise in ETL/ELT pipelines using tools like Airflow, DBT, Fivetran.
Proficiency in Python for data processing and advanced SQL for managing databases.
Solid understanding of data modeling techniques and cost management strategies.
Experience with data quality frameworks and deploying data solutions in the cloud.
Familiarity with version control systems and implementing CI/CD pipelines.

💡 Responsibilities

Develop and maintain ETL/ELT pipelines to ingest data from diverse sources.
Monitor and optimize cloud costs while performing query optimization in Snowflake.
Establish modern data architectures including data lakes and warehouses.
Apply dimensional modeling techniques and develop transformations using DBT or Spark.
Write reusable and efficient code, and develop data-intensive UIs and dashboards.
Implement data quality frameworks and observability solutions.
Collaborate cross-functionally and document data flows, processes, and architecture.

AWSPythonSQLApache AirflowDynamoDBETLFlaskMongoDBSnowflakeFastAPIPandasCI/CDData modeling

Posted 24 days ago

Apply

🔥 Senior Data Engineer - Verikai

Posted about 1 month ago

📍 United States of America

🧭 Full-Time

💸 110000.0 - 160000.0 USD per year

🔍 Insurance industry

🏢 Company: Verikai_External

🔧 Requirements

Bachelor's degree or above in Computer Science, Data Science, or a related field.
At least 5 years of relevant experience.
Proficient in SQL, Python, and data processing frameworks such as Spark.
Hands-on experience with AWS services including Lambda, Athena, Dynamo, Glue, Kinesis, and Data Wrangler.
Expertise in handling large datasets using technologies like Hadoop and Spark.
Experience working with PII and PHI under HIPAA constraints.
Strong commitment to data security, accuracy, and compliance.
Exceptional ability to communicate complex technical concepts to stakeholders.

💡 Responsibilities

Design, build, and maintain robust ETL processes and data pipelines for large-scale data ingestion and transformation.
Manage third-party data sources and customer data to ensure clean and deduplicated datasets.
Develop scalable data storage systems using cloud platforms like AWS.
Collaborate with data scientists and product teams to support data needs.
Implement data validation and quality checks, ensuring accuracy and compliance with regulations.
Integrate new data sources to enhance the data ecosystem and document data strategies.
Continuously optimize data workflows and research new tools for the data infrastructure.

AWSPythonSQLDynamoDBETLSpark

Posted about 1 month ago

Apply

🔥 Senior Data Engineer

Posted about 1 month ago

📍 United States

💸 229500.0 - 280500.0 USD per year

🔍 Event analytics

🏢 Company: Mixpanel👥 251-500💰 $200,000,000 Series C over 3 years agoWeb Apps SaaS Analytics Mobile Apps

🔧 Requirements

A strong background in both data and software engineering, with at least 5 years of professional experience.
Proficiency with at least one programming language (Python, Java, etc.) and SQL.
Excellent debugging and technical investigation skills.
Excellent technical communication skills, ideally in a remote environment.
Familiarity with rETL tools (e.g., Hightouch, Census, Rudderstack).
Experience with modern data storage technologies (e.g., BigQuery SQL, Airflow, DBT or similar).

💡 Responsibilities

Build and maintain software and data pipelines across backend and data orchestration systems.
Design and build data architecture spanning a wide range of complex data.
Create and maintain foundational datasets to support analytics, modeling, and product/business needs.
Collaborate with, teach, and learn from engineers across the organization.
Work with Finance and Data Science to ensure relevance and understanding.
Participate in team on-call rotation to maintain system health.
Build testing and alerting features for data hygiene.
Write internal technical documentation for systems designed and maintained.

PythonSQLApache AirflowETLData engineeringDebugging

Posted about 1 month ago

Apply

🔥 Senior Data Engineer

Posted about 1 month ago

📍 South Africa, Mauritius, Kenya, Nigeria

🔍 Technology, Marketplaces

🔧 Requirements

BSc degree in Computer Science, Information Systems, Engineering, or related technical field or equivalent work experience.
3+ years related work experience.
Minimum of 2 years experience building and optimizing ‘big data’ data pipelines, architectures and maintaining data sets.
Experienced in Python.
Experienced in SQL (PostgreSQL, MS SQL).
Experienced in using cloud services: AWS, Azure or GCP.
Proficiency in version control, CI/CD and GitHub.
Understanding/experience in Glue and PySpark highly desirable.
Experience in managing data life cycle.
Proficiency in manipulating, processing and architecting large disconnected data sets for analytical requirements.
Ability to maintain and optimise processes supporting data transformation, data structures, metadata, dependency and workload management.
Good understanding of data management principles - data quality assurance and governance.
Strong analytical skills related to working with unstructured datasets.
Understanding of message queuing, stream processing, and highly scalable ‘big data’ datastores.
Strong attention to detail.
Good communication and interpersonal skills.

💡 Responsibilities

Suggest efficiencies and execute on implementation of internal process improvements in automating manual processes.
Implement enhancements and new features across data systems.
Improve streamline processes within data systems with support from Senior Data Engineer.
Test CI/CD process for optimal data pipelines.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Highly efficient in ETL processes.
Develop and conduct unit tests on data pipelines as well as ensuring data consistency.
Develop and maintain automated monitoring solutions.
Support reporting and analytics infrastructure.
Maintain data quality and data governance as well as upkeep of overall maintenance of data infrastructure systems.
Maintain data warehouse and data lake metadata, data catalogue, and user documentation for internal business users.
Ensure best practice is implemented and maintained on database.

AWSPostgreSQLPythonSQLETLGitCI/CD

Posted about 1 month ago

Apply