Sr. Data Engineer

Posted about 1 month agoViewed

💎 Seniority level: Senior, 7+ years of professional experience in software engineering including 5+ years of experience in data engineering

📍 Location: USA, Canada, Mexico

💸 Salary: 175000.0 USD per year

🔍 Industry: Digital tools for hourly employees

🏢 Company: TeamSense👥 11-50💰 Seed about 1 year agoInformation Services Information Technology Software

🗣️ Languages: English

⏳ Experience: 7+ years of professional experience in software engineering including 5+ years of experience in data engineering

🪄 Skills: PostgreSQLPythonSQLETLMongoDBData engineeringData modeling

Requirements:

Bachelor's or Master's degree in Computer Science, Software Engineering, or a related technical field.
7+ years of professional experience in software engineering including 5+ years of experience in data engineering.
Proven expertise in building and managing scalable data platforms.
Proficiency in Python.
Strong knowledge of SQL, data modeling, data migration and database systems such as PostgreSQL and MongoDB.
Exceptional problem-solving skills optimizing data systems.

Responsibilities:

As a Senior Data Engineer, your primary responsibility is to contribute to the design, development, and maintenance of a scalable and reliable data platform.
Analyze the current database and warehouse.
Design and develop scalable ETL/ELT pipelines to support data migration.
Build and maintain robust, scalable, and high-performing data platforms, including data lakes and/or warehouses.
Implement data engineering best practices and design patterns.
Guide design reviews for new features impacting data.

Apply

Related Jobs

Apply

🔥 Sr. Data Engineer (Remote)

Posted 11 days ago

📍 United States

💸 68800.0 - 113500.0 USD per year

🔍 Software Development

🏢 Company: external_career_site_usa

🔧 Requirements

3+ years of production-level experience within an organization using AWS infrastructure as code using CDK, SDK, and/or Terraform, Python, SQL, and Git.
Bachelor’s degree or above in quantitative or engineering fields (Computer Science, Statistics, Data Science, Mathematics or similar).
Experience orchestrating production and development data pipelines integrated with data quality tests.
Experience with application interfaces and APIs to ensure data output is easily ingested by other systems and processes.
Experience measuring and monitoring data validity, accuracy, consistency, timeliness, and relevance.

💡 Responsibilities

Work cross-functionally with data scientists, engineers, and product owners to understand, propose, implement, and orchestrate data pipelines and quality monitoring.
Develop and mature our data infrastructure and processes by developing foundational data models across products, operations, and finance.
Curate an analytic tier of valid, reliable data to fuel analytic research and development.
Prioritize data governance, quality monitoring, and documentation.
Be innately curious with a bias for action to develop solutions that balance speed and scale.
Foster a data-driven culture through training and documentation.
Mentor junior Analytic Engineers.

AWSDockerPythonSQLApache AirflowETLGitKubernetesAPI testingData engineeringData scienceREST APICommunication SkillsAnalytical SkillsCI/CDProblem SolvingLinuxDevOpsTerraformMicroservicesData modelingData analytics

Posted 11 days ago

Apply

🔥 Sr Data Engineer

Posted 11 days ago

📍 US, Europe and India

🔍 Software Development

🔧 Requirements

Extensive experience in developing data and analytics applications in geographically distributed teams
Hands-on experience in using modern architectures and frameworks, structured, semi-structured and unstructured data, and programming with Python
Hands-on SQL knowledge and experience with relational databases such as MySQL, PostgreSQL, and others
Hands-on ETL knowledge and experience
Knowledge of commercial data platforms (Databricks, Snowflake) or cloud data warehouses (Redshift, BigQuery)
Knowledge of data catalog and MDM tooling (Atlan, Alation, Informatica, Collibra)
CICD pipeline for continuous deployment (CloudFormation template)
Knowledge of how machine learning / A.I. workloads are implemented in batch and streaming, including the preparing of datasets, training models, and using pre-trained models
Exposure to software engineering processes that can be applied to Data Ecosystems

💡 Responsibilities

Design and develop our best-in-class cloud platform, working on all parts of the code stack from front-end, REST and asynchronous APIs, back-end application logic, SQL/NoSQL databases and integrations with external systems
Develop solutions across the data and analytics stack from ETL and Streaming data
Design and develop reusable libraries
Enhance strong processes in Data Ecosystem
Write unit and integration tests

PythonSQLApache AirflowCloud ComputingETLMachine LearningSnowflakeAlgorithmsApache KafkaData engineeringData StructuresCommunication SkillsAnalytical SkillsCI/CDRESTful APIsDevOpsMicroservicesExcellent communication skillsData visualizationData modelingData analyticsData management

Posted 11 days ago

Apply

🔥 Sr. Data Engineer

Posted 17 days ago

📍 United States

💸 150000.0 - 165000.0 USD per year

🔍 Healthcare

🏢 Company: Transcarent👥 251-500💰 $126,000,000 Series D 10 months agoPersonal Health Health Care Software

🔧 Requirements

You are entrepreneurial and mission-driven and can present your ideas with clarity and confidence.
You are a high-agency person. You refuse to accept undue constraints and the status quo and will not rest until you figure things out.
Advanced expertise in python and dbt for data pipelines.
Advanced working SQL knowledge and experience working with relational databases.
Experience building and optimizing big data pipelines, architectures, and data sets. A definite plus with healthcare experience.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
A successful history of manipulating, processing, and extracting value from large disconnected datasets.
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Strong project management and organizational skills.
Experience supporting and working with cross-functional teams in a dynamic environment.
Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.

💡 Responsibilities

Be a data champion and seek to empower others to leverage the data to its full potential.
Create and maintain optimal data pipeline architecture with high observability and robust operational characteristics.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal data extraction, transformation, and loading using SQL, python, and dbt from various sources.
Work with stakeholders, including the Executive, Product, Clinical, Data, and Design teams, to assist with data-related technical issues and support their data infrastructure needs.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

PythonSQLApache AirflowETLKafkaSnowflakeData engineering

Posted 17 days ago

Apply

🔥 Sr. Data Engineer

Posted about 1 month ago

📍 United States, Denver, Colorado, New York, New York, Dallas, Texas, Lisbon, Portugal

🧭 Full-Time

💸 190000.0 - 215000.0 USD per year

🔍 Healthcare

🏢 Company: Cleerly👥 11-50 Real Estate Investment Personal Finance Banking Wealth Management Insurance

🔧 Requirements

Bachelor’s degree in Computer Science, Engineering, or equivalent experience.
5+ years of software development experience.
2+ years as a Data Engineer.
Strong SQL developer skills including experience in Postgres, Redshift, Snowflake or similar.
Experience developing and maintaining Airflow DAGs.
Excellent knowledge of Python, TypeScript, or other programming languages.
Experience implementing and maintaining CI/CD solutions.
Experience working with version control systems such as GitHub.
Strong written and verbal communication skills in English.

💡 Responsibilities

Contribute to all facets of the Cleerly data platform focusing on scale, performance, and reliability.
Work closely with business intelligence, data science, and operations teams, as well as interdepartmental stakeholders.
Build Airflow DAGs for data transformation and create normalized data structures to ingest disparate client data.
Contribute to CI/CD pipeline and capabilities, build validation and training data sets in coordination with data scientists.
Design methods for searching and storing large amounts of imaging data at scale, and generate aggregate reporting tables.

PythonSQLSnowflakeAirflowPostgresCI/CD

Posted about 1 month ago

Apply

🔥 Sr. Data Engineer/Analyst - Contract

Posted about 2 months ago

📍 Mexico

🧭 Contract

🔍 Consulting

🏢 Company: Tech Holding👥 101-250 Consulting Finance Information Technology

🔧 Requirements

Bachelor’s degree in Computer Science, Data Science, or a related field.
5+ years of experience in data engineering, focusing on large-scale data pipelines.
Expertise in SQL for complex data analysis.
Strong programming skills in Python and shell scripting, with experience in Spark.
Hands-on experience with ETL tools and AWS cloud platforms.
Proficiency in working with relational databases and data warehouses.
Ability to scale data processing solutions and strong problem-solving skills.
Excellent communication and interpersonal skills.

💡 Responsibilities

Design, develop, and optimize data pipelines and workflows for seamless data movement and processing.
Build and maintain scalable data architectures, including data warehouses and big data platforms.
Implement ETL processes and automate data workflows for high performance.
Analyze large datasets for insights and improve data systems.
Build dashboards and visualizations to communicate insights effectively.
Develop, train, and deploy machine learning models within data pipelines.
Mentor junior team members and partner with stakeholders across various teams.

AWSPythonSQLETLMachine LearningSnowflakeData engineeringSparkData modeling

Posted about 2 months ago

Apply

🔥 Sr Data Engineer (Scala/Spark)

Posted 2 months ago

📍 United States

🧭 Full-Time

💸 115000.0 - 145000.0 USD per year

🔍 Media and Entertainment

🔧 Requirements

5+ years of relevant experience
Experience in Data Modeling, Data Quality, ETL
2+ years with AWS tech stack
Experience with Python, Spark, and Scala

💡 Responsibilities

Build data pipelines for internal & external datasets
Educate business partners on architecture and capabilities
Write documentation and architecture diagrams

AWSPythonSQLETLSnowflakeSparkLinuxScalaData modeling

Posted 2 months ago

Apply

🔥 Sr. Data Engineer

Posted 3 months ago

📍 United States

🧭 Full-Time

💸 115000.0 - 145000.0 USD per year

🔍 Data Engineering

🔧 Requirements

5+ years experience in data engineering
Strong knowledge of ETL/ELT development principles
Deep experience with Python and SQL
Experience with Airflow or similar orchestration engines
Understanding of CI/CD principles in data engineering

💡 Responsibilities

Design and scale data pipelines across various source systems
Implement data modeling and warehousing principles
Collaborate with teams to understand data requirements
Interface with technology teams for data extraction and transformation
Create documentation for products

PythonSQLApache AirflowCloud ComputingETLMachine LearningData engineeringCI/CDData modeling

Posted 3 months ago

Apply

🔥 Sr. Data Engineer

Posted 4 months ago

📍 LATAM

🔍 IT services

🏢 Company: Moovx

🔧 Requirements

Advanced working SQL knowledge and experience with relational databases.
Experience with Snowflake or other data warehousing applications.
Proficiency in object-oriented scripting languages like Python, Java, C++, or Scala.
Experience in developing reports with visualization tools such as Tableau or PowerBI.
Understanding of the retail industry, especially in areas like financial planning or merchandising.
Strong root cause analysis and problem-solving abilities.
Ability to quickly learn new applications.
Strong organizational skills and attention to detail.
Advanced level in English.

💡 Responsibilities

Translate stakeholder business requirements into actionable requirements documentation.
Analyze organization's data for business insights.
Identify necessary data transformations for usability.
Assemble complex data sets to meet business requirements.
Design complex queries for user-facing deliverables.
Develop user-facing reports, visualizations, and dashboards.

PythonSQLJavaSnowflakeC++TableauScala

Posted 4 months ago

Apply

🔥 Sr. Data Engineer

Posted 4 months ago

📍 United States

🧭 Contract

🏢 Company: Two95 International Inc.

🔧 Requirements

Bachelor’s degree in Computer Science, Computer Information Systems, Engineering, Statistics, or a closely related field (foreign education equivalent accepted).
Experience with AWS services for data and analytics.
5 years of experience in data ingestion, extraction, and integration.
5+ years of hands-on experience with the Mark Logic framework.

💡 Responsibilities

The role focuses on data ingestion, extraction, and integration.
Utilizing AWS services for data and analytics.
Implementing solutions using the Mark Logic framework.

AWSAmazon Web ServicesData engineering

Posted 4 months ago

Apply

🔥 Sr Data Engineer

Posted 4 months ago

📍 LATAM

🔍 Software Development and Talent Staffing

🏢 Company: Moovx

🔧 Requirements

At least 1-3 experience with ETL support and development and analytical Python experience.
Strong SQL query writing skills.
Experience with AWS Lambda or similar serverless ingestion pipelines.
Experience with GraphQL APIs and API ingestion best practices.
Comfortable working with Git and deployment pipelines.
A detailed-oriented problem solver.

💡 Responsibilities

Work closely with product and Engineering teams to support Business Operations data platforms.
Design and implement best practices around data cleanliness and schema design to provide a best in class real time data set.
Built and support automation pipelines in AWS from third party SaaS providers into a first party data warehouse for analytics systems.
Work directly with the CTO and other stakeholders on delivering the best data for dashboards powered by Looker.
Build reusable products and systems that can effectively ingest data to leverage across all business teams.
Automate the influx of data and build flexible solutions for data acquisition, ETL, and other automated pipelines.
Support new feature developments between data sources for the client's own ingestion, reporting, and analysis platforms.
Work with the data team and business stake-holders on architecture, capabilities, best practices and solutions to build out future enhancements.

AWSGraphQLPythonSQLETLGitBusiness OperationsServerlessProblem Solving

Posted 4 months ago

Apply