Senior Data Engineer

Posted 10 days agoViewed

💎 Seniority level: Senior

📍 Location: United States, United Kingdom, Spain, Estonia

🔍 Industry: Identity verification

🏢 Company: Veriff👥 501-1000💰 $100,000,000 Series C almost 3 years ago🫂 Last layoff over 1 year agoArtificial Intelligence (AI)Fraud Detection Information Technology Cyber Security Identity Management

🗣️ Languages: English

🪄 Skills: PythonSQLApache AirflowETLData engineeringJSONData modeling

Requirements:

Expert-level knowledge of SQL, particularly with Redshift.
Strong experience in data modeling with an understanding of dimensional data modeling best practices.
Proficiency in data transformation frameworks like dbt.
Solid programming skills in languages used in data engineering, such as Python or R.
Familiarity with orchestration frameworks like Apache Airflow or Luigi.
Experience with data from diverse sources including RDBMS and APIs.

Responsibilities:

Collaborate with business stakeholders to design, document, and implement robust data models.
Build and optimize data pipelines to transform raw data into actionable insights.
Fine-tune query performance and ensure efficient use of data warehouse infrastructure.
Ensure data reliability and quality through rigorous testing and monitoring.
Assist in migrating from batch processing to real-time streaming systems.
Expand support for various use cases including business intelligence and analytics.

Apply

Related Jobs

Apply

🔥 Senior Data Engineer (Remote, USA)

Posted 3 days ago

📍 USA

💸 152960.0 - 183552.0 USD per year

🔍 Data Engineering and Observability Solutions

Software development skills in Python, Java, Scala, or Go.
High proficiency in SQL.
Experience with workflow orchestration systems like Prefect, Dagster, or Airflow.
Knowledge of MLOps best practices.
Familiarity with dbt or similar data transformation tools.
Excellent communication skills for technical topics.

Build and maintain production quality data pipelines between operational systems and BigQuery.
Implement data quality and freshness checks to ensure data accuracy and consistency.
Build and maintain machine learning pipelines for automated model validation and deployment.
Create and maintain documentation for data engineering processes and workflows.
Maintain observability and monitoring of internal data pipelines.
Troubleshoot data pipeline issues to ensure data availability.
Contribute to dbt systems ensuring efficiency and availability.

PythonSQLETLGCPMachine LearningData engineering

Posted 3 days ago

Apply

🔥 Senior Data Engineer (Python - REMOTE)

Posted 3 days ago

📍 Colombia, Spain, Ecuador, Venezuela, Argentina

🔍 HR Tech

🏢 Company: Jobgether👥 11-50💰 $1,493,585 Seed almost 2 years agoInternet

Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.
Minimum of 5 years of experience in data engineering.
5 years of experience in Python programming.
Hands-on experience with big data technologies like Hadoop, Spark, or Kafka.
Proficiency with MySQL, PostgreSQL, and MongoDB.
Experience with AWS cloud platforms.
Strong understanding of data modeling and warehousing concepts.
Excellent analytical and problem-solving skills.
Fluency in English and Spanish.

Design, build, and maintain scalable data pipelines and ETL processes.
Develop and optimize data scraping and extraction solutions.
Collaborate with data scientists to implement AI-driven algorithms.
Ensure data integrity and reliability with validation mechanisms.
Analyze and optimize system performance.
Deploy machine learning models into production.
Stay updated on emergent technologies in data engineering.
Work with cross-functional teams to define data requirements.
Develop and maintain comprehensive documentation.

AWSDockerPostgreSQLPythonETLHadoopKafkaKubernetesMachine LearningMongoDBMySQLSparkCI/CDData modeling

Posted 3 days ago

Apply

🔥 Senior Data Engineer

Posted 10 days ago

📍 TX, MN, FL

💸 130000.0 - 195000.0 USD per year

🔍 Healthcare

🏢 Company: NeueHealth

Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, or equivalent.
Around five years of experience in an enterprise data engineering role in an Azure environment.
Healthcare IT background preferred.
Experience coding in Scala and building batch and streaming data pipelines.
Experience with API design.
Extensive experience developing data solutions in Azure Cloud.
Experience with event sourcing and/or Big Data architectures.

Write traditional code and server-less functions mainly in Scala.
Build APIs, data microservices, and ETL pipelines for data sharing and analytics.
Develop and optimize processes for large language models and AI enhancements.
Support Data Ingestion frameworks deployed in Azure.
Participate in cultivating a culture of DevOps and Quality Assurance.
Act as tech lead and mentor junior engineers.
Continuously document code and team processes.

ETLC#AzureSparkCI/CDDevOpsMicroservicesScala

Posted 10 days ago

Apply

🔥 Senior Data Engineer

Posted 11 days ago

📍 USA

🧭 Full-Time

💸 165000.0 - 210000.0 USD per year

🔍 E-commerce and AI technologies

🏢 Company: Wizard👥 11-50 Customer Service Manufacturing

5+ years of professional experience in software development with a focus on data engineering.
Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
Proficiency in Python with software engineering best practices.
Strong expertise in building ETL pipelines using tools like Apache Spark.
Hands-on experience with NoSQL databases like MongoDB, Cassandra, or DynamoDB.
Proficiency in real-time stream processing systems such as Kafka or AWS Kinesis.
Experience with cloud platforms (AWS, GCP, Azure) and technologies like Delta Lake and Parquet files.

Develop and maintain scalable data infrastructure for batch and real-time processing.
Build and optimize ETL pipelines for efficient data flow.
Collaborate with data scientists and cross-functional teams for accurate monitoring.
Design backend data solutions for microservices architecture.
Implement and manage integrations with third-party e-commerce platforms.

AWSPythonDynamoDBElasticSearchETLGCPGitHadoopKafkaMongoDBRabbitmqAzureCassandraRedis

Posted 11 days ago

Apply

🔥 Senior Data Engineer (SQL, Fabric, ADF)

Posted 11 days ago

📍 Ireland, United Kingdom

🔍 IT, Digital Transformation

🏢 Company: Tekenable👥 51-100 Information Technology Enterprise Software Software

Experience with the Azure Intelligent Data Platform, including Data Lakes, Data Factory, Azure Synapse, Azure SQL, and Power BI.
Knowledge of Microsoft Fabric.
Proficiency in SQL and Python.
Understanding of data integration and ETL processes.
Ability to work with large datasets and optimize data systems for performance and scalability.
Experience working with JSON, CSV, XML, Open API, RESTful API integration and OData v4.0.
Strong knowledge of SQL and experience with relational databases.
Experience with big data technologies like Hadoop, Spark, or Kafka.
Familiarity with cloud platforms such as Azure.
Bachelor's degree in Computer Science, Engineering, or a related field.

Design, develop, and maintain scalable data pipelines.
Collaborate with data analysts to understand their requirements.
Implement data integration solutions to meet business needs.
Ensure data quality and integrity through testing and validation.
Optimize data systems for performance and scalability.

PythonSQLETLHadoopKafkaAzureSparkJSON

Posted 11 days ago

Apply

🔥 Senior Data Engineer

Posted 13 days ago

📍 United States

🧭 Full-Time

🏢 Company: Avalore, LLC

Master’s or PhD in statistics, mathematics, computer science, or related field.
8+ years of experience as a Data Engineer within the IC.
Outstanding communication skills, influencing abilities, and client focus.
Professional proficiency in English is required.
Current, active Top Secret security clearance.
Applicants must be currently authorized to work in the United States on a full-time basis.

Develops and documents data pipelines for ingest, transformation, and preparation of data for AI applications.
Designs scalable technologies such as streaming and transformation, joining disparate data sets for predictive analytics.
Develops API interfaces for accessibility.
Leads technical efforts and guides development teams.

PythonSQLApache AirflowArtificial IntelligenceETLMachine LearningAPI testingData engineering

Posted 13 days ago

Apply

🔥 Senior Data Engineer

Posted 15 days ago

📍 USA

🧭 Full-Time

💸 190000.0 - 220000.0 USD per year

🔍 B2B data / Data as a Service (DaaS)

🏢 Company: People Data Labs👥 101-250💰 $45,000,000 Series B about 3 years agoDatabase Artificial Intelligence (AI)Developer APIs Machine Learning Analytics B2B Software

5-7+ years industry experience with strategic technical problem-solving.
Strong software development fundamentals.
Experience with Python.
Expertise in Apache Spark (Java, Scala, or Python-based).
Proficiency in SQL.
Experience building scalable data processing systems.
Familiarity with data pipeline orchestration tools (e.g., Airflow, dbt).
Knowledge of modern data design and storage patterns.
Experience working in Databricks.
Familiarity with cloud computing services (e.g., AWS, GCP, Azure).
Experience in data warehousing technologies.
Understanding of modern data storage formats and tools.

Build infrastructure for ingestion, transformation, and loading of data using Spark, SQL, AWS, and Databricks.
Create an entity resolution framework for merging billions of entities into clean datasets.
Develop CI/CD pipelines and anomaly detection systems to enhance data quality.
Provide solutions to undefined data engineering problems.
Assist Engineering and Product teams with data-related technical issues.

AWSPythonSQLKafkaAirflowData engineeringPandasCI/CD

Posted 15 days ago

Apply

🔥 Senior Data Engineer (Remote)

Posted 17 days ago

📍 United Kingdom

🔍 Esports, gaming, tournaments, leagues, events

🏢 Company: ESL FACEIT Group👥 501-1000🫂 Last layoff 10 months agoVideo Games Gaming Digital Entertainment eSports

Experience shaping architecture for mature data platforms.
Hands-on building of resilient data pipelines (Airflow, Kafka, etc.) at scale.
CI/CD expertise (Github Actions, Jenkins) in data engineering.
Infrastructure management using IaC (Terraform).
Knowledge of data modeling in cloud warehouses (BigQuery, Snowflake).
Familiarity with database design principles.
Skills in operational procedures and data observability tools.

Serve as a leader in tech and understand customer needs.
Partner with stakeholders and promote data platform adoption.
Contribute to technical strategy and manage delivery.
Set high standards for documentation, testing, and code quality.
Drive efficiencies in code, infrastructure and data models.
Inspire and guide team members through code reviews and design sessions.

AWSLeadershipPythonSQLGCPJenkinsKafkaSnowflakeStrategyAirflowData engineeringData StructuresPrometheusCI/CDDevOpsTerraformDocumentationData modeling

Posted 17 days ago

Apply

🔥 Senior Data Engineer

Posted 25 days ago

📍 Spain

💸 80000 - 110000 EUR per year

🔍 Financial services

5+ years of professional experience in Data Engineering or similar roles.
Proficient in SQL and DBT for data transformations.
Fluent in Python or other modern programming languages.
Experience with infrastructure as code languages, like Terraform.
Experienced in data pipelines, data modeling, data warehouse technologies, and cloud infrastructures.
Experience with AWS and/or other cloud providers like Azure or GCP.
Strong cross-team communication and collaboration skills.
Ability to thrive in ambiguous situations.

Work with engineering managers and tech leads to identify and plan projects based on team goals.
Collaborate closely with tech leads, managers, and cross-functional teams to deliver technology for analytical use cases.
Write high-quality, understandable code.
Review other engineers' work, providing constructive feedback.
Act as a technical resource and mentor for engineers inside and outside the team.
Promote a respectful and supportive team environment.
Participate in on-call rotation as required.

AWSPythonSQLGCPAzureData engineeringCollaborationTerraformData modeling

Posted 25 days ago

Apply

🔥 Senior Data Engineer

Posted about 1 month ago

📍 United States, United Kingdom, Singapore, Indonesia, Germany, France, Japan, Australia

🔍 Customer engagement platform

🏢 Company: Braze👥 1001-5000💰 Grant over 1 year agoCRM Analytics Marketing Marketing Automation Software

5+ years of hands-on experience in data engineering, cloud data warehouses, and ETL development.
Proven expertise in designing and optimizing data pipelines and architectures.
Strong proficiency in advanced SQL and data modeling techniques.
Experience leading impactful data projects from conception to deployment.
Effective collaboration skills with cross-functional teams and stakeholders.
In-depth understanding of technical architecture and data flow in a cloud-based environment.
Ability to mentor and guide junior team members.
Passion for building scalable data solutions.
Strong analytical and problem-solving skills with attention to detail.
Experience with large event-level data aggregation.
Familiarity with data governance principles.

Lead the design, implementation, and monitoring of scalable data pipelines and architectures using tools like Snowflake and dbt.
Develop and maintain robust ETL processes to ensure high-quality data ingestion, transformation, and storage.
Collaborate with data scientists, analysts, and engineers to implement data solutions for customer engagement.
Optimize and manage data flows across various platforms and applications.
Ensure data quality, consistency, and governance through best practices.
Work with large-scale event-level data to support business intelligence and analytics.
Implement and maintain data products using advanced techniques.
Collaborate with cross-functional teams to deliver valuable data solutions.
Evaluate and integrate new data technologies to enhance data infrastructure.

SQLBusiness IntelligenceETLSnowflakeData engineeringCollaborationCompliance

Posted about 1 month ago

Apply

Senior Data Engineer

Requirements:

Responsibilities:

Related Jobs

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities

🔧 Requirements

💡 Responsibilities