Senior Data Engineer

Posted about 1 month agoViewed

View full description

💎 Seniority level: Senior, 5+ years or 3+ years with a Master's degree

📍 Location: United States, Canada

💸 Salary: 125000.0 - 160000.0 USD per year

🔍 Industry: Digital driver assistance services

🏢 Company: Agero👥 1001-5000💰 $4,750,000 over 2 years agoAutomotive InsurTech Information Technology Insurance

🗣️ Languages: English

⏳ Experience: 5+ years or 3+ years with a Master's degree

🪄 Skills: AWSPythonSQLApache AirflowDynamoDBETLFlaskMongoDBSnowflakeFastAPIPandasCI/CDData modeling

Requirements:

Bachelor's degree in a technical field and 5+ years or Master's degree with 3+ years of industry experience.
Extensive experience with Snowflake or other cloud-based data warehousing solutions.
Expertise in ETL/ELT pipelines using tools like Airflow, DBT, Fivetran.
Proficiency in Python for data processing and advanced SQL for managing databases.
Solid understanding of data modeling techniques and cost management strategies.
Experience with data quality frameworks and deploying data solutions in the cloud.
Familiarity with version control systems and implementing CI/CD pipelines.

Responsibilities:

Develop and maintain ETL/ELT pipelines to ingest data from diverse sources.
Monitor and optimize cloud costs while performing query optimization in Snowflake.
Establish modern data architectures including data lakes and warehouses.
Apply dimensional modeling techniques and develop transformations using DBT or Spark.
Write reusable and efficient code, and develop data-intensive UIs and dashboards.
Implement data quality frameworks and observability solutions.
Collaborate cross-functionally and document data flows, processes, and architecture.

Apply

Related Jobs

Apply

🔥 Senior Data Engineer

Posted 2 days ago

📍 Canada

🧭 Full-Time

🔍 Retail Media

🏢 Company: Vantage👥 1001-5000 Cryptocurrency Financial Services FinTech Trading Platform

🔧 Requirements

5+ years of experience in data engineering, big data, or distributed systems.
Strong expertise in Python, SQL (or equivalent big data processing frameworks).
Proficiency in ETL/ELT pipelines using Apache Airflow, or similar orchestration tools.
Experience working with real-time streaming data (Kafka, Kinesis, or Pub/Sub).
Strong understanding of data modelling, data warehousing, and distributed systems.
Familiarity with privacy-compliant data processing (GDPR, CCPA) for advertising/retail media use cases.

💡 Responsibilities

Design, develop, and optimize data pipelines, ETL/ELT workflows, and data warehouses to support large-scale retail media analytics.
Handle real-time and batch processing at scale
Work closely with data scientists, analysts, software engineers, and product teams to ensure seamless data integration and access.
Implement robust monitoring, validation, and security controls to maintain high data reliability.

PythonSQLApache AirflowETLKafkaData engineeringData modeling

Posted 2 days ago

Apply

🔥 Senior Data Engineer (Remote)

Posted 3 days ago

📍 United States

🔍 Software Development

AWSPostgreSQLPythonSQLApache AirflowCloud ComputingData AnalysisETLApache KafkaData engineeringCI/CDRESTful APIsMicroservicesData visualizationData modelingData analyticsData management

Posted 3 days ago

Apply

🔥 Senior Data Engineer/Scientist

Posted 4 days ago

📍 United States, Canada

🧭 Full-Time

💸 105825.0 - 136950.0 CAD per year

🔍 Data Engineering

🏢 Company: Samsara👥 1001-5000💰 Secondary Market over 4 years ago🫂 Last layoff almost 5 years agoCloud Data Services Business Intelligence Internet of Things SaaS Software

🔧 Requirements

BS degree in Computer Science, Statistics, Engineering, or a related quantitative discipline
6+ years experience in a data engineering and data science-focused role
Proficiency in data manipulation and processing in SQL and Python
Expertise building data pipelines with new API endpoints from their documentation
Proficiency in building ETL pipelines to handle large volumes of data
Demonstrated experience in designing data models at scale

💡 Responsibilities

Build and maintain highly reliable computed tables, incorporating data from various sources, including unstructured and highly sensitive data
Access, manipulate, and integrate external datasets with internal data
Building analytical and statistical models to identify patterns, anomalies, and root causes
Leverage SQL and Python to shape and aggregate data
Incorporate generative AI tools (ChatGPT Enterprise) into production data pipelines and automated workflows
Collaborate closely with data scientists, data analysts, and Tableau developers to ship top quality analytic products
Champion, role model, and embed Samsara’s cultural principles (Focus on Customer Success, Build for the Long Term, Adopt a Growth Mindset, Be Inclusive, Win as a Team) as we scale globally and across new offices

PythonSQLETLTableauAPI testingData engineeringData scienceSparkCommunication SkillsAnalytical SkillsData visualizationData modeling

Posted 4 days ago

Apply

🔥 Senior Data Engineer - Delivery team

Posted 8 days ago

📍 United States, Canada

🔍 Software Development

🏢 Company: Overstory👥 1-10 E-Commerce

🔧 Requirements

Approximately 5 years of experience in Data Engineering with at least one experience in a startup environment
Product-minded and able to demonstrate significant impact you have had on a business through the application of technology
Proven experience of data engineering across the following (or similar) technologies: Python, data orchestration platforms (Airflow, Luigi, Dagster, etc…), data quality frameworks, data lakes/warehouses
Ability to design and implement scalable and resilient data systems
Excellent communication skills and ability to collaborate effectively in a cross-functional team environment
Passion for learning and staying updated with evolving technologies and industry trends

💡 Responsibilities

Owning day-to-day operational responsibilities of deliveries our analysis to the customers
Developing data-driven solutions to customer problems that our products aren’t solving for yet
Building new and improving existing technologies such as:
Automation of the analysis for all customers, leading to faster implementation of Overstory’s recommendations
Metrics to identify what are the time bottlenecks in the current flow of analysis, therefore helping all Overstory teams identify areas of improvements
Visualization of status and progress of the analysis for internal use
Working on performance & scalability of our pipelines ensuring that our tech can handle our growth

PythonSQLCloud ComputingGCPAmazon Web ServicesData engineeringCommunication SkillsAnalytical SkillsRESTful APIsData visualizationData modeling

Posted 8 days ago

Apply

🔥 Senior Data Engineer

Posted 9 days ago

📍 United States

🧭 Full-Time

🔍 Software Development

🏢 Company: Mangomint👥 51-100💰 $35,000,000 Series B 6 months agoManagement Information Systems Beauty Software

🔧 Requirements

3+ years of experience in data engineering or a related role
Proficiency in SQL and Python for data pipelines and automation
Experience with dbt (or similar data modeling tools)
Familiarity with Snowflake (or other cloud data warehouses)
Knowledge of APIs and experience integrating various data sources
Experience with CRM and business systems (Salesforce, Outreach, Stripe, etc.)
Strong problem-solving skills and ability to take ownership of projects
Ability to work independently in a small, fast-paced startup environment
Effective communication skills to translate business needs into technical solutions

💡 Responsibilities

Design, develop, and maintain ETL/ELT data pipelines using Snowflake, dbt, Prefect, and other modern data tools
Automate data workflows to improve efficiency and reliability
Integrate CRM and other business systems to support cross-functional needs
Develop data enrichment pipelines to power our sales process
Build internal data tools to drive data-driven decision making
Work directly with stakeholders to define requirements and implement data solutions that support business objectives
Ensure data integrity, governance, and security best practices are upheld
Support analytics and reporting efforts by building dashboards and data models in dbt and Sigma

AWSPythonSQLETLSnowflakeCRMData modeling

Posted 9 days ago

Apply

🔥 Senior Data Engineer

Posted 9 days ago

📍 United States

🧭 Full-Time

💸 160000.0 - 182000.0 USD per year

🔍 Adtech

🏢 Company: tvScientific👥 11-50💰 $9,400,000 Convertible Note about 1 year agoInternet Advertising

🔧 Requirements

7+ years of experience in data engineering.
Proven experience building data infrastructure using Spark with Scala.
Familiarity with data lakes, cloud warehouses, and storage formats.
Strong proficiency in AWS services.
Expertise in SQL for data manipulation and extraction.

💡 Responsibilities

Design and implement robust data infrastructure using Spark with Scala.
Collaborate with our cross-functional teams to design data solutions that meet business needs.
Build out our core data pipelines, store data in optimal engines and formats, and feed our machine learning models.
Leverage and optimize AWS resources.
Collaborate closely with the Data Science team.

AWSSQLCloud ComputingETLMachine LearningData engineeringSparkScalaData modeling

Posted 9 days ago

Apply

🔥 Senior Data Engineer

Posted 10 days ago

📍 United States, Canada

🧭 Full-Time

💸 110000.0 - 130000.0 USD per year

🔍 Software Development

🏢 Company: Ceros👥 101-250💰 $100,000,000 Private over 4 years agoAdvertising Content Creators Content Marketing Graphic Design Software

🔧 Requirements

5+ years of experience in data engineering, focusing on AWS Redshift and ETL pipeline development.
Strong expertise in SQL performance tuning, schema management, and query optimization.
Experience designing and maintaining ETL pipelines using AWS Glue, Matillion, or similar tools.
Proficiency in JavaScript/TypeScript, with experience building custom ETL workflows and integrations.
Hands-on experience with Python for data automation and scripting.
Strong understanding of data warehousing best practices, ensuring high-quality, scalable data models.
Experience with data monitoring and alerting tools such as AWS CloudWatch and New Relic.
Ability to work independently in a fast-paced environment, collaborating across teams to support data-driven initiatives.

💡 Responsibilities

Own and lead the management of AWS Redshift, ensuring optimal performance, disk usage, and cost efficiency.
Design and maintain scalable ETL pipelines using AWS Glue, Lambda, and Matillion to integrate data from Mixpanel, CRM platforms, and customer engagement tools.
Optimize SQL-based data transformations and Redshift queries to improve performance and reliability.
Automate data offloading and partition management, leveraging AWS services like S3 and external schemas.
Ensure version control and documentation of all Redshift queries, ETL processes, and AWS configurations through a centralized GitHub repository.
Develop monitoring and alerting for data pipelines using CloudWatch and other observability tools to ensure high availability and early issue detection.
Implement and maintain data quality checks and governance processes to ensure accuracy and consistency across foundational tables.
Collaborate with AI engineers and business stakeholders to enhance data accessibility and reporting for internal teams.
Maintain and optimize BI dashboards in Metabase and HubSpot, ensuring accuracy and efficiency of business reporting.
Manage key integrations between Redshift and external platforms, including Mixpanel, HubSpot, and Census, optimizing data accessibility and performance.
Administer AWS infrastructure supporting Redshift, ensuring efficient resource utilization, IAM security, and cost management.
Automate repetitive data tasks using Python and scripting to enhance data processes and improve team efficiency.

AWSPythonSQLETLGitJavascriptTypeScriptAmazon Web ServicesAPI testingData engineeringREST APICI/CDAnsibleData modelingData analyticsData management

Posted 10 days ago

Apply

🔥 Senior Data Engineer

Posted 12 days ago

📍 United States, Canada

🧭 Full-Time

💸 113000.0 - 130000.0 USD per year

🔍 Software Development

🏢 Company: Later👥 1-10 Consumer Electronics iOS Apps Software

🔧 Requirements

Minimum of 5 years in data engineering or related fields
Bachelor’s degree in Computer Science, Engineering, or related field
Strong focus on building data infrastructure and pipelines

💡 Responsibilities

Design and build a robust data warehouse architecture
Design, build, and maintain scalable data pipelines
Develop reliable transformation layers and data pipelines
Establish optimized data architectures using cloud technologies
Enforce data quality checks and governance practices
Collaborate with cross-functional teams to deliver insights
Analyze and optimize data pipelines for performance

SQLData engineering

Posted 12 days ago

Apply

🔥 Senior Data Engineer

Posted 13 days ago

📍 United States

🧭 Full-Time

💸 150000.0 - 190000.0 USD per year

🔍 Game Development

🏢 Company: Second Dinner

🔧 Requirements

Demonstrated experience in large-scale distributed data systems such as Spark and Flink
Deep expertise in analytical database technologies, including SQL and NoSQL
Experience with database technologies and ETL/ELT processes
Experience with orchestration and automation tools like Airflow and Beam
Experience with Databricks and AWS-based data/analytics solutions

💡 Responsibilities

Develop and operate data infrastructure and pipelines for analytics and reporting
Empower Marketing team with high-quality data for user acquisition and retention
Collaborate with teams to gain insights from analytics

AWSPythonSQLApache AirflowETLData engineeringNosqlSpark

Posted 13 days ago

Apply

🔥 Senior Data Engineer

Posted 13 days ago

📍 United States

🧭 Full-Time

💸 145000.0 - 160000.0 USD per year

🔍 EdTech

🏢 Company: Magpie Literacy

🔧 Requirements