Senior Data Engineer
New
L
Life360Mobile App / Tech
All positions, unless otherwise specified, can be performed remotely (within the US and Canada)Full-TimeSenior
Salary103,500 - 192,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- AWSPythonSQLApache AirflowKafkaSparkTerraformDatabricksLLM
Requirements
- 5+ years working with high-volume data infrastructure.
- Proficiency with Databricks and AWS services (EMR, Kinesis, Kafka, S3).
- Strong skills in Apache Spark, Spark Streaming, and Apache Airflow.
- Strong proficiency in SQL and Python.
- Proven experience with data quality frameworks like Great Expectations.
- Familiarity with IaC tools such as Terraform.
- BS in CS, Engineering, Math, or equivalent hands-on experience.
- Ability to architect logical/physical data models and optimize performance.
- Experienced with AI/LLM tools for code generation and quality management.
Responsibilities
- Design and manage scalable data platforms powering real-time analytics, batch processing, and exploratory analysis.
- Own the full data lifecycle including ingestion, ETL, storage, and serving using AI pair-programming.
- Ingest data from diverse sources via streaming (Kafka, Kinesis) and batch pipelines.
- Architect medallion-layer data models (Bronze/Silver/Gold) in Databricks.
- Automate, test, and harden data workflows, including CI/CD pipelines.
- Build and maintain AI-ready tooling such as custom slash commands and agent workflows.
- Develop Databricks Genie chatbots for natural language data querying.
- Collaborate with data science and analytics teams to provide reliable, production-ready datasets.
- Contribute to infrastructure-as-code for provisioning cloud data resources.
View Full Description & ApplyYou'll be redirected to the employer's site
