Sr. Lead Software Engineer, Data Platform
United StatesFull-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 8–10+ years of experience
- Required Skills
- AWSPythonSQLGCPSnowflakeAzureBigQueryDatabricks
Requirements
- 8–10+ years of experience in software engineering or data platform engineering
- Strong focus on building scalable distributed data systems
- Deep expertise in data ingestion patterns, including CDC
- Strong knowledge of how data is modeled and optimized within lakehouse architectures
- Highly proficient in Python and SQL
- Track record of delivering production-grade, maintainable, and testable code
- Hands-on experience with cloud data services across AWS, GCP, or Azure
- Familiarity with modern data warehouses such as Snowflake, BigQuery, or Databricks
- Understanding of large-scale data pipeline design
- Experience with query engines like Trino or Presto
- Experience with Apache Iceberg or Delta Lake
- Experience with data governance, metadata, and lineage practices
- Strong communicator with a collaborative mindset
Responsibilities
- Design and implement scalable data ingestion systems supporting high-volume batch and streaming (CDC) pipelines across diverse data sources.
- Build and enhance core data platform components including ingestion, validation, orchestration, lineage, and data quality frameworks.
- Develop and evolve a centralized data lake architecture using Apache Iceberg or similar lakehouse technologies.
- Architect and implement cloud-agnostic data processing solutions across AWS, GCP, and Azure environments.
- Contribute to the semantic layer to ensure data is consumable for analytics, BI, and downstream applications.
- Define and promote engineering standards for observability, testing, performance, and operational excellence across the data platform.
- Partner with cross-functional teams to align data modeling, storage, and consumption strategies.
- Provide technical leadership through design reviews, mentorship, and hands-on engineering contributions.
View Full Description & ApplyYou'll be redirected to the employer's site