Senior Software Engineer – Data Platform
New
This is a remote position open to candidates residing in the US.Full-TimeSenior
Salary130,900 - 220,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years
- Required Skills
- AWSPythonJavaGoSparkScalaDistributed Systems
Requirements
- 4+ years of professional software engineering experience in production environments.
- 4+ years of experience building or maintaining large-scale production data infrastructure, data platforms, distributed systems, or data lake systems.
- Strong experience with Apache Spark or similar distributed data processing systems.
- Experience operating production infrastructure in AWS (S3, RDS, DynamoDB, SQS, Kinesis, Lambda).
- Experience designing, building, and operating reliable systems with strong ownership of scalability, observability, and security.
- Proficiency in at least one production programming language such as Go, Python, Scala, or Java.
- Ability to collaborate effectively with cross-functional partners.
Responsibilities
- Design, build, and operate high-scale data ingestion and replication systems from primary production data stores into data lakehouse.
- Build and maintain reliable, scalable, and modern data platform infrastructure for petabytes of data.
- Improve reliability, observability, scalability, security, and developer experience of Spark and Databricks-based data processing platforms.
- Develop internal libraries, APIs, frameworks, and tooling in Go and Python.
- Work on foundational data lake and lakehouse technologies including Delta Lake on S3, data catalogs, and orchestration systems.
- Collaborate with infrastructure, product, data science, analytics, and security teams.
View Full Description & ApplyYou'll be redirected to the employer's site
