Software Engineer - Data Platform
New
S
SamsaraInternet of Things
Remote - USFull-TimeMiddle
Salary$113,645 — $191,000 USD
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years
- Required Skills
- AWSPythonJavaGoSparkScalaDistributed Systems
Requirements
- 4+ years of professional software engineering experience in production environments.
- 4+ years of experience building or maintaining large-scale production data infrastructure, data platforms, distributed systems, or data lake systems.
- Strong experience with Apache Spark or similar distributed data processing systems.
- Experience operating production infrastructure in AWS, including services such as S3, RDS, DynamoDB, SQS, Kinesis, or Lambda.
- Experience designing, building, and operating reliable systems with strong ownership of scalability, observability, and security.
- Proficiency in at least one production programming language such as Go, Python, Scala, or Java.
- Ability to collaborate effectively with cross-functional partners including engineers, data scientists, and product stakeholders.
Responsibilities
- Design, build, and operate high-scale data ingestion and replication systems from primary production data stores like RDS and DynamoDB into the data lakehouse.
- Build and maintain reliable, scalable, and modern data platform infrastructure for petabytes of data.
- Improve the reliability, observability, scalability, security, and developer experience of the Spark and Databricks-based data processing platform.
- Develop internal libraries, APIs, frameworks, and tooling in languages such as Go and Python to facilitate efficient data movement and access.
- Manage foundational data lake and lakehouse technologies including Delta Lake on S3, data catalogs, metadata services, and orchestration systems.
- Collaborate with infrastructure, product engineering, data science, and security teams to deliver scalable platform solutions.
- Support the company’s long-term data infrastructure roadmap, including AI, privacy, and security initiatives.
View Full Description & ApplyYou'll be redirected to the employer's site
