Software Engineer - Data Movement Platform
New
R
RedditData Platform
Remote - United StatesFull-TimeMiddle
Salary164,200 - 229,900 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 2+ years of software engineering experience
- Required Skills
- PythonApache AirflowCloud ComputingJavaKubernetesGoSparkScala
Requirements
- 2+ years of software engineering experience in a production setting.
- Proficiency in object-oriented programming languages (Python, Scala, Go, or Java).
- Expertise in designing and implementing large-scale systems.
- Demonstrated proactive leadership as a self-starter.
- Experience with cloud services and modern cloud-based infrastructure.
- Experience with Airflow, Kubernetes, Spark, and Flink.
- Excellent communication skills for cross-functional collaboration.
Responsibilities
- Refine and maintain data infrastructure technologies supporting ML and analytics.
- Own the Data Movement Platform for batch and stream data processing.
- Build infrastructure for Spark, Flink, and Airflow technologies.
- Contribute to the open source community as needed.
- Develop automated solutions to provide a declarative, self-service experience.
- Collaborate with teammates on on-call responsibilities, monitoring, and alerting.
- Improve reliability, scalability, latency, and efficiency of the Data Platform.
View Full Description & ApplyYou'll be redirected to the employer's site