Software Engineer - Data Movement Platform
New
R
RedditData Infrastructure
USAFull-TimeMiddle
Salary$164,200 — $229,900 USD
Apply NowOpens the employer's application page
Job Details
- Experience
- 2+ years
- Required Skills
- PythonApache AirflowJavaKubernetesGoSparkCI/CDScala
Requirements
- 2+ years of software engineering experience in a production setting.
- Proficiency in object-oriented programming languages: Python, Scala, Go, or Java.
- Expertise in designing and implementing large-scale systems.
- Experience with cloud services and modern cloud-based infrastructure.
- Experience with Airflow, Kubernetes, Spark, and Flink.
- Experience with CI/CD practices.
- Ability to write clean, maintainable, and well-tested code.
- Strong communication skills for effective collaboration.
- Proactive leadership and self-starter mindset.
Responsibilities
- Refine and maintain data infrastructure technologies to support ML and analytics workflows.
- Own the Data Movement Platform to enable batch and stream data processing.
- Build new infrastructure for Spark, Flink, and Airflow technologies.
- Contribute to open source communities as needed.
- Develop automated solutions to provide a declarative, self-service experience for data users.
- Collaborate on on-call responsibilities and monitoring/alerting to improve platform performance and reliability.
View Full Description & ApplyYou'll be redirected to the employer's site
