Data Engineer
New
This role can be based within the United States (EST time zone) or within the EMEA region as long as we have a work location., ESTContractMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonJavaSparkScalaData modelingBigQueryDistributed Systems
Requirements
- Experience of working in a product-driven engineering environment.
- Experience working with high-volume, heterogeneous datasets using distributed systems and big data technologies such as Python, Scala, Scio, Ray, Apache Spark, or similar frameworks.
- Proficient in designing and building distributed data pipelines in Python, Scala, or Java, including experience with frameworks such as Scio and platforms like Dataflow.
- Understand data modeling, data access, and storage techniques across both batch and analytical processing systems.
- Experience working with large-scale analytical systems such as BigQuery or similar technologies.
- Value iterative software development, data-driven decision making, reliability, responsible experimentation, and cost-efficient engineering practices.
- Thrive in collaborative environments and enjoy working closely with cross-functional teams.
- Creative problem solver who enjoys building products that create meaningful experiences.
- Excited by the challenge of turning research ideas and experimental concepts into reliable, scalable production systems.
Responsibilities
- Design, build, and maintain distributed data pipelines that power Spotify Wrapped data stories and personalized experiences for more than 300M users globally.
- Partner with Data Scientists to evaluate and operationalize new Wrapped story concepts, balancing personalization, scalability, and eligibility requirements.
- Build scalable systems that process large-scale listening data and generate insights that celebrate users’ unique listening journeys.
- Develop and optimize pipelines supporting AI-powered personalized playlist experiences and recommendation technologies.
- Collaborate with partner teams to integrate social and shared listening experiences into Wrapped and adjacent user experiences.
- Contribute to technical excellence by improving reliability, observability, performance, and development velocity across the squad’s data systems.
- Support experimentation and iteration on new storytelling concepts beginning early in the product development cycle.
- Work cross-functionally with engineering, product, design, and music domain experts to bring large-scale personalized experiences to life.
View Full Description & ApplyYou'll be redirected to the employer's site
