Apply

Sr Data Engineer (Scala/Spark)

Posted 5 days agoViewed

View full description

💎 Seniority level: Senior, 5+ years

💸 Salary: 115000.0 - 145000.0 USD per year

🔍 Industry: Software Development

⏳ Experience: 5+ years

Requirements:
  • 5+ years of relevant experience
  • 1+ Experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL and Data Warehouse methodologies and technologies.
  • Demonstrated experience as an engineering lead in implementing scalable, distributed, and highly available systems using cloud technologies, specifically Amazon Web Services.
  • Experience in any combination of the following: SQL, AWS EMR/Lambda, Iceberg, Linux, Python, Web technologies, APIs, Spark, Scala.
  • 2+ years’ experience with AWS tech stack.
  • Basic understanding of relational data modeling and be able to clearly articulate the reasons to use non-relational systems in our architecture.
Responsibilities:
  • Build data pipelines to land, profile, and store multiple internal & external datasets, and build applications that surface this data to support our business partners’ strategic decision making for analytics solution in media industry.
  • Be a Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions.
  • Leverage prototyping methodologies to propose and design creative business solutions that exploit our broad toolset of technologies (AWS tech stack, data lake, Python, Spark, Scala, Iceberg, EMR Serverless, SNS, SQS, AWS Lambda, Step Functions, Event Triggers etc.)
  • Educate and inform business partners on architecture, capabilities, best practices, and solutions to build out future enhancements.
  • Assist in analyzing business requirements, source systems, understand underlying data sources, transformation requirements, data mapping, data model and metadata for reporting solutions.
  • Write easily understood documentation and architecture diagrams and keeping them up to date as code and frameworks change over time.
Apply

Related Articles

Posted about 1 month ago

How to Overcome Burnout While Working Remotely: Practical Strategies for Recovery

Burnout is a silent epidemic among remote workers. The blurred lines between work and home life, coupled with the pressure to always be “on,” can leave even the most dedicated professionals feeling drained. But burnout doesn’t have to define your remote work experience. With the right strategies, you can recover, recharge, and prevent future episodes. Here’s how.



Posted 6 days ago

Top 10 Skills to Become a Successful Remote Worker by 2025

Remote work is here to stay, and by 2025, the competition for remote jobs will be tougher than ever. To stand out, you need more than just basic skills. Employers want people who can adapt, communicate well, and stay productive without constant supervision. Here’s a simple guide to the top 10 skills that will make you a top candidate for remote jobs in the near future.

Posted 9 months ago

Google is gearing up to expand its remote job listings, promising more opportunities across various departments and regions. Find out how this move can benefit job seekers and impact the market.

Posted 10 months ago

Read about the recent updates in remote work policies by major companies, the latest tools enhancing remote work productivity, and predictive statistics for remote work in 2024.

Posted 10 months ago

In-depth analysis of the tech layoffs in 2024, covering the reasons behind the layoffs, comparisons to previous years, immediate impacts, statistics, and the influence on the remote job market. Discover how startups and large tech companies are adapting, and learn strategies for navigating the new dynamics of the remote job market.