Senior Software Engineer II, Data

View full description

Requirements:

• Bachelor's degree in Computer Science, Engineering or similar.
• 7+ years of relevant experience.
• Proficiency with Java, Golang, Scala, or Python.
• Strong knowledge of computer science fundamentals and data structures.
• Expert SQL skills.
• Hands-on experience with big data processing systems.
• Experience with cloud technology stacks (GCP or AWS).
• Experience with large amounts of data in production and frameworks like Spark, Hadoop.
• Experience with data warehousing architecture, data lakes, and data modeling.
• Experience with Data Ops and data reliability.
• Experience with error handling, data validation, and dbt models.
• Previous startup experience preferred.

Responsibilities:

• Develop and implement data pipelines and systems that can handle large volumes of data.
• Process TBs of data delivering actionable insights using Spark, Airflow, Google Pubsub, etc.
• Collaborate with data scientists and other teams for data integration into business processes.
• Maintain and optimize existing data systems for costs and data governance.
• Improve data quality by building testing and observability pipelines.
• Stay updated with advances in data engineering.