ApplySenior Software Engineer - Data Platform
Posted about 1 month agoViewed
View full description
Requirements:
- Bachelor's Degree in Computer Science/Engineering or equivalent practical experience.
- 4+ years experience building/maintaining a large scale production-grade data platform.
- Strong programming and software engineering skills, including Python, Go, Scala, or SQL.
- 2+ years experience working with Spark.
- Experience managing data orchestration systems (e.g. Airflow, Flyte, Prefect, Dagster).
- AWS knowledge and expertise (S3, Lambda, SQS, Kinesis).
Responsibilities:
- Develop software to reliably ingest vast amounts of data into our data lake.
- Explore new infrastructure needed to support the growing needs of our data platform.
- Design, scope, and build libraries and data management tooling for effective use.
- Expand ability to stream data for near real-time access.
- Ensure uptime, reliability, and monitoring of the data platform.
- Implement new tools for easier data leverage.
- Uplevel team members on data best practices and tools.
Apply