Senior Data Engineer - Data Platform (Remote)

View full description

Requirements:

• Experience with AWS services
• Experience with infrastructure as code, batch processing, scheduling, data warehousing
• Understanding of data engineering best practices

Responsibilities:

• Design our data platform, from data ingestion and validation to transport, storage, and exposure to consumers.
• Collaborate with other data engineering teams focused on delivering analytics services, sharing technical knowledge and defining best practices, and guiding them in the configuration of core systems such as data warehousing and orchestration.
• Work hand in hand with machine learning engineers to design and scale automation and intelligence features into the Pennylane application.
• Partner with software engineers to ensure data quality and integrity, acting as a role model to establish data as a core part of our production systems.
• Drive optimizations on our core components to maintain an effective balance between scalability and costs.
• Shape an engineering culture with high standards in the data team by defining best practices, architecture patterns and security measures.