Sr Data Engineer

View full description

Requirements:

• Extensive experience in developing data and analytics applications in geographically distributed teams.
• Hands-on experience in using modern architectures and frameworks, structured, semi-structured and unstructured data, and programming with Python.
• Hands-on SQL knowledge and experience with relational databases such as MySQL, PostgreSQL, and others.
• Hands-on ETL knowledge and experience.
• Knowledge of commercial data platforms (Databricks, Snowflake) or cloud data warehouses (Redshift, BigQuery).
• Knowledge of data catalog and MDM tooling (Atlan, Alation, Informatica, Collibra).
• CICD pipeline for continuous deployment (CloudFormation template).
• Knowledge of how machine learning / A.I. workloads are implemented in batch and streaming, including the preparing of datasets, training models, and using pre-trained models.
• Exposure to software engineering processes that can be applied to Data Ecosystems.
• Excellent analytical and troubleshooting skills.
• Excellent communication skills.
• Excellent English (both verbal and written).
• BS. in Computer Science or equivalent.

Responsibilities:

• Design and develop our best-in-class cloud platform, working on all parts of the code stack from front-end, REST and asynchronous APIs, back-end application logic, SQL/NoSQL databases and integrations with external systems.
• Develop solutions across the data and analytics stack from ETL and Streaming data.
• Design and develop reusable libraries.
• Enhance strong processes in Data Ecosystem.
• Write unit and integration tests.