Senior Data Engineer
New
G
Globaldev GroupRenewable Energy
PolandFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Required Skills
- GitMachine LearningMLFlowSnowflakeAzureData engineeringCI/CDDatabricks
Requirements
- Strong, hands-on experience with Azure and the Databricks platform.
- Solid experience with MLflow for lifecycle management.
- Proven track record in setting up production-ready engineering practices (CI/CD, IaC, Git, unit/integration testing).
- Senior-level engineering mindset with the ability to work independently in a complex data environment.
- Excellent communication skills and fluent English.
- Experience with Snowflake (preferred).
- Additional Data Science / ML capabilities, especially with anomaly detection (preferred).
- Experience with Databricks-based ML workflows, model serving, versioning, testing, and tuning (preferred).
- Knowledge of statistical normalization techniques (e.g., z-score) and signal processing (e.g., FFT transformation) (preferred).
Responsibilities
- Design and implement streaming and batch data pipelines for data integration, ingestion, data quality management, transformations, and auditing.
- Perform feature engineering and data exploration.
- Collaborate with business and operations teams to align on requirements and standardize waveform/sensor data.
- Build and maintain the Gold data layer, key KPIs, and PoC evaluation frameworks.
- Set up and maintain solid engineering practices, including CI/CD pipelines, Infrastructure as Code (IaC), version control (Git), unit and integration testing, and documentation.
View Full Description & ApplyYou'll be redirected to the employer's site