Apply

Senior DataBricks Engineer (with ML)

Posted 6 days agoViewed

View full description

💎 Seniority level: Senior, 6+ years

🔍 Industry: Software Development

🏢 Company: Crodu

🗣️ Languages: English

⏳ Experience: 6+ years

Requirements:
  • 6+ years experience in data engineering/ data science areas
  • Very good knowledge of Apache Spark and the DataBricks platform
  • Solid experience in ML areas
  • Experience with MLOps and MLflow
  • Experience working in an AWS environment
  • Experience in conducting similar migrations
  • Interpersonal and teamwork skills
  • Ability to take initiative and independence
  • English at a level enabling free communication in the team
Responsibilities:
  • Assessment of project requirements, analysis of existing and creation of a new model architecture
  • Preparing the platform for integration with Databricks and ensuring Unity Catalog compliance and configuration
  • Processing and transformation of data with aggregation of metrics for two related Glue tasks
  • Creating ETL pipelines for processing data about visits to the platform and users, including flattening data for the model
  • Implementation of MLOps using MLflow
  • Running the model on Databricks Serving Endpoints for testing latency
  • Creating test frameworks and supporting the Tealium team in testing
  • Preparing an implementation plan for live launch
  • Documentation of work results using Unity Catalog
Apply

Related Articles

Posted about 1 month ago

Why remote work is such a nice opportunity?

Why is remote work so nice? Let's try to see!

Posted 7 months ago

Insights into the evolving landscape of remote work in 2024 reveal the importance of certifications and continuous learning. This article breaks down emerging trends, sought-after certifications, and provides practical solutions for enhancing your employability and expertise. What skills will be essential for remote job seekers, and how can you navigate this dynamic market to secure your dream role?

Posted 8 months ago

Explore the challenges and strategies of maintaining work-life balance while working remotely. Learn about unique aspects of remote work, associated challenges, historical context, and effective strategies to separate work and personal life.

Posted 8 months ago

Google is gearing up to expand its remote job listings, promising more opportunities across various departments and regions. Find out how this move can benefit job seekers and impact the market.

Posted 8 months ago

Learn about the importance of pre-onboarding preparation for remote employees, including checklist creation, documentation, tools and equipment setup, communication plans, and feedback strategies. Discover how proactive pre-onboarding can enhance job performance, increase retention rates, and foster a sense of belonging from day one.