Senior ML Data Engineer

New
I
Intuition MachinesCybersecurity, machine learning
Source API remote eligibility restrictions: PolandContractSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
Minimum of 3 years of experience in a data role involving designing and building data stores, feature engineering, and building reliable data pipelines that handle high loads. At least 2 years of professional software development experience in a role other than data engineering.
Required Skills
AWSPythonSQLKafkaKubernetesAzureClickhouseCI/CD

Requirements

  • Have at least 3 years of experience in a data role involving data stores, feature engineering, and reliable high-load data pipelines.
  • Have at least 2 years of professional software development experience outside data engineering.
  • Be proficient in Python.
  • Have experience with Kafka infrastructure and distributed data systems.
  • Have a deep understanding of SQL and NoSQL databases; ClickHouse is preferred.
  • Be familiar with public cloud providers such as AWS or Azure.
  • Have experience with CI/CD, Kubernetes, containerization, and microservice design.
  • Be able to make independent decisions about data processing strategy and architecture.
  • Be self-directed and able to work effectively in a fast-paced environment.
  • Familiarity with coding using agents is part of the interview process.
  • Machine learning fundamentals, including model training, inference, and PyTorch or TensorFlow, are nice to have.

Responsibilities

  • Maintain, extend, and improve existing data/ML workflows and implement new ones for high-velocity data.
  • Provide interfaces and systems that enable ML engineers and researchers to build datasets on demand.
  • Influence data storage and processing strategies.
  • Collaborate with ML, frontend, and backend teams to build the data platform.
  • Reduce time-to-deployment for dashboards and ML models.
  • Establish best practices and develop pipelines and software for building and using datasets.
  • Work with large datasets under high performance constraints.
  • Iterate quickly and support deployment of new products or features to millions of users.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now