Senior ML Data Engineer
New
I
Intuition MachinesCybersecurity, machine learning
Source API remote eligibility restrictions: PolandContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- Minimum of 3 years of experience in a data role involving designing and building data stores, feature engineering, and building reliable data pipelines that handle high loads. At least 2 years of professional software development experience in a role other than data engineering.
- Required Skills
- AWSPythonSQLKafkaKubernetesAzureClickhouseCI/CD
Requirements
- Have at least 3 years of experience in a data role involving data stores, feature engineering, and reliable high-load data pipelines.
- Have at least 2 years of professional software development experience outside data engineering.
- Be proficient in Python.
- Have experience with Kafka infrastructure and distributed data systems.
- Have a deep understanding of SQL and NoSQL databases; ClickHouse is preferred.
- Be familiar with public cloud providers such as AWS or Azure.
- Have experience with CI/CD, Kubernetes, containerization, and microservice design.
- Be able to make independent decisions about data processing strategy and architecture.
- Be self-directed and able to work effectively in a fast-paced environment.
- Familiarity with coding using agents is part of the interview process.
- Machine learning fundamentals, including model training, inference, and PyTorch or TensorFlow, are nice to have.
Responsibilities
- Maintain, extend, and improve existing data/ML workflows and implement new ones for high-velocity data.
- Provide interfaces and systems that enable ML engineers and researchers to build datasets on demand.
- Influence data storage and processing strategies.
- Collaborate with ML, frontend, and backend teams to build the data platform.
- Reduce time-to-deployment for dashboards and ML models.
- Establish best practices and develop pipelines and software for building and using datasets.
- Work with large datasets under high performance constraints.
- Iterate quickly and support deployment of new products or features to millions of users.
View Full Description & ApplyYou'll be redirected to the employer's site