Senior Data Engineer - Agents Systems
New
CanadaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of experience in data engineering, including at least 2+ years working with streaming systems in production
- Required Skills
- PythonSQLMachine LearningScalaDistributed Systems
Requirements
- 5+ years of experience in data engineering
- 2+ years working with streaming systems in production
- Hands-on experience with Kafka Streams, Apache Flink, RisingWave, or similar frameworks
- Strong knowledge of feature store design, including real-time serving and point-in-time correctness
- Experience building pipelines that support production ML models or inference systems
- Proficiency in Python and/or Scala
- Strong SQL skills
- Experience with data observability, monitoring, and pipeline reliability best practices
- Ability to work in fast-paced, ambiguous environments within AI-driven engineering teams
- Strong collaboration skills when working with ML, infra, and product stakeholders
- Experience with distributed systems and scalable backend architectures
Responsibilities
- Design, build, and maintain real-time streaming data pipelines supporting AI and inference systems
- Develop and optimize low-latency feature stores ensuring consistency across online and offline environments
- Implement streaming architectures using tools such as Kafka Streams, Apache Flink, or RisingWave
- Collaborate with ML engineers to define data contracts, feature definitions, and pipeline SLAs
- Improve latency by migrating batch-based systems toward real-time streaming architectures
- Ensure observability, reliability, and data quality across all pipelines and feature systems
- Support inference and agent system workflows where data engineering and ML serving intersect
- Evaluate and integrate new streaming and feature engineering technologies to evolve the platform
View Full Description & ApplyYou'll be redirected to the employer's site
