Staff Data Engineer
New
CanadaFull-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 10+ years
- Required Skills
- AWSPythonSQLApache AirflowETLJavaKafkaKubernetesSpark
Requirements
- 10+ years of software engineering experience, including ownership of large-scale production systems
- Strong experience building and operating data-intensive distributed systems at scale
- Proven experience in a senior, staff, or lead engineering role influencing architecture and technical direction
- Strong programming skills in Python or Java, with experience building microservices and APIs
- Hands-on experience with Kafka or equivalent event streaming systems (e.g., Kinesis, Pub/Sub)
- Strong expertise in Spark or Flink for large-scale batch and streaming data processing
- Experience with Airflow or similar orchestration tools and Kubernetes-based environments
- Strong SQL, data modeling, and ETL/ELT design experience
- Experience with cloud platforms (AWS preferred) and understanding of cost, scalability, and reliability tradeoffs
- Experience building or integrating AI/LLM-based systems, agents, or automation workflows is highly valued
- Strong communication skills with the ability to influence technical and non-technical stakeholders
- Proven ability to mentor engineers and drive best practices across teams
Responsibilities
- Own the architecture and evolution of large-scale data pipelines, including streaming and batch systems for MLS and property data
- Design and implement event-driven data flows using Kafka or similar messaging systems
- Build and maintain backend services and APIs in Python or Java to serve data to product and AI systems
- Develop scalable data processing workflows using Spark or Flink, orchestrated with tools such as Airflow
- Ensure high standards of data quality, lineage, governance, and reliability across all pipelines
- Implement observability practices including monitoring, alerting, logging, and operational runbooks
- Collaborate with product, ML, and engineering teams to support AI agents and data-driven features
- Mentor engineers and contribute to technical design reviews and architectural decisions
View Full Description & ApplyYou'll be redirected to the employer's site
