Staff Data Platform Engineer
New
O
OXIOTelecommunications
Remote, New York City Office, Canada, Montreal OfficeFull-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 15+ years of experience in software engineering with a strong focus on data systems and platform architecture
- Required Skills
- PythonSQLKafkaKubernetesAirflowGoSparkTerraformScaladbt
Requirements
- 15+ years of experience in software engineering with a strong focus on data systems and platform architecture
- 10+ years of experience building data solutions using data lakehouse architectures and self-serve data platforms
- 10+ years of hands-on programming experience with Scala, Go, Python, and SQL
- 5+ years of experience building scalable data solutions using Python, Spark, and Terraform
- Proven experience building serverless and scalable ML infrastructure
- Deep expertise in cloud-native data stacks (AWS, Databricks, Snowflake, BigQuery, Synapse)
- Strong understanding of microservices architecture, event-driven systems (Kafka), and container orchestration (Kubernetes)
- Experience with orchestration tools like Airflow or Prefect and transformation tools like DBT
- Proficient in building and scaling APIs (REST/gRPC) for data access and activation
- Strong grasp of data governance, compliance frameworks, and secure data sharing practices
- Experience applying AI/ML and LLMs to data products and predictive analytics
Responsibilities
- Architect, build, and scale a unified data platform integrating internal and external sources into data lakes and warehouses
- Design and implement streaming and batch data pipelines using tools like Spark, Airflow, and DBT
- Lead infrastructure provisioning using Terraform and Kubernetes, ensuring scalable and secure deployments
- Evaluate and drive the migration to our North Star data architecture, aligning platform capabilities with long-term business goals
- Collaborate with cross-functional teams to define logging standards, data contracts, and consumption patterns
- Drive best practices in data governance, privacy compliance (GDPR, CCPA), and metadata management
- Build APIs and data services to support real-time activation and client-facing data sharing
- Participate in strategic architectural decisions and long-term data roadmap planning
- Evangelize modern data Platform & engineering practices across the organization
- Mentor junior engineers and contribute to hiring and team growth
View Full Description & ApplyYou'll be redirected to the employer's site