Staff Data Platform Engineer

New
O
OXIOTelecommunications
Remote, New York City Office, Canada, Montreal OfficeFull-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
15+ years of experience in software engineering with a strong focus on data systems and platform architecture
Required Skills
PythonSQLKafkaKubernetesAirflowGoSparkTerraformScaladbt

Requirements

  • 15+ years of experience in software engineering with a strong focus on data systems and platform architecture
  • 10+ years of experience building data solutions using data lakehouse architectures and self-serve data platforms
  • 10+ years of hands-on programming experience with Scala, Go, Python, and SQL
  • 5+ years of experience building scalable data solutions using Python, Spark, and Terraform
  • Proven experience building serverless and scalable ML infrastructure
  • Deep expertise in cloud-native data stacks (AWS, Databricks, Snowflake, BigQuery, Synapse)
  • Strong understanding of microservices architecture, event-driven systems (Kafka), and container orchestration (Kubernetes)
  • Experience with orchestration tools like Airflow or Prefect and transformation tools like DBT
  • Proficient in building and scaling APIs (REST/gRPC) for data access and activation
  • Strong grasp of data governance, compliance frameworks, and secure data sharing practices
  • Experience applying AI/ML and LLMs to data products and predictive analytics

Responsibilities

  • Architect, build, and scale a unified data platform integrating internal and external sources into data lakes and warehouses
  • Design and implement streaming and batch data pipelines using tools like Spark, Airflow, and DBT
  • Lead infrastructure provisioning using Terraform and Kubernetes, ensuring scalable and secure deployments
  • Evaluate and drive the migration to our North Star data architecture, aligning platform capabilities with long-term business goals
  • Collaborate with cross-functional teams to define logging standards, data contracts, and consumption patterns
  • Drive best practices in data governance, privacy compliance (GDPR, CCPA), and metadata management
  • Build APIs and data services to support real-time activation and client-facing data sharing
  • Participate in strategic architectural decisions and long-term data roadmap planning
  • Evangelize modern data Platform & engineering practices across the organization
  • Mentor junior engineers and contribute to hiring and team growth
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now