Senior Data Platform Engineer

A
Aker SystemsData platforms
Remote/Home Based, UKFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
5+ years of relevant professional experience
Required Skills
AWSPythonSQLJavaKafkaKubernetesAzureSparkTerraform

Requirements

  • Have 5+ years of relevant professional experience in Data Engineering, Data Platform Engineering, Software Engineering, Platform Engineering or a similar technical discipline.
  • Demonstrate strong hands-on experience building and operating cloud-native data platforms.
  • Have strong programming experience using Java and/or Python.
  • Have hands-on experience with real-time streaming and event-driven architectures, including Kafka, Kinesis or equivalent.
  • Have experience with distributed data processing technologies such as Spark, Flink or Kafka Streams.
  • Have strong experience with AWS and/or Azure cloud environments.
  • Have experience with relational and NoSQL databases, strong SQL skills, data modelling and schema design.
  • Have experience with CI/CD, DevOps practices and Terraform or equivalent Infrastructure as Code technologies.
  • Have experience with Docker and/or Kubernetes and GitHub/GitLab source control practices.
  • Have experience implementing monitoring, logging and observability for platform services and supporting production systems.
  • Understand platform security, resilience, scalability and availability.
  • Have UK Government Security Check (SC) clearance.

Responsibilities

  • Design, develop, test and deploy data platform services and components.
  • Build and maintain platform capabilities for batch and real-time data workloads.
  • Develop and operate distributed data services using Kafka, Kinesis, Spark, Flink or equivalent technologies.
  • Build and maintain cloud-native data platform capabilities using AWS and/or Azure.
  • Support data ingestion, processing, storage and integration across multiple systems.
  • Develop and maintain data models, schemas and platform data structures.
  • Implement CI/CD pipelines and use Infrastructure as Code to create repeatable environments.
  • Monitor platform services, investigate failures and participate in incident investigation and root cause analysis.
  • Contribute to platform security, performance, scalability, resilience and availability improvements.
  • Contribute to technical design decisions, code reviews and engineering standards.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now