Senior Data Platform Engineer
New
S
SwordAI Healthcare
Remote - PortugalFull-TimeSenior
Salary€52.500 — €82.500 EUR
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Artificial IntelligenceKafkagRPCREST APISpark
Requirements
- Proven experience designing and operating data platforms at scale (warehouse, data lake, or lakehouse).
- Hands-on experience with a modern lakehouse table format (Iceberg preferred, Delta Lake or Hudi).
- Clear mental model of catalogs (REST, Polaris, Glue, Unity, Hive) and storage/compute detachment.
- Experience with at least one vendor platform (Snowflake, Starburst, or Databricks).
- Strong experience with a distributed processing engine (Flink preferred, Spark).
- Familiarity with durable execution (e.g., Temporal, Restate).
- Production experience building and operating APIs (REST or gRPC) at scale.
- Solid understanding of Kafka and event-driven architectures.
- Comfort working in regulated environments (healthcare, fintech, gov).
- Platform mindset with a focus on self-service and API-first design.
- Ability to demonstrate at least Level 1 AI proficiency (Explorer level).
Responsibilities
- Design and evolve Sword’s streaming lakehouse architecture.
- Build and operate distributed streaming pipelines ensuring low latency and high reliability.
- Own durable workflows to coordinate complex data movement across systems.
- Shape the platform’s API surface for self-service consumption.
- Evaluate and integrate vendor data platforms within an architectural trade-off framework.
- Contribute to self-service and agentic layers for human and AI system consumption.
- Partner with data engineers and analysts on contracts, governance, and lineage.
- Build and maintain AI-ready data infrastructure for ML products.
- Leverage AI coding assistants and LLMs to accelerate development and automate documentation.
View Full Description & ApplyYou'll be redirected to the employer's site
