Senior Data Platform Engineer
New
PortugalFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- Proven experience
- Required Skills
- KafkaSnowflakeGrafanagRPCPrometheusSparkdbtDatabricksHIPAA
Requirements
- Proven experience designing and operating data platforms at scale - warehouse, data lake, or lakehouse architectures in production.
- Hands-on experience with a modern lakehouse table format - Iceberg strongly preferred; Delta Lake or Hudi also welcome.
- Clear mental model of catalogs (REST, Polaris, Glue, Unity, Hive).
- Exposure to at least one vendor lakehouse or query platform - Snowflake, Starburst, or Databricks.
- Strong experience with a distributed processing engine - Flink strongly preferred; Spark also fine.
- Familiarity with durable execution - Temporal, Restate, or similar.
- Production experience building and operating APIs (REST or gRPC) at scale.
- Solid understanding of Kafka and event-driven architectures.
- Comfortable in regulated environments (healthcare, fintech, gov).
- Platform mindset: you design for self-service, API-first, and with systems and agents.
Responsibilities
- Design and evolve Sword’s streaming lakehouse.
- Build and operate distributed streaming pipelines that move data at low latency and high reliability.
- Own the durable workflows that coordinate complex data movement across systems.
- Shape the platform’s API surface.
- Drive evaluations and integrations with vendor data platforms.
- Contribute to the self-service and agentic layer: interfaces designed to be consumed by humans, systems, and AI agents alike.
- Partner with data engineers and analysts on contracts, governance, and lineage.
- Build and maintain AI-ready data infrastructure that powers ML and AI-driven products across Sword.
- Leverage AI coding assistants and LLMs to accelerate development, automate documentation, and raise code quality.
- Work in a regulated environment where audit, compliance, and governance are part of every design.
View Full Description & ApplyYou'll be redirected to the employer's site