Senior Data Engineer
New
R
RYZ LabsData Engineering
Remote position - only for professionals based in LATAM.ContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- PythonSQLTerraform
Requirements
- 5+ years of experience building and operating production-grade data pipelines.
- Strong experience with both batch data processing and event-driven architectures.
- Hands-on experience with AWS Glue, Athena, and S3-based data lakes.
- Strong proficiency in Python and SQL for data transformation, processing, and analysis.
- Experience with identity resolution, entity matching, or deduplication.
- Understanding of durable identifiers and first-seen/locked identity mappings.
- Experience with event schemas and schema-registry-backed contracts (e.g., Protobuf).
- Strong troubleshooting and production incident-response skills.
- Ability to understand and debug code written in functional or concurrent languages (e.g., Elixir).
- Strong communication and collaboration skills.
Responsibilities
- Own and evolve data ingestion pipelines including source scraping, data cleaning, and curation using AWS Glue.
- Design and maintain reliable batch and event-driven data workflows across the data platform.
- Diagnose and resolve identity-resolution issues including deduplication and entity-matching challenges.
- Develop and maintain data quality and validation frameworks like freshness monitoring and schema-drift detection.
- Monitor data at the ingestion boundary and proactively identify issues before they impact downstream products.
- Partner with engineering teams to trace data and events end-to-end.
- Collaborate with Product and Analytics stakeholders to align pipeline requirements.
- Automate infrastructure and pipeline changes using Infrastructure as Code (Terraform or AWS CDK).
- Participate in production incident response to identify scope and implement remediation.
View Full Description & ApplyYou'll be redirected to the employer's site
