Data Engineer - Data Platform
New
J
JobgetherData Platform
Work remotely from IndiaFull-TimeMiddle
SalaryCompetitive base salary along with meaningful equity participation.
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years of experience in data engineering or data infrastructure
- Required Skills
- AWSPythonSQLSnowflakeAirflowData engineeringdbt
Requirements
- 3+ years of experience in data engineering or data infrastructure.
- 2+ years of hands-on Snowflake experience.
- Strong production-grade Python and SQL skills.
- Proven experience integrating LLMs into production data pipelines or quality systems.
- Experience building or maintaining evaluation and testing harnesses for LLM outputs.
- Production experience with dbt and Airflow for resilient DAGs and modular data models.
- Experience with cloud data warehouse schema design, query optimization, and cost control.
- Daily experience using AI coding tools such as Claude Code or Cursor.
- Strong systems thinking and ability to assess upstream/downstream impact.
- Familiarity with embeddings, vector search, fuzzy matching, or model distillation is a plus.
Responsibilities
- Build and operate production systems that use LLMs for extraction, enrichment, entity resolution, and semantic validation across millions of records.
- Develop labelled evaluation datasets, scoring systems, and regression suites to measure LLM performance.
- Apply engineering judgment to balance deterministic approaches like SQL and regex with LLM-based decisions.
- Establish token budgets, route workloads, and monitor model behavior for drift.
- Ensure production LLM calls and data pipelines are fully observable with comprehensive logs, metrics, and alerts.
- Build and maintain Airflow orchestration and modular dbt models across staging and mart layers.
- Develop matching and deduplication capabilities using embeddings and retrieval techniques.
View Full Description & ApplyYou'll be redirected to the employer's site
