Senior Software Engineer - Semantic Data Lake
New
J
JobgetherData Engineering
IndiaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 4–8 years
- Required Skills
- PythonSQLApache AirflowKubernetesGrafanaTerraformScalaLLM
Requirements
- 4–8 years of experience in software or data engineering focusing on transformation, modeling, or data-intensive applications.
- Strong SQL skills and proficiency in Python or Scala.
- Hands-on experience using AI development tools such as Claude, GitHub Copilot, or Cursor.
- Practical knowledge of AI-native architectures, LLM-driven applications, RAG, agentic workflows, vector databases, and ontologies.
- Experience with frameworks such as LangGraph or CrewAI.
- Familiarity with AI engineering practices like prompt design, Spec-Driven Development, and AI-assisted code review.
- Strong experience with data orchestration and Apache Airflow.
- Knowledge of data validation and quality frameworks such as Great Expectations.
- Experience with Infrastructure as Code, Terraform, Kubernetes, and CI/CD automation.
- Experience with enterprise data governance and metadata management platforms like DataHub.
- Knowledge of observability using Grafana and incident-management practices.
Responsibilities
- Design and implement core infrastructure and control-plane services that orchestrate data lifecycles from ingestion through consumption.
- Build proactive reliability capabilities, including observability frameworks, automated quality gates, and validation mechanisms.
- Develop self-service portals, developer tooling, and reusable templates for domain teams to manage trusted data products.
- Automate governance and security capabilities such as lineage, metadata management, RBAC, and auditability.
- Contribute to AI-native data architecture, including RAG systems, agentic workflows, and semantic models.
- Utilize AI coding assistants to accelerate development while applying engineering judgment to validate outputs.
- Collaborate with stakeholders to translate business concepts into scalable frameworks and semantic models.
View Full Description & ApplyYou'll be redirected to the employer's site
