Staff Software Engineer
New
J
JobgetherSecurity & IT
Based in IndiaFull-TimeStaff
SalaryCompetitive compensation package.
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 7 years of combined experience in software engineering and/or data engineering
- Required Skills
- AWSPythonSQLApache AirflowJavaSparkTerraformScaladbt
Requirements
- At least 7 years of combined experience in software engineering and/or data engineering, with substantial depth in both disciplines.
- Strong software engineering fundamentals and experience writing clean, maintainable, testable, and well-reviewed code in Java, Python, or Scala.
- Strong experience building and optimizing data pipelines using Trino, Spark, dbt, or comparable data frameworks.
- Experience designing and developing backend services, APIs, integrations, and data platform components.
- Hands-on experience managing application and data infrastructure in public cloud environments, particularly AWS, including services such as EMR, EC2, S3, and IAM.
- Experience with orchestration platforms such as Apache Airflow or Dagster.
- Strong SQL skills and the ability to move comfortably between SQL and general-purpose programming languages.
- Knowledge of modern data modeling techniques and architectures for data lakes.
- Familiarity with RAG and other architectural patterns for AI-powered applications.
- Experience building API integrations to extract and process data from third-party sources.
- Proficiency with Configuration-as-Code and Infrastructure-as-Code tools such as Pulumi, Terraform, and/or Ansible.
- Ability to travel approximately 25% for onboarding, team or department events, customer engagements, and other business activities.
Responsibilities
- Design, build, and operate high-quality data lakes and the software systems and pipelines that support them across business functions.
- Develop production-grade services, APIs, tooling, integrations, and automation that enable reliable data workflows at scale.
- Leverage Trino and related technologies to solve complex data management, analytics, and software architecture challenges.
- Build and optimize data pipelines using technologies such as Trino, Spark, dbt, and modern orchestration frameworks.
- Collaborate with technical leads, product managers, data analysts, and other stakeholders to develop robust data products and analytics solutions.
- Build infrastructure that enables broader, more effective access to organizational datasets, including support for AI-driven applications.
- Support dataset preparation, model evaluation, and RAG-based use cases for AI initiatives.
- Define and evolve engineering standards, processes, and best practices spanning software and data engineering, with an emphasis on reliability, maintainability, and speed.
- Work with engineering and business leaders to continuously improve data architecture and the systems that implement it.
- Identify emerging patterns in data management, software engineering, and AI, and help translate relevant innovations into practical solutions.
- Contribute to technical decision-making and provide senior-level guidance across projects and teams.
View Full Description & ApplyYou'll be redirected to the employer's site
