Principal Software Quality Engineer
New
W
WeekdayDistributed databases
Remote (India), Bengaluru, Karnataka, IndiaFull-TimePrincipal
Salary4,000,000 - 7,000,000 INR per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 10–18 years of experience
- Required Skills
- PythonJenkinsGitHub ActionsDistributed Systems
Requirements
- Have 10–18 years of experience in Software Quality Engineering, SDET, or Systems Engineering, with demonstrated Staff- or Principal-level technical impact.
- Bring hands-on experience testing distributed databases or storage systems, preferably NoSQL platforms; distributed relational databases are also relevant.
- Have experience testing replication, partitioning, sharding, consistency, transactions, secondary indexes, backup and restore, and cross-datacenter replication.
- Understand distributed-systems fundamentals, including replication protocols, consensus, quorum reads and writes, consistency models, split-brain scenarios, clock skew, and failure recovery.
- Be able to read and debug server-side code in C, C++, Go, Rust, or Java and trace defects to specific functions and root causes.
- Understand protocol and serialization edge cases, including wire formats, MessagePack, Protocol Buffers, Thrift, and compression codecs.
- Have strong Python software engineering and automation skills, plus proficiency in at least one systems programming language.
- Have practical experience with fault injection, GDB, chaos-style testing, network and disk faults, corrupted inputs, version skew, and boundary-value testing.
- Have experience across unit, integration, API, contract, end-to-end, performance, scalability, upgrade/downgrade, and soak testing.
- Have strong CI/CD experience with GitHub Actions, Jenkins, or equivalent tools, and experience managing shared test infrastructure.
- Have practical experience using AI agents for testing, including agent workflows, tool integration, prompt and evaluation design, and integration with testing frameworks.
- Be able to lead debugging and root-cause investigations across QE, client, and server teams and produce actionable technical analysis.
Responsibilities
- Own the platform’s quality strategy, test architecture, coverage models, release gates, and risk-based prioritization.
- Drive quality across server components, client SDKs, operator and backup tooling, and management interfaces.
- Design testing strategies for replication, rebalancing, partitioning, consistency, transactions, indexes, query planning, backup and restore, and cross-datacenter replication.
- Validate cluster correctness under failures, network partitions, clock skew, disk issues, upgrades, mixed-version deployments, and soak tests.
- Build and maintain scalable test frameworks using Python, pytest, custom harnesses, API testing, and end-to-end automation.
- Improve test-farm reliability by reducing flaky tests and strengthening regression coverage across shared infrastructure and CI/CD.
- Integrate AI agents into testing frameworks for test execution, log and state inspection, defect reporting, and failure triage.
- Develop evaluation frameworks using golden datasets, graders, and regression suites to measure AI-generated output reliability.
- Investigate defects at source-code level and provide minimal reproducible cases and root-cause analysis.
- Collaborate with QE, client, and server engineering teams, and mentor senior QEs and SDETs on debugging and test architecture.
View Full Description & ApplyYou'll be redirected to the employer's site