Principal Software Quality Engineer
New
W
Weekday AIDistributed databases
Remote (India)Full-TimePrincipal
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 10–18 years of experience in Software Quality Engineering, SDET, or Systems Engineering
- Required Skills
- PythonC++Distributed Systems
Requirements
- Have 10–18 years of experience in Software Quality Engineering, SDET, or Systems Engineering, with demonstrated Staff- or Principal-level technical impact.
- Bring hands-on experience testing distributed databases or storage systems; NoSQL platforms are preferred.
- Have experience testing replication, partitioning, sharding, consistency, transactions, secondary indexes, backup and restore, and cross-datacenter replication.
- Understand distributed-systems fundamentals, including consensus, quorum reads and writes, consistency models, split-brain scenarios, clock skew, and failure and recovery semantics.
- Be able to read and debug server-side code in C, C++, Go, Rust, or Java and trace defects to specific functions and root causes.
- Have software engineering and automation skills in Python and proficiency in at least one systems programming language.
- Have practical experience with fault injection, GDB, chaos-style testing, network and disk faults, corrupted inputs, version skew, and boundary-value testing.
- Have experience across unit, integration, API, contract, end-to-end, performance, scalability, upgrade and downgrade, and soak testing.
- Have strong CI/CD experience with GitHub Actions, Jenkins, or equivalent tools, and experience managing shared test infrastructure.
- Have practical experience using AI agents for testing, including agent workflows, tool integration, evaluation design, and integration with testing frameworks.
- Be able to debug and investigate protocol and serialization edge cases, including wire formats, MessagePack, Protocol Buffers, Thrift, and compression codecs.
- Preferred experience includes client SDK testing, Kubernetes and database operator testing, cloud infrastructure, and security-focused testing.
Responsibilities
- Own the quality strategy, test architecture, coverage models, release gates, and risk-based prioritization for the distributed database platform.
- Drive quality across server components, client SDKs, operator and backup tooling, and management interfaces.
- Design testing strategies for database operations including replication, rebalancing, partitioning, consistency, transactions, indexes, query planning, compaction, and backup and restore.
- Validate cluster correctness under production-like failures and conditions, including node failures, network partitions, clock skew, disk faults, rolling upgrades, and long-running tests.
- Build and maintain scalable test frameworks using Python, pytest, custom harnesses, API testing, and end-to-end automation.
- Improve test-farm reliability by reducing flaky tests, identifying noisy failures, and strengthening regression coverage.
- Lead integration of AI agents into testing frameworks and develop evaluation suites for AI-generated outputs.
- Reproduce system defects, identify suspect functions, and provide minimal reproducible test cases and root-cause analysis.
- Convert production and pre-release incidents into regression tests, monitoring checks, and preventive measures.
- Mentor senior QEs and SDETs and establish quality practices across QE, client, and server engineering teams.
View Full Description & ApplyYou'll be redirected to the employer's site
