Software Engineer - AI Tooling
New
J
JobgetherAI developer tools
Based in New ZealandFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 5 years of professional software engineering experience.
- Required Skills
- PostgreSQLJavascriptTypeScript
Requirements
- At least 5 years of professional software engineering experience.
- Strong proficiency in TypeScript.
- Extensive knowledge of the JavaScript ecosystem, including npm, ES modules, bundlers, and compatibility considerations.
- Deep familiarity with AI tools, agent architectures, development patterns, and their practical trade-offs.
- Experience building developer tools, product interfaces, or platform components used by other engineers.
- Experience designing, implementing, or working with evaluation frameworks for AI quality, reliability, and task success.
- Understand evaluation fundamentals, including baselines, performance variance, costs, and measurable quality improvements.
- Apply solid testing practices and validate software reliability under real-world conditions.
- Good knowledge of PostgreSQL and relational database principles.
- Write effectively and collaborate across engineering, product, and documentation teams.
- Work comfortably in asynchronous, globally distributed teams and manage priorities independently.
- Additional experience with vector databases, embeddings, semantic search, or pgvector is advantageous.
- Experience with customer-facing AI features, assistants, or autonomous agents; technical documentation for developers and AI agents; Braintrust or similar evaluation and tracing platforms; CI/CD quality gates; or open-source developer tools is advantageous.
Responsibilities
- Design, develop, and improve AI-powered developer tools, including MCP servers, intelligent agents, agent skills, and dashboard assistants.
- Build tools, integrations, and evaluation frameworks that make products and features accessible to AI agents.
- Prototype emerging AI technologies and agent architectures, assess their effectiveness, and identify production-ready solutions.
- Develop evaluation frameworks, instrumentation, and feedback loops to measure AI tool quality and effectiveness.
- Benchmark AI-powered tools against no-tool baselines, monitor performance, and define quality indicators and release criteria.
- Analyze developer and AI-agent usage and use the findings to improve interfaces, documentation, and functionality.
- Structure and expose technical documentation and product knowledge for AI agents, and measure its effectiveness.
- Develop reusable patterns for customer AI integrations, including MCP integrations with Edge Functions, vector embeddings, and AI agents running on Edge Functions.
- Provide contribution guidelines, templates, documentation, and review processes for teams building AI capabilities.
- Test, benchmark, and stress-test production systems; collaborate with infrastructure engineers on hosting, authentication, scalability, and reliability.
View Full Description & ApplyYou'll be redirected to the employer's site