Software Engineer - AI Tooling

New
J
JobgetherAI developer tools
Based in New ZealandFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
At least 5 years of professional software engineering experience.
Required Skills
PostgreSQLJavascriptTypeScript

Requirements

  • At least 5 years of professional software engineering experience.
  • Strong proficiency in TypeScript.
  • Extensive knowledge of the JavaScript ecosystem, including npm, ES modules, bundlers, and compatibility considerations.
  • Deep familiarity with AI tools, agent architectures, development patterns, and their practical trade-offs.
  • Experience building developer tools, product interfaces, or platform components used by other engineers.
  • Experience designing, implementing, or working with evaluation frameworks for AI quality, reliability, and task success.
  • Understand evaluation fundamentals, including baselines, performance variance, costs, and measurable quality improvements.
  • Apply solid testing practices and validate software reliability under real-world conditions.
  • Good knowledge of PostgreSQL and relational database principles.
  • Write effectively and collaborate across engineering, product, and documentation teams.
  • Work comfortably in asynchronous, globally distributed teams and manage priorities independently.
  • Additional experience with vector databases, embeddings, semantic search, or pgvector is advantageous.
  • Experience with customer-facing AI features, assistants, or autonomous agents; technical documentation for developers and AI agents; Braintrust or similar evaluation and tracing platforms; CI/CD quality gates; or open-source developer tools is advantageous.

Responsibilities

  • Design, develop, and improve AI-powered developer tools, including MCP servers, intelligent agents, agent skills, and dashboard assistants.
  • Build tools, integrations, and evaluation frameworks that make products and features accessible to AI agents.
  • Prototype emerging AI technologies and agent architectures, assess their effectiveness, and identify production-ready solutions.
  • Develop evaluation frameworks, instrumentation, and feedback loops to measure AI tool quality and effectiveness.
  • Benchmark AI-powered tools against no-tool baselines, monitor performance, and define quality indicators and release criteria.
  • Analyze developer and AI-agent usage and use the findings to improve interfaces, documentation, and functionality.
  • Structure and expose technical documentation and product knowledge for AI agents, and measure its effectiveness.
  • Develop reusable patterns for customer AI integrations, including MCP integrations with Edge Functions, vector embeddings, and AI agents running on Edge Functions.
  • Provide contribution guidelines, templates, documentation, and review processes for teams building AI capabilities.
  • Test, benchmark, and stress-test production systems; collaborate with infrastructure engineers on hosting, authentication, scalability, and reliability.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now