AI-Assisted Developer Workflows (Trace) AI Task Auditor

NewInactive
J
JobgetherAI training
Based in IndiaContract
This job is no longer active. We keep the page for reference, but the employer may not accept new applications.
Salary60 USD per hour
Job closed

Job Details

Requirements

  • Demonstrable professional experience and deep technical knowledge in modern developer tooling.
  • Experience with AI-assisted coding tools, developer workflow ecosystems, telemetry, trace analysis, or closely related technical domains.
  • Strong analytical and problem-solving skills for rigorously testing and troubleshooting complex technical scenarios.
  • Ability to assess technical tasks objectively for accuracy, practicality, reproducibility, and reliability.
  • Strong understanding of software development workflows and the technical challenges involved in AI-assisted development.
  • Ability to identify IDE integration issues, coding inefficiencies, logic errors, and other technical faults.
  • Strong attention to detail and ability to provide precise, actionable technical feedback.
  • Specialty assignment is based on professional experience; expertise across all listed domains is not required.
  • Ability to work independently in a remote freelance environment and deliver high-quality technical assessments.

Responsibilities

  • Evaluate developer workflow tasks for technical accuracy, realism, solvability, reproducibility, and completeness.
  • Assess whether tasks are supported by reliable tests and appropriate evaluation criteria.
  • Audit AI-assisted developer workflows and identify issues that could affect training and evaluation task quality or validity.
  • Review IDE integrations and identify technical faults, inconsistencies, or workflow issues.
  • Analyze AI-assisted coding processes for inefficiencies, logic errors, and technical shortcomings.
  • Test and troubleshoot complex technical scenarios to determine whether tasks function as intended.
  • Provide clear, actionable, and technically detailed feedback on identified issues.
  • Apply specialized knowledge of developer tooling, AI coding assistants, telemetry, trace analysis, and developer workflow ecosystems.
  • Help ensure AI training tasks meet technical standards and reflect practical developer workflows.
Job closed
60 USD per hour
Job closed