AI Engineer (AI & Automation)
New
I
Industrial Security Integrators, LLCAI automation
Source API remote eligibility restrictions: United StatesContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of software engineering experience, including 2+ years building and shipping LLM-powered applications to production users
- Required Skills
- AWSPythonGitTypeScriptCI/CDRESTful APIsTerraform
Requirements
- 5+ years of software engineering experience, including 2+ years building and shipping LLM-powered applications to production users.
- Hands-on experience with AI agents, including tool or function calling, structured outputs, retrieval (RAG), and prompt and context design.
- Experience building evaluations for LLM systems, including regression sets and accuracy measurement.
- Strong proficiency in Python or TypeScript and ability to work within an existing full-stack codebase.
- Experience designing, deploying, and operating AWS infrastructure, including a managed model service such as Amazon Bedrock.
- Experience building integrations with REST APIs and third-party SaaS platforms.
- Experience using AI tooling such as Claude, Codex, or an equivalent service to develop enterprise software.
- Familiarity with Git and CI/CD practices.
- Preferred: bachelor's degree in computer science, software engineering, or a related technical field, or equivalent work or military experience.
- Preferred: experience with AWS GovCloud or other regulated cloud environments, document extraction, form-filling, or workflow automation.
- Preferred: hands-on Terraform experience and experience with vector databases such as pgvector, OpenSearch, or Pinecone.
- Preferred: Docker or Kubernetes experience and familiarity with CMMC, NIST SP 800-171, DFARS, or FedRAMP.
- Preferred: experience in government contracting or the defense sector.
Responsibilities
- Build and ship LLM-powered applications and AI agents for production users.
- Implement tool or function calling, structured outputs, retrieval, and prompt and context design in AI workflows.
- Build evaluation harnesses with regression sets and accuracy metrics, and use them to gate releases.
- Implement tracing, logging, and cost monitoring for production AI workflows.
- Define accuracy and quality targets with business stakeholders and report against them.
- Embed least-privilege access, human-in-the-loop controls, audit logging, and data classification into AI workflows.
- Enforce handling requirements for sensitive and controlled information, including CUI, and support relevant compliance obligations.
- Deploy and operate AI services in AWS, including AWS GovCloud, using Terraform, managed model services, and containerized or serverless runtimes.
- Use CI/CD for deployments and contribute through pull requests and code reviews.
- Work with business stakeholders to scope minimum viable products, demonstrate progress weekly, and document work for the permanent team.
View Full Description & ApplyYou'll be redirected to the employer's site