Senior Software Engineer, Applied AI
New
S
SylloLegal Technology
United States - RemoteFull-TimeSenior
Salary160,000 - 200,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonPrompt EngineeringLLMUnit TestingDistributed Systems
Requirements
- Deep engineering fluency in building and deploying complex, high-quality software systems.
- Emphasis on maintainable code, rigorous testing, and engineering best practices.
- Fluent in Python and its ecosystem for backend services and data processing.
- Strong grasp of system design principles, including distributed systems and API design.
- Demonstrated ability to design scalable distributed systems.
- Experience directly building, shipping, and maintaining AI-powered products, agents, or intelligent features in a commercial setting.
- Hands-on experience with the engineering challenges of integrating Large Language Models into a production environment.
- Experience with prompt engineering, working with vector databases, RAG systems, and managing context windows.
- Excellent ability to read, understand, and navigate an unfamiliar codebase quickly.
Responsibilities
- Design and build high-performance, production-level AI-powered features and services, with a focus on reliability and scalability.
- Develop robust engineering solutions to mitigate the inherent unreliability of LLMs including guardrails, validation, error handling, and caching.
- Design long-running batch processing that is idempotent, resumable, and resilient.
- Optimize latency, throughput, and cost efficiency for all AI-powered services.
- Serve as an engineering expert in integrating models and data feeds with existing business logic and APIs.
- Define and implement evaluation for AI feature output quality.
- Implement rigorous testing strategies to ensure the robustness of AI features.
- Maintain high standards for code quality, architectural design, and system documentation.
- Take ownership of the full lifecycle of new AI features from design to deployment and monitoring.
- Work closely with product managers and engineers to deliver features on a fast iterative cycle.
View Full Description & ApplyYou'll be redirected to the employer's site