Senior Engineering Manager, AI
New
A
AlphaSenseMarket Intelligence
Remote - United StatesFull-TimeManager
Salary$275,000 — $375,000 USD
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonJavaLLMDistributed SystemsCoaching
Requirements
- Proven track record of managing and growing high-performing teams of senior and staff engineers.
- Background in designing, building, and operating high-throughput, low-latency distributed systems.
- Experience with complex routing, caching, queueing, or rate limiting.
- Ability to engage in high-level architectural discussions and provide technical direction.
- Exceptional communication and partnership skills to align diverse stakeholders.
- Familiarity with AI tools and an AI-first mindset for engineering workflows.
- Nice to have: Experience in applied AI space or frameworks like LangChain, LangGraph, LiteLLM, or OpenRouter.
- Nice to have: Experience with orchestrators and proxies such as Temporal or Envoy.
- Nice to have: Proficient in Python, Java, and distributed caching/queueing systems.
Responsibilities
- Manage, mentor, and grow a team of up to 10 senior and staff software engineers.
- Foster a culture of technical excellence, predictable delivery, and career growth.
- Own the strategy and architecture of the enterprise AI Gateway to ensure high availability and performance.
- Guide the integration and management of multiple LLM vendors and models, optimizing for latency, cost, and reliability.
- Partner with product management, AI research, and executive leads to align the roadmap with organizational goals.
- Define and champion software engineering best practices, architectural standards, and cost-tracking telemetry.
View Full Description & ApplyYou'll be redirected to the employer's site
