Staff Software Engineer
New
A
A Place for MomSenior Care Technology
RemoteFull-TimeStaff
Salary$160K - $190K • Bonus: 10% of Annual Earnings
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years
- Required Skills
- AWSPostgreSQLDynamoDBTypeScriptLLMDistributed Systems
Requirements
- 8+ years of software engineering experience, specifically in building platform infrastructure, developer tools, SDKs, or distributed systems.
- Production experience with LLM/AI systems (OpenAI, Anthropic) and managing challenges like token limits and model deprecations.
- Strong TypeScript expertise for API design and development.
- Experience designing APIs and abstractions that balance power and simplicity.
- Understanding of safety and compliance in AI, including PII handling, guardrails, and audit logging.
- Proficiency with event-driven architectures and async processing (EventBridge, SQS).
- Understanding of observability, metrics, tracing, and alerting in distributed systems.
- Strong communication and technical writing skills for documentation.
- Track record of technical leadership, including mentoring and driving architectural decisions.
- Experience with cloud infrastructure (AWS: Fargate, DynamoDB, RDS, S3).
Responsibilities
- Design and build core platform primitives including provider abstraction, structured output validation, streaming infrastructure, and token management.
- Own safety and compliance infrastructure including guardrail systems, PII detection, and privacy-first observability.
- Build evaluation infrastructure for systematic quality measurement of non-deterministic LLM outputs.
- Lead churn containment strategy for rapidly changing LLM provider SDKs.
- Architect prompt lifecycle management, version control, and CI/CD integration pipelines.
- Design Agent-as-a-Service infrastructure for long-running async tasks using AWS EventBridge, DynamoDB, and PostgreSQL.
- Collaborate with internal teams to onboard them to the platform and provide technical support.
View Full Description & ApplyYou'll be redirected to the employer's site