Staff Software Engineer - AI Platform
New
M
MeridianLinkFinTech
US RemoteFull-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years
- Required Skills
- AWSDockerPythonDjangoKubernetesTypeScriptFastAPIGrafanaPrometheusReactCI/CDRESTful APIsTerraformDatadogMLOpsGenerative AIDistributed SystemsNetworking
Requirements
- 8+ years in professional software engineering, with demonstrated cross-team architectural influence
- Proven end-to-end delivery of AI-powered features, from product concepts to production
- Experience leading large, complex technical initiatives
- Strong proficiency in Python and RESTful API development (FastAPI, Django)
- Knowledge of full-stack development (React, TypeScript)
- Hands-on integration with third-party LLM/AI APIs
- Experience with AWS (preferred), including IAM, networking, managed services, and storage
- Solid foundation in distributed systems, API design, cloud-native architecture
- Comfortable with CI/CD pipelines, version control, Docker, and AI-assisted development tools
- Demonstrated ability to author durable technical proposals (RFCs, ADRs)
- Clear communicator with technical and non-technical stakeholders
- GenAI experience (e.g., RAG pipelines, prompt management, LLM evaluation, agent frameworks)
- Familiarity with vector databases/semantic search (Pinecone, pgvector, OpenSearch)
- Exposure to model serving, MLOps/LLMOps practices, and model lifecycle/deployment tools
- Experience building developer platforms, SDKs, and self-service engineering tooling
- Experience with IaC tools (Terraform/Pulumi), Kubernetes, and observability tools (Prometheus, Grafana, Datadog)
- Leadership in technical communities, mentoring, and architectural standards
- Bachelor’s in Computer Science, Software Engineering, or equivalent experience
Responsibilities
- Define multi-team strategy, address architectural bottlenecks, and evaluate build vs. buy decisions across the platform.
- Architect scalable AI systems with security, compliance, and developer experience at the core.
- Lead cross-team architecture reviews, drive collaborative alignment, establish engineering best practices.
- Mentor and sponsor engineers at L3–L4 levels, facilitate knowledge sharing, and drive tech debt and best practice initiatives.
- Author clear, auditable architectural documentation; translate technical concepts for business partners; and partner with Product on business requirements and roadmaps.
- Own the reference architecture for the AI platform, encompassing API abstractions, prompt and version management, RAG infrastructure, vector retrieval, evaluation harnesses, and model serving.
- Contribute to backend development in Python and RESTful API design, including integrations with leading AI providers.
- Build and maintain tooling, SDKs, and platform APIs to enable safe, scalable AI adoption by product teams.
- Implement integrations with LLMs: context management, prompt templating, response validation, and robust fallback strategies.
- Advise and collaborate with Security through architecture and design phases, ensuring compliance and security standards are met.
View Full Description & ApplyYou'll be redirected to the employer's site
