Blueprint

Built or owned evaluation infrastructure for LLMs or generative AI products
Experience designing QA workflows, human-in-the-loop systems, or LLM-as-a-judge pipelines
Think in terms of feedback loops — and can turn fuzzy product goals into testable quality metrics
Write code, ship experiments, and are comfortable working across the stack to get the right signals flowing

💡 Responsibilities

Design and build our end-to-end evaluation infrastructure: LLM-as-a-judge, human QA pipelines, offline scoring, and more
Define and implement application-specific quality metrics — not just accuracy, but tone, structure, clinical alignment, and more
Collaborate with product and clinical leads to turn subjective requirements into structured evaluation criteria
Monitor and analyze model performance across different therapist cohorts and workflows
Build tools and processes to capture in-the-wild feedback from clinicians and route it back into model and product improvement loops
Work closely with engineers to integrate eval into our CI, deployment, and iteration cycles
Help shape data labeling, prompt evaluation, experiment design, and prompt tuning frameworks

PythonArtificial IntelligenceData AnalysisMachine LearningQACI/CD

Posted 3 days ago

Apply

🔥 Principal Product Designer

Posted 3 months ago

📍 United States, Canada

🔍 Software Development

🔧 Requirements

Passion for design and figuring out best-in-class solutions to UX, UI, and interaction challenges
A portfolio of excellent product designs delivered within a fast-paced environment
Ability to think through complex interaction design
Ability to express ideas through visuals and prototyping (Blueprint uses Figma)
Excellent visual, UI, and interaction skills

💡 Responsibilities

Contribute to the strategic direction of our product with a deep focus on user needs and experience.
Define and refine feature areas with exceptional attention to detail, ensuring consistency and quality across broader flows.
Design polished, intuitive, and engaging user interfaces that build trust and highlight the power of our AI technology.
Collaborate closely with product managers, engineers, and other stakeholders to align on vision, strategy, and roadmap.
Rapidly prototype and iterate on ideas to communicate concepts and drive excitement.
Navigate a fast-paced, evolving startup environment by finding creative ways to ship high-quality work efficiently.
Help with hiring and establishing a design culture within the company

LeadershipAgileDesign PatternsFigmaProduct ManagementSCRUMUI DesignUser Experience DesignProduct AnalyticsProduct designCommunication SkillsRESTful APIsAttention to detailCross-functional collaborationStakeholder managementStrategic thinkingPrototyping

Posted 3 months ago

Apply

🔥 Customer Support Associate

Posted 6 months ago

📍 United States

🧭 Full-Time

🔍 Digital health

🔧 Requirements

Excellent customer-facing communication skills.
A track record of great customer service.
A positive attitude, even when things get tough.
A willingness to go above and beyond to deliver an amazing customer experience.
1+ years experience in a customer support or related role.
Experience with support/messaging platforms (e.g., Intercom, Zendesk, HelpScout).
Experience working with mental health providers and/or a clinical background is a plus.

💡 Responsibilities

Respond to customer questions and support inquiries via email and chat.
Communicate with customers about support ticket status, timelines, and final resolution.
Manage support tickets based on urgency and customer needs.
Troubleshoot & reproduce reported and/or known issues.
Help to create and maintain content and documentation in Blueprint's online help center.

Customer support

Posted 6 months ago

Apply