Blueprint Technologies

Blueprint is a technology solutions firm that helps companies accelerate their success through digital transformation.

501-1000 employees
Founded 2013
Consulting
Private Company

Open Positions9

Remote (U.S.-based)Full-TimeTechnology SolutionsPosted
  • Support an initiative focused on evaluating and improving AI-powered search and assistant experiences
  • Work with real user queries to build and refine evaluation datasets
  • Benchmark Microsoft Copilot against leading AI systems
  • Review and analyze real user query logs to identify queries with clear intent and representativeness
  • Curate and maintain high-quality datasets for AI system evaluation
  • Annotate queries across multiple evaluation dimensions (web search need, PII presence, domain expertise requirement, AI response quality attributes)
  • Ensure annotations are consistent, structured, and aligned with evaluation guidelines
  • Use tools such as Excel to organize, review, and summarize evaluation outputs
  • Identify trends in query patterns and provide feedback to improve dataset coverage and quality
  • Maintain high attention to detail, documentation quality, and evaluation integrity
Microsoft Excel
Showing 1 of 9 positions

About Blueprint Technologies

Blueprint Technologies accelerates company success through digital transformation. We're a technology solutions firm leveraging cutting-edge technologies to create new revenue streams and business lines for our clients. Our team of 501-1000 professionals connects strategy, business solutions, products, and services to drive growth. We utilize a robust technology stack, including Azure, Amazon S3, Cloudflare, and Microsoft technologies, fostering a collaborative engineering culture that embraces agile methodologies. We are committed to solving complex business problems and value diverse perspectives. With a strong presence across the US and a fully remote-friendly work environment, we offer opportunities for professional growth and development. Founded in 2013, Blueprint Technologies is a rapidly growing company with a substantial funding history. We're looking for talented individuals who share our passion for innovation and delivering exceptional results. Our engineering teams prioritize scalable and secure solutions, utilizing a range of technologies to meet diverse client needs. We emphasize continuous improvement and encourage innovative problem-solving, providing a supportive environment for engineers to grow their skills and expertise. We offer a comprehensive benefits package including competitive salaries, generous PTO, parental leave, and opportunities for professional development. Blueprint operates a fully remote workplace, creating a flexible and inclusive environment for our employees across the United States. Our diverse teams collaborate seamlessly, using cutting-edge tools and technologies to deliver exceptional results for our clients. We are a growing and evolving company committed to employee growth and work-life balance. We consistently rank among the top technology firms in the West Coast region. Blueprint Technologies values innovation, collaboration, and a commitment to delivering exceptional results. We provide a dynamic and inclusive workplace, fostering a culture of growth, development, and continuous learning. Our work environment is designed to support employee well-being and empower individuals to reach their full potential. Our rapid expansion and consistent success speak to our commitment to excellence and our strong market position.

Tech Stack

servermobile