SK
SlideKick
Back to research

Quality Metrics

Every eval run pushes the agent through a golden dataset of research queries, scores the answers with an independent LLM judge (Gemini, a different model family than the agent's Llama), and checks whether the agent's self-critique agrees with the external judge.

Run: 2026-10-12Judge: groq/openai/gpt-oss-120bAgent LLM: groq0/20 queries scoredbundled snapshot
Faithfulness
—/ 1.00

Are the answer's claims grounded in retrieved context? (ragas, LLM judge)

Context Precision
—/ 1.00

How much of the retrieved context is actually relevant? (ragas)

Fact Recall
—/ 1.00

Fraction of expected golden facts covered by the answer

Answer Quality
—/ 1.00

Rubric-scored relevance, completeness, specificity, coherence

Critic Calibration

—

Pearson correlation between the agent critic's own quality score and the external judge. Higher means the agent knows when its own answers are good.

Avg Self-Score

—

Agent critic's average confidence

Avg Iterations

—

Self-reflection loops per query

Avg Latency

—

End-to-end per research query

Per-Query Results

Who is the CEO of Microsoft?

Error: GROQ_API_KEY is required when using Groq.

What is Microsoft's corporate mission?

Error: GROQ_API_KEY is required when using Groq.

What climate commitments did Microsoft make in its 2020 shareholder letter?

Error: GROQ_API_KEY is required when using Groq.

How did Microsoft Teams perform during the pandemic according to the 2020 letter?

Error: GROQ_API_KEY is required when using Groq.

What role does the OpenAI partnership play in Microsoft's AI strategy?

Error: GROQ_API_KEY is required when using Groq.

What is Microsoft Copilot and which products does it span?

Error: GROQ_API_KEY is required when using Groq.

How did Microsoft's strategic narrative shift between the 2020 and 2023 shareholder letters?

Error: GROQ_API_KEY is required when using Groq.

What are the key themes across Microsoft's shareholder letters from 2020 to 2024?

Error: GROQ_API_KEY is required when using Groq.

What did Microsoft say about the Activision Blizzard acquisition?

Error: GROQ_API_KEY is required when using Groq.

How does Microsoft describe Azure's role in its cloud strategy?

Error: GROQ_API_KEY is required when using Groq.

What is GitHub Copilot and why does Microsoft consider it significant?

Error: GROQ_API_KEY is required when using Groq.

What security initiatives did Microsoft emphasize in its 2024 shareholder letter?

Error: GROQ_API_KEY is required when using Groq.

How does Microsoft position itself on responsible AI?

Error: GROQ_API_KEY is required when using Groq.

What did Microsoft's letters say about hybrid work?

Error: GROQ_API_KEY is required when using Groq.

Compare how Microsoft talked about gaming in 2020 versus 2022.

Error: GROQ_API_KEY is required when using Groq.

What does Microsoft say about LinkedIn in its shareholder letters?

Error: GROQ_API_KEY is required when using Groq.

How should an enterprise software competitor respond to Microsoft's AI strategy?

Error: GROQ_API_KEY is required when using Groq.

What did Microsoft say about datacenter and AI infrastructure investment?

Error: GROQ_API_KEY is required when using Groq.

What products did Microsoft highlight as AI-first in the 2024 letter?

Error: GROQ_API_KEY is required when using Groq.

Summarize Microsoft's transformation from 2020 to 2024 as key strategic phases.

Error: GROQ_API_KEY is required when using Groq.