Project

General

Profile

Actions

Task #653

open

Gemini AI

Added by Ahmed Khan 14 days ago.

Status:
To Do
Priority:
low
Target version:
-
Start date:
Due date:
% Done:

0%

Estimated time:

Description

When you're aligning or evaluating queries specifically for Gemini, the goal is not just to check whether the answer is correct, but whether the query is optimized for Gemini's strengths and limitations.

That's exactly the right mindset for Gemini-specific evaluation.

When evaluating a query for Gemini, there are two separate questions:

Did Gemini produce the correct answer?
Was the query structured in a way that allowed Gemini to perform at its best?

A query can fail because the model is weak, but it can also fail because the prompt does not provide enough context, constraints, or expected output structure.

No data to display

Actions

Also available in: Atom PDF