What goes into a good golden dataset for an LLM feature?
#A team tests its summariser with ten hand-picked examples that always pass.
Show answer
Use real inputs, sampled from production or realistic user research, not examples written to pass. Cover the main use cases in proportion, then add edge cases, known past failures, adversarial inputs and cases where the right answer is to refuse or say "I don't know".
For each item, store the input, the expected outcome or grading criteria, and tags such as language or difficulty so you can slice results. Version the set, keep it out of any training data, and add every new production bug as a case.
Trade-offs
Larger sets give more confidence but cost more to label and to run; start small and grow from failures.
Common mistake
Using the same examples to write the prompt and to evaluate it.
Follow-up
How would you keep the dataset representative as user behaviour changes?