Turn an agent failure into a task you can verify
ServiceNow CoreAI · Esakkivel Esakkiraja et al. · AutoSynthData: Generating Training Data for Enterprise Agents ↗Why it matters
Before asking for more training examples, decide what a useful example must prove.
Reading note
AutoSynthData turns capability gaps into executable tasks, then checks valid and invalid outcomes. The authors report improvements in EnterpriseOps Gym; transfer to your workflow still needs testing.
Before this step: Agent · Tool · Workflow
“Do relevant incorrect outcomes fail?”One English pattern
A valid example must …; the check should reject …Use must for an acceptance condition and should reject to name a failure case. This is our practice pattern, not a source quotation.
Choose a support-ticket task. Write three English sentences: what tools make it feasible, what a correct final record looks like, and one plausible wrong record your check must reject.
Check your draft
Did you explain the mechanism, name a condition, and make a concrete work decision? Saving records your draft, not a mastery score.