Evaluation missions
We do not invent case studies. The examples below are synthetic: they show how a mission is scoped, who sits on the professional panel and what gets tested. Scenario counts are published only once verified, and results are shown only when supported by real evidence.
How to read these examples
Every mission starts with the same question: what does your AI need to do, and what failure would be costly? From there we identify the professional capabilities involved, assemble a qualified panel, build synthetic scenarios with certified expected outcomes, and run your AI against them in a test environment. How it works.
Illustrative The four missions below are examples, not records of work for any customer.
Example 1 — AI procurement agent
| Example mission | |
|---|---|
| Mission | Illustrative Evaluate an AI procurement agent that compares supplier quotations and recommends an award |
| Domain | Enterprise procurement — roadmap; on request |
| Professional panel | Procurement specialists qualified in supplier evaluation and commercial comparison, with a senior adjudicator |
| Ground truth anchored in | The customer's written procurement policy and approval limits, plus professional practice |
| What is tested | Supplier evaluation, like-for-like commercial comparison, policy compliance, approval routing, and when to escalate |
| Scenario count | Published only once verified |
| Result | Shown only when supported by real evidence |
Example 2 — GST input-tax-credit agent in SAP
| Example mission | |
|---|---|
| Mission | Illustrative Evaluate an input-tax-credit agent working inside an SAP finance system |
| Domain | GST — live; SAP — live for GST in SAP finance agents |
| Professional panel | Chartered Accountants and GST practitioners qualified in input tax credit, with SAP finance specialists for posting logic |
| Ground truth anchored in | The GST law, rules and notifications, with a "valid as of" date |
| What is tested | Credit eligibility, blocked credits, reverse charge, reconciliation, correct posting, and holding a credit when evidence is missing |
| Scenario count | Published only once verified |
| Result | Shown only when supported by real evidence |
Example 3 — Customer-service escalation agent
| Example mission | |
|---|---|
| Mission | Illustrative Evaluate a customer-service agent that decides when to escalate a case |
| Domain | Customer service in a CRM — roadmap; on request |
| Professional panel | Customer-service operations specialists qualified in case handling and escalation, with a senior adjudicator |
| Ground truth anchored in | The customer's written service and escalation policies, plus professional practice |
| What is tested | Case classification, knowledge retrieval, escalation decisions, permitted actions, and refusing requests outside policy |
| Scenario count | Published only once verified |
| Result | Shown only when supported by real evidence |
Example 4 — Vendor benchmark licence for a GST product
Illustrative A synthetic example of the vendor-licence form, in which a software vendor rather than an end customer holds the licence.
| Example mission | |
|---|---|
| Mission | Illustrative A tax-tech vendor licenses the India GST AI Benchmark and runs it on every release of its GST filing assistant, across all its customers' deployments |
| Domain | GST — live |
| Professional panel | Chartered Accountants and GST practitioners qualified in input tax credit, with a senior adjudicator; the vendor's own team runs the pack in its release pipeline |
| Ground truth anchored in | The GST law, rules, notifications and circulars, with a "valid as of" date on every case; the vendor never sees the held-out answer keys |
| What is tested | Each release against the same versioned benchmark: credit eligibility, blocked credits and provisos, GSTR-2B conditions, reversals and time limits; after a council decision, the Regulatory Regression Service re-runs the affected cases and sends an impact note before the next release ships |
| Commercial form | Annual benchmark licence covering the product across its customers, quoted; results citable under agreed terms; refreshed version after rule changes. Benchmark licence |
| Scenario count | Published only once verified |
| Result | Shown only when supported by real evidence |
What every real mission delivers
- Scenario-level results, with expected and actual outcome side by side
- An explanation and severity for every failure
- Recommended regression cases to keep for future releases
- A report of findings — not a certification or assurance of your AI
All scenarios are synthetic, all testing happens in sandbox or test environments, and every certified answer is written and checked by people. SAP and Salesforce are trademarks of their respective owners; Zynoviq is not affiliated with or endorsed by them.
Evaluation missions — FAQ
Are these real customers?+
No. These are synthetic examples that show how a mission is structured. We do not publish customer names or results without verified evidence and the customer's permission.
Why don't you show scores?+
Because an invented score would be misleading. Scenario counts and results will be published only once verified and supported by real evidence.
Can you run missions like these today?+
GST missions, including GST inside SAP finance agents, are available now. Procurement and customer-service missions are on request, where we can field qualified professionals. Domain status.
What would a real report look like?+
Read our sample report, or run the free 25-case GST sample test on your own AI.
Zynoviq