Post-Mortem: An Agent Pilot That Failed

“Post-Mortem: An Agent Pilot That Failed” is the search phrase. The file needs a decision. A P1 CIO/CTO who cannot attach a change-advisory minute should not schedule another workshop. This guide is the decision, the artefact, and the stop rule — written for Indian government, PSU and campus buyers, not for a global CIO newsletter.

Implementation reality in Indian government is a transfer, a union meeting, a missing PDF, and a go-live date that was announced before the data was cleaned. The model is rarely the bottleneck. The bottleneck is an owner who can still be found after the posting order, a corpus that is not a folder of scans, and a stop rule that someone is allowed to use.

We will not invent a circular, a GMV, or a percentage so the heading looks like research. Where the title bank dangles a figure, we treat it as a hook to interrogate. Where the law is silent, we say so. Confirm everything against the live Gazette, the live GeM term, and counsel. This is not legal, procurement or engineering advice.

What is actually true — and what the heading is hiding

Take the heading literally. “Post-Mortem: An Agent Pilot That Failed” is either a control you can show a stranger, or it is decoration. Decoration is how a MeitY-adjacent programme office ends up with a public agent, an undeclared tool, and a noting that says “AI-enabled.”

Do not treat a vendor workshop as change management. Clerical staff will route around an agent that makes them look slow or that cannot print the noting they already know how to write. Supervising an agent is a job: refusal rules, exception queues, and a person who can say the agent is wrong without a scene.

The primary keyword “AI pilot failure” is useful for search. It is useless in a file unless you define the object, the owner, the artefact and the revisit. Those four fields are the whole article, restated for this title.

A pilot that has no held-out set, no dated baseline, and no “kill” sentence is theatre. It will produce a photograph and a newspaper line. It will not produce a number a finance officer can reuse. Write the evidence the pilot is allowed to create before you start it.

• Define AI pilot failure in one sentence a stranger can score.
• Name a designation, not a vendor, as owner of “Post-Mortem: An Agent Pilot That Failed.”
• Attach a change-advisory minute or write the date it will exist.
• Name the instrument. Do not name a mood.

How to score “Post-Mortem: An Agent Pilot That Failed” in a note, not in a slide.

Claim in the deck	What the file needs	Fail if missing
We handle AI pilot failure	Named owner (the CISO) plus a change-advisory minute	A heading with no attachment
a MeitY-adjacent programme office is ready	A dated readiness note with a stop rule	A photograph of a workshop
Compliant / sovereign / secure	The instrument: DPDP schedule, CERT-In mapping, GFR clause, or guideline paragraph	An adjective without a PDF date
Pilot succeeded	Held-out task, baseline, and a kill sentence	A newspaper line

How this fails in a real Indian file

The common failure is a photograph. Someone ran a demo titled Post-Mortem: An Agent Pilot That Failed, used a live row because “otherwise it will not impress,” and left no pack, no deletion, and no owner. Six months later the question is not “did the model work.” The question is “who has the log.”

“We have the data” usually means “we have a share drive.” Scheme names change. District codes collide. Transliterated names do not match. If the agent’s first week is spent asking clerks to re-type what the PDF already said, you did not have the data. You had a rumour of a database.

The second failure is a transferred champion. Indian postings are not a risk register line you add for colour. If AI pilot failure lives in one officer’s inbox, it will die in that inbox. Write a deputy. Write a zip. Write a runbook a stranger can run.

The third failure is mixing legal persons. NIC is not NICSI. IndiaAI compute access is not an application empanelment. A GeM catalogue is not a PAC. A guideline is not a Gazette. Mixing them is how you apply to the wrong portal and then blog that the state is hostile.

• Workshop photograph, no artefact.
• Champion posted out, no deputy, no zip.
• Live personal data in a demo, no schedule.
• Guideline sold as statute, or a forecast sold as a measurement.
• Wrong legal person: NIC / NICSI / IndiaAI / GeM / PAC mixed on one slide.

How to read claims about “Post-Mortem: An Agent Pilot That Failed” without inventing a number

Start with a sentence a secretary can repeat: what AI pilot failure is, what it is not, and what you will attach. Then collect a change-advisory minute. If you cannot collect it this week, write the date you will, and do not demo until that date.

Handover is a zip with hashes, a runbook a stranger can run, and a named owner inside the department. If the vendor is the only person who can restart the service, you bought a hostage, not a platform. Budget the second deployment — the one after the champion is posted out — in the same note as the first.

Keep personal data off the demo path. Use a pack you brought. Write training and improvement rights as refused unless counsel says otherwise. If the buyer insists on live data, insist on a processing schedule and a deletion certificate, or walk.

Put CERT-In-relevant logs in India for the required period if the object is in scope of the 2022 directions. Put DPDP roles on a one-page schedule. Do not claim localisation the Act does not write.

This is not a survey. We will not mint a percentage for AI pilot failure. If a title-bank figure or a house forecast is in the heading, treat it as a hook to interrogate, not as a fact to repeat.

Ask four questions of every number: who measured, whom, when, and what the unit was. GMV is not cash. Belief is not go-live. A GPU hour is not a citizen outcome.

If you cannot answer the four questions, leave the number out of the noting. A qualitative fail (no owner, no artefact, no stop rule) is still a fail.

• Publisher and date on the same line as the figure.
• Population: global CIO, Indian secretary, vendor, or citizen.
• Unit: agents in production with a write path, or decks titled AI.
• Incentive: who sells the forecast or the GMV slide.

What to put in the next note

Next note, three dated sentences: (1) we mean AI pilot failure as [definition]; (2) the owner is [designation] with deputy [designation]; (3) the artefact is [name] last checked on [date], next check on [date]. If you cannot write the three sentences, you are not ready to buy or to sell.

Attach a change-advisory minute or a one-page reason it does not exist. Refuse a vendor one-pager as the only annexure. A P1 CIO/CTO signs the note. The vendor does not.

Objections you will hear — and what to do with them

These are the lines that stall the file. Answer them in the room, then put the answer in the note. A spoken answer without paper will be forgotten by the next officer.

We do not have time for another control

You already have a control: the day someone asks why a citizen got the wrong answer. “Post-Mortem: An Agent Pilot That Failed” is that day, scheduled. A two-page note now is cheaper than a six-month reconstruction later.

The vendor said this is included

Included in a brochure is not included in a statement of work. Ask for the artefact that would exist if AI pilot failure were true. If they cannot name it, it is not included.

This is only a pilot

A pilot that touches personal data, a public URL, or a write tool is a production-shaped object with a short calendar. DPDP duties and CERT-In clocks do not wait for your go-live banner. Time-box it, use a pack you brought, and write the deletion.

A field playbook for “Post-Mortem: An Agent Pilot That Failed”

Run this as a month, not as a mindset. If a week produces no artefact, stop. A meity-adjacent programme office does not need another group photograph.

1. Write the one-sentence definition of AI pilot failure that a secretary can repeat.
2. Assign the CISO as the file owner. Put a deputy on the same line for the next posting order.
3. Collect a change-advisory minute or write why it does not yet exist and when it will.
4. Map the data path for one user-visible answer: prompt, retrieval, tool, log, exit.
5. Name the instrument: DPDP schedule, CERT-In 2022 mapping, GFR clause, GeM term, or guideline paragraph.
6. Run one non-production rehearsal. Minute what broke. Do not use live citizen rows.
7. Put a stop rule and a revisit date in the note. Create the calendar invite.
8. Tell the vendor, in writing, which hops and which training rights are refused.

How this shows up in the file

If this article does its job, someone will put “Post-Mortem: An Agent Pilot That Failed” on a change-advisory or a bid-opening agenda as a single line with an owner. That is the success metric. Traffic is not.

Revisit when the model, the SI, the GeM term, the region, or the posting order changes. Unsigned watch items are souvenirs.

This article is informational, not legal, procurement or engineering advice. Confirm against the current Gazette, circular, GeM term and your counsel before you file it.