AI
The AI program passed its pilot. Then it went dark.


A month after a Fortune 500 industrial client's AI document-classification pilot hit 94% accuracy in the sandbox, the same model was quietly routing 30% of live invoices to a manual queue nobody had budget for, while the executive sponsor asked why the dashboard he approved was showing the same three green tiles it had shown at go-live. The pilot did not fail. The pilot succeeded. Production is where the program went dark, and that gap is where the BCG 74% failure statistic actually lives.
I have watched this pattern show up on healthcare shop floors, in aerospace document control rooms, inside CRE portfolio ops teams, and across two solar deployments in the last eighteen months. The pilot works. The demo lands. The steering committee claps. Then six to ten weeks after go-live, usage flattens, the error queue grows, and the AI program is either quietly euthanized or reclassified as "phase two." That is the AI pilot to production failure gap, and it is not a model problem. It is a contract problem.
The BCG 74% number is a contract design artifact
Boston Consulting Group's number that 74% of companies fail to scale value from AI gets quoted like a technology finding. It is not. Underneath that number is a fairly consistent operating story: pilots are scoped, priced, and staffed for a proof point, and deployment SOWs are then scoped, priced, and staffed for a go-live milestone. Both contracts end before the AI is actually working in the business. The signature block sits on the wrong side of the failure curve.
Every AI program I have shipped in the last three years fails or succeeds at one of four specific points. If your contract does not have a named owner, a named budget, and a named commercial consequence at all four, you are buying a pilot dressed up as a deployment.
Failure point one: integration
The model works on the extract. The extract is not the system. On one active Fortune 500 industrial engagement, the first honest surprise was not the ML. It was that the "shipping document" the sandbox trained on and the "shipping document" that actually moves through the operational systems had a 22% schema drift once you counted carrier variants, freight-forwarder overrides, and the manual PDFs a specific plant emails at 4 a.m. every Tuesday. The pilot ate a clean copy. Production had to eat the mess.
Failure point two: exception handling
Every AI system generates exceptions. The question is who catches them, on what SLA, and against what budget. Most SOWs write "human in the loop" in the design section and then forget to fund the humans. Six weeks in, the exception queue becomes a second full-time job for a team that already had a first one, and the fastest way to make the second job go away is to stop using the AI.
Failure point three: adoption
The people who used the pilot were the people who volunteered to use the pilot. The people who use production are everyone else. On a JLL-adjacent CRE portfolio workflow we ran, sandbox adoption was 100% because it was three named power users. Production adoption on week four was 41%, and the delta was not resistance. It was that the AI added two extra clicks to a workflow that a leasing coordinator does 60 times a day, and nobody had touched the UX between demo and rollout.
Failure point four: value verification
Nobody measures whether the AI actually produced the number in the business case. Almost every enterprise AI program I have seen post go-live measures adoption, uptime, and accuracy. Very few measure the cost savings, the cycle-time reduction, or the revenue impact that the pilot business case promised. When the CFO asks the honest question six months later, the answer is a shrug and a phase-two proposal.
Why T&M contracts stop at failure point three
Time and materials is the default enterprise AI contract shape because it is the most flexible thing procurement knows how to sign. It also has a mechanical property that nobody talks about at signing: the vendor's revenue is maximized by staying in weeks one through eight and being invited back for weeks twenty through twenty-eight. Weeks nine through nineteen, the ugly middle where integration reality hits and exception queues grow, are the least profitable weeks in a T&M engagement. The rational T&M vendor either accelerates to go-live and demobilizes, or slows down and expands scope. Neither of those behaviors gets you to production value.
Fixed-fee is not the answer either. Fixed-fee on an AI deployment is a bet that the requirements will not change, and AI deployments are the single most requirement-volatile contract shape in enterprise IT. Fixed-fee vendors either pad heavily or fight scope, and both make the ugly middle uglier.
The contract shape that actually gets to production is one where the vendor's economics are stapled to the outcome the pilot business case promised, and the vendor is contractually still present at the point where that outcome is measured. Everything else is a negotiated fiction.
The 8 questions to ask before signing a deployment SOW
I give this list to every operator who calls me about an AI deployment they are about to sign. If your SOW does not answer all eight in writing, it is a pilot dressed up as a deployment. Read every question against the failure point it maps to and refuse to sign until you have a written answer.
- Which of the four failure points does the vendor stay funded through, and where does their contract end? Integration, exceptions, adoption, or value. If the answer is "go-live," you are buying a pilot.
- Who owns the exception queue on day 30, day 90, and day 180, and what is the SLA? If the vendor's answer is "your team," ask what happens when your team says no.
- What is the named business metric this program moves, expressed as a dollar or percent, and who signs off that it moved? Not accuracy. Not adoption. The number in the business case.
- What percentage of the vendor's fee is contingent on that metric being verified in production? If the answer is zero, the vendor has no economic reason to still be there when the number gets read.
- What integration reality has been tested against live production data, not extracts, before signature? Not sample data. Not last quarter's export. The live flow, with the weird 4 a.m. Tuesday PDFs.
- What is the adoption threshold that defines "in production," and how is it measured? A specific percent of the target user base, on a specific workflow, sustained over a specific window.
- Who is the named accountable individual on the vendor's side from week one through the value verification checkpoint? Not an account team. A named human whose bonus moves with the outcome.
- What is the honest, written escape hatch if the metric does not verify? Both sides need one. Vendors that will not write an escape hatch do not believe in the outcome.
Two hours with this list will save you two years of phase-two proposals. I would rather lose a sale in question four than win it and be arguing about value in month nine.
How outcome-staked commercial terms change delivery behavior in weeks 6-10
Weeks six through ten are where AI deployments die quietly. The go-live pressure of weeks one through five is over. The value verification of weeks twelve through sixteen is not yet visible. This is the window where integration reality has landed, exception queues have grown, and the vendor's most senior people are being pulled to the next sale. If the commercial terms do not fight for this window, nothing does.
On Nextracker, our flagship energy engagement, the reason we cut time-to-market by roughly 75% was not a smarter model. It was that the commercial terms explicitly staked a slice of fees to a production-verified cycle-time number, which meant weeks six through ten were the weeks we sent our sharpest people in, not the weeks we sent our juniors. The economics inverted the staffing pattern. On NextPower, the current active engagement running the TrueSim V5 build across the 2026 retainer, the same principle is what keeps parallel tracks from decoupling in the ugly middle.
Three commercial clauses do most of this work. If your SOW has all three, the vendor's incentives are aligned with your production outcome. If it has none, you are shopping on hourly rate.
Clause one: the value verification checkpoint
A named business metric, a named measurement window, a named human on each side who signs a one-page attestation. The clause pushes the definition-of-done past go-live and into the business result. The measurement window is usually 60 to 120 days after production cutover. Anything shorter measures the demo, not the deployment.
Clause two: the contingent fee slice
A meaningful percentage of the fee, usually 15% to 30%, released only on verification. The percentage matters less than the presence. A 15% contingent slice on a $2M engagement is $300K, and $300K is enough to keep senior partners on the ugly-middle calls.
Clause three: the escape hatch
If the metric does not verify, both sides have a written path out that does not require a lawyer. The vendor gets a chance to remediate on their dime for a defined window. The client gets a defined refund or credit if remediation does not close the gap. This is the clause that lets both sides say the honest thing in week eight instead of pretending in month six.
What an AI Native Operating Partner looks like structurally
An AI Native Operating Partner is not a vendor with a fancier deck. It is a delivery structure where the same team owns pilot, deployment, and value verification under one commercial contract, one senior accountable individual, and one economic outcome. Three structural elements make it work.
One team across the failure curve
The same lead engineer who shipped the pilot is on the exception-queue triage call in week eight. The handoff-tax that kills most enterprise AI programs disappears because there is no handoff. On that same engagement, the individual who owns the model architecture is the same individual who takes the Tuesday morning call when the freight-forwarder schema drifts. That is not a staffing preference. It is a design requirement.
Contract shape that follows the outcome, not the milestone
Fees are staged around integration verification, exception SLA, adoption threshold, and value verification, not around design, build, test, and go-live. The stage gates are business events, not delivery events. This is the change that makes weeks six through ten survivable.
A written pilot-checkpoint guarantee
Future Works ships a triple guarantee: On-Time, On-Budget, On-Results. The public-facing version uses defensible pilot-checkpoint language because guarantees that cannot be honored are worse than no guarantee. What matters is that the guarantee exists in writing, has a measurable definition, and has a remediation path if it is missed. A guarantee without a definition is marketing. A guarantee with a definition is a contract clause.
Industry breakout: how this failure pattern shows up by sector
The four failure points are universal. Their weight is not. In some sectors, integration eats the program. In others, adoption does. Pattern-matching the failure mode to the sector is what lets an operator decide which of the eight questions to press hardest.
Industrial manufacturing and healthcare value chains
In industrial manufacturing and health-tech value chains, the dominant failure point is integration, followed closely by exception handling. Operational document workflows across North American shipping look uniform on a slide and are wildly heterogeneous in the ERP. The platforms we build in this sector carry more of their risk in the schema drift and the exception SLA than in the model. If you are signing a value-chain AI SOW in industrial or health-tech, press question five and question two harder than the rest.
Energy and climate technology
Nextracker and NextPower sit in a sector where the dominant failure point is value verification. The pilots almost always work; the utility-scale physics are well understood. What kills programs is that the number in the business case, whether that is time-to-market, cycle-time reduction, or throughput on a specific engineering workflow, does not have a named human signing off in production. On Nextracker, we cut time-to-market roughly 75% because that number had an owner and a checkpoint. On NextPower, the 2026 retainer explicitly staples fees to verified engineering throughput numbers across parallel tracks. Press question three and question four hardest.
Aerospace and space technology
Boom Supersonic is building the first commercial supersonic airliner since Concorde. Astroscale is doing on-orbit servicing. In aerospace, the dominant failure point is exception handling, and the reason is regulatory. Every exception has to be documented in a form that will satisfy an audit years later, which means the exception queue is not a nuisance, it is a compliance artifact. AI SOWs in aerospace that do not fund the exception workflow with a defined SLA and a defined audit trail fail on failure point two, no matter how good the model is. Press question two hardest.
Commercial real estate and property technology
JLL sits alongside CBRE and Colliers as one of the anchor CRE references in FW's core-industries positioning. In CRE, the dominant failure point is adoption. The user population is large, distributed, and workflow-embedded, and the AI has to fight for two seconds of a leasing coordinator's time against a workflow that already exists. If the deployment SOW does not have an adoption threshold, a UX ownership clause, and a real number that defines "in production," the program dies at failure point three. Press question six hardest.
FAQ
Why do most enterprise AI pilots fail to scale to production?
Because the deployment contract is designed around go-live, not around outcome verification. Pilots and deployments are typically two separate SOWs, each optimized for a milestone that ends before the AI is actually working in the business. The BCG 74% statistic is a symptom of this contract design pattern, not a symptom of immature technology.
What is the difference between a pilot succeeding and an AI program succeeding?
A pilot succeeds when the model hits an accuracy or feasibility threshold in a controlled environment. An AI program succeeds when the business metric in the original business case is verified in production by a named human, on a named window, against a named number. Those two definitions are separated by six to ten weeks of integration, exception handling, and adoption work that most contracts do not fund.
What is an outcome-staked AI consulting contract?
A contract where a meaningful slice of vendor fees, usually 15% to 30%, is contingent on a production-verified business metric measured 60 to 120 days after go-live. The contingent slice pulls senior vendor talent into the ugly middle of the deployment, weeks six through ten, where AI programs typically go dark. It also gives both sides a written escape hatch if the metric does not verify.
What are the four failure points every AI deployment has to survive?
Integration, exception handling, adoption, and value verification. Integration is where the model meets the real data, not the extract. Exception handling is where the humans catch what the AI cannot. Adoption is where the target user base actually uses the tool at scale. Value verification is where the CFO checks that the business case number showed up. Every enterprise AI program that fails, fails at one of these four points.
What is an AI Native Operating Partner?
A delivery structure where the same team owns pilot, deployment, and value verification under one commercial contract, one senior accountable individual, and one economic outcome. It eliminates the handoff tax between pilot vendors and deployment vendors, aligns fees to business events instead of delivery milestones, and includes a written guarantee with a measurable definition and a remediation path.
How does Future Works price AI deployments differently?
Future Works stages fees around integration verification, exception SLA, adoption threshold, and value verification, not around design, build, test, and go-live. A defined slice of the fee is contingent on the production-verified business metric, and the engagement carries the On-Time, On-Budget, On-Results triple guarantee with defensible pilot-checkpoint language. The commercial terms are designed to keep senior talent on the account through weeks six to ten, which is the window where most enterprise AI programs die.
How long should the value verification window be after go-live?
Between 60 and 120 days for most enterprise AI programs. Shorter than 60 days and you are still measuring the go-live sugar rush; the exception queue has not yet built up and adoption has not stabilized. Longer than 120 days and the organizational memory of the pilot business case has faded, staffing has churned, and nobody feels accountable for the number anymore. The window has to be long enough to be honest and short enough to be actionable.
What to do next
If you are about to sign a deployment SOW, run the eight questions against it before your next steering committee. If your vendor cannot answer all eight in writing, you have your answer about which failure point they will leave you at. If you want a second read on a contract that is already signed, or you want to see what an outcome-staked deployment actually looks like when it is stapled to a live P&L, that is the conversation Future Works is built for. We ship as an AI Native Operating Partner, not as a T&M shop, and the commercial terms follow the outcome. Start at the AI Native Operating Partner delivery model, read the Nextracker case study and our other work, and if you are heads-down on a specific program that has gone dark between pilot and production, book a working session with the team.