AI Procurement Checklist: Use Case Review, Data Rights, Output Terms, Indemnity, Evaluation, and Monitoring

By ·

This checklist procures a model service and then builds the controls that actually reduce the risk, which are not in the agreement. It opens by identifying the deployment shape, because the same contract term means different things for a hosted model, a retrieval deployment, and a fine-tuned one. It reviews the four definitions that determine what every operative clause reaches, drafts a training restriction covering fine-tuning, evaluation, abuse monitoring, and human review, and closes the aggregated-data carve-out that otherwise swallows it. It replaces the largely fictional output ownership negotiation with a covenant not to assert and provenance logging, reads the indemnity backwards from its carve-outs, and maps the subprocessor chain. It then gates use cases by consequence, writes the acceptable use policy that does the trade secret work, designs human review as the accuracy control, and stands up the evaluation suite that detects undisclosed model change.

IP and Technology > Information Technology | Checklist | Published 23 October 2025 - Updated 13 August 2026 | Casey Scott McKay - marksy.us

Summary. This checklist procures a model service and then builds the controls that actually reduce the risk, which are not in the agreement. It opens by identifying the deployment shape, because the same contract term means different things for a hosted model, a retrieval deployment, and a fine-tuned one. It reviews the four definitions that determine what every operative clause reaches, drafts a training restriction covering fine-tuning, evaluation, abuse monitoring, and human review, and closes the aggregated-data carve-out that otherwise swallows it. It replaces the largely fictional output ownership negotiation with a covenant not to assert and provenance logging, reads the indemnity backwards from its carve-outs, and maps the subprocessor chain. It then gates use cases by consequence, writes the acceptable use policy that does the trade secret work, designs human review as the accuracy control, and stands up the evaluation suite that detects undisclosed model change.

Keywords: deployment shape · definitions review · training restriction · aggregated data carve-out · covenant not to assert · provenance logging · indemnity carve-outs · training data provenance · model change notice · subprocessor mapping · human review disclosure · use case intake · consequence classification · regulated use routing · acceptable use policy · prohibited inputs · human review design · evaluation suite · shadow usage discovery · exit and deletion


How to use this checklist

| Phase | What it covers | |---|---| | 1 | Deployment shape | | 2 | The four definitions | | 3 | The training restriction | | 4 | The aggregated-data carve-out | | 5 | Output terms | | 6 | Provenance logging | | 7 | The indemnity, read backwards | | 8 | Training data provenance | | 9 | Model change | | 10 | Subprocessor mapping | | 11 | Human review disclosure | | 12 | The vendor question set | | 13 | Use case intake | | 14 | Consequence classification | | 15 | Regulated use routing | | 16 | The acceptable use policy | | 17 | Human review design | | 18 | The evaluation suite | | 19 | Shadow usage | | 20 | Exit and deletion | | 21 | Downstream obligations | | 22 | Ownership and review cycle |

Boxes marked [Gate] must clear before the service processes any company data.

The matter. A financial services company found its vendor's "Input" definition reached only material submitted through the interface, not through the retrieval connector its deployment plan required — and that the training restriction applied to a defined term excluding usage telemetry entirely.


Phase 1. Deployment shape


Phase 2. The four definitions


Phase 3. The training restriction


Phase 4. The aggregated-data carve-out


Phase 5. Output terms


Phase 6. Provenance logging


Phase 7. The indemnity, read backwards


Phase 8. Training data provenance


Phase 9. Model change


Phase 10. Subprocessor mapping


Phase 11. Human review disclosure


Phase 12. The vendor question set

Send in advance of negotiation; written answers are worth more than a month of redlines.


Phase 13. Use case intake


Phase 14. Consequence classification


Phase 15. Regulated use routing


Phase 16. The acceptable use policy


Phase 17. Human review design


Phase 18. The evaluation suite


Phase 19. Shadow usage


Phase 20. Exit and deletion


Phase 21. Downstream obligations


Phase 22. Ownership and review cycle

Outcome. The definitions review found "Input" limited to interface submissions, which did not reach the planned retrieval connector, and a training restriction keyed to a "Customer Data" definition excluding usage telemetry. Both were broadened. The training restriction was extended to fine-tuning, evaluation, abuse monitoring, and human review, with a disclosed thirty-day abuse-monitoring window accepted. The aggregated-data carve-out was qualified with irreversible de-identification and a no-reconstruction clause. No provenance warranty, version pinning, benchmark floor, or uncapped indemnity was obtained — all refused, as expected. The deployment design did the rest: two use cases approved, one refused and routed to sector counsel because it scored customer communications for risk; mandatory human review before send on the customer-facing use; an acceptable use policy naming prohibited inputs and scoping the retrieval corpus to a defined document set; and a forty-task evaluation suite run monthly, which detected an unannounced behaviour change at month five and triggered re-validation before anything reached a customer. Four days of legal effort on the agreement, six on the deployment design.


Phase 23. Model clause language

Starting points for Phases 2 to 6. Adapt them; keep the structure.

Definitions.

"Input" means any data, content, or material made available to the Service by or on behalf of Customer, however transmitted, including through the user interface, application programming interfaces, connectors, integrations, and plug-ins.

"Output" means any data, content, or material generated by the Service in response to an Input, including intermediate representations, embeddings, indexes, summaries, and derived artifacts.

Training restriction.

Vendor will not use Inputs, Outputs, or Customer Data to train, fine-tune, evaluate, benchmark, or otherwise develop or improve any model, service, or product, other than a model dedicated exclusively to Customer. This restriction applies to abuse and safety monitoring and to human review, except that Vendor may retain Inputs solely for abuse monitoring for no more than thirty days, after which they will be deleted.

Aggregated data.

Vendor may use data derived from Customer's use of the Service in aggregated and irreversibly de-identified form, provided such data does not include, and cannot be used to reconstruct, any Input, Output, or Customer-specific content, and Vendor will not attempt re-identification.

Covenant not to assert.

Vendor covenants not to assert against Customer, its affiliates, or its customers any right, title, or interest in or to any Output, and will not challenge Customer's use of Output on the basis of any right Vendor holds.

Provenance.

Vendor will make available to Customer, and Customer may export, a record for each generation comprising the model identifier and version, the Input, the Output, the requesting user, and the timestamp, retained for no less than [period].

Material change.

Vendor will give Customer no less than [period] prior written notice of any Material Change, meaning a change to the model, its weights, its system instructions, or its safety filtering that could reasonably be expected to alter Output for Customer's use cases.


Phase 24. Rewrite reference

| Written | Rewritten | |---|---| | "Input means data Customer submits through the Service interface." | "...made available to the Service by or on behalf of Customer, however transmitted, including connectors and integrations." | | "Vendor will not use Customer Data for training." | "...to train, fine-tune, evaluate, benchmark, or otherwise improve any model," with abuse monitoring and human review named. | | "Vendor may use aggregated data." | "...aggregated and irreversibly de-identified... cannot be used to reconstruct... no re-identification attempts." | | "Customer owns all Output." | Retain, and add a covenant not to assert plus provenance obligations. | | "Vendor will indemnify Customer against claims that Output infringes." | Read the carve-outs; negotiate removal of the modification carve-out for ordinary editing and a defined list of required filters. | | "Vendor may update the Service from time to time." | Add a Material Change definition and a re-evaluation right, or accept and build the evaluation suite. | | "Vendor will delete Customer Data on termination." | "...including embeddings, indexes, and fine-tuned weights, from production and backups, within [period], with written confirmation." | | Confidentiality clause silent on human review | Human review disclosed, bounded, and covered by obligations no less protective than the agreement's. |


Phase 25. Evidence and record request

Assemble during the term, not at the point of need.

Why this belongs here. Almost every retrospective question — an infringement inquiry, a regulatory request, a customer complaint about an output, an ownership question in diligence — is answerable only from the provenance log and the approval records, and neither exists unless someone required them at procurement.


Phase 26. Use-case-type boxes

Run the base checklist, then the boxes for the use case in play.

Internal document summarization.

Customer-facing drafting.

Code generation.

Search and knowledge retrieval.

Decision support about a person.

Voice, image, or likeness generation.


Phase 27. The ninety-day standing-up

What is deliberately deferred. A comprehensive inventory of every model-adjacent feature in every product the company already buys. That is a long tail with diminishing returns; prioritise the deployments that see confidential material or produce customer-facing output.


Phase 28. Where the exposure actually sits

Ranked, because the ranking is not what a contract review would suggest, and the ranking should drive where the effort goes.


Phase 29. What to accept, push on, and walk from


Phase 30. Three sentences worth saying


Key Authorities at a Glance

| Authority | Proposition | |---|---| | 17 U.S.C. § 102 | Originality and authorship | | 17 U.S.C. § 106 | Rights implicated by training and output | | 17 U.S.C. § 107 | Fair use, unresolved for training | | 17 U.S.C. § 201 | Ownership vests in the author | | 17 U.S.C. § 204 | Writing required to transfer | | 17 U.S.C. § 504 | Statutory damages | | 17 U.S.C. § 512 | Safe harbor for hosted output | | Andy Warhol Foundation v. Goldsmith | Transformative purpose narrowed | | Google v. Oracle America | Intermediate copying | | Authors Guild v. Google | Search index reasoning | | Thaler v. Vidal | Inventor must be a natural person | | Thaler v. Perlmutter | Human authorship for copyright | | 35 U.S.C. § 101 | Patentable subject matter | | 18 U.S.C. § 1839 | Reasonable measures; disclosure | | 18 U.S.C. § 1836 | Misappropriation claim | | 15 U.S.C. § 45 | Deceptive capability claims | | Colo. Rev. Stat. § 6-1-1701 | Deployer obligations | | Cal. Civ. Code § 1798.140 | Controller and processor definitions | | Cal. Civ. Code § 1798.121 | Sensitive data limits | | 15 U.S.C. § 6801 | Financial sector constraints | | 45 C.F.R. § 164.502 | Health information constraints | | 15 U.S.C. § 1681b | Consumer report uses | | 15 U.S.C. § 1125 | Trademark exposure from output |


The five things people get wrong

Negotiating the agreement without knowing the deployment shape. A restriction saying the vendor will not train on customer data is coherent for a hosted model, needs qualification for a retrieval deployment, and is self-contradictory for fine-tuning. Most agreements are drafted for the first and signed for the third.

Accepting the definitions. "Input" limited to interface submissions excludes connectors and integrations, which in an enterprise deployment is most of the material at risk — and every operative term reaches only what the definitions permit.

Spending weeks on output ownership and none on provenance logging. The ownership clause settles the vendor's position and confers nothing against the world, because raw machine output is unlikely to be protectable. The log of model, version, prompt, and timestamp is what makes every later question answerable.

Reading the indemnity before its carve-outs. If the claim arises from customer inputs, or the output was edited, or a filter was disabled, the grant frequently does not apply — and enterprise deployments are mostly input-derived.

Treating this as a contract review. The largest exposures are deployment decisions — which use cases, which inputs, which review layer — and the smallest are drafting decisions. A perfectly negotiated agreement with an ungated deployment is worse than a mediocre agreement with a well-designed one.


Related Documents

Articles

Guides

Checklists

Toolkits

Templates & Forms


This document is general information about the law, not legal advice, and does not create an attorney-client relationship. Model procurement turns on the specific agreement, deployment, and use case. Marksy is not a law firm.

Read this article on Marksy