Generic AI (GPT-4o)
The "Dumb Scanner"
Surface-Level Reading. Passed clauses simply because words like "Governing Law" appeared, ignoring playbook rules.
No Evidence Provided. Failed to provide quotes making it impossible to verify its (incorrect) judgments.
ContractLens Engine
Logic-Driven Execution. Read Rule #7 and actively compared it to Section 13, failing the contract accurately.
Evidence-Based Redlines. Provided precise "Contract Evidence" quotes and suggested exact redlines matching JSON requirements.
Head-to-Head
Accuracy Against Playbook Rules
Direct benchmark on the Taylor Morrison Home Corp Employment Agreement.
| Feature | Rule Requirement | Generic AI | ContractLens | Winner |
|---|---|---|---|---|
| Governing Law | Must be NY, DE, CA, or UK. | PASS (Incorrect) | FAIL (Correct) | |
| Confidentiality | Max duration 3 years. | FAIL (Correct) | FAIL (Correct) | Tie |
| Assignment | Need prior written consent. | PASS (Incorrect) | FAIL (Correct) | |
| Injunctive Relief | Must be explicitly mutual. | PASS (Incorrect) | FAIL (Correct) |
Deep Dive
Where the "Dumb Scanner" Creates Liability
Governing Law Failure
Contract Section 13 (Arizona)
The Rule: Require NY, DE, CA, or England & Wales.
Generic AI: Saw the words "Governing Law" and marked it PASS. Failed to check the jurisdiction against the playbook.
ContractLens: Accurately extracted "Arizona", compared it to preferred states, flagged it as non-preferred, and issued the required redline.
Assignment Restriction Failure
Contract Section 12
The Rule: Requires "Prior written consent" for assignment.
Generic AI: Missed that the contract allows the Company to assign freely without consent while forbidding the Executive. Marked it PASS.
ContractLens: Detected the asymmetry. Correctly identified the missing restriction on the Company and failed the clause.
The Power of Evidence-Based Redlines
Generic AI gives you a summary. ContractLens gives you Contract Evidence (exact quotes from the document) and Suggested Redlines. In the confidentiality clause, ContractLens didn't just flag the perpetual duration—it suggested changing the duration to exactly 3 years, matching the JSON playbook rules verbatim.