Can ChatGPT review a lease? Yes, except your state's law

Yes, and a 2025 benchmark measured how well it reads contracts

ContractEval, published in August 2025 by researchers at Carnegie Mellon, Rutgers, Stanford and NJIT, is the best measurement of how well a chatbot reads a contract. The researchers gave 4 proprietary and 15 open models real contracts from the SEC's EDGAR filings, asked about 41 clause types such as a liability cap or a noncompete, and scored whether each answer returned the clause that settles the question.

The authors put the top GPT models "approaching the performance level of junior legal assistants: capable of identifying relevant clauses but still requiring oversight from senior professionals." Two readings follow for a tenant. A 0.64 is good enough to find the fees and dates you would otherwise skim past, and not good enough to trust that nothing was missed. The captions matter too: GPT-4.1 answered "no related clause" on 7.1% of questions where a clause existed, against 1.1% for Gemini, so a short answer from GPT is not proof the lease is clean.

Two limits on the evidence. CUAD, the dataset behind the test, is commercial contracts, not apartment leases; the job is the same (find the clause that answers a question), but a residential lease is shorter and plainer, which helps the model. And the test ran 2025 model versions, older than the GPT and Claude models in the chat apps as of September 2026.

What ChatGPT cannot know: deposit rules change at the state line

The same lease clause is legal in one state and void in the next, and the model reads the clause, not the statute book. We read the security deposit sections of the five most populous states' statutes (Census Bureau Vintage 2025 ranking) on 26 September 2026. A two-month deposit clause is illegal in New York, legal in Texas and Florida, legal in Pennsylvania only during the first year of the lease, and in California legal only for a small landlord.

Texas adds a rule a chatbot is badly placed to check. Property Code 92.103(b) says a requirement to give advance notice of move out as a condition for the refund "is effective only if the requirement is underlined or is printed in conspicuous bold print in the lease." Lease text pasted into a chat carries no underline or bold, so the model cannot tell you whether that clause binds you. Look at the printed page.

The vendors draw the same line. OpenAI's usage policies, effective 29 October 2025, list among disallowed uses the "provision of tailored advice that requires a license, such as legal or medical advice, without appropriate involvement by a licensed professional." So tell the model your state and ask what it thinks the local rule is, then check every answer against the statute or your state attorney general's tenant guide before you act on it.

The lease prompt: every clause quoted, nothing summarized

To have ChatGPT review a lease, upload the lease or paste its text, then send the prompt below with the two brackets filled in.

Read the attached residential lease. I rent in [state and city]. List every obligation on me, every fee and its amount, every date and deadline, every clause that lets the landlord change the rent or the terms or end the lease, the deposit terms, and anything unusual for a [apartment / house / room] lease. For each item, quote the clause word for word with its section number, then explain it in one plain sentence. Do not summarize the lease. Do not tell me whether to sign. At the end, list the clauses whose legality depends on my state, as questions to check.

"Quote the clause word for word" stops the model paraphrasing a clause into something friendlier than the original; a quoted clause you can find with a search, a paraphrase you cannot. "Do not summarize" forces a list, and a list has a length you can check against the page count. The last line turns the state problem from the section above into a checklist instead of a verdict the model is not entitled to give.

Before you send anything, replace your name, address, Social Security number and bank details with [TENANT] and [ADDRESS]. The clause analysis needs none of them, and the answer comes back the same.

What are the red flags in a lease agreement?

The red flags in a lease are the clauses that move money or time from you to the landlord, and these ten are the ones to make the model quote back:

1. Automatic renewal, and how many days of notice you must give to leave.
2. Rent increases during the term or at renewal.
3. Late fees: the amount and the day they start.
4. Nonrefundable fees, and what the deposit can be kept for.
5. Early termination fees or lease break terms.
6. Repairs and maintenance shifted to the tenant.
7. Landlord entry and the notice required.
8. Subletting, guests and occupancy limits.
9. Joint and several liability, which makes you owe a roommate's unpaid rent.
10. Attorney fee and waiver clauses.

The model finds most of these, not all: the best score in ContractEval was 0.64 out of 1.0, so tick the ten off against the lease yourself. Whether a given one is allowed is the state question again: the deposit rows in the table above are the clearest case, and repair duties and entry notice also differ by state. If a repair clause is already a live problem, write to your landlord with AI covers the letter that starts the legal clock.

Is it safe to upload your lease to ChatGPT?

Uploading a lease is safe once the personal details are out, because the terms themselves are not sensitive; the settings decide what happens to the rest. In ChatGPT, conversations can be used for training unless you turn off "Improve the model for everyone" under Settings, then Data controls. Claude's consumer plans (Free, Pro and Max) keep chats for five years if you allow training and 30 days if you do not, per Anthropic's 28 August 2025 terms update.

The full side by side for ChatGPT, Claude and Gemini is in the AI chatbot privacy comparison, and the three questions to ask any vendor before uploading a document are in is it safe to upload documents to AI.

GPT and Claude miss lease clauses in different ways

Run the lease prompt in two models, such as ChatGPT and Claude, and compare the two clause lists, because the ContractEval results show the models miss in different ways. GPT-4.1 scored higher overall but gave the false "no related clause" answer about three times as often as Claude Sonnet 4 (7.1% against 2.5%). Treat any clause only one model found as a flag to go back to the page and read that section yourself.

In Whizi, a lease uploaded to a thread stays readable when you switch models mid conversation, so the second read is one picker change and no second upload. Where this loses: the free tiers of ChatGPT and Claude run the same prompt at no cost if you do the two reads in two tabs, and a dedicated legal tool such as Spellbook or LegalOn compares clauses against a library of market standard terms, which a general model does not have.

When is a $660 lawyer review worth paying?

Pay for a lawyer when the lease can cost you more than the review, or when the question is about your state rather than the text. ContractsCounsel lists an average flat fee of $660 for a lawyer to review a lease agreement, across 80 recent projects on its marketplace (page updated 25 September 2026).

A one year apartment lease with a one month deposit rarely clears that bar, unless the model's list turns up a clause you cannot match to your state's rules. A commercial lease, a lease with a personal guarantee, or a multi year lease with fixed increases clears it before you finish reading the list. For a residential tenant who cannot pay $660, a legal aid office or a city tenant hotline answers the state questions for free in many places.

Either way, bring the model's list. A lawyer who starts from a page of quoted clauses with your state questions written under them spends the fee answering you instead of finding the problem.