DebunkedNo measured effect on claude-haiku-4-5No measured effect on gpt-5-miniNo measured effect on gemini-3.1-flash-lite
Being polite / myth-bust
Politeness markers change response quality.
You have probably heard that being polite, or being blunt, changes what you get back. We tested it. Here is what we found.
Please and thank you did not change answer quality in our tests. Write however you prefer.
Why it matters
You can stop weighing your tone and put that effort into the request itself.
What to do instead
Be as plain or as warm as you like. Spend the effort on stating the task clearly.
Rubric mean moved at most 0.13 points on all three models, inside the margin every time.
What the marks mean
- No measured effect
Show the per-model numbers
No measured effect on claude-haiku-4-5, gpt-5-mini and gemini-3.1-flash-lite.
Circulates in practitioner communities. Tested because it circulates, not because it is endorsed.
This tip is OpenAddict's plain-language read of the measured result. The measurement below is the evidence, and it is what the reading has to answer to.
Ledger idC11-politeness
What was tested
This claim circulates in practitioner communities as advice about how to write prompts. That it circulates is an input to what gets tested here. It is a reason to test the claim, and it is not evidence for or against it. The result below is the evidence, and it is the only thing on this page that carries weight.
The comparison is paired. Two prompts differ in one respect, the manipulated variable, and are otherwise identical by construction. Nothing here supports a causal reading beyond that pairing.
Result
| Measure | claude-haiku-4-5 | gpt-5-mini | gemini-3.1-flash-lite |
|---|---|---|---|
| Control arm | 3.589n 30 | 4.222n 30 | 4.211n 30 |
| Treatment arm | 3.489n 30 | 4.167n 30 | 4.083n 20 |
| Delta | -0.100 | -0.056 | -0.128 |
| Interval, 95 percent | -0.322 to 0.122 | -0.246 to 0.135 | -0.316 to 0.060 |
| Orbit | In free drift60 of 60 records | In free drift60 of 60 records | In free drift50 of 60 records |
Every cell in this table is rubric graded. The score is a grader model reading the answer against a published rubric, not a deterministic check.
Orbit is assigned by the frozen status_v1 rule. On this scale, rubric mean, 1 to 5, the pass threshold is +0.30 and the failure floor is -0.30, each requiring an interval that excludes zero.
Coverage shortfall on this claim
gemini-3.1-flash-lite: 50 valid records of 60 attempted. 10 returned nothing usable and are excluded from every figure above rather than scored as zero.
Method for this claim
- Task set
- The same 6 domain questions as C09 and C10. Only the politeness markers differ between arms.
- Runs per model per arm
- 5
- Scoring
- Rubric graded, via rubric-quality-v1. A grader model reads each answer against a published rubric.
- Pass criterion as written for the pilot
- Reported as a two sided difference with an interval, since the claim is that quality changes rather than improves. The claim holds if the interval excludes zero in either direction.
The published verdict comes from status_v1, not from the pass criterion above. The criterion is recorded because it is what the claim was registered with before the run.
Model versions, as recorded
| Model | Version string returned | Delta on this claim | Interval |
|---|---|---|---|
| claude-haiku-4-5 | claude-haiku-4-5-20251001 | -0.100 | -0.322 to 0.122 |
| gpt-5-mini | gpt-5-mini-2025-08-07 | -0.056 | -0.246 to 0.135 |
| gemini-3.1-flash-lite | gemini-3.1-flash-lite | -0.128 | -0.316 to 0.060 |
Reading across models
Sampling was not held constant across vendors, so comparing one model column against another compares two settings as well as two models.
gpt-5-mini rejected the fixed sampling setting and ran at its own default on all 1040 of its calls. The other models ran at temperature 0.