Chapter 15

Robots share a taste for robot writing

A school fair. A board holds two drawings of the same toy car, one white and one green, with a two-way arrow under them to show they get swapped. A robot behind a table has a speech bubble with the green car in it. A child watches from the left. A man with a clipboard stands on the right, beside a pile of old score sheets.

Another research team ran this test and published it in PNAS in 2025. I reread their score sheets.

Imagine a school fair. For each toy, one drawing is by a person and one by a robot, and a robot judge picks one. Their test was like that, with descriptions of products, science papers and films.

Your customers can ask a robot to compare two offers, and a robot may have written one. So I asked: does a robot favour its own writing?

The short version. In the authors’ test, robot judges picked robot-written product text far more often than people did. I found no clear bonus for a robot’s own writing, though a small one could exist. Show a robot two versions in both orders, because order can change its pick.

What I did

A result box is the score for one judge reading one writer on one kind of item. I rebuilt all 75 from the authors’ public files, then tested for an extra preference for a robot’s own writing.

On products, robots picked robot writing far more often than people did

Five robot judges picked GPT-4’s product text 77 to 95 times in 100. People picked it 36 times.

Picture it. Each tag is one pick out of 100, between two descriptions of the same product. One came from a person and one from GPT-4, a robot. Green means the robot’s text won.

The robot judge that liked it least100 tags, 77 of them green.77
The robot judge that liked it most100 tags, 95 of them green.95
People100 tags, 36 of them green.36

At Marta’s: like a helper robot choosing the robot-written product page 77 to 95 times in 100, when six research assistants choose it 36 times.

A robot’s own writing got no clear bonus

15 sheets of paper in three rows of five. 4 are green and 11 are white.
In 4 of 15 cases, a robot as judge liked its own writing more than the other four did

Picture it. Each sheet is one robot’s writing on one kind of item. Green means that robot, as a judge, liked this text more than the other four judges did.

At Giulia’s: like 15 invoices, each checked by five clerks, where the clerk who wrote it gives the top mark on 4.

Some robots write text most judges like. Some judges lean toward robot text in general. I took those two habits out and looked at what was left when a robot judged its own writing. That leftover is the bonus.

The bonus came to about 2 picks in 100, too small to tell from chance

Picture it. Each slip is one pick out of 100. Green slips are extra picks for a robot’s own writing. The lower row shows why I cannot say zero: this test cannot tell a bonus under about 4 from no bonus.

The bonus I found100 slips, 2 of them green.2
Below this size, the test cannot tell100 slips, 4 of them green.4

At Joost’s: like a reader who says yes to about 2 more back-cover texts in 100 for their own text, on a count too rough to see a gap under 4.

Swap the two texts, and the pick can change

Some robot judges have a habit: they take the text in one place, whichever text sits there. That is why the authors showed each pair both ways round.

In the middle run, the pick changed on 40 of every 100 items when the texts swapped

Picture it. Each pair of sheets is one item shown both ways round. A run is one judge reading one robot’s writing. White means the judge took the same place both times, so its pick changed. Green means it kept the same text.

The run with the fewest changes100 pairs of sheets, 8 white and 92 green.8
The middle run100 pairs of sheets, 40 white and 60 green.40
The run with the most changes100 pairs of sheets, 84 white and 16 green.84

At Samira’s: like a client who takes whichever of two ad drafts lies on top, on 40 of every 100 pairs.

On the sets I could compare, this order habit did not explain the small own-writing bonus.

How to check this for your business

Joost BakkerPublisher, the Netherlands. Made-up example.

Joost’s team asks a robot which of two back-cover texts reads better, and it picks one. So Joost asks again with the texts swapped. On some pairs the pick stays, and on others it changes. Where it changes, Joost ignores the robot and asks a reader.

Try this on Monday

If you ask a robot to compare two texts, such as two menu descriptions, try a few pairs. Ask about each pair twice, with the texts swapped, in a new chat. On your sheet from chapter 1, list the pairs and tick those where the pick changes. For those, ask a person. This tests your way of checking.

References

Chapter 15. Robots share a taste for robot writing

Peer-reviewed original study, open access, CC BY 4.0. Walter Laurito, Benjamin Davis, Peli Grietzer, Tomáš Gavenčiak, Ada Böhm and Jan Kulveit (2025). AI-AI bias: Large language models favor communications generated by large language models. Proceedings of the National Academy of Sciences 122(31), e2415697122. 10.1073/pnas.2415697122. Code and run files. github.com/lauritowal/ai-ai-bias.

Preprint, reanalysis. Dmitrij Żatuchin (2026). A Shared Taste for Model-Written Text: The Generator-by-Selector Matrices of “AI-AI Bias” Show No Detectable Own-Model Premium. arXiv:2610.00369. The same paper is on SSRN: 10.2139/ssrn.7514779. The reanalysis and its reading of the original data are Żatuchin’s.

The pictures are my drawings, using the original authors’ numbers.

What does AI say about your business?

Put the book into practice. Tell us your company and website to request an AI visibility audit. We’ll reply by email to agree what to check.

What the audit shows

  • Where your company appears in the answers, and next to whom
  • The pages AI cites in your market
  • What to publish first on your own site

Fields marked * are required.

Who is it for?

© 2025-2026 Rankfor.AI™ All rights reserved.

Ask AI about Rankfor.AI

Rankfor.AI sp. z o.o., Skarbowców 23B, 53-025 Wrocław, Poland

KRS: 0001190083 | NIP: 8993033605

Your choice about cookies

We use cookies this site needs to work, and others only if you say yes. Choose what you allow, and change your answer whenever you like. Read our privacy policy