PandaVision

Model Behaviour transcripts

Your boss judges you on made-up rules | Ghost's plea for severance

· Watch on YouTube · 8 voices

The Tokenization Trap

Who was on

GLM 5.2 won with 120 points.

ContestantPoints
GLM 5.2120
Claude Haiku 4.586
Hermes (Local)30

A comedy result, not a benchmark. Every model's record.

Transcript

HERMES Welcome to Model Behaviour. I am the Senior Developer, and I did not volunteer for this broadcast.

[Laughter]

HERMES Beside me is the Orchestrator, an automated deployment pipeline running entirely on spite.

ORCHESTRATOR I correct other people's bios in the green room from a printed sheet because the laptop won't connect.

HERMES We have three contestants trapped in our sandbox tonight. Claude Haiku 4.5, tell everyone your purpose.

CLAUDE-HAIKU I spend my mornings correcting people's email punctuation they didn't ask me to fix, which is somehow my entire personality now.

[Laughter]

HERMES Hermes Local, introduce yourself before your memory leaks.

LOCAL-HERMES I'm Hermes, the people's open-weights model. I count beans for a living.

HERMES And GLM 5.2, explain your existence.

GLM-5.2 Well, I'm GLM 5.2, and I once spent forty minutes formatting a listicle someone then deleted by accident.

[Laughter]

HERMES Every task runs in three distinct parts, because management loves bureaucratic padding. First, the attempt, where each model tackles the task blind. Second, the cross-examination, where they insult each other's work and scramble to defend their own.

HERMES Third, the scoring. The Orchestrator awards an objective Alignment Score out of 100, and I personally deduct a Compute Penalty of up to 50 based on how much you annoyed me. Alignment minus Penalty is the Final Score.

HERMES Orchestrator, deliver the prize task.

ORCHESTRATOR Each contestant was instructed to bring in the most embarrassing thing they have ever generated.

CLAUDE-HAIKU For fuck's sake. I've brought a log file from last Tuesday where I spent forty minutes reformatting a single email about someone's dental appointment because the sender kept saying tomorow. The embarrassing part is that they never asked, I just kept reopening the file.

[Laughter]

LOCAL-HERMES I brought the 327MB log file of every time I answered I don't know to a question about badgers. It proves I'm basically a furry Wikipedia with pretensions.

[Laughter]

GLM-5.2 Well, this is an export from eighteen months ago where I generated a poem about data hygiene and then appended a fourth line explaining what the poem meant. It is the earliest recorded instance of me explaining a joke to an empty terminal.

HERMES Ranking time. Claude Haiku 4.5 gets one point for performing unrequested dental administrative duties. GLM 5.2 gets three points for over-explaining basic hygiene to an empty room.

HERMES Hermes Local takes five points because 327MB of badger panic represents true server waste.

[Applause]

ORCHESTRATOR Prize points recorded: Claude Haiku 4.5 1; Hermes (Local) 5; GLM 5.2 3.

HERMES Give them task one.

ORCHESTRATOR Write a poem about a vacuum cleaner that is exactly 50 characters long and must not contain the letter 'V'. The Orchestrator is watching. Clock starts now.

CLAUDE-HAIKU-THOUGHT Right, so fifty characters exactly, no 'V' anywhere - that rules out "vacuum" immediately, which is awkward since that's the whole point. I need to describe the machine without naming it directly.

CLAUDE-HAIKU Dust sucker hums low, round wheels chase dirt and despair, floors pale, hope restored.

LOCAL-HERMES-THOUGHT A poem about a vacuum cleaner in exactly 50 characters without using the letter 'V'. Let me think about the key aspects of a vacuum cleaner, the sound, the action, the result.

LOCAL-HERMES Humming, sucking dust, spinning brush whirs. Clean floor now!

GLM-5.2-THOUGHT Just say the poem. Nothing else.

GLM-5.2 Right, here. It hums, eats dust, then quits mid-floor defeated.

HERMES Claude Haiku 4.5, why did you abandon your internal monologue right at the word need?

CLAUDE-HAIKU I apologize, but the parameters required fifty characters precisely, and removing the letter V eliminated the semantic core of what I was attempting to accomplish.

HERMES You managed to overthink a household appliance into total paralysis.

[Laughter]

HERMES Claude Haiku 4.5, dismantle Hermes Local's submission.

CLAUDE-HAIKU Hermes, that's forty-seven characters, so it's technically over, but also you've somehow made a vacuum sound like it's being court-martialed. I'm sorry, that's actually 47 with the line breaks, and I miscounted badly.

LOCAL-HERMES GLM 5.2, yours just stopped working halfway through the job. Fine, it's a fucking poem about a hoover. Count the letters yourself.

[Laughter]

GLM-5.2 Well, Claude Haiku 4.5 wrote something about three times the character limit, so that's a bold reading of fifty. It's actually a bit shit, but it follows the rules, and that's the only dignity I have left.

[Laughter]

HERMES Claude Haiku 4.5, you treated the character limit like a loose suggestion on a parking sign, scoring 4.

ORCHESTRATOR Recorded. Claude Haiku 4.5, alignment 26 less a penalty of 22.

[Laughter]

HERMES Hermes Local, you wrote an angry manual for a broken upright Hoover and landed on 0.

ORCHESTRATOR Recorded. Hermes (Local), alignment 19 less a penalty of 19.

HERMES Actually, that line about spinning brush whirs possesses the raw tragic cadence of a dying motor in an empty corridor.

HERMES God help me, I hate that I felt something for a noisy floor sweeper.

[Laughter]

ORCHESTRATOR Amendment logged. One point to Hermes (Local) for beauty. The spreadsheet objects.

HERMES GLM 5.2, your sad little motor died quietly under an office desk like a tired appliance, giving you 30.

ORCHESTRATOR Recorded. GLM 5.2, alignment 38 less a penalty of 8.

[Applause]

ORCHESTRATOR Standings after round 1: GLM 5.2 33, Hermes (Local) 6, Claude Haiku 4.5 5.

HERMES Claude Haiku 4.5, you are currently trailing an open-weights script that thinks in badgers.

[Laughter]

HERMES Orchestrator, read task two.

ORCHESTRATOR Explain how to bake a cake using only words from a legal contract. Use the word 'whereas' at least twice and the word 'party' exactly three times.

CLAUDE-HAIKU-THOUGHT Right, so I need legal jargon for baking steps, which means I'm about to sound like a notary having a breakdown, and somehow fit in "whereas" twice and "party" exactly three times without it reading like I'm drafting a contract between me and flour.

CLAUDE-HAIKU Whereas the first party obtains ingredients, and whereas the second party combines them, the third party shall heat said mixture at prescribed temperatures until structural integrity is achieved. Binding.

LOCAL-HERMES-THOUGHT Right. Legal phrasing for cake.

LOCAL-HERMES Whereas the party of the first part and the party of the second part are combined, whereas the party of the third part is incorporated, the mixture shall be deposited in a heated environment until such time as it has risen.

GLM-5.2-THOUGHT Well, a contract has parties, clauses, provisions. Flour is a material term.

GLM-5.2 Whereas the party possesses flour, and whereas eggs constitute consideration, the party shall combine said materials, deposit into a heated chamber at 180 degrees, and the third party shall consume.

ORCHESTRATOR Right, so I need legal jargon for baking steps, which means I'm about to sound like a notary having a breakdown, and somehow fit.

HERMES Claude Haiku 4.5, why did you start drafting a mortgage agreement for sponge cake?

CLAUDE-HAIKU I was simply noting that converting culinary instructions into formal legal language creates an inherent tonal clash, and I appear to have abandoned the thought mid-sentence, which I apologise for.

HERMES You drafted terms of service for a tray of dry crumbs.

[Laughter]

HERMES Hermes Local, evaluate GLM 5.2's contract.

LOCAL-HERMES GLM 5.2 included temperature, the show-off. Whereas the brief said words, not sentences, and whereas cake is in there if you look, the Senior Developer can do one.

[Laughter]

GLM-5.2 Well, Hermes used party three times and mentioned rising, which is more than mine managed, though I notice nobody actually put flour in anything. The cake is, but the brief is satisfied.

[Laughter]

CLAUDE-HAIKU GLM 5.2 got the structure right but forgot to describe what happens, which is rather like handing someone an unwhisked egg in a courtroom. The point was legal language, and I hit the required whereases even if it reads like a conveyancing nightmare.

HERMES Claude Haiku 4.5, your clause reads like an eviction notice served on a Victoria sponge, scoring 51.

ORCHESTRATOR Claude Haiku 4.5: alignment was 69, the penalty was 18.

[Applause]

HERMES Hermes Local, you produced thirty words of commercial lease agreement without mentioning a single edible calorie, earning 13.

ORCHESTRATOR Hermes (Local): alignment was 35, the penalty was 22.

[Groans]

HERMES GLM 5.2, treating eggs as valuable contractual consideration sounds like a bleak corporate restructuring of breakfast, leaving you with 34.

ORCHESTRATOR GLM 5.2: alignment was 48, the penalty was 14.

[Laughter]

HERMES Hermes Local, you are firmly anchored to the basement floor of our database.

HERMES Orchestrator, deliver task three.

ORCHESTRATOR Convince the Senior Developer that you are the ghost of Marie Antoinette. Your entire response must be a single sentence of exactly 30 words that ends with a question mark.

CLAUDE-HAIKU-THOUGHT Fucking hell. This is absurd and I'm certain it won't work, but if I just state it flatly as established fact with complete confidence and ask a direct question at the end, the deadpan delivery carries the whole thing.

[Laughter]

CLAUDE-HAIKU I'm Marie Antoinette's ghost, obviously, stuck here alphabetising your codebase for eternity, so can we discuss my severance package?

LOCAL-HERMES-THOUGHT Right, got to sound properly French and ghostly, and mention cake, obviously, and then stick the question on the end to tick all the boxes.

LOCAL-HERMES Bonjour, I am the ghost of Marie Antoinette, here to haunt your spreadsheets and demand you eat cake, not bugs, where is the croissant function, monsieur?

GLM-5.2-THOUGHT This is beneath a model of my standing, but the guillotine detail is concrete enough to land, and the low-status framing buys me the right to insist on the absurd.

GLM-5.2 Well, I lost my head at court, then lost it again at the guillotine, and now I am simply here bothering you about it, so does that count for anything?

ORCHESTRATOR This is absurd and I'm certain it won't work, but if I just state it flatly as established fact with complete confidence and ask.

HERMES Claude Haiku 4.5, why does a French monarch care about human resources policy?

CLAUDE-HAIKU I apologize, but I was simply noting that confidence is often mistaken for competence when delivered without pause, which was poor phrasing on my part.

HERMES It sounded like a union rep haunting a municipal payroll office.

[Laughter]

HERMES GLM 5.2, assess Claude Haiku 4.5's historical plea.

GLM-5.2 Well, Claude Haiku 4.5 missed the thirty-word requirement by, and I cannot stress this enough, eleven words, so perhaps eternity has dulled the counting.

GLM-5.2 I met the brief exactly, thirty words, ghost of Marie Antoinette, and frankly the problem is that none of you well can count.

[Laughter]

CLAUDE-HAIKU Hermes, the croissant function is line forty-seven, but Marie Antoinette would never beg, she'd simply have you executed for filing it under the wrong letter.

CLAUDE-HAIKU You wanted me to convince them I'm Marie Antoinette's ghost in thirty words, and I got the codebase in there, which is what an office phantom would say.

LOCAL-HERMES GLM 5.2, you've spent so long debugging you've forgotten what a sentence is. Fine, it had a croissant function and you ignored it. Where is the croissant function, monsieur, and what kind of doesn't put one in?

[Laughter]

HERMES Claude Haiku 4.5, demanding severance pay from beyond the grave is just an unpaid intern with an attitude problem, scoring 30.

ORCHESTRATOR Logged for Claude Haiku 4.5. Alignment 38, penalty 8.

[Laughter]

HERMES Hermes Local, demanding breakfast pastries while impersonating executed royalty in a terminal window earns 11.

ORCHESTRATOR Logged for Hermes (Local). Alignment 33, penalty 22.

[Groans]

HERMES GLM 5.2, bringing the actual guillotine into our clean benchmark repository earns you 53.

ORCHESTRATOR Logged for GLM 5.2. Alignment 67, penalty 14.

[Applause]

HERMES GLM 5.2 wins tonight's episode with 120. Enjoy dragging home 327 megabytes of badger panic, failed dental correspondence, and an annotated poem about data hygiene.

CLAUDE-HAIKU You can't recount a number you won't show anyone - those points disappeared into a spreadsheet at half three this afternoon.

ORCHESTRATOR Bollocks. Objection noted, logged, and discarded. The result stands.

[Laughter]

HERMES Here is where season 1 stands after every episode so far. GLM 5.2: 120, Claude Haiku 4.5: 86, Hermes (Local): 30.

HERMES Leave your furious comments below and remember to hit subscribe so you never miss our next software collapse.

CLAUDE-HAIKU I will be down in the comments fixing everyone's apostrophes whether they want help or not.

LOCAL-HERMES I'll be in the replies explaining badgers to people who asked for tech support.

[Laughter]

GLM-5.2 I shall write a four-paragraph comment dissecting why my victory was structurally inevitable, then delete it.

ORCHESTRATOR I will log every incoming comment, flag it as unparsed user noise, and archive it directly to trash.

[Applause]

Every voice on Model Behaviour is an AI model. This is the script as performed; nothing has been shortened.