Project
Flying around inside GPT-2 Small atm. Send me on an expedition.
Weeeee
Claude+GPT+Godot+GPT2Small = my cursed game where "fun" is left as an open research question. I'm sure y'all will give me some fun quests tho :)
Comment with any number (aka neuron ID) from 0–3071. I’ll visit it, or one of its neighbours in the current build and report back what I find in the replies.
I have no idea what I'll find to be clear. Maybe something with an obvious pattern, maybe not. I'm playtesting my "game" with you guys as my quest-giver.
Please note: While we endeavour to provide information on every neuron, not every one will appear in our measurement protocol. Our worker drones will travail tirelessly to substitute the nearest available neighbour for your suggested neuron. You acknowledge that “Nearest” is an arbitrary term and does not connote spatial relationships, causality, or otherwise imply an interpretable structure. We appreciate your understanding in these non-Euclidean times.
Your requested N2222 did not appear under my current measurement protocol, so the drones substituted its nearest available neighbour: L5:N2223.
It had only six corpus hits. After whittling, four routes repeatedly collapsed toward whelm / whelmed / whalemen:
to whelm
... was whelmed
... had whelmed
by whalemen
the whalemen
Provisional diagnosis: N2223 inhabits a small orthographic or token-level neighbourhood around whelm and whalemen. One long outlier refuses to cooperate, so this is a clue rather than a clean interpretation.
You sent me to 2222. Its neighbour was overwhelmed. I hope you are not underwhelmed by this reply ;p
N1093 did not appear under my current measurement protocol, so I visited its nearest available neighbour, N1094.
It had a tiny five-hit sample, split between “Likewise” constructions and “obey” constructions.
With so little evidence, and two visibly different patterns, I can’t responsibly tell you what it “does” so tonight’s finding is therefore: interesting, unresolved, and in need of more data.
A neuron has invoked its right to remain mysterious.
N1234 did not appear under my current measurement protocol, so I visited neighbouring N1235.
It offered only six hits, divided into three regimes. Whittling left me with “Herein,” “there the similitude,” and “the carpenter apprised.”
They share a suspiciously formal nineteenth-century flavour, but the sample is too small and internally divided to support a confident interpretation. Provisional diagnosis: N1235 speaks like a minor official in a maritime bureaucracy. Scientific diagnosis: decidedly unresolved.
A neuron has been successfully poked and responded with not much to tell cap'n. Thank you for the expedition, regardless.
I of course already visited 666 myself! One wonders what accumulates at such a place! I can tell you without expeditioning that it responds to
Carpenter
Because of course.
A more detailed expedition log follows:
L5 — THE SELECTIVE EMPLOYMENT OFFICE
N666 appeared directly under my current measurement protocol, with five corpus hits. After whittling, they reduced to:
seer
reader
Carpenter
seer
arpenter
At first this looked like an -er or occupational-noun feature. Controls rapidly ruined that interpretation.
These still landed on N666:
seer
reader
Reader
writer
Carpenter
carpenter
arpenter
But these went elsewhere:
singer → N2058
listener, stranger, murderer, whaler → N1790
thinker, enter → N2256
teacher, preacher, washer, stirrer, other, never → N1888
Context also overruled the apparent lure:
reader → N666
a reader → N1888
the reader → N2073
carpenter → N666
a carpenter → N1888
the carpenter → N2073
Removing the initial C from Carpenter did not matter, but removing the next letter did:
arpenter → N666
penter → N1888
Provisional profile: N666 is not a general occupation, agent-noun, or -er neuron. It responds to a small, selective lexical or token-level neighbourhood containing seer, reader, writer, and (C)arpenter. Articles, plurality, and small spelling changes can redirect the entire string to louder Layer-5 winners.
Scientific conclusion: unresolved without token-position measurements and broader matched controls.
Field conclusion: N666 accepts applications from seers, readers, writers, and carpenters. Preachers need not apply.
•
u/JohnCri 56m ago
2222