What is Universality in LLMs? How to Find Universal Neurons

Researchers discovered that independently trained language models develop some identical neurons, demonstrating "universality" similar to how human brains converge despite different starting conditions. By analyzing two separately trained transformer models and calculating correlation between their neurons, they identified several that performed identical functions, suggesting neural networks naturally develop similar internal mechanisms regardless of initialization.