- cross-posted to:
- programming@programming.dev
- cross-posted to:
- programming@programming.dev
cross-posted from: https://feddit.org/post/36615673
Forgive the smelly domain.
This is a fantastic short essay by Rich Hickey.
cross-posted from: https://feddit.org/post/36615673
Forgive the smelly domain.
This is a fantastic short essay by Rich Hickey.
LLMs are a stochastic tool that generalizes patterns imprinted into the neural network during training. And then these patterns are expressed in the given context during inference. The stochastic aspect is what makes it possible for the LLM to adopt generalized training to the specific problem being solved. So, the outputs LLMs produced are not random in a sense of playing bingo because randomness is not the dominant property of the system. It is predicting the most likely next token within the given context.