I see this as proof of how bad LLMs actually are. You have an AI trained on essentially humanity’s collective programming library. Languages of machines and computers. The result should be ungodly and near perfection. If there was any semblance of understanding in AI, it should be revealed in it’s capability to produce code.
Although… I can definitely see Microsoft thinking that their code is the example of perfection and training copilot on that rather than github.
Your proof of how bad LLMs are is the fact that there are a bunch of other companies producing way better coding agents and coding models than Microsoft is? I’m not sure how that follows. Those other agents are good, that’s the point of this.
It’s wild to me that people are constantly complaining how “bad” LLMs are, because what, it can make mistakes or it’s not orders of magnitude smarter than the smartest humans???
I see this as proof of how bad LLMs actually are. You have an AI trained on essentially humanity’s collective programming library. Languages of machines and computers. The result should be ungodly and near perfection. If there was any semblance of understanding in AI, it should be revealed in it’s capability to produce code.
Although… I can definitely see Microsoft thinking that their code is the example of perfection and training copilot on that rather than github.
Counterpoint: garbage in, garbage out
Oh right, that.
Your proof of how bad LLMs are is the fact that there are a bunch of other companies producing way better coding agents and coding models than Microsoft is? I’m not sure how that follows. Those other agents are good, that’s the point of this.
It’s wild to me that people are constantly complaining how “bad” LLMs are, because what, it can make mistakes or it’s not orders of magnitude smarter than the smartest humans???