Gary Marcus / Marcus on AI:
Why LLMs, which don’t induce an algorithm that computes multiplication, still don’t truly understand multiplication no matter how much data they are trained on — Some Reply Guy on X assured me yesteday that “transformers can multiply”. Even pointed me to a paper, allegedly offering proof.
