OpenAI may have tested GPT-4 on its training data, violating the cardinal rule of ML, and GPT-4’s exam performance says little about its real-world usefulness (AI Snake Oil)

OpenAI may have tested GPT-4 on its training data, violating the cardinal rule of ML, and GPT-4’s exam performance says little about its real-world usefulness (AI Snake Oil)

AI Snake Oil:
OpenAI may have tested GPT-4 on its training data, violating the cardinal rule of ML, and GPT-4’s exam performance says little about its real-world usefulness  —  OpenAI may have tested on the training data.  Besides, human benchmarks are meaningless for bots.