On Reality and the Limits of Language Data: Aligning LLMs with Human Norms

Now for historical interest: our 2023 study found that language-trained AI struggled with real-world common-sense reasoning. New 2024-25 benchmarks confirm that even multimodal models still falter on spatial physical tasks and object affordances. Ground-truth world modelling remains a frontier but aligning AI with human-scale embodied knowledge is still vital for safe applications.

Abstract originally published in Proceedings of the Annual Meeting of the Cognitive Science Society, see the full article here on arXiv.