I've figured out what pisses me off so much about Facebook's Galactica demo.
It's not because people can use to to write bad essays for their homework. There are plenty of large language models that can do that. It's because Facebook is presenting it as something that it most definitely is not.
Facebook is selling it as a knowledge engine, a "new interface to access and manipulate what we know about the universe."
Actually it's just a random bullshit generator.
galactica nonsense
@ct_bergstrom lmfao, so few lines and yet it manages to be wrong in multiple ways, none of which would be easily detectable to a typical reader...
re: galactica nonsense
@ct_bergstrom (specifically, 1. it doesn't expand on the "not always", 2. static typing doesn't *always* require explicit declaration, inference also exists, and 3. from a research perspective it's highly debatable whether it's true at all - ie. exactly the kind of errors I would expect a neural net to make)