Thought some here may enjoy this. I posted about it somewhere on BGG a few months ago.
Talkie 1930 is a "vintage language model". Only texts from before 1931 were used to train it (give or take some small amount of newer texts that were accidentally included… they discuss that a bit in the linked page). Seems like it did not get much mainstream attention when it was released ~3 months ago:
link
It's a pretty small for a "large" language model, not even on the level of the first public versions of ChatGPT (if any of you remember that; very primitive compared to what we have now).
Of course you can instruct any LLM to role-play and pretend that it's 1930 and it doesn't know the future, but the point of a vintage language model is that it really can't leak any modern information or bias into its answers.
There have been a few other vintage language models, and no doubt more will be released. Talkie 1930 seems to be the most useful one available for now. Other models have different cut-off dates. Only using texts from before 1900 seems like a popular one. But from what I understand there is a hard limit somewhere in the late 19th century. Before that date there just isn't enough text available to be able to train a large language model from scratch.
