I wanted to share a Python package that I’ve been working on for exposing language models to students who are new to programming:
This isn’t much more than a thin wrapper around CTranslate2 and some other basic tools, but I’m hopeful that it will be useful in intro to programming courses and similar settings. It avoids heavier dependencies like pytorch and should be usable on nearly any system. I’ve tested it on the free tier or repl.it and it stays under the 512MB RAM limit.
It does make use of the new BERT support that landed yesterday for semantic search embeddings if anyone is curious to see an example of that.
Thanks to Guillaume @guillaumekln and the CTranslate2 developers for all of your work!