Should work fine offline. It's based around a local chatbot. Done a bit of work like this myself and the models don't require online access. In fact, most of the chatbots now have addressed issues with older models by adding online search so that is something you have to add. That said, I have yet to try this out myself. Saw it the other day.