Is this hosted somewhere? Maybe distributed? I would love a privacy respecting distributed LLM chatbot.

That’s definitely going to be a solved problem very soon with RAG LLMs. I have a friend who works in LLM research and it’s crazy how much progress they make so quickly. Their cutting edge stuff he shows me makes GPT-5 look like a toddler.

They’ve already lost my trust. GrapheneOS or LineageOS are the only safe bets now.