• 0 Posts
  • 98 Comments
Joined 3 years ago
cake
Cake day: June 2nd, 2023

help-circle




  • The blog article you link I think implies you do not have your own VM. LLMs are stateless, the previous conversation is fed in as part of the prompt.

    You send your message, which is E2E encrypted. The LLM runs in an environment where it can decrypt your message and run in through the LLM, then send a response to you. Then it gets the next user’s message and replies to them.

    The key part is that the LLM is running inside an encrypted environment not accessible to the host system, so no one can watch as it decrypts your message.

    That’s what I get from reading your links.






  • Do you have a plan? I have a Home Assistant Voice Preview Edition and it’s great but I don’t think it can do unit conversions without connecting it to an LLM. Timers work locally.

    I guess if it’s an equation you could add automation to pick up on the phrase and reply with the conversion, but that would need each unit to be manually done and wouldn’t work for things like currency conversion that needs live data.

    Also arbitrary things would be challenging, like converting tablespoons of butter into grams or grams of rice into cups.