Cast by kenny

1 reply

• 

  jvaleska.eth2h

  does winner works with wikipedia only is it a full llm ?

  1 likes0 recasts1 replies
  

  kenny2h

  it's powered by a real local LLM, just leans on Wikipedia and customizable knowledge packs to power what it's referencing

  

  

  Commonplace: ask Wikipedia in airplane mode

  Commonplace is a free, open-source Android app. It answers questions from Wikipedia and other reference works stored on your phone, cites every source, and has no internet permission.

  2 likes0 recasts2 replies
  

  kenny2h

  good thread walking through the tech here as well @jvaleska.eth

  

  @0xPD33

  The challenge of optimizing LLM inference on phones is way greater than it should be. This is partly because not many people are doing it, but also because on most systems it seems incredibly difficult to get proper access to the hardware underneath the OS. I'll break down what I've tried and wh…

  1 likes0 recasts1 replies
  

  jvaleska.ethkenny2h

  the customizable knowledge feels interesting enough with an open source repo it means anyone can fork and create their own knowledge packs

  2 likes0 recasts0 replies