Cast by dylsteck.eth

Show the cast this replies to

gonna try this later!! I feel like this could actually turn out well given how massive the context window for some models like Gemini & Llama are getting also gonna see if I can find some small tool to make it easier to copy-paste the contents of both repos

1 likes0 recasts1 replies

1 reply

  • i am learning that hosted for llama if you want long context you gotta go vertex ai or self host on a 8xh100 (or run at int-4 on a 1xh100), still leagues away from google just being like here's 1 mil and it responds in 0.2s and it's basically free

    1 like · 0 recastsRead 1 reply

    good to know!! and also yeah the 180 Google has been able to make lately with all of these massive, multimodal models is very impressive

    1 like · 0 recasts