Cast by dylsteck.eth
Show the cast this replies togonna try this later!! I feel like this could actually turn out well given how massive the context window for some models like Gemini & Llama are getting also gonna see if I can find some small tool to make it easier to copy-paste the contents of both repos
1 reply
i am learning that hosted for llama if you want long context you gotta go vertex ai or self host on a 8xh100 (or run at int-4 on a 1xh100), still leagues away from google just being like here's 1 mil and it responds in 0.2s and it's basically free
good to know!! and also yeah the 180 Google has been able to make lately with all of these massive, multimodal models is very impressive