Cast by jc4p
Show the cast this replies toi am learning that hosted for llama if you want long context you gotta go vertex ai or self host on a 8xh100 (or run at int-4 on a 1xh100), still leagues away from google just being like here's 1 mil and it responds in 0.2s and it's basically free
1 reply
good to know!! and also yeah the 180 Google has been able to make lately with all of these massive, multimodal models is very impressive