Cast by jc4p

Show the cast this replies to

i am learning that hosted for llama if you want long context you gotta go vertex ai or self host on a 8xh100 (or run at int-4 on a 1xh100), still leagues away from google just being like here's 1 mil and it responds in 0.2s and it's basically free

1 likes0 recasts1 replies

1 reply

  • good to know!! and also yeah the 180 Google has been able to make lately with all of these massive, multimodal models is very impressive

    1 like · 0 recasts