Cast by purp
Show the cast this replies toThe big problem with huewei's current chips is the scope of it. To train deepseek v.5 they are chaining 160k together. And the programming they are using instead of cuda is more time intensive (if one node goes out they have to pull every node and check by hand) so having extra gpu if even as fallback is advantagous
0 replies
No replies yet