The chipmaker has been quick to redesign its products to pass the current restrictions, but US Commerce Secretary Gina Raimondo seems to have had enough.
And yet all of the good, open source LLM work is coming out of China. But hey, maybe this will spur some ROCm development so AMD cards don’t suck so fucking hard in that space.
I liked your original comment before the edit, it’s true. AMD only has consumer grade hardware, which is the main reason the majority of the AI projects don’t support it. Code written for CUDA can work on a A100 just as well as a 3090, there’s no money in developing software to run on someone’s 4 year old gaming PC.
And yet all of the good, open source LLM work is coming out of China. But hey, maybe this will spur some ROCm development so AMD cards don’t suck so fucking hard in that space.
AMD is also subject to export restrictions.
I liked your original comment before the edit, it’s true. AMD only has consumer grade hardware, which is the main reason the majority of the AI projects don’t support it. Code written for CUDA can work on a A100 just as well as a 3090, there’s no money in developing software to run on someone’s 4 year old gaming PC.
AMD makes a few Mi999 cards that support pytorch with ROCM and are subject to the export ban.
Not sure how I missed the MI250 series, but thanks.