Good read! It would be also interesting to compare the prices.
I personally don't believe in "LLM-specific" chips. AI field is moving so fast, I'm sure we will throw away transformers at some point.
Also Sohu doesn't support LLM training, only inference, so it really is a leap into faith.