Trainium 3: the first dedicated AI chips
- Thread starter Shadow Reaper
- Start date
Title is a bit misleading. How is it the first when it's the third generation of their AI chips lol? Amazon has made them since 2020 and dedicated AI research chips have been a thing since the 90's.
Well, this is Amazon’s claim. I suppose it is the first purely AI chip put into full production. Also, it is 3nm transistor so that is represented in the name as well.
Intel has had Springhill chips for years before Amazon made their first and that's a production level datacenter chip, I think it's just marketing crap lol.
Well if you watch the vid, she explains that the AI chip actually has hardwired what would normally be AI code. So it’s possible there is a distinction with a difference here. The big point however is that these chips are consuming only 40% of the power their competition consumes. She did not however explain if she was talking about the competition’s 3nm chip technology.
As the transistors grow smaller they consume less power, so the 60% reduction may just be from the smaller size.
Either way, it is scary to me that we feed thinking machines gigawatts of power. Do we have a death wish to knock ourselves off the top of the evolutionary pyramid?
Everyone acknowledges how badly wrong this can go, and Congress hasn’t even brought it up for discussion. Crazy.
As the transistors grow smaller they consume less power, so the 60% reduction may just be from the smaller size.
Either way, it is scary to me that we feed thinking machines gigawatts of power. Do we have a death wish to knock ourselves off the top of the evolutionary pyramid?
Everyone acknowledges how badly wrong this can go, and Congress hasn’t even brought it up for discussion. Crazy.
I've already written to my rep about AI with some of the talking points ControlAI have created. It's definitely a concern lol. https://controlai.com/