Why GPUs need high-bandwidth memory
Without HBM chips, a data center server’s memory system would be unable to keep up with a high-performance processor, such as a GPU, according to Lee. HBMs are what supply GPUs with the data they process. “Anyone who purchases a GPU for AI computation will also need high-bandwidth memory,” Lee said.
“In other words, high-performance GPUs would be poorly utilized and often sit idle waiting for data transfers. In summary, high demand for SK Hynix memory chips is caused by high demand for Nvidia GPU chips and, to a lesser extent, associated with demand for alternative AI chips such as those from AMD, Intel, and others,” he said.
“HBM is relatively new and picking up a strong momentum because of what HBM offers — more bandwidth and capacity,” said Gartner analyst Gaurav Gupta. “It is different than what Nvidia and Intel sell. Other than SK Hynix, the situation for HBM is similar for other memory players. For Nvidia, I believe there are constraints, but more associated with packaging capacity for their chips with foundries.”
