Samsung patent boosts AI server memory efficiency without adding GPUs

Samsung Electronics has disclosed a patent application targeting GPU memory shortages when multiple users simultaneously submit requests to AI servers. By calculating data-transfer costs between GPUs and CPUs and minimizing unnecessary transfers, the technology is designed to enable AI servers to…

hardware

Sources