At SC25, experts highlighted how accelerated computing and smarter memory handling are reshaping AI infrastructure, improving GPU utilization and more.