OpenAI says its own models optimised Astra Ultrafast's inference on Nvidia GPUs

OpenAI used its own models to tune the inference software that serves GPT-6 Astra Ultrafast on Nvidia hardware, two of its executives say on the record in a post Nvidia published on October 1. "We used our internal models to optimize inference on NVIDIA GPUs, and NVIDIA's programmability helped us…

aihardwareiottelecomxr

Sources