Open models and llm-d enabled IBM Research to explore quantum error correction hardware at 11.5Γ lower inference cost than an all-proprietary configuration.
Researchers show that serving AI models with llm-d can boost inference speeds by up to 5 times and double throughput β all while using heterogeneous GPUs.