Intel Arc B580 runs 125B AI model nearly 3x faster with XeStrata in new test

Intel's 12GB Arc B580 delivered 31.1 tokens per second when running a 125-billion-parameter AI model with XeStrata, compared with 10.9 tokens per second using Strata. The result highlights the impact of inference software, although the test PC also required 64GB of RAM.

aihardware

Sources