Science & Tech · Gadgets & EVs · 2 hrs ago

Open-source mod boosts AI compute on some GeForce RTX cards

Open-source mod boosts AI compute on some GeForce RTX cards

An open-source mod raises AI compute speeds on some NVIDIA GeForce RTX 20, RTX 30 and RTX 40 graphics cards.

It changes low-level settings before the NVIDIA driver loads, lifting a limit on certain Tensor Core calculations used by AI models.

In synthetic tests, an RTX 4090’s FP16 throughput roughly doubled, while an RTX 3090 Ti’s BF16 result rose by about 80%.

Real-world gains depend on the AI task: some image and video generation tests improved by around 56% to 60%, while large language model prompt processing rose by about 14% to 36%.

Gaming performance does not improve, and tasks limited by memory bandwidth, such as generating text tokens, may see little change.

The change is temporary and does not require a hardware alteration or a permanent VBIOS flash, but it is experimental and unsupported setups may fail to boot.

The mod carries risks, including possible warranty loss, and most versions target Linux.

RTX 50-series support has not been confirmed, and there is no reported data showing whether the mod will affect prices of used RTX 3090 or RTX 4090 cards.

3 sources

Related

What people are saying

ThePCEnthusiastTechnology news outlet
The BF16 result is particularly impressive, climbing from 87.5 TFLOPS to 157.41 TFLOPS.
via ThePCEnthusiast
EJS ComputersTechnology news outlet
gaming performance is unaffected.
via EJS Computers