I’m just expecting performance optimisations, especially for local LLMs. Right now there are models as good as GPT-4 (Goliath 120B), but they require 2 RTX 4090 to run.
The models that require less powerful equipment are not as good, of course.
But hopefully, given enough time, good enough models will be able to run with mid end hardware.
I’m just expecting performance optimisations, especially for local LLMs. Right now there are models as good as GPT-4 (Goliath 120B), but they require 2 RTX 4090 to run.
The models that require less powerful equipment are not as good, of course.
But hopefully, given enough time, good enough models will be able to run with mid end hardware.