minus-squarelevzzz@lemmy.worldtoTechnology@lemmy.world•Edward Snowden slams Nvidia's RTX 50-series 'F-tier value,' whistleblows on lackluster VRAM capacitylinkfedilinkEnglisharrow-up2·3 hours agoYou need a pretty large context window to fit all the reasoning, ollama forces 2048 by default and more uses more memory linkfedilink
You need a pretty large context window to fit all the reasoning, ollama forces 2048 by default and more uses more memory