NVIDIA RTX A6000

The RTX A6000 is the workstation card that keeps turning up on home AI benches, and for one reason. Forty-eight gigabytes of memory, on a single dual-slot card, at 300W, cooled by a blower that dumps its heat out the back. It’s not fast and it isn’t cheap, but it runs a 70B on one GPU in a build you can actually keep quiet. That’s a rare combination.

The take

You’re paying for packaging, not speed. Two 3090s pool the same 48GB for a good deal less money, so on pure value the A6000 loses. What it gives you instead is 48GB in two slots at 300W with ECC memory and pro drivers, which makes for a clean, stable, single-card machine. If a tidy build and single-GPU simplicity are worth real money to you, that’s the case. If they aren’t, dual 3090s win.

What it’ll actually run

Forty-eight gigabytes changes what one card can hold. A 70B at Q4 fits with room for context, and you don’t need a second GPU or CPU offload to get there. That alone is the reason people buy it. Below that, a 32B runs at higher quant and much longer context than any 24GB card manages, which helps with document work and long chats.

Speed is the compromise. At 768 GB/s the bandwidth trails a 3090, so tokens come out at a steady rather than snappy pace, and for the price that stings if you were expecting quick. Judge this card on capacity per slot and per watt, not on throughput. It’s a fit-it-in-one-card tool.

The build side is where it shines. The blower cooler self-exhausts, so two of them stack in adjacent slots and stay sane on air, where two triple-slot gaming cards would choke. Three hundred watts and a single power input keep the wiring simple. For a quiet, always-on box with a lot of VRAM, little else is this civilised.

Who should buy it, and who shouldn’t

Buy it if you want a large model on one card in a clean, quiet, workstation-style build, and 48GB of ECC in two slots is worth paying over. It suits people who value stability and packaging, or who plan to run two cards for 96GB on air. Used pricing is the way in, so buy from a seller who will stand behind it.

Skip it if value is the priority, because dual 3090s give the same 48GB for less. Skip it too if you want the fastest tokens per pound, where newer cards do better. But for 48GB in a two-slot, 300W package that stays quiet, the A6000 still earns its keep.