

Oh yeah, 16 GB of VRAM is a strange spot to be in. Most of the focus goes onto the models that fit in 24 GB cards.
Qwen 3.6 35b-a3b is pretty solid when you don’t have enough VRAM for a dense model. Most of the weights can be left in RAM and it still runs really quickly.
If you knew the source, you wouldn’t need to go to the LLM. It’s helpful when you don’t know where to begin, like when you don’t even know the name of the piece of your staircase that snapped off. You can just take a picture of the broken part and ask what is called and then verify that answer rather than read a bunch of blogspam from people trying to sell their home repair service.