Basically a deer with a human face. Despite probably being some sort of magical nature spirit, his interests are primarily in technology and politics and science fiction.

Spent many years on Reddit before joining the Threadiverse as well.

  • 0 Posts
  • 651 Comments
Joined 3 years ago
cake
Cake day: March 3rd, 2024

help-circle










  • Sure, we could do that. But we’d need even more computer hardware that we don’t have, so it would be more expensive, and energy use would be less efficient so there’d be even more environmental impact. Just spread around to every house rather than in one centralized easily-protested spot.

    Sam Altman was incredibly tone deaf and it was a stupid thing for him to say out loud when he said RAM was better off in data centers, but in some significant and important ways he was right. Computer equipment is much more efficiently utilized when it’s in a data center.

    I say this as someone who’s super into running local models myself. I do it because I believe the autonomy and privacy are worth trading off the extra cost in hardware and electricity. If I just wanted to use AI to get something done and didn’t care about that I’d be paying for API access instead.


  • Depends on the framework you’re using. I’m using Qwen Code Companion (via a VS Code IDE plugin) and it’s got some kind of tiered system built into it for adding tool definitions to context, it’s got a standard built-in set that’s always mentioned but other stuff only gets added to the context under certain circumstances. I can’t recall all the details, I found out about it when I was chatting with Qwen Code to ask it why it hadn’t used a particular MCP I’d given it to solve a problem despite it seeming like a useful tool for the task and we got into a discussion about to configure it. As I recall it’s something along the lines of most tools only being present in context by default as little one-liner stubs and the agent has to tell the framework “that one looks like it might be useful for what I’m doing” for the full definition to get loaded.

    Most of the time I’m working on small scripts and specialized applications these days, and codebase memory is overkill for those so I haven’t actually seen it in use much.