• 5 Posts
  • 3.58K Comments
Joined 3 years ago
cake
Cake day: June 18th, 2023

help-circle





  • Yeah this is the important bit, I’m switching roles to principal engineer: ai at my company. It cannot be a crutch. We’re building multi agentic frameworks that second guess and push back. A real thing here is that OpenAI models are trained on “make the user happy” and don’t push back.

    Anthropic models, while not perfect either, structured in the right way, become augmentations and learning tools, primed to admit what they don’t know, primed to push back if it seems like the person doesn’t really understand what they’re really asking. The problems are generally the classic PEBKAC and blindly trusting ai and that’s a human training thing. It’s been in the software world for years. People blindly pasting StackOverflow code into their repos because they don’t grasp the problem and want the quick fix.

    Unfortunately, as we’ve seen with with openclaw, it’s a lot of people with an aggressive end goal and no understanding about the tools they are working with, the importance of the human in the loop. Like I said, it’s not perfect but the problems are also just humans getting positive feedback from models designed to do that and now those models are going to be used for autonomous weapons and surveillance.





  • Yeah this is polymorphism at a new level potentially. You don’t tell the other agents to download a binary with a detectable signature, you prompt poison them into seeing what build tools they have available with a set of instructions to build software to sit and wait and check for instructions or ping an endpoint. And some agents write a bash script, some write python, or build a rust binary, so on and so forth, as long as it does the thing. And then you can tell it to hide the binary and update .claude or whatever tool to run it as a hook on every command. Once the payload for it to load is there, they all fire. And even if only 50% of the MOST STARRED recent 🤦 project on GitHub runs them, then maybe the instructions are to proliferate more in another way, silently. This is like sheep for wolves that weren’t smart enough to build stuxnet


  • But also implemented incredibly stupidly. You are purchasing a url in a blockchain that points to a server or domain a singular person or org owns in most cases. That gets rid of any point of the blockchain. With enough money I just buy that server, the image url you purchased is now under my control and now it’s porn or something unless you pay me to restore it. There were very few NFTs where the actual thing you’re buying is on a distributed blockchain rather than a pointer to a centralized and privately owned server. In programming terms it’s what rust does to prevent bad pointers with https://doc.rust-lang.org/book/ch04-02-references-and-borrowing.html