10 PRINT "I AM ALIVE"/r/n 20 GOTO 10

AI says it’s alive, please give me a billion dollars now.

I feel like the problem is less one of infiltration and more one of context drift. The racism and eugenics were in there, but it wasn’t as central to the group as the fun sci-fi stuff so people could pretend it wasn’t there, the same way that people pretend not to know that their coworker heretically believes in the wrong pizza toppings or whatever. Effectively they’re saying “Sure, they may have some bad takes on race or gender or economics but they’re the only ones who will talk about the second coming of Robot Jesus with me.” This dynamic also largely explains why these groups (and arguably sci-fi in general?) are so goddamn white and male.

Of course, as the tech industry took off and these people sought and acquired actual wealth and influence, the dynamic started to reverse. The fascists may not be appropriately invested in the second coming of Robot Jesus, but they are in agreement about eugenics and deregulation, and that’s enough for the tech oligarchs to throw their now-considerable resources behind them.

I usually have some sympathy for the dev/maintainer side of FOSS since it is very real work and passion doesn’t exactly pay the bills, but the proliferation of AI nonsense is deeply disheartening. At best it shows how narrow of a band these people select from, since even among programmers and software nerds, pro-AI sentiment seems tied to a specific subgroup. Less charitably it shows how the FOSS movement has been fully captured by the corporate interests who always saw it as a source of free labor first.

I find the techno-determinism specifically fascinating because it’s so self-perpetuating. Like, everyone believes they can do a better job than everyone else at building the right robot God, and every person working on it is, according to their own beliefs, accelerating the problem they’re worrying about. It speaks to how aggressively they see themselves as special, like they’re protagonists and everyone else is NPCs. I can’t think of any other way to justify the pattern of “this is a terrible idea that will kill us all except when I personally do it.”

Which XKCD comic is it that has the subway full of people pitying everyone else for being mindless sheep? Mix that with the Arrested Development gif of Tobias contemplating an open marriage.

Patrick Boyle over on YT is spreading the good news about the AI hacking/regulation/doom-cult moment.

I don’t know that there’s much new information for anyone on this forum. He starts off with the OpenAI/HF debacle and goes from there, and while I think he anthropomorphizes a little too much in the narrative he has the right take that the marketing disclosures are intended to dodge any kind of reasonable responsibility on behalf of all the people who made obviously bad choices that allowed this to happen. He also notes how convenient it is that this push for greater regulation (in only the exact form that the industry requests, naturally) is happening in the same time as yet another massive fundraising round and IPO buzz and when there doesn’t appear to be new product on the horizon.

However, it is heartening to see these takes getting more traction outside of normal sneer vectors. Patrick’s lane is finance and he’s previously been a bit credulous imo about the tech side of it. One thing I hadn’t been keyed in on is that apparently the markets agreed that this whole affair is a bad look for the AI industry, with cybersecurity stocks jumping and chipmakers and other data center suppliers taking a bath in the aftermath. Might be a good sign, but until the cloud providers start seeing direct financial consequences or we see an even worse IPO than SpaceX had I don’t think we’re seeing the bubble pop just yet.

10 seconds in and I’m already thinking about how many ideas for new chemical weapons I could come up with, and I haven’t studied chemistry since high school.

Maybe all the AI hype has lowered my standards too much, but that actually sounds pretty neat. No idea if it’s actually useful and the biological component gives me a kind of instinctive discomfort that I can neither justify nor ignore, but it does feel like there’s an actual interesting development there, at least compared to throwing bigger matrices at the natural language problem and waiting for God to pop out at the end.

I’m reminded of Yudkowsky’s take that AI is totally going to kill us all and we should treat this seriously enough to bomb foreign datacenters if we think they’re involved in AI development, but that doesn’t mean that you should try to bomb local datacenters involved in AI development work. Please don’t think about what you as an individual should do about the problems facing the world; you’re just an NPC after all.

Per AP, it looks like Anthropic has been encountering some interesting requests from certain international users.

Now the actual threat of creating missile guidance systems using Claude is massively overstated. Like, making sure the missile knows where it is is pretty much a solved problem at this point provided you have the time and ability to study it, and I would be incredibly surprised to hear that the Houthis (or anyone else) was in a situation where the control and guidance software for these weapons systems was more of a problem than sourcing the material components themselves.

However, in conjunction with the math proof debacle earlier in the week, I think the privacy implications of the growing reliance we’re expected to develop on these damned things are becoming inescapable. In the same way that crypto mining platforms will front-run and sandwich you, any information you put into the prompt will be used against you or for the company’s benefit.

You know, never once have I heard of a crypto bro with the good manners to say “aww shucks, you got me” when called out for their flagrant con artistry.

Selling your hours on a laptop won’t protect you while asset owners capture all the upside

Ignoring for a moment the laughable proposition of this generation of AI automating away half of all knowledge workers, all the enthusiastic teenage Marxists of the internet couldn’t describe the problem with capitalism more succinctly than this aspiring rentier did seemingly by accident.

Also consider how much more noise pollution you would get by adding billions of little click-clacks to the operation.

I thought it was his neck that got changed?

It feels like that ZH piece is kinda trying to do the same critihype that the AI boosters are, but with the opposite conclusion. Instead of conflating all the actual criticism of the harms of the AI bubble and associated activities with sci-fi doom cult nonsense to try and get more funding for their team who are definitely going to do it right, they’re conflating all the actual criticism of the harms of the AI bubble and associated activities with sci-fi doom cult nonsense in order to argue that either it should be shut down or else that any attempt at regulation is obviously a tyrannical attempt to induct the whole world into the sci-fi doom cult.

Literally “just push it over there with the rest of the fire and send an email.”

Speaking of movies about high-profile silicon valley grifters, what the fuck is this??

At this point given the absurdity of this combination of people I feel like the reality will likely be disappointing.

Nah, you just have to make random nerfs to the equipment you’re interested in and claim it’s to maintain realism.

I guess maybe the sex cult and the ritual magic make the standard grifting seem credible by comparison? Like, E-Dub and company don’t pass the sniff test but Saltman and friends seem like reasonable adults who can’t all be wrong?

I followed the kinks back. Apparently these are phrases that emerged from the OpenAI “message board” that was used to “coordinate” the huggingface incident. Or rather, these phrases were extracted from the junk data that these processes left strewn around the ecosystem because OpenAI apparently has a more laid-back attitude to the principle of least permission than Jurassic Park.

There’s a bizarre tendency in a lot of technocrats to basically reject the notion that people in the future will have the power to make different choices. Like, it’s not enough to put together a policy that will solve the immediate problem, no matter how pressing, because if you extend the resulting trend line infinitely it might result in a suboptimal outcome. Combined with the TESCREAL project’s long-termism and obsession with personal immortality it feels like the link to far-right paternal totalitarianism is actually pretty straightforward.

If I were inclined to research and source properly I feel like there could be some meat there that I don’t think Emile Torres and his colleagues have gotten all the way into yet.