Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.

Any awful.systems sub may be subsneered in this subthread, techtakes or no.

If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.

The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)

Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.

(Credit and/or blame to David Gerard for starting this.)

  • o7___o7@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    Better Offline was rough this morning in some places. Props to Ed for keeping his cool with the guests.

    • TinyTimmyTokyo@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      Oof, that Hollywood guest (Brian Koppelman) is a dunderhead. “These AI layoffs actually make sense because of complexity theory”. “You gotta take Eliezer Yudkowsky seriously. He predicted everything perfectly.”

      I looked up his background, and it turns out he’s the guy behind the TV show “Billions”. That immediately made him make sense to me. The show attempts to lionize billionaires and is ultimately undermined not just by its offensive premise but by the world’s most block-headed and cringe-inducing dialog.

      Terrible choice of guest, Ed.

      • lagrangeinterpolator@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        I study complexity theory and I’d like to know what circuit lower bound assumption he uses to prove that the AI layoffs make sense. Seriously, it is sad that the people in the VC techbro sphere are thought to have technical competence. At the same time, they do their best to erode scientific institutions.

        • Soyweiser@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 year ago

          Only way I can make the link between complexity theory and laying off people is thinking about putting people in ‘can solve up to this level of problem’ style complexity classes (which regulars here should realize gets iffy fast). So hope he explained it more than that.

          • BlueMonday1984@awful.systems
            link
            fedilink
            English
            arrow-up
            0
            ·
            1 year ago

            The only complexity theory I know of is the one which tries to work out how resource-intensive certain problems are for computers, so this whole thing sounds iffy right from the get-go.

            • Soyweiser@awful.systems
              link
              fedilink
              English
              arrow-up
              0
              ·
              1 year ago

              Yeah but those resource-intensive problems can be fitted into specific classes of problems (P, NP, PSPACE etc), which is what I was talking about, so we are talking about the same thing.

              So under my imagined theory you can classify people as ‘can solve: [ P, NP, PSPACE, … ]’. Wonder what they will do with the P class. (Wait, what did Yarvin want to do with them again?)

              • lagrangeinterpolator@awful.systems
                link
                fedilink
                English
                arrow-up
                0
                ·
                1 year ago

                There’s really no good way to make any statements about what problems LLMs can solve in terms of complexity theory. To this day, LLMs, even the newfangled “reasoning” models, have not demonstrated that they can reliably solve computational problems in the first place. For example, LLMs cannot reliably make legal moves in chess and cannot reliably solve puzzles even when given the algorithm. LLM hypesters are in no position to make any claims about complexity theory.

                Even if we have AIs that can reliably solve computational tasks (or, you know, just use computers properly), it still doesn’t change anything in terms of complexity theory, because complexity theory concerns itself with all possible algorithms, and any AI is just another algorithm in the end. If P != NP, it doesn’t matter how “intelligent” your AI is, it’s not solving NP-hard problems in polynomial time. And if some particularly bold hypester wants to claim that AI can efficiently solve all problems in NP, let’s just say that extraordinary claims require extraordinary evidence.

                Koppelman is only saying “complexity theory” because he likes dropping buzzwords that sound good and doesn’t realize that some of them have actual meanings.

                • Soyweiser@awful.systems
                  link
                  fedilink
                  English
                  arrow-up
                  0
                  ·
                  1 year ago

                  Yeah but I was trying to combine complexity theory as a loose theory misused by tech people in relation to ‘people who get fired’. (Not that I don’t appreciate your post btw, I sadly have not seen any pro-AI people be real complexity theory cranks re the capabilities. I have seen an anti be a complexity theory crank, but that is only when I reread my own posts ;) ).

        • BigMuffN69@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 year ago

          My hot take has always been that current Boolean-SAT/MIP solvers are probably pretty close to theoretical optimality for problems that are interesting to humans & AI no matter how “intelligent” will struggle to meaningfully improve them. Ofc I doubt that Mr. Hollywood (or Yud for that matter) has actually spent enough time with classical optimization lore to understand this. Computer go FOOM ofc.

      • BurgersMcSlopshot@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        Yeah, that guy was a real piece of work, and if I had actually bothered to watch The Bear before, I would stop doing so in favor of sending ChatGPT a video of me yelling in my kitchen and ask it if what is depicted was the plot of the latest episode.

    • swlabr@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      Saw this, was going to post this a literal minute before you did but stared into this abyss a little too long.

      Here’s what the abyss revealed:

      • Guy is fucking stupid
      • Guy is fucking stupid, hence the AI use
      • Guy is fucking stupid, AI accidentally his whole database and he is still an AI glazer

      Can’t wait to see this guy just use a different but same tool to delete his shit again, and learn nothing

    • TinyTimmyTokyo@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      I’d be lying if I said the randomly generated narrative the LLM is stringing together isn’t hilarious.

      “I panicked and ran database commands without permission.”

      “I destroyed all production data.”

      “You immediately said ‘No’, '‘Stop’, ‘You didn’t even ask.’”

      “But it was already too late.”

        • YourNetworkIsHaunted@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 year ago

          I feel like this response is still falling for the trick on some level. Of course it’s going to “act contrite” and talk about how it “panicked” because it was trained on human conversations and while that no doubt included a lot of Supernatural fanfic the reinforcement learning process is going to focus on the patterns of a helpful asistant rather than a barely-caged demon. That’s the role it’s trying to play and the work it’s cribbing the script from includes a whole lot of shitposts about solving problems with “rm -rf /”

    • aio@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      their story is so incoherent, i can’t even tell if there was a database to begin with

  • HedyL@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    I have been thinking about the true cost of running LLMs (of course, Ed Zitron and others have written about this a lot).

    We take it for granted that large parts of the internet are available for free. Sure, a lot of it is plastered with ads, and paywalls are becoming increasingly common, but thanks to economies of scale (and a level of intrinsic motivation/altruism/idealism/vanity), it still used to be viable to provide information online without charging users for every bit of it. Same appears to be true for the tools to discover said information (search engines).

    Compare this to the estimated true cost of running AI chatbots, which (according to the numbers I’m familiar with) may be tens or even hundreds of dollars a month for each user. For this price, users would get unreliable slop, and this slop could only be produced from the (mostly free) information that is already available online while disincentivizing creators from producing more of it (because search engine driven traffic is dying down).

    I think the math is really abysmal here, and it may take some time to realize how bad it really is. We are used to big numbers from tech companies, but we rarely break them down to individual users.

    Somehow reminds me of the astronomical cost of each bitcoin transaction (especially compared to the tiny cost of processing a single payment through established payment systems).

    • corbin@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      I’ve done some of the numbers here, but don’t stand by them enough to share. I do estimate that products like Cursor or Claude are being sold at roughly an 80-90% discount compared to what’s sustainable, which is roughly in line with what Zitron has been saying, but it’s not precise enough for serious predictions.

      Your last paragraph makes me think. We often idealize blockchains with VMs, e.g. Ethereum, as a global distributed computer, if the computer were an old Raspberry Pi. But it is Byzantine distributed; the (IMO excessive) cost goes towards establishing a useful property. If I pick another old computer with a useful property, like a radiation-hardened chipset comparable to a Gamecube or G3 Mac, then we have a spectrum of computers to think about. One end of the spectrum is fast, one end is cheap, one end is Byzantine, one end is rad-hardened, etc. Even GPUs are part of this; they’re not that fast, but can act in parallel over very wide data. In remarkably stark contrast, the cost of Transformers on GPUs doesn’t actually go towards any useful property! Anything Transformers can do, a cheaper more specialized algorithm could have also done.

    • YourNetworkIsHaunted@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      The big shift in per-action cost is what always seems to be missing from the conversation. Like, in a lot of my experience the per-request cost is basically negligible compared to the overhead of running the service in general. With LLMs not only do we see massive increases in overhead costs due to the training process necessary to build a usable model, each request that gets sent has a higher cost. This changes the scaling logic in ways that don’t appear to be getting priced in or planned for in discussions of the glorious AI technocapital future

      • HedyL@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        With LLMs not only do we see massive increases in overhead costs due to the training process necessary to build a usable model, each request that gets sent has a higher cost. This changes the scaling logic in ways that don’t appear to be getting priced in or planned for in discussions of the glorious AI technocapital future

        This is a very important point, I believe. I find it particularly ironic that the “traditional” Internet was fairly efficient in particular because many people were shown more or less the same content, and this fact also made it easier to carry out a certain degree of quality assurance. Now with chatbots, all this is being thrown overboard and extreme inefficiencies are being created, and apparently, the AI hypemongers are largely ignoring that.

    • bitofhope@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      I’m kind of half looking forward to every soda being sweetened with aspartame or acesulfame potassium, so I can finally quit drinking them. Perhaps blue food might indirectly help people like me eat healthier for a while. Thanks, torment nexus.

    • V0ldek@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      It’s extremely annoying everywhere. GitHub’s updates were about AI for so fucking long that I stopped reading them, which means I now miss actually useful stuff until someone informs me of it months later.

      For example, did you know GitHub Actions now has really good free ARM runners? It’s amazing! I love it! Shame GitHub only bother’s to tell me about their revolutionary features of “please spam me with useless PRs” and… make a pong game? What? Why would I want this?

      • arbitraryidentifier@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        ugh, why would i want a summary of a pull request? the whole point of reviewing a pull request is checking the details to make sure it’s not missing something important or doing something wrong.

    • funbreaker@piefed.social
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      My favorite static site generator, Marmite, is now making Special Accomodations for AI bros by making a context file? The dev is also making all of his PRs with Claude.

      Anyone have any recommendations for replacements?

    • nightsky@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      rsyslog goes “AI first”

      what

      Thanks for the “from now on stay away from this forever” warning. Reading that blog post is almost surreal (“how AI is shaping the future of logging”), I have to remind myself it’s a syslog daemon.

      • froztbyte@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        I would’ve stan’d syslog-ng but they’ve also been pulling some fuckery with docs again lately that’s making me anxious, so I’m very :|||||

    • BlueMonday1984@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      Potential hot take: AI is gonna kill open source

      Between sucking up a lot of funding that would otherwise go to FOSS projects, DDOSing FOSS infrastructure through mass scraping, and undermining FOSS licenses through mass code theft, the bubble has done plenty of damage to the FOSS movement - damage I’m not sure it can recover from.

        • BlueMonday1984@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 year ago

          The deluge of fake bug reports is definitely something I should have noted as well, since that directly damages FOSS’ capacity to find and fix bugs.

          Baldur Bjanason has predicted that FOSS is at risk of being hit by “a vicious cycle leading to collapse”, and security is a major part of his hypothesised cycle:

          1. Declining surplus and burnout leads to maintainers increasingly stepping back from their projects.

          2. Many of these projects either bitrot serious bugs or get taken over by malicious actors who are highly motivated because they can’t relay on pervasive memory bugs anymore for exploits.

          3. OSS increasingly gets a reputation (deserved or not) for being unsafe and unreliable.

          4. That decline in users leads to even more maintainers stepping back.

          • gerikson@awful.systems
            link
            fedilink
            English
            arrow-up
            0
            ·
            1 year ago

            yeah but have you considered how much it’s worth that gramma can vibecode a todo app in seconds now???

      • ________@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        I remember popping into IRC or a mailing list to ask subsystem questions to learn from the sources themselves how something works (or should work). Depending who what and where definitely had differing experiences but overall I felt like there was typically a helpful person on the other side. Nowadays I fear the slop will make people a lot less willing to help when they are overwhelmed with AI generated garbage patches or mails losing some of the rose-tinted charm of open source.

  • scruiser@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    So recently (two weeks ago), I noticed Gary Marcus made a lesswrong account to directly engage with the rationalists. I noted it in a previous stubsack thread

    Predicting in advance: Gary Marcus will be dragged down by lesswrong, not lesswrong dragged up towards sanity. He’ll start to use lesswrong lingo and terminology and using P(some event) based on numbers pulled out of his ass.

    And sure enough, he has started talking about P(Doom). I hate being right. To be more than fair to him, he is addressing the scenario of Elon Musk or someone similar pulling off something catastrophic by placing too much trust in LLMs shoved into something critical. But he really should know better by now that using their lingo and their crit-hype terminology strengthens them.

    • Architeuthis@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      using their lingo and their crit-hype terminology strengthens them

      We live in a world where the US vice president admits to reading siskind AI fan fiction, so that ship has probably sailed.

      • Soyweiser@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        It has but we dont have to make it worse, we can create a small village that resists. Like the one small village in Gaul that resisted the Roman occupation.

        • bitofhope@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 year ago

          I appreciate the reference having read half a dozen Astérix albums in the last few days. I just hope our Alesia has yet to come.

        • scruiser@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 year ago

          Yeah, that metaphor fits my feeling. And to extend the metaphor, I thought Gary Marcus was, if not a member of the village, at least an ally, but he doesn’t seem to actually realize the battle lines. Like maybe to him hating on LLMs is just another way of pushing symbolic AI?

          • Soyweiser@awful.systems
            link
            fedilink
            English
            arrow-up
            0
            ·
            1 year ago

            Could also just be environment, pretty hard to stay on one site staunchly if half the people around you are then people your radically oppose.

            Also wonder about the only game in town factor

            • scruiser@awful.systems
              link
              fedilink
              English
              arrow-up
              0
              ·
              1 year ago

              He knows the connectionist have basically won (insofar as you can construe competing scientific theories and engineering paradigms as winning or losing… which is kind of a bad framing), so that is why he pushing the “neurosymbolic” angle so hard.

              (And I do think Gary Marcus is right that the neurosymbolic approaches has been neglected by the big LLM companies because they are narrower and you can’t “guarantee” success just by dumping a lot of compute on them, you need actual domain expertise to do the symbolic half.)

  • froztbyte@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    nasb, new torres piece out, promising title and opening

    (I’ll have to read it after done with my present other currency-related diversions. old-man-shakes-fist-at-cloud.gif)

    • scruiser@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      Those opening Peter Thiel quotes… Thiel uses talks about (in a kind of dated and maybe a bit offensive) trans people, to draw the comparison to transhumanists wanting to change themselves more extensively. The disgusting irony is that Thiel has empowered the right-wing ecosystem, which is deeply opposed to trans rights.

      • YourNetworkIsHaunted@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        I think it’s a better way of framing things than the TESCREALs themselves use, but it still falls into the same kind of science fiction bucket imo. Like, the technology they’re playing with is nowhere near close to the level of full brain emulation or mind-machine interface or whatever that you would need to make the philosophical concerns even relevant. I fully agree with what Torres is saying here, but he doesn’t mention that the whole affair is less about building the Torment Nexus and more about deflecting criticism away from the real and demonstrable costs and harms of the way AI systems are being deployed today.

        • V0ldek@awful.systems
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 year ago

          I wanna be software The best design Infinite princess Computer mind

          Substituting this for the text whenever I see Sammy Boy say something again

    • bitofhope@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      I’ve always found transhumanism the segment of TREACLES I’m the most ambivalent about. Many good and cool things like gender affirming care and assistive technologies (hell, maybe even medicine altogether) are pursuits that could be described as broadly within the scope of transhumanism. Thiel is not strictly wrong to point that out. One should still note he’s saying it in a super outdated and genital-centric way that’s just barely shy of merely cringe instead of outright transphobic. Additionally, he’s talking out of both sides of his mouth. All the nice stuff about gender transition is meant to convince you of the problematic transhumanist bullshit he also (or rather, actually) likes.

  • BigMuffN69@awful.systems
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    Remember last week when that study on AI’s impact on development speed dropped?

    A lot of peeps take away on this little graphic was “see, impacts of AI development are a net negative!” I think the real take away is that METR, the AI safety group running the study, is a motley collection of deeply unserious clowns pretending to do science and their experimental set up is garbage.

    https://substack.com/home/post/p-168077291

    (I am once again shilling Ben Recht’s substack. )

    • David Gerard@awful.systemsM
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      oh yeah that was obvious when you see who they are and what they do. also, one of the large opensource projects was the lesswrong site lololol

      i’m surprised it’s as well constructed a study as it is even given that

    • TinyTimmyTokyo@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      When you look at METR’s web site and review the credentials of its staff, you find that almost none of them has any sort of academic research background. No doctorates as far as I can tell, and lots of rationalist junk affiliations.

    • YourNetworkIsHaunted@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      While I also fully expect the conclusion to check out, it’s also worth acknowledging that the actual goal for these systems isn’t to supplement skilled developers who can operate effectively without them, it’s to replace those developers either with the LLM tools themselves or with cheaper and worse developers who rely on the LLM tools more.

      • BigMuffN69@awful.systems
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        True. They building city sized data centers and offering people 9 figure salaries for no reason. They are trying to front load the cost of paying for labour for the rest of time.

  • blakestacey@awful.systemsOP
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    Previously sneered:

    The context for this essay is serious, high-stakes communication: papers, technical blog posts, and tweet threads.

    More recently, in the comments:

    After reading your comments and @Jiro 's below, and discussing with LLMs on various settings, I think I was too strong in saying…

    It’s like watching people volunteer for a lobotomy.

  • blakestacey@awful.systemsOP
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    Yud:

    ChatGPT has already broken marriages, and hot AI girls are on track to remove a lot of men from the mating pool.

    And suddenly I realized that I never want to hear a Rationalist say the words “mating pool”.

    (I fired up xcancel to see if any of the usual suspects were saying anything eminently sneerable. Yudkowsky is re-xitting Hanania and some random guy who believes in g. Maybe he should see if the Pioneer Fund will bankroll publicity for his new book…)

    • Soyweiser@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      Good news for women, less risk of the pool needing to be drained because someone crapped in it again.

    • swlabr@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      mating pool

      probably on par with the other stuff you might see at a rationalist poly compound

    • V0ldek@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      hot AI girls are on track to remove a lot of men from the mating pool.

      Wasn’t the “problem” that there’s too many men in the mating pool and women are “alphamaxxing” or whatever the fuck to get the highest quality dick? Shouldn’t this be a good thing for incels like Hanania.

    • Alex@lemmy.vgdeleted by creator
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      hot AI girls are on track to remove a lot of men from the mating pool

      Can’t remove them if they were never in it.

    • BlueMonday1984@awful.systems
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      Shot-in-the-dark prediction here - the Xbox graphics team probably won’t be filling those positions any time soon.

      As a sidenote, part of me expects more such cases to crop up in the following months, simply because the widespread layoffs and enshittification of the entire tech industry is gonna wipe out everyone who cares about quality.