I’m currently pulling together a bunch of sources – that are mostly recent – on the topic of LLMs and their use in software development. Some are peer-reviewed studies. Some are i…

studies show a clear trend – output is up (more code, more commits, bigger diffs), but outcomes don’t reflect that trend. If anything, the average team is taking longer to ship worse software

    • WhatAmLemmy@lemmy.worldEnglish
      0·
      17 hours ago

      It’s obvious if you actually use software. I use hundreds of apps across iphone, mac, and linux os’s. Literally none of them have noticeably increased in quality or stability beyond their average from 1-5 years ago.

      Mac and iphone appear to have more bugs and shittier quality control than at any other point in the last decade.

      I notice far more idiocracy-grade errors in digital content, cx, business processes than ever before.

      Auto-generated subtitles are great for content that was never going to receive human attention, but they’re clearly being used to replace humans. At least once a week I notice a major contextual error that completely alters the perception of the line/scene, and there’s no way to submit corrections. Art, culture, and knowledge are being actively corrupted and bastardized.

      • ∃∀λ@programming.dev
        0·
        12 hours ago

        Weather forecasts have gone to dogshit in the last 2 years. Even same-day forecasts can shift on a dime unpredictably. It’s at the point where I check 3 apps. Until this year, I never had a time where I woke up to 0% chance of rain and sunny, then looked outside to see rain. Not a sun shower. A rainy day hour-long downpour.

        Supposing you’re right that weather forecasts have gone to dogshit (I’m skeptical because your evidence is anecdotal), there may be reasons beside AI for that.

        • WhatAmLemmy@lemmy.worldEnglish
          0·
          4 hours ago

          Yeah I was gonna add the weather part could be entirely explained by climate change and fascisms war on science, but forgot. Weather forecasting is actually one area where AI should far exceed what humans could ever possibly achieve without it. It is impossible for humans to process and adapt to the changing patterns across hundreds or thousands of variables interacting with each other in real time.

          I’d never heard of the 5G impact, so thanks for that. I consider it unlikely unless there were a significant change in 5G usage during the last year. 5G has covered most Australian major cities since 2021, and 5g coverage is essentially non-existent outside of populated areas (90% or more of Australia).

        • blarghly@lemmy.worldEnglish
          0·
          11 hours ago

          I was gonna say - the bulk of weather forcasting is done by governments. Commercial weather channels/sites/apps draw from these predictions and give them a nice interface, and sometimes apply some proprietary prediction algorithm (eg, a lot of commercial weather services bump up chance of rain, because people are angrier when it rains when you said it wouldnt, versus doesnt rain when you said it would).

          But I wouldnt expect government forecasts to have changed due to AI tools. Except maybe in the US due to the DOGE debacle - but even then, why fuck with it?

      • Feyd@programming.dev
        0·
        15 hours ago

        Yes it blows my mind everyone can’t see all the historically perfectly fine software starting to crumble to dust