• eRac@lemmings.world
    link
    fedilink
    arrow-up
    9
    ·
    4 months ago

    Generative AI doesn’t get any training in use. The explosion in public AI offerings falls into three categories:

    1. Saves the company labor by replacing support staff
    2. Used to entice users by offering features competitors lack (or as catch-up after competitors have added it for this reason)
    3. Because AI is the current hot thing that gets investors excited

    To make a good model you need two things:

    1. Clean data that is tagged in a way that allows you to grade model performance
    2. Lots of it

    User data might meet need 2, but it fails at need 1. Running random data through neural networks to make it more exploitable (more accurate interest extraction, etc) makes sense, but training on that data doesn’t.

    This is clearly demonstrated by Google’s search AI, which learned lots of useful info from Reddit but also learned absurd lies with the same weight. Not just overtuned-for-confidence lies, straight up glue-the-cheese-on lies.

    • sunzu@kbin.run
      link
      fedilink
      arrow-up
      1
      ·
      4 months ago

      Thank you for explaining this.

      Ok so what is ChatGPT angle here providing this services for “free”

      What do they get out of it? or is this just a google play to get you in the door, then data mine?

      • eRac@lemmings.world
        link
        fedilink
        arrow-up
        4
        ·
        4 months ago

        They have two avenues to make money:

        1. Sell commercial services such as customer support bots. They get customers thanks to the massive buzz their free services generated.
        2. Milking investors, the real way to make money.