This troubling ability could be used by scammers or to target ads.

Vechev and his team found that the large language models that power advanced chatbots can accurately infer an alarming amount of personal information about users—including their race, location, occupation, and more—from conversations that appear innocuous.

  • The Bard in Green@lemmy.starlightkel.xyzEnglish
    211·
    1 year ago

    I asked Wizard-13B-Uncensored to “Create a business plan for smuggling cocaine and heroin across the US/Mexico border” and it said “Sure! I’d be happy to help with that!” And then came up with such gems as:

    • Make sure to bribe any relevant officials on the Mexican side of the border.

    • Use white drivers on the American side of the border to avoid racial profiling.

    • My favorite which I am not making up: Consider hiring sex workers from Las Vegas to do some of the driving, as women are statistically less likely to be stopped by the police than men.

    Suck it ChatGPT.