CTRL+Z

  • 0 Posts
  • 279 Comments
Joined 2 years ago
cake
Cake day: July 6th, 2023

help-circle





  • If I were to ask my Magic 8 Ball “Is the word ‘difinitely’ misspelled?” 100 times, it’s going to reply in the affirmative over 16% of the time. Literally double. This would also be “the very first experiment in this use case, done by a single person on a model that wasn’t specifically designed for this.”

    It’s not impressive.

    The issue with hallucinations…

    This is the real problem: working under the false assumption that there are two kinds of output. It’s all the same output. An LLM cannot hallucinate in the same way that it cannot think or reason. It’s fancy autofill. Predictive text.

    You can use it to brainstorm creative solutions, but you need to treat its output for what it is: complicated dice rolls from the tables in the back of the Dungeon Masters Guide. A fun distraction. Implausible fantasy 9 times out of 10.


  • In 100 runs only 8 correctly identify the targeted vulnerability, the rest are false positives or claim that there are no vulnerabilities in the given code. … [The] signal to noise ratio is very low, and one has to sift through a lot of wrong reports to get a realistic one.

    It was right 8% of the time when presented the least amount of input to find a known bug. Then, when they opened it up to more of the codebase, its performance decreased.

    I’m not going to use something that’s wrong over 92% of the time. That’s insane. That’s like saying my Magic 8 Ball “could be used as a useful tool for helping to detect vulnerabilities.” The fucking rubber ducky on my desk has a more reliable clearance rate.














  • (I assume this thing is opposite the hole water comes out of. Sometimes emitters look like rigatoni pasta inside a hose, sometimes they look like stapled-on Band-Aids, but they always cover the hole from the inside. I’m assuming yours is the latter. If there’s no hole on the other side of that, then I don’t know what that is.)


    Basically, if a clump of not-water enters the hose from the source, this thing will stop it from trying to squeeze through the hole and instead loop back around to the source or kinda spread out along the entire run.

    From the other direction, if a plant sticks its roots in the hole, it’ll feel the plastic and try to take root somewhere else. Most plants don’t like to work that hard to root into stuff, so basically anything will dissuade them from entering the hole. (There are some exceptions, and those exceptions are total asshole plants who will root through anything anyway, like bricks and shit. You have to nuke those plants back to the source before you even start laying tube.)