• 1 Post
  • 7 Comments
Joined 1 year ago
cake
Cake day: June 15th, 2023

help-circle
  • Not really. The money is going to American workers producing military hardware. Most of that is the US upgrading to new equipment and giving away the old for a low price.

    This sounds like right wing fox news style nonsense IMO.

    When an authoritarian dictator invades a foreign country, there is one giant overwhelming lesson about what happens when others act passively or appease the criminal. This simple fact should slap anyone a hundred miles down the road for suggesting appeasement is a sound policy. This only ends with the end if Putin, much like the Nazis only ended with the end of Hitler. Anything less will result in WW3 as a guaranteed outcome. It will be more one sided. The entire Russian GDP is less than just the state of Texas. But it will be nuclear and era ending, likely with the majority of surviving humanity in the southern hemisphere.

    If anything, we should be giving Ukraine absolutely anything they want right now. Let them win before we have to go over there and start dying to stop Putin somewhere halfway across Europe. Putin has proven he will never stop trying to conquer. He is the new Hitler. He keeps power by force and what he has called ‘convenient idiots’ that follow whatever misinformation they are given. It is a propaganda misdirection scheme to talk about things out of context like saying military spending in Ukraine is somehow on the US tax payer. This is completely wrong and intended to provoke people that can’t look at an issue and think for longer than the headline.



  • Endless Sky. The save game is a text file. Save a file on the mobile app (F-Droid), and on the PC (Flatpak), and note the last line. This is the line you must swap to transfer the save file. It is the first game I have played on both practically. The game mechanics are different between the two and you need to alter your strategy accordingly. On mobile, I travel with a ship setup for boarding pirate vessels and never target enemies directly; all of my guns are automatic turrets. I just use a fast ship and travel with a large group of fighters. It is more of a grind on mobile, but it can be used to build up resources and reserves. The game is much bigger than it first appears to be. You need to either check out a guide or explore very deep into the obscure pockets of the map.



  • I won’t touch the proprietary junk. Big tech “free” usually means street corner data whore. I have a dozen FOSS models running offline on my computer though. I also have text to image, text to speech, am working on speech to text, and probably my ironman suit after that.

    These things can’t be trusted though. It is just a next word statistical prediction system combined with a categorization system. There are ways to make an LLM trustworthy, but it involves offline databases and prompting for direct citations, these are different from Chat prompt structures.


  • Oobabooga is the main GUI used to interact with models.

    https://github.com/oobabooga/text-generation-webui

    FYI, you need to find checkpoint models. In the available chat models space, naming can be ambiguous for a few reasons I’m not going to ramble about here. The main source of models is Hugging Face. Start with this model (or get the censored version):

    https://huggingface.co/TheBloke/llama2_7b_chat_uncensored-GGML

    First, let’s break down the title.

    • This is a model based in Meta’s Llama2.
    • This is not “FOSS” in the GPL/MIT type of context. This model has a license that is quite broad in scope with the key point stipulating it can not be used commercially for apps that have more than 700 million users.
    • Next, it was quantized by a popular user going by “The Bloke.” I have no idea who this is IRL but I imagine this is a pseudonym or corporate alias given how much content is uploaded by this account on HF.
    • This model is based on a 7 Billion parameter dataset, and is fine tuned for chat applications.
    • This is uncensored meaning it will respond to most inputs as best it can. It can get NSFW, or talk about almost anything. In practice there are still some minor biases that are likely just over arching morality inherent to the datasets used, or it might be coded somewhere obscure.
    • Last part of the title is that this is a GGML model. This means it can run on CPU or GPU or a split between the two.

    As for options on the landing page or “model card”

    • you need to get one of the older style models that have “q(numb)” as the quantization type. Do not get the ones that say “qK” as these won’t work with the llama.cpp file you will get with Oobabooga.
    • look at the guide at the bottom of the model card where it tells you how much ram you need for each quantization type. If you have a Nvidia GPU with the CUDA API, enabling GPU layers makes the model run faster, and with quite a bit less system memory from what is stated on the model card.

    The 7B models are about like having a conversation with your average teenager. Asking technical questions yielded around 50% accuracy in my experience. A 13B model got around 80% accuracy. The 30B WizardLM is around 90-95%. I’m still working on trying to get a 70B running on my computer. A lot of the larger models require compiling tools from source. They won’t work directly with Oobabooga.