/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>100070066 & >>100070008

►News
>(04/18) Llama 3 8B, 70B pretrained and instruction-tuned models released: https://llama.meta.com/llama3/
>(04/17) Mixtral-8x22B-Instruct-v0.1 released: https://mistral.ai/news/mixtral-8x22b/
>(04/15) Microsoft AI unreleases WizardLM 2: https://web.archive.org/web/20240415221214/https://wizardlm.github.io/WizardLM2/
>(04/09) Mistral releases Mixtral-8x22B: https://twitter.com/MistralAI/status/1777869263778291896
>(04/09) Llama 3 coming in the next month: https://techcrunch.com/2024/04/09/meta-confirms-that-its-llama-3-open-source-llm-is-coming-in-the-next-month/

►FAQ: https://wikia.schneedc.com
►Glossary: https://archive.today/E013q | https://rentry.org/local_llm_glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/llama-mini-guide
https://rentry.org/8-step-llm-guide
https://rentry.org/llama_v2_sillytavern
https://rentry.org/lmg-spoonfeed-guide
https://rentry.org/rocm-llamacpp

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
General Purpose:
https://hf.co/spaces/HuggingFaceH4/open_llm_leaderboard
https://hf.co/spaces/lmsys/chatbot-arena-leaderboard
Programming: https://hf.co/spaces/bigcode/bigcode-models-leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler visualizer: https://artefact2.github.io/llm-sampling/index.xhtml

►Text Gen. UI, Inference Engines
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/lmg-anon/mikupad
https://github.com/turboderp/exui
https://github.com/ggerganov/llama.cpp

Opinions on my new PC case?

Previous /sdg/ thread : >>100072951

>Beginner UI local install
Fooocus: https://github.com/lllyasviel/fooocus
EasyDiffusion: https://easydiffusion.github.io

>Local install
Automatic1111: https://github.com/automatic1111/stable-diffusion-webui
ComfyUI (Node-based): https://rentry.org/comfyui
AMD GPU: https://rentry.org/sdg-link#amd-gpu
Intel GPU: https://rentry.org/sdg-link#intel-gpu

>Use a VAE if your images look washed out
https://rentry.org/sdvae

>Auto1111 forks
Forge: https://github.com/lllyasviel/stable-diffusion-webui-forge
Anapnoe UX: https://github.com/anapnoe/stable-diffusion-webui-ux
Vladmandic: https://github.com/vladmandic/automatic

>Run cloud hosted instance
https://rentry.org/sdg-link#run-cloud-hosted-instance

>Try online without registration
txt2img: https://www.mage.space
img2img: https://huggingface.co/spaces/huggingface/diffuse-the-rest
Inpainting: https://huggingface.co/spaces/fffiloni/stable-diffusion-inpainting
pixart: https://huggingface.co/spaces/PixArt-alpha/PixArt-Sigma

>Models, LoRAs & embeddings
https://civitai.com
https://huggingface.co
https://rentry.org/embeddings

>Animation
https://rentry.org/AnimAnon
https://rentry.org/AnimAnon-AnimDiff
https://rentry.org/AnimAnon-Deforum

>SDXL info & download
https://rentry.org/sdg-link#sdxl

>Index of guides and other tools
https://codeberg.org/tekakutli/neuralnomicon
https://rentry.org/sdg-link
https://rentry.org/rentrysd

>View and submit GPU performance data
https://docs.getgrist.com/3mjouqRSdkBY/sdperformance
https://vladmandic.github.io/sd-extension-system-info/pages/benchmark.html

>Share image prompt info
4chan removes prompt info from images, share them with the following guide/site...
https://rentry.org/hdgcb
https://catbox.moe

>Related boards
>>>/h/hdg
>>>/e/edg
>>>/d/ddg
>>>/b/degen
>>>/vt/vtai
>>>/aco/sdg
>>>/trash/sdg

Official: discord.gg/stablediffusion

Mad about you edition

previous: >>99955288

READ THE WIKI! & help by contributing:
https://wiki.installgentoo.com/wiki/Home_server

>NAS Case Guide. Feel free to add to it:
https://wiki.installgentoo.com/wiki/Home_server/Case_guide

/hsg/ is about learning and expanding your horizons. Know all about NAS? Learn virtualization. Spun up some VMs? Learn about networking by standing up a OPNsense/PFsense box and configuring some VLANs. There's always more to learn and chances to grow. Think you’re god-tier already? Setup OpenStack and report back.

>What software should I run?
Install Gentoo. Or whatever flavor of *nix is best for the job or most comfy for you. Jellyfin/Emby/Plex to replace Netflix, Nextcloud to replace Googlel, Ampache/Navidrome to replace Spotify, the list goes on. Look at the awesome self-hosted list and ask.

>Why should I have a home server?
/hsg/ is about learning and expanding your horizons. De-botnet your life. Learn something new. Serving applications to yourself, your family, and your frens feels good. Put your tech skills to good use for yourself and those close to you. Store their data with proper availability redundancy and backups and serve it back to them with a /comfy/ easy to use interface.

>Links & resources
Cool stuff to host: https://gitlab.com/awesome-selfhosted/awesome-selfhosted
RouterOS's: https://wiki.installgentoo.com/wiki/Home_server#Custom
https://reddit.com/r/datahoarder
https://www.labgopher.com
https://www.reddit.com/r/homelab/wiki/index
https://wiki.debian.org/FreedomBox/Features
List of ARM-based SBCs: https://docs.google.com/spreadsheets/d/1PGaVu0sPBEy5GgLM8N-CvHB2FESdlfBOdQKqLziJLhQ
Low-power x86 systems: https://docs.google.com/spreadsheets/d/1LHvT2fRp7I6Hf18LcSzsNnjp10VI-odvwZpQZKv_NCI
Cheap disks: https://shucks.top/ & https://diskprices.com/

Remember:
RAID protects you from DOWNTIME
BACKUPS protect you from DATA LOSS

okay, tell me what's bad about PHP 7.4+
protip: you can't

and you can't mention flaws of older versions

PS. you want hardcore difficulty: tell me flaws of PHP 8.2+

Why can no one figure out auto correct? It’s been 15 FUCKING YEARS and it’s still just as bad as day one.

These retards really think ai will control the world and they can’t even fix a typo

Users of all levels are welcome to ask questions about GNU/Linux and share their experiences.

*** Please be civil, notice the "Friendly" in every Friendly GNU/Linux Thread ***

Before asking for help, please check our list of resources.

If you would like to try out GNU/Linux you can do one of the following:
0) Install a GNU/Linux distribution of your choice in a Virtual Machine.
1) Use a live image and to boot directly into the GNU/Linux distribution without installing anything.
2) Dual boot the GNU/Linux distribution of your choice along with Windows or macOS.
3) Go balls deep and replace everything with GNU/Linux.

Resources: Please spend at least a minute to check a web search engine with your question.
*Many free software projects have active mailing lists.

$ man %command%
$ info %command%
$ %command% -h/--help
$ help %builtin/keyword%

Don't know what to look for?
$ apropos %something%

Check the Wikis (most troubleshoots work for all distros):
https://wiki.archlinux.org
https://wiki.gentoo.org

/g/'s Wiki on GNU/Linux:
https://wiki.installgentoo.com/index.php/Category:GNU/Linux

>What distro should I choose?
https://wiki.installgentoo.com/index.php/Babbies_First_Linux
>What are some cool programs?
https://wiki.archlinux.org/index.php/list_of_applications
https://directory.fsf.org/wiki/Main_Page
>What are some cool terminal commands?
https://www.commandlinefu.com/commands/browse
https://cheat.sh/
>Where can I learn the command line?
https://mywiki.wooledge.org/BashGuide
https://www.grymoire.com/Unix/
>Where can I learn more about Free Software?
https://www.gnu.org/philosophy/philosophy.html
>How to break out of the botnet?
https://prism-break.org/en/categories/gnu-linux

/fglt/'s website and copypasta collection:
https://fglt.nl && https://p.teknik.io/wJ9Zy

/t/'s GNU/Linux Games: >>>/t/1175569

IRC: #sqt on Libera.Chat
https://fglt.nl/irc.html

Previous thread: >>100046268

Why has there been a rise in people deliberately cutting fiber optic cables across US

Everything is already from China, but in here we discuss the cheap chink shit you see on various sites.

Useful links
>New guide (WIP): https://csg-guide.neocities.org/
>installgentoo wiki: https://wiki.installgentoo.com/wiki/Chink_shit_general
>NEW GUIDE (WORK IN PROGRESS, USUALLY TRASH): https://pad.disroot.org/p/ZxYEUYubPTPDhsEkKobh
>Mergeboss links (Click 3, post yours): https://pad.disroot.org/p/%2Fcsg%2F_ali_game

>What headphones/earbuds should I buy?
>>>/g/iemg
>I want a cheap smartphone what should I buy?
>>>/g/spg/
>I want to buy some sort of emulation device
>>>/vr/hhg/

News!
>>100025265 We discuss zoomers and LEDs
>>100026277 Discussion about tooth whiteners and chink quackery
>>100027094 Anon doesn't know about reverse image search
>>100028427 We discuss blue LEDs and sleep
>>100028959 Anon's $8 cancer tablet case arrived, despite delays to the rest of his order, which he later reviews >>100068942
>>100030857 >What ever happened to partial refunds without returning?
>>100038465 Anon asks for controller recommendations
>>100042373 Anon's $6 order arrives
>>100044346 Anon is confused by how the algorithm works
>>100045138 New policy for delayed orders
>>100045309 Anon buys a Chinesium grater
>>100046948 Outdoor anon's order arrives
>>100047641 Anon asks for advice when buying a powerbank
>>100051121 types of "biodegradable" plastics
>>100054614 Anon's sounding device arrived
>>100056592 towel review
>>100056907 Soldering iron recommendations
>>100063413 Anon buys chink waifu RAM
>>100063618 Do chink sound isolation plates actually work?

Previous: >>100025070

I'm about to buy this monitor, because after 10 years, my monitor has broken down.
>OLED
>1440p
>360 Hz
>900 bucks

Should I do it? The alternative is the MSI MPG 271QRX.