/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>100027884 & >>100024636

►News
>(04/15) Microsoft AI unreleases WizardLM 2: https://web.archive.org/web/20240415221214/https://wizardlm.github.io/WizardLM2/
>(04/09) Mistral releases Mixtral-8x22B: https://twitter.com/MistralAI/status/1777869263778291896
>(04/09) Llama 3 coming in the next month: https://techcrunch.com/2024/04/09/meta-confirms-that-its-llama-3-open-source-llm-is-coming-in-the-next-month/
>(04/08) StableLM 2 12B released https://huggingface.co/stabilityai/stablelm-2-12b
>(04/05) Qwen1.5-32B released with GQA: https://huggingface.co/Qwen/Qwen1.5-32B

►FAQ: https://wikia.schneedc.com
►Glossary: https://archive.today/E013q | https://rentry.org/local_llm_glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/llama-mini-guide
https://rentry.org/8-step-llm-guide
https://rentry.org/llama_v2_sillytavern
https://rentry.org/lmg-spoonfeed-guide
https://rentry.org/rocm-llamacpp

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
General Purpose:
https://hf.co/spaces/HuggingFaceH4/open_llm_leaderboard
https://hf.co/spaces/lmsys/chatbot-arena-leaderboard
Programming: https://hf.co/spaces/bigcode/bigcode-models-leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler visualizer: https://artefact2.github.io/llm-sampling/index.xhtml

►Text Gen. UI, Inference Engines
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/lmg-anon/mikupad
https://github.com/turboderp/exui
https://github.com/ggerganov/llama.cpp

Previous /sdg/ thread : >>100026082

>Beginner UI local install
Fooocus: https://github.com/lllyasviel/fooocus
EasyDiffusion: https://easydiffusion.github.io

>Local install
Automatic1111: https://github.com/automatic1111/stable-diffusion-webui
ComfyUI (Node-based): https://rentry.org/comfyui
AMD GPU: https://rentry.org/sdg-link#amd-gpu
Intel GPU: https://rentry.org/sdg-link#intel-gpu

>Use a VAE if your images look washed out
https://rentry.org/sdvae

>Auto1111 forks
Forge: https://github.com/lllyasviel/stable-diffusion-webui-forge
Anapnoe UX: https://github.com/anapnoe/stable-diffusion-webui-ux
Vladmandic: https://github.com/vladmandic/automatic

>Run cloud hosted instance
https://rentry.org/sdg-link#run-cloud-hosted-instance

>Try online without registration
txt2img: https://www.mage.space
img2img: https://huggingface.co/spaces/huggingface/diffuse-the-rest
Inpainting: https://huggingface.co/spaces/fffiloni/stable-diffusion-inpainting

>Models, LoRAs & embeddings
https://civitai.com
https://huggingface.co
https://rentry.org/embeddings

>Animation
https://rentry.org/AnimAnon
https://rentry.org/AnimAnon-AnimDiff
https://rentry.org/AnimAnon-Deforum

>SDXL info & download
https://rentry.org/sdg-link#sdxl

>Index of guides and other tools
https://codeberg.org/tekakutli/neuralnomicon
https://rentry.org/sdg-link
https://rentry.org/rentrysd

>View and submit GPU performance data
https://docs.getgrist.com/3mjouqRSdkBY/sdperformance
https://vladmandic.github.io/sd-extension-system-info/pages/benchmark.html

>Share image prompt info
4chan removes prompt info from images, share them with the following guide/site...
https://rentry.org/hdgcb
https://catbox.moe

>Related boards
>>>/h/hdg
>>>/e/edg
>>>/d/ddg
>>>/b/degen
>>>/vt/vtai
>>>/aco/sdg
>>>/trash/sdg

Official: discord.gg/stablediffusion

Previously >>99986315
What are you working on?

500 days of summer edition

previous: >>99939336

READ THE WIKI! & help by contributing:
https://wiki.installgentoo.com/wiki/Home_server

>NAS Case Guide. Feel free to add to it:
https://wiki.installgentoo.com/wiki/Home_server/Case_guide

/hsg/ is about learning and expanding your horizons. Know all about NAS? Learn virtualization. Spun up some VMs? Learn about networking by standing up a OPNsense/PFsense box and configuring some VLANs. There's always more to learn and chances to grow. Think you’re god-tier already? Setup OpenStack and report back.

>What software should I run?
Install Gentoo. Or whatever flavor of *nix is best for the job or most comfy for you. Jellyfin/Emby/Plex to replace Netflix, Nextcloud to replace Googlel, Ampache/Navidrome to replace Spotify, the list goes on. Look at the awesome self-hosted list and ask.

>Why should I have a home server?
/hsg/ is about learning and expanding your horizons. De-botnet your life. Learn something new. Serving applications to yourself, your family, and your frens feels good. Put your tech skills to good use for yourself and those close to you. Store their data with proper availability redundancy and backups and serve it back to them with a /comfy/ easy to use interface.

>Links & resources
Cool stuff to host: https://gitlab.com/awesome-selfhosted/awesome-selfhosted
RouterOS's: https://wiki.installgentoo.com/wiki/Home_server#Custom
https://reddit.com/r/datahoarder
https://www.labgopher.com
https://www.reddit.com/r/homelab/wiki/index
https://wiki.debian.org/FreedomBox/Features
List of ARM-based SBCs: https://docs.google.com/spreadsheets/d/1PGaVu0sPBEy5GgLM8N-CvHB2FESdlfBOdQKqLziJLhQ
Low-power x86 systems: https://docs.google.com/spreadsheets/d/1LHvT2fRp7I6Hf18LcSzsNnjp10VI-odvwZpQZKv_NCI
Cheap disks: https://shucks.top/ & https://diskprices.com/

Remember:
RAID protects you from DOWNTIME
BACKUPS protect you from DATA LOSS

I will be honest, I never liked Codes of Conduct (CoCs) but this profound perspective really got me thinking: Was I wrong?
What do you think, /g/?

Comfy dev edition

/gedg/ Wiki: https://wiki.installgentoo.com/wiki/Gedg
IRC: irc.rizon.net #/g/gedg
Progress Day: https://rentry.org/gedg-jams
/gedg/ Compendium: https://rentry.org/gedg
/agdg/: >>>/vg/agdg
previous: https://desuarchive.org/g/thread/99939716/#99939716

Requesting Help
-Problem Description: Clearly explain the issue you're facing, providing context and relevant background information.
-Relevant Code or Content: If applicable, include relevant code, configuration, or content related to your question. Use code tags.

/aicg/ - A general dedicated to the discussion and development of AI chatbots

Second Best Squid Sister edition!

>News
Opus comes to AWS: https://aws.amazon.com/blogs/aws/anthropics-claude-3-opus-model-on-amazon-bedrock/
gpt-4-turbo finally out of preview, not as fucked as the last preview snapshot
https://platform.openai.com/docs/models/gpt-4-turbo-and-gpt-4
gemini-1.5-pro is available to everyone, via API (turn off streaming if you're having filter errors) https://developers.googleblog.com/2024/04/gemini-15-pro-in-public-preview-with-new-features.html

additional info: https://rentry.org/aicg_extra_information
lore: https://rentry.org/aicg_chronicles

>Bots
https://chub.ai
https://chub-archive.evulid.cc
https://rentry.org/meta_bot_list
https://booru.plus/+pygmalion

>Frontends
https://sillytavern.app [SillyTavern]
https://agnai.chat [Agnai]
https://risuai.xyz [RisuAI]
https://docs.miku.gg [Miku]
https://character.ai [CAI]

>Botmaking
https://rentry.org/meta_botmaking_list
https://desune.moe/aichared
https://agnai.chat/editor

>Guides
https://rentry.org/tavern4retards

>Jailbreaks
https://rentry.org/jb-listing

>Models
claude: https://docs.anthropic.com
gpt: https://platform.openai.com/docs
gemini: https://ai.google.dev/docs
local: >>>/g/lmg
https://rentry.org/meta_golocal_list

>Meta
OP templates: https://rentry.org/aicgOP
services assessment: https://rentry.org/aicg_meta
fun JBs and prompts: https://rentry.org/weirdbutfunjailbreaksandprompts - https://rentry.org/jinxbreaks
sultra: https://github.com/kingbased/gemini
logs: https://chatlogs.neocities.org
aicg botmaking events: https://rentry.org/meta_event_list

Previous: >>100032249

My favorite YouTube channel. I learn while masturbating

I still don't know why people still use social media at all. Everything except 4chan fucking sucks. and 4chan is not that good either

Revanced bros... I don't feel so good