/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>100150326 & >>100145958

►News
>(04/23) Phi-3 Mini model released: https://hf.co/microsoft/Phi-3-mini-128k-instruct-onnx
>(04/21) Llama3 70B pruned to 42B parameters: https://hf.co/chargoddard/llama3-42b-v0
>(04/18) Llama3 8B, 70B pretrained and instruction-tuned models released: https://llama.meta.com/llama3/
>(04/17) Mixtral-8x22B-Instruct-v0.1 released: https://mistral.ai/news/mixtral-8x22b/
>(04/15) Microsoft AI unreleases WizardLM 2: https://web.archive.org/web/20240415221214/https://wizardlm.github.io/WizardLM2/
>(04/09) Mistral releases Mixtral-8x22B: https://twitter.com/MistralAI/status/1777869263778291896

►FAQ: https://wikia.schneedc.com
►Glossary: https://archive.today/E013q | https://rentry.org/local_llm_glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/llama-mini-guide
https://rentry.org/8-step-llm-guide
https://rentry.org/llama_v2_sillytavern
https://rentry.org/lmg-spoonfeed-guide
https://rentry.org/rocm-llamacpp

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
Chatbot Arena: https://chat.lmsys.org/?leaderboard
Programming: https://hf.co/spaces/bigcode/bigcode-models-leaderboard
Censorship: https://hf.co/spaces/DontPlanToEnd/UGI-Leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler visualizer: https://artefact2.github.io/llm-sampling/index.xhtml

►Text Gen. UI, Inference Engines
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/lmg-anon/mikupad
https://github.com/turboderp/exui
https://github.com/ggerganov/llama.cpp

Long story short because of my life situation I have acces to over 18 zoomers like a lot.

Here are the results of my zoomer project
Case of the 2 cavemen zoomers

Be me
2 zoomers get interested in my gaming laptop since they do not recognize the desktop (it is linux mint)
I decide to bait them. And simply create an account for them so they can literally do whatever they want.

Zoomer1
>What is this?

ME
>I do not know you tell me smug_face.jpg

Zoomer1
>It is linux

Me:
>I do not know is it?!smug_face.jpg You tell me.

Zoomer clicks around does not even exist the desktop or anything.

Not acceding local files or folders.

Zoomer finds chromium, clicks it.
Zoomer complains that it uses start page on google.
I show him brave who uses google as the search engine.

Zoomer has no idea what to do.
I encourage him more
>You have a entire computer to you, what will you do?
Literally can not search in google or on youtube.

I click YouTube and search for cats.
I encourage him more to use the computer.
Zoomer literally has no idea what to do.

I go back to the computer.
And see the zoomers using their phones.
>Hey what are you doing ^.^

Zoomer1
>Looking at reddit

Me:
>Why not do it on the computer

Zoomer1
>You know on phone it is better

I'm visually shocked

ME:
>How is it better?!?!?!

Zoomer1
>You know

ME:
>No I do not.

Roomer
>Phones are mobile and you can take them with you

Keep in mind this is with them talking about a gaming laptop.

Not only this however I know for a fact these zoomers literally drive to work, go back home and then sit on their asses at home.

In 90% of use cases the portability is meaningless.

Either way they rather torture themselves with a phone.
Zoomers are brain damaged. This is what happens if you do not outlaw phones to everyone under 18.

/aicg/ - A general dedicated to the discussion and development of AI chatbots

despniggable me edition

>News
llama 3 8b and 70b https://llama.meta.com/llama3/, among other developments in local
opus on aws https://aws.amazon.com/blogs/aws/anthropics-claude-3-opus-model-on-amazon-bedrock/
gpt-4-turbo finally out of preview, not as fucked as the last preview snapshot
https://platform.openai.com/docs/models/gpt-4-turbo-and-gpt-4
news: https://rentry.org/aicg_chronicles
additional info: https://rentry.org/aicg_extra_information

>Bots
https://chub.ai
https://chub-archive.evulid.cc
https://booru.plus/+pygmalion
https://rentry.org/meta_bot_list

>Guides
https://rentry.org/tavern4retards

>Jailbreaks
https://rentry.org/jb-listing

>Frontends
https://sillytavern.app [SillyTavern]
https://agnai.chat [Agnai]
https://risuai.xyz [RisuAI]
https://docs.miku.gg [Miku]
https://character.ai [Cai]

>Models
gpt: https://platform.openai.com/docs
claude: https://docs.anthropic.com
gemini: https://ai.google.dev/docs
local: >>>/g/lmg
https://rentry.org/meta_golocal_list

>Botmaking
https://rentry.org/meta_botmaking_list
https://desune.moe/aichared
https://agnai.chat/editor

>Meta
OP templates: https://rentry.org/aicgOP
services assessment: https://rentry.org/aicg_meta
fun JBs and prompts: https://rentry.org/weirdbutfunjailbreaksandprompts - https://rentry.org/jinxbreaks
sultra: https://github.com/kingbased/gemini
logs: https://chatlogs.neocities.org
aicg botmaking events: https://rentry.org/meta_event_list

prev: >>100150070

FEDORA 40 IS UP
https://www.phoronix.com/news/Fedora-40-Available
https://fedoraproject.org/

TikTok is now officially banned

The only non US social media competition has been barred from operating in US

is Qubes OS good? on one hand seems comfy to be able to easily run code in separated virtualized enviroments, i have to work in many projects and it's annoying setting up safe separated environments for each one so i don't mix it with my stuff. on the other hand Qubes OS seems to be full of women, pronouns, and trannies which makes it suspicious

Love edition

Previous: >>100090335

READ THE WIKI! & help by contributing:
https://wiki.installgentoo.com/wiki/Home_server

>NAS Case Guide. Feel free to add to it:
https://wiki.installgentoo.com/wiki/Home_server/Case_guide

/hsg/ is about learning and expanding your horizons. Know all about NAS? Learn virtualization. Spun up some VMs? Learn about networking by standing up a OPNsense/PFsense box and configuring some VLANs. There's always more to learn and chances to grow. Think you’re god-tier already? Setup OpenStack and report back.

>What software should I run?
Install Gentoo. Or whatever flavor of *nix is best for the job or most comfy for you. Jellyfin/Emby/Plex to replace Netflix, Nextcloud to replace Googlel, Ampache/Navidrome to replace Spotify, the list goes on. Look at the awesome self-hosted list and ask.

>Why should I have a home server?
/hsg/ is about learning and expanding your horizons. De-botnet your life. Learn something new. Serving applications to yourself, your family, and your frens feels good. Put your tech skills to good use for yourself and those close to you. Store their data with proper availability redundancy and backups and serve it back to them with a /comfy/ easy to use interface.

>Links & resources
Cool stuff to host: https://gitlab.com/awesome-selfhosted/awesome-selfhosted
RouterOS's: https://wiki.installgentoo.com/wiki/Home_server#Custom
https://reddit.com/r/datahoarder
https://www.labgopher.com
https://www.reddit.com/r/homelab/wiki/index
https://wiki.debian.org/FreedomBox/Features
List of ARM-based SBCs: https://docs.google.com/spreadsheets/d/1PGaVu0sPBEy5GgLM8N-CvHB2FESdlfBOdQKqLziJLhQ
Low-power x86 systems: https://docs.google.com/spreadsheets/d/1LHvT2fRp7I6Hf18LcSzsNnjp10VI-odvwZpQZKv_NCI
Cheap disks: https://shucks.top/ & https://diskprices.com/

Remember:
RAID protects you from DOWNTIME
BACKUPS protect you from DATA LOSS

https://www.youtube.com/watch?v=TC57G7QUoBs

Phones will rot the brain of children.
Stop giving phones to children.

Previous /sdg/ thread : >>100153234

>Beginner UI local install
Fooocus: https://github.com/lllyasviel/fooocus
EasyDiffusion: https://easydiffusion.github.io

>Local install
Automatic1111: https://github.com/automatic1111/stable-diffusion-webui
ComfyUI (Node-based): https://rentry.org/comfyui
AMD GPU: https://rentry.org/sdg-link#amd-gpu
Intel GPU: https://rentry.org/sdg-link#intel-gpu

>Use a VAE if your images look washed out
https://rentry.org/sdvae

>Auto1111 forks
Forge: https://github.com/lllyasviel/stable-diffusion-webui-forge
Anapnoe UX: https://github.com/anapnoe/stable-diffusion-webui-ux
Vladmandic: https://github.com/vladmandic/automatic

>Run cloud hosted instance
https://rentry.org/sdg-link#run-cloud-hosted-instance

>Try online without registration
txt2img: https://www.mage.space
img2img: https://huggingface.co/spaces/huggingface/diffuse-the-rest
Inpainting: https://huggingface.co/spaces/fffiloni/stable-diffusion-inpainting
pixart: https://huggingface.co/spaces/PixArt-alpha/PixArt-Sigma

>Models, LoRAs & embeddings
https://civitai.com
https://huggingface.co
https://rentry.org/embeddings

>Animation
https://rentry.org/AnimAnon
https://rentry.org/AnimAnon-AnimDiff
https://rentry.org/AnimAnon-Deforum

>SDXL info & download
https://rentry.org/sdg-link#sdxl

>Index of guides and other tools
https://codeberg.org/tekakutli/neuralnomicon
https://rentry.org/sdg-link
https://rentry.org/rentrysd

>View and submit GPU performance data
https://docs.getgrist.com/3mjouqRSdkBY/sdperformance
https://vladmandic.github.io/sd-extension-system-info/pages/benchmark.html

>Share image prompt info
4chan removes prompt info from images, share them with the following guide/site...
https://rentry.org/hdgcb
https://catbox.moe

>Related boards
>>>/h/hdg
>>>/e/edg
>>>/d/ddg
>>>/b/degen
>>>/vt/vtai
>>>/aco/sdg
>>>/trash/sdg

Official: discord.gg/stablediffusion

Microsoft products are dangerous for our democracy. How do we fix this?