/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>100173514 & >>100166886

►News
>(04/24) Snowflake Arctic Instruct 128x3B MoE released: https://hf.co/Snowflake/snowflake-arctic-instruct
>(04/23) Phi-3 Mini model released: https://hf.co/microsoft/Phi-3-mini-128k-instruct-onnx
>(04/21) Llama3 70B pruned to 42B parameters: https://hf.co/chargoddard/llama3-42b-v0
>(04/18) Llama3 8B, 70B pretrained and instruction-tuned models released: https://llama.meta.com/llama3/
>(04/17) Mixtral-8x22B-Instruct-v0.1 released: https://mistral.ai/news/mixtral-8x22b/

►News Archive: https://rentry.org/lmg-news-archive
►FAQ: https://wikia.schneedc.com
►Glossary: https://rentry.org/lmg-glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png (embed)

►Getting Started
https://rentry.org/llama-mini-guide
https://rentry.org/8-step-llm-guide
https://rentry.org/llama_v2_sillytavern
https://rentry.org/lmg-spoonfeed-guide
https://rentry.org/rocm-llamacpp

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
Chatbot Arena: https://chat.lmsys.org/?leaderboard
Programming: https://hf.co/spaces/bigcode/bigcode-models-leaderboard
Censorship: https://hf.co/spaces/DontPlanToEnd/UGI-Leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler visualizer: https://artefact2.github.io/llm-sampling/index.xhtml

►Text Gen. UI, Inference Engines
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/lmg-anon/mikupad
https://github.com/turboderp/exui
https://github.com/ggerganov/llama.cpp

>UPGRADE & BUILD ADVICE.
Post build list or current specs including MONITOR: https://pcpartpicker.com/
Provide specific use cases.
State BUDGET and COUNTRY or you will NOT be helped.

>UPCOMING
Intel Battlemage (Q3 2024)
RTX 5000 Series (Q4 2024)
Intel Arrow Lake (Q4 2024)

>CPU
Web browsing: i3 12100/5600G
Budget: 12400F/5600
Gaming: 13600KF/7600
High end gaming: 14700K/7800X3D
Workstation: 14700K/7900X
AM4 upgrade: 5600/5800X3D

>COOLER
Arctic Liquid Freezer III
Thermalright Phantom Spirit 120 SE/EVO, Peerless Assassin SE/Assassin Spirit EVO
Scythe Fuma 3 (ITX/>42mm RAM)
AVOID: Dark Rock Pro 4/5, NH-U12A/D15(S)

>MOTHERBOARD
ASRock B650M-HDV/M.2

>RAM
DDR4: 2x16GB 3200CL16. Budget, 2x8GB
DDR5: 2x16GB 6000CL30
Workstation/high end: consider 2x32GB

>SSD (OS drive)
Budget: Crucial P3 Plus, Lexar NM710 (EU)
Mid range: WD SN850X
High end: Sabrent Rocket 5, Samsung 990 Pro

>GPU
1080p: RTX 4070 Super, RX 7700 XT, used RTX 2080 Ti, RX 6650 XT
1440p: RTX 4070 Ti Super, RX 7900 GRE, RX 7800 XT
2160p: RTX 4090, RTX 4080 Super
Workstation: RTX 4000 Series, AVOID: AMD cards

>CASE (from $ to $$$)
mATX: Montech Air 100, Fractal Pop Mini Air, Lian Li O11 Air Mini
ATX: Phanteks XT PRO, Montech AIR 903 Base/MAX, Vetroo AL600, Phanteks XT PRO ULTRA, Lian Li Lancool 216, Lian Li Lancool III
AVOID: 'Silent' cases, fanless cases, 4000D airflow

>PSU
Budget: Gold rated 500-600W PSU
Mid range: ATX 3.0 compliant fully modular gold rated PSU @ 75% max load
High end: Seasonic PRIME TX
AVOID: GAMEMAX
PSU buying guides:
https://hwbusters.com/best_picks/best-atx-v3-0-pcie-5-0-ready-psus-picks-2023-hardware-busters/ (updated for 2024)

>MONITOR
Standout:
1080p: Asus VG249Q1A
1440p: Dell G2724D
2160p: Acer P3biipruzx
https://pcpartpicker.com/list/C9MzL9

>OS
Activate Windows @ >>>/g/fwt

>CASE FANS
Meta: Case with good stock PWM fans
Budget: Arctic P12/P14 Max (5-pack)
High end: Noctua NF-A12x25 PWM

Shenzhen Guangdong pos #187452 edition

How to request advice:
>Budget
>Intended use (media, source, environment)
>Frequency response preference (basshead, female vocal, treble sensitive, etc.)
>Past gear and your thoughts on them

FAQ:
>Where do I buy IEMs?
Amazon, Aliexpress, Linsoul, Hifigo, Shenzhenaudio, Bloom Audio, MusicTeck, Elise Audio (UK)

>Full Guide (IEMs, Cables, Ear Tips, etc.):
https://rentry.org/c8gqc

>Frequency Response Graph Tool
squig.link

>Budget Wire Over-Ear IEMs:
• Tangzu Wan'er S.G (mild V) - $20
• EPZ Q1 Pro (Harman) - $35
• TRN Conch (bright V) - $35
• Simgot EA500LM (bright V) - $90

>Bullet IEMs:
• Tanchjim Zero (bright neutral) - $15
• Final E500 (dark) - $25
• Tanchjim One DSP (neutral) - $30

>Flathead Earbuds:
• Blue Vido (warm) - $5
• RY4S 32Ω mmcx Plus (V-shape) - $10
• Yincrow X6 (warm) - $10

>USB-C DACs:
• Moondrop Dawn Pro - $50
• Tanchjim Space - $90
• Tempotec Sonata BHD Pro - $90
• Qudelix 5K - $110

>PMPs:
• Surfans F20 (Rockbox) - $120
• Shanling M0 Pro - $130
• HiBy M300 - $200
• Hidizs AP80 Pro-X - $200
• Tempotec V3 - $200

Previous thread: >>100138556

FOSS doesn't work because it is literally Communism. There is no mechanism to determine whether or not some product is in demand, and additionally there is no mechanism to reward labor even if demand goes up. This is why so much FOSS isn't that good, since it relies on donations.

Previous: >>100159394

Why aren't you calculating fibonacci(10000000), /g/?

Previous /sdg/ thread : >>100178978

>Beginner UI local install
Fooocus: https://github.com/lllyasviel/fooocus
EasyDiffusion: https://easydiffusion.github.io

>Local install
Automatic1111: https://github.com/automatic1111/stable-diffusion-webui
ComfyUI (Node-based): https://rentry.org/comfyui
AMD GPU: https://rentry.org/sdg-link#amd-gpu
Intel GPU: https://rentry.org/sdg-link#intel-gpu

>Use a VAE if your images look washed out
https://rentry.org/sdvae

>Auto1111 forks
Forge: https://github.com/lllyasviel/stable-diffusion-webui-forge
Anapnoe UX: https://github.com/anapnoe/stable-diffusion-webui-ux
Vladmandic: https://github.com/vladmandic/automatic

>Run cloud hosted instance
https://rentry.org/sdg-link#run-cloud-hosted-instance

>Try online without registration
txt2img: https://www.mage.space
img2img: https://huggingface.co/spaces/huggingface/diffuse-the-rest
Inpainting: https://huggingface.co/spaces/fffiloni/stable-diffusion-inpainting
pixart: https://huggingface.co/spaces/PixArt-alpha/PixArt-Sigma

>Models, LoRAs & embeddings
https://civitai.com
https://huggingface.co
https://rentry.org/embeddings

>Animation
https://rentry.org/AnimAnon
https://rentry.org/AnimAnon-AnimDiff
https://rentry.org/AnimAnon-Deforum

>SDXL info & download
https://rentry.org/sdg-link#sdxl

>Index of guides and other tools
https://codeberg.org/tekakutli/neuralnomicon
https://rentry.org/sdg-link
https://rentry.org/rentrysd

>View and submit GPU performance data
https://docs.getgrist.com/3mjouqRSdkBY/sdperformance
https://vladmandic.github.io/sd-extension-system-info/pages/benchmark.html

>Share image prompt info
4chan removes prompt info from images, share them with the following guide/site...
https://rentry.org/hdgcb
https://catbox.moe

>Related boards
>>>/h/hdg
>>>/e/edg
>>>/d/ddg
>>>/b/degen
>>>/vt/vtai
>>>/aco/sdg
>>>/trash/sdg

Official: discord.gg/stablediffusion

>manufactures and sells their own laptops, desktops, servers, and keyboards
>disables Intel's ME backdoor firmware
>leading the charge in innovating Linux and freeing it from the clutches of people and projects sabotaging and holding Linux back (you know who)
>doing it all in a programming language that fixes all of C/C++'s shortfalls and which stands to become the most dominant programming language of the future, Rust
>picking up where Ubuntu left off to make an OS consumer friendly enough to convince people to ditch Mac and Windows

Name another Linux distro doing more for the Linux community and regular consumers who aren't hardcore hackers. I'll wait.

Holy fuck I hate onedrive. I just lost 10 years of irreplaceable photos and documents because this piece of shit forced itself into my computer, hijacked my Documents, Pictures, Desktop etc folders, copied that shit to their servers and removed my local copies, and then when I deleted their shit, all my shit is gone and the windows file browser is throwing errors whenever I try to open those folders.

it's all fucking gone. I never asked for this shit on my computer, I didn't want it to replace my normal fucking folders with some spyware bullshit, I never wanted fucking anything to do with it but fucking MICROSOFT integrated it into the OS, like cortana and internet explorer, and FUCK YOU if you don't like it. turn it off, it turns back on. forcefully remove it, and it breaks system critical shit.

I have repeatedly disabled onedrive since getting my computer, and when I found a onedrive folder in my user directory while cleaning up files, I deleted it without a second thought. now, it turns out that all my pictures and documents were actually inside that folder, and not in my actual pictures or documents folder.

no, none of it is in the recycle bin on my computer or on onedrive

as for file recovery, it got back about 10% of what I lost. I'm feeling very emotional. fuck this spyware software. microsoft forced this shit onto my computer, stole my files and moved them around without permission, and then fucked me in the ass. holy fuck I'm so mad

How would this fare as an induction cooker? commercial gas ranges are like 160,000 BTUs while induction cookers are 3 kw max which is a measly 12,000 btu.

old >>100105771