/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>100150326 & >>100145958

►News
>(04/23) Phi-3 Mini model released: https://hf.co/microsoft/Phi-3-mini-128k-instruct-onnx
>(04/21) Llama3 70B pruned to 42B parameters: https://hf.co/chargoddard/llama3-42b-v0
>(04/18) Llama3 8B, 70B pretrained and instruction-tuned models released: https://llama.meta.com/llama3/
>(04/17) Mixtral-8x22B-Instruct-v0.1 released: https://mistral.ai/news/mixtral-8x22b/
>(04/15) Microsoft AI unreleases WizardLM 2: https://web.archive.org/web/20240415221214/https://wizardlm.github.io/WizardLM2/
>(04/09) Mistral releases Mixtral-8x22B: https://twitter.com/MistralAI/status/1777869263778291896

►FAQ: https://wikia.schneedc.com
►Glossary: https://archive.today/E013q | https://rentry.org/local_llm_glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/llama-mini-guide
https://rentry.org/8-step-llm-guide
https://rentry.org/llama_v2_sillytavern
https://rentry.org/lmg-spoonfeed-guide
https://rentry.org/rocm-llamacpp

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
Chatbot Arena: https://chat.lmsys.org/?leaderboard
Programming: https://hf.co/spaces/bigcode/bigcode-models-leaderboard
Censorship: https://hf.co/spaces/DontPlanToEnd/UGI-Leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler visualizer: https://artefact2.github.io/llm-sampling/index.xhtml

►Text Gen. UI, Inference Engines
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/lmg-anon/mikupad
https://github.com/turboderp/exui
https://github.com/ggerganov/llama.cpp

Why should I get mechanical keyboards over membrane ones?

>this is space-age technology in the eyes of an average American
Or at least that is what /g/ says, but how true is this statement in reality?

https://www.ftc.gov/news-events/news/press-releases/2024/04/ftc-announces-rule-banning-noncompetes

techbros.... we're winning

Previously >>100124857
What are you working on?

/aicg/ - A general dedicated to the discussion and development of AI chatbots

nuclear edition

>News
llama 3 8b and 70b https://llama.meta.com/llama3/, among other developments in local
opus on aws https://aws.amazon.com/blogs/aws/anthropics-claude-3-opus-model-on-amazon-bedrock/
gpt-4-turbo finally out of preview, not as fucked as the last preview snapshot
https://platform.openai.com/docs/models/gpt-4-turbo-and-gpt-4
news: https://rentry.org/aicg_chronicles
additional info: https://rentry.org/aicg_extra_information

>Bots
https://chub.ai
https://chub-archive.evulid.cc
https://booru.plus/+pygmalion
https://rentry.org/meta_bot_list

>Guides
https://rentry.org/tavern4retards

>Jailbreaks
https://rentry.org/jb-listing

>Frontends
https://sillytavern.app [SillyTavern]
https://agnai.chat [Agnai]
https://risuai.xyz [RisuAI]
https://docs.miku.gg [Miku]
https://character.ai [Cai]

>Models
gpt: https://platform.openai.com/docs
claude: https://docs.anthropic.com
gemini: https://ai.google.dev/docs
local: >>>/g/lmg
https://rentry.org/meta_golocal_list

>Botmaking
https://rentry.org/meta_botmaking_list
https://desune.moe/aichared
https://agnai.chat/editor

>Meta
OP templates: https://rentry.org/aicgOP
services assessment: https://rentry.org/aicg_meta
fun JBs and prompts: https://rentry.org/weirdbutfunjailbreaksandprompts - https://rentry.org/jinxbreaks
sultra: https://github.com/kingbased/gemini
logs: https://chatlogs.neocities.org
aicg botmaking events: https://rentry.org/meta_event_list

prev: >>100145524

Apple is dying.

https://github.com/TeamNewPipe/NewPipe/releases/tag/v0.27.0

Too many fixes to name!

>UPGRADE & BUILD ADVICE.
Post build list or current specs including MONITOR: https://pcpartpicker.com/
Provide specific use cases.
State BUDGET and COUNTRY or you will NOT be helped.

>CPU
Web browsing: i3 14100, 5600G
Budget: i5 12400F, 5600
Gaming: i5 12600KF, 7600
High end gaming: i5 14600K, 7800X3D
Workstation: i7 14700K, 7900X
AM4 upgrade: 5600, 5800X3D

>COOLER
Arctic Liquid Freezer III
Thermalright Phantom Spirit 120 EVO
Scythe Fuma 3
Thermalright Peerless Assassin SE
Budget: Assassin X 120 Refined SE, ID-COOLING SE-214-XT
AVOID: Dark Rock Pro 4/5, NH-U12A/D15

>RAM
DDR4: 2x16GB 3200CL16. Budget, 2x8GB 3200CL16
DDR5: 2x16GB 7200CL34. Budget: 6400CL32, AM5: 6000CL30
Workstation/high end: consider 2x32GB

>SSD (OS drive)
Budget: Cheapest PCIE4
Mid range: WD SN770
High end: Sabrent Rocket 5, Samsung 990 Pro, Solidigm P44 Pro

>GPU
1080p: 7700XT, budget: 6700XT, 6650XT, used RTX 2080 Ti
1440p: 7900GRE budget: 7800XT, used 6800XT
2160p: RX 7900XTX, budget: RX 7900XT
AVOID: Nvidia GPUs (4070 series has too many driver issues on Windows 10 & 11, 4080 and 4090 have board design issues causing hardware failure)

>CASE (from $ to $$$)
mATX: Thermaltake Versa H18, Thermaltake S100, Deepcool CH370, Fractal Pop Mini Air, Lian Li O11 Air Mini
ATX: Phanteks G300A (1 fan), Montech AIR 903 Base, Lian Li Lancool 216, Lian Li Lancool III, Fractal Torrent

>PSU
Budget: High end gold rated 500-600W PSU
Mid range: ATX 3.0 compliant gold rated PSU @ 75% max load
High end: Seasonic PRIME TX, be quiet! Dark Power Pro 13, Corsair HX1500i refresh
AVOID: GAMEMAX
https://cultists.network/140/psu-tier-list/
https://hwbusters.com/best_picks/best-atx-v3-0-pcie-5-0-ready-psus-picks-2023-hardware-busters/

>OS
Activate Windows @ >>>/g/fwt

>MONITORS
https://pcpartpicker.com/user/pcbg/saved/dP3v4D

>CASE FANS
Meta: get a case with good stock PWM fans
Budget: Arctic P12 PWM PST 5 pack
High end: Noctua NF-A12x25 PWM

Previous: >>100140754

Stop getting nostalgic over proprietary software.