/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>100077829 & >>100070066

►News
>(04/18) Llama 3 8B, 70B pretrained and instruction-tuned models released: https://llama.meta.com/llama3/
>(04/17) Mixtral-8x22B-Instruct-v0.1 released: https://mistral.ai/news/mixtral-8x22b/
>(04/15) Microsoft AI unreleases WizardLM 2: https://web.archive.org/web/20240415221214/https://wizardlm.github.io/WizardLM2/
>(04/09) Mistral releases Mixtral-8x22B: https://twitter.com/MistralAI/status/1777869263778291896
>(04/09) Llama 3 coming in the next month: https://techcrunch.com/2024/04/09/meta-confirms-that-its-llama-3-open-source-llm-is-coming-in-the-next-month/

►FAQ: https://wikia.schneedc.com
►Glossary: https://archive.today/E013q | https://rentry.org/local_llm_glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/llama-mini-guide
https://rentry.org/8-step-llm-guide
https://rentry.org/llama_v2_sillytavern
https://rentry.org/lmg-spoonfeed-guide
https://rentry.org/rocm-llamacpp

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
General Purpose:
https://hf.co/spaces/HuggingFaceH4/open_llm_leaderboard
https://hf.co/spaces/lmsys/chatbot-arena-leaderboard
Programming: https://hf.co/spaces/bigcode/bigcode-models-leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler visualizer: https://artefact2.github.io/llm-sampling/index.xhtml

►Text Gen. UI, Inference Engines
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/lmg-anon/mikupad
https://github.com/turboderp/exui
https://github.com/ggerganov/llama.cpp

What wearable technology do you use?

>Interviewing
Neetcode 150: https://neetcode.io/practice
Tips and interview practice: https://blog.interviewing.io/

>Resume Stuff
https://www.careercup.com/resume

>Salary Stuff
"What's your expected salary?": https://www.fearlesssalarynegotiation.com/salary-expectations-interview-question/
Negotiation advice: https://www.freecodecamp.org/news/how-not-to-bomb-your-offer-negotiation-c46bb9bc7dea/
Salary data: https://levels.fyi/

Don't disclose your current salary to recruiters.

>Layoffs
https://layoffs.fyi/

>Helpful YouTube Channels
https://www.youtube.com/@ContinuousDelivery
https://www.youtube.com/@EngineeringwithUtsav
https://www.youtube.com/@ByteByteGo (systems design at a high level)
https://www.youtube.com/@ycombinator (if you're doing a startup)
https://www.youtube.com/@hnasr (for studying backed architecture)

Previous thread: >>100063409

mpv ffmpeg yt-dlp

/g/ humour thread

Especially thin laptops.

The Macbook Air M3 weighs 1490g.
The Huawei Matebook X weighs 980g.

Who does this stuff appeal to? They're easier to break, and they're less powerful than thick laptops that weighs 3-4 times as much, since there is much more powerful hardware instead.

/aicg/ - A general dedicated to the discussion and development of AI chatbots

maid 2 skate edition

>News
Meta AI released Llama 3 8B and 70B https://llama.meta.com/llama3
Opus comes to AWS: https://aws.amazon.com/blogs/aws/anthropics-claude-3-opus-model-on-amazon-bedrock/
gpt-4-turbo finally out of preview, not as fucked as the last preview snapshot
https://platform.openai.com/docs/models/gpt-4-turbo-and-gpt-4


additional info: https://rentry.org/aicg_extra_information
lore: https://rentry.org/aicg_chronicles

>Bots
https://chub.ai
https://chub-archive.evulid.cc
https://rentry.org/meta_bot_list
https://booru.plus/+pygmalion

>Frontends
https://sillytavern.app [SillyTavern]
https://agnai.chat [Agnai]
https://risuai.xyz [RisuAI]
https://docs.miku.gg [Miku]
https://character.ai [CAI]

>Botmaking
https://rentry.org/meta_botmaking_list
https://desune.moe/aichared
https://agnai.chat/editor

>Guides
https://rentry.org/tavern4retards

>Jailbreaks
https://rentry.org/jb-listing

>Models
claude: https://docs.anthropic.com
gpt: https://platform.openai.com/docs
gemini: https://ai.google.dev/docs
local: >>>/g/lmg
https://rentry.org/meta_golocal_list

>Meta
OP templates: https://rentry.org/aicgOP
services assessment: https://rentry.org/aicg_meta
fun JBs and prompts: https://rentry.org/weirdbutfunjailbreaksandprompts - https://rentry.org/jinxbreaks
sultra: https://github.com/kingbased/gemini
logs: https://chatlogs.neocities.org
aicg botmaking events: https://rentry.org/meta_event_list

banned from the skatepark >>100080570

GPT-5 can do math, and it's thanks to the mysterious Q* breakthrough.
Midwits here have been coping hard despite skyrocketing benchmarks on LLMs, but I hope you have a rope ready for this.

Users of all levels are welcome to ask questions about GNU/Linux and share their experiences.

*** Please be civil, notice the "Friendly" in every Friendly GNU/Linux Thread ***

Before asking for help, please check our list of resources.

If you would like to try out GNU/Linux you can do one of the following:
0) Install a GNU/Linux distribution of your choice in a Virtual Machine.
1) Use a live image and to boot directly into the GNU/Linux distribution without installing anything.
2) Dual boot the GNU/Linux distribution of your choice along with Windows or macOS.
3) Go balls deep and replace everything with GNU/Linux.

Resources: Please spend at least a minute to check a web search engine with your question.
*Many free software projects have active mailing lists.

$ man %command%
$ info %command%
$ %command% -h/--help
$ help %builtin/keyword%

Don't know what to look for?
$ apropos %something%

Check the Wikis (most troubleshoots work for all distros):
https://wiki.archlinux.org
https://wiki.gentoo.org

/g/'s Wiki on GNU/Linux:
https://wiki.installgentoo.com/index.php/Category:GNU/Linux

>What distro should I choose?
https://wiki.installgentoo.com/index.php/Babbies_First_Linux
>What are some cool programs?
https://wiki.archlinux.org/index.php/list_of_applications
https://directory.fsf.org/wiki/Main_Page
>What are some cool terminal commands?
https://www.commandlinefu.com/commands/browse
https://cheat.sh/
>Where can I learn the command line?
https://mywiki.wooledge.org/BashGuide
https://www.grymoire.com/Unix/
>Where can I learn more about Free Software?
https://www.gnu.org/philosophy/philosophy.html
>How to break out of the botnet?
https://prism-break.org/en/categories/gnu-linux

/fglt/'s website and copypasta collection:
https://fglt.nl && https://p.teknik.io/wJ9Zy

/t/'s GNU/Linux Games: >>>/t/1175569

IRC: #sqt on Libera.Chat
https://fglt.nl/irc.html

Previous thread: >>100071558

Presented without comment.