/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>100180197 & >>100173514

►News
>(04/24) Snowflake Arctic Instruct 128x3B MoE released: https://hf.co/Snowflake/snowflake-arctic-instruct
>(04/23) Phi-3 Mini model released: https://hf.co/microsoft/Phi-3-mini-128k-instruct-onnx
>(04/21) Llama3 70B pruned to 42B parameters: https://hf.co/chargoddard/llama3-42b-v0
>(04/18) Llama3 8B, 70B pretrained and instruction-tuned models released: https://llama.meta.com/llama3/
>(04/17) Mixtral-8x22B-Instruct-v0.1 released: https://mistral.ai/news/mixtral-8x22b/

►News Archive: https://rentry.org/lmg-news-archive
►FAQ: https://wikia.schneedc.com
►Glossary: https://rentry.org/lmg-glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/llama-mini-guide
https://rentry.org/8-step-llm-guide
https://rentry.org/llama_v2_sillytavern
https://rentry.org/lmg-spoonfeed-guide
https://rentry.org/rocm-llamacpp

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
Chatbot Arena: https://chat.lmsys.org/?leaderboard
Programming: https://hf.co/spaces/bigcode/bigcode-models-leaderboard
Censorship: https://hf.co/spaces/DontPlanToEnd/UGI-Leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler visualizer: https://artefact2.github.io/llm-sampling/index.xhtml

►Text Gen. UI, Inference Engines
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/lmg-anon/mikupad
https://github.com/turboderp/exui
https://github.com/ggerganov/llama.cpp

PTG.Private.Trackers.General.2024.1080p.BluRay.DD+5.1.x264-ANONYMOUS edition

>Not sure what private trackers are all about?
The mission of /ptg/ is to promote the highest possible standards of tracker service by providing members with opportunities for professional development, by recognizing technical competence through examinations and by advancing the interests of its members.

>Have a question?
- FAQ https://archive.is/UVQkn
- WIKI https://wiki.installgentoo.com/index.php/Private_trackers
- PYRAMID (Updated 2021-08-22) https://i.imgur.com/akrkAyV.png
- STUDY https://www.cambridge.org/core/services/aop-cambridge-core/content/view/2F379FE0CB50DF502F0075119FD3E060
- SPREADSHEET https://hdvinnie.github.io/Private-Trackers-Spreadsheet/
- STATUS https://trackerstatus.info

Use >>>/g/ptg as a link to find the /ptg/ thread.

>Remember the following:
>READ THE OP BEFORE MAKING A FUCKING QUESTION YOU RETARDED FAGGOT
>It doesn't matter if you use the same username in different trackers, the staff still share your IP with each other.
>Staff is reading, being /marked/ is NOT a meme, and even if it was, it isn't.
>Don't ask for invites, it's private for a reason.
>If starting out you should interview for RED, rank to elite, wait on account age and get invites from there. THAT'S IT THAT IS ALL YOU HAVE TO DO
>something about RED

>- NEWS -
HEVC in shambles >>100173480

Previous thread: >>100149195

Redpill me on go
I just saw a bunch of job openings requesting Golang programmers

What is the definitive video game controller?

Pröööhhh :DDD

/aicg/ - A general dedicated to the discussion and development of AI chatbots

Cyborg 009 Edition

>News
Meta AI released Llama 3 8B and 70B https://llama.meta.com/llama3
Claude Opus on Amazon Bedrock https://aws.amazon.com/blogs/aws/anthropics-claude-3-opus-model-on-amazon-bedrock
OpenAI released the gpt-4-turbo as stable
Anthropic released the Claude 3 family https://www.anthropic.com/news/claude-3-family

additional info: https://rentry.org/aicg_extra_information

>Bots
https://chub.ai
https://chub-archive.evulid.cc
https://booru.plus/+pygmalion
https://rentry.org/meta_bot_list
https://rentry.org/charcardrentrylist

>Guides
https://rentry.org/tavern4retards - https://rentry.org/agnai_guides

>Jailbreaks
https://rentry.org/jb-listing

>Frontends
https://sillytavern.app [SillyTavern]
https://agnai.chat [Agnai]
https://risuai.xyz [RisuAI]
https://docs.miku.gg [Miku]
https://character.ai [Cai]

>Models
gpt: https://platform.openai.com/docs
claude: https://docs.anthropic.com
gemini: https://ai.google.dev/docs
local: >>>/g/lmg
https://rentry.org/meta_golocal_list

>Botmaking
https://rentry.org/meta_botmaking_list
https://desune.moe/aichared
https://agnai.chat/editor

>Meta
OP templates: https://rentry.org/aicgOP
services assessment: https://rentry.org/aicg_meta
try these -> https://rentry.org/weirdbutfunjailbreaksandprompts - https://rentry.org/jinxbreaks
old slaude stuff: https://rentry.org/meta_claude_list
logs: https://chatlogs.neocities.org
aicg botmaking events: https://rentry.org/meta_event_list

Previous: >>100179477

High IQ edition

previous: >>100134049

READ THE WIKI! & help by contributing:
https://wiki.installgentoo.com/wiki/Home_server

>NAS Case Guide. Feel free to add to it:
https://wiki.installgentoo.com/wiki/Home_server/Case_guide

/hsg/ is about learning and expanding your horizons. Know all about NAS? Learn virtualization. Spun up some VMs? Learn about networking by standing up a OPNsense/PFsense box and configuring some VLANs. There's always more to learn and chances to grow. Think you’re god-tier already? Setup OpenStack and report back.

>What software should I run?
Install Gentoo. Or whatever flavor of *nix is best for the job or most comfy for you. Jellyfin/Emby/Plex to replace Netflix, Nextcloud to replace Googlel, Ampache/Navidrome to replace Spotify, the list goes on. Look at the awesome self-hosted list and ask.

>Why should I have a home server?
/hsg/ is about learning and expanding your horizons. De-botnet your life. Learn something new. Serving applications to yourself, your family, and your frens feels good. Put your tech skills to good use for yourself and those close to you. Store their data with proper availability redundancy and backups and serve it back to them with a /comfy/ easy to use interface.

>Links & resources
Cool stuff to host: https://gitlab.com/awesome-selfhosted/awesome-selfhosted
RouterOS's: https://wiki.installgentoo.com/wiki/Home_server#Custom
https://reddit.com/r/datahoarder
https://www.labgopher.com
https://www.reddit.com/r/homelab/wiki/index
https://wiki.debian.org/FreedomBox/Features
List of ARM-based SBCs: https://docs.google.com/spreadsheets/d/1PGaVu0sPBEy5GgLM8N-CvHB2FESdlfBOdQKqLziJLhQ
Low-power x86 systems: https://docs.google.com/spreadsheets/d/1LHvT2fRp7I6Hf18LcSzsNnjp10VI-odvwZpQZKv_NCI
Cheap disks: https://shucks.top/ & https://diskprices.com/

Remember:
RAID protects you from DOWNTIME
BACKUPS protect you from DATA LOSS

If your favorite language/framework/library/engine/tool doesn't have an official offline manual/documentation you have a shit taste.

Sorry, I don't make the rules.

OK, fine. I'm fucking tired of segfault bugs in my C project, I'm considering unironically using Rust for the next one. Tell me about Rust's advantages, disadvantages and what do I need to know before dipping my toes into it.

>Spotify CEO Daniel Ek surprised by how much laying off 1,500 employees negatively affected the streaming giant’s operations

>When Spotify announced its largest-ever round of layoffs in December, CEO Daniel Ek hailed a new age of efficiency at the streaming giant. But four months on, it seems he and his executives weren’t prepared for how tough filling in for 1,500 axed workers would be.
>The music streamer enjoyed record quarterly profits of €168 million ($179 million) in the first three months of 2024, enjoying double-digit revenue growth to €3.6 billion ($3.8 billion) in the process.
>However, the company failed to hit its guidance on profitability and monthly active user growth.

Oh no! So following the Alien and Elon Cucksk and firing people was ultimately a bad decision long term?