Donations to the archive would be appreciated to help fund our server hardware & storage drives. We are looking for developers to help build new software and archives, discuss here.

/aicg/ - AI Chatbot General

No.99721163 View ViewReplyLast 50OriginalReport
597 posts and 101 images omitted

/lmg/ - Local Models General

No.99718737 View ViewReplyLast 50OriginalReport
/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>99710043 & >>99702452

►News
>(03/28) Jamba 52B MoE released with 256k context: https://huggingface.co/ai21labs/Jamba-v0.1
>(03/27) Databricks Releases 132B MoE model: https://huggingface.co/collections/databricks/dbrx-6601c0852a0cdd3c59f71962
>(03/23) Mistral releases 7B v0.2 base model with 32k context: https://models.mistralcdn.com/mistral-7b-v0-2/mistral-7B-v0.2.tar
>(03/23) Grok support merged: https://github.com/ggerganov/llama.cpp/pull/6204
>(03/17) xAI open sources Grok: https://github.com/xai-org/grok
>(03/15) Control vector support in llamacpp: https://github.com/ggerganov/llama.cpp/pull/5970

►FAQ: https://wikia.schneedc.com
►Glossary: https://archive.today/E013q | https://rentry.org/local_llm_glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/llama-mini-guide
https://rentry.org/8-step-llm-guide
https://rentry.org/llama_v2_sillytavern
https://rentry.org/lmg-spoonfeed-guide
https://rentry.org/rocm-llamacpp

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
General Purpose:
https://hf.co/spaces/HuggingFaceH4/open_llm_leaderboard
https://hf.co/spaces/lmsys/chatbot-arena-leaderboard
Programming: https://hf.co/spaces/bigcode/bigcode-models-leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/GGUF-VRAM-Calculator
Sampler visualizer: https://artefact2.github.io/llm-sampling/index.xhtml

►Text Gen. UI, Inference Engines
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/lmg-anon/mikupad
https://github.com/turboderp/exui
https://github.com/ggerganov/llama.cpp
279 posts and 47 images omitted

/twg/ - Tech Workers General

No.99716896 View ViewReplyLast 50OriginalReport
178 posts and 25 images omitted

No.99719507 View ViewReplyOriginalReport
What improvements would you make to the modern smartphone?
28 posts and 3 images omitted

No.99719162 View ViewReplyOriginalReport
What's wrong with this fucking retard, and Jewtubers in general?

This nigger destroys old gadgets in almost every video just to get some attention. It makes me mad.
16 posts omitted

post faggot tech

No.99723651 View ViewReplyOriginalReport
i'll start
37 posts and 3 images omitted

No.99723751 View ViewReplyOriginalReport
Reminder that a version of 8**** still exists.
17 posts and 1 image omitted

No.99720105 View ViewReplyOriginalReport
>HDRlets can't enjoy this video
l m a o

1440p/HDR/144hz is bare minimum to enjoy anything in 2024
30 posts and 3 images omitted

/pcbg/ - PC Building General

No.99719751 View ViewReplyLast 50OriginalReport
>UPGRADE & BUILD ADVICE.
Post build list or current specs including MONITOR: https://pcpartpicker.com/
Provide specific use cases.
State BUDGET and COUNTRY or you will NOT be helped.

>CPU
Web browsing: i3 14100, 5600G
Budget: i5 12400F, 5600
Gaming: i5 12600KF, 7600
High end gaming: i5 14600K, 7800X3D
Workstation: i7 14700K, 7900X
AM4 upgrade: 5600, 5800X3D

>COOLER
Arctic Liquid Freezer III 240-360
Thermalright Phantom Spirit 120 EVO
Scythe Fuma 3
Thermalright Peerless Assassin SE
Budget: Assassin X 120 Refined SE, ID-COOLING SE-214-XT
AVOID: Dark Rock Pro 4/5, NH-U12A/D15

>RAM
DDR4: 2x16GB 3200CL16. Budget, 2x8GB 3200CL16
DDR5: 2x16GB 7200CL34. Budget: 6400CL32, AM5: 6000CL30
Workstation/high end: consider 2x32GB

>SSD (OS drive)
Budget: Cheapest PCIE4
Mid range: WD SN770
High end: Sabrent Rocket 5, Samsung 990 Pro

>GPU
1080p: RTX 4070 Super, budget: RTX 4060, used RTX 2080 Ti
1440p: RTX 4080 Super, budget: RTX 4070 Ti Super
2160p: RTX 4090, budget: RX 7900 XTX
Workstation: RTX 4060/4070/4090, AVOID: AMD cards, RTX 3060 12GB

>CASE (from $ to $$$)
mATX: Thermaltake Versa H18, Thermaltake S100, Fractal Pop Mini Air, Lian Li O11 Air Mini
ATX: Phanteks G300A (1 fan), Montech AIR 903 Base, Lian Li Lancool 216, Lian Li Lancool III, Fractal Torrent
AVOID: 'Silent' cases, fanless cases, 4000D airflow

>PSU
Budget: High end gold rated 500-600W PSU
Mid range: ATX 3.0 compliant gold rated PSU @ 75% max load
High end: Seasonic PRIME TX, be quiet! Dark Power Pro 13, Corsair HX1500i refresh
AVOID: GAMEMAX
PSU buying guides:
https://cultists.network/140/psu-tier-list/
https://hwbusters.com/best_picks/best-atx-v3-0-pcie-5-0-ready-psus-picks-2023-hardware-busters/ (updated 4 2024)

>OS
Activate Windows @ >>>/g/fwt

>MONITORS
https://pcpartpicker.com/user/pcbg/saved/dP3v4D

>CASE FANS
Meta: get a case with good stock PWM fans
Budget: Arctic P12 PWM PST 5 pack
High end: Noctua NF-A12x25 PWM

Previous:
>>99705590
127 posts and 21 images omitted

/dpt/ - Daily Programming Thread

No.99689281 View ViewReplyLast 50OriginalReport
Old thread: >>99655287

What are you working on, /g/?
361 posts and 40 images omitted