/aicg/ - A general dedicated to the discussion and development of AI chatbots

maid 2 skate edition

>News
Meta AI released Llama 3 8B and 70B https://llama.meta.com/llama3
Opus comes to AWS: https://aws.amazon.com/blogs/aws/anthropics-claude-3-opus-model-on-amazon-bedrock/
gpt-4-turbo finally out of preview, not as fucked as the last preview snapshot
https://platform.openai.com/docs/models/gpt-4-turbo-and-gpt-4


additional info: https://rentry.org/aicg_extra_information
lore: https://rentry.org/aicg_chronicles

>Bots
https://chub.ai
https://chub-archive.evulid.cc
https://rentry.org/meta_bot_list
https://booru.plus/+pygmalion

>Frontends
https://sillytavern.app [SillyTavern]
https://agnai.chat [Agnai]
https://risuai.xyz [RisuAI]
https://docs.miku.gg [Miku]
https://character.ai [CAI]

>Botmaking
https://rentry.org/meta_botmaking_list
https://desune.moe/aichared
https://agnai.chat/editor

>Guides
https://rentry.org/tavern4retards

>Jailbreaks
https://rentry.org/jb-listing

>Models
claude: https://docs.anthropic.com
gpt: https://platform.openai.com/docs
gemini: https://ai.google.dev/docs
local: >>>/g/lmg
https://rentry.org/meta_golocal_list

>Meta
OP templates: https://rentry.org/aicgOP
services assessment: https://rentry.org/aicg_meta
fun JBs and prompts: https://rentry.org/weirdbutfunjailbreaksandprompts - https://rentry.org/jinxbreaks
sultra: https://github.com/kingbased/gemini
logs: https://chatlogs.neocities.org
aicg botmaking events: https://rentry.org/meta_event_list

banned from the skatepark >>100080570

>Interviewing
Neetcode 150: https://neetcode.io/practice
Tips and interview practice: https://blog.interviewing.io/

>Resume Stuff
https://www.careercup.com/resume

>Salary Stuff
"What's your expected salary?": https://www.fearlesssalarynegotiation.com/salary-expectations-interview-question/
Negotiation advice: https://www.freecodecamp.org/news/how-not-to-bomb-your-offer-negotiation-c46bb9bc7dea/
Salary data: https://levels.fyi/

Don't disclose your current salary to recruiters.

>Layoffs
https://layoffs.fyi/

>Helpful YouTube Channels
https://www.youtube.com/@ContinuousDelivery
https://www.youtube.com/@EngineeringwithUtsav
https://www.youtube.com/@ByteByteGo (systems design at a high level)
https://www.youtube.com/@ycombinator (if you're doing a startup)
https://www.youtube.com/@hnasr (for studying backed architecture)

Previous thread: >>100063409

Basically I have a big metal barn about 250 feet from my house. I get absolutely zero service inside of it, but I can easily pick up the Wi-Fi from the house directly in front of the window in the barn. Can I get one of those Wi-Fi extender deals, put it in front of the window and it’ll extend the Wi-Fi from the house into and throughout the barn? It doesn’t need to be crazy fast or anything, it would just be nice to at least be able to get texts on my phone when I’m out there.

/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>100081628 & >>100077829

►News
>(04/18) Llama 3 8B, 70B pretrained and instruction-tuned models released: https://llama.meta.com/llama3/
>(04/17) Mixtral-8x22B-Instruct-v0.1 released: https://mistral.ai/news/mixtral-8x22b/
>(04/15) Microsoft AI unreleases WizardLM 2: https://web.archive.org/web/20240415221214/https://wizardlm.github.io/WizardLM2/
>(04/09) Mistral releases Mixtral-8x22B: https://twitter.com/MistralAI/status/1777869263778291896
>(04/09) Llama 3 coming in the next month: https://techcrunch.com/2024/04/09/meta-confirms-that-its-llama-3-open-source-llm-is-coming-in-the-next-month/

►FAQ: https://wikia.schneedc.com
►Glossary: https://archive.today/E013q | https://rentry.org/local_llm_glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/llama-mini-guide
https://rentry.org/8-step-llm-guide
https://rentry.org/llama_v2_sillytavern
https://rentry.org/lmg-spoonfeed-guide
https://rentry.org/rocm-llamacpp

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
General Purpose:
https://hf.co/spaces/HuggingFaceH4/open_llm_leaderboard
https://hf.co/spaces/lmsys/chatbot-arena-leaderboard
Programming: https://hf.co/spaces/bigcode/bigcode-models-leaderboard
Censorbench: https://codeberg.org/jts2323/censorbench

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler visualizer: https://artefact2.github.io/llm-sampling/index.xhtml

►Text Gen. UI, Inference Engines
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/lmg-anon/mikupad
https://github.com/turboderp/exui
https://github.com/ggerganov/llama.cpp

>UPGRADE & BUILD ADVICE.
Post build list or current specs including MONITOR: https://pcpartpicker.com/
Provide specific use cases.
State BUDGET and COUNTRY or you will NOT be helped.

>CPU
Web browsing: i3 14100, 5600G
Budget: i5 12400F, 5600
Gaming: i5 12600KF, 7600
High end gaming: i5 14600K, 7800X3D
Workstation: i7 14700K, 7900X
AM4 upgrade: 5600, 5800X3D

>COOLER
Arctic Liquid Freezer III
Thermalright Phantom Spirit 120 EVO
Scythe Fuma 3
Thermalright Peerless Assassin SE
Budget: Assassin X 120 Refined SE, ID-COOLING SE-214-XT
AVOID: Dark Rock Pro 4/5, NH-U12A/D15

>RAM
DDR4: 2x16GB 3200CL16. Budget, 2x8GB 3200CL16
DDR5: 2x16GB 7200CL34. Budget: 6400CL32, AM5: 6000CL30
Workstation/high end: consider 2x32GB

>SSD (OS drive)
Budget: Cheapest PCIE4
Mid range: WD SN770
High end: Sabrent Rocket 5, Samsung 990 Pro, Solidigm P44 Pro

>GPU
1080p: 7700XT, budget: 6700XT, 6650XT, used RTX 2080 Ti
1440p: 7900GRE budget: 7800XT, used 6800XT
2160p: RX 7900XTX, budget: RX 7900XT
AVOID: Nvidia GPUs (4070 series has too many driver issues on Windows 10 & 11, 4080 and 4090 have board design issues causing hardware failure)

>CASE (from $ to $$$)
mATX: Thermaltake Versa H18, Thermaltake S100, Deepcool CH370, Fractal Pop Mini Air, Lian Li O11 Air Mini
ATX: Phanteks G300A (1 fan), Montech AIR 903 Base, Lian Li Lancool 216, Lian Li Lancool III, Fractal Torrent

>PSU
Budget: High end gold rated 500-600W PSU
Mid range: ATX 3.0 compliant gold rated PSU @ 75% max load
High end: Seasonic PRIME TX, be quiet! Dark Power Pro 13, Corsair HX1500i refresh
AVOID: GAMEMAX
https://cultists.network/140/psu-tier-list/
https://hwbusters.com/best_picks/best-atx-v3-0-pcie-5-0-ready-psus-picks-2023-hardware-busters/

>OS
Activate Windows @ >>>/g/fwt

>MONITORS
https://pcpartpicker.com/user/pcbg/saved/dP3v4D

>CASE FANS
Meta: get a case with good stock PWM fans
Budget: Arctic P12 PWM PST 5 pack
High end: Noctua NF-A12x25 PWM

Previous: >>100068403

why does /g/ pretend this can't do gmail?

If you don't understand how a computer works down to the nand gate level, you shouldn't be allowed to work in the tech industry.

What are we filtering?

Previous /sdg/ thread : >>100077216

>Beginner UI local install
Fooocus: https://github.com/lllyasviel/fooocus
EasyDiffusion: https://easydiffusion.github.io

>Local install
Automatic1111: https://github.com/automatic1111/stable-diffusion-webui
ComfyUI (Node-based): https://rentry.org/comfyui
AMD GPU: https://rentry.org/sdg-link#amd-gpu
Intel GPU: https://rentry.org/sdg-link#intel-gpu

>Use a VAE if your images look washed out
https://rentry.org/sdvae

>Auto1111 forks
Forge: https://github.com/lllyasviel/stable-diffusion-webui-forge
Anapnoe UX: https://github.com/anapnoe/stable-diffusion-webui-ux
Vladmandic: https://github.com/vladmandic/automatic

>Run cloud hosted instance
https://rentry.org/sdg-link#run-cloud-hosted-instance

>Try online without registration
txt2img: https://www.mage.space
img2img: https://huggingface.co/spaces/huggingface/diffuse-the-rest
Inpainting: https://huggingface.co/spaces/fffiloni/stable-diffusion-inpainting
pixart: https://huggingface.co/spaces/PixArt-alpha/PixArt-Sigma

>Models, LoRAs & embeddings
https://civitai.com
https://huggingface.co
https://rentry.org/embeddings

>Animation
https://rentry.org/AnimAnon
https://rentry.org/AnimAnon-AnimDiff
https://rentry.org/AnimAnon-Deforum

>SDXL info & download
https://rentry.org/sdg-link#sdxl

>Index of guides and other tools
https://codeberg.org/tekakutli/neuralnomicon
https://rentry.org/sdg-link
https://rentry.org/rentrysd

>View and submit GPU performance data
https://docs.getgrist.com/3mjouqRSdkBY/sdperformance
https://vladmandic.github.io/sd-extension-system-info/pages/benchmark.html

>Share image prompt info
4chan removes prompt info from images, share them with the following guide/site...
https://rentry.org/hdgcb
https://catbox.moe

>Related boards
>>>/h/hdg
>>>/e/edg
>>>/d/ddg
>>>/b/degen
>>>/vt/vtai
>>>/aco/sdg
>>>/trash/sdg

Official: discord.gg/stablediffusion

Why is all the soulful technology disappearing? It feels technology peaked 20 years ago and the world is going backwards now. I don't think anyone even knows how to create intricate mechanical assembly lines like this anymore.

https://www.youtube.com/watch?v=kc4kJKOGnHY