Domi

Good for him!

Curious about the quant tho.

Q8 from unsloth.

Something like Qwen3.5-122b

My go to model for knowledge. Definitely much faster at Q5 but it lacks the tool calling quality of the Qwen3.6 models. Really hoping we see a Qwen3.6-122b soon…

About 200 t/s prompt processing and 10-20 t/s with MTP.

Greatly depends on the task, predictable things like code generates at 18-20 t/s. Creative writing more like 10-17 t/s.

Yes, I got a Strix Halo machine before the RAM price hike and use it to run all my ML stuff on it.

Currently using llama-swap with llama.cpp/ComfyUI and opencode/Open WebUI as frontend.

I’m running Qwen3.6-27b, Voxtral Mini 4b, Piper and Qwen Image. Also, some embedding and reranking models.

I use them for:

• Tagging and classification of my documents in Paperless
• Home Assistant (voice assistant)
• Translations (both text and image)
• Transcriptions
• Some light coding and debugging
• Avatar/Backdrop generation for DnD sessions

If you have trouble with outgoing mails, you can use a hybrid approach.

Receive mails directly to your server but use a mail service to relay your outgoing mails. Configuration for that is very simple in mailcow and there are a few dozen (free) transactional email providers (e.g. Scaleway).

That way you can keep receiving your mails privately and only have to give up some privacy when sending mails.

As a side note, Qwen3.6-27B is much more capable than Qwen3.6-35B, even though it is much slower.

https://huggingface.co/unsloth/Qwen3.6-27B-GGUF

For coding tasks where you don’t mind waiting, you should be able to barely squeeze in the 8-bit quantized version with 32 GB RAM + 8 GB VRAM and have a pretty competent local model. 4-bit quants work but they have issues with complex tool calls.

If you use the MTP branch of llama.cpp (and a suitable model) you can even double or triple your token generation speed: https://github.com/ggml-org/llama.cpp/pull/22673

For easier tasks, disable reasoning for instant responses.

That looks pretty good. Looks like Portainer is getting replaced this weekend.

Do you actually train the LLM or use RAG? I have been looking for a local LLM + Wikipedia RAG solution for a while now.

For now I just have kiwix-serve + searxng doing a simple search but the Kiwix search is…questionable.

I wrote an application which runs on my server and monitors my favorites on Tidal/Deezer/Qobuz. It downloads them in bulk whenever I have a premium account with one of them. Usually I purchase a month of premium every few months, at which point I get nice clean FLACs for local use.

The FLACs are moved to Jellyfin and I stream them using Finamp, which also supports transcoding, so I keep 128 kbps Opus files for offline playback and stream the raw FLAC files when bandwidth is no concern.

I have amassed a huge music library over the last decades, so even if all streaming websites go under tomorrow, I have enough music locally to last me a lifetime.

If we’re talking about online editing, Collabora has web editors based on LibreOffice but with a modern UI: https://www.collaboraonline.com/

They are really great and can be self hosted (e.g. with Nextcloud).

For offline editing, as already mentioned, LibreOffice has an optional ribbon UI and OnlyOffice looks pretty modern as well.

Yes, that’s still a bit annoying unfortunately.

Editing the fstab to properly mount a network share also currently has no UI available in KDE and has to be done manually.

but to discover it on my other linux machine is always a chore that involves editing a few config files and just kinda randomly poking around until it works.

What’s your desktop environment? On KDE you can just enter smb://serverhost/path in the Dolphin navigation bar and it will open it.

The first one I think is a fundamental limitation in that display preferences by default is per-user. Maybe this makes it work for you? https://feddit.online/post/1350756/comment/6636228

I don’t really have this problem anymore since I got rid of my projector which advertised a resolution it couldn’t handle. Had to login into the void since the login screen never showed up. Looks like this might be fixable nowadays.

The 24h clock might be similar - check your system-wide locale.

The locale is set to American English but the time format is set to German, something the lock screen can handle but SDDM cannot. I also tried applying the Plasma settings to SDDM a few times but it doesn’t really change anything.

It always chooses the default highest resolution, (which may not work on some devices with faulty EDID), does not respect the Wayland/X11 choice, has a long pause when going from login screen to desktop and does not support 24h clocks.

Just to name a few.

AND per app focus stealing prevention settings.

It does? BRB, putting Steam on the lowest level possible so I can turn everything else back up.

I don’t really want automatic updates, I want a notification once a month with all images that have a newer :latest available or if versionised, when a image with a newer version is available.

Does this check for version tags as well or only updates to the current tag?

Like the current container uses an image with the tag :0.1.0 or :v0.1.0 but :0.2.0 is available on the registry.

Depends on what they settle on, especially for screen sharing. Many downscale content for people with weaker connections.

I currently have a Raspberry Pi 3 B+ but I’m aware it’s a bit old and is ARM so I’m thinking of buying a Pi 5.

The Pi 5 lacks a H264 hardware encoder/decoder, making it unsuitable for most streaming/transcoding purposes.

The EU store ships from the EU with warranty, support, etc. for quite a hefty premium. I ordered from the global store which ships from Hong Kong. Paid ~500€ a year ago (including taxes).