Download Lemonade Server 9.3.0

Headline
- NPU enabled for Whisper models on the /audio/transcription endpoint (Windows only).
- Kokoro TTS is available on the /audio/speech endpoint.
- Desktop and web apps have backend selection, providing a ROCm option in the GUI for the first time.
- Significant performance uplift on AMD devices using llamacpp Vulkan and FastFlowLM.
- A lot more! This was a huge release.
Breaking Changes
- The .deb now installs as a systemd service. See https://github.com/lemonade-sdk/lemonade/issues/1006 for details and migration info.
- The inference_engines key has been removed from the /system-info endpoint response, replaced by a new recipes list.
Quick Install
Operating System Server + App Server Only
Windows lemonade.msi lemonade-server-minimal.msi
Ubuntu lemonade_9.3.0_amd64.deb lemonade-server-minimal_9.3.0_amd64.deb
Other platforms? See our Installation Options for Docker, Arch, Fedora, Debian, and more.

What's Changed
Thanks @Geramy, @LaurentChardin, @bitgamma, @choppu, @dennemark, @iswaryaalex, @jeremyfowers, @kenvandine, @ramkrishna2910, @sofiageo, @superm1 for your awesome contributions to this release!
Click to expand changelog
- feat: Add status bar with server and system stats by @kenvandine in https://github.com/lemonade-sdk/lemonade/pull/927
- Remove all trailing whitespace and apply black to all python files by @jeremyfowers in https://github.com/lemonade-sdk/lemonade/pull/966
- enable /responses endpoint for llamacpp recipes by @bitgamma in https://github.com/lemonade-sdk/lemonade/pull/945
- Add load options menu by @sofiageo in https://github.com/lemonade-sdk/lemonade/pull/880
- Fix link to llm-debate.html in instructions by @jeremyfowers in https://github.com/lemonade-sdk/lemonade/pull/984
- Rename SD label by @ramkrishna2910 in https://github.com/lemonade-sdk/lemonade/pull/986
- fix: Don't attempt to preserve ownership when extracting backends by @kenvandine in https://github.com/lemonade-sdk/lemonade/pull/989
- Add a helper script that uses Ninja build for building by @superm1 in https://github.com/lemonade-sdk/lemonade/pull/991
- Add a new /api/v1/system-stats endpoint and use it by @superm1 in https://github.com/lemonade-sdk/lemonade/pull/970
- Update the Installing Models section of the integration guide by @jeremyfowers in https://github.com/lemonade-sdk/lemonade/pull/993
- Update CMake minimum version to use ... syntax by @superm1 in https://github.com/lemonade-sdk/lemonade/pull/999
- Prevent a rare Windows model load bug by @jeremyfowers in https://github.com/lemonade-sdk/lemonade/pull/979
- llamacpp: also reserve flag aliases/negatives by @bitgamma in https://github.com/lemonade-sdk/lemonade/pull/974
- Create and distribute systemd service by @superm1 in https://github.com/lemonade-sdk/lemonade/pull/1002
- Add more system information into about modal by @superm1 in https://github.com/lemonade-sdk/lemonade/pull/1005
- Windows - fix some issues with buildscripts by @LaurentChardin in https://github.com/lemonade-sdk/lemonade/pull/1001
- Add image generation docs openwebui by @dennemark in https://github.com/lemonade-sdk/lemonade/pull/994
- Add connection settings in Electron app by @choppu in https://github.com/lemonade-sdk/lemonade/pull/1004
- Re-do the system info code and endpoint by @jeremyfowers in https://github.com/lemonade-sdk/lemonade/pull/992
- do not close the same stream multiple times by @bitgamma in https://github.com/lemonade-sdk/lemonade/pull/1014
- Geramy/announce to lan by @Geramy in https://github.com/lemonade-sdk/lemonade/pull/988
- feat: Add copy button to code blocks by @kenvandine in https://github.com/lemonade-sdk/lemonade/pull/969
- Fix systemd service installation for non-/usr prefixes by @superm1 in https://github.com/lemonade-sdk/lemonade/pull/1007
- Add Kokoro TTS backend by @bitgamma in https://github.com/lemonade-sdk/lemonade/pull/1000
- Show --help output if no arguments to lemonade-server by @superm1 in https://github.com/lemonade-sdk/lemonade/pull/1017
- Desktop app: llamacpp backend dropdown, build improvements by @jeremyfowers in https://github.com/lemonade-sdk/lemonade/pull/1013
- Add support for lemonade-server hosting a Lemonade Web-App by @superm1 in https://github.com/lemonade-sdk/lemonade/pull/965
- Add qwen-coder-next to the models list by @jeremyfowers in https://github.com/lemonade-sdk/lemonade/pull/1020
- Add NPU support for whisper.cpp on Lemonade by @iswaryaalex in https://github.com/lemonade-sdk/lemonade/pull/956
- Geramy/macosx support stg1 by @Geramy in https://github.com/lemonade-sdk/lemonade/pull/868
- Look for snap.lemonade-server.daemon.service for systemd too by @superm1 in https://github.com/lemonade-sdk/lemonade/pull/1018
- feat: Suppress logging system stats by @kenvandine in https://github.com/lemonade-sdk/lemonade/pull/1021
- Add basic API key support to the webapp by @bitgamma in https://github.com/lemonade-sdk/lemonade/pull/1026
- Remove snap connection from installation docs by @kenvandine in https://github.com/lemonade-sdk/lemonade/pull/1027
- Open the web app from the windows tray by @jeremyfowers in https://github.com/lemonade-sdk/lemonade/pull/1032
- Add whispercpp args to spec, CLI, system_info, and app by @jeremyfowers in https://github.com/lemonade-sdk/lemonade/pull/1030
- Rev FLM to 0.9.31 by @jeremyfowers in https://github.com/lemonade-sdk/lemonade/pull/1034
- Bug fix - whispercpp model manager by @iswaryaalex in https://github.com/lemonade-sdk/lemonade/pull/1041
- Hardcode lib for systemd service under $PREFIX by @superm1 in https://github.com/lemonade-sdk/lemonade/pull/1039
New Contributors
- @kenvandine made their first contribution in https://github.com/lemonade-sdk/lemonade/pull/927
- @LaurentChardin made their first contribution in https://github.com/lemonade-sdk/lemonade/pull/1001
- @dennemark made their first contribution in https://github.com/lemonade-sdk/lemonade/pull/994
- @choppu made their first contribution in https://github.com/lemonade-sdk/lemonade/pull/1004
- @iswaryaalex made their first contribution in https://github.com/lemonade-sdk/lemonade/pull/956
Full Changelog: https://github.com/lemonade-sdk/lemonade/compare/v9.2.0...v9.3.0