I agree limiting application scope is useful for multiple reasons, however Jellyfin started as a fork of Emby which already had music support. I have yet to find a standalone application that has enough features to sway me from just utilizing the existing media server functionality.
Just add a new user