Probably. Jellyfin also has a music version of the app similar to plex amp.
Honestly I have been considering making the switch.
I didn’t know Jellyfin had a music version. Is it not on Play Store?
Edit: Oh, I found it on F-droid. It’s called Boum. It is on Play Store too it just doesn’t show up when you search for jellyfin.
I think it’s called finamp
https://play.google.com/store/apps/details?id=com.unicornsonlsd.finamp&hl=en_US&gl=US
One of them is Finamp. I think there might be more. The normal players (the official one and Findroid) also play music just fine FWIW.