A Flatpak build of jammr is available for testing here:
https://flathub.org/apps/details/net.jammr.jammrIt supports ARM and should run on a Raspberry Pi, but I haven't tried it myself.
A USB audio interface is probably necessary if you want good quality audio recording. This only matters if you are plugging in an instrument or microphone. If you are using software instruments then the built-in audio output is probably fine.
Please let me know how it goes!