USB Port and Ubuntu Server (hyper-v)

A few ways....

Windows Guest to remote Windows Guest Host...
With using Hyper-V, set your VM inteal in the OS to allow remote coection in the System properties. In your VM Guest Host (machine your are coecting from) start a remote desktop coection. At the panel where you see "coect" as an option, to the right of that button will be a link that says "options". Select that link.

The panel that will open will let you select local machine resource options that will be joined to that remote desktop coection. One of the options will be to allow use of the local USB ports... You will need to boot or reboot the VM guest from that coection for it to see a locally attached device, through that local port. Sadly, it doesn't work for everything, but allows "some" local access and resource mapping.

Linux Guest to remote Linux Guest Host
VNC to VNC, or Spice-to-Spice doing the same.

Linux Guest to Windows Guest Host
VNC to VNC compatible app doing the same.

Like I said, with Hyper-v, is limited... and what is gong to bring it close is the coection between (RDP, Spice or VNC) and how the app on the remote coection maps the local resources. The closest it's going to get is the Win-to-Win with RDP (hyper-v's native ties) and anything else, you would be trying to replicate that.

Personally, I have hyper-v here... but use some of my other Virtual Hosts to host most of my VM's. Hyper-V does what it does, but has it's limits. And what it does do, is not always convenient or easy.