How are you connecting the Yamahas to the router? I'm not sure whether they work with USB hubs, so if you're connecting both of them to a hub and then connecting the hub to the router, try connecting each one directly to the router to see whether they work that way.
I don't see anything in the router's manual that indicates whether its USB port is USB 2 or USB 3, but I know that the manuals for some Yamaha models specify that they should not be used with USB 3; the data speeds for the two protocols are different. USB 3 devices are supposed to be able communicate with either USB 2 or USB 3 devices-- "downward compatibility"-- but I wonder whether they can get confused by the type of USB cable involved. In particular, if a USB 2 device and a USB 3 are connected together by a USB 3 cable, I wonder if the USB 3 device might mistakenly assume that it's communicating with another USB 3 device and use USB 3 data speeds which are too fast for the USB 2 device? I might be barking up the wrong tree with that idea, but it's something that I do wonder about. If the manuals for the Yamahas mention anything about not using USB 3, check your USB cable and change to a USB 2 cable if necessary.
Of course, if you're using a USB hub between the router and the Yamahas, that adds another can of worms, since there are different kinds of USB hubs-- USB 2 versus USB 3, powered versus unpowered, etc.
A third possible issue when using USB connections with Yamahas (and, I assume, with other brands as well) is the length of the USB cable. If the cable is too long, the lag time or how long it takes the data to travel from one end of the cable to the other-- and, thus, from one device to the other-- can become problematic and prevent proper communication between the two devices. I think most Yamaha models stiplulate that you should not use USB cables which are over 3 meters long, so check to make sure your cables aren't too long.
And of course, if you're using a USB hub then that adds another can of worms, because you wouldn't want to connect the Yamahas to the hub using 3-meter USB cables, then connect the hub to the router with a 3-meter USB cable, as that would amount to using a 6-meter USB cable. And that's assuming the Yamahas would work with a USB hub at all.
So I would start by individually testing each Yamaha with the router, directly connecting it to the router using a USB 2 cable which is 3 meters or less in length, to see if that works. Once you've verified whether or not each keyboard works with the router that way, you can try varying the setup a little bit at a time to see what works and what doesn't.