Hello Jessie
If you are planing to use the public baths no reservations should be necessary. Only if you would want to reserve a private baths. It would seem that you can reserve the massages but they are not required, as long as there are free spots. You can make reservations and ask more information from this email info@yamatonoyu.com
Hope this helps you and that you have nice time at the Onsen