Assuming I've looked at the right manual (
http://www.manualslib.com/manual/367...?page=2#manual ) then you are right, there's no address reservation under DHCP on that Belkin model. The router's web-based user interface does allow to get the RPi ip address using the "client list", and you should be able to restart it too - see page 64 - without going upstairs.
If you ever decide to configure the RPi to use a fixed (static) ip address don't forget to pick a value which is outside the range of the router's DHCP IP pool. ( see pages 43 & 44)