Just make sure your Gateway is set to your routers IP (probably 192.168.1.1)
and that you have DNS and secondary DNS IP set up (usually your ISP's DNS,
but any will do).
Regards,
Martin