You need the router to have DHCP enabled so that it allocates an IP address and Default Gateway to both PCs. Then, if you are running Windows XP, you can simply run the Network Setup Wizard (which you can find in My Network Places) on both PCs and that will guide you through the process of getting them both networked together.
Let us know if that helps