Always check your documentation first, they tend to highlight things you will need (ie like xross-over cables)
If your router is new you often have to configure it first, if you don't have a manual you can get one from:
Linksys Routers
When working with networks also try it smaller first, not all at once.
For instance:
Modem > A single puter - use the network connection that will be used to connect to the router later.
See if that puter connects to the internet fine (it might not and if so this is where the problem lies). If you know the USB connection on your modem works and nothing else on it does, you can always snag a USB network connection adapter

Next add router:
Modem > Router > same puter that connected straight the modem a moment ago (don't connect any other computer yet).
If you made it this far you should be about home free (since you said the hub works fine), all you have to do now is add the hub then all the puters to said hub..... hehe
Make sure you power things on the first time in accordance to where they are located in the chain, starting with the modem.