Ninja,
I'd like you to try something. And excuse me if I go through everything step by step. This is just so you'll have a check list as you go through the process of setting everything up. So, here we go....
1. Open GTP3 Select Options > Audio
2. Go to the Advanced Tab. Under playback and recording select ASIO. Make sure the check box next to Share Drivers With Other Programs is un-checked then Click Ok
3. A pop up will appear stating that you have to restart the program for the changes to take effect. Click Ok.
4. Close GTP3
5. Re-open GTP3. Go to Options > Audio.
6. Go to the Drivers tab and make sure only the drivers for the Rock Frog are highlighted. Any other deselect by clicking on them.
7. Go to the General tab and set the playback and recording timing masters to the Rock Frog.
8. In the same tab open the ASIO Panel by clicking on the ASIO Panel button.
9. In the next window there will be settings for latency. the ASIO panel will be Rock Frog specific. The settings might be called buffer size or something else. In either case you will want to buffer size to be small or set the setting to more device or what ever Rock Frog calls the ASIO setting. Click Ok when Done and OK again for the Audio Options dialog box.
10. This optional but recommended. Close GTP3 and reopen. I do this just to make sure the settings take. I usually go back and double check the settings as well.
11. Go to Console view and select tracks 1-16 by clicking on the 1-16 button. At the top of each channel strip under the track number is the input selection. If you click on it it will give you the options for your Rock Frog Inputs. Make sure that you have your desired input selected.
12. at the bottom of each channel strip is an output selection which is located right under the fader. You can select the Rock Frog or a sub group to patch the signal to. make your desired selection. Do this for every channel strip you intend to use for the recording.
13. Next click on the BUS button to show all your subs and AUX channel strips. Make sure that at the bottom of each one the output is the Rock Frog.
14. Next make sure the Audio engine in on. You can find this on the transport controls. It will be towards the center, second button to the right of the record button. It should be green in color when activated.
15. Attempt a recording and see if you get a monitored sound out. If so you have success. If not there is one more thing to try.
The one more thing is to disable the onboard (in-built) sound card. To do this right click on My Computer. Select properties. Next select the hardware tab and then click on Device Manager. In the next window look for the "+" next to Sound, video and game controllers. Click on the "+" sign to expand the menu. Find the on board sound card (usually RealTek AC97 or the like). and right click on it. Select disable and it will ask you if you are sure you want to do this. Click yes. It will go through it's process to shut the card down. When finished it will have a red "X" over the device. Close the window and then click ok on the system properties window. And retry GTP3 after closing and opening.
Let us know how you make out with this.