Allowing remote desktop over 2 different NICs

Allowing remote desktop over 2 different NICs

I have 2 networks plugged into a server 2008 R2 box. Both are separate
vlans with internet connections. I want network B to be able to remote
desktop into the server using IP 10.20.0.16 and network A remote desktop
into it via 10.10.0.16.
NIC A has the IP, default gateway, and DNS servers set up. NIC B just has
IP and default gateway (NO DNS). Metric is statically set with NIC A being
20 and NIC B being 40.
The server isn't really used for internet access, just for internal
traffic. Is there anything I need to be worried about by having two
default gateways set up?
Active Routes:
Network Destination Netmask Gateway Interface Metric
0.0.0.0 0.0.0.0 10.10.0.1 10.10.0.16 276
0.0.0.0 0.0.0.0 10.20.0.1 10.20.0.16 296
10.20.0.0 255.255.255.0 On-link 10.20.0.16 296
10.20.0.16 255.255.255.255 On-link 10.20.0.16 296
10.20.0.255 255.255.255.255 On-link 10.20.0.16 296
127.0.0.0 255.0.0.0 On-link 127.0.0.1 306
127.0.0.1 255.255.255.255 On-link 127.0.0.1 306
127.255.255.255 255.255.255.255 On-link 127.0.0.1 306
172.18.0.0 255.255.0.0 On-link 10.10.0.16 276
10.10.0.16 255.255.255.255 On-link 10.10.0.16 276
10.10.255.255 255.255.255.255 On-link 10.10.0.16 276
224.0.0.0 240.0.0.0 On-link 127.0.0.1 306
224.0.0.0 240.0.0.0 On-link 10.10.0.16 276
224.0.0.0 240.0.0.0 On-link 10.20.0.16 296
255.255.255.255 255.255.255.255 On-link 127.0.0.1 306
255.255.255.255 255.255.255.255 On-link 10.10.0.16 276
255.255.255.255 255.255.255.255 On-link 10.20.0.16 296
===========================================================================
Persistent Routes:
Network Address Netmask Gateway Address Metric
0.0.0.0 0.0.0.0 10.10.0.1 Default
0.0.0.0 0.0.0.0 10.20.0.1 Default