The computer itself and the NTP installation are OK because we can see it syncing to other NTP servers. Likely you have a problem in the way the GPS using is connected. Some common errors is an inverted PPS, just flip it ad see if you gets better, it is really hard to see a 1Hz signal on a scope.