I managed to take the average path calculation time down from 4-8 milliseconds to 100-200 microseconds. All in a day's work!