If a black hole is flying through space, lets say it gets flung out during an event with other black holes, Is there a speed in which the black holes gravity doesn't effect the stars around it?

Could a black hole move so fast we wouldn't be able to detect it a head of time?