Once you've sent a Driver off to work, they won't be able to come back until they have completed their Route. You can only cancel a trip if you are the driver and exiting through the Pause menu.

If you want to know how much time left your Driver has, click the "Drivers" button on the main menu. You can click "Show" beside your driver list and it will provide you the remaining time for their trip.