Is there a way to get rid of troops if my upkeep is to much?

Click on the Shooting Range, Artillery Foundry, Barracks, etc. and choose Train. Choose the class of soldier you wish to dismiss from the list on the left, then click on the "i" next to the name of the class on the right. This brings up the Troop Details gui from which you can use a slider to choose how many troops of that class to dismiss.

I am trying to dismiss to no avail.

Click on the troops you want to dismiss. Next to the troop's title, you will see a little blue circle. Click the blue circle and dismiss the troops.

Yes, you can select them and choose dismiss. You can't do this while training or constructing