Should I leave my troops in base while I'm away or does it still adds to defense even if my APCs are..

Troops only count as defenders if they are in your base. So leave them at home if you want to have the best defence. However if you are being attacked by a strong enemy it can be a better idea to move your troops out and take the hit otherwise you risk losing troops if your hospitals fill up.