By adding in an extra layer, you should have all bases covered. A shirt for the day, a warmer layer such as a hoodie or cardigan and a waterproof for any stormy spells.
Even though we are throwing in warmer layers in the fall for the evenings, the days can still be warm. So, you’ll want light layers that can be easily removed.