When you upgrade or downgrade your pricing plan, you also start a new monthly contractual period immediately. You may cancel your subscription at the end of each monthly contractual period.
Since you can only downgrade to a lower pricing plan at the end of the current monthly contractual period, you can only cancel your subscription at the end of the new billing period.