Yeah I reckon you should keep Extension 1 English AT LEAST until year 12 and make another decision there.
Trust me, there is no real need to rush for year 11, this year should be one where you try things out.
You should definitely try to do 4U Maths (which you should)
And even if you don't...