It really depends on how you think. The maths in maths is different to the maths in physics. In maths, we use things like calculus and trigonometry to prove identities which can be applied to physics or engineering. While you do do that to a certain extent in physics, the maths in physics focuses more on a mathematical equation being a relationship between two concepts.
For example, if we take Newton's Second Law of Motion, Force = Mass x Acceleration (F = ma), we can deduce that for a force to exist, there must be both acceleration and mass - because if any of those are 0, then the force would be 0. However, we know that all objects have mass (generally speaking, don't get into the technical stuff like quantum particles or anti-matter), so in this equation, the only thing that really affects the force is the acceleration of an object. From this, we can deduce that an accerleration causes a force, and vice versa; a forces causes an acceleration. Or even to simplify it a little bit more; a force and an acceleration are the same concept, but only differ by the mass of said object.
You don't really do this stuff in maths in general. I'm doing Extension 2 Maths, and nothing comes into my head that is similar to the example I just gave. According to my physics teacher, they have dumbed down the course a lot from being 80% maths and 20% literacy to about 50-50 (40-60 if I daresay so). As long as you know how to solve an equation, then it should be fine. The hardest thing you'll ever have to do is the quadratic formula, and maybe if the question is being VERY specific (which doesn't happen), the sine/cosine rule when it comes to vector operations.