You do need to worry about your calcium level. If it is too low, you can damage some of the materials in your pump and heater, etc. Usually, if it is too high, you can get scaling - especially with high TA and pH.
You can lower TA without lowering pH. Read the directions on the bottle or from your local dealer. You will notice lowering of pH initially, but with a high TA, the pH will come back. Once you get the TA in line, the pH will stabilize and not "bounce."