Should I decline my training contract offer?

I’ve had a better training contract offer, should I take it and decline the one I already have?

Has anyone been in the position where they have accepted a training contract with a firm (who do not pay the LPC) and then declined it later if there has been a better offer?