Mazda Exhaust Problems

My exhaust broke of just before my cat. convertor. Would I hurt anything if I took out my cat. and put a straight pipe to the muffler. I have heard that I could run into some back pressure problems (a lack of it).