Yeah, when the engine is running it will create a certain amount of blow-by past the rings and therefore pressurize the crankcase. How much blow-by, and therefore crankcase pressure, depends on how good of shape the rings are in........the more worn, the more blow-by.
The PCV valve is supposed to help alleviate those crankcase pressures, but as the engine wears, that pressure increases. So if your oil pan has a leak, then it will more than likely leak worse while the engine is running.......if not from increased pressures, then from the oil being slung around from the crankshaft spinning.
Also.......I never use a oil pan gasket! I use the grey RTV and never have any leaks from the oil pan. I don't believe Mazda used a pan gasket.......all the motors that I have pulled apart had the grey silicone on it.
I make sure the parts are 100% free of oil and then brush on a thin layer of RTV on both surfaces and assemble them. I do this to the windage tray-to-block as well as the oil pan-to-windage tray.
This is a B2600i motor, but it is just to show you how I do it......