This is the drivers side bolt.
I ended up having to just keep unscrewing that adjustment bolt like I thought, the bolt was just knackered. Finally got it haha. I've ordered 2 new bolts from Mazda part # 34-050, will give them a good grease before putting them back in.