Smoothing interior questions

i'm in the process of smoothing out my interior to be painted. is it really necessary to sand it smooth as a babys ass? wont the primer build up enough to fill in the really minor texture? what about a high build primer?