No you should be able to paint over the car primer just fine, the only thing you need is smooth coverage which you can get with almost any primer. I actually use a flat black paint for my stuff at times (mainly plastic, it tends to wear from pewter to easy).