I do everything then "varnish" as the final step.
I use a Tamiya Matt, Semi-gloss or Gloss spray lacquer as my final coat. It is simply superb and makes a HUGE difference to the final look of the mini.
Is there a possibility for you to post a with/without pictures?
I've never varnished any of my minis... yet...