This is a scenario where having a few gauge blocks or 1-2-3 blocks comes in handy.
With the resolution of most dial and digital calipers being +/- 0.001 inch, a 1-2-3 block ground within +/- 0.0002 inch is a adequate check.
Example:
https://www.amazon.com/Taytools--Har.../dp/B081D9CYPJ