Trouble lining up labels of different scales

I’ve tried various scaling, anchorpoints, etc, but can’t seem to get this to work.

I’m laying down a label with a scale of 1, and I want to add another label using the same font, but a scale of 0.6 next to it as a description). I’d like the bottom of both labels to line up, but the second label is consistently below the first label.

Any ideas? Thanks!