"Fatiguing day, isn't it, Lady Victoria?", he asked with his usual stoic tone, unlike her not wanting to show weakness