He definitely addresses Lelouch that way... *only watches raw so yep* so I think he's banking all his hopes on Lelouch taking over Britannia. If Charles went and ordered his own wife (of many other wives) to be assassinated, then I have little doubt that Jeremiah would prefer Lelouch over the emperor.
(no subject)
Oh yeah, and he only said that once. :O