I don't remember Napoleon making any determined efforts to get either wife or son to join him on Elba, it didn't seem to be a top priority for him.
Susan