Old prejudice would have been replaced by new prejudices. After the fall of the final Bourbons there was hardly any more equality than before and class prejudice still remained, as they essentially did during the First empire and do throughout all social systems, if it's not one thing it's another. And it is obvious that the Bourbons failed utterly to restore France to its former state, if they'd succeeded France would hardly still have the Napoleonic Code.