The “ruling class” of today rely on the vast pools of labor that constantly increase with food production and industrialization. If something ever killed a significant percentage of the world and reversed population trends, they’d have much less leverage to continue their way of life as they do now. That doesn’t mean things will be good, but there can only be so much cannibalism before it is no longer in a ruling elite’s self interest.