He says he isn’t worried about keeping Cory and America because they won’t be a threat against him