kick somebody upstairs

to promote somebody to a seemingly higher position that is actually less important or influential

to promote somebody to a rank or position that is officially superior, but in fact carries less power and opportunity for influence