A portrait of Mark Esper from his time as Secretary of the Army placed in the Pentagon has been removed as of Wednesday.