A trustee of a Nelson Mandela charity said he will leave the organization after being caught up in a scandal involving a supermodel, a warlord and rough diamonds.