His spokesperson accused UN and French troops of colluding with former rebels.
The UN and major powers have recognised Mr Gbagbo's rival, Alassane Ouattara, as the winner of the 28 November poll. Mr Gbagbo insists he has won.
Mr Ouattara is currently under UN protection at a hotel in Abidjan. In a statement read out on national television on Saturday, government spokeswoman Jacqueline Oble said Mr Gbagbo had "requested the immediate departure of the Unoci (UN mission) and the French forces supporting it". The UN force, she added, had "interfered seriously in the internal affairs of Ivory Coast".
Mr Ban responded with his own statement saying the UN mission "will fulfil its mandate and will continue to monitor and document any human rights violations, incitement to hatred and violence, or attacks on UN peacekeepers".
Earlier, the UN said one of its patrols had come under fire as it entered the mission compound in Abidjan, the country's main city.