Wipe the dirt off from the planter with a cleaning cloth. If you use soap, make sure the planter is rinsed with water afterwards.
Do not use other chemicals while cleaning.