Deuteronomy 12:2-3

2Ye shall utterly destroy all the places, in which the nations which ye shall possess served their gods, upon the high mountains, and upon the hills, and under every green tree:1

3And ye shall overthrow their altars, and break their pillars, and burn their groves with fire; and ye shall hew down the graven images of their gods, and destroy the names of them out of that place.2