Ezekiel 9:5-6

5And as I listened, He said to the others, “Follow him through the city and start killing; do not show pity or spare anyone! 6Slaughter the old men, the young men and maidens, the women and children; but do not go near anyone who has the mark. Now begin at My sanctuary.”

So they began with the elders who were before the temple.