Click on the page.. then there should be a list of groups, challenges, tags etc. that the page is entered in. Simply hit the red x next to the "Under 500 points!!"
I remove pages as soon as I see that they've gone over 500. But you are welcome to remove them yourself. :)
Sep 5, 2007