Easy off makes a cleaner that is safe for self cleaning ovens. It should say so on the label.

I was just going to make the same suggestion as Bayou-Mama.  I have used it on my self cleaning oven when I spilled pie juice all in the bottom one year.  Worked fine and my oven still self cleans!  I would just do it before Thanksgiving and bake a few things in it before your Thanksgiving meal.  When you first bake there is a weird smell and you might not want that in your home when you are baking and having guests over!!

Yay!  Thanks you guys!  Just went and bought the Easy off.  I have an exciting evening ahead of me ;)