Holy crap I was JUST about to post this very subject after a much sanctified run (that's the -75% thing, right?).
I would be fine if it were even just the numbers but you had to click onto the temple, just to save me moving the mouse as much.
Function keys would be better again though.
Another option could be alt+number, you hold alt and then the list of choices pops up somewhere with the numbers alongside them.
The only thing is this would make the insta-worship preparation much improved, since you don't even know where the temple is let alone have it uncovered. You could get around this by making it only work if the temple is shown, OR just let this be a (much needed) upgrade for insta-worship and bump the prep cost.