I believe it was in the caves...where I didn't want to go
I wasn't at a high enough level to handle the whole lot of monsters. Can't remember what the name of the caves are, just that it's the site of the finale. I was able to sneak in and sneak back out, got the prismatic spell and then went back to finish the job. Good luck and sorry not being able to pinpoint it.