Is there guidance for CPE credit for teaching security courses at universities?
Yes. See the CPE Guidance document. Briefly, you claim the hours for preparing (writing) the course, but not for teaching it. That is to prevent claiming new credit for teaching the same syllabus multiple times (classes).
It also prevents claiming CPE for teaching a course for which the syllabus was given to you to teach.
The CPE credit is for researching and writing the course content, analogous for writing an article or book.
Thank you!