I haven't listened to many, but the INFOSEC podcast I love is Down The Security Rabbit Hole. No ads, great audio quality, fantastic guests/interviews, and I find myself agreeing with just about everything they have to say.
My favorite podcast is Down the Security Rabbit Hole (DtSR) because it talks about important topics that are not technical, but just as important for a well rounded security professional.
One to consider is Brakeing Down Security - no ads http://www.brakeingsecurity.com
In addition to that I listen to Down The Security Rabbit Hole, Security Now, and Cyberwire already mentioned.
I have a long commute but those fill it up with a little time for other things to listen to that are non-security related. I will be watching this list and the other mentioned a few posts back to see if there are some I may switch over to.
Thanks for providing this topic!
Great input. My favorites include Security Now, Internet Storm Center, Southern Fried Security (policy type discussions) and Hak5 (pen testing)