I definitely dig a solid rhythm section, if it's funky, even better (everything from RATM to The Meters, Galactic, and Soulive, to Lettuce and Pigeons Playing Ping Pong).
But I also love the frenetic, syncopated flurry that jazz can be (or a local favorite, Critters Buggin).
But mostly, yeah, it's about the drummer for me. I'm a massive fan of Larnell Lewis, Alan Evans, and Stanton Moore especially.