What he's referring to is not leaves on the ground, but upturned leaves on the trees. The conventional wisdom says that a storm is coming when you can see the backs of the leaves.

It’s not leaves on the ground, it’s the leaves on the branches to watch. When they’re upturned, it means that the pressure system is changing, which often precludes rain.