Foot Brake won't catch properly on 5AT 2004 coupe
 

So I bought my 2004 5AT G35 coupe a little over half a year ago, and a few months ago I've noticed that the parking brake doesn't like to catch/reengage after I've let the car sit for a while (basically it wont make the clicking noises when I press it down and it bounces back up after I let it go). I basically have to pump the foot brake a ton to get it to catch eventually, though it holds the car just fine even when it doesn't catch so I don't think it's the cable. Also once it starts catching, it'll basically always catch for a while until I leave it on and let the car sit for a few hours or overnight. Is there anything else I can check to make it catch properly every time other than the cable?

I'd spray the latching mechanism with some silicone spray.