When the mail comes from different mail servers, Postgrey treats each as a new server.
You can use the whitelist feature if this is a regular problem.
I made this guide. It covers one specific scenario and the solution may not perfectly align with your problem, but the general idea of using a whitelist is what I was hoping to communicate:
Odds are their admins already know about the problem and don’t care to fix it.