Is this play money? Then you should definately call.
I think button has QJ or 76, as those are hands that he might not raise with PF but has a reasonable hand. 76 is more likely. You made a good fold, far too many hands have you beat here, and though he could have flush draw it is more likely he has you dominated.