Question, if a table loses players, how long should I sit there waiting for them to come back?

ie: This happened this morning. I sat down a 2 tables, looking to grind for an hour or so. At both tables, after about 30 hands or so people started leaving the tables. I've noticed that once a table gets <6 players, it usually won't fill back up.

On both tables I was down about $.25 (total of $.50) and both tables did it at the same time. I left without recouping that money to find bigger tables. I've noticed that this seems to happen mostly during the mornings and is one reason I really don't like playing when the sun is up.

Is this something others have noticed, how long should I sit there hoping the table will fill back up, and is this something I need to learn to take in stride?

__________________
Trons
JstTrons
Toyotatruck