"No...no, if your heart's not in it, it's not really gonna do me any good, huh?" It's a halfhearted joke. "If you really feel it, then go for it; I can take it."

But he can hear some implication. That yes, he should have showed up. That under different circumstances, Phil would've been pissed about it.