He is indeed clever enough. Or at least impatient enough. Combine that with his usual marine suspiciousness and he's good to go. Besides, he wanted to make his menu fort early, seeing as Robin might be able to get Luffy cleaned up, but Smoker doubts she can make him stay that way.

So when the two pirates follow him in, he'll be leaning against the wall waiting for their table for three, and scoping out all directions and still making sure his "prisoners" don't run for it. Which also means he's figured out the escape routes. For completely different reasons, but still, they are analyzed and filed into his brain.