Deserter has put together a map of pubs around South East London that don’t require booking. It’s a bit thin, but possibly of use none-the-less. Locally it lists Blythe Hill Tavern and The Dolphin, Sydenham.
We also know that the newly re-opened Perry Hill pub only requires booking for covered tables, and while booking isn’t necessary at these venues I guess it doesn’t ensure you can find a space at busy times: