That was pretty much the story of Wilshire Boulevard, in it's early days, as seen here. Not a single office tower. This photo was taken between 1930- 1940, looking west from New Hampshire Ave, with a clear shot of the Gaylord, center right. And WOW, that 'Indian Chief' neon sign!
(photo courtesy of the USC Digital Library.)