Oswald in the doorway: the blog of the Oswald Innocence Campaign, by Ralph Cinque

And, let's remember that Baker went up a flight when he climbed the entrance steps. The "1st" floor of the TSBD was not at ground level.  And then, he went up two runs of stairs to get to the lunch room. So, that could easily have felt like the 3rd floor to him.