But, Oswald's arrest pants were black or at least dark enough to appear black in a black and white photo.
I have no reason to think that grey pants would appear like that.
So, that settles it: Oswald changed his pants.
And it means that Oswald definitely went to his room because where else could he have changed them? There is no place else.