Here in our thick atmosphere (atmo-plane), it is the air that the rocket is “pushing” against to create lift.
Without the thick air, the thrust from the rocket has nothing to push against.
It’s like doing a standing push up against a wall. You can easily push yourself away from the wall while standing.
Now remove the wall and give it a try.
Exactly