The ladder is still there! See that pile of wood there? That's where we put the rungs. And if dig in that hole over there you might even find the extension we removed last week...

How was the task of building this project easier for them than it would now be for you or me? I feel like you are using the phrase “pulling up the ladder” in a way that doesn’t track with common usage.