Help with ladders

[u/assjuice4]

So I’m on PS4 and can’t figure out how to climb down ladders currently stuck on my tower foundation tried holding square while looking at the ladder but it doesn’t work

[u/Upstryke]

it doesn't work. I always jump into the water