That's a good way of looking at it. In that case, I think the solution is to narrate fall damage just as you would anything else. If you roll low, then maybe the falling creature caught an updraft that slowed them just enough, or snagged on a branch, or hit a slope that redirected some of the force.