I don't think the challenge is bad, I just think it shouldn't be so punishing in unfun ways. Like not adding Fly because people say it makes the game too easy, and I don't get how, it makes it more tedious sure but where's the challenge in walking for hours to get somewhere? Sure you can get bikes and mounts for convenient travel but there's really no need to restrict something like that.
I feel the game can be challenging in other ways than bashing your head against a brick wall until you get past it, but that's just my 2c.