Depending on the structure of your object you might want to have a look at IdeaMaker. There's a
"displacement" function, which will use a given picture as a height map to create structure on walls.
Sometimes this is enough to completely avoid modelling anything on the outside...
https://www.youtube.com/watch?v=eFrSeppuGZg&t=262s