Textured Walls

Photography is an important part of my work. Most of the time, I am seeking the unseen; decaying walls, burnt down materials, rotten details in your every day surroundings are textures that appeal to me. While they wouldn't even catch the usual passerby's attention, they completely hold my attention and I sometime even go back to those places with my DSLR to take proper pictures purposefully.

Now that is probably what I should do since these ones have be taken with my phone, hence the poor quality of the photographs. However, I sometimes feel awkward as when standing at the front door of a recently burnt down flat and the tenant suddenly pops out. How inappropriate is that?