A little rough around the edges.

So Caleb and I drove around our potentially future neighborhood today. It was a little rough around the edges. Should that put us off from buying? We checked the crime reports, past and current of the area, and nothing really goes on in the vicinity. I think if the Little old lady who lives there is safe we will have no problem... What do you think?