The third party being everyone else in the neighborhood. When a house becomes vacant either due to foreclosure or someone walking away from their mortgage it lowers the property value of everybody else in the neighborhood (it also decreases the property tax base.)

Any discussion on morality should take in consideration the harms of the people directly involved as well as indirectly involved. Harms are still harms no matter how casual the connection is.