Augmented Reality + NYC Open Data API integration

I'd like to make a project called "NYC - What Went Wrong."  Incorporating complaint data from NYC's Open Data set, I want to make an experience that allows users to walk around a neighborhood and see the story of the place through the gripes of it's residents.

Not all citizens feel comfortable lodging official complaints with the city, and their silence tells almost as descriptive a story as the places where residents are comfortable being more vocal.  But the complaints that do exist in the data set can help us trace back the changes and activity in a neighborhood, which is a story well suited to being told while actually walking around the neighborhood.