The Ilmenau University of Technology, Department of Virtual Worlds call it “Diminished Reality” – they are able to remove objects from live video in realtime… almost like a content-aware fill that happens instantly over all frames! crazy. Read more at PopSci.
“The Diminished reality technology is done in two steps: First, the object to be removed in each camera image is detected, that is, it is determined that part of the overall picture that has to be replaced. The outlines of the detected object define the image area, the individual image pixels have to be replaced. This occurs after a single selection of the object completely automatically. In a second step, now fills the image synthesis from the previously defined image area with image information to the rest of the image be removed. Thus, the viewer, the new image as “real” accepted, special procedures ensure that the area to be filled to the rest of image is consistent, ie to “match”. The Diminished reality system provides both tasks within a few milliseconds and can therefore be used not only for static images, but especially for live video streams.”
