How a neural network algorithm sees Times Square

AI scientist Clayton Blythe fed a video of someone walking around Times Square into an AI program that’s been trained to detect objects (aka “a state of the art object detection framework called NASNet from Google Research”) and made a video showing what the algorithm sees in realtime — cars, traffic lights, people, bicycles, trucks, etc. — along with its confidence in what it sees. Love the cheeky soundtrack…a remix of Daft Punk’s Something About Us.

See also a neural network tries to identify objects in Star Trek:TNG intro. (via prosthetic knowledge)

Update: Well, it looks like the video is offline for whatever reason. You can see some animated screengrabs at prosthetic knowledge.

• artificial intelligence
• Clayton Blythe
• NYC
• video