Researchers at Northeastern University have developed a way to extract audio from both still photos and muted videos using artificial intelligence.<\/p>\n\n\n\n
The research project is called Side Eye.<\/p>\n\n\n\n
\u201cMost of the cameras today have what’s called image stabilization hardware,\u201d said Kevin Fu, a professor of electrical and computer engineering at Northeastern University. \u201cIt turns out that when you speak near a camera lens that has some of these functions, a camera lens will move every so slightly, what’s called modulating your voice, onto the image and it changes the pixels.\u201d<\/p>\n\n\n\n
Basically, these small movements can be interpreted into rudimentary audio that Side Eye artificial intelligence can then interpret into individual words with high accuracies, according to the research team.<\/p>\n\n\n\n
\u201cYou’re able to get thousands of samples per second. What does this mean? It means you basically get a very rudimentary microphone,\u201d Fu said.<\/p>\n\n\n\n
Even though the recovered audio sounds muffled, some pieces of information can be extracted.<\/p>\n\n\n\n
\u201cThings like understanding what is the gender of the speaker, not on camera but in the room while the photograph or video is being taken, that’s nearly 100% accurate,\u201d he said.<\/p>\n\n\n\n
So what can technology like this be used for?<\/p>\n\n\n\n
\u201cFor instance in legal cases or in investigations of either proving or disproving somebody\u2019s presence, it gives you evidence that can be backed up by science of whether somebody was likely in the room speaking or not,\u201d Fu said.<\/p>\n\n\n\n
\u201cThis is one more tool we can use to bring authenticity to evidence, potentially to investigations, but also trying to solve criminal applications,\u201d he said.<\/p>\n","protected":false},"excerpt":{"rendered":"
Researchers at Northeastern University have developed a way to extract audio from both still photos and muted videos using artificial intelligence. The research project is called Side Eye. \u201cMost of the cameras today have what’s called image stabilization hardware,\u201d said Kevin Fu, a professor of electrical and computer engineering at Northeastern University. \u201cIt turns out […]<\/p>\n","protected":false},"author":2,"featured_media":22124,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_seopress_robots_primary_cat":"none","_seopress_titles_title":"","_seopress_titles_desc":"","_seopress_robots_index":"","footnotes":""},"categories":[2],"tags":[],"class_list":["post-22122","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news"],"rttpg_featured_image_url":{"full":["https:\/\/web3unplugged.io\/blog\/wp-content\/uploads\/2023\/10\/Untitled-4.jpg",1280,720,false],"landscape":["https:\/\/web3unplugged.io\/blog\/wp-content\/uploads\/2023\/10\/Untitled-4.jpg",1280,720,false],"portraits":["https:\/\/web3unplugged.io\/blog\/wp-content\/uploads\/2023\/10\/Untitled-4.jpg",1280,720,false],"thumbnail":["https:\/\/web3unplugged.io\/blog\/wp-content\/uploads\/2023\/10\/Untitled-4-150x150.jpg",150,150,true],"medium":["https:\/\/web3unplugged.io\/blog\/wp-content\/uploads\/2023\/10\/Untitled-4-300x169.jpg",300,169,true],"large":["https:\/\/web3unplugged.io\/blog\/wp-content\/uploads\/2023\/10\/Untitled-4-1024x576.jpg",1024,576,true],"1536x1536":["https:\/\/web3unplugged.io\/blog\/wp-content\/uploads\/2023\/10\/Untitled-4.jpg",1280,720,false],"2048x2048":["https:\/\/web3unplugged.io\/blog\/wp-content\/uploads\/2023\/10\/Untitled-4.jpg",1280,720,false],"post-thumbnail":["https:\/\/web3unplugged.io\/blog\/wp-content\/uploads\/2023\/10\/Untitled-4.jpg",747,420,false],"graptor-sq-xs":["https:\/\/web3unplugged.io\/blog\/wp-content\/uploads\/2023\/10\/Untitled-4.jpg",100,56,false]},"rttpg_author":{"display_name":"Admin CG","author_link":"https:\/\/web3unplugged.io\/blog\/author\/admin-cg\/"},"rttpg_comment":0,"rttpg_category":"news<\/a>","rttpg_excerpt":"Researchers at Northeastern University have developed a way to extract audio from both still photos and muted videos using artificial intelligence. The research project is called Side Eye. \u201cMost of the cameras today have what’s called image stabilization hardware,\u201d said Kevin Fu, a professor of electrical and computer engineering at Northeastern University. \u201cIt turns out…","_links":{"self":[{"href":"https:\/\/web3unplugged.io\/blog\/wp-json\/wp\/v2\/posts\/22122","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/web3unplugged.io\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/web3unplugged.io\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/web3unplugged.io\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/web3unplugged.io\/blog\/wp-json\/wp\/v2\/comments?post=22122"}],"version-history":[{"count":1,"href":"https:\/\/web3unplugged.io\/blog\/wp-json\/wp\/v2\/posts\/22122\/revisions"}],"predecessor-version":[{"id":22125,"href":"https:\/\/web3unplugged.io\/blog\/wp-json\/wp\/v2\/posts\/22122\/revisions\/22125"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/web3unplugged.io\/blog\/wp-json\/wp\/v2\/media\/22124"}],"wp:attachment":[{"href":"https:\/\/web3unplugged.io\/blog\/wp-json\/wp\/v2\/media?parent=22122"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/web3unplugged.io\/blog\/wp-json\/wp\/v2\/categories?post=22122"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/web3unplugged.io\/blog\/wp-json\/wp\/v2\/tags?post=22122"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}