Even though smartphone manufacturers have done wonders with the cameras they equip in their contemporary flagships, every user still suffers the bane of noisy photos every once in a while. This is because the camera sensors in our handsets still need to be small enough to fit. They don't have the physical capability of collecting enough light at a reasonable time, so the ISO is boosted in order to compensate. ISO boosts will brighten the overall image, but also introduce noise. This is, of course, rarely a problem when out in the Summer sun, but try to take a selfie in a bar and you get the results we are talking about.
If exposure is not the issue, it's zooming — we often want to capture something that is at a relative distance from us. However, there's only so much a tiny sensor with a small lens can do. Regardless of our smartphones ability to churn out high-res photos, zoom in or crop these photos and you will see varying degrees of noise digging into the details and watering down whatever it is you wanted to zoom in on.
For years now, manufacturers have been compensating for these hardware limitations by developing complex algorithms that work to clear up noise and sharpen images digitally. These work out to varying degrees. Google's HDR+ deserves a shoutout here, but Samsung, LG, Apple, and other major players also have done a lot of magic with their own software implementations.
However, it appears that the next step in smartphone camera evolution is nigh. Researchers from Nvidia, Aalto University, and MIT have developed a complex AI algorithm that takes image de-noising to the next level.
The team set out to develop a software solution based on deep learning techniques that can fix noisy photos without the need for "clean" samples to base its work on.
According to the researchers, the project was a success and sometimes even performed better than similar algorithms that use a clean sample in their de-noising processes. A number of samples, as well as a YouTube video, have been provided. As we can see, the results are definitely impressive.
Recommended Stories
Sure, they look a little softer than the actual target image, but the AI seems to have done an impeccable job at restoring the images. It's worth noting that it has also been used to remove randomly positioned text from various photos and did so with great success. Could this spell doom for watermarks?
The AI was able to be trained to perform its task in minutes and the actual de-noising of images took milliseconds. The team used Nvidia Tesla P100 GPUs with Nvidia's TensorFlow deep learning framework, accelerated by the cuDNN. In other words, that's data-center-grade hardware and we don't expect to see this AI working on smartphones or personal computers soon... but it's definitely on the horizon.
Preslav, a member of the PhoneArena team since 2014, is a mobile technology enthusiast with a penchant for integrating tech into his hobbies and work. Whether it's writing articles on an iPad Pro, recording band rehearsals with multiple phones, or exploring the potential of mobile gaming through services like GeForce Now and Steam Link, Preslav's approach is hands-on and innovative. His balanced perspective allows him to appreciate both Android and iOS ecosystems, focusing on performance, camera quality, and user experience over brand loyalty.
Recommended Stories
Loading Comments...
COMMENT
All comments need to comply with our
Community Guidelines
Phonearena comments rules
A discussion is a place, where people can voice their opinion, no matter if it
is positive, neutral or negative. However, when posting, one must stay true to the topic, and not just share some
random thoughts, which are not directly related to the matter.
Things that are NOT allowed:
Off-topic talk - you must stick to the subject of discussion
Offensive, hate speech - if you want to say something, say it politely
Spam/Advertisements - these posts are deleted
Multiple accounts - one person can have only one account
Impersonations and offensive nicknames - these accounts get banned
Moderation is done by humans. We try to be as objective as possible and moderate with zero bias. If you think a
post should be moderated - please, report it.
Have a question about the rules or why you have been moderated/limited/banned? Please,
contact us.
Things that are NOT allowed: