Non-local means
![](http://upload.wikimedia.org/wikipedia/commons/thumb/7/74/Non-local_means_denoising_example.png/400px-Non-local_means_denoising_example.png)
Non-local means is an algorithm in image processing for image denoising. Unlike "local mean" filters, which take the mean value of a group of pixels surrounding a target pixel to smooth the image, non-local means filtering takes a mean of all pixels in the image, weighted by how similar these pixels are to the target pixel. This results in much greater post-filtering clarity, and less loss of detail in the image compared with local mean algorithms.[1]
If compared with other well-known denoising techniques, non-local means adds "method noise" (i.e. error in the denoising process) which looks more like white noise, which is desirable because it is typically less disturbing in the denoised product.[2] Recently non-local means has been extended to other image processing applications such as deinterlacing,[3] view interpolation,[4] and depth maps regularization.[5]
Definition
Suppose is the area of an image, and and are two points within the image. Then, the algorithm is:[6]
where is the filtered value of the image at point , is the unfiltered value of the image at point , is the weighting function, and the integral is evaluated .
is a normalizing factor, given by
Common weighting functions
The purpose of the weighting function, , is to determine how closely related the image at the point is to the image at the point . It can take many forms.
Gaussian
The Gaussian weighting function sets up a normal distribution with a mean, and a variable standard deviation:[7]
where is the filtering parameter (i.e., standard deviation) and is the local mean value of the image point values surrounding .
Discrete algorithm
For an image, , with discrete pixels, a discrete algorithm is required.
where, once again, is the unfiltered value of the image at point . is given by:
Then, for a Gaussian weighting function,
where is given by:
where and is a square region of pixels surrounding and is the number of pixels in the region .
Efficient implementation
The computational complexity of the non-local means algorithm is quadratic in the number of pixels in the image, making it particularly expensive to apply directly. Several techniques were proposed to speed up execution. One simple variant consists of restricting the computation of the mean for each pixel to a search window centred on the pixel itself, instead of the whole image. Another approximation uses summed-area tables and fast Fourier transform to calculate the similarity window between two pixels, speeding up the algorithm by a factor of 50 while preserving comparable quality of the result.[8]
See also
- Anisotropic diffusion
- Digital image processing
- Noise reduction
- Nonlocal operator
- Signal processing
- Total variation denoising
- Bounded variation
- Total variation
References
- ^ Buades, Antoni (20–25 June 2005). "A non-local algorithm for image denoising". 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05). Vol. 2. pp. 60–65. CiteSeerX 10.1.1.103.9157. doi:10.1109/CVPR.2005.38. ISBN 978-0-7695-2372-9. S2CID 11206708.
{{cite book}}
:|journal=
ignored (help) - ^ Buades, Antoni. "On image denoising methods" (PDF). 123 Seminars Only.
- ^ Dehghannasiri, R.; Shirani, S. (2012). "A novel de-interlacing method based on locally-adaptive Nonlocal-means". 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR). pp. 1708–1712. doi:10.1109/ACSSC.2012.6489324. ISBN 978-1-4673-5051-8. S2CID 20709950.
- ^ Dehghannasiri, R.; Shirani, S. (2013). "A view interpolation method without explicit disparity estimation". 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW). pp. 1–4. doi:10.1109/ICMEW.2013.6618274. ISBN 978-1-4799-1604-7. S2CID 32025000.
- ^ Martinello, Manuel; Favaro, Paolo. "Depth Estimation From a Video Sequence with Moving and Deformable Objects" (PDF). IET Image Processing Conference.
- ^ Buades, Antoni (2011). "Non-Local Means Denoising". Image Processing on Line. 1: 208–212. doi:10.5201/ipol.2011.bcm_nlm. S2CID 34599104.
- ^ Buades, Antoni. "On image denoising methods (page 10)" (PDF). 123 Seminars Only.
- ^ Wang, Jin; Guo, Yanwen; Ying, Yiting; Liu, Yanli; Peng, Qunsheng (2006). "Fast non-local algorithm for image denoising". International Conference on Image Processing. pp. 1429–1432.
External links
- Recent trends in denoising tutorial
- Non-local image denoising, with code and online demonstration
- Patents citing 2005 IEEE paper where NLM was claimed as a new technique[dead link]
- v
- t
- e
- Acoustic quieting
- Distortion
- Noise cancellation
- Noise control
- Noise measurement
- Noise power
- Noise reduction
- Noise temperature
- Phase distortion
- Audio
- Buildings
- Electronics
- Environment
- Government regulation
- Human health
- Images
- Radio
- Rooms
- Ships
- Sound masking
- Transportation
- Video
- Additive white Gaussian noise (AWGN)
- Atmospheric noise
- Background noise
- Brownian noise
- Burst noise
- Cosmic noise
- Flicker noise
- Gaussian noise
- Grey noise
- Infrasound
- Jitter
- Johnson–Nyquist noise (thermal noise)
- Pink noise
- Quantization error (or q. noise)
- Shot noise
- White noise
- Coherent noise
terms
- Channel noise level
- Circuit noise level
- Effective input noise temperature
- Equivalent noise resistance
- Equivalent pulse code modulation noise
- Impulse noise (audio)
- Noise figure
- Noise floor
- Noise shaping
- Noise spectral density
- Noise, vibration, and harshness (NVH)
- Phase noise
- Pseudorandom noise
- Statistical noise
- Carrier-to-noise ratio (C/N)
- Carrier-to-receiver noise density (C/kT)
- dBrnC
- Eb/N0 (energy per bit to noise density)
- Es/N0 (energy per symbol to noise density)
- Modulation error ratio (MER)
- Signal, noise and distortion (SINAD)
- Signal-to-interference ratio (S/I)
- Signal-to-noise ratio (S/N, SNR)
- Signal-to-noise ratio (imaging)
- Signal-to-interference-plus-noise ratio (SINR)
- Signal-to-quantization-noise ratio (SQNR)
- Contrast-to-noise ratio (CNR)
- List of noise topics
- Acoustics
- Colors of noise
- Interference (communication)
- Noise generator
- Spectrum analyzer
- Thermal radiation
methods
General | |
---|---|
2D (Image) |
|