Supplementary Materials for "Learning to Distort Images using Generative Adversarial Networks"
Updates
(12/20, 2020) Matlab implementation of the JND_{NSS} index: jsd_nss.m
(11/24, 2020) Image source files of the results on validation set: JPEG, JPEG2000, WN, PN
(11/16, 2020) Aside from the subjective comparisons, we also include the objective results for each example. Note that PSNR/SSIM are calculated from the reference picture and distorted picture, so there are two PSNR/SSIM's. While JNDNSS is calculated from two distorted pictures (true distortion and GAN).
Results
JPEG
| Pristine image x |
Ground truth distortion xgt |
GAN-synthesized distortion xgan |
| JNDNSS(xgt,xgan) = 0.0224 |
PSNR(x,xgt ) = 25.09 |
PSNR(x,xgan) = 22.63 |
| SSIM(x,xgt ) = 0.8588 |
SSIM(x,xgan) = 0.7112 |
| JNDNSS(xgt,xgan) = 0.0192 |
PSNR(x,xgt ) = 23.72 |
PSNR(x,xgan) = 22.10 |
| SSIM(x,xgt ) = 0.7577 |
SSIM(x,xgan) = 0.6339 |
| JNDNSS(xgt,xgan) = 0.0082 |
PSNR(x,xgt ) = 26.30 |
PSNR(x,xgan) = 21.79 |
| SSIM(x,xgt ) = 0.8913 |
SSIM(x,xgan) = 0.5718 |
| JNDNSS(xgt,xgan) = 0.0136 |
PSNR(x,xgt ) = 24.10 |
PSNR(x,xgan) = 21.55 |
| SSIM(x,xgt ) = 0.8542 |
SSIM(x,xgan) = 0.7096 |
| JNDNSS(xgt,xgan) = 0.0106 |
PSNR(x,xgt ) = 26.01 |
PSNR(x,xgan) = 23.98 |
| SSIM(x,xgt ) = 0.8856 |
SSIM(x,xgan) = 0.7994 |
| JNDNSS(xgt,xgan) = 0.0241 |
PSNR(x,xgt ) = 22.67 |
PSNR(x,xgan) = 20.11 |
| SSIM(x,xgt ) = 0.8837 |
SSIM(x,xgan) = 0.7459 |
| JNDNSS(xgt,xgan) = 0.0204 |
PSNR(x,xgt ) = 23.65 |
PSNR(x,xgan) = 21.21 |
| SSIM(x,xgt ) = 0.7243 |
SSIM(x,xgan) = 0.6115 |
| JNDNSS(xgt,xgan) = 0.0127 |
PSNR(x,xgt ) = 23.58 |
PSNR(x,xgan) = 21.67 |
| SSIM(x,xgt ) = 0.8526 |
SSIM(x,xgan) = 0.7208 |
| JNDNSS(xgt,xgan) = 0.0021 |
PSNR(x,xgt ) = 26.36 |
PSNR(x,xgan) = 23.74 |
| SSIM(x,xgt ) = 0.8538 |
SSIM(x,xgan) = 0.7942 |
| JNDNSS(xgt,xgan) = 0.0120 |
PSNR(x,xgt ) = 24.98 |
PSNR(x,xgan) = 19.87 |
| SSIM(x,xgt ) = 0.9164 |
SSIM(x,xgan) = 0.8004 |
| JNDNSS(xgt,xgan) = 0.0078 |
PSNR(x,xgt ) = 25.04 |
PSNR(x,xgan) = 23.17 |
| SSIM(x,xgt ) = 0.7466 |
SSIM(x,xgan) = 0.7309 |
| JNDNSS(xgt,xgan) = 0.0245 |
PSNR(x,xgt ) = 23.40 |
PSNR(x,xgan) = 21.21 |
| SSIM(x,xgt ) = 0.8085 |
SSIM(x,xgan) = 0.7132 |
| JNDNSS(xgt,xgan) = 0.0039 |
PSNR(x,xgt ) = 25.25 |
PSNR(x,xgan) = 23.50 |
| SSIM(x,xgt ) = 0.8572 |
SSIM(x,xgan) = 0.7240 |
| JNDNSS(xgt,xgan) = 0.0052 |
PSNR(x,xgt ) = 27.79 |
PSNR(x,xgan) = 25.23 |
| SSIM(x,xgt ) = 0.8744 |
SSIM(x,xgan) = 0.8108 |
❮
❯
JPEG 2000 (J2K)
| Pristine image x |
Ground truth distortion xgt |
GAN-synthesized distortion xgan |
| JNDNSS(xgt,xgan) = 0.0020 |
PSNR(x,xgt ) = 24.99 |
PSNR(x,xgan) = 24.31 |
| SSIM(x,xgt ) = 0.8566 |
SSIM(x,xgan) = 0.8422 |
| JNDNSS(xgt,xgan) = 0.0019 |
PSNR(x,xgt ) = 24.27 |
PSNR(x,xgan) = 22.63 |
| SSIM(x,xgt ) = 0.7816 |
SSIM(x,xgan) = 0.7364 |
| JNDNSS(xgt,xgan) = 0.0036 |
PSNR(x,xgt ) = 27.89 |
PSNR(x,xgan) = 23.31 |
| SSIM(x,xgt ) = 0.9211 |
SSIM(x,xgan) = 0.8207 |
| JNDNSS(xgt,xgan) = 0.0029 |
PSNR(x,xgt ) = 23.74 |
PSNR(x,xgan) = 23.47 |
| SSIM(x,xgt ) = 0.8493 |
SSIM(x,xgan) = 0.8640 |
| JNDNSS(xgt,xgan) = 0.0039 |
PSNR(x,xgt ) = 28.44 |
PSNR(x,xgan) = 24.96 |
| SSIM(x,xgt ) = 0.9330 |
SSIM(x,xgan) = 0.8805 |
| JNDNSS(xgt,xgan) = 0.0032 |
PSNR(x,xgt ) = 21.64 |
PSNR(x,xgan) = 21.73 |
| SSIM(x,xgt ) = 0.8554 |
SSIM(x,xgan) = 0.8657 |
| JNDNSS(xgt,xgan) = 0.0041 |
PSNR(x,xgt ) = 23.80 |
PSNR(x,xgan) = 22.41 |
| SSIM(x,xgt ) = 0.7347 |
SSIM(x,xgan) = 0.7188 |
| JNDNSS(xgt,xgan) = 0.0010 |
PSNR(x,xgt ) = 23.67 |
PSNR(x,xgan) = 23.12 |
| SSIM(x,xgt ) = 0.8329 |
SSIM(x,xgan) = 0.8354 |
| JNDNSS(xgt,xgan) = 0.0013 |
PSNR(x,xgt ) = 28.63 |
PSNR(x,xgan) = 26.37 |
| SSIM(x,xgt ) = 0.9238 |
SSIM(x,xgan) = 0.9181 |
| JNDNSS(xgt,xgan) = 0.0029 |
PSNR(x,xgt ) = 25.69 |
PSNR(x,xgan) = 24.45 |
| SSIM(x,xgt ) = 0.9281 |
SSIM(x,xgan) = 0.9156 |
| JNDNSS(xgt,xgan) = 0.0045 |
PSNR(x,xgt ) = 25.67 |
PSNR(x,xgan) = 24.37 |
| SSIM(x,xgt ) = 0.8425 |
SSIM(x,xgan) = 0.8222 |
| JNDNSS(xgt,xgan) = 0.0042 |
PSNR(x,xgt ) = 22.81 |
PSNR(x,xgan) = 22.13 |
| SSIM(x,xgt ) = 0.7858 |
SSIM(x,xgan) = 0.7776 |
| JNDNSS(xgt,xgan) = 0.0016 |
PSNR(x,xgt ) = 26.59 |
PSNR(x,xgan) = 25.33 |
| SSIM(x,xgt ) = 0.8748 |
SSIM(x,xgan) = 0.8478 |
| JNDNSS(xgt,xgan) = 0.0015 |
PSNR(x,xgt ) = 34.32 |
PSNR(x,xgan) = 27.43 |
| SSIM(x,xgt ) = 0.9775 |
SSIM(x,xgan) = 0.9162 |
❮
❯
Gaussian white noise (WN)
| Pristine image x |
Ground truth distortion xgt |
GAN-synthesized distortion xgan |
| JNDNSS(xgt,xgan) = 0.0010 |
PSNR(x,xgt ) = 17.81 |
PSNR(x,xgan) = 18.21 |
| SSIM(x,xgt ) = 0.4058 |
SSIM(x,xgan) = 0.4351 |
| JNDNSS(xgt,xgan) = 0.0005 |
PSNR(x,xgt ) = 17.31 |
PSNR(x,xgan) = 17.51 |
| SSIM(x,xgt ) = 0.4399 |
SSIM(x,xgan) = 0.4529 |
| JNDNSS(xgt,xgan) = 0.0008 |
PSNR(x,xgt ) = 17.01 |
PSNR(x,xgan) = 17.40 |
| SSIM(x,xgt ) = 0.4657 |
SSIM(x,xgan) = 0.4883 |
| JNDNSS(xgt,xgan) = 0.0005 |
PSNR(x,xgt ) = 17.92 |
PSNR(x,xgan) = 18.13 |
| SSIM(x,xgt ) = 0.5241 |
SSIM(x,xgan) = 0.5349 |
| JNDNSS(xgt,xgan) = 0.0011 |
PSNR(x,xgt ) = 16.94 |
PSNR(x,xgan) = 17.36 |
| SSIM(x,xgt ) = 0.4811 |
SSIM(x,xgan) = 0.5107 |
| JNDNSS(xgt,xgan) = 0.0007 |
PSNR(x,xgt ) = 17.19 |
PSNR(x,xgan) = 17.59 |
| SSIM(x,xgt ) = 0.6565 |
SSIM(x,xgan) = 0.6749 |
| JNDNSS(xgt,xgan) = 0.0006 |
PSNR(x,xgt ) = 16.96 |
PSNR(x,xgan) = 17.36 |
| SSIM(x,xgt ) = 0.4492 |
SSIM(x,xgan) = 0.4714 |
| JNDNSS(xgt,xgan) = 0.0009 |
PSNR(x,xgt ) = 17.26 |
PSNR(x,xgan) = 17.67 |
| SSIM(x,xgt ) = 0.5701 |
SSIM(x,xgan) = 0.5958 |
| JNDNSS(xgt,xgan) = 0.0003 |
PSNR(x,xgt ) = 17.91 |
PSNR(x,xgan) = 17.97 |
| SSIM(x,xgt ) = 0.5265 |
SSIM(x,xgan) = 0.5331 |
| JNDNSS(xgt,xgan) = 0.0005 |
PSNR(x,xgt ) = 17.97 |
PSNR(x,xgan) = 18.26 |
| SSIM(x,xgt ) = 0.6758 |
SSIM(x,xgan) = 0.6909 |
| JNDNSS(xgt,xgan) = 0.0008 |
PSNR(x,xgt ) = 17.39 |
PSNR(x,xgan) = 17.75 |
| SSIM(x,xgt ) = 0.3604 |
SSIM(x,xgan) = 0.3760 |
| JNDNSS(xgt,xgan) = 0.0004 |
PSNR(x,xgt ) = 17.66 |
PSNR(x,xgan) = 17.78 |
| SSIM(x,xgt ) = 0.5180 |
SSIM(x,xgan) = 0.5254 |
| JNDNSS(xgt,xgan) = 0.0005 |
PSNR(x,xgt ) = 18.04 |
PSNR(x,xgan) = 18.15 |
| SSIM(x,xgt ) = 0.3814 |
SSIM(x,xgan) = 0.3853 |
| JNDNSS(xgt,xgan) = 0.0006 |
PSNR(x,xgt ) = 17.40 |
PSNR(x,xgan) = 17.65 |
| SSIM(x,xgt ) = 0.3804 |
SSIM(x,xgan) = 0.4115 |
❮
❯
Pink noise (PN)
| Pristine image x |
Ground truth distortion xgt |
GAN-synthesized distortion xgan |
| JNDNSS(xgt,xgan) = 0.0008 |
PSNR(x,xgt ) = 21.02 |
PSNR(x,xgan) = 19.74 |
| SSIM(x,xgt ) = 0.5784 |
SSIM(x,xgan) = 0.5675 |
| JNDNSS(xgt,xgan) = 0.0040 |
PSNR(x,xgt ) = 19.71 |
PSNR(x,xgan) = 19.92 |
| SSIM(x,xgt ) = 0.6061 |
SSIM(x,xgan) = 0.6334 |
| JNDNSS(xgt,xgan) = 0.0059 |
PSNR(x,xgt ) = 19.66 |
PSNR(x,xgan) = 19.49 |
| SSIM(x,xgt ) = 0.6402 |
SSIM(x,xgan) = 0.6588 |
| JNDNSS(xgt,xgan) = 0.0006 |
PSNR(x,xgt ) = 21.48 |
PSNR(x,xgan) = 20.15 |
| SSIM(x,xgt ) = 0.7151 |
SSIM(x,xgan) = 0.6609 |
| JNDNSS(xgt,xgan) = 0.0087 |
PSNR(x,xgt ) = 19.86 |
PSNR(x,xgan) = 20.00 |
| SSIM(x,xgt ) = 0.6594 |
SSIM(x,xgan) = 0.6620 |
| JNDNSS(xgt,xgan) = 0.0017 |
PSNR(x,xgt ) = 20.40 |
PSNR(x,xgan) = 20.00 |
| SSIM(x,xgt ) = 0.8198 |
SSIM(x,xgan) = 0.8017 |
| JNDNSS(xgt,xgan) = 0.0024 |
PSNR(x,xgt ) = 19.86 |
PSNR(x,xgan) = 19.70 |
| SSIM(x,xgt ) = 0.6402 |
SSIM(x,xgan) = 0.6576 |
| JNDNSS(xgt,xgan) = 0.0037 |
PSNR(x,xgt ) = 19.99 |
PSNR(x,xgan) = 19.12 |
| SSIM(x,xgt ) = 0.7385 |
SSIM(x,xgan) = 0.7291 |
| JNDNSS(xgt,xgan) = 0.0055 |
PSNR(x,xgt ) = 20.63 |
PSNR(x,xgan) = 20.64 |
| SSIM(x,xgt ) = 0.6560 |
SSIM(x,xgan) = 0.6709 |
| JNDNSS(xgt,xgan) = 0.0021 |
PSNR(x,xgt ) = 20.65 |
PSNR(x,xgan) = 19.91 |
| SSIM(x,xgt ) = 0.7814 |
SSIM(x,xgan) = 0.7752 |
| JNDNSS(xgt,xgan) = 0.0059 |
PSNR(x,xgt ) = 19.92 |
PSNR(x,xgan) = 19.51 |
| SSIM(x,xgt ) = 0.4949 |
SSIM(x,xgan) = 0.4868 |
| JNDNSS(xgt,xgan) = 0.0023 |
PSNR(x,xgt ) = 20.54 |
PSNR(x,xgan) = 19.85 |
| SSIM(x,xgt ) = 0.6828 |
SSIM(x,xgan) = 0.6643 |
| JNDNSS(xgt,xgan) = 0.0023 |
PSNR(x,xgt ) = 21.08 |
PSNR(x,xgan) = 19.91 |
| SSIM(x,xgt ) = 0.5198 |
SSIM(x,xgan) = 0.5065 |
| JNDNSS(xgt,xgan) = 0.0116 |
PSNR(x,xgt ) = 20.07 |
PSNR(x,xgan) = 19.71 |
| SSIM(x,xgt ) = 0.5784 |
SSIM(x,xgan) = 0.5539 |
❮
❯