三維高效率視訊編碼(3D-HEVC)為三維視訊編碼的最新標準，輸入端是具有彩色資訊與景深圖的視訊格式，景深圖可以幫助合成虛擬視角或合成3D立體影像。3D-HEVC有採用Depth Modelling Mode (DMM)以提升景深圖在畫面內編碼的效率，但同時增加了編碼的時間。為了加速景深圖的畫面內編碼速度，本論文提出並結合三種快速演算法以加速景深圖的畫面內編碼速度：第一，所提出之預測單位快速模式決策，透過邊界之總離均差平方和的計算，降低一般畫面內預測模式的數量；第二，所提出之DMM快速決策，透過邊界之變異數的計算來決定是否執行DMM；第三、所提出之編碼單位提早終止演算法，透過邊界之總離均差平方和與位元失真成本的臨界值設定相結合，提前決定是否繼續編碼單位的切割。本論文與對景深圖做快速演算法的參考文獻進行比較，在實驗結果顯示了我們在編碼速度與畫面品質上皆有更好的表現，在景深圖的編碼時間節省了56.08%，而合成視角BD-BR的表現僅增加了0.32%。

3D-HEVC is the latest coding standard for 3D video with the video format of multi-view texture plus depth map (MVD). The depth map is capable of assisting the synthesis of virtual views or rendering the stereo display. Depth modelling mode is adopted in 3D-HEVC to improve the efficiency of depth intra coding but increases the coding time. To accelerate the intra coding time of depth map, this thesis conceives three fast algorithms: Firstly, the proposed fast prediction unit(PU) mode decision reduces the number of the conventional intra prediction modes based on calculating the Total Sum of Squares (TSS) of the PU boundaries. Secondly, the proposed fast DMM decision makes use of the variances of the boundary pixels to determine the execution of DMM. Thirdly, the proposed Coding Unit (CU) early termination algorithm decides whether to further split the current CU by utilizing the thresholds of TSS and the rate-distortion cost(RD-cost). The experimental results show that the proposed algorithm provides better performance in coding speed and image quality than previous work. The coding time of the depth map is saved by 56.08%, while the BD-BR is only increased by 0.32%.

摘要 ............................................. i
Abstract ........................................ ii
目錄 ............................................. iii
表目錄 ........................................... vi
圖目錄 ........................................... viii
第一章 緒論........................................ 1
1.1 視訊編碼發展與架構 ............................. 1
1.2 H.265/HEVC壓縮標準概論 ......................... 9
1.3 研究動機 ....................................... 13
1.4 論文架構 ....................................... 14
第二章 景深圖與畫面內編碼之文獻探討 ................... 15
2.1 景深圖編碼概論 .................................. 15
2.2 景深圖編碼模式 .................................. 16
2.3 景深畫面內編碼之預測流程 ......................... 27
2.4 相關文獻探討 .................................... 28
第三章 所提出之景深圖之畫面內編碼快速演算法 ........... 33
3.1 景深圖分析 ..................................... 33
3.2 預測單位之快速模式決策 .......................... 34
3.2.1 基於總離均差平方和之邊界複雜度計算 ............. 34
3.2.2 邊界複雜度臨界值的選擇與分析 ................... 34
3.2.3 預測單位快速模式決策之演算法流程 ............... 40
3.3 DMM快速決策演算法 ............................... 42
3.3.1 基於邊界變異數之DMM快速模式決策 ................ 43
3.3.2 邊界變異數臨界值的選擇與分析 ................... 46
3.3.3 DMM快速決策之演算法流程 ....................... 50
3.4 編碼單位提早終止演算法 ........................... 52
3.4.1 基於邊界總離均差平方和之編碼單位提早終止 ......... 54
3.4.2 基於位元失真成本之臨界值準則 ................... 56
3.4.3 編碼單位提早終止演算法流程 ..................... 59
3.5 所提出景深圖之畫面內快速演算法之整體流程 .......... 61
第四章 實驗結果 ..................................... 65
4.1 3D-HEVC測試影像與參數設定 ....................... 65
4.2 實驗結果 ....................................... 70
4.3 演算法各部分效能評比 ............................ 81
第五章 結論與未來展望 ............................... 87
參考文獻 ........................................... 89

[1] T. Wiegand, G. J. Sullivan, G. Bjontegaard, and A. Luthra, “Overview of the H.264/AVC Video Coding Standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, no. 7, pp. 560-576, July 2003.
[2] G. J. Sullivan, J. R. Ohm, W. J. Han, and T. Wiegand, “Overview of the High Efficiency Video Coding (HEVC) Standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1648-1668, December 2012.
[3] P. Merkle, A. Smolic´, K. Müller, and T. Wiegand, “Efficient Prediction Structures for Multiview Video Coding,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, no. 11, pp. 1461-1473, November 2007.
[4] P. Merkle, A. Smolic, K. Müller, and T. Wiegand, “Multi-View Video Plus Depth Representation and Coding,” in Proceeding of 2007 IEEE International Conference on Image Processing, vol. 1, pp. I-203-I-204, 2007.
[5] Y. Chen and A. Vetro, “Next-Generation 3D Formats with Depth Map Support,” IEEE Multimedia, vol. 21, no. 2, pp. 90-94, April 2014.
[6] M. M. Hannuksela, Y. Yan, X. Huang, and H. Li, “Overview of the Multiview High Efficiency Video Coding (MV-HEVC) Standard,” in Proceedings of 2015 IEEE International Conference on Image Processing (ICIP), pp.2154-2158, September 2015.
[7] M. M. Hannuksela, Y. Chen, T. Suzuki, J. R. Ohm, and G. J. Sullivan, “3D-AVC Draft Text 8,” JCT3V-F1002, Geneva, November 2013.
[8] G. Tech, Y. Chen, K. Müller, J. R. Ohm, A. Vetro, and Y. K. Wang, “Overview of the Multiview and 3D Extensions of High Efficiency Video Coding,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 26, no. 11, pp. 35-49, January 2016.
[9] D. Rusanovskyy, F. C. Chen, L. Zhang, and T. Suzuki, “3D-AVC Test Model 8,” JCT3V-F1003, Geneva, November 2013.
[10] Y. Chen, G. Tech, K. Wegner, and S. Yea, “Test Model 11 of 3D-HEVC and MV-HEVC,” JCT3V-K1003, February 2015.
[11] F. Bossen, “Common Test Conditions and Software Reference Configurations,” JCTVC-F900, Torino, IT, July 2011.
[12] A. Ortega, and K. Ramchandran, “Rate-Distortion Methods for Image and Video Compression,” IEEE Signal Processing Magazine, vol. 15, no. 6, pp. 23-50, November 1998.
[13] K. Muller, P. Merkle, G. Tech, and T. Wiegand, “3D Video Coding with Depth Modelling Modes and View Synthesis Optimization,” in Proceedings of Annual Summit and Conference on Signal & Information Processing Association (APSIPA ASC), Hollywood, CA, USA, December 2012.
[14] P. Merkle, C. Bartnik, K. Muller, D. Marpe, and T. Wiegand, “3D Video: Depth Coding Based on Inter-Component Prediction of Block Partitions,” in Proceedings of Picture Coding Symposium (PCS), pp. 149-152, Krakow, Poland, May 2012.
[15] P. Merkle, K. Müller, and T. Wiegand, “Coding of Depth Signals for 3D Video Using Wedgelet Block Segmentation with Residual Adaptation,” in Proceedings of IEEE International Conference onMultimedia and Expo (ICME), San Jose, CA, USA, July 2013.
[16] K. J. Oh, J. Lee, and D. S. Park, “Depth Intra Skip Prediction for 3D Video Coding,” in Proceedings of Annual Summit and Conference on Signal & Information Processing Association (APSIPA ASC), Hollywood, CA, USA, December 2012.
[17] G. Sanchez, M. Saldanha, G. Balota, B. Zatt, M. Porto, and L. Agostini1, “A Complexity Reduction Algorithm for Depth Maps Intra Prediction on the 3D-HEVC,” in Proceedings of 2014 IEEE Visual Communications and Image Processing Conference, Valletta, Malta, December 2014.
[18] G. Sanchez, M. Saldanha, B. Zatt, M. Porto, and L. Agostini, “S-GMOF: A Gradient-based Complexity Reduction Algorithm for Depth-Maps Intra Prediction on 3D-HEVC,” in Proceedings of 2015 IEEE 6th Latin American Symposium on Circuits and Systems (LASCAS), Montevideo, Uruguay, February 2015.
[19] M. Saldanha, B. Zatt, M. Porto, L. Agostini, and G. Sanchez, “Solutions for DMM-1 Complexity Reduction in 3D-HEVC Based on Gradient Calculation,” in Proceedings of 2016 IEEE 7th Latin
American Symposium on Circuits and Systems (LASCAS), Florianopolis, Brazil, March 2016.
[20] C. H. Fu, H. B. Zhang and W. M. Su, “Fast Wedgelet Pattern Decision for DMM in 3D-HEVC,” in Proceedings of 2015 IEEE International Conference on Digital Signal Processing (DSP), Singapore, July 2015.
[21] H. B. Zhang, S. H. Tsang, Y. L. Chan, C. H. Fu, and W. M. Su, “Early Determination of Intra Mode and Segment-wise DC Coding for Depth Map Based on Hierarchical Coding Structure in 3D-HEVC,” in Proceedings of 2015 Asia-Pacific Signal and Information Processing Association(APSIPA), Hong Kong, China, December 2015.
[22] R. H. Hong, M. J. Chen, and J. R. Lin, “Efficient DMM Decision of Depth Intra Coding in 3D-HEVC,” in Proceedings of the 30th IPPR Conference on Computer Vision, Graphics, and Image Processing (CVGIP 2017), Taiwan, August 2017.
[23] Z. Y. Gu, J. H. Zheng, L. Nam, and P. Zhang, “Fast Bi-partition Mode Selection for 3D HEVC Depth Intra Coding,” in Proceedings of 2014 IEEE International Conference on Multimedia and Expo (ICME),Chengdu, China, July 2014.
[24] C. S. Park, “Edge-Based Intra Mode Selection for Depth-Map Coding in 3D-HEVC,” IEEE Transactions on Image Processing, vol. 24, no. 1, January 2015.
[25] Q. W. Zhang, N. N. LI, L. X. Xun and Y. Gan, “Effective Early Terminate Algorithm for Depth Map Intra Coding in 3D-HEVC,” Electronics Letters, vol. 50, no. 14, pp. 994-996, July 2014.
[26] H. B. Zhang, C. H. Fu, Y. L. Chan, S. H. Tsang, and W. C. Siu, “Probability-based Depth Intra Mode Skipping Strategy and Novel VSO Metric for DMM Decision in 3D-HEVC,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 28, no. 2, pp. 513-527, February 2018.
[27] G. Sanchez, R. Cataldo, R. Fernandes, L. Agostini, and C. Marcon, “3D-HEVC Depth Maps Intra Prediction Complexity Analysis,” in Proceedings of 2016 IEEE International Conference on Electronics, Circuits and Systems (ICECS), Monte Carlo, Monaco, December 2016.
[28] 3D-HEVC reference software version 16.0 (HTM-16.0), available online at https://hevc.hhi.fraunhofer.de/svn/svn_3DVCSoftware/tags/HTM-16.0/
[29] K. Müller and A. Vetro, “Common Test Conditions of 3DV Core Experiments,” JCT3V-G1100, January 2014.
[30] G. Bjontegaard, “Calculation of Average PSNR Differences between RD Curves,” ITU-T SG16/Q6 Document, VCEG-M33, Austin, April 2001.
[31] G. Bjontegaard, “Improvements of the BD-PSNR Model,” ITU-T SG16/Q6, Document, VCEG-AI11, Berlin, July 2008.