• 台湾“裤子大王”:百姓三餐不济谈啥“台湾价值” 2019-05-23
  • 韩国釜山海滩变“垃圾场” 清洁工叫苦不堪 2019-05-23
  • 浙江宣讲十九大:之江大地“好声音”“红船”精神入人心 2019-05-19
  • “回天地区”下月开放千套人才公寓 ——凤凰网房产北京 2019-05-13
  • 中国智能手机在东南亚受追捧 2019-04-25
  • 阜阳网络达人“点赞”颍泉绿化提升专项工作 2019-04-23
  • 《国家人文历史》往期杂志汇总 2019-04-22
  • 一师一团土地确权登记颁证工作全面展开 2019-04-14
  • 德州扑克赌场披“俱乐部”外衣 打竞技旗号难掩赌博实质 2019-04-12
  • 自治区党委召开常委(扩大)会议 陈全国主持 2019-04-12
  • 17年来首次!塔利班组织宣布停火3天 与阿富汗民众自拍 2019-04-04
  • 2022年冬奥会筹备进行时 2019-04-03
  • 人家80年前就造航母,我们现在才造航母,基础不一样。 2019-04-03
  • 葡萄牙首都上演城市节狂欢 2019-04-01
  • RED EARTH红地球展现自我丝绒唇膏全新发布 2019-03-24
  • Welcome to

    Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

     

    Go Back   Doom9's Forum > Capturing and Editing Video > VapourSynth

    Reply
     
    Thread Tools Search this Thread Display Modes
    Old 7th November 2018, 10:41   #1  |  Link
    Registered User
     
    HolyWu's Avatar
     
    Join Date: Aug 2006
    Location: Taiwan
    Posts: 566
    VMAF - Video Multi-Method Assessment Fusion

    https://github.com/HomeOfVapourSynth...ourSynth-VMAF/
    HolyWu is offline   Reply With Quote
    Old 7th November 2018, 15:11   #2  |  Link
    Registered User
     
    Join Date: Sep 2007
    Posts: 3,793
    Thanks
    poisondeathray is offline   Reply With Quote
    Old 7th November 2018, 15:37   #3  |  Link
    Registered User
     
    Join Date: Sep 2006
    Posts: 1,110
    I'm confused, what is this filter supposed to do?
    lansing is offline   Reply With Quote
    Old 7th November 2018, 15:52   #4  |  Link
    Registered User
     
    Join Date: Dec 2005
    Location: Germany
    Posts: 770
    It calculates a score.... You have 2 clips, the score tells you by how much the the seconds clips differs from the first one. The VMAF algo tries take the human perception into account. https://en.wikipedia.org/wiki/Video_...essment_Fusion
    __________________
    Search and denoise
    ChaosKing is online now   Reply With Quote
    Old 7th November 2018, 19:07   #5  |  Link
    Registered User
     
    Selur's Avatar
     
    Join Date: Oct 2001
    Location: Germany
    Posts: 5,814
    Nice thanks!
    __________________
    Hybrid here in the forum, homepage
    Selur is offline   Reply With Quote
    Old 8th November 2018, 10:11   #6  |  Link
    Registered User
     
    Join Date: Dec 2005
    Location: Germany
    Posts: 770
    Also available via vsrepo now
    __________________
    Search and denoise
    ChaosKing is online now   Reply With Quote
    Old 9th November 2018, 01:56   #7  |  Link
    ifb
    Registered User
     
    Join Date: Dec 2009
    Posts: 64
    Very timely for me. Thanks.

    I've had mixed results getting yuv422p10le to work correctly with vmafossexec and/or ffmpeg builds with libvmaf. That's probably my fault for trying on Windows, but I was too lazy to try on a Linux VM at the time.
    ifb is offline   Reply With Quote
    Old 13th November 2018, 17:23   #8  |  Link
    Registered User
     
    Join Date: Sep 2007
    Posts: 3,793
    Request: is it possible to print out the aggregate psnr, ssim, ms_ssim scores ? (Currently it's only aggregate vmaf)
    poisondeathray is offline   Reply With Quote
    Old 14th November 2018, 11:21   #9  |  Link
    Registered User
     
    HolyWu's Avatar
     
    Join Date: Aug 2006
    Location: Taiwan
    Posts: 566
    Update r2.
    • Scale 10-bit pixel values to 8-bit range for correct score calculation.
    • Use stricter linear frame request since VMAF score will change if frame order is different.
    • Report aggregate PSNR, SSIM, and MS-SSIM scores in addition to VMAF score.
    HolyWu is offline   Reply With Quote
    Old 14th November 2018, 14:09   #10  |  Link
    Registered User
     
    Join Date: Apr 2015
    Posts: 76
    Is it possible to registered to frame props like mvsfunc PlaneStatistics?
    edcrfv94 is offline   Reply With Quote
    Old 14th November 2018, 14:51   #11  |  Link
    Registered User
     
    Join Date: Dec 2005
    Location: Germany
    Posts: 770
    Quote:
    Originally Posted by edcrfv94 View Post
    Is it possible to registered to frame props like mvsfunc PlaneStatistics?
    This would be awesome.
    __________________
    Search and denoise
    ChaosKing is online now   Reply With Quote
    Old 15th November 2018, 02:43   #12  |  Link
    Registered User
     
    HolyWu's Avatar
     
    Join Date: Aug 2006
    Location: Taiwan
    Posts: 566
    Quote:
    Originally Posted by edcrfv94 View Post
    Is it possible to registered to frame props like mvsfunc PlaneStatistics?
    Not possible with the exposed API of libvmaf. Only when all frames are deliverd and processed does the library print the aggregate scores and optionally write the log file. There is no way to access the library's internal data to get the per-frame score and add that to the frame property.

    Last edited by HolyWu; 15th November 2018 at 02:57.
    HolyWu is offline   Reply With Quote
    Old 19th January 2019, 08:30   #13  |  Link
    Registered User
     
    Join Date: Sep 2006
    Posts: 1,110
    Can you add an "average score" for each metric at the end of the log?
    lansing is offline   Reply With Quote
    Old 19th January 2019, 14:42   #14  |  Link
    Registered User
     
    HolyWu's Avatar
     
    Join Date: Aug 2006
    Location: Taiwan
    Posts: 566
    Quote:
    Originally Posted by lansing View Post
    Can you add an "average score" for each metric at the end of the log?
    It's already there, albeit not at the end. For example a xml log:

    Code:
    <?xml version="1.0" encoding="ISO-8859-1"?>
    <VMAF version="1.3.7">
    <params subsample="1" scaledHeight="1080" scaledWidth="1920" model=""/>
    <fyi execFps="2.3972" aggregateMS_SSIM="0.997629" aggregateSSIM="0.998861" aggregatePSNR="48.5527" aggregateVMAF="98.452" numOfFrames="6"/>
    <frames>
    <frame vmaf="95.1147" vif_scale3="0.999067" vif_scale2="0.997998" vif_scale1="0.986572" vif_scale0="0.711273" ssim="0.998833" psnr="48.1752" ms_ssim="0.997502" motion2="0" adm2="0.990135" frameNum="0"/>
    <frame vmaf="98.0908" vif_scale3="0.999122" vif_scale2="0.998097" vif_scale1="0.987361" vif_scale0="0.725121" ssim="0.998876" psnr="48.5654" ms_ssim="0.997635" motion2="2.08641" adm2="0.991341" frameNum="1"/>
    <frame vmaf="98.6133" vif_scale3="0.999151" vif_scale2="0.998111" vif_scale1="0.987686" vif_scale0="0.737886" ssim="0.998892" psnr="48.9502" ms_ssim="0.997769" motion2="2.4176" adm2="0.991782" frameNum="2"/>
    <frame vmaf="99.0617" vif_scale3="0.999089" vif_scale2="0.998038" vif_scale1="0.98654" vif_scale0="0.71651" ssim="0.99883" psnr="48.3169" ms_ssim="0.997532" motion2="2.96657" adm2="0.990675" frameNum="3"/>
    <frame vmaf="100" vif_scale3="0.999108" vif_scale2="0.998094" vif_scale1="0.987838" vif_scale0="0.738668" ssim="0.998885" psnr="48.9485" ms_ssim="0.997766" motion2="3.60763" adm2="0.991847" frameNum="4"/>
    <frame vmaf="100" vif_scale3="0.999115" vif_scale2="0.99804" vif_scale1="0.986751" vif_scale0="0.720485" ssim="0.99885" psnr="48.371" ms_ssim="0.997572" motion2="4.2859" adm2="0.991102" frameNum="5"/>
    </frames>
    </VMAF>
    HolyWu is offline   Reply With Quote
    Old 19th January 2019, 15:04   #15  |  Link
    Registered User
     
    Join Date: Sep 2006
    Posts: 1,110
    Oh, I was using the json format and it doesn't have it
    lansing is offline   Reply With Quote
    Old 20th January 2019, 04:50   #16  |  Link
    Registered User
     
    Join Date: Sep 2006
    Posts: 1,110
    So I finally have time to play with this plugin, it's very good tool to help find optimal encode settings for my contents.

    My test clip is a 1000 frames of 1440x1080 anime with no grain and very little motion. Here are the comparison between x264 and x265 I made with vmaf :

    Code:
                                       Aggregate VMAF Percentage
    source                                   98.8374
    
    x264 300 kb/s medium animation           79.9185
    x265 300 kb/s medium                     85.6454
    x265 300 kb/s slower                     86.9443
    
    x264 2500 kb/s medium animation          95.1616
    x265 2500 kb/s medium                    94.9675
    
    x264 CRF 25 medium animation             91.3914
    x265 CRF 25 medium                       91.1363
    
    x264 CRF 18 medium animation             96.1513
    x265 CRF 21 medium                       93.6972
    
    x264 CRF 18 medium animation             96.1513
    x264 CRF 18 slower animation             96.3279
    According to the FAQ, comparing the source clip to itself won't gives 100% score, so 98.8% here is the highest quality for this clip.

    For encoding in low bitrate, x265 clearly wins. But for high/transparent encoding, it seems that x264 is still better if encode in same bitrate or same CRF. I don't have good 4k contents to see how that goes.

    I have heard people said that x264 crf 18 is equivalent to x265 crf 21 so I did a comparison on those too, and the score shows that there is a difference.

    On the last comparison I did it between two different presets. So with high bitrate encoding for my content, using slower preset is just a waste of time with insignificant amount of gains. It only make sense to use it on low bitrate encodes.
    lansing is offline   Reply With Quote
    Old 20th January 2019, 20:23   #17  |  Link
    Pig on the wing
     
    Boulder's Avatar
     
    Join Date: Mar 2002
    Location: Hollola, Finland
    Posts: 4,525
    Did I understand correctly that model 0 should be used if the tested material is 1080p or less? At first I thought that it meant the viewing device but after reading the FAQ, it looks like it's the content itself.
    __________________
    And if the band you're in starts playing different tunes
    I'll see you on the dark side of the Moon...
    Boulder is offline   Reply With Quote
    Old 20th January 2019, 21:48   #18  |  Link
    Registered User
     
    Join Date: Jul 2012
    Location: Scarborough, Canada
    Posts: 878
    Quote:
    Originally Posted by Boulder View Post
    Did I understand correctly that model 0 should be used if the tested material is 1080p or less? At first I thought that it meant the viewing device but after reading the FAQ, it looks like it's the content itself.
    I think it is the screen, otherwise the --phone-model switch makes no sense
    gonca is offline   Reply With Quote
    Old 21st January 2019, 03:46   #19  |  Link
    Pig on the wing
     
    Boulder's Avatar
     
    Join Date: Mar 2002
    Location: Hollola, Finland
    Posts: 4,525
    Quote:
    Originally Posted by gonca View Post
    I think it is the screen, otherwise the --phone-model switch makes no sense
    Yes, looking at the models page suggests that.. Looking at the linked slideshow there, it also seems that for proper analysis, you have to upscale to 4K.

    EDIT: with video upscaled to 4K, it runs out of memory quite often. Even with core.max_cache_size = 1024, the usage jumps to over 8GB quite fast and then the errors appear. I have 16GB on the machine so it's really not using all the memory.

    Code:
    Start calculating VMAF score...
    Script exceeded memory limit. Consider raising cache size.
    error: aligned_malloc failed for data_buf.
    error: aligned_malloc failed for data_buf.
    error: aligned_malloc failed for data_buf.
    Exec FPS: 3.574859
    VMAF score (harmonic_mean) = nan
    __________________
    And if the band you're in starts playing different tunes
    I'll see you on the dark side of the Moon...

    Last edited by Boulder; 21st January 2019 at 04:24.
    Boulder is offline   Reply With Quote
    Old 21st January 2019, 05:45   #20  |  Link
    Registered User
     
    HolyWu's Avatar
     
    Join Date: Aug 2006
    Location: Taiwan
    Posts: 566
    Quote:
    Originally Posted by Boulder View Post
    EDIT: with video upscaled to 4K, it runs out of memory quite often. Even with core.max_cache_size = 1024, the usage jumps to over 8GB quite fast and then the errors appear. I have 16GB on the machine so it's really not using all the memory.

    Code:
    Start calculating VMAF score...
    Script exceeded memory limit. Consider raising cache size.
    error: aligned_malloc failed for data_buf.
    error: aligned_malloc failed for data_buf.
    error: aligned_malloc failed for data_buf.
    Exec FPS: 3.574859
    VMAF score (harmonic_mean) = nan
    Can't reproduce. Provide the exact script you used.
    HolyWu is offline   Reply With Quote
    Reply


    Posting Rules
    You may not post new threads
    You may not post replies
    You may not post attachments
    You may not edit your posts

    BB code is On
    Smilies are On
    [IMG] code is On
    HTML code is Off

    Forum Jump


    All times are GMT +1. The time now is 10:45.


    Powered by vBulletin® Version 3.8.11
    Copyright ©2000 - 2019, vBulletin Solutions Inc.
  • 台湾“裤子大王”:百姓三餐不济谈啥“台湾价值” 2019-05-23
  • 韩国釜山海滩变“垃圾场” 清洁工叫苦不堪 2019-05-23
  • 浙江宣讲十九大:之江大地“好声音”“红船”精神入人心 2019-05-19
  • “回天地区”下月开放千套人才公寓 ——凤凰网房产北京 2019-05-13
  • 中国智能手机在东南亚受追捧 2019-04-25
  • 阜阳网络达人“点赞”颍泉绿化提升专项工作 2019-04-23
  • 《国家人文历史》往期杂志汇总 2019-04-22
  • 一师一团土地确权登记颁证工作全面展开 2019-04-14
  • 德州扑克赌场披“俱乐部”外衣 打竞技旗号难掩赌博实质 2019-04-12
  • 自治区党委召开常委(扩大)会议 陈全国主持 2019-04-12
  • 17年来首次!塔利班组织宣布停火3天 与阿富汗民众自拍 2019-04-04
  • 2022年冬奥会筹备进行时 2019-04-03
  • 人家80年前就造航母,我们现在才造航母,基础不一样。 2019-04-03
  • 葡萄牙首都上演城市节狂欢 2019-04-01
  • RED EARTH红地球展现自我丝绒唇膏全新发布 2019-03-24
  • 新浪足彩网 近十期体彩p3试机号 排列5未开出的号 南国特区彩票论坛 上海时时彩开奖结杲2元 山东快乐扑克3包选遗漏 快乐时时彩开奖记录 山东时时彩怎么中奖 双色球爱彩网波波预测 现在买彩票在哪里买 好运快3是合法的吗 全速足球比分 福建体育彩票 军旗玩法 幸运赛车开奖 北京赛车pk10倍投输死