About the re-trained results on HO3D dataset

[dyklq]

Hello, @lzfff12 . Thanks for your excellent work.

I tried to retrain the model on the HO3Dv2 dataset using your default settings for three times. However, the best result I obtained is only 9.38 on the public leaderboard.
Therefore, I wonder if you have some other tricks applied during training to boost the performance?

The following are the parameter output in option.txt and the trained losses for reference.

====== Options ======
HO3D_root: /media/data1/Dataset/HO3D_v2/Data
blocks: 1
channels: 256
dex_ycb_root: /media/data1/Dataset/data_for_alignsdf/dexycb/dex-ycb
epochs: 70
evaluate: False
host_folder: experiments/ho3d
inp_res: 256
lambda_joints2d: 100.0
lambda_objects: 500.0
lr: 0.0001
lr_decay_gamma: 0.7
lr_decay_step: 10
mano_lambda_joints3d: 10000.0
mano_lambda_manopose: 10
mano_lambda_manoshape: 0.1
mano_lambda_regulpose: 0.0
mano_lambda_regulshape: 0.0
mano_lambda_verts3d: 10000.0
mano_neurons: [1024, 512]
mano_root: assets/mano_models
manual_seed: 0
momentum: 0.9
network: honet_transformer
obj_model_root: assets/object_models
resume: None
save_results: True
snapshot: 10
stacks: 1
test_batch: 64
test_freq: 10
train_batch: 64
transformer_depth: 1
transformer_head: 4
use_cuda: 1
use_ho3d: True
weight_decay: 0.0005
workers: 16
=====================
launched traineval.py at 2023-10-06 23:15:23.422155

==== log  at Fri Oct  6 23:15:31 2023 ====
(epoch: 1, time: Fri Oct  6 23:42:02 2023),mano_mesh3d_loss:5.545252323150635,mano_joints3d_loss:5.8843488693237305,manopose_loss:1.0071043968200684,manoshape_loss:0.3506675064563751,mano_total_loss:12.787386894226074,hm_joints2d_loss:3.3286962509155273,obj_reg_loss:95.60641479492188,obj_conf_loss:10.81941032409668,total_loss:122.54190063476562
(epoch: 2, time: Sat Oct  7 00:01:25 2023),mano_mesh3d_loss:1.6909847259521484,mano_joints3d_loss:1.8189302682876587,manopose_loss:0.3632090091705322,manoshape_loss:0.2927539646625519,mano_total_loss:4.165874004364014,hm_joints2d_loss:1.0852590799331665,obj_reg_loss:74.8833999633789,obj_conf_loss:6.6124725341796875,total_loss:86.74691009521484
(epoch: 3, time: Sat Oct  7 00:20:30 2023),mano_mesh3d_loss:1.320427417755127,mano_joints3d_loss:1.418541669845581,manopose_loss:0.33809858560562134,manoshape_loss:0.2805778682231903,mano_total_loss:3.3576478958129883,hm_joints2d_loss:0.7900612354278564,obj_reg_loss:68.6631088256836,obj_conf_loss:6.496152877807617,total_loss:79.30706024169922
(epoch: 4, time: Sat Oct  7 00:39:24 2023),mano_mesh3d_loss:1.0319397449493408,mano_joints3d_loss:1.1067063808441162,manopose_loss:0.31386926770210266,manoshape_loss:0.27310410141944885,mano_total_loss:2.725619316101074,hm_joints2d_loss:0.626470148563385,obj_reg_loss:50.83426284790039,obj_conf_loss:6.533202648162842,total_loss:60.71949768066406
(epoch: 5, time: Sat Oct  7 00:58:18 2023),mano_mesh3d_loss:1.109512209892273,mano_joints3d_loss:1.1911731958389282,manopose_loss:0.3025909662246704,manoshape_loss:0.26847589015960693,mano_total_loss:2.8717548847198486,hm_joints2d_loss:0.6564722061157227,obj_reg_loss:32.07004165649414,obj_conf_loss:6.203098773956299,total_loss:41.8013801574707
(epoch: 6, time: Sat Oct  7 01:17:10 2023),mano_mesh3d_loss:0.8024893999099731,mano_joints3d_loss:0.8596831560134888,manopose_loss:0.2736554443836212,manoshape_loss:0.2501206696033478,mano_total_loss:2.1859476566314697,hm_joints2d_loss:0.49380725622177124,obj_reg_loss:24.4095458984375,obj_conf_loss:5.715297698974609,total_loss:32.8045654296875
(epoch: 7, time: Sat Oct  7 01:36:03 2023),mano_mesh3d_loss:0.7018308043479919,mano_joints3d_loss:0.7514442801475525,manopose_loss:0.2519541382789612,manoshape_loss:0.23022988438606262,mano_total_loss:1.9354584217071533,hm_joints2d_loss:0.4389413297176361,obj_reg_loss:21.660181045532227,obj_conf_loss:5.430682182312012,total_loss:29.465261459350586
(epoch: 8, time: Sat Oct  7 01:54:57 2023),mano_mesh3d_loss:0.7097055912017822,mano_joints3d_loss:0.760745108127594,manopose_loss:0.237700954079628,manoshape_loss:0.21521404385566711,mano_total_loss:1.9233664274215698,hm_joints2d_loss:0.4387645721435547,obj_reg_loss:20.013832092285156,obj_conf_loss:5.234278202056885,total_loss:27.61023712158203
(epoch: 9, time: Sat Oct  7 02:13:49 2023),mano_mesh3d_loss:0.6313846707344055,mano_joints3d_loss:0.6764567494392395,manopose_loss:0.21927033364772797,manoshape_loss:0.19187459349632263,mano_total_loss:1.7189861536026,hm_joints2d_loss:0.4031234681606293,obj_reg_loss:18.915592193603516,obj_conf_loss:5.095491886138916,total_loss:26.133188247680664
(epoch: 10, time: Sat Oct  7 02:32:41 2023),mano_mesh3d_loss:0.523613452911377,mano_joints3d_loss:0.5597004890441895,manopose_loss:0.20173479616641998,manoshape_loss:0.1715564727783203,mano_total_loss:1.4566054344177246,hm_joints2d_loss:0.34694531559944153,obj_reg_loss:18.07473373413086,obj_conf_loss:4.9923834800720215,total_loss:24.870689392089844
(epoch: 11, time: Sat Oct  7 02:54:18 2023),mano_mesh3d_loss:0.4169944226741791,mano_joints3d_loss:0.4443188011646271,manopose_loss:0.18351642787456512,manoshape_loss:0.15521594882011414,mano_total_loss:1.2000457048416138,hm_joints2d_loss:0.2933536171913147,obj_reg_loss:16.09233856201172,obj_conf_loss:4.738110542297363,total_loss:22.323837280273438
(epoch: 12, time: Sat Oct  7 03:13:10 2023),mano_mesh3d_loss:0.4134601652622223,mano_joints3d_loss:0.44073936343193054,manopose_loss:0.17495545744895935,manoshape_loss:0.14630506932735443,mano_total_loss:1.175460696220398,hm_joints2d_loss:0.28917309641838074,obj_reg_loss:15.431581497192383,obj_conf_loss:4.642738342285156,total_loss:21.538957595825195
(epoch: 13, time: Sat Oct  7 03:32:06 2023),mano_mesh3d_loss:0.38888412714004517,mano_joints3d_loss:0.41429993510246277,manopose_loss:0.16559498012065887,manoshape_loss:0.13578476011753082,mano_total_loss:1.1045626401901245,hm_joints2d_loss:0.27534645795822144,obj_reg_loss:15.078113555908203,obj_conf_loss:4.583775043487549,total_loss:21.04180145263672
(epoch: 14, time: Sat Oct  7 03:51:07 2023),mano_mesh3d_loss:0.3549215495586395,mano_joints3d_loss:0.37789350748062134,manopose_loss:0.15566569566726685,manoshape_loss:0.12407279014587402,mano_total_loss:1.0125529766082764,hm_joints2d_loss:0.25565218925476074,obj_reg_loss:14.624402046203613,obj_conf_loss:4.510421276092529,total_loss:20.403018951416016
(epoch: 15, time: Sat Oct  7 04:10:10 2023),mano_mesh3d_loss:0.33881744742393494,mano_joints3d_loss:0.3610582649707794,manopose_loss:0.14748990535736084,manoshape_loss:0.11132899671792984,mano_total_loss:0.9586951732635498,hm_joints2d_loss:0.24588024616241455,obj_reg_loss:14.220447540283203,obj_conf_loss:4.439467906951904,total_loss:19.864479064941406
(epoch: 16, time: Sat Oct  7 04:29:12 2023),mano_mesh3d_loss:0.344839483499527,mano_joints3d_loss:0.36794713139533997,manopose_loss:0.1418749988079071,manoshape_loss:0.10055044293403625,mano_total_loss:0.9552118182182312,hm_joints2d_loss:0.2514665722846985,obj_reg_loss:14.002887725830078,obj_conf_loss:4.404102802276611,total_loss:19.613676071166992
(epoch: 17, time: Sat Oct  7 04:48:17 2023),mano_mesh3d_loss:0.31140848994255066,mano_joints3d_loss:0.33215394616127014,manopose_loss:0.13374680280685425,manoshape_loss:0.09187189489603043,mano_total_loss:0.8691810369491577,hm_joints2d_loss:0.23249368369579315,obj_reg_loss:13.677811622619629,obj_conf_loss:4.357553958892822,total_loss:19.13705062866211
(epoch: 18, time: Sat Oct  7 05:07:23 2023),mano_mesh3d_loss:0.3076970875263214,mano_joints3d_loss:0.32838159799575806,manopose_loss:0.12850818037986755,manoshape_loss:0.08531295508146286,mano_total_loss:0.8499000072479248,hm_joints2d_loss:0.23005546629428864,obj_reg_loss:13.268312454223633,obj_conf_loss:4.292179107666016,total_loss:18.640451431274414
(epoch: 19, time: Sat Oct  7 05:26:21 2023),mano_mesh3d_loss:0.28561967611312866,mano_joints3d_loss:0.3048730790615082,manopose_loss:0.12182731181383133,manoshape_loss:0.0790138989686966,mano_total_loss:0.7913343906402588,hm_joints2d_loss:0.21642200648784637,obj_reg_loss:13.026782989501953,obj_conf_loss:4.262256622314453,total_loss:18.296777725219727
(epoch: 20, time: Sat Oct  7 05:45:18 2023),mano_mesh3d_loss:0.277950257062912,mano_joints3d_loss:0.2968460023403168,manopose_loss:0.11732558161020279,manoshape_loss:0.07458312064409256,mano_total_loss:0.7667051553726196,hm_joints2d_loss:0.21429479122161865,obj_reg_loss:12.710926055908203,obj_conf_loss:4.2091264724731445,total_loss:17.901058197021484
(epoch: 21, time: Sat Oct  7 06:06:40 2023),mano_mesh3d_loss:0.22853213548660278,mano_joints3d_loss:0.24356263875961304,manopose_loss:0.10862389206886292,manoshape_loss:0.06617280840873718,mano_total_loss:0.6468917727470398,hm_joints2d_loss:0.19150859117507935,obj_reg_loss:11.651315689086914,obj_conf_loss:4.061398506164551,total_loss:16.55109977722168
(epoch: 22, time: Sat Oct  7 06:25:32 2023),mano_mesh3d_loss:0.22958622872829437,mano_joints3d_loss:0.24495862424373627,manopose_loss:0.10522033274173737,manoshape_loss:0.06243627518415451,mano_total_loss:0.6422010064125061,hm_joints2d_loss:0.1889542043209076,obj_reg_loss:11.409490585327148,obj_conf_loss:4.019417762756348,total_loss:16.260072708129883
(epoch: 23, time: Sat Oct  7 06:44:26 2023),mano_mesh3d_loss:0.2153177112340927,mano_joints3d_loss:0.22962281107902527,manopose_loss:0.10147976875305176,manoshape_loss:0.058818519115448,mano_total_loss:0.6052390336990356,hm_joints2d_loss:0.18056973814964294,obj_reg_loss:11.198007583618164,obj_conf_loss:3.98140025138855,total_loss:15.965216636657715
(epoch: 24, time: Sat Oct  7 07:03:19 2023),mano_mesh3d_loss:0.20651397109031677,mano_joints3d_loss:0.22022728621959686,manopose_loss:0.09777483344078064,manoshape_loss:0.05607279762625694,mano_total_loss:0.580588698387146,hm_joints2d_loss:0.1739843785762787,obj_reg_loss:11.012195587158203,obj_conf_loss:3.9543087482452393,total_loss:15.721080780029297
(epoch: 25, time: Sat Oct  7 07:22:12 2023),mano_mesh3d_loss:0.20141790807247162,mano_joints3d_loss:0.21492783725261688,manopose_loss:0.09459319710731506,manoshape_loss:0.0531650073826313,mano_total_loss:0.5641037821769714,hm_joints2d_loss:0.17087452113628387,obj_reg_loss:10.864304542541504,obj_conf_loss:3.9264392852783203,total_loss:15.52572250366211
(epoch: 26, time: Sat Oct  7 07:41:09 2023),mano_mesh3d_loss:0.201676607131958,mano_joints3d_loss:0.21520575881004333,manopose_loss:0.09257832169532776,manoshape_loss:0.0514155849814415,mano_total_loss:0.5608764886856079,hm_joints2d_loss:0.17022444307804108,obj_reg_loss:10.622261047363281,obj_conf_loss:3.8847124576568604,total_loss:15.238078117370605
(epoch: 27, time: Sat Oct  7 08:00:07 2023),mano_mesh3d_loss:0.19071389734745026,mano_joints3d_loss:0.20348554849624634,manopose_loss:0.08914336562156677,manoshape_loss:0.04889301583170891,mano_total_loss:0.5322357416152954,hm_joints2d_loss:0.16337093710899353,obj_reg_loss:10.549095153808594,obj_conf_loss:3.870743751525879,total_loss:15.115458488464355
(epoch: 28, time: Sat Oct  7 08:19:07 2023),mano_mesh3d_loss:0.23688818514347076,mano_joints3d_loss:0.2534085214138031,manopose_loss:0.0935741439461708,manoshape_loss:0.05119090899825096,mano_total_loss:0.6350612640380859,hm_joints2d_loss:0.19653542339801788,obj_reg_loss:10.403693199157715,obj_conf_loss:3.8390674591064453,total_loss:15.074353218078613
(epoch: 29, time: Sat Oct  7 08:38:06 2023),mano_mesh3d_loss:0.19114631414413452,mano_joints3d_loss:0.20406465232372284,manopose_loss:0.08648949861526489,manoshape_loss:0.04697412624955177,mano_total_loss:0.5286747813224792,hm_joints2d_loss:0.16974963247776031,obj_reg_loss:10.26810073852539,obj_conf_loss:3.820260763168335,total_loss:14.786787033081055
(epoch: 30, time: Sat Oct  7 08:57:06 2023),mano_mesh3d_loss:0.17334526777267456,mano_joints3d_loss:0.1849597543478012,manopose_loss:0.08274952322244644,manoshape_loss:0.04422345012426376,mano_total_loss:0.48527833819389343,hm_joints2d_loss:0.1554250419139862,obj_reg_loss:10.121633529663086,obj_conf_loss:3.7856688499450684,total_loss:14.548008918762207
(epoch: 31, time: Sat Oct  7 09:18:31 2023),mano_mesh3d_loss:0.16478119790554047,mano_joints3d_loss:0.17587342858314514,manopose_loss:0.07944251596927643,manoshape_loss:0.041589926928281784,mano_total_loss:0.4616870880126953,hm_joints2d_loss:0.15273596346378326,obj_reg_loss:9.506138801574707,obj_conf_loss:3.6882781982421875,total_loss:13.80883502960205
(epoch: 32, time: Sat Oct  7 09:37:30 2023),mano_mesh3d_loss:0.15073515474796295,mano_joints3d_loss:0.16063547134399414,manopose_loss:0.07667186111211777,manoshape_loss:0.04007638618350029,mano_total_loss:0.4281182885169983,hm_joints2d_loss:0.14260604977607727,obj_reg_loss:9.351908683776855,obj_conf_loss:3.6598691940307617,total_loss:13.582501411437988
(epoch: 33, time: Sat Oct  7 09:56:27 2023),mano_mesh3d_loss:0.14841628074645996,mano_joints3d_loss:0.15824133157730103,manopose_loss:0.07510595768690109,manoshape_loss:0.0386144183576107,mano_total_loss:0.4203777015209198,hm_joints2d_loss:0.1396702080965042,obj_reg_loss:9.239740371704102,obj_conf_loss:3.633779287338257,total_loss:13.433578491210938
(epoch: 34, time: Sat Oct  7 10:15:24 2023),mano_mesh3d_loss:0.14759379625320435,mano_joints3d_loss:0.1574031263589859,manopose_loss:0.07368716597557068,manoshape_loss:0.03823874145746231,mano_total_loss:0.4169226884841919,hm_joints2d_loss:0.13818441331386566,obj_reg_loss:9.119954109191895,obj_conf_loss:3.6089816093444824,total_loss:13.284035682678223
(epoch: 35, time: Sat Oct  7 10:34:22 2023),mano_mesh3d_loss:0.14904358983039856,mano_joints3d_loss:0.15902993083000183,manopose_loss:0.07242788374423981,manoshape_loss:0.037397585809230804,mano_total_loss:0.4178985357284546,hm_joints2d_loss:0.1392756700515747,obj_reg_loss:9.069344520568848,obj_conf_loss:3.5924813747406006,total_loss:13.219003677368164
(epoch: 36, time: Sat Oct  7 10:53:18 2023),mano_mesh3d_loss:0.14350050687789917,mano_joints3d_loss:0.15311022102832794,manopose_loss:0.0709749087691307,manoshape_loss:0.036276381462812424,mano_total_loss:0.4038615822792053,hm_joints2d_loss:0.13455429673194885,obj_reg_loss:9.051795959472656,obj_conf_loss:3.595832347869873,total_loss:13.186050415039062
(epoch: 37, time: Sat Oct  7 11:12:13 2023),mano_mesh3d_loss:0.14273126423358917,mano_joints3d_loss:0.15233394503593445,manopose_loss:0.06969793140888214,manoshape_loss:0.03588210791349411,mano_total_loss:0.40064552426338196,hm_joints2d_loss:0.13360971212387085,obj_reg_loss:8.948972702026367,obj_conf_loss:3.57106614112854,total_loss:13.054300308227539
(epoch: 38, time: Sat Oct  7 11:31:07 2023),mano_mesh3d_loss:0.13943752646446228,mano_joints3d_loss:0.14888498187065125,manopose_loss:0.0683208778500557,manoshape_loss:0.034927383065223694,mano_total_loss:0.3915705680847168,hm_joints2d_loss:0.1317022144794464,obj_reg_loss:8.835185050964355,obj_conf_loss:3.544879674911499,total_loss:12.903342247009277
(epoch: 39, time: Sat Oct  7 11:50:01 2023),mano_mesh3d_loss:0.13801789283752441,mano_joints3d_loss:0.14734631776809692,manopose_loss:0.06706735491752625,manoshape_loss:0.03384441137313843,mano_total_loss:0.38627585768699646,hm_joints2d_loss:0.13088363409042358,obj_reg_loss:8.772802352905273,obj_conf_loss:3.527719736099243,total_loss:12.817673683166504
(epoch: 40, time: Sat Oct  7 12:08:56 2023),mano_mesh3d_loss:0.13565415143966675,mano_joints3d_loss:0.14483524858951569,manopose_loss:0.06606493145227432,manoshape_loss:0.03335905075073242,mano_total_loss:0.3799135088920593,hm_joints2d_loss:0.12853878736495972,obj_reg_loss:8.71053695678711,obj_conf_loss:3.5165371894836426,total_loss:12.735530853271484
(epoch: 41, time: Sat Oct  7 12:30:16 2023),mano_mesh3d_loss:0.12016043812036514,mano_joints3d_loss:0.12817123532295227,manopose_loss:0.06273456662893295,manoshape_loss:0.031158236786723137,mano_total_loss:0.3422246277332306,hm_joints2d_loss:0.11996433883905411,obj_reg_loss:8.308180809020996,obj_conf_loss:3.449866771697998,total_loss:12.220237731933594
(epoch: 42, time: Sat Oct  7 12:49:10 2023),mano_mesh3d_loss:0.11684741824865341,mano_joints3d_loss:0.1246257871389389,manopose_loss:0.06163860112428665,manoshape_loss:0.030793393030762672,mano_total_loss:0.33390501141548157,hm_joints2d_loss:0.11763712018728256,obj_reg_loss:8.220166206359863,obj_conf_loss:3.4317102432250977,total_loss:12.103408813476562
(epoch: 43, time: Sat Oct  7 13:08:03 2023),mano_mesh3d_loss:0.11615670472383499,mano_joints3d_loss:0.12390806525945663,manopose_loss:0.06090841442346573,manoshape_loss:0.030320031568408012,mano_total_loss:0.3312932252883911,hm_joints2d_loss:0.11643796414136887,obj_reg_loss:8.138731002807617,obj_conf_loss:3.419668436050415,total_loss:12.006118774414062
(epoch: 44, time: Sat Oct  7 13:26:57 2023),mano_mesh3d_loss:0.11400722712278366,mano_joints3d_loss:0.12164226174354553,manopose_loss:0.05996820703148842,manoshape_loss:0.029928108677268028,mano_total_loss:0.32554587721824646,hm_joints2d_loss:0.1151140034198761,obj_reg_loss:8.098417282104492,obj_conf_loss:3.4054768085479736,total_loss:11.944546699523926
(epoch: 45, time: Sat Oct  7 13:45:51 2023),mano_mesh3d_loss:0.11454638093709946,mano_joints3d_loss:0.12228084355592728,manopose_loss:0.05945529043674469,manoshape_loss:0.029216475784778595,mano_total_loss:0.3254990875720978,hm_joints2d_loss:0.11491260677576065,obj_reg_loss:7.9944000244140625,obj_conf_loss:3.383631706237793,total_loss:11.818445205688477
(epoch: 46, time: Sat Oct  7 14:04:47 2023),mano_mesh3d_loss:0.11160285025835037,mano_joints3d_loss:0.1191403791308403,manopose_loss:0.05832337215542793,manoshape_loss:0.028604691848158836,mano_total_loss:0.31767117977142334,hm_joints2d_loss:0.11264491826295853,obj_reg_loss:7.98276424407959,obj_conf_loss:3.376598358154297,total_loss:11.789679527282715
(epoch: 47, time: Sat Oct  7 14:23:42 2023),mano_mesh3d_loss:0.11110903322696686,mano_joints3d_loss:0.11865051835775375,manopose_loss:0.05760474130511284,manoshape_loss:0.028183262795209885,mano_total_loss:0.3155476152896881,hm_joints2d_loss:0.11159872263669968,obj_reg_loss:7.9566850662231445,obj_conf_loss:3.363412380218506,total_loss:11.747257232666016
(epoch: 48, time: Sat Oct  7 14:42:38 2023),mano_mesh3d_loss:0.1091856062412262,mano_joints3d_loss:0.11657179147005081,manopose_loss:0.056735437363386154,manoshape_loss:0.027795489877462387,mano_total_loss:0.3102882504463196,hm_joints2d_loss:0.1106155663728714,obj_reg_loss:7.884998321533203,obj_conf_loss:3.3498823642730713,total_loss:11.655786514282227
(epoch: 49, time: Sat Oct  7 15:01:35 2023),mano_mesh3d_loss:0.1097884252667427,mano_joints3d_loss:0.11723995953798294,manopose_loss:0.05634310096502304,manoshape_loss:0.027560019865632057,mano_total_loss:0.31093165278434753,hm_joints2d_loss:0.11030231416225433,obj_reg_loss:7.853546142578125,obj_conf_loss:3.3441338539123535,total_loss:11.618903160095215
(epoch: 50, time: Sat Oct  7 15:20:32 2023),mano_mesh3d_loss:0.10706812143325806,mano_joints3d_loss:0.11436346173286438,manopose_loss:0.05535992607474327,manoshape_loss:0.026760032400488853,mano_total_loss:0.303551584482193,hm_joints2d_loss:0.1082940325140953,obj_reg_loss:7.794037818908691,obj_conf_loss:3.329094171524048,total_loss:11.534963607788086
(epoch: 51, time: Sat Oct  7 15:41:52 2023),mano_mesh3d_loss:0.09684311598539352,mano_joints3d_loss:0.10332230478525162,manopose_loss:0.053307268768548965,manoshape_loss:0.02556159719824791,mano_total_loss:0.2790343165397644,hm_joints2d_loss:0.1032257229089737,obj_reg_loss:7.533874988555908,obj_conf_loss:3.2844197750091553,total_loss:11.200546264648438
(epoch: 52, time: Sat Oct  7 16:00:49 2023),mano_mesh3d_loss:0.09450680762529373,mano_joints3d_loss:0.10085099190473557,manopose_loss:0.052514947950839996,manoshape_loss:0.025269990786910057,mano_total_loss:0.27314284443855286,hm_joints2d_loss:0.10182569175958633,obj_reg_loss:7.460644245147705,obj_conf_loss:3.267666816711426,total_loss:11.103293418884277
(epoch: 53, time: Sat Oct  7 16:19:46 2023),mano_mesh3d_loss:0.09501060098409653,mano_joints3d_loss:0.1014629378914833,manopose_loss:0.05211701616644859,manoshape_loss:0.025020809844136238,mano_total_loss:0.27361124753952026,hm_joints2d_loss:0.10079546272754669,obj_reg_loss:7.461483001708984,obj_conf_loss:3.261809825897217,total_loss:11.097702980041504
(epoch: 54, time: Sat Oct  7 16:38:42 2023),mano_mesh3d_loss:0.09330987930297852,mano_joints3d_loss:0.09960994124412537,manopose_loss:0.05142093822360039,manoshape_loss:0.024672970175743103,mano_total_loss:0.2690138518810272,hm_joints2d_loss:0.09964569658041,obj_reg_loss:7.3937153816223145,obj_conf_loss:3.2502307891845703,total_loss:11.012606620788574
(epoch: 55, time: Sat Oct  7 16:57:39 2023),mano_mesh3d_loss:0.09286456555128098,mano_joints3d_loss:0.09916429966688156,manopose_loss:0.050903432071208954,manoshape_loss:0.024266956374049187,mano_total_loss:0.2671990692615509,hm_joints2d_loss:0.0990472212433815,obj_reg_loss:7.3620781898498535,obj_conf_loss:3.24031138420105,total_loss:10.968634605407715
(epoch: 56, time: Sat Oct  7 17:16:35 2023),mano_mesh3d_loss:0.09175398200750351,mano_joints3d_loss:0.09801234304904938,manopose_loss:0.05042383447289467,manoshape_loss:0.02417638897895813,mano_total_loss:0.26436638832092285,hm_joints2d_loss:0.09816519170999527,obj_reg_loss:7.323878765106201,obj_conf_loss:3.2299399375915527,total_loss:10.916350364685059
(epoch: 57, time: Sat Oct  7 17:35:32 2023),mano_mesh3d_loss:0.0910763218998909,mano_joints3d_loss:0.09726162254810333,manopose_loss:0.04974101856350899,manoshape_loss:0.023786157369613647,mano_total_loss:0.26186510920524597,hm_joints2d_loss:0.09725120663642883,obj_reg_loss:7.318131446838379,obj_conf_loss:3.2261650562286377,total_loss:10.903412818908691
(epoch: 58, time: Sat Oct  7 17:54:29 2023),mano_mesh3d_loss:0.09058976918458939,mano_joints3d_loss:0.09672299027442932,manopose_loss:0.04962611198425293,manoshape_loss:0.02374994568526745,mano_total_loss:0.2606890797615051,hm_joints2d_loss:0.09684713929891586,obj_reg_loss:7.309973239898682,obj_conf_loss:3.224032402038574,total_loss:10.8915433883667
(epoch: 59, time: Sat Oct  7 18:13:25 2023),mano_mesh3d_loss:0.08985183387994766,mano_joints3d_loss:0.09598299115896225,manopose_loss:0.04902930185198784,manoshape_loss:0.023459285497665405,mano_total_loss:0.25832319259643555,hm_joints2d_loss:0.09613147377967834,obj_reg_loss:7.263236045837402,obj_conf_loss:3.2125003337860107,total_loss:10.830181121826172
(epoch: 60, time: Sat Oct  7 18:32:21 2023),mano_mesh3d_loss:0.08880581706762314,mano_joints3d_loss:0.0948566421866417,manopose_loss:0.04857998341321945,manoshape_loss:0.023149723187088966,mano_total_loss:0.2553921937942505,hm_joints2d_loss:0.09555651247501373,obj_reg_loss:7.233233451843262,obj_conf_loss:3.2053377628326416,total_loss:10.789507865905762
(epoch: 61, time: Sat Oct  7 18:53:40 2023),mano_mesh3d_loss:0.08232354372739792,mano_joints3d_loss:0.08788643777370453,manopose_loss:0.04713120684027672,manoshape_loss:0.022293152287602425,mano_total_loss:0.23963432013988495,hm_joints2d_loss:0.09172297269105911,obj_reg_loss:7.020287036895752,obj_conf_loss:3.166713237762451,total_loss:10.518362045288086
(epoch: 62, time: Sat Oct  7 19:12:36 2023),mano_mesh3d_loss:0.08107398450374603,mano_joints3d_loss:0.0865740180015564,manopose_loss:0.04653767868876457,manoshape_loss:0.022064145654439926,mano_total_loss:0.2362498790025711,hm_joints2d_loss:0.09076698869466782,obj_reg_loss:7.007259368896484,obj_conf_loss:3.1664960384368896,total_loss:10.500771522521973
(epoch: 63, time: Sat Oct  7 19:31:33 2023),mano_mesh3d_loss:0.08061462640762329,mano_joints3d_loss:0.08610554784536362,manopose_loss:0.046216391026973724,manoshape_loss:0.02184167318046093,mano_total_loss:0.23477840423583984,hm_joints2d_loss:0.09029495716094971,obj_reg_loss:6.9472975730896,obj_conf_loss:3.147662878036499,total_loss:10.420034408569336
(epoch: 64, time: Sat Oct  7 19:50:27 2023),mano_mesh3d_loss:0.08001669496297836,mano_joints3d_loss:0.08543546497821808,manopose_loss:0.04600432887673378,manoshape_loss:0.021648744121193886,mano_total_loss:0.23310525715351105,hm_joints2d_loss:0.08920629322528839,obj_reg_loss:6.9754958152771,obj_conf_loss:3.1554527282714844,total_loss:10.453252792358398
(epoch: 65, time: Sat Oct  7 20:09:23 2023),mano_mesh3d_loss:0.07977167516946793,mano_joints3d_loss:0.08519323915243149,manopose_loss:0.045651257038116455,manoshape_loss:0.02133576199412346,mano_total_loss:0.23195204138755798,hm_joints2d_loss:0.08907648921012878,obj_reg_loss:6.944581508636475,obj_conf_loss:3.1451847553253174,total_loss:10.41077995300293
(epoch: 66, time: Sat Oct  7 20:28:18 2023),mano_mesh3d_loss:0.07970717549324036,mano_joints3d_loss:0.08516678214073181,manopose_loss:0.045242391526699066,manoshape_loss:0.021310513839125633,mano_total_loss:0.23142695426940918,hm_joints2d_loss:0.08866064250469208,obj_reg_loss:6.913706302642822,obj_conf_loss:3.1371090412139893,total_loss:10.370906829833984
(epoch: 67, time: Sat Oct  7 20:47:14 2023),mano_mesh3d_loss:0.07800474762916565,mano_joints3d_loss:0.08331823348999023,manopose_loss:0.04487057030200958,manoshape_loss:0.02107924036681652,mano_total_loss:0.22727279365062714,hm_joints2d_loss:0.08763626962900162,obj_reg_loss:6.888713359832764,obj_conf_loss:3.130798578262329,total_loss:10.334418296813965
(epoch: 68, time: Sat Oct  7 21:06:10 2023),mano_mesh3d_loss:0.07723458856344223,mano_joints3d_loss:0.08247040957212448,manopose_loss:0.044599227607250214,manoshape_loss:0.0208301842212677,mano_total_loss:0.22513432800769806,hm_joints2d_loss:0.08709744364023209,obj_reg_loss:6.8570237159729,obj_conf_loss:3.1245005130767822,total_loss:10.293752670288086
(epoch: 69, time: Sat Oct  7 21:25:05 2023),mano_mesh3d_loss:0.07718764990568161,mano_joints3d_loss:0.08243744820356369,manopose_loss:0.04429706931114197,manoshape_loss:0.02068469673395157,mano_total_loss:0.22460657358169556,hm_joints2d_loss:0.08711066842079163,obj_reg_loss:6.865562438964844,obj_conf_loss:3.12186861038208,total_loss:10.299142837524414
(epoch: 70, time: Sat Oct  7 21:44:01 2023),mano_mesh3d_loss:0.07669926434755325,mano_joints3d_loss:0.08193569630384445,manopose_loss:0.04408050328493118,manoshape_loss:0.020810119807720184,mano_total_loss:0.22352568805217743,hm_joints2d_loss:0.08646570146083832,obj_reg_loss:6.827320575714111,obj_conf_loss:3.114396572113037,total_loss:10.251701354980469

I am looking forward to your reply. And thanks in advance for your help!

[rookiiiie]

Hello, @lzfff12 . Thanks for your excellent work.

I tried to retrain the model on the HO3Dv2 dataset using your default settings for three times. However, the best result I obtained is only 9.38 on the public leaderboard. Therefore, I wonder if you have some other tricks applied during training to boost the performance?

The following are the parameter output in option.txt and the trained losses for reference.

====== Options ======
HO3D_root: /media/data1/Dataset/HO3D_v2/Data
blocks: 1
channels: 256
dex_ycb_root: /media/data1/Dataset/data_for_alignsdf/dexycb/dex-ycb
epochs: 70
evaluate: False
host_folder: experiments/ho3d
inp_res: 256
lambda_joints2d: 100.0
lambda_objects: 500.0
lr: 0.0001
lr_decay_gamma: 0.7
lr_decay_step: 10
mano_lambda_joints3d: 10000.0
mano_lambda_manopose: 10
mano_lambda_manoshape: 0.1
mano_lambda_regulpose: 0.0
mano_lambda_regulshape: 0.0
mano_lambda_verts3d: 10000.0
mano_neurons: [1024, 512]
mano_root: assets/mano_models
manual_seed: 0
momentum: 0.9
network: honet_transformer
obj_model_root: assets/object_models
resume: None
save_results: True
snapshot: 10
stacks: 1
test_batch: 64
test_freq: 10
train_batch: 64
transformer_depth: 1
transformer_head: 4
use_cuda: 1
use_ho3d: True
weight_decay: 0.0005
workers: 16
=====================
launched traineval.py at 2023-10-06 23:15:23.422155

==== log  at Fri Oct  6 23:15:31 2023 ====
(epoch: 1, time: Fri Oct  6 23:42:02 2023),mano_mesh3d_loss:5.545252323150635,mano_joints3d_loss:5.8843488693237305,manopose_loss:1.0071043968200684,manoshape_loss:0.3506675064563751,mano_total_loss:12.787386894226074,hm_joints2d_loss:3.3286962509155273,obj_reg_loss:95.60641479492188,obj_conf_loss:10.81941032409668,total_loss:122.54190063476562
(epoch: 2, time: Sat Oct  7 00:01:25 2023),mano_mesh3d_loss:1.6909847259521484,mano_joints3d_loss:1.8189302682876587,manopose_loss:0.3632090091705322,manoshape_loss:0.2927539646625519,mano_total_loss:4.165874004364014,hm_joints2d_loss:1.0852590799331665,obj_reg_loss:74.8833999633789,obj_conf_loss:6.6124725341796875,total_loss:86.74691009521484
(epoch: 3, time: Sat Oct  7 00:20:30 2023),mano_mesh3d_loss:1.320427417755127,mano_joints3d_loss:1.418541669845581,manopose_loss:0.33809858560562134,manoshape_loss:0.2805778682231903,mano_total_loss:3.3576478958129883,hm_joints2d_loss:0.7900612354278564,obj_reg_loss:68.6631088256836,obj_conf_loss:6.496152877807617,total_loss:79.30706024169922
(epoch: 4, time: Sat Oct  7 00:39:24 2023),mano_mesh3d_loss:1.0319397449493408,mano_joints3d_loss:1.1067063808441162,manopose_loss:0.31386926770210266,manoshape_loss:0.27310410141944885,mano_total_loss:2.725619316101074,hm_joints2d_loss:0.626470148563385,obj_reg_loss:50.83426284790039,obj_conf_loss:6.533202648162842,total_loss:60.71949768066406
(epoch: 5, time: Sat Oct  7 00:58:18 2023),mano_mesh3d_loss:1.109512209892273,mano_joints3d_loss:1.1911731958389282,manopose_loss:0.3025909662246704,manoshape_loss:0.26847589015960693,mano_total_loss:2.8717548847198486,hm_joints2d_loss:0.6564722061157227,obj_reg_loss:32.07004165649414,obj_conf_loss:6.203098773956299,total_loss:41.8013801574707
(epoch: 6, time: Sat Oct  7 01:17:10 2023),mano_mesh3d_loss:0.8024893999099731,mano_joints3d_loss:0.8596831560134888,manopose_loss:0.2736554443836212,manoshape_loss:0.2501206696033478,mano_total_loss:2.1859476566314697,hm_joints2d_loss:0.49380725622177124,obj_reg_loss:24.4095458984375,obj_conf_loss:5.715297698974609,total_loss:32.8045654296875
(epoch: 7, time: Sat Oct  7 01:36:03 2023),mano_mesh3d_loss:0.7018308043479919,mano_joints3d_loss:0.7514442801475525,manopose_loss:0.2519541382789612,manoshape_loss:0.23022988438606262,mano_total_loss:1.9354584217071533,hm_joints2d_loss:0.4389413297176361,obj_reg_loss:21.660181045532227,obj_conf_loss:5.430682182312012,total_loss:29.465261459350586
(epoch: 8, time: Sat Oct  7 01:54:57 2023),mano_mesh3d_loss:0.7097055912017822,mano_joints3d_loss:0.760745108127594,manopose_loss:0.237700954079628,manoshape_loss:0.21521404385566711,mano_total_loss:1.9233664274215698,hm_joints2d_loss:0.4387645721435547,obj_reg_loss:20.013832092285156,obj_conf_loss:5.234278202056885,total_loss:27.61023712158203
(epoch: 9, time: Sat Oct  7 02:13:49 2023),mano_mesh3d_loss:0.6313846707344055,mano_joints3d_loss:0.6764567494392395,manopose_loss:0.21927033364772797,manoshape_loss:0.19187459349632263,mano_total_loss:1.7189861536026,hm_joints2d_loss:0.4031234681606293,obj_reg_loss:18.915592193603516,obj_conf_loss:5.095491886138916,total_loss:26.133188247680664
(epoch: 10, time: Sat Oct  7 02:32:41 2023),mano_mesh3d_loss:0.523613452911377,mano_joints3d_loss:0.5597004890441895,manopose_loss:0.20173479616641998,manoshape_loss:0.1715564727783203,mano_total_loss:1.4566054344177246,hm_joints2d_loss:0.34694531559944153,obj_reg_loss:18.07473373413086,obj_conf_loss:4.9923834800720215,total_loss:24.870689392089844
(epoch: 11, time: Sat Oct  7 02:54:18 2023),mano_mesh3d_loss:0.4169944226741791,mano_joints3d_loss:0.4443188011646271,manopose_loss:0.18351642787456512,manoshape_loss:0.15521594882011414,mano_total_loss:1.2000457048416138,hm_joints2d_loss:0.2933536171913147,obj_reg_loss:16.09233856201172,obj_conf_loss:4.738110542297363,total_loss:22.323837280273438
(epoch: 12, time: Sat Oct  7 03:13:10 2023),mano_mesh3d_loss:0.4134601652622223,mano_joints3d_loss:0.44073936343193054,manopose_loss:0.17495545744895935,manoshape_loss:0.14630506932735443,mano_total_loss:1.175460696220398,hm_joints2d_loss:0.28917309641838074,obj_reg_loss:15.431581497192383,obj_conf_loss:4.642738342285156,total_loss:21.538957595825195
(epoch: 13, time: Sat Oct  7 03:32:06 2023),mano_mesh3d_loss:0.38888412714004517,mano_joints3d_loss:0.41429993510246277,manopose_loss:0.16559498012065887,manoshape_loss:0.13578476011753082,mano_total_loss:1.1045626401901245,hm_joints2d_loss:0.27534645795822144,obj_reg_loss:15.078113555908203,obj_conf_loss:4.583775043487549,total_loss:21.04180145263672
(epoch: 14, time: Sat Oct  7 03:51:07 2023),mano_mesh3d_loss:0.3549215495586395,mano_joints3d_loss:0.37789350748062134,manopose_loss:0.15566569566726685,manoshape_loss:0.12407279014587402,mano_total_loss:1.0125529766082764,hm_joints2d_loss:0.25565218925476074,obj_reg_loss:14.624402046203613,obj_conf_loss:4.510421276092529,total_loss:20.403018951416016
(epoch: 15, time: Sat Oct  7 04:10:10 2023),mano_mesh3d_loss:0.33881744742393494,mano_joints3d_loss:0.3610582649707794,manopose_loss:0.14748990535736084,manoshape_loss:0.11132899671792984,mano_total_loss:0.9586951732635498,hm_joints2d_loss:0.24588024616241455,obj_reg_loss:14.220447540283203,obj_conf_loss:4.439467906951904,total_loss:19.864479064941406
(epoch: 16, time: Sat Oct  7 04:29:12 2023),mano_mesh3d_loss:0.344839483499527,mano_joints3d_loss:0.36794713139533997,manopose_loss:0.1418749988079071,manoshape_loss:0.10055044293403625,mano_total_loss:0.9552118182182312,hm_joints2d_loss:0.2514665722846985,obj_reg_loss:14.002887725830078,obj_conf_loss:4.404102802276611,total_loss:19.613676071166992
(epoch: 17, time: Sat Oct  7 04:48:17 2023),mano_mesh3d_loss:0.31140848994255066,mano_joints3d_loss:0.33215394616127014,manopose_loss:0.13374680280685425,manoshape_loss:0.09187189489603043,mano_total_loss:0.8691810369491577,hm_joints2d_loss:0.23249368369579315,obj_reg_loss:13.677811622619629,obj_conf_loss:4.357553958892822,total_loss:19.13705062866211
(epoch: 18, time: Sat Oct  7 05:07:23 2023),mano_mesh3d_loss:0.3076970875263214,mano_joints3d_loss:0.32838159799575806,manopose_loss:0.12850818037986755,manoshape_loss:0.08531295508146286,mano_total_loss:0.8499000072479248,hm_joints2d_loss:0.23005546629428864,obj_reg_loss:13.268312454223633,obj_conf_loss:4.292179107666016,total_loss:18.640451431274414
(epoch: 19, time: Sat Oct  7 05:26:21 2023),mano_mesh3d_loss:0.28561967611312866,mano_joints3d_loss:0.3048730790615082,manopose_loss:0.12182731181383133,manoshape_loss:0.0790138989686966,mano_total_loss:0.7913343906402588,hm_joints2d_loss:0.21642200648784637,obj_reg_loss:13.026782989501953,obj_conf_loss:4.262256622314453,total_loss:18.296777725219727
(epoch: 20, time: Sat Oct  7 05:45:18 2023),mano_mesh3d_loss:0.277950257062912,mano_joints3d_loss:0.2968460023403168,manopose_loss:0.11732558161020279,manoshape_loss:0.07458312064409256,mano_total_loss:0.7667051553726196,hm_joints2d_loss:0.21429479122161865,obj_reg_loss:12.710926055908203,obj_conf_loss:4.2091264724731445,total_loss:17.901058197021484
(epoch: 21, time: Sat Oct  7 06:06:40 2023),mano_mesh3d_loss:0.22853213548660278,mano_joints3d_loss:0.24356263875961304,manopose_loss:0.10862389206886292,manoshape_loss:0.06617280840873718,mano_total_loss:0.6468917727470398,hm_joints2d_loss:0.19150859117507935,obj_reg_loss:11.651315689086914,obj_conf_loss:4.061398506164551,total_loss:16.55109977722168
(epoch: 22, time: Sat Oct  7 06:25:32 2023),mano_mesh3d_loss:0.22958622872829437,mano_joints3d_loss:0.24495862424373627,manopose_loss:0.10522033274173737,manoshape_loss:0.06243627518415451,mano_total_loss:0.6422010064125061,hm_joints2d_loss:0.1889542043209076,obj_reg_loss:11.409490585327148,obj_conf_loss:4.019417762756348,total_loss:16.260072708129883
(epoch: 23, time: Sat Oct  7 06:44:26 2023),mano_mesh3d_loss:0.2153177112340927,mano_joints3d_loss:0.22962281107902527,manopose_loss:0.10147976875305176,manoshape_loss:0.058818519115448,mano_total_loss:0.6052390336990356,hm_joints2d_loss:0.18056973814964294,obj_reg_loss:11.198007583618164,obj_conf_loss:3.98140025138855,total_loss:15.965216636657715
(epoch: 24, time: Sat Oct  7 07:03:19 2023),mano_mesh3d_loss:0.20651397109031677,mano_joints3d_loss:0.22022728621959686,manopose_loss:0.09777483344078064,manoshape_loss:0.05607279762625694,mano_total_loss:0.580588698387146,hm_joints2d_loss:0.1739843785762787,obj_reg_loss:11.012195587158203,obj_conf_loss:3.9543087482452393,total_loss:15.721080780029297
(epoch: 25, time: Sat Oct  7 07:22:12 2023),mano_mesh3d_loss:0.20141790807247162,mano_joints3d_loss:0.21492783725261688,manopose_loss:0.09459319710731506,manoshape_loss:0.0531650073826313,mano_total_loss:0.5641037821769714,hm_joints2d_loss:0.17087452113628387,obj_reg_loss:10.864304542541504,obj_conf_loss:3.9264392852783203,total_loss:15.52572250366211
(epoch: 26, time: Sat Oct  7 07:41:09 2023),mano_mesh3d_loss:0.201676607131958,mano_joints3d_loss:0.21520575881004333,manopose_loss:0.09257832169532776,manoshape_loss:0.0514155849814415,mano_total_loss:0.5608764886856079,hm_joints2d_loss:0.17022444307804108,obj_reg_loss:10.622261047363281,obj_conf_loss:3.8847124576568604,total_loss:15.238078117370605
(epoch: 27, time: Sat Oct  7 08:00:07 2023),mano_mesh3d_loss:0.19071389734745026,mano_joints3d_loss:0.20348554849624634,manopose_loss:0.08914336562156677,manoshape_loss:0.04889301583170891,mano_total_loss:0.5322357416152954,hm_joints2d_loss:0.16337093710899353,obj_reg_loss:10.549095153808594,obj_conf_loss:3.870743751525879,total_loss:15.115458488464355
(epoch: 28, time: Sat Oct  7 08:19:07 2023),mano_mesh3d_loss:0.23688818514347076,mano_joints3d_loss:0.2534085214138031,manopose_loss:0.0935741439461708,manoshape_loss:0.05119090899825096,mano_total_loss:0.6350612640380859,hm_joints2d_loss:0.19653542339801788,obj_reg_loss:10.403693199157715,obj_conf_loss:3.8390674591064453,total_loss:15.074353218078613
(epoch: 29, time: Sat Oct  7 08:38:06 2023),mano_mesh3d_loss:0.19114631414413452,mano_joints3d_loss:0.20406465232372284,manopose_loss:0.08648949861526489,manoshape_loss:0.04697412624955177,mano_total_loss:0.5286747813224792,hm_joints2d_loss:0.16974963247776031,obj_reg_loss:10.26810073852539,obj_conf_loss:3.820260763168335,total_loss:14.786787033081055
(epoch: 30, time: Sat Oct  7 08:57:06 2023),mano_mesh3d_loss:0.17334526777267456,mano_joints3d_loss:0.1849597543478012,manopose_loss:0.08274952322244644,manoshape_loss:0.04422345012426376,mano_total_loss:0.48527833819389343,hm_joints2d_loss:0.1554250419139862,obj_reg_loss:10.121633529663086,obj_conf_loss:3.7856688499450684,total_loss:14.548008918762207
(epoch: 31, time: Sat Oct  7 09:18:31 2023),mano_mesh3d_loss:0.16478119790554047,mano_joints3d_loss:0.17587342858314514,manopose_loss:0.07944251596927643,manoshape_loss:0.041589926928281784,mano_total_loss:0.4616870880126953,hm_joints2d_loss:0.15273596346378326,obj_reg_loss:9.506138801574707,obj_conf_loss:3.6882781982421875,total_loss:13.80883502960205
(epoch: 32, time: Sat Oct  7 09:37:30 2023),mano_mesh3d_loss:0.15073515474796295,mano_joints3d_loss:0.16063547134399414,manopose_loss:0.07667186111211777,manoshape_loss:0.04007638618350029,mano_total_loss:0.4281182885169983,hm_joints2d_loss:0.14260604977607727,obj_reg_loss:9.351908683776855,obj_conf_loss:3.6598691940307617,total_loss:13.582501411437988
(epoch: 33, time: Sat Oct  7 09:56:27 2023),mano_mesh3d_loss:0.14841628074645996,mano_joints3d_loss:0.15824133157730103,manopose_loss:0.07510595768690109,manoshape_loss:0.0386144183576107,mano_total_loss:0.4203777015209198,hm_joints2d_loss:0.1396702080965042,obj_reg_loss:9.239740371704102,obj_conf_loss:3.633779287338257,total_loss:13.433578491210938
(epoch: 34, time: Sat Oct  7 10:15:24 2023),mano_mesh3d_loss:0.14759379625320435,mano_joints3d_loss:0.1574031263589859,manopose_loss:0.07368716597557068,manoshape_loss:0.03823874145746231,mano_total_loss:0.4169226884841919,hm_joints2d_loss:0.13818441331386566,obj_reg_loss:9.119954109191895,obj_conf_loss:3.6089816093444824,total_loss:13.284035682678223
(epoch: 35, time: Sat Oct  7 10:34:22 2023),mano_mesh3d_loss:0.14904358983039856,mano_joints3d_loss:0.15902993083000183,manopose_loss:0.07242788374423981,manoshape_loss:0.037397585809230804,mano_total_loss:0.4178985357284546,hm_joints2d_loss:0.1392756700515747,obj_reg_loss:9.069344520568848,obj_conf_loss:3.5924813747406006,total_loss:13.219003677368164
(epoch: 36, time: Sat Oct  7 10:53:18 2023),mano_mesh3d_loss:0.14350050687789917,mano_joints3d_loss:0.15311022102832794,manopose_loss:0.0709749087691307,manoshape_loss:0.036276381462812424,mano_total_loss:0.4038615822792053,hm_joints2d_loss:0.13455429673194885,obj_reg_loss:9.051795959472656,obj_conf_loss:3.595832347869873,total_loss:13.186050415039062
(epoch: 37, time: Sat Oct  7 11:12:13 2023),mano_mesh3d_loss:0.14273126423358917,mano_joints3d_loss:0.15233394503593445,manopose_loss:0.06969793140888214,manoshape_loss:0.03588210791349411,mano_total_loss:0.40064552426338196,hm_joints2d_loss:0.13360971212387085,obj_reg_loss:8.948972702026367,obj_conf_loss:3.57106614112854,total_loss:13.054300308227539
(epoch: 38, time: Sat Oct  7 11:31:07 2023),mano_mesh3d_loss:0.13943752646446228,mano_joints3d_loss:0.14888498187065125,manopose_loss:0.0683208778500557,manoshape_loss:0.034927383065223694,mano_total_loss:0.3915705680847168,hm_joints2d_loss:0.1317022144794464,obj_reg_loss:8.835185050964355,obj_conf_loss:3.544879674911499,total_loss:12.903342247009277
(epoch: 39, time: Sat Oct  7 11:50:01 2023),mano_mesh3d_loss:0.13801789283752441,mano_joints3d_loss:0.14734631776809692,manopose_loss:0.06706735491752625,manoshape_loss:0.03384441137313843,mano_total_loss:0.38627585768699646,hm_joints2d_loss:0.13088363409042358,obj_reg_loss:8.772802352905273,obj_conf_loss:3.527719736099243,total_loss:12.817673683166504
(epoch: 40, time: Sat Oct  7 12:08:56 2023),mano_mesh3d_loss:0.13565415143966675,mano_joints3d_loss:0.14483524858951569,manopose_loss:0.06606493145227432,manoshape_loss:0.03335905075073242,mano_total_loss:0.3799135088920593,hm_joints2d_loss:0.12853878736495972,obj_reg_loss:8.71053695678711,obj_conf_loss:3.5165371894836426,total_loss:12.735530853271484
(epoch: 41, time: Sat Oct  7 12:30:16 2023),mano_mesh3d_loss:0.12016043812036514,mano_joints3d_loss:0.12817123532295227,manopose_loss:0.06273456662893295,manoshape_loss:0.031158236786723137,mano_total_loss:0.3422246277332306,hm_joints2d_loss:0.11996433883905411,obj_reg_loss:8.308180809020996,obj_conf_loss:3.449866771697998,total_loss:12.220237731933594
(epoch: 42, time: Sat Oct  7 12:49:10 2023),mano_mesh3d_loss:0.11684741824865341,mano_joints3d_loss:0.1246257871389389,manopose_loss:0.06163860112428665,manoshape_loss:0.030793393030762672,mano_total_loss:0.33390501141548157,hm_joints2d_loss:0.11763712018728256,obj_reg_loss:8.220166206359863,obj_conf_loss:3.4317102432250977,total_loss:12.103408813476562
(epoch: 43, time: Sat Oct  7 13:08:03 2023),mano_mesh3d_loss:0.11615670472383499,mano_joints3d_loss:0.12390806525945663,manopose_loss:0.06090841442346573,manoshape_loss:0.030320031568408012,mano_total_loss:0.3312932252883911,hm_joints2d_loss:0.11643796414136887,obj_reg_loss:8.138731002807617,obj_conf_loss:3.419668436050415,total_loss:12.006118774414062
(epoch: 44, time: Sat Oct  7 13:26:57 2023),mano_mesh3d_loss:0.11400722712278366,mano_joints3d_loss:0.12164226174354553,manopose_loss:0.05996820703148842,manoshape_loss:0.029928108677268028,mano_total_loss:0.32554587721824646,hm_joints2d_loss:0.1151140034198761,obj_reg_loss:8.098417282104492,obj_conf_loss:3.4054768085479736,total_loss:11.944546699523926
(epoch: 45, time: Sat Oct  7 13:45:51 2023),mano_mesh3d_loss:0.11454638093709946,mano_joints3d_loss:0.12228084355592728,manopose_loss:0.05945529043674469,manoshape_loss:0.029216475784778595,mano_total_loss:0.3254990875720978,hm_joints2d_loss:0.11491260677576065,obj_reg_loss:7.9944000244140625,obj_conf_loss:3.383631706237793,total_loss:11.818445205688477
(epoch: 46, time: Sat Oct  7 14:04:47 2023),mano_mesh3d_loss:0.11160285025835037,mano_joints3d_loss:0.1191403791308403,manopose_loss:0.05832337215542793,manoshape_loss:0.028604691848158836,mano_total_loss:0.31767117977142334,hm_joints2d_loss:0.11264491826295853,obj_reg_loss:7.98276424407959,obj_conf_loss:3.376598358154297,total_loss:11.789679527282715
(epoch: 47, time: Sat Oct  7 14:23:42 2023),mano_mesh3d_loss:0.11110903322696686,mano_joints3d_loss:0.11865051835775375,manopose_loss:0.05760474130511284,manoshape_loss:0.028183262795209885,mano_total_loss:0.3155476152896881,hm_joints2d_loss:0.11159872263669968,obj_reg_loss:7.9566850662231445,obj_conf_loss:3.363412380218506,total_loss:11.747257232666016
(epoch: 48, time: Sat Oct  7 14:42:38 2023),mano_mesh3d_loss:0.1091856062412262,mano_joints3d_loss:0.11657179147005081,manopose_loss:0.056735437363386154,manoshape_loss:0.027795489877462387,mano_total_loss:0.3102882504463196,hm_joints2d_loss:0.1106155663728714,obj_reg_loss:7.884998321533203,obj_conf_loss:3.3498823642730713,total_loss:11.655786514282227
(epoch: 49, time: Sat Oct  7 15:01:35 2023),mano_mesh3d_loss:0.1097884252667427,mano_joints3d_loss:0.11723995953798294,manopose_loss:0.05634310096502304,manoshape_loss:0.027560019865632057,mano_total_loss:0.31093165278434753,hm_joints2d_loss:0.11030231416225433,obj_reg_loss:7.853546142578125,obj_conf_loss:3.3441338539123535,total_loss:11.618903160095215
(epoch: 50, time: Sat Oct  7 15:20:32 2023),mano_mesh3d_loss:0.10706812143325806,mano_joints3d_loss:0.11436346173286438,manopose_loss:0.05535992607474327,manoshape_loss:0.026760032400488853,mano_total_loss:0.303551584482193,hm_joints2d_loss:0.1082940325140953,obj_reg_loss:7.794037818908691,obj_conf_loss:3.329094171524048,total_loss:11.534963607788086
(epoch: 51, time: Sat Oct  7 15:41:52 2023),mano_mesh3d_loss:0.09684311598539352,mano_joints3d_loss:0.10332230478525162,manopose_loss:0.053307268768548965,manoshape_loss:0.02556159719824791,mano_total_loss:0.2790343165397644,hm_joints2d_loss:0.1032257229089737,obj_reg_loss:7.533874988555908,obj_conf_loss:3.2844197750091553,total_loss:11.200546264648438
(epoch: 52, time: Sat Oct  7 16:00:49 2023),mano_mesh3d_loss:0.09450680762529373,mano_joints3d_loss:0.10085099190473557,manopose_loss:0.052514947950839996,manoshape_loss:0.025269990786910057,mano_total_loss:0.27314284443855286,hm_joints2d_loss:0.10182569175958633,obj_reg_loss:7.460644245147705,obj_conf_loss:3.267666816711426,total_loss:11.103293418884277
(epoch: 53, time: Sat Oct  7 16:19:46 2023),mano_mesh3d_loss:0.09501060098409653,mano_joints3d_loss:0.1014629378914833,manopose_loss:0.05211701616644859,manoshape_loss:0.025020809844136238,mano_total_loss:0.27361124753952026,hm_joints2d_loss:0.10079546272754669,obj_reg_loss:7.461483001708984,obj_conf_loss:3.261809825897217,total_loss:11.097702980041504
(epoch: 54, time: Sat Oct  7 16:38:42 2023),mano_mesh3d_loss:0.09330987930297852,mano_joints3d_loss:0.09960994124412537,manopose_loss:0.05142093822360039,manoshape_loss:0.024672970175743103,mano_total_loss:0.2690138518810272,hm_joints2d_loss:0.09964569658041,obj_reg_loss:7.3937153816223145,obj_conf_loss:3.2502307891845703,total_loss:11.012606620788574
(epoch: 55, time: Sat Oct  7 16:57:39 2023),mano_mesh3d_loss:0.09286456555128098,mano_joints3d_loss:0.09916429966688156,manopose_loss:0.050903432071208954,manoshape_loss:0.024266956374049187,mano_total_loss:0.2671990692615509,hm_joints2d_loss:0.0990472212433815,obj_reg_loss:7.3620781898498535,obj_conf_loss:3.24031138420105,total_loss:10.968634605407715
(epoch: 56, time: Sat Oct  7 17:16:35 2023),mano_mesh3d_loss:0.09175398200750351,mano_joints3d_loss:0.09801234304904938,manopose_loss:0.05042383447289467,manoshape_loss:0.02417638897895813,mano_total_loss:0.26436638832092285,hm_joints2d_loss:0.09816519170999527,obj_reg_loss:7.323878765106201,obj_conf_loss:3.2299399375915527,total_loss:10.916350364685059
(epoch: 57, time: Sat Oct  7 17:35:32 2023),mano_mesh3d_loss:0.0910763218998909,mano_joints3d_loss:0.09726162254810333,manopose_loss:0.04974101856350899,manoshape_loss:0.023786157369613647,mano_total_loss:0.26186510920524597,hm_joints2d_loss:0.09725120663642883,obj_reg_loss:7.318131446838379,obj_conf_loss:3.2261650562286377,total_loss:10.903412818908691
(epoch: 58, time: Sat Oct  7 17:54:29 2023),mano_mesh3d_loss:0.09058976918458939,mano_joints3d_loss:0.09672299027442932,manopose_loss:0.04962611198425293,manoshape_loss:0.02374994568526745,mano_total_loss:0.2606890797615051,hm_joints2d_loss:0.09684713929891586,obj_reg_loss:7.309973239898682,obj_conf_loss:3.224032402038574,total_loss:10.8915433883667
(epoch: 59, time: Sat Oct  7 18:13:25 2023),mano_mesh3d_loss:0.08985183387994766,mano_joints3d_loss:0.09598299115896225,manopose_loss:0.04902930185198784,manoshape_loss:0.023459285497665405,mano_total_loss:0.25832319259643555,hm_joints2d_loss:0.09613147377967834,obj_reg_loss:7.263236045837402,obj_conf_loss:3.2125003337860107,total_loss:10.830181121826172
(epoch: 60, time: Sat Oct  7 18:32:21 2023),mano_mesh3d_loss:0.08880581706762314,mano_joints3d_loss:0.0948566421866417,manopose_loss:0.04857998341321945,manoshape_loss:0.023149723187088966,mano_total_loss:0.2553921937942505,hm_joints2d_loss:0.09555651247501373,obj_reg_loss:7.233233451843262,obj_conf_loss:3.2053377628326416,total_loss:10.789507865905762
(epoch: 61, time: Sat Oct  7 18:53:40 2023),mano_mesh3d_loss:0.08232354372739792,mano_joints3d_loss:0.08788643777370453,manopose_loss:0.04713120684027672,manoshape_loss:0.022293152287602425,mano_total_loss:0.23963432013988495,hm_joints2d_loss:0.09172297269105911,obj_reg_loss:7.020287036895752,obj_conf_loss:3.166713237762451,total_loss:10.518362045288086
(epoch: 62, time: Sat Oct  7 19:12:36 2023),mano_mesh3d_loss:0.08107398450374603,mano_joints3d_loss:0.0865740180015564,manopose_loss:0.04653767868876457,manoshape_loss:0.022064145654439926,mano_total_loss:0.2362498790025711,hm_joints2d_loss:0.09076698869466782,obj_reg_loss:7.007259368896484,obj_conf_loss:3.1664960384368896,total_loss:10.500771522521973
(epoch: 63, time: Sat Oct  7 19:31:33 2023),mano_mesh3d_loss:0.08061462640762329,mano_joints3d_loss:0.08610554784536362,manopose_loss:0.046216391026973724,manoshape_loss:0.02184167318046093,mano_total_loss:0.23477840423583984,hm_joints2d_loss:0.09029495716094971,obj_reg_loss:6.9472975730896,obj_conf_loss:3.147662878036499,total_loss:10.420034408569336
(epoch: 64, time: Sat Oct  7 19:50:27 2023),mano_mesh3d_loss:0.08001669496297836,mano_joints3d_loss:0.08543546497821808,manopose_loss:0.04600432887673378,manoshape_loss:0.021648744121193886,mano_total_loss:0.23310525715351105,hm_joints2d_loss:0.08920629322528839,obj_reg_loss:6.9754958152771,obj_conf_loss:3.1554527282714844,total_loss:10.453252792358398
(epoch: 65, time: Sat Oct  7 20:09:23 2023),mano_mesh3d_loss:0.07977167516946793,mano_joints3d_loss:0.08519323915243149,manopose_loss:0.045651257038116455,manoshape_loss:0.02133576199412346,mano_total_loss:0.23195204138755798,hm_joints2d_loss:0.08907648921012878,obj_reg_loss:6.944581508636475,obj_conf_loss:3.1451847553253174,total_loss:10.41077995300293
(epoch: 66, time: Sat Oct  7 20:28:18 2023),mano_mesh3d_loss:0.07970717549324036,mano_joints3d_loss:0.08516678214073181,manopose_loss:0.045242391526699066,manoshape_loss:0.021310513839125633,mano_total_loss:0.23142695426940918,hm_joints2d_loss:0.08866064250469208,obj_reg_loss:6.913706302642822,obj_conf_loss:3.1371090412139893,total_loss:10.370906829833984
(epoch: 67, time: Sat Oct  7 20:47:14 2023),mano_mesh3d_loss:0.07800474762916565,mano_joints3d_loss:0.08331823348999023,manopose_loss:0.04487057030200958,manoshape_loss:0.02107924036681652,mano_total_loss:0.22727279365062714,hm_joints2d_loss:0.08763626962900162,obj_reg_loss:6.888713359832764,obj_conf_loss:3.130798578262329,total_loss:10.334418296813965
(epoch: 68, time: Sat Oct  7 21:06:10 2023),mano_mesh3d_loss:0.07723458856344223,mano_joints3d_loss:0.08247040957212448,manopose_loss:0.044599227607250214,manoshape_loss:0.0208301842212677,mano_total_loss:0.22513432800769806,hm_joints2d_loss:0.08709744364023209,obj_reg_loss:6.8570237159729,obj_conf_loss:3.1245005130767822,total_loss:10.293752670288086
(epoch: 69, time: Sat Oct  7 21:25:05 2023),mano_mesh3d_loss:0.07718764990568161,mano_joints3d_loss:0.08243744820356369,manopose_loss:0.04429706931114197,manoshape_loss:0.02068469673395157,mano_total_loss:0.22460657358169556,hm_joints2d_loss:0.08711066842079163,obj_reg_loss:6.865562438964844,obj_conf_loss:3.12186861038208,total_loss:10.299142837524414
(epoch: 70, time: Sat Oct  7 21:44:01 2023),mano_mesh3d_loss:0.07669926434755325,mano_joints3d_loss:0.08193569630384445,manopose_loss:0.04408050328493118,manoshape_loss:0.020810119807720184,mano_total_loss:0.22352568805217743,hm_joints2d_loss:0.08646570146083832,obj_reg_loss:6.827320575714111,obj_conf_loss:3.114396572113037,total_loss:10.251701354980469

I am looking forward to your reply. And thanks in advance for your help!

hello，have you used multiple GPUs for training?I can't even get such a good result as yours..

[rookiiiie]

option.txt：

====== Options ======
HO3D_root: E:/localPy/HFL-Net-main/data/ho3d_v2
blocks: 1
channels: 256
dex_ycb_root: D:/Git/data1/zhifeng/dex-ycb
epochs: 60
evaluate: False
host_folder: host_folder/ho3d
inp_res: 256
lambda_joints2d: 100.0
lambda_objects: 500.0
lr: 0.0001
lr_decay_gamma: 0.7
lr_decay_step: 10
mano_lambda_joints3d: 10000.0
mano_lambda_manopose: 10
mano_lambda_manoshape: 0.1
mano_lambda_regulpose: 0.0
mano_lambda_regulshape: 0.0
mano_lambda_verts3d: 10000.0
mano_neurons: [1024, 512]
mano_root: assets/mano_models
manual_seed: 0
momentum: 0.9
network: honet_transformer
obj_model_root: assets/object_models
resume: None
save_results: True
snapshot: 10
stacks: 1
test_batch: 64
test_freq: 10
train_batch: 64
transformer_depth: 1
transformer_head: 4
use_cuda: 1
use_ho3d: True
weight_decay: 0.0005
workers: 16

train.txt：

==== log  at Wed Oct 25 01:40:52 2023 ====
(epoch: 1, time: Wed Oct 25 01:52:17 2023),mano_mesh3d_loss:10.752909660339355,mano_joints3d_loss:11.451794624328613,manopose_loss:1.289530873298645,manoshape_loss:0.3697274625301361,mano_total_loss:23.86395263671875,hm_joints2d_loss:6.5248870849609375,obj_reg_loss:96.85530853271484,obj_conf_loss:10.933370590209961,total_loss:138.1775360107422
(epoch: 2, time: Wed Oct 25 02:03:28 2023),mano_mesh3d_loss:4.629872798919678,mano_joints3d_loss:4.9628729820251465,manopose_loss:0.4780120253562927,manoshape_loss:0.32294487953186035,mano_total_loss:10.393712997436523,hm_joints2d_loss:4.203575611114502,obj_reg_loss:75.1034927368164,obj_conf_loss:6.743462562561035,total_loss:96.44424438476562
(epoch: 3, time: Wed Oct 25 02:14:38 2023),mano_mesh3d_loss:3.918079376220703,mano_joints3d_loss:4.212019443511963,manopose_loss:0.44128432869911194,manoshape_loss:0.31245240569114685,mano_total_loss:8.883832931518555,hm_joints2d_loss:3.205676555633545,obj_reg_loss:71.31925964355469,obj_conf_loss:6.484461784362793,total_loss:89.89317321777344
(epoch: 4, time: Wed Oct 25 02:25:49 2023),mano_mesh3d_loss:2.7081122398376465,mano_joints3d_loss:2.916504383087158,manopose_loss:0.3971784710884094,manoshape_loss:0.29889291524887085,mano_total_loss:6.320693016052246,hm_joints2d_loss:2.1719908714294434,obj_reg_loss:52.872005462646484,obj_conf_loss:6.808237075805664,total_loss:68.1729507446289
(epoch: 5, time: Wed Oct 25 02:37:01 2023),mano_mesh3d_loss:2.288590431213379,mano_joints3d_loss:2.4638617038726807,manopose_loss:0.3740963935852051,manoshape_loss:0.29061606526374817,mano_total_loss:5.417167663574219,hm_joints2d_loss:1.7243465185165405,obj_reg_loss:34.398860931396484,obj_conf_loss:6.466247081756592,total_loss:48.00663757324219
(epoch: 6, time: Wed Oct 25 02:48:11 2023),mano_mesh3d_loss:1.9901221990585327,mano_joints3d_loss:2.141371250152588,manopose_loss:0.3564828634262085,manoshape_loss:0.2840758264064789,mano_total_loss:4.77205228805542,hm_joints2d_loss:1.4532033205032349,obj_reg_loss:26.178821563720703,obj_conf_loss:5.9560160636901855,total_loss:38.36008071899414
(epoch: 7, time: Wed Oct 25 02:59:21 2023),mano_mesh3d_loss:1.7808808088302612,mano_joints3d_loss:1.9151705503463745,manopose_loss:0.3439672589302063,manoshape_loss:0.27842819690704346,mano_total_loss:4.318448543548584,hm_joints2d_loss:1.2809354066848755,obj_reg_loss:23.085390090942383,obj_conf_loss:5.652368545532227,total_loss:34.33715057373047
(epoch: 8, time: Wed Oct 25 03:10:30 2023),mano_mesh3d_loss:1.6949399709701538,mano_joints3d_loss:1.8231991529464722,manopose_loss:0.33483967185020447,manoshape_loss:0.27211278676986694,mano_total_loss:4.125091552734375,hm_joints2d_loss:1.1903128623962402,obj_reg_loss:21.269927978515625,obj_conf_loss:5.456887245178223,total_loss:32.04220962524414
(epoch: 9, time: Wed Oct 25 03:21:41 2023),mano_mesh3d_loss:1.4635310173034668,mano_joints3d_loss:1.5730884075164795,manopose_loss:0.32081156969070435,manoshape_loss:0.26460158824920654,mano_total_loss:3.622032642364502,hm_joints2d_loss:1.0599191188812256,obj_reg_loss:20.1235408782959,obj_conf_loss:5.337487697601318,total_loss:30.142982482910156
(epoch: 10, time: Wed Oct 25 03:32:51 2023),mano_mesh3d_loss:1.418460726737976,mano_joints3d_loss:1.523280143737793,manopose_loss:0.31185874342918396,manoshape_loss:0.25713586807250977,mano_total_loss:3.5107359886169434,hm_joints2d_loss:1.0269742012023926,obj_reg_loss:19.010021209716797,obj_conf_loss:5.207118511199951,total_loss:28.754823684692383
(epoch: 11, time: Wed Oct 25 03:46:43 2023),mano_mesh3d_loss:1.193665623664856,mano_joints3d_loss:1.280689001083374,manopose_loss:0.2987012267112732,manoshape_loss:0.250125914812088,mano_total_loss:3.0231823921203613,hm_joints2d_loss:0.9157587885856628,obj_reg_loss:16.938608169555664,obj_conf_loss:4.95547342300415,total_loss:25.833026885986328
(epoch: 12, time: Wed Oct 25 03:57:50 2023),mano_mesh3d_loss:1.1145036220550537,mano_joints3d_loss:1.195290446281433,manopose_loss:0.289430171251297,manoshape_loss:0.24314558506011963,mano_total_loss:2.842369556427002,hm_joints2d_loss:0.8486097455024719,obj_reg_loss:16.034114837646484,obj_conf_loss:4.8238844871521,total_loss:24.54898452758789
(epoch: 13, time: Wed Oct 25 04:08:58 2023),mano_mesh3d_loss:0.9834831953048706,mano_joints3d_loss:1.0544124841690063,manopose_loss:0.2776447534561157,manoshape_loss:0.23525017499923706,mano_total_loss:2.550790786743164,hm_joints2d_loss:0.776290237903595,obj_reg_loss:15.797685623168945,obj_conf_loss:4.783112049102783,total_loss:23.907852172851562
(epoch: 14, time: Wed Oct 25 04:20:05 2023),mano_mesh3d_loss:0.9185969829559326,mano_joints3d_loss:0.9848751425743103,manopose_loss:0.2688054144382477,manoshape_loss:0.22684742510318756,mano_total_loss:2.3991267681121826,hm_joints2d_loss:0.7364019751548767,obj_reg_loss:15.291302680969238,obj_conf_loss:4.711390495300293,total_loss:23.138221740722656
(epoch: 15, time: Wed Oct 25 04:31:13 2023),mano_mesh3d_loss:0.9470927119255066,mano_joints3d_loss:1.0160199403762817,manopose_loss:0.26361390948295593,manoshape_loss:0.22004179656505585,mano_total_loss:2.4467670917510986,hm_joints2d_loss:0.7441012859344482,obj_reg_loss:14.843892097473145,obj_conf_loss:4.6497697830200195,total_loss:22.684518814086914
(epoch: 16, time: Wed Oct 25 04:42:23 2023),mano_mesh3d_loss:0.8844348788261414,mano_joints3d_loss:0.9488947987556458,manopose_loss:0.25555214285850525,manoshape_loss:0.21306294202804565,mano_total_loss:2.3019464015960693,hm_joints2d_loss:0.7065331935882568,obj_reg_loss:14.548267364501953,obj_conf_loss:4.605362415313721,total_loss:22.162113189697266
(epoch: 17, time: Wed Oct 25 04:53:31 2023),mano_mesh3d_loss:0.8047218918800354,mano_joints3d_loss:0.8627440333366394,manopose_loss:0.24653878808021545,manoshape_loss:0.2039784938097,mano_total_loss:2.1179826259613037,hm_joints2d_loss:0.661069393157959,obj_reg_loss:14.104904174804688,obj_conf_loss:4.534990310668945,total_loss:21.418956756591797
(epoch: 18, time: Wed Oct 25 05:04:42 2023),mano_mesh3d_loss:0.8145290613174438,mano_joints3d_loss:0.8733441233634949,manopose_loss:0.24098022282123566,manoshape_loss:0.19874443113803864,mano_total_loss:2.1275970935821533,hm_joints2d_loss:0.6634856462478638,obj_reg_loss:13.81422233581543,obj_conf_loss:4.48942232131958,total_loss:21.0947265625
(epoch: 19, time: Wed Oct 25 05:15:53 2023),mano_mesh3d_loss:0.7527212500572205,mano_joints3d_loss:0.8070859313011169,manopose_loss:0.23149627447128296,manoshape_loss:0.19083136320114136,mano_total_loss:1.9821343421936035,hm_joints2d_loss:0.6252222061157227,obj_reg_loss:13.43486499786377,obj_conf_loss:4.436611652374268,total_loss:20.47881317138672
(epoch: 20, time: Wed Oct 25 05:27:04 2023),mano_mesh3d_loss:0.6978055834770203,mano_joints3d_loss:0.7475771307945251,manopose_loss:0.22276505827903748,manoshape_loss:0.18519411981105804,mano_total_loss:1.8533426523208618,hm_joints2d_loss:0.5955826044082642,obj_reg_loss:13.288825988769531,obj_conf_loss:4.411688327789307,total_loss:20.149442672729492
(epoch: 21, time: Wed Oct 25 05:40:41 2023),mano_mesh3d_loss:0.6163346171379089,mano_joints3d_loss:0.6598300933837891,manopose_loss:0.21307078003883362,manoshape_loss:0.17750677466392517,mano_total_loss:1.6667431592941284,hm_joints2d_loss:0.5490133762359619,obj_reg_loss:12.124747276306152,obj_conf_loss:4.249111652374268,total_loss:18.589618682861328
(epoch: 22, time: Wed Oct 25 05:51:53 2023),mano_mesh3d_loss:0.5889445543289185,mano_joints3d_loss:0.6301571130752563,manopose_loss:0.20686481893062592,manoshape_loss:0.17313581705093384,mano_total_loss:1.5991026163101196,hm_joints2d_loss:0.5260227918624878,obj_reg_loss:11.895912170410156,obj_conf_loss:4.204814434051514,total_loss:18.225852966308594
(epoch: 23, time: Wed Oct 25 06:03:04 2023),mano_mesh3d_loss:0.5638411045074463,mano_joints3d_loss:0.6031050682067871,manopose_loss:0.20107275247573853,manoshape_loss:0.16932927072048187,mano_total_loss:1.5373482704162598,hm_joints2d_loss:0.5113769173622131,obj_reg_loss:11.645064353942871,obj_conf_loss:4.155946254730225,total_loss:17.849721908569336
(epoch: 24, time: Wed Oct 25 06:14:15 2023),mano_mesh3d_loss:0.5516886711120605,mano_joints3d_loss:0.589899480342865,manopose_loss:0.19590947031974792,manoshape_loss:0.165851429104805,mano_total_loss:1.50334894657135,hm_joints2d_loss:0.5031511187553406,obj_reg_loss:11.465591430664062,obj_conf_loss:4.129396915435791,total_loss:17.601497650146484
(epoch: 25, time: Wed Oct 25 06:25:26 2023),mano_mesh3d_loss:0.5273696184158325,mano_joints3d_loss:0.5636463165283203,manopose_loss:0.19080750644207,manoshape_loss:0.16115736961364746,mano_total_loss:1.4429796934127808,hm_joints2d_loss:0.48509201407432556,obj_reg_loss:11.296234130859375,obj_conf_loss:4.095125675201416,total_loss:17.31943130493164
(epoch: 26, time: Wed Oct 25 06:36:42 2023),mano_mesh3d_loss:0.5195494890213013,mano_joints3d_loss:0.5554061532020569,manopose_loss:0.18638235330581665,manoshape_loss:0.15797892212867737,mano_total_loss:1.4193177223205566,hm_joints2d_loss:0.4740477502346039,obj_reg_loss:11.13321304321289,obj_conf_loss:4.059964656829834,total_loss:17.086536407470703
(epoch: 27, time: Wed Oct 25 06:47:51 2023),mano_mesh3d_loss:0.4989352524280548,mano_joints3d_loss:0.533070981502533,manopose_loss:0.18164299428462982,manoshape_loss:0.15430334210395813,mano_total_loss:1.3679529428482056,hm_joints2d_loss:0.462337851524353,obj_reg_loss:11.0255126953125,obj_conf_loss:4.048074245452881,total_loss:16.903888702392578
(epoch: 28, time: Wed Oct 25 06:59:02 2023),mano_mesh3d_loss:0.49263688921928406,mano_joints3d_loss:0.5262185335159302,manopose_loss:0.17773163318634033,manoshape_loss:0.15123704075813293,mano_total_loss:1.347824215888977,hm_joints2d_loss:0.4545643925666809,obj_reg_loss:10.866546630859375,obj_conf_loss:4.015366077423096,total_loss:16.68430519104004
(epoch: 29, time: Wed Oct 25 07:10:11 2023),mano_mesh3d_loss:0.4807720184326172,mano_joints3d_loss:0.5135596990585327,manopose_loss:0.17401611804962158,manoshape_loss:0.1483847200870514,mano_total_loss:1.316732406616211,hm_joints2d_loss:0.4473799169063568,obj_reg_loss:10.791046142578125,obj_conf_loss:4.0038018226623535,total_loss:16.558956146240234
(epoch: 30, time: Wed Oct 25 07:21:23 2023),mano_mesh3d_loss:0.47114014625549316,mano_joints3d_loss:0.5031269788742065,manopose_loss:0.17050711810588837,manoshape_loss:0.14502981305122375,mano_total_loss:1.2898037433624268,hm_joints2d_loss:0.43984442949295044,obj_reg_loss:10.584182739257812,obj_conf_loss:3.9672834873199463,total_loss:16.281103134155273
(epoch: 31, time: Wed Oct 25 07:35:07 2023),mano_mesh3d_loss:0.41468220949172974,mano_joints3d_loss:0.4422364830970764,manopose_loss:0.16384810209274292,manoshape_loss:0.14079593122005463,mano_total_loss:1.1615628004074097,hm_joints2d_loss:0.40340355038642883,obj_reg_loss:9.931541442871094,obj_conf_loss:3.860775947570801,total_loss:15.357304573059082
(epoch: 32, time: Wed Oct 25 07:46:16 2023),mano_mesh3d_loss:0.3969498574733734,mano_joints3d_loss:0.4229135811328888,manopose_loss:0.16038979589939117,manoshape_loss:0.13736507296562195,mano_total_loss:1.1176183223724365,hm_joints2d_loss:0.3919767141342163,obj_reg_loss:9.821260452270508,obj_conf_loss:3.8370723724365234,total_loss:15.167925834655762
(epoch: 33, time: Wed Oct 25 07:57:28 2023),mano_mesh3d_loss:0.39224880933761597,mano_joints3d_loss:0.4179043173789978,manopose_loss:0.15765786170959473,manoshape_loss:0.1353393793106079,mano_total_loss:1.1031500101089478,hm_joints2d_loss:0.3874833583831787,obj_reg_loss:9.660332679748535,obj_conf_loss:3.807631254196167,total_loss:14.958609580993652
(epoch: 34, time: Wed Oct 25 08:08:39 2023),mano_mesh3d_loss:0.37970519065856934,mano_joints3d_loss:0.4045814871788025,manopose_loss:0.1551581174135208,manoshape_loss:0.13317154347896576,mano_total_loss:1.0726162195205688,hm_joints2d_loss:0.37724757194519043,obj_reg_loss:9.531811714172363,obj_conf_loss:3.783555030822754,total_loss:14.76522445678711
(epoch: 35, time: Wed Oct 25 08:19:49 2023),mano_mesh3d_loss:0.38037270307540894,mano_joints3d_loss:0.40534377098083496,manopose_loss:0.1525384783744812,manoshape_loss:0.13065239787101746,mano_total_loss:1.068907618522644,hm_joints2d_loss:0.3749103546142578,obj_reg_loss:9.468002319335938,obj_conf_loss:3.7678425312042236,total_loss:14.679648399353027
(epoch: 36, time: Wed Oct 25 08:30:59 2023),mano_mesh3d_loss:0.36373138427734375,mano_joints3d_loss:0.38719385862350464,manopose_loss:0.14982393383979797,manoshape_loss:0.1283956915140152,mano_total_loss:1.0291451215744019,hm_joints2d_loss:0.368274986743927,obj_reg_loss:9.448993682861328,obj_conf_loss:3.765721559524536,total_loss:14.612144470214844
(epoch: 37, time: Wed Oct 25 08:42:10 2023),mano_mesh3d_loss:0.3638724088668823,mano_joints3d_loss:0.3875702917575836,manopose_loss:0.14771652221679688,manoshape_loss:0.12560367584228516,mano_total_loss:1.0247623920440674,hm_joints2d_loss:0.36348995566368103,obj_reg_loss:9.361434936523438,obj_conf_loss:3.7470695972442627,total_loss:14.49675178527832
(epoch: 38, time: Wed Oct 25 08:53:20 2023),mano_mesh3d_loss:0.35567665100097656,mano_joints3d_loss:0.37887656688690186,manopose_loss:0.14538151025772095,manoshape_loss:0.12356165796518326,mano_total_loss:1.003495693206787,hm_joints2d_loss:0.35647279024124146,obj_reg_loss:9.239431381225586,obj_conf_loss:3.7187163829803467,total_loss:14.31810188293457
(epoch: 39, time: Wed Oct 25 09:04:32 2023),mano_mesh3d_loss:0.3545629382133484,mano_joints3d_loss:0.3777306377887726,manopose_loss:0.14342275261878967,manoshape_loss:0.12178390473127365,mano_total_loss:0.9975000619888306,hm_joints2d_loss:0.35505324602127075,obj_reg_loss:9.162734985351562,obj_conf_loss:3.701186418533325,total_loss:14.216477394104004
(epoch: 40, time: Wed Oct 25 09:15:42 2023),mano_mesh3d_loss:0.34934934973716736,mano_joints3d_loss:0.3723464608192444,manopose_loss:0.14123259484767914,manoshape_loss:0.11915383487939835,mano_total_loss:0.9820817112922668,hm_joints2d_loss:0.34859272837638855,obj_reg_loss:9.107193946838379,obj_conf_loss:3.6828525066375732,total_loss:14.12072467803955
(epoch: 41, time: Wed Oct 25 09:29:17 2023),mano_mesh3d_loss:0.3166537284851074,mano_joints3d_loss:0.3369356691837311,manopose_loss:0.13702958822250366,manoshape_loss:0.11509580910205841,mano_total_loss:0.9057145714759827,hm_joints2d_loss:0.3259579837322235,obj_reg_loss:8.67348575592041,obj_conf_loss:3.617037057876587,total_loss:13.522196769714355
(epoch: 42, time: Wed Oct 25 09:40:26 2023),mano_mesh3d_loss:0.30322203040122986,mano_joints3d_loss:0.32240182161331177,manopose_loss:0.1351913958787918,manoshape_loss:0.1124424859881401,mano_total_loss:0.8732581734657288,hm_joints2d_loss:0.319118469953537,obj_reg_loss:8.579022407531738,obj_conf_loss:3.5982096195220947,total_loss:13.369601249694824
(epoch: 43, time: Wed Oct 25 09:51:38 2023),mano_mesh3d_loss:0.2991984784603119,mano_joints3d_loss:0.3180887997150421,manopose_loss:0.13326948881149292,manoshape_loss:0.11048780381679535,mano_total_loss:0.8610449433326721,hm_joints2d_loss:0.31597355008125305,obj_reg_loss:8.526888847351074,obj_conf_loss:3.5915284156799316,total_loss:13.29543399810791
(epoch: 44, time: Wed Oct 25 10:02:47 2023),mano_mesh3d_loss:0.2938302755355835,mano_joints3d_loss:0.31253358721733093,manopose_loss:0.1317608803510666,manoshape_loss:0.10860414803028107,mano_total_loss:0.8467288017272949,hm_joints2d_loss:0.3113006055355072,obj_reg_loss:8.471697807312012,obj_conf_loss:3.5736875534057617,total_loss:13.203421592712402
(epoch: 45, time: Wed Oct 25 10:13:57 2023),mano_mesh3d_loss:0.29078274965286255,mano_joints3d_loss:0.30930498242378235,manopose_loss:0.129866823554039,manoshape_loss:0.1057443842291832,mano_total_loss:0.8356990814208984,hm_joints2d_loss:0.3080862760543823,obj_reg_loss:8.350577354431152,obj_conf_loss:3.5544214248657227,total_loss:13.048791885375977
(epoch: 46, time: Wed Oct 25 10:25:08 2023),mano_mesh3d_loss:0.289814829826355,mano_joints3d_loss:0.3084244728088379,manopose_loss:0.12868648767471313,manoshape_loss:0.10353092104196548,mano_total_loss:0.8304575085639954,hm_joints2d_loss:0.305131196975708,obj_reg_loss:8.357501029968262,obj_conf_loss:3.5464112758636475,total_loss:13.039493560791016
(epoch: 47, time: Wed Oct 25 10:36:21 2023),mano_mesh3d_loss:0.28463542461395264,mano_joints3d_loss:0.3029240071773529,manopose_loss:0.12736032903194427,manoshape_loss:0.10103366523981094,mano_total_loss:0.8159525394439697,hm_joints2d_loss:0.3017639219760895,obj_reg_loss:8.291011810302734,obj_conf_loss:3.531067132949829,total_loss:12.93979263305664
(epoch: 48, time: Wed Oct 25 10:47:31 2023),mano_mesh3d_loss:0.2839604318141937,mano_joints3d_loss:0.3023182153701782,manopose_loss:0.12583155930042267,manoshape_loss:0.09867504984140396,mano_total_loss:0.8107843995094299,hm_joints2d_loss:0.29897844791412354,obj_reg_loss:8.246275901794434,obj_conf_loss:3.522000789642334,total_loss:12.878042221069336
(epoch: 49, time: Wed Oct 25 10:58:41 2023),mano_mesh3d_loss:0.27805042266845703,mano_joints3d_loss:0.2960144281387329,manopose_loss:0.12420348078012466,manoshape_loss:0.09670817852020264,mano_total_loss:0.7949761748313904,hm_joints2d_loss:0.2957865595817566,obj_reg_loss:8.218408584594727,obj_conf_loss:3.513432264328003,total_loss:12.822595596313477
(epoch: 50, time: Wed Oct 25 11:09:52 2023),mano_mesh3d_loss:0.27407968044281006,mano_joints3d_loss:0.2917310297489166,manopose_loss:0.12260081619024277,manoshape_loss:0.09477099031209946,mano_total_loss:0.7831826210021973,hm_joints2d_loss:0.2925334572792053,obj_reg_loss:8.145541191101074,obj_conf_loss:3.501967430114746,total_loss:12.723234176635742
(epoch: 51, time: Wed Oct 25 11:23:28 2023),mano_mesh3d_loss:0.25593605637550354,mano_joints3d_loss:0.2722707688808441,manopose_loss:0.12056838721036911,manoshape_loss:0.09211313724517822,mano_total_loss:0.7408881783485413,hm_joints2d_loss:0.27820852398872375,obj_reg_loss:7.874297142028809,obj_conf_loss:3.4541916847229004,total_loss:12.347591400146484
(epoch: 52, time: Wed Oct 25 11:34:36 2023),mano_mesh3d_loss:0.2514323890209198,mano_joints3d_loss:0.26729634404182434,manopose_loss:0.11895803362131119,manoshape_loss:0.0908338651061058,mano_total_loss:0.7285211682319641,hm_joints2d_loss:0.276092529296875,obj_reg_loss:7.791955947875977,obj_conf_loss:3.4337902069091797,total_loss:12.23036003112793
(epoch: 53, time: Wed Oct 25 11:45:48 2023),mano_mesh3d_loss:0.2502717673778534,mano_joints3d_loss:0.2662234902381897,manopose_loss:0.1176418736577034,manoshape_loss:0.09003624320030212,mano_total_loss:0.7241730093955994,hm_joints2d_loss:0.2741023898124695,obj_reg_loss:7.786301136016846,obj_conf_loss:3.4334709644317627,total_loss:12.218050003051758
(epoch: 54, time: Wed Oct 25 11:57:00 2023),mano_mesh3d_loss:0.24666082859039307,mano_joints3d_loss:0.26235440373420715,manopose_loss:0.1168682873249054,manoshape_loss:0.08864308148622513,mano_total_loss:0.7145267128944397,hm_joints2d_loss:0.2707567512989044,obj_reg_loss:7.723181247711182,obj_conf_loss:3.4204087257385254,total_loss:12.128878593444824
(epoch: 55, time: Wed Oct 25 12:08:12 2023),mano_mesh3d_loss:0.23850621283054352,mano_joints3d_loss:0.2534066438674927,manopose_loss:0.11548995971679688,manoshape_loss:0.08748502284288406,mano_total_loss:0.6948878169059753,hm_joints2d_loss:0.26775920391082764,obj_reg_loss:7.683210372924805,obj_conf_loss:3.407618761062622,total_loss:12.053478240966797
(epoch: 56, time: Wed Oct 25 12:19:21 2023),mano_mesh3d_loss:0.2446204274892807,mano_joints3d_loss:0.26020005345344543,manopose_loss:0.11479218304157257,manoshape_loss:0.08635731786489487,mano_total_loss:0.7059704065322876,hm_joints2d_loss:0.2668567895889282,obj_reg_loss:7.657772064208984,obj_conf_loss:3.4039435386657715,total_loss:12.03454303741455
(epoch: 57, time: Wed Oct 25 12:30:35 2023),mano_mesh3d_loss:0.23748382925987244,mano_joints3d_loss:0.2525421380996704,manopose_loss:0.11364442855119705,manoshape_loss:0.08547336608171463,mano_total_loss:0.6891438961029053,hm_joints2d_loss:0.26522210240364075,obj_reg_loss:7.639414310455322,obj_conf_loss:3.3926398754119873,total_loss:11.986421585083008
(epoch: 58, time: Wed Oct 25 12:41:57 2023),mano_mesh3d_loss:0.2319469302892685,mano_joints3d_loss:0.24651791155338287,manopose_loss:0.11278776824474335,manoshape_loss:0.08405213057994843,mano_total_loss:0.6753043532371521,hm_joints2d_loss:0.26136916875839233,obj_reg_loss:7.621338844299316,obj_conf_loss:3.3923985958099365,total_loss:11.950410842895508
(epoch: 59, time: Wed Oct 25 12:53:07 2023),mano_mesh3d_loss:0.2330622524023056,mano_joints3d_loss:0.24781538546085358,manopose_loss:0.11174234002828598,manoshape_loss:0.08335136622190475,mano_total_loss:0.6759718060493469,hm_joints2d_loss:0.2587144672870636,obj_reg_loss:7.584078311920166,obj_conf_loss:3.3814706802368164,total_loss:11.900238990783691
(epoch: 60, time: Wed Oct 25 13:04:18 2023),mano_mesh3d_loss:0.2318374663591385,mano_joints3d_loss:0.24655134975910187,manopose_loss:0.11092830449342728,manoshape_loss:0.08326156437397003,mano_total_loss:0.6725788116455078,hm_joints2d_loss:0.2578127682209015,obj_reg_loss:7.551944732666016,obj_conf_loss:3.377779722213745,total_loss:11.86011028289795

The above are the running results of 60 epochs. I used the predicted JSON file of the 60th epoch to evaluate the results on codalab as follows:

Evaluation 3D KP results:
auc=0.047, mean_kp3d_avg=10571.21 cm
Evaluation 3D KP PROCRUSTES ALIGNED results:
auc=0.783, mean_kp3d_avg=1.09 cm
Evaluation 3D KP SCALE-TRANSLATION ALIGNED results:
auc=0.409, mean_kp3d_avg=3.86 cm

Evaluation 3D MESH results:
auc=0.000, mean_kp3d_avg=10125.54 cm
Evaluation 3D MESH ALIGNED results:
auc=0.786, mean_kp3d_avg=1.07 cm

F-scores
[email protected] = 0.000 	[email protected] = 0.468
[email protected] = 0.000 	[email protected] = 0.936

It seems that my results are much worse than yours!

[dyklq]

Your model seems to not converge since the mano_joints3d_loss is still very high. Have you tried to train on another machine? I tried on multiple machines and 9.38 is the best one :(

[rookiiiie]

Your model seems to not converge since the mano_joints3d_loss is still very high. Have you tried to train on another machine? I tried on multiple machines and 9.38 is the best one :(

May I ask what type of GPU you are using? Have you ever had a situation where the convergence effect is poor just like mine?

[rookiiiie]

hello！About the file ho3d.py in folder 'dataset'：

with open(train_label_root + '/ho3d_train_data.json', 'r') as f:
                 data_ho3d = json.load(f)

Do you use the file 'ho3d_train_data.json' provided by the author?

Its content is as follows：
{"images": [{"id": 0, "file_name": "SMu41/rgb/1583.png", "width": 640, "height": 480}, {"id": 1, "file_name": "ShSu10/rgb/0832.png", "width": 640, "height": 480}, {"id": 2, "file_name": "GPMF11/rgb/0281.png", "width": 640, "height": 480}.....}

I don't think it contains enough information.

So I used the preprocessed JSON file provided by its baseline "https://github.com/stevenlsw/Semi-Hand-Object" ,can u tell me how you handle this？

Thank you.

[rookiiiie]

Hello, @lzfff12 . Thanks for your excellent work.
I am looking forward to your reply. And thanks in advance for your help!

hello,after alter,i have tried twice (the first time was the configuration of the original code，the second time was when I fine-tuned the settings),here is my second result（More effective than first one）：

options.txt

====== Options ======
HO3D_root: E:/localPy/HFL-Net-main/data/ho3d_v2
blocks: 1
channels: 256
dex_ycb_root: D:/Git/data1/zhifeng/dex-ycb
epochs: 70
evaluate: False
host_folder: host_folder/ho3d
inp_res: 256
lambda_joints2d: 100.0
lambda_objects: 500.0
lr: 0.0001
lr_decay_gamma: 0.7
lr_decay_step: 10
mano_lambda_joints3d: 10000.0
mano_lambda_manopose: 10
mano_lambda_manoshape: 0.1
mano_lambda_regulpose: 0.2
mano_lambda_regulshape: 0.2
mano_lambda_verts3d: 10000.0
mano_neurons: [1024, 512]
mano_root: assets/mano_models
manual_seed: 0
momentum: 0.9
network: honet_transformer
obj_model_root: assets/object_models
resume: None
save_results: True
snapshot: 10
stacks: 1
test_batch: 64
test_freq: 10
train_batch: 64
transformer_depth: 1
transformer_head: 4
use_cuda: 1
use_ho3d: True
weight_decay: 0.001
workers: 16

train.txt：

==== log  at Sat Oct 28 04:20:45 2023 ====
(epoch: 1, time: Sat Oct 28 04:32:04 2023),mano_mesh3d_loss:5.662834167480469,mano_joints3d_loss:6.009425163269043,manopose_loss:1.0275304317474365,manoshape_loss:0.35120895504951477,mano_total_loss:13.050987243652344,hm_joints2d_loss:3.332943916320801,obj_reg_loss:95.97749328613281,obj_conf_loss:10.82190227508545,total_loss:123.1833724975586
(epoch: 2, time: Sat Oct 28 04:43:13 2023),mano_mesh3d_loss:1.7092427015304565,mano_joints3d_loss:1.838788390159607,manopose_loss:0.3695008456707001,manoshape_loss:0.29448679089546204,mano_total_loss:4.2120184898376465,hm_joints2d_loss:1.0964133739471436,obj_reg_loss:74.93360900878906,obj_conf_loss:6.622196197509766,total_loss:86.86421966552734
(epoch: 3, time: Sat Oct 28 04:54:22 2023),mano_mesh3d_loss:1.241330623626709,mano_joints3d_loss:1.332657814025879,manopose_loss:0.33577996492385864,manoshape_loss:0.280681312084198,mano_total_loss:3.1904513835906982,hm_joints2d_loss:0.7641048431396484,obj_reg_loss:65.98077392578125,obj_conf_loss:6.6194376945495605,total_loss:76.55472564697266
(epoch: 4, time: Sat Oct 28 05:05:30 2023),mano_mesh3d_loss:1.074718713760376,mano_joints3d_loss:1.1533006429672241,manopose_loss:0.3129923641681671,manoshape_loss:0.27333492040634155,mano_total_loss:2.8143465518951416,hm_joints2d_loss:0.6560158729553223,obj_reg_loss:43.1744384765625,obj_conf_loss:6.532155990600586,total_loss:53.17695999145508
(epoch: 5, time: Sat Oct 28 05:16:39 2023),mano_mesh3d_loss:0.8916702270507812,mano_joints3d_loss:0.9558337330818176,manopose_loss:0.2903936803340912,manoshape_loss:0.26218751072883606,mano_total_loss:2.400084972381592,hm_joints2d_loss:0.5454354286193848,obj_reg_loss:30.977998733520508,obj_conf_loss:6.160439968109131,total_loss:40.08393096923828
(epoch: 6, time: Sat Oct 28 05:27:48 2023),mano_mesh3d_loss:0.7830766439437866,mano_joints3d_loss:0.8389892578125,manopose_loss:0.26648566126823425,manoshape_loss:0.24429908394813538,mano_total_loss:2.132850408554077,hm_joints2d_loss:0.485781729221344,obj_reg_loss:23.728727340698242,obj_conf_loss:5.701799392700195,total_loss:32.049163818359375
(epoch: 7, time: Sat Oct 28 05:38:57 2023),mano_mesh3d_loss:0.7074136734008789,mano_joints3d_loss:0.7578544020652771,manopose_loss:0.2474588006734848,manoshape_loss:0.22751455008983612,mano_total_loss:1.9402421712875366,hm_joints2d_loss:0.43951788544654846,obj_reg_loss:21.181623458862305,obj_conf_loss:5.4152326583862305,total_loss:28.976593017578125
(epoch: 8, time: Sat Oct 28 05:50:05 2023),mano_mesh3d_loss:0.6819313168525696,mano_joints3d_loss:0.7305638790130615,manopose_loss:0.2345249354839325,manoshape_loss:0.21270360052585602,mano_total_loss:1.8597235679626465,hm_joints2d_loss:0.42826828360557556,obj_reg_loss:19.724390029907227,obj_conf_loss:5.23876953125,total_loss:27.251142501831055
(epoch: 9, time: Sat Oct 28 06:01:15 2023),mano_mesh3d_loss:0.566699743270874,mano_joints3d_loss:0.606271505355835,manopose_loss:0.21531590819358826,manoshape_loss:0.1904924213886261,mano_total_loss:1.5787794589996338,hm_joints2d_loss:0.36369195580482483,obj_reg_loss:18.8460693359375,obj_conf_loss:5.13468074798584,total_loss:25.92321014404297
(epoch: 10, time: Sat Oct 28 06:12:24 2023),mano_mesh3d_loss:0.5373648405075073,mano_joints3d_loss:0.5746345520019531,manopose_loss:0.20171691477298737,manoshape_loss:0.17193517088890076,mano_total_loss:1.4856501817703247,hm_joints2d_loss:0.3476342558860779,obj_reg_loss:17.96419906616211,obj_conf_loss:5.0319504737854,total_loss:24.82945442199707
(epoch: 11, time: Sat Oct 28 06:26:04 2023),mano_mesh3d_loss:0.4485572874546051,mano_joints3d_loss:0.47871464490890503,manopose_loss:0.18699632585048676,manoshape_loss:0.15731799602508545,mano_total_loss:1.2715870141983032,hm_joints2d_loss:0.309822142124176,obj_reg_loss:15.925003051757812,obj_conf_loss:4.760201454162598,total_loss:22.266626358032227
(epoch: 12, time: Sat Oct 28 06:37:11 2023),mano_mesh3d_loss:0.40595823526382446,mano_joints3d_loss:0.43283167481422424,manopose_loss:0.17622996866703033,manoshape_loss:0.14559805393218994,mano_total_loss:1.1606184244155884,hm_joints2d_loss:0.2844153344631195,obj_reg_loss:15.3441743850708,obj_conf_loss:4.662963390350342,total_loss:21.45216178894043
(epoch: 13, time: Sat Oct 28 06:48:22 2023),mano_mesh3d_loss:0.3820558786392212,mano_joints3d_loss:0.4072566628456116,manopose_loss:0.16696564853191376,manoshape_loss:0.1341530680656433,mano_total_loss:1.0904302597045898,hm_joints2d_loss:0.2705530524253845,obj_reg_loss:15.037650108337402,obj_conf_loss:4.610491752624512,total_loss:21.009130477905273
(epoch: 14, time: Sat Oct 28 06:59:33 2023),mano_mesh3d_loss:0.3696688413619995,mano_joints3d_loss:0.39424899220466614,manopose_loss:0.1591099351644516,manoshape_loss:0.12204775214195251,mano_total_loss:1.0450762510299683,hm_joints2d_loss:0.26182112097740173,obj_reg_loss:14.576507568359375,obj_conf_loss:4.537997245788574,total_loss:20.421415328979492
(epoch: 15, time: Sat Oct 28 07:10:42 2023),mano_mesh3d_loss:0.3448692858219147,mano_joints3d_loss:0.3679249882698059,manopose_loss:0.15044954419136047,manoshape_loss:0.11074288189411163,mano_total_loss:0.973986029624939,hm_joints2d_loss:0.24927860498428345,obj_reg_loss:14.205662727355957,obj_conf_loss:4.4779372215271,total_loss:19.9068660736084
(epoch: 16, time: Sat Oct 28 07:21:51 2023),mano_mesh3d_loss:0.3370217978954315,mano_joints3d_loss:0.35975182056427,manopose_loss:0.14321072399616241,manoshape_loss:0.102091483771801,mano_total_loss:0.9420754909515381,hm_joints2d_loss:0.24294531345367432,obj_reg_loss:13.906782150268555,obj_conf_loss:4.438730716705322,total_loss:19.53054428100586
(epoch: 17, time: Sat Oct 28 07:33:00 2023),mano_mesh3d_loss:0.32418736815452576,mano_joints3d_loss:0.3461523652076721,manopose_loss:0.13678163290023804,manoshape_loss:0.09566398710012436,mano_total_loss:0.90278559923172,hm_joints2d_loss:0.23915356397628784,obj_reg_loss:13.599492073059082,obj_conf_loss:4.398905277252197,total_loss:19.14032554626465
(epoch: 18, time: Sat Oct 28 07:44:09 2023),mano_mesh3d_loss:0.3067699372768402,mano_joints3d_loss:0.32761362195014954,manopose_loss:0.1303979903459549,manoshape_loss:0.08971349895000458,mano_total_loss:0.8544954657554626,hm_joints2d_loss:0.22962167859077454,obj_reg_loss:13.17901611328125,obj_conf_loss:4.328402519226074,total_loss:18.591533660888672
(epoch: 19, time: Sat Oct 28 07:55:16 2023),mano_mesh3d_loss:0.3326760232448578,mano_joints3d_loss:0.35582032799720764,manopose_loss:0.1292036771774292,manoshape_loss:0.08780618011951447,mano_total_loss:0.9055067300796509,hm_joints2d_loss:0.24861286580562592,obj_reg_loss:12.922616004943848,obj_conf_loss:4.296939373016357,total_loss:18.373680114746094
(epoch: 20, time: Sat Oct 28 08:06:26 2023),mano_mesh3d_loss:0.2851618528366089,mano_joints3d_loss:0.3047958314418793,manopose_loss:0.1207108274102211,manoshape_loss:0.0808601826429367,mano_total_loss:0.791528582572937,hm_joints2d_loss:0.21976621448993683,obj_reg_loss:12.635034561157227,obj_conf_loss:4.240077495574951,total_loss:17.886398315429688
(epoch: 21, time: Sat Oct 28 08:20:13 2023),mano_mesh3d_loss:0.2413000762462616,mano_joints3d_loss:0.2576342225074768,manopose_loss:0.11208445578813553,manoshape_loss:0.0733523964881897,mano_total_loss:0.6843715310096741,hm_joints2d_loss:0.19743114709854126,obj_reg_loss:11.594879150390625,obj_conf_loss:4.087043285369873,total_loss:16.563737869262695
(epoch: 22, time: Sat Oct 28 08:31:23 2023),mano_mesh3d_loss:0.23808254301548004,mano_joints3d_loss:0.25420594215393066,manopose_loss:0.1087004542350769,manoshape_loss:0.07033073157072067,mano_total_loss:0.6713203191757202,hm_joints2d_loss:0.19552989304065704,obj_reg_loss:11.357163429260254,obj_conf_loss:4.046005725860596,total_loss:16.270015716552734
(epoch: 23, time: Sat Oct 28 08:42:34 2023),mano_mesh3d_loss:0.22303153574466705,mano_joints3d_loss:0.2381325513124466,manopose_loss:0.1043282151222229,manoshape_loss:0.06636489182710648,mano_total_loss:0.6318575143814087,hm_joints2d_loss:0.18510396778583527,obj_reg_loss:11.204244613647461,obj_conf_loss:4.013647556304932,total_loss:16.034841537475586
(epoch: 24, time: Sat Oct 28 08:53:41 2023),mano_mesh3d_loss:0.21834805607795715,mano_joints3d_loss:0.23316016793251038,manopose_loss:0.10139405727386475,manoshape_loss:0.06390062719583511,mano_total_loss:0.616802990436554,hm_joints2d_loss:0.18174901604652405,obj_reg_loss:10.998129844665527,obj_conf_loss:3.9754202365875244,total_loss:15.77209758758545
(epoch: 25, time: Sat Oct 28 09:04:50 2023),mano_mesh3d_loss:0.2267076075077057,mano_joints3d_loss:0.24229414761066437,manopose_loss:0.10017641633749008,manoshape_loss:0.06223537400364876,mano_total_loss:0.6314136981964111,hm_joints2d_loss:0.18706148862838745,obj_reg_loss:10.882990837097168,obj_conf_loss:3.9570155143737793,total_loss:15.658480644226074
(epoch: 26, time: Sat Oct 28 09:16:01 2023),mano_mesh3d_loss:0.20992885529994965,mano_joints3d_loss:0.22425466775894165,manopose_loss:0.09644884616136551,manoshape_loss:0.05919996276497841,mano_total_loss:0.5898324847221375,hm_joints2d_loss:0.17612944543361664,obj_reg_loss:10.692288398742676,obj_conf_loss:3.9185421466827393,total_loss:15.376782417297363
(epoch: 27, time: Sat Oct 28 09:27:09 2023),mano_mesh3d_loss:0.20439286530017853,mano_joints3d_loss:0.21843118965625763,manopose_loss:0.09337317943572998,manoshape_loss:0.056570958346128464,mano_total_loss:0.5727676749229431,hm_joints2d_loss:0.17172567546367645,obj_reg_loss:10.570456504821777,obj_conf_loss:3.8927483558654785,total_loss:15.207696914672852
(epoch: 28, time: Sat Oct 28 09:38:18 2023),mano_mesh3d_loss:0.20159512758255005,mano_joints3d_loss:0.21540959179401398,manopose_loss:0.09143779426813126,manoshape_loss:0.054532893002033234,mano_total_loss:0.5629754662513733,hm_joints2d_loss:0.16953451931476593,obj_reg_loss:10.492072105407715,obj_conf_loss:3.877789258956909,total_loss:15.102376937866211
(epoch: 29, time: Sat Oct 28 09:49:28 2023),mano_mesh3d_loss:0.20265913009643555,mano_joints3d_loss:0.21668246388435364,manopose_loss:0.08963057398796082,manoshape_loss:0.05374207720160484,mano_total_loss:0.5627146363258362,hm_joints2d_loss:0.169356569647789,obj_reg_loss:10.426400184631348,obj_conf_loss:3.863560199737549,total_loss:15.022018432617188
(epoch: 30, time: Sat Oct 28 10:00:38 2023),mano_mesh3d_loss:0.19642247259616852,mano_joints3d_loss:0.21001696586608887,manopose_loss:0.0872916579246521,manoshape_loss:0.0508001334965229,mano_total_loss:0.5445307493209839,hm_joints2d_loss:0.16633856296539307,obj_reg_loss:10.198943138122559,obj_conf_loss:3.815551996231079,total_loss:14.725363731384277
(epoch: 31, time: Sat Oct 28 10:14:11 2023),mano_mesh3d_loss:0.16568946838378906,mano_joints3d_loss:0.17683908343315125,manopose_loss:0.08211340755224228,manoshape_loss:0.04720231518149376,mano_total_loss:0.4718441963195801,hm_joints2d_loss:0.15033352375030518,obj_reg_loss:9.601272583007812,obj_conf_loss:3.7213919162750244,total_loss:13.94483470916748
(epoch: 32, time: Sat Oct 28 10:25:19 2023),mano_mesh3d_loss:0.17451374232769012,mano_joints3d_loss:0.18646077811717987,manopose_loss:0.08178779482841492,manoshape_loss:0.04850923642516136,mano_total_loss:0.49127134680747986,hm_joints2d_loss:0.15547028183937073,obj_reg_loss:9.466179847717285,obj_conf_loss:3.6913211345672607,total_loss:13.804255485534668
(epoch: 33, time: Sat Oct 28 10:36:30 2023),mano_mesh3d_loss:0.15718041360378265,mano_joints3d_loss:0.16772334277629852,manopose_loss:0.07845774292945862,manoshape_loss:0.04543435946106911,mano_total_loss:0.4487956762313843,hm_joints2d_loss:0.14588990807533264,obj_reg_loss:9.32116985321045,obj_conf_loss:3.6623103618621826,total_loss:13.57817268371582
(epoch: 34, time: Sat Oct 28 10:47:40 2023),mano_mesh3d_loss:0.15411457419395447,mano_joints3d_loss:0.16449466347694397,manopose_loss:0.07683444023132324,manoshape_loss:0.04411856085062027,mano_total_loss:0.4395628571510315,hm_joints2d_loss:0.14205093681812286,obj_reg_loss:9.232551574707031,obj_conf_loss:3.6429340839385986,total_loss:13.457100868225098
(epoch: 35, time: Sat Oct 28 10:58:50 2023),mano_mesh3d_loss:0.15422479808330536,mano_joints3d_loss:0.16464848816394806,manopose_loss:0.07577081769704819,manoshape_loss:0.04326550289988518,mano_total_loss:0.4379095435142517,hm_joints2d_loss:0.14130626618862152,obj_reg_loss:9.17093276977539,obj_conf_loss:3.6278951168060303,total_loss:13.378044128417969
(epoch: 36, time: Sat Oct 28 11:10:00 2023),mano_mesh3d_loss:0.15343570709228516,mano_joints3d_loss:0.16386844217777252,manopose_loss:0.07454315572977066,manoshape_loss:0.04216218367218971,mano_total_loss:0.43400922417640686,hm_joints2d_loss:0.14049193263053894,obj_reg_loss:9.180436134338379,obj_conf_loss:3.6301958560943604,total_loss:13.385126113891602
(epoch: 37, time: Sat Oct 28 11:21:10 2023),mano_mesh3d_loss:0.16436193883419037,mano_joints3d_loss:0.1756923496723175,manopose_loss:0.07478334754705429,manoshape_loss:0.04260081797838211,mano_total_loss:0.4574384093284607,hm_joints2d_loss:0.1493612378835678,obj_reg_loss:9.0538969039917,obj_conf_loss:3.6091856956481934,total_loss:13.269893646240234
(epoch: 38, time: Sat Oct 28 11:32:21 2023),mano_mesh3d_loss:0.1467495560646057,mano_joints3d_loss:0.15678171813488007,manopose_loss:0.07179394364356995,manoshape_loss:0.04037374258041382,mano_total_loss:0.41569873690605164,hm_joints2d_loss:0.13658347725868225,obj_reg_loss:8.964479446411133,obj_conf_loss:3.583949089050293,total_loss:13.100708961486816
(epoch: 39, time: Sat Oct 28 11:43:29 2023),mano_mesh3d_loss:0.14664947986602783,mano_joints3d_loss:0.1567125916481018,manopose_loss:0.0704290047287941,manoshape_loss:0.03937835991382599,mano_total_loss:0.4131694734096527,hm_joints2d_loss:0.13533154129981995,obj_reg_loss:8.905155181884766,obj_conf_loss:3.5679280757904053,total_loss:13.021589279174805
(epoch: 40, time: Sat Oct 28 11:54:39 2023),mano_mesh3d_loss:0.14597277343273163,mano_joints3d_loss:0.15601740777492523,manopose_loss:0.06963561475276947,manoshape_loss:0.038897741585969925,mano_total_loss:0.4105234146118164,hm_joints2d_loss:0.13427306711673737,obj_reg_loss:8.873422622680664,obj_conf_loss:3.556645154953003,total_loss:12.97485637664795
(epoch: 41, time: Sat Oct 28 12:08:19 2023),mano_mesh3d_loss:0.12881845235824585,mano_joints3d_loss:0.13751783967018127,manopose_loss:0.06606460362672806,manoshape_loss:0.03656820207834244,mano_total_loss:0.36896902322769165,hm_joints2d_loss:0.12540531158447266,obj_reg_loss:8.405516624450684,obj_conf_loss:3.482649087905884,total_loss:12.382532119750977
(epoch: 42, time: Sat Oct 28 12:19:30 2023),mano_mesh3d_loss:0.12560255825519562,mano_joints3d_loss:0.13411390781402588,manopose_loss:0.06481858342885971,manoshape_loss:0.03593159466981888,mano_total_loss:0.36046671867370605,hm_joints2d_loss:0.12262165546417236,obj_reg_loss:8.346345901489258,obj_conf_loss:3.467864751815796,total_loss:12.297296524047852
(epoch: 43, time: Sat Oct 28 12:30:41 2023),mano_mesh3d_loss:0.12390559911727905,mano_joints3d_loss:0.13230720162391663,manopose_loss:0.06397642195224762,manoshape_loss:0.03563334420323372,mano_total_loss:0.35582235455513,hm_joints2d_loss:0.1214630976319313,obj_reg_loss:8.284894943237305,obj_conf_loss:3.455350160598755,total_loss:12.217531204223633
(epoch: 44, time: Sat Oct 28 12:41:48 2023),mano_mesh3d_loss:0.1229902133345604,mano_joints3d_loss:0.13137127459049225,manopose_loss:0.06320002675056458,manoshape_loss:0.03475012630224228,mano_total_loss:0.35231155157089233,hm_joints2d_loss:0.12045256793498993,obj_reg_loss:8.233452796936035,obj_conf_loss:3.4427366256713867,total_loss:12.148958206176758
(epoch: 45, time: Sat Oct 28 12:52:58 2023),mano_mesh3d_loss:0.12175589799880981,mano_joints3d_loss:0.13006193935871124,manopose_loss:0.062149778008461,manoshape_loss:0.03422839567065239,mano_total_loss:0.3481960892677307,hm_joints2d_loss:0.11923261731863022,obj_reg_loss:8.115653991699219,obj_conf_loss:3.4177277088165283,total_loss:12.00079345703125
(epoch: 46, time: Sat Oct 28 13:04:09 2023),mano_mesh3d_loss:0.12115732580423355,mano_joints3d_loss:0.12948668003082275,manopose_loss:0.061326585710048676,manoshape_loss:0.034037355333566666,mano_total_loss:0.34600749611854553,hm_joints2d_loss:0.11851581931114197,obj_reg_loss:8.11032772064209,obj_conf_loss:3.412278413772583,total_loss:11.987126350402832
(epoch: 47, time: Sat Oct 28 13:15:20 2023),mano_mesh3d_loss:0.1253247708082199,mano_joints3d_loss:0.13404950499534607,manopose_loss:0.06109656020998955,manoshape_loss:0.033268820494413376,mano_total_loss:0.35373950004577637,hm_joints2d_loss:0.1208271011710167,obj_reg_loss:8.07556438446045,obj_conf_loss:3.4025168418884277,total_loss:11.952635765075684
(epoch: 48, time: Sat Oct 28 13:26:30 2023),mano_mesh3d_loss:0.11985543370246887,mano_joints3d_loss:0.12814730405807495,manopose_loss:0.060057979077100754,manoshape_loss:0.03258959576487541,mano_total_loss:0.34065043926239014,hm_joints2d_loss:0.11802057176828384,obj_reg_loss:8.004759788513184,obj_conf_loss:3.3876311779022217,total_loss:11.851078987121582
(epoch: 49, time: Sat Oct 28 13:37:41 2023),mano_mesh3d_loss:0.11691064387559891,mano_joints3d_loss:0.12493997067213058,manopose_loss:0.05921006575226784,manoshape_loss:0.03257705271244049,mano_total_loss:0.3336375951766968,hm_joints2d_loss:0.11568503826856613,obj_reg_loss:7.974672794342041,obj_conf_loss:3.3817553520202637,total_loss:11.805760383605957
(epoch: 50, time: Sat Oct 28 13:48:50 2023),mano_mesh3d_loss:0.11554089933633804,mano_joints3d_loss:0.12353342771530151,manopose_loss:0.05817755311727524,manoshape_loss:0.031938016414642334,mano_total_loss:0.329189658164978,hm_joints2d_loss:0.11398716270923615,obj_reg_loss:7.9070353507995605,obj_conf_loss:3.369141101837158,total_loss:11.719348907470703
(epoch: 51, time: Sat Oct 28 14:02:36 2023),mano_mesh3d_loss:0.10344426333904266,mano_joints3d_loss:0.11045370995998383,manopose_loss:0.055916376411914825,manoshape_loss:0.030225815251469612,mano_total_loss:0.30004048347473145,hm_joints2d_loss:0.10746721178293228,obj_reg_loss:7.651699542999268,obj_conf_loss:3.317945718765259,total_loss:11.377151489257812
(epoch: 52, time: Sat Oct 28 14:13:52 2023),mano_mesh3d_loss:0.10194513201713562,mano_joints3d_loss:0.10886973887681961,manopose_loss:0.05515212193131447,manoshape_loss:0.029877573251724243,mano_total_loss:0.2958447337150574,hm_joints2d_loss:0.10663778334856033,obj_reg_loss:7.559969425201416,obj_conf_loss:3.3037054538726807,total_loss:11.266155242919922
(epoch: 53, time: Sat Oct 28 14:25:01 2023),mano_mesh3d_loss:0.10208802670240402,mano_joints3d_loss:0.1090310662984848,manopose_loss:0.05464491993188858,manoshape_loss:0.029633978381752968,mano_total_loss:0.29539793729782104,hm_joints2d_loss:0.10559526085853577,obj_reg_loss:7.563592433929443,obj_conf_loss:3.2987234592437744,total_loss:11.263313293457031
(epoch: 54, time: Sat Oct 28 14:36:09 2023),mano_mesh3d_loss:0.10122016817331314,mano_joints3d_loss:0.10814669728279114,manopose_loss:0.054077111184597015,manoshape_loss:0.02943260595202446,mano_total_loss:0.2928770184516907,hm_joints2d_loss:0.10487799346446991,obj_reg_loss:7.485760688781738,obj_conf_loss:3.2843728065490723,total_loss:11.167890548706055
(epoch: 55, time: Sat Oct 28 14:47:20 2023),mano_mesh3d_loss:0.10205835849046707,mano_joints3d_loss:0.10903657227754593,manopose_loss:0.053719278424978256,manoshape_loss:0.028941920027136803,mano_total_loss:0.2937563359737396,hm_joints2d_loss:0.10538212954998016,obj_reg_loss:7.457801342010498,obj_conf_loss:3.272324562072754,total_loss:11.129267692565918
(epoch: 56, time: Sat Oct 28 14:58:32 2023),mano_mesh3d_loss:0.09829597920179367,mano_joints3d_loss:0.10505352914333344,manopose_loss:0.052780020982027054,manoshape_loss:0.02858399786055088,mano_total_loss:0.284713476896286,hm_joints2d_loss:0.10253097862005234,obj_reg_loss:7.439862251281738,obj_conf_loss:3.270693302154541,total_loss:11.09780502319336
(epoch: 57, time: Sat Oct 28 15:09:41 2023),mano_mesh3d_loss:0.09729442000389099,mano_joints3d_loss:0.10396406054496765,manopose_loss:0.052309274673461914,manoshape_loss:0.028072619810700417,mano_total_loss:0.2816403806209564,hm_joints2d_loss:0.1019558534026146,obj_reg_loss:7.415909290313721,obj_conf_loss:3.263462543487549,total_loss:11.062966346740723
(epoch: 58, time: Sat Oct 28 15:20:50 2023),mano_mesh3d_loss:0.09801080077886581,mano_joints3d_loss:0.1047215461730957,manopose_loss:0.05206959322094917,manoshape_loss:0.027966607362031937,mano_total_loss:0.282768577337265,hm_joints2d_loss:0.10198980569839478,obj_reg_loss:7.398490905761719,obj_conf_loss:3.2593257427215576,total_loss:11.04257583618164
(epoch: 59, time: Sat Oct 28 15:32:00 2023),mano_mesh3d_loss:0.0968116968870163,mano_joints3d_loss:0.10345067083835602,manopose_loss:0.05133624002337456,manoshape_loss:0.027651330456137657,mano_total_loss:0.27924996614456177,hm_joints2d_loss:0.10103309154510498,obj_reg_loss:7.359562397003174,obj_conf_loss:3.2471320629119873,total_loss:10.986968994140625
(epoch: 60, time: Sat Oct 28 15:43:12 2023),mano_mesh3d_loss:0.09643588215112686,mano_joints3d_loss:0.10310786962509155,manopose_loss:0.051103103905916214,manoshape_loss:0.02742544561624527,mano_total_loss:0.27807238698005676,hm_joints2d_loss:0.10060996562242508,obj_reg_loss:7.3342976570129395,obj_conf_loss:3.2417984008789062,total_loss:10.954782485961914
(epoch: 61, time: Sat Oct 28 15:56:49 2023),mano_mesh3d_loss:0.08837481588125229,mano_joints3d_loss:0.09439828991889954,manopose_loss:0.04942017048597336,manoshape_loss:0.02664175070822239,mano_total_loss:0.25883516669273376,hm_joints2d_loss:0.09577089548110962,obj_reg_loss:7.107104778289795,obj_conf_loss:3.2011754512786865,total_loss:10.66286849975586
(epoch: 62, time: Sat Oct 28 16:07:56 2023),mano_mesh3d_loss:0.08631057292222977,mano_joints3d_loss:0.09216723591089249,manopose_loss:0.04876800253987312,manoshape_loss:0.0261559896171093,mano_total_loss:0.25340181589126587,hm_joints2d_loss:0.09409265965223312,obj_reg_loss:7.09523344039917,obj_conf_loss:3.199032783508301,total_loss:10.64176082611084
(epoch: 63, time: Sat Oct 28 16:19:05 2023),mano_mesh3d_loss:0.0863175168633461,mano_joints3d_loss:0.09219611436128616,manopose_loss:0.04831601679325104,manoshape_loss:0.025971749797463417,mano_total_loss:0.2528013586997986,hm_joints2d_loss:0.09402365982532501,obj_reg_loss:7.023326873779297,obj_conf_loss:3.177539587020874,total_loss:10.547697067260742
(epoch: 64, time: Sat Oct 28 16:30:15 2023),mano_mesh3d_loss:0.08572214096784592,mano_joints3d_loss:0.09159374237060547,manopose_loss:0.04797494038939476,manoshape_loss:0.025726692751049995,mano_total_loss:0.25101736187934875,hm_joints2d_loss:0.09326569736003876,obj_reg_loss:7.040609836578369,obj_conf_loss:3.185788869857788,total_loss:10.570687294006348
(epoch: 65, time: Sat Oct 28 16:41:23 2023),mano_mesh3d_loss:0.08503575623035431,mano_joints3d_loss:0.09086427837610245,manopose_loss:0.04766691476106644,manoshape_loss:0.02547791600227356,mano_total_loss:0.2490449696779251,hm_joints2d_loss:0.09280109405517578,obj_reg_loss:7.017753601074219,obj_conf_loss:3.1747889518737793,total_loss:10.534392356872559
(epoch: 66, time: Sat Oct 28 16:52:31 2023),mano_mesh3d_loss:0.08514980971813202,mano_joints3d_loss:0.09098846465349197,manopose_loss:0.04729922488331795,manoshape_loss:0.025491511449217796,mano_total_loss:0.24892912805080414,hm_joints2d_loss:0.09225159138441086,obj_reg_loss:6.975396633148193,obj_conf_loss:3.1682169437408447,total_loss:10.484794616699219
(epoch: 67, time: Sat Oct 28 17:03:41 2023),mano_mesh3d_loss:0.08326686173677444,mano_joints3d_loss:0.08896473795175552,manopose_loss:0.046716149896383286,manoshape_loss:0.02502763643860817,mano_total_loss:0.2439752221107483,hm_joints2d_loss:0.0913994163274765,obj_reg_loss:6.958188533782959,obj_conf_loss:3.1610074043273926,total_loss:10.454562187194824
(epoch: 68, time: Sat Oct 28 17:14:52 2023),mano_mesh3d_loss:0.08348693698644638,mano_joints3d_loss:0.08918599784374237,manopose_loss:0.0464562326669693,manoshape_loss:0.024929193779826164,mano_total_loss:0.2440582811832428,hm_joints2d_loss:0.09143798798322678,obj_reg_loss:6.923981189727783,obj_conf_loss:3.155660390853882,total_loss:10.415136337280273
(epoch: 69, time: Sat Oct 28 17:26:02 2023),mano_mesh3d_loss:0.08321628719568253,mano_joints3d_loss:0.08891810476779938,manopose_loss:0.04632878303527832,manoshape_loss:0.024727454409003258,mano_total_loss:0.24319081008434296,hm_joints2d_loss:0.09073806554079056,obj_reg_loss:6.943118572235107,obj_conf_loss:3.1519672870635986,total_loss:10.429012298583984
(epoch: 70, time: Sat Oct 28 17:37:11 2023),mano_mesh3d_loss:0.08251919597387314,mano_joints3d_loss:0.0881907045841217,manopose_loss:0.04587491229176521,manoshape_loss:0.02451799251139164,mano_total_loss:0.24110279977321625,hm_joints2d_loss:0.09034167975187302,obj_reg_loss:6.905939102172852,obj_conf_loss:3.1496031284332275,total_loss:10.386990547180176

codalab.stout_epoch_70.txt：

Evaluation 3D KP results:
auc=0.047, mean_kp3d_avg=10728.32 cm
Evaluation 3D KP PROCRUSTES ALIGNED results:
auc=0.806, mean_kp3d_avg=0.97 cm
Evaluation 3D KP SCALE-TRANSLATION ALIGNED results:
auc=0.499, mean_kp3d_avg=2.84 cm

Evaluation 3D MESH results:
auc=0.000, mean_kp3d_avg=10276.98 cm
Evaluation 3D MESH ALIGNED results:
auc=0.809, mean_kp3d_avg=0.96 cm

F-scores
[email protected] = 0.000 	[email protected] = 0.541
[email protected] = 0.000 	[email protected] = 0.954

It seems that there is still a certain gap between my results and yours（9.38）.

How do you gain the result？Have you received results similar to mine？

I am looking forward to your reply~

[kyxxc]

Hello, I would like to ask you how you successfully reproduced the code

I encountered this error during the replication process and was unable to find/data1/zhifeng/hoddv2/evaluation. txt . May I ask if you encountered this situation while running the code?

Looking forward to your reply

[happyStudyOk]

Hello, @lzfff12 . Thanks for your excellent work.

I tried to retrain the model on the HO3Dv2 dataset using your default settings for three times. However, the best result I obtained is only 9.38 on the public leaderboard. Therefore, I wonder if you have some other tricks applied during training to boost the performance?

The following are the parameter output in option.txt and the trained losses for reference.

====== Options ======
HO3D_root: /media/data1/Dataset/HO3D_v2/Data
blocks: 1
channels: 256
dex_ycb_root: /media/data1/Dataset/data_for_alignsdf/dexycb/dex-ycb
epochs: 70
evaluate: False
host_folder: experiments/ho3d
inp_res: 256
lambda_joints2d: 100.0
lambda_objects: 500.0
lr: 0.0001
lr_decay_gamma: 0.7
lr_decay_step: 10
mano_lambda_joints3d: 10000.0
mano_lambda_manopose: 10
mano_lambda_manoshape: 0.1
mano_lambda_regulpose: 0.0
mano_lambda_regulshape: 0.0
mano_lambda_verts3d: 10000.0
mano_neurons: [1024, 512]
mano_root: assets/mano_models
manual_seed: 0
momentum: 0.9
network: honet_transformer
obj_model_root: assets/object_models
resume: None
save_results: True
snapshot: 10
stacks: 1
test_batch: 64
test_freq: 10
train_batch: 64
transformer_depth: 1
transformer_head: 4
use_cuda: 1
use_ho3d: True
weight_decay: 0.0005
workers: 16
=====================
launched traineval.py at 2023-10-06 23:15:23.422155

==== log  at Fri Oct  6 23:15:31 2023 ====
(epoch: 1, time: Fri Oct  6 23:42:02 2023),mano_mesh3d_loss:5.545252323150635,mano_joints3d_loss:5.8843488693237305,manopose_loss:1.0071043968200684,manoshape_loss:0.3506675064563751,mano_total_loss:12.787386894226074,hm_joints2d_loss:3.3286962509155273,obj_reg_loss:95.60641479492188,obj_conf_loss:10.81941032409668,total_loss:122.54190063476562
(epoch: 2, time: Sat Oct  7 00:01:25 2023),mano_mesh3d_loss:1.6909847259521484,mano_joints3d_loss:1.8189302682876587,manopose_loss:0.3632090091705322,manoshape_loss:0.2927539646625519,mano_total_loss:4.165874004364014,hm_joints2d_loss:1.0852590799331665,obj_reg_loss:74.8833999633789,obj_conf_loss:6.6124725341796875,total_loss:86.74691009521484
(epoch: 3, time: Sat Oct  7 00:20:30 2023),mano_mesh3d_loss:1.320427417755127,mano_joints3d_loss:1.418541669845581,manopose_loss:0.33809858560562134,manoshape_loss:0.2805778682231903,mano_total_loss:3.3576478958129883,hm_joints2d_loss:0.7900612354278564,obj_reg_loss:68.6631088256836,obj_conf_loss:6.496152877807617,total_loss:79.30706024169922
(epoch: 4, time: Sat Oct  7 00:39:24 2023),mano_mesh3d_loss:1.0319397449493408,mano_joints3d_loss:1.1067063808441162,manopose_loss:0.31386926770210266,manoshape_loss:0.27310410141944885,mano_total_loss:2.725619316101074,hm_joints2d_loss:0.626470148563385,obj_reg_loss:50.83426284790039,obj_conf_loss:6.533202648162842,total_loss:60.71949768066406
(epoch: 5, time: Sat Oct  7 00:58:18 2023),mano_mesh3d_loss:1.109512209892273,mano_joints3d_loss:1.1911731958389282,manopose_loss:0.3025909662246704,manoshape_loss:0.26847589015960693,mano_total_loss:2.8717548847198486,hm_joints2d_loss:0.6564722061157227,obj_reg_loss:32.07004165649414,obj_conf_loss:6.203098773956299,total_loss:41.8013801574707
(epoch: 6, time: Sat Oct  7 01:17:10 2023),mano_mesh3d_loss:0.8024893999099731,mano_joints3d_loss:0.8596831560134888,manopose_loss:0.2736554443836212,manoshape_loss:0.2501206696033478,mano_total_loss:2.1859476566314697,hm_joints2d_loss:0.49380725622177124,obj_reg_loss:24.4095458984375,obj_conf_loss:5.715297698974609,total_loss:32.8045654296875
(epoch: 7, time: Sat Oct  7 01:36:03 2023),mano_mesh3d_loss:0.7018308043479919,mano_joints3d_loss:0.7514442801475525,manopose_loss:0.2519541382789612,manoshape_loss:0.23022988438606262,mano_total_loss:1.9354584217071533,hm_joints2d_loss:0.4389413297176361,obj_reg_loss:21.660181045532227,obj_conf_loss:5.430682182312012,total_loss:29.465261459350586
(epoch: 8, time: Sat Oct  7 01:54:57 2023),mano_mesh3d_loss:0.7097055912017822,mano_joints3d_loss:0.760745108127594,manopose_loss:0.237700954079628,manoshape_loss:0.21521404385566711,mano_total_loss:1.9233664274215698,hm_joints2d_loss:0.4387645721435547,obj_reg_loss:20.013832092285156,obj_conf_loss:5.234278202056885,total_loss:27.61023712158203
(epoch: 9, time: Sat Oct  7 02:13:49 2023),mano_mesh3d_loss:0.6313846707344055,mano_joints3d_loss:0.6764567494392395,manopose_loss:0.21927033364772797,manoshape_loss:0.19187459349632263,mano_total_loss:1.7189861536026,hm_joints2d_loss:0.4031234681606293,obj_reg_loss:18.915592193603516,obj_conf_loss:5.095491886138916,total_loss:26.133188247680664
(epoch: 10, time: Sat Oct  7 02:32:41 2023),mano_mesh3d_loss:0.523613452911377,mano_joints3d_loss:0.5597004890441895,manopose_loss:0.20173479616641998,manoshape_loss:0.1715564727783203,mano_total_loss:1.4566054344177246,hm_joints2d_loss:0.34694531559944153,obj_reg_loss:18.07473373413086,obj_conf_loss:4.9923834800720215,total_loss:24.870689392089844
(epoch: 11, time: Sat Oct  7 02:54:18 2023),mano_mesh3d_loss:0.4169944226741791,mano_joints3d_loss:0.4443188011646271,manopose_loss:0.18351642787456512,manoshape_loss:0.15521594882011414,mano_total_loss:1.2000457048416138,hm_joints2d_loss:0.2933536171913147,obj_reg_loss:16.09233856201172,obj_conf_loss:4.738110542297363,total_loss:22.323837280273438
(epoch: 12, time: Sat Oct  7 03:13:10 2023),mano_mesh3d_loss:0.4134601652622223,mano_joints3d_loss:0.44073936343193054,manopose_loss:0.17495545744895935,manoshape_loss:0.14630506932735443,mano_total_loss:1.175460696220398,hm_joints2d_loss:0.28917309641838074,obj_reg_loss:15.431581497192383,obj_conf_loss:4.642738342285156,total_loss:21.538957595825195
(epoch: 13, time: Sat Oct  7 03:32:06 2023),mano_mesh3d_loss:0.38888412714004517,mano_joints3d_loss:0.41429993510246277,manopose_loss:0.16559498012065887,manoshape_loss:0.13578476011753082,mano_total_loss:1.1045626401901245,hm_joints2d_loss:0.27534645795822144,obj_reg_loss:15.078113555908203,obj_conf_loss:4.583775043487549,total_loss:21.04180145263672
(epoch: 14, time: Sat Oct  7 03:51:07 2023),mano_mesh3d_loss:0.3549215495586395,mano_joints3d_loss:0.37789350748062134,manopose_loss:0.15566569566726685,manoshape_loss:0.12407279014587402,mano_total_loss:1.0125529766082764,hm_joints2d_loss:0.25565218925476074,obj_reg_loss:14.624402046203613,obj_conf_loss:4.510421276092529,total_loss:20.403018951416016
(epoch: 15, time: Sat Oct  7 04:10:10 2023),mano_mesh3d_loss:0.33881744742393494,mano_joints3d_loss:0.3610582649707794,manopose_loss:0.14748990535736084,manoshape_loss:0.11132899671792984,mano_total_loss:0.9586951732635498,hm_joints2d_loss:0.24588024616241455,obj_reg_loss:14.220447540283203,obj_conf_loss:4.439467906951904,total_loss:19.864479064941406
(epoch: 16, time: Sat Oct  7 04:29:12 2023),mano_mesh3d_loss:0.344839483499527,mano_joints3d_loss:0.36794713139533997,manopose_loss:0.1418749988079071,manoshape_loss:0.10055044293403625,mano_total_loss:0.9552118182182312,hm_joints2d_loss:0.2514665722846985,obj_reg_loss:14.002887725830078,obj_conf_loss:4.404102802276611,total_loss:19.613676071166992
(epoch: 17, time: Sat Oct  7 04:48:17 2023),mano_mesh3d_loss:0.31140848994255066,mano_joints3d_loss:0.33215394616127014,manopose_loss:0.13374680280685425,manoshape_loss:0.09187189489603043,mano_total_loss:0.8691810369491577,hm_joints2d_loss:0.23249368369579315,obj_reg_loss:13.677811622619629,obj_conf_loss:4.357553958892822,total_loss:19.13705062866211
(epoch: 18, time: Sat Oct  7 05:07:23 2023),mano_mesh3d_loss:0.3076970875263214,mano_joints3d_loss:0.32838159799575806,manopose_loss:0.12850818037986755,manoshape_loss:0.08531295508146286,mano_total_loss:0.8499000072479248,hm_joints2d_loss:0.23005546629428864,obj_reg_loss:13.268312454223633,obj_conf_loss:4.292179107666016,total_loss:18.640451431274414
(epoch: 19, time: Sat Oct  7 05:26:21 2023),mano_mesh3d_loss:0.28561967611312866,mano_joints3d_loss:0.3048730790615082,manopose_loss:0.12182731181383133,manoshape_loss:0.0790138989686966,mano_total_loss:0.7913343906402588,hm_joints2d_loss:0.21642200648784637,obj_reg_loss:13.026782989501953,obj_conf_loss:4.262256622314453,total_loss:18.296777725219727
(epoch: 20, time: Sat Oct  7 05:45:18 2023),mano_mesh3d_loss:0.277950257062912,mano_joints3d_loss:0.2968460023403168,manopose_loss:0.11732558161020279,manoshape_loss:0.07458312064409256,mano_total_loss:0.7667051553726196,hm_joints2d_loss:0.21429479122161865,obj_reg_loss:12.710926055908203,obj_conf_loss:4.2091264724731445,total_loss:17.901058197021484
(epoch: 21, time: Sat Oct  7 06:06:40 2023),mano_mesh3d_loss:0.22853213548660278,mano_joints3d_loss:0.24356263875961304,manopose_loss:0.10862389206886292,manoshape_loss:0.06617280840873718,mano_total_loss:0.6468917727470398,hm_joints2d_loss:0.19150859117507935,obj_reg_loss:11.651315689086914,obj_conf_loss:4.061398506164551,total_loss:16.55109977722168
(epoch: 22, time: Sat Oct  7 06:25:32 2023),mano_mesh3d_loss:0.22958622872829437,mano_joints3d_loss:0.24495862424373627,manopose_loss:0.10522033274173737,manoshape_loss:0.06243627518415451,mano_total_loss:0.6422010064125061,hm_joints2d_loss:0.1889542043209076,obj_reg_loss:11.409490585327148,obj_conf_loss:4.019417762756348,total_loss:16.260072708129883
(epoch: 23, time: Sat Oct  7 06:44:26 2023),mano_mesh3d_loss:0.2153177112340927,mano_joints3d_loss:0.22962281107902527,manopose_loss:0.10147976875305176,manoshape_loss:0.058818519115448,mano_total_loss:0.6052390336990356,hm_joints2d_loss:0.18056973814964294,obj_reg_loss:11.198007583618164,obj_conf_loss:3.98140025138855,total_loss:15.965216636657715
(epoch: 24, time: Sat Oct  7 07:03:19 2023),mano_mesh3d_loss:0.20651397109031677,mano_joints3d_loss:0.22022728621959686,manopose_loss:0.09777483344078064,manoshape_loss:0.05607279762625694,mano_total_loss:0.580588698387146,hm_joints2d_loss:0.1739843785762787,obj_reg_loss:11.012195587158203,obj_conf_loss:3.9543087482452393,total_loss:15.721080780029297
(epoch: 25, time: Sat Oct  7 07:22:12 2023),mano_mesh3d_loss:0.20141790807247162,mano_joints3d_loss:0.21492783725261688,manopose_loss:0.09459319710731506,manoshape_loss:0.0531650073826313,mano_total_loss:0.5641037821769714,hm_joints2d_loss:0.17087452113628387,obj_reg_loss:10.864304542541504,obj_conf_loss:3.9264392852783203,total_loss:15.52572250366211
(epoch: 26, time: Sat Oct  7 07:41:09 2023),mano_mesh3d_loss:0.201676607131958,mano_joints3d_loss:0.21520575881004333,manopose_loss:0.09257832169532776,manoshape_loss:0.0514155849814415,mano_total_loss:0.5608764886856079,hm_joints2d_loss:0.17022444307804108,obj_reg_loss:10.622261047363281,obj_conf_loss:3.8847124576568604,total_loss:15.238078117370605
(epoch: 27, time: Sat Oct  7 08:00:07 2023),mano_mesh3d_loss:0.19071389734745026,mano_joints3d_loss:0.20348554849624634,manopose_loss:0.08914336562156677,manoshape_loss:0.04889301583170891,mano_total_loss:0.5322357416152954,hm_joints2d_loss:0.16337093710899353,obj_reg_loss:10.549095153808594,obj_conf_loss:3.870743751525879,total_loss:15.115458488464355
(epoch: 28, time: Sat Oct  7 08:19:07 2023),mano_mesh3d_loss:0.23688818514347076,mano_joints3d_loss:0.2534085214138031,manopose_loss:0.0935741439461708,manoshape_loss:0.05119090899825096,mano_total_loss:0.6350612640380859,hm_joints2d_loss:0.19653542339801788,obj_reg_loss:10.403693199157715,obj_conf_loss:3.8390674591064453,total_loss:15.074353218078613
(epoch: 29, time: Sat Oct  7 08:38:06 2023),mano_mesh3d_loss:0.19114631414413452,mano_joints3d_loss:0.20406465232372284,manopose_loss:0.08648949861526489,manoshape_loss:0.04697412624955177,mano_total_loss:0.5286747813224792,hm_joints2d_loss:0.16974963247776031,obj_reg_loss:10.26810073852539,obj_conf_loss:3.820260763168335,total_loss:14.786787033081055
(epoch: 30, time: Sat Oct  7 08:57:06 2023),mano_mesh3d_loss:0.17334526777267456,mano_joints3d_loss:0.1849597543478012,manopose_loss:0.08274952322244644,manoshape_loss:0.04422345012426376,mano_total_loss:0.48527833819389343,hm_joints2d_loss:0.1554250419139862,obj_reg_loss:10.121633529663086,obj_conf_loss:3.7856688499450684,total_loss:14.548008918762207
(epoch: 31, time: Sat Oct  7 09:18:31 2023),mano_mesh3d_loss:0.16478119790554047,mano_joints3d_loss:0.17587342858314514,manopose_loss:0.07944251596927643,manoshape_loss:0.041589926928281784,mano_total_loss:0.4616870880126953,hm_joints2d_loss:0.15273596346378326,obj_reg_loss:9.506138801574707,obj_conf_loss:3.6882781982421875,total_loss:13.80883502960205
(epoch: 32, time: Sat Oct  7 09:37:30 2023),mano_mesh3d_loss:0.15073515474796295,mano_joints3d_loss:0.16063547134399414,manopose_loss:0.07667186111211777,manoshape_loss:0.04007638618350029,mano_total_loss:0.4281182885169983,hm_joints2d_loss:0.14260604977607727,obj_reg_loss:9.351908683776855,obj_conf_loss:3.6598691940307617,total_loss:13.582501411437988
(epoch: 33, time: Sat Oct  7 09:56:27 2023),mano_mesh3d_loss:0.14841628074645996,mano_joints3d_loss:0.15824133157730103,manopose_loss:0.07510595768690109,manoshape_loss:0.0386144183576107,mano_total_loss:0.4203777015209198,hm_joints2d_loss:0.1396702080965042,obj_reg_loss:9.239740371704102,obj_conf_loss:3.633779287338257,total_loss:13.433578491210938
(epoch: 34, time: Sat Oct  7 10:15:24 2023),mano_mesh3d_loss:0.14759379625320435,mano_joints3d_loss:0.1574031263589859,manopose_loss:0.07368716597557068,manoshape_loss:0.03823874145746231,mano_total_loss:0.4169226884841919,hm_joints2d_loss:0.13818441331386566,obj_reg_loss:9.119954109191895,obj_conf_loss:3.6089816093444824,total_loss:13.284035682678223
(epoch: 35, time: Sat Oct  7 10:34:22 2023),mano_mesh3d_loss:0.14904358983039856,mano_joints3d_loss:0.15902993083000183,manopose_loss:0.07242788374423981,manoshape_loss:0.037397585809230804,mano_total_loss:0.4178985357284546,hm_joints2d_loss:0.1392756700515747,obj_reg_loss:9.069344520568848,obj_conf_loss:3.5924813747406006,total_loss:13.219003677368164
(epoch: 36, time: Sat Oct  7 10:53:18 2023),mano_mesh3d_loss:0.14350050687789917,mano_joints3d_loss:0.15311022102832794,manopose_loss:0.0709749087691307,manoshape_loss:0.036276381462812424,mano_total_loss:0.4038615822792053,hm_joints2d_loss:0.13455429673194885,obj_reg_loss:9.051795959472656,obj_conf_loss:3.595832347869873,total_loss:13.186050415039062
(epoch: 37, time: Sat Oct  7 11:12:13 2023),mano_mesh3d_loss:0.14273126423358917,mano_joints3d_loss:0.15233394503593445,manopose_loss:0.06969793140888214,manoshape_loss:0.03588210791349411,mano_total_loss:0.40064552426338196,hm_joints2d_loss:0.13360971212387085,obj_reg_loss:8.948972702026367,obj_conf_loss:3.57106614112854,total_loss:13.054300308227539
(epoch: 38, time: Sat Oct  7 11:31:07 2023),mano_mesh3d_loss:0.13943752646446228,mano_joints3d_loss:0.14888498187065125,manopose_loss:0.0683208778500557,manoshape_loss:0.034927383065223694,mano_total_loss:0.3915705680847168,hm_joints2d_loss:0.1317022144794464,obj_reg_loss:8.835185050964355,obj_conf_loss:3.544879674911499,total_loss:12.903342247009277
(epoch: 39, time: Sat Oct  7 11:50:01 2023),mano_mesh3d_loss:0.13801789283752441,mano_joints3d_loss:0.14734631776809692,manopose_loss:0.06706735491752625,manoshape_loss:0.03384441137313843,mano_total_loss:0.38627585768699646,hm_joints2d_loss:0.13088363409042358,obj_reg_loss:8.772802352905273,obj_conf_loss:3.527719736099243,total_loss:12.817673683166504
(epoch: 40, time: Sat Oct  7 12:08:56 2023),mano_mesh3d_loss:0.13565415143966675,mano_joints3d_loss:0.14483524858951569,manopose_loss:0.06606493145227432,manoshape_loss:0.03335905075073242,mano_total_loss:0.3799135088920593,hm_joints2d_loss:0.12853878736495972,obj_reg_loss:8.71053695678711,obj_conf_loss:3.5165371894836426,total_loss:12.735530853271484
(epoch: 41, time: Sat Oct  7 12:30:16 2023),mano_mesh3d_loss:0.12016043812036514,mano_joints3d_loss:0.12817123532295227,manopose_loss:0.06273456662893295,manoshape_loss:0.031158236786723137,mano_total_loss:0.3422246277332306,hm_joints2d_loss:0.11996433883905411,obj_reg_loss:8.308180809020996,obj_conf_loss:3.449866771697998,total_loss:12.220237731933594
(epoch: 42, time: Sat Oct  7 12:49:10 2023),mano_mesh3d_loss:0.11684741824865341,mano_joints3d_loss:0.1246257871389389,manopose_loss:0.06163860112428665,manoshape_loss:0.030793393030762672,mano_total_loss:0.33390501141548157,hm_joints2d_loss:0.11763712018728256,obj_reg_loss:8.220166206359863,obj_conf_loss:3.4317102432250977,total_loss:12.103408813476562
(epoch: 43, time: Sat Oct  7 13:08:03 2023),mano_mesh3d_loss:0.11615670472383499,mano_joints3d_loss:0.12390806525945663,manopose_loss:0.06090841442346573,manoshape_loss:0.030320031568408012,mano_total_loss:0.3312932252883911,hm_joints2d_loss:0.11643796414136887,obj_reg_loss:8.138731002807617,obj_conf_loss:3.419668436050415,total_loss:12.006118774414062
(epoch: 44, time: Sat Oct  7 13:26:57 2023),mano_mesh3d_loss:0.11400722712278366,mano_joints3d_loss:0.12164226174354553,manopose_loss:0.05996820703148842,manoshape_loss:0.029928108677268028,mano_total_loss:0.32554587721824646,hm_joints2d_loss:0.1151140034198761,obj_reg_loss:8.098417282104492,obj_conf_loss:3.4054768085479736,total_loss:11.944546699523926
(epoch: 45, time: Sat Oct  7 13:45:51 2023),mano_mesh3d_loss:0.11454638093709946,mano_joints3d_loss:0.12228084355592728,manopose_loss:0.05945529043674469,manoshape_loss:0.029216475784778595,mano_total_loss:0.3254990875720978,hm_joints2d_loss:0.11491260677576065,obj_reg_loss:7.9944000244140625,obj_conf_loss:3.383631706237793,total_loss:11.818445205688477
(epoch: 46, time: Sat Oct  7 14:04:47 2023),mano_mesh3d_loss:0.11160285025835037,mano_joints3d_loss:0.1191403791308403,manopose_loss:0.05832337215542793,manoshape_loss:0.028604691848158836,mano_total_loss:0.31767117977142334,hm_joints2d_loss:0.11264491826295853,obj_reg_loss:7.98276424407959,obj_conf_loss:3.376598358154297,total_loss:11.789679527282715
(epoch: 47, time: Sat Oct  7 14:23:42 2023),mano_mesh3d_loss:0.11110903322696686,mano_joints3d_loss:0.11865051835775375,manopose_loss:0.05760474130511284,manoshape_loss:0.028183262795209885,mano_total_loss:0.3155476152896881,hm_joints2d_loss:0.11159872263669968,obj_reg_loss:7.9566850662231445,obj_conf_loss:3.363412380218506,total_loss:11.747257232666016
(epoch: 48, time: Sat Oct  7 14:42:38 2023),mano_mesh3d_loss:0.1091856062412262,mano_joints3d_loss:0.11657179147005081,manopose_loss:0.056735437363386154,manoshape_loss:0.027795489877462387,mano_total_loss:0.3102882504463196,hm_joints2d_loss:0.1106155663728714,obj_reg_loss:7.884998321533203,obj_conf_loss:3.3498823642730713,total_loss:11.655786514282227
(epoch: 49, time: Sat Oct  7 15:01:35 2023),mano_mesh3d_loss:0.1097884252667427,mano_joints3d_loss:0.11723995953798294,manopose_loss:0.05634310096502304,manoshape_loss:0.027560019865632057,mano_total_loss:0.31093165278434753,hm_joints2d_loss:0.11030231416225433,obj_reg_loss:7.853546142578125,obj_conf_loss:3.3441338539123535,total_loss:11.618903160095215
(epoch: 50, time: Sat Oct  7 15:20:32 2023),mano_mesh3d_loss:0.10706812143325806,mano_joints3d_loss:0.11436346173286438,manopose_loss:0.05535992607474327,manoshape_loss:0.026760032400488853,mano_total_loss:0.303551584482193,hm_joints2d_loss:0.1082940325140953,obj_reg_loss:7.794037818908691,obj_conf_loss:3.329094171524048,total_loss:11.534963607788086
(epoch: 51, time: Sat Oct  7 15:41:52 2023),mano_mesh3d_loss:0.09684311598539352,mano_joints3d_loss:0.10332230478525162,manopose_loss:0.053307268768548965,manoshape_loss:0.02556159719824791,mano_total_loss:0.2790343165397644,hm_joints2d_loss:0.1032257229089737,obj_reg_loss:7.533874988555908,obj_conf_loss:3.2844197750091553,total_loss:11.200546264648438
(epoch: 52, time: Sat Oct  7 16:00:49 2023),mano_mesh3d_loss:0.09450680762529373,mano_joints3d_loss:0.10085099190473557,manopose_loss:0.052514947950839996,manoshape_loss:0.025269990786910057,mano_total_loss:0.27314284443855286,hm_joints2d_loss:0.10182569175958633,obj_reg_loss:7.460644245147705,obj_conf_loss:3.267666816711426,total_loss:11.103293418884277
(epoch: 53, time: Sat Oct  7 16:19:46 2023),mano_mesh3d_loss:0.09501060098409653,mano_joints3d_loss:0.1014629378914833,manopose_loss:0.05211701616644859,manoshape_loss:0.025020809844136238,mano_total_loss:0.27361124753952026,hm_joints2d_loss:0.10079546272754669,obj_reg_loss:7.461483001708984,obj_conf_loss:3.261809825897217,total_loss:11.097702980041504
(epoch: 54, time: Sat Oct  7 16:38:42 2023),mano_mesh3d_loss:0.09330987930297852,mano_joints3d_loss:0.09960994124412537,manopose_loss:0.05142093822360039,manoshape_loss:0.024672970175743103,mano_total_loss:0.2690138518810272,hm_joints2d_loss:0.09964569658041,obj_reg_loss:7.3937153816223145,obj_conf_loss:3.2502307891845703,total_loss:11.012606620788574
(epoch: 55, time: Sat Oct  7 16:57:39 2023),mano_mesh3d_loss:0.09286456555128098,mano_joints3d_loss:0.09916429966688156,manopose_loss:0.050903432071208954,manoshape_loss:0.024266956374049187,mano_total_loss:0.2671990692615509,hm_joints2d_loss:0.0990472212433815,obj_reg_loss:7.3620781898498535,obj_conf_loss:3.24031138420105,total_loss:10.968634605407715
(epoch: 56, time: Sat Oct  7 17:16:35 2023),mano_mesh3d_loss:0.09175398200750351,mano_joints3d_loss:0.09801234304904938,manopose_loss:0.05042383447289467,manoshape_loss:0.02417638897895813,mano_total_loss:0.26436638832092285,hm_joints2d_loss:0.09816519170999527,obj_reg_loss:7.323878765106201,obj_conf_loss:3.2299399375915527,total_loss:10.916350364685059
(epoch: 57, time: Sat Oct  7 17:35:32 2023),mano_mesh3d_loss:0.0910763218998909,mano_joints3d_loss:0.09726162254810333,manopose_loss:0.04974101856350899,manoshape_loss:0.023786157369613647,mano_total_loss:0.26186510920524597,hm_joints2d_loss:0.09725120663642883,obj_reg_loss:7.318131446838379,obj_conf_loss:3.2261650562286377,total_loss:10.903412818908691
(epoch: 58, time: Sat Oct  7 17:54:29 2023),mano_mesh3d_loss:0.09058976918458939,mano_joints3d_loss:0.09672299027442932,manopose_loss:0.04962611198425293,manoshape_loss:0.02374994568526745,mano_total_loss:0.2606890797615051,hm_joints2d_loss:0.09684713929891586,obj_reg_loss:7.309973239898682,obj_conf_loss:3.224032402038574,total_loss:10.8915433883667
(epoch: 59, time: Sat Oct  7 18:13:25 2023),mano_mesh3d_loss:0.08985183387994766,mano_joints3d_loss:0.09598299115896225,manopose_loss:0.04902930185198784,manoshape_loss:0.023459285497665405,mano_total_loss:0.25832319259643555,hm_joints2d_loss:0.09613147377967834,obj_reg_loss:7.263236045837402,obj_conf_loss:3.2125003337860107,total_loss:10.830181121826172
(epoch: 60, time: Sat Oct  7 18:32:21 2023),mano_mesh3d_loss:0.08880581706762314,mano_joints3d_loss:0.0948566421866417,manopose_loss:0.04857998341321945,manoshape_loss:0.023149723187088966,mano_total_loss:0.2553921937942505,hm_joints2d_loss:0.09555651247501373,obj_reg_loss:7.233233451843262,obj_conf_loss:3.2053377628326416,total_loss:10.789507865905762
(epoch: 61, time: Sat Oct  7 18:53:40 2023),mano_mesh3d_loss:0.08232354372739792,mano_joints3d_loss:0.08788643777370453,manopose_loss:0.04713120684027672,manoshape_loss:0.022293152287602425,mano_total_loss:0.23963432013988495,hm_joints2d_loss:0.09172297269105911,obj_reg_loss:7.020287036895752,obj_conf_loss:3.166713237762451,total_loss:10.518362045288086
(epoch: 62, time: Sat Oct  7 19:12:36 2023),mano_mesh3d_loss:0.08107398450374603,mano_joints3d_loss:0.0865740180015564,manopose_loss:0.04653767868876457,manoshape_loss:0.022064145654439926,mano_total_loss:0.2362498790025711,hm_joints2d_loss:0.09076698869466782,obj_reg_loss:7.007259368896484,obj_conf_loss:3.1664960384368896,total_loss:10.500771522521973
(epoch: 63, time: Sat Oct  7 19:31:33 2023),mano_mesh3d_loss:0.08061462640762329,mano_joints3d_loss:0.08610554784536362,manopose_loss:0.046216391026973724,manoshape_loss:0.02184167318046093,mano_total_loss:0.23477840423583984,hm_joints2d_loss:0.09029495716094971,obj_reg_loss:6.9472975730896,obj_conf_loss:3.147662878036499,total_loss:10.420034408569336
(epoch: 64, time: Sat Oct  7 19:50:27 2023),mano_mesh3d_loss:0.08001669496297836,mano_joints3d_loss:0.08543546497821808,manopose_loss:0.04600432887673378,manoshape_loss:0.021648744121193886,mano_total_loss:0.23310525715351105,hm_joints2d_loss:0.08920629322528839,obj_reg_loss:6.9754958152771,obj_conf_loss:3.1554527282714844,total_loss:10.453252792358398
(epoch: 65, time: Sat Oct  7 20:09:23 2023),mano_mesh3d_loss:0.07977167516946793,mano_joints3d_loss:0.08519323915243149,manopose_loss:0.045651257038116455,manoshape_loss:0.02133576199412346,mano_total_loss:0.23195204138755798,hm_joints2d_loss:0.08907648921012878,obj_reg_loss:6.944581508636475,obj_conf_loss:3.1451847553253174,total_loss:10.41077995300293
(epoch: 66, time: Sat Oct  7 20:28:18 2023),mano_mesh3d_loss:0.07970717549324036,mano_joints3d_loss:0.08516678214073181,manopose_loss:0.045242391526699066,manoshape_loss:0.021310513839125633,mano_total_loss:0.23142695426940918,hm_joints2d_loss:0.08866064250469208,obj_reg_loss:6.913706302642822,obj_conf_loss:3.1371090412139893,total_loss:10.370906829833984
(epoch: 67, time: Sat Oct  7 20:47:14 2023),mano_mesh3d_loss:0.07800474762916565,mano_joints3d_loss:0.08331823348999023,manopose_loss:0.04487057030200958,manoshape_loss:0.02107924036681652,mano_total_loss:0.22727279365062714,hm_joints2d_loss:0.08763626962900162,obj_reg_loss:6.888713359832764,obj_conf_loss:3.130798578262329,total_loss:10.334418296813965
(epoch: 68, time: Sat Oct  7 21:06:10 2023),mano_mesh3d_loss:0.07723458856344223,mano_joints3d_loss:0.08247040957212448,manopose_loss:0.044599227607250214,manoshape_loss:0.0208301842212677,mano_total_loss:0.22513432800769806,hm_joints2d_loss:0.08709744364023209,obj_reg_loss:6.8570237159729,obj_conf_loss:3.1245005130767822,total_loss:10.293752670288086
(epoch: 69, time: Sat Oct  7 21:25:05 2023),mano_mesh3d_loss:0.07718764990568161,mano_joints3d_loss:0.08243744820356369,manopose_loss:0.04429706931114197,manoshape_loss:0.02068469673395157,mano_total_loss:0.22460657358169556,hm_joints2d_loss:0.08711066842079163,obj_reg_loss:6.865562438964844,obj_conf_loss:3.12186861038208,total_loss:10.299142837524414
(epoch: 70, time: Sat Oct  7 21:44:01 2023),mano_mesh3d_loss:0.07669926434755325,mano_joints3d_loss:0.08193569630384445,manopose_loss:0.04408050328493118,manoshape_loss:0.020810119807720184,mano_total_loss:0.22352568805217743,hm_joints2d_loss:0.08646570146083832,obj_reg_loss:6.827320575714111,obj_conf_loss:3.114396572113037,total_loss:10.251701354980469

I am looking forward to your reply. And thanks in advance for your help!

Hello, during the replication process, cuda has been continuously unavailable. torch. cuda. is-available(): False. Have you encountered this issue? How to solve it?

[YiJian666]

你好，@lzfff12。感谢您的出色工作。

我尝试在 HO3Dv2 数据集上使用您的默认设置重新训练模型三次。但是，我在公共排行榜上的图纸9.38上获得了最好的结果因此，我想知道您是否在训练过程中应用了其他一些技巧来提高成绩？

以下是参数输出option.txt和训练出来的损失，提供参考。

====== Options ======
HO3D_root: /media/data1/Dataset/HO3D_v2/Data
blocks: 1
channels: 256
dex_ycb_root: /media/data1/Dataset/data_for_alignsdf/dexycb/dex-ycb
epochs: 70
evaluate: False
host_folder: experiments/ho3d
inp_res: 256
lambda_joints2d: 100.0
lambda_objects: 500.0
lr: 0.0001
lr_decay_gamma: 0.7
lr_decay_step: 10
mano_lambda_joints3d: 10000.0
mano_lambda_manopose: 10
mano_lambda_manoshape: 0.1
mano_lambda_regulpose: 0.0
mano_lambda_regulshape: 0.0
mano_lambda_verts3d: 10000.0
mano_neurons: [1024, 512]
mano_root: assets/mano_models
manual_seed: 0
momentum: 0.9
network: honet_transformer
obj_model_root: assets/object_models
resume: None
save_results: True
snapshot: 10
stacks: 1
test_batch: 64
test_freq: 10
train_batch: 64
transformer_depth: 1
transformer_head: 4
use_cuda: 1
use_ho3d: True
weight_decay: 0.0005
workers: 16
=====================
launched traineval.py at 2023-10-06 23:15:23.422155

==== log  at Fri Oct  6 23:15:31 2023 ====
(epoch: 1, time: Fri Oct  6 23:42:02 2023),mano_mesh3d_loss:5.545252323150635,mano_joints3d_loss:5.8843488693237305,manopose_loss:1.0071043968200684,manoshape_loss:0.3506675064563751,mano_total_loss:12.787386894226074,hm_joints2d_loss:3.3286962509155273,obj_reg_loss:95.60641479492188,obj_conf_loss:10.81941032409668,total_loss:122.54190063476562
(epoch: 2, time: Sat Oct  7 00:01:25 2023),mano_mesh3d_loss:1.6909847259521484,mano_joints3d_loss:1.8189302682876587,manopose_loss:0.3632090091705322,manoshape_loss:0.2927539646625519,mano_total_loss:4.165874004364014,hm_joints2d_loss:1.0852590799331665,obj_reg_loss:74.8833999633789,obj_conf_loss:6.6124725341796875,total_loss:86.74691009521484
(epoch: 3, time: Sat Oct  7 00:20:30 2023),mano_mesh3d_loss:1.320427417755127,mano_joints3d_loss:1.418541669845581,manopose_loss:0.33809858560562134,manoshape_loss:0.2805778682231903,mano_total_loss:3.3576478958129883,hm_joints2d_loss:0.7900612354278564,obj_reg_loss:68.6631088256836,obj_conf_loss:6.496152877807617,total_loss:79.30706024169922
(epoch: 4, time: Sat Oct  7 00:39:24 2023),mano_mesh3d_loss:1.0319397449493408,mano_joints3d_loss:1.1067063808441162,manopose_loss:0.31386926770210266,manoshape_loss:0.27310410141944885,mano_total_loss:2.725619316101074,hm_joints2d_loss:0.626470148563385,obj_reg_loss:50.83426284790039,obj_conf_loss:6.533202648162842,total_loss:60.71949768066406
(epoch: 5, time: Sat Oct  7 00:58:18 2023),mano_mesh3d_loss:1.109512209892273,mano_joints3d_loss:1.1911731958389282,manopose_loss:0.3025909662246704,manoshape_loss:0.26847589015960693,mano_total_loss:2.8717548847198486,hm_joints2d_loss:0.6564722061157227,obj_reg_loss:32.07004165649414,obj_conf_loss:6.203098773956299,total_loss:41.8013801574707
(epoch: 6, time: Sat Oct  7 01:17:10 2023),mano_mesh3d_loss:0.8024893999099731,mano_joints3d_loss:0.8596831560134888,manopose_loss:0.2736554443836212,manoshape_loss:0.2501206696033478,mano_total_loss:2.1859476566314697,hm_joints2d_loss:0.49380725622177124,obj_reg_loss:24.4095458984375,obj_conf_loss:5.715297698974609,total_loss:32.8045654296875
(epoch: 7, time: Sat Oct  7 01:36:03 2023),mano_mesh3d_loss:0.7018308043479919,mano_joints3d_loss:0.7514442801475525,manopose_loss:0.2519541382789612,manoshape_loss:0.23022988438606262,mano_total_loss:1.9354584217071533,hm_joints2d_loss:0.4389413297176361,obj_reg_loss:21.660181045532227,obj_conf_loss:5.430682182312012,total_loss:29.465261459350586
(epoch: 8, time: Sat Oct  7 01:54:57 2023),mano_mesh3d_loss:0.7097055912017822,mano_joints3d_loss:0.760745108127594,manopose_loss:0.237700954079628,manoshape_loss:0.21521404385566711,mano_total_loss:1.9233664274215698,hm_joints2d_loss:0.4387645721435547,obj_reg_loss:20.013832092285156,obj_conf_loss:5.234278202056885,total_loss:27.61023712158203
(epoch: 9, time: Sat Oct  7 02:13:49 2023),mano_mesh3d_loss:0.6313846707344055,mano_joints3d_loss:0.6764567494392395,manopose_loss:0.21927033364772797,manoshape_loss:0.19187459349632263,mano_total_loss:1.7189861536026,hm_joints2d_loss:0.4031234681606293,obj_reg_loss:18.915592193603516,obj_conf_loss:5.095491886138916,total_loss:26.133188247680664
(epoch: 10, time: Sat Oct  7 02:32:41 2023),mano_mesh3d_loss:0.523613452911377,mano_joints3d_loss:0.5597004890441895,manopose_loss:0.20173479616641998,manoshape_loss:0.1715564727783203,mano_total_loss:1.4566054344177246,hm_joints2d_loss:0.34694531559944153,obj_reg_loss:18.07473373413086,obj_conf_loss:4.9923834800720215,total_loss:24.870689392089844
(epoch: 11, time: Sat Oct  7 02:54:18 2023),mano_mesh3d_loss:0.4169944226741791,mano_joints3d_loss:0.4443188011646271,manopose_loss:0.18351642787456512,manoshape_loss:0.15521594882011414,mano_total_loss:1.2000457048416138,hm_joints2d_loss:0.2933536171913147,obj_reg_loss:16.09233856201172,obj_conf_loss:4.738110542297363,total_loss:22.323837280273438
(epoch: 12, time: Sat Oct  7 03:13:10 2023),mano_mesh3d_loss:0.4134601652622223,mano_joints3d_loss:0.44073936343193054,manopose_loss:0.17495545744895935,manoshape_loss:0.14630506932735443,mano_total_loss:1.175460696220398,hm_joints2d_loss:0.28917309641838074,obj_reg_loss:15.431581497192383,obj_conf_loss:4.642738342285156,total_loss:21.538957595825195
(epoch: 13, time: Sat Oct  7 03:32:06 2023),mano_mesh3d_loss:0.38888412714004517,mano_joints3d_loss:0.41429993510246277,manopose_loss:0.16559498012065887,manoshape_loss:0.13578476011753082,mano_total_loss:1.1045626401901245,hm_joints2d_loss:0.27534645795822144,obj_reg_loss:15.078113555908203,obj_conf_loss:4.583775043487549,total_loss:21.04180145263672
(epoch: 14, time: Sat Oct  7 03:51:07 2023),mano_mesh3d_loss:0.3549215495586395,mano_joints3d_loss:0.37789350748062134,manopose_loss:0.15566569566726685,manoshape_loss:0.12407279014587402,mano_total_loss:1.0125529766082764,hm_joints2d_loss:0.25565218925476074,obj_reg_loss:14.624402046203613,obj_conf_loss:4.510421276092529,total_loss:20.403018951416016
(epoch: 15, time: Sat Oct  7 04:10:10 2023),mano_mesh3d_loss:0.33881744742393494,mano_joints3d_loss:0.3610582649707794,manopose_loss:0.14748990535736084,manoshape_loss:0.11132899671792984,mano_total_loss:0.9586951732635498,hm_joints2d_loss:0.24588024616241455,obj_reg_loss:14.220447540283203,obj_conf_loss:4.439467906951904,total_loss:19.864479064941406
(epoch: 16, time: Sat Oct  7 04:29:12 2023),mano_mesh3d_loss:0.344839483499527,mano_joints3d_loss:0.36794713139533997,manopose_loss:0.1418749988079071,manoshape_loss:0.10055044293403625,mano_total_loss:0.9552118182182312,hm_joints2d_loss:0.2514665722846985,obj_reg_loss:14.002887725830078,obj_conf_loss:4.404102802276611,total_loss:19.613676071166992
(epoch: 17, time: Sat Oct  7 04:48:17 2023),mano_mesh3d_loss:0.31140848994255066,mano_joints3d_loss:0.33215394616127014,manopose_loss:0.13374680280685425,manoshape_loss:0.09187189489603043,mano_total_loss:0.8691810369491577,hm_joints2d_loss:0.23249368369579315,obj_reg_loss:13.677811622619629,obj_conf_loss:4.357553958892822,total_loss:19.13705062866211
(epoch: 18, time: Sat Oct  7 05:07:23 2023),mano_mesh3d_loss:0.3076970875263214,mano_joints3d_loss:0.32838159799575806,manopose_loss:0.12850818037986755,manoshape_loss:0.08531295508146286,mano_total_loss:0.8499000072479248,hm_joints2d_loss:0.23005546629428864,obj_reg_loss:13.268312454223633,obj_conf_loss:4.292179107666016,total_loss:18.640451431274414
(epoch: 19, time: Sat Oct  7 05:26:21 2023),mano_mesh3d_loss:0.28561967611312866,mano_joints3d_loss:0.3048730790615082,manopose_loss:0.12182731181383133,manoshape_loss:0.0790138989686966,mano_total_loss:0.7913343906402588,hm_joints2d_loss:0.21642200648784637,obj_reg_loss:13.026782989501953,obj_conf_loss:4.262256622314453,total_loss:18.296777725219727
(epoch: 20, time: Sat Oct  7 05:45:18 2023),mano_mesh3d_loss:0.277950257062912,mano_joints3d_loss:0.2968460023403168,manopose_loss:0.11732558161020279,manoshape_loss:0.07458312064409256,mano_total_loss:0.7667051553726196,hm_joints2d_loss:0.21429479122161865,obj_reg_loss:12.710926055908203,obj_conf_loss:4.2091264724731445,total_loss:17.901058197021484
(epoch: 21, time: Sat Oct  7 06:06:40 2023),mano_mesh3d_loss:0.22853213548660278,mano_joints3d_loss:0.24356263875961304,manopose_loss:0.10862389206886292,manoshape_loss:0.06617280840873718,mano_total_loss:0.6468917727470398,hm_joints2d_loss:0.19150859117507935,obj_reg_loss:11.651315689086914,obj_conf_loss:4.061398506164551,total_loss:16.55109977722168
(epoch: 22, time: Sat Oct  7 06:25:32 2023),mano_mesh3d_loss:0.22958622872829437,mano_joints3d_loss:0.24495862424373627,manopose_loss:0.10522033274173737,manoshape_loss:0.06243627518415451,mano_total_loss:0.6422010064125061,hm_joints2d_loss:0.1889542043209076,obj_reg_loss:11.409490585327148,obj_conf_loss:4.019417762756348,total_loss:16.260072708129883
(epoch: 23, time: Sat Oct  7 06:44:26 2023),mano_mesh3d_loss:0.2153177112340927,mano_joints3d_loss:0.22962281107902527,manopose_loss:0.10147976875305176,manoshape_loss:0.058818519115448,mano_total_loss:0.6052390336990356,hm_joints2d_loss:0.18056973814964294,obj_reg_loss:11.198007583618164,obj_conf_loss:3.98140025138855,total_loss:15.965216636657715
(epoch: 24, time: Sat Oct  7 07:03:19 2023),mano_mesh3d_loss:0.20651397109031677,mano_joints3d_loss:0.22022728621959686,manopose_loss:0.09777483344078064,manoshape_loss:0.05607279762625694,mano_total_loss:0.580588698387146,hm_joints2d_loss:0.1739843785762787,obj_reg_loss:11.012195587158203,obj_conf_loss:3.9543087482452393,total_loss:15.721080780029297
(epoch: 25, time: Sat Oct  7 07:22:12 2023),mano_mesh3d_loss:0.20141790807247162,mano_joints3d_loss:0.21492783725261688,manopose_loss:0.09459319710731506,manoshape_loss:0.0531650073826313,mano_total_loss:0.5641037821769714,hm_joints2d_loss:0.17087452113628387,obj_reg_loss:10.864304542541504,obj_conf_loss:3.9264392852783203,total_loss:15.52572250366211
(epoch: 26, time: Sat Oct  7 07:41:09 2023),mano_mesh3d_loss:0.201676607131958,mano_joints3d_loss:0.21520575881004333,manopose_loss:0.09257832169532776,manoshape_loss:0.0514155849814415,mano_total_loss:0.5608764886856079,hm_joints2d_loss:0.17022444307804108,obj_reg_loss:10.622261047363281,obj_conf_loss:3.8847124576568604,total_loss:15.238078117370605
(epoch: 27, time: Sat Oct  7 08:00:07 2023),mano_mesh3d_loss:0.19071389734745026,mano_joints3d_loss:0.20348554849624634,manopose_loss:0.08914336562156677,manoshape_loss:0.04889301583170891,mano_total_loss:0.5322357416152954,hm_joints2d_loss:0.16337093710899353,obj_reg_loss:10.549095153808594,obj_conf_loss:3.870743751525879,total_loss:15.115458488464355
(epoch: 28, time: Sat Oct  7 08:19:07 2023),mano_mesh3d_loss:0.23688818514347076,mano_joints3d_loss:0.2534085214138031,manopose_loss:0.0935741439461708,manoshape_loss:0.05119090899825096,mano_total_loss:0.6350612640380859,hm_joints2d_loss:0.19653542339801788,obj_reg_loss:10.403693199157715,obj_conf_loss:3.8390674591064453,total_loss:15.074353218078613
(epoch: 29, time: Sat Oct  7 08:38:06 2023),mano_mesh3d_loss:0.19114631414413452,mano_joints3d_loss:0.20406465232372284,manopose_loss:0.08648949861526489,manoshape_loss:0.04697412624955177,mano_total_loss:0.5286747813224792,hm_joints2d_loss:0.16974963247776031,obj_reg_loss:10.26810073852539,obj_conf_loss:3.820260763168335,total_loss:14.786787033081055
(epoch: 30, time: Sat Oct  7 08:57:06 2023),mano_mesh3d_loss:0.17334526777267456,mano_joints3d_loss:0.1849597543478012,manopose_loss:0.08274952322244644,manoshape_loss:0.04422345012426376,mano_total_loss:0.48527833819389343,hm_joints2d_loss:0.1554250419139862,obj_reg_loss:10.121633529663086,obj_conf_loss:3.7856688499450684,total_loss:14.548008918762207
(epoch: 31, time: Sat Oct  7 09:18:31 2023),mano_mesh3d_loss:0.16478119790554047,mano_joints3d_loss:0.17587342858314514,manopose_loss:0.07944251596927643,manoshape_loss:0.041589926928281784,mano_total_loss:0.4616870880126953,hm_joints2d_loss:0.15273596346378326,obj_reg_loss:9.506138801574707,obj_conf_loss:3.6882781982421875,total_loss:13.80883502960205
(epoch: 32, time: Sat Oct  7 09:37:30 2023),mano_mesh3d_loss:0.15073515474796295,mano_joints3d_loss:0.16063547134399414,manopose_loss:0.07667186111211777,manoshape_loss:0.04007638618350029,mano_total_loss:0.4281182885169983,hm_joints2d_loss:0.14260604977607727,obj_reg_loss:9.351908683776855,obj_conf_loss:3.6598691940307617,total_loss:13.582501411437988
(epoch: 33, time: Sat Oct  7 09:56:27 2023),mano_mesh3d_loss:0.14841628074645996,mano_joints3d_loss:0.15824133157730103,manopose_loss:0.07510595768690109,manoshape_loss:0.0386144183576107,mano_total_loss:0.4203777015209198,hm_joints2d_loss:0.1396702080965042,obj_reg_loss:9.239740371704102,obj_conf_loss:3.633779287338257,total_loss:13.433578491210938
(epoch: 34, time: Sat Oct  7 10:15:24 2023),mano_mesh3d_loss:0.14759379625320435,mano_joints3d_loss:0.1574031263589859,manopose_loss:0.07368716597557068,manoshape_loss:0.03823874145746231,mano_total_loss:0.4169226884841919,hm_joints2d_loss:0.13818441331386566,obj_reg_loss:9.119954109191895,obj_conf_loss:3.6089816093444824,total_loss:13.284035682678223
(epoch: 35, time: Sat Oct  7 10:34:22 2023),mano_mesh3d_loss:0.14904358983039856,mano_joints3d_loss:0.15902993083000183,manopose_loss:0.07242788374423981,manoshape_loss:0.037397585809230804,mano_total_loss:0.4178985357284546,hm_joints2d_loss:0.1392756700515747,obj_reg_loss:9.069344520568848,obj_conf_loss:3.5924813747406006,total_loss:13.219003677368164
(epoch: 36, time: Sat Oct  7 10:53:18 2023),mano_mesh3d_loss:0.14350050687789917,mano_joints3d_loss:0.15311022102832794,manopose_loss:0.0709749087691307,manoshape_loss:0.036276381462812424,mano_total_loss:0.4038615822792053,hm_joints2d_loss:0.13455429673194885,obj_reg_loss:9.051795959472656,obj_conf_loss:3.595832347869873,total_loss:13.186050415039062
(epoch: 37, time: Sat Oct  7 11:12:13 2023),mano_mesh3d_loss:0.14273126423358917,mano_joints3d_loss:0.15233394503593445,manopose_loss:0.06969793140888214,manoshape_loss:0.03588210791349411,mano_total_loss:0.40064552426338196,hm_joints2d_loss:0.13360971212387085,obj_reg_loss:8.948972702026367,obj_conf_loss:3.57106614112854,total_loss:13.054300308227539
(epoch: 38, time: Sat Oct  7 11:31:07 2023),mano_mesh3d_loss:0.13943752646446228,mano_joints3d_loss:0.14888498187065125,manopose_loss:0.0683208778500557,manoshape_loss:0.034927383065223694,mano_total_loss:0.3915705680847168,hm_joints2d_loss:0.1317022144794464,obj_reg_loss:8.835185050964355,obj_conf_loss:3.544879674911499,total_loss:12.903342247009277
(epoch: 39, time: Sat Oct  7 11:50:01 2023),mano_mesh3d_loss:0.13801789283752441,mano_joints3d_loss:0.14734631776809692,manopose_loss:0.06706735491752625,manoshape_loss:0.03384441137313843,mano_total_loss:0.38627585768699646,hm_joints2d_loss:0.13088363409042358,obj_reg_loss:8.772802352905273,obj_conf_loss:3.527719736099243,total_loss:12.817673683166504
(epoch: 40, time: Sat Oct  7 12:08:56 2023),mano_mesh3d_loss:0.13565415143966675,mano_joints3d_loss:0.14483524858951569,manopose_loss:0.06606493145227432,manoshape_loss:0.03335905075073242,mano_total_loss:0.3799135088920593,hm_joints2d_loss:0.12853878736495972,obj_reg_loss:8.71053695678711,obj_conf_loss:3.5165371894836426,total_loss:12.735530853271484
(epoch: 41, time: Sat Oct  7 12:30:16 2023),mano_mesh3d_loss:0.12016043812036514,mano_joints3d_loss:0.12817123532295227,manopose_loss:0.06273456662893295,manoshape_loss:0.031158236786723137,mano_total_loss:0.3422246277332306,hm_joints2d_loss:0.11996433883905411,obj_reg_loss:8.308180809020996,obj_conf_loss:3.449866771697998,total_loss:12.220237731933594
(epoch: 42, time: Sat Oct  7 12:49:10 2023),mano_mesh3d_loss:0.11684741824865341,mano_joints3d_loss:0.1246257871389389,manopose_loss:0.06163860112428665,manoshape_loss:0.030793393030762672,mano_total_loss:0.33390501141548157,hm_joints2d_loss:0.11763712018728256,obj_reg_loss:8.220166206359863,obj_conf_loss:3.4317102432250977,total_loss:12.103408813476562
(epoch: 43, time: Sat Oct  7 13:08:03 2023),mano_mesh3d_loss:0.11615670472383499,mano_joints3d_loss:0.12390806525945663,manopose_loss:0.06090841442346573,manoshape_loss:0.030320031568408012,mano_total_loss:0.3312932252883911,hm_joints2d_loss:0.11643796414136887,obj_reg_loss:8.138731002807617,obj_conf_loss:3.419668436050415,total_loss:12.006118774414062
(epoch: 44, time: Sat Oct  7 13:26:57 2023),mano_mesh3d_loss:0.11400722712278366,mano_joints3d_loss:0.12164226174354553,manopose_loss:0.05996820703148842,manoshape_loss:0.029928108677268028,mano_total_loss:0.32554587721824646,hm_joints2d_loss:0.1151140034198761,obj_reg_loss:8.098417282104492,obj_conf_loss:3.4054768085479736,total_loss:11.944546699523926
(epoch: 45, time: Sat Oct  7 13:45:51 2023),mano_mesh3d_loss:0.11454638093709946,mano_joints3d_loss:0.12228084355592728,manopose_loss:0.05945529043674469,manoshape_loss:0.029216475784778595,mano_total_loss:0.3254990875720978,hm_joints2d_loss:0.11491260677576065,obj_reg_loss:7.9944000244140625,obj_conf_loss:3.383631706237793,total_loss:11.818445205688477
(epoch: 46, time: Sat Oct  7 14:04:47 2023),mano_mesh3d_loss:0.11160285025835037,mano_joints3d_loss:0.1191403791308403,manopose_loss:0.05832337215542793,manoshape_loss:0.028604691848158836,mano_total_loss:0.31767117977142334,hm_joints2d_loss:0.11264491826295853,obj_reg_loss:7.98276424407959,obj_conf_loss:3.376598358154297,total_loss:11.789679527282715
(epoch: 47, time: Sat Oct  7 14:23:42 2023),mano_mesh3d_loss:0.11110903322696686,mano_joints3d_loss:0.11865051835775375,manopose_loss:0.05760474130511284,manoshape_loss:0.028183262795209885,mano_total_loss:0.3155476152896881,hm_joints2d_loss:0.11159872263669968,obj_reg_loss:7.9566850662231445,obj_conf_loss:3.363412380218506,total_loss:11.747257232666016
(epoch: 48, time: Sat Oct  7 14:42:38 2023),mano_mesh3d_loss:0.1091856062412262,mano_joints3d_loss:0.11657179147005081,manopose_loss:0.056735437363386154,manoshape_loss:0.027795489877462387,mano_total_loss:0.3102882504463196,hm_joints2d_loss:0.1106155663728714,obj_reg_loss:7.884998321533203,obj_conf_loss:3.3498823642730713,total_loss:11.655786514282227
(epoch: 49, time: Sat Oct  7 15:01:35 2023),mano_mesh3d_loss:0.1097884252667427,mano_joints3d_loss:0.11723995953798294,manopose_loss:0.05634310096502304,manoshape_loss:0.027560019865632057,mano_total_loss:0.31093165278434753,hm_joints2d_loss:0.11030231416225433,obj_reg_loss:7.853546142578125,obj_conf_loss:3.3441338539123535,total_loss:11.618903160095215
(epoch: 50, time: Sat Oct  7 15:20:32 2023),mano_mesh3d_loss:0.10706812143325806,mano_joints3d_loss:0.11436346173286438,manopose_loss:0.05535992607474327,manoshape_loss:0.026760032400488853,mano_total_loss:0.303551584482193,hm_joints2d_loss:0.1082940325140953,obj_reg_loss:7.794037818908691,obj_conf_loss:3.329094171524048,total_loss:11.534963607788086
(epoch: 51, time: Sat Oct  7 15:41:52 2023),mano_mesh3d_loss:0.09684311598539352,mano_joints3d_loss:0.10332230478525162,manopose_loss:0.053307268768548965,manoshape_loss:0.02556159719824791,mano_total_loss:0.2790343165397644,hm_joints2d_loss:0.1032257229089737,obj_reg_loss:7.533874988555908,obj_conf_loss:3.2844197750091553,total_loss:11.200546264648438
(epoch: 52, time: Sat Oct  7 16:00:49 2023),mano_mesh3d_loss:0.09450680762529373,mano_joints3d_loss:0.10085099190473557,manopose_loss:0.052514947950839996,manoshape_loss:0.025269990786910057,mano_total_loss:0.27314284443855286,hm_joints2d_loss:0.10182569175958633,obj_reg_loss:7.460644245147705,obj_conf_loss:3.267666816711426,total_loss:11.103293418884277
(epoch: 53, time: Sat Oct  7 16:19:46 2023),mano_mesh3d_loss:0.09501060098409653,mano_joints3d_loss:0.1014629378914833,manopose_loss:0.05211701616644859,manoshape_loss:0.025020809844136238,mano_total_loss:0.27361124753952026,hm_joints2d_loss:0.10079546272754669,obj_reg_loss:7.461483001708984,obj_conf_loss:3.261809825897217,total_loss:11.097702980041504
(epoch: 54, time: Sat Oct  7 16:38:42 2023),mano_mesh3d_loss:0.09330987930297852,mano_joints3d_loss:0.09960994124412537,manopose_loss:0.05142093822360039,manoshape_loss:0.024672970175743103,mano_total_loss:0.2690138518810272,hm_joints2d_loss:0.09964569658041,obj_reg_loss:7.3937153816223145,obj_conf_loss:3.2502307891845703,total_loss:11.012606620788574
(epoch: 55, time: Sat Oct  7 16:57:39 2023),mano_mesh3d_loss:0.09286456555128098,mano_joints3d_loss:0.09916429966688156,manopose_loss:0.050903432071208954,manoshape_loss:0.024266956374049187,mano_total_loss:0.2671990692615509,hm_joints2d_loss:0.0990472212433815,obj_reg_loss:7.3620781898498535,obj_conf_loss:3.24031138420105,total_loss:10.968634605407715
(epoch: 56, time: Sat Oct  7 17:16:35 2023),mano_mesh3d_loss:0.09175398200750351,mano_joints3d_loss:0.09801234304904938,manopose_loss:0.05042383447289467,manoshape_loss:0.02417638897895813,mano_total_loss:0.26436638832092285,hm_joints2d_loss:0.09816519170999527,obj_reg_loss:7.323878765106201,obj_conf_loss:3.2299399375915527,total_loss:10.916350364685059
(epoch: 57, time: Sat Oct  7 17:35:32 2023),mano_mesh3d_loss:0.0910763218998909,mano_joints3d_loss:0.09726162254810333,manopose_loss:0.04974101856350899,manoshape_loss:0.023786157369613647,mano_total_loss:0.26186510920524597,hm_joints2d_loss:0.09725120663642883,obj_reg_loss:7.318131446838379,obj_conf_loss:3.2261650562286377,total_loss:10.903412818908691
(epoch: 58, time: Sat Oct  7 17:54:29 2023),mano_mesh3d_loss:0.09058976918458939,mano_joints3d_loss:0.09672299027442932,manopose_loss:0.04962611198425293,manoshape_loss:0.02374994568526745,mano_total_loss:0.2606890797615051,hm_joints2d_loss:0.09684713929891586,obj_reg_loss:7.309973239898682,obj_conf_loss:3.224032402038574,total_loss:10.8915433883667
(epoch: 59, time: Sat Oct  7 18:13:25 2023),mano_mesh3d_loss:0.08985183387994766,mano_joints3d_loss:0.09598299115896225,manopose_loss:0.04902930185198784,manoshape_loss:0.023459285497665405,mano_total_loss:0.25832319259643555,hm_joints2d_loss:0.09613147377967834,obj_reg_loss:7.263236045837402,obj_conf_loss:3.2125003337860107,total_loss:10.830181121826172
(epoch: 60, time: Sat Oct  7 18:32:21 2023),mano_mesh3d_loss:0.08880581706762314,mano_joints3d_loss:0.0948566421866417,manopose_loss:0.04857998341321945,manoshape_loss:0.023149723187088966,mano_total_loss:0.2553921937942505,hm_joints2d_loss:0.09555651247501373,obj_reg_loss:7.233233451843262,obj_conf_loss:3.2053377628326416,total_loss:10.789507865905762
(epoch: 61, time: Sat Oct  7 18:53:40 2023),mano_mesh3d_loss:0.08232354372739792,mano_joints3d_loss:0.08788643777370453,manopose_loss:0.04713120684027672,manoshape_loss:0.022293152287602425,mano_total_loss:0.23963432013988495,hm_joints2d_loss:0.09172297269105911,obj_reg_loss:7.020287036895752,obj_conf_loss:3.166713237762451,total_loss:10.518362045288086
(epoch: 62, time: Sat Oct  7 19:12:36 2023),mano_mesh3d_loss:0.08107398450374603,mano_joints3d_loss:0.0865740180015564,manopose_loss:0.04653767868876457,manoshape_loss:0.022064145654439926,mano_total_loss:0.2362498790025711,hm_joints2d_loss:0.09076698869466782,obj_reg_loss:7.007259368896484,obj_conf_loss:3.1664960384368896,total_loss:10.500771522521973
(epoch: 63, time: Sat Oct  7 19:31:33 2023),mano_mesh3d_loss:0.08061462640762329,mano_joints3d_loss:0.08610554784536362,manopose_loss:0.046216391026973724,manoshape_loss:0.02184167318046093,mano_total_loss:0.23477840423583984,hm_joints2d_loss:0.09029495716094971,obj_reg_loss:6.9472975730896,obj_conf_loss:3.147662878036499,total_loss:10.420034408569336
(epoch: 64, time: Sat Oct  7 19:50:27 2023),mano_mesh3d_loss:0.08001669496297836,mano_joints3d_loss:0.08543546497821808,manopose_loss:0.04600432887673378,manoshape_loss:0.021648744121193886,mano_total_loss:0.23310525715351105,hm_joints2d_loss:0.08920629322528839,obj_reg_loss:6.9754958152771,obj_conf_loss:3.1554527282714844,total_loss:10.453252792358398
(epoch: 65, time: Sat Oct  7 20:09:23 2023),mano_mesh3d_loss:0.07977167516946793,mano_joints3d_loss:0.08519323915243149,manopose_loss:0.045651257038116455,manoshape_loss:0.02133576199412346,mano_total_loss:0.23195204138755798,hm_joints2d_loss:0.08907648921012878,obj_reg_loss:6.944581508636475,obj_conf_loss:3.1451847553253174,total_loss:10.41077995300293
(epoch: 66, time: Sat Oct  7 20:28:18 2023),mano_mesh3d_loss:0.07970717549324036,mano_joints3d_loss:0.08516678214073181,manopose_loss:0.045242391526699066,manoshape_loss:0.021310513839125633,mano_total_loss:0.23142695426940918,hm_joints2d_loss:0.08866064250469208,obj_reg_loss:6.913706302642822,obj_conf_loss:3.1371090412139893,total_loss:10.370906829833984
(epoch: 67, time: Sat Oct  7 20:47:14 2023),mano_mesh3d_loss:0.07800474762916565,mano_joints3d_loss:0.08331823348999023,manopose_loss:0.04487057030200958,manoshape_loss:0.02107924036681652,mano_total_loss:0.22727279365062714,hm_joints2d_loss:0.08763626962900162,obj_reg_loss:6.888713359832764,obj_conf_loss:3.130798578262329,total_loss:10.334418296813965
(epoch: 68, time: Sat Oct  7 21:06:10 2023),mano_mesh3d_loss:0.07723458856344223,mano_joints3d_loss:0.08247040957212448,manopose_loss:0.044599227607250214,manoshape_loss:0.0208301842212677,mano_total_loss:0.22513432800769806,hm_joints2d_loss:0.08709744364023209,obj_reg_loss:6.8570237159729,obj_conf_loss:3.1245005130767822,total_loss:10.293752670288086
(epoch: 69, time: Sat Oct  7 21:25:05 2023),mano_mesh3d_loss:0.07718764990568161,mano_joints3d_loss:0.08243744820356369,manopose_loss:0.04429706931114197,manoshape_loss:0.02068469673395157,mano_total_loss:0.22460657358169556,hm_joints2d_loss:0.08711066842079163,obj_reg_loss:6.865562438964844,obj_conf_loss:3.12186861038208,total_loss:10.299142837524414
(epoch: 70, time: Sat Oct  7 21:44:01 2023),mano_mesh3d_loss:0.07669926434755325,mano_joints3d_loss:0.08193569630384445,manopose_loss:0.04408050328493118,manoshape_loss:0.020810119807720184,mano_total_loss:0.22352568805217743,hm_joints2d_loss:0.08646570146083832,obj_reg_loss:6.827320575714111,obj_conf_loss:3.114396572113037,total_loss:10.251701354980469

你好，请问您最终复现出来论文中的指标了么，是怎么复现的呢？
我期待您的回复。并提前感谢您的帮助！

[Wavebiter]

Hello, @lzfff12 . Thanks for your excellent work.
I tried to retrain the model on the HO3Dv2 dataset using your default settings for three times. However, the best result I obtained is only 9.38 on the public leaderboard. Therefore, I wonder if you have some other tricks applied during training to boost the performance?
The following are the parameter output in option.txt and the trained losses for reference.

====== Options ======
HO3D_root: /media/data1/Dataset/HO3D_v2/Data
blocks: 1
channels: 256
dex_ycb_root: /media/data1/Dataset/data_for_alignsdf/dexycb/dex-ycb
epochs: 70
evaluate: False
host_folder: experiments/ho3d
inp_res: 256
lambda_joints2d: 100.0
lambda_objects: 500.0
lr: 0.0001
lr_decay_gamma: 0.7
lr_decay_step: 10
mano_lambda_joints3d: 10000.0
mano_lambda_manopose: 10
mano_lambda_manoshape: 0.1
mano_lambda_regulpose: 0.0
mano_lambda_regulshape: 0.0
mano_lambda_verts3d: 10000.0
mano_neurons: [1024, 512]
mano_root: assets/mano_models
manual_seed: 0
momentum: 0.9
network: honet_transformer
obj_model_root: assets/object_models
resume: None
save_results: True
snapshot: 10
stacks: 1
test_batch: 64
test_freq: 10
train_batch: 64
transformer_depth: 1
transformer_head: 4
use_cuda: 1
use_ho3d: True
weight_decay: 0.0005
workers: 16
=====================
launched traineval.py at 2023-10-06 23:15:23.422155

==== log  at Fri Oct  6 23:15:31 2023 ====
(epoch: 1, time: Fri Oct  6 23:42:02 2023),mano_mesh3d_loss:5.545252323150635,mano_joints3d_loss:5.8843488693237305,manopose_loss:1.0071043968200684,manoshape_loss:0.3506675064563751,mano_total_loss:12.787386894226074,hm_joints2d_loss:3.3286962509155273,obj_reg_loss:95.60641479492188,obj_conf_loss:10.81941032409668,total_loss:122.54190063476562
(epoch: 2, time: Sat Oct  7 00:01:25 2023),mano_mesh3d_loss:1.6909847259521484,mano_joints3d_loss:1.8189302682876587,manopose_loss:0.3632090091705322,manoshape_loss:0.2927539646625519,mano_total_loss:4.165874004364014,hm_joints2d_loss:1.0852590799331665,obj_reg_loss:74.8833999633789,obj_conf_loss:6.6124725341796875,total_loss:86.74691009521484
(epoch: 3, time: Sat Oct  7 00:20:30 2023),mano_mesh3d_loss:1.320427417755127,mano_joints3d_loss:1.418541669845581,manopose_loss:0.33809858560562134,manoshape_loss:0.2805778682231903,mano_total_loss:3.3576478958129883,hm_joints2d_loss:0.7900612354278564,obj_reg_loss:68.6631088256836,obj_conf_loss:6.496152877807617,total_loss:79.30706024169922
(epoch: 4, time: Sat Oct  7 00:39:24 2023),mano_mesh3d_loss:1.0319397449493408,mano_joints3d_loss:1.1067063808441162,manopose_loss:0.31386926770210266,manoshape_loss:0.27310410141944885,mano_total_loss:2.725619316101074,hm_joints2d_loss:0.626470148563385,obj_reg_loss:50.83426284790039,obj_conf_loss:6.533202648162842,total_loss:60.71949768066406
(epoch: 5, time: Sat Oct  7 00:58:18 2023),mano_mesh3d_loss:1.109512209892273,mano_joints3d_loss:1.1911731958389282,manopose_loss:0.3025909662246704,manoshape_loss:0.26847589015960693,mano_total_loss:2.8717548847198486,hm_joints2d_loss:0.6564722061157227,obj_reg_loss:32.07004165649414,obj_conf_loss:6.203098773956299,total_loss:41.8013801574707
(epoch: 6, time: Sat Oct  7 01:17:10 2023),mano_mesh3d_loss:0.8024893999099731,mano_joints3d_loss:0.8596831560134888,manopose_loss:0.2736554443836212,manoshape_loss:0.2501206696033478,mano_total_loss:2.1859476566314697,hm_joints2d_loss:0.49380725622177124,obj_reg_loss:24.4095458984375,obj_conf_loss:5.715297698974609,total_loss:32.8045654296875
(epoch: 7, time: Sat Oct  7 01:36:03 2023),mano_mesh3d_loss:0.7018308043479919,mano_joints3d_loss:0.7514442801475525,manopose_loss:0.2519541382789612,manoshape_loss:0.23022988438606262,mano_total_loss:1.9354584217071533,hm_joints2d_loss:0.4389413297176361,obj_reg_loss:21.660181045532227,obj_conf_loss:5.430682182312012,total_loss:29.465261459350586
(epoch: 8, time: Sat Oct  7 01:54:57 2023),mano_mesh3d_loss:0.7097055912017822,mano_joints3d_loss:0.760745108127594,manopose_loss:0.237700954079628,manoshape_loss:0.21521404385566711,mano_total_loss:1.9233664274215698,hm_joints2d_loss:0.4387645721435547,obj_reg_loss:20.013832092285156,obj_conf_loss:5.234278202056885,total_loss:27.61023712158203
(epoch: 9, time: Sat Oct  7 02:13:49 2023),mano_mesh3d_loss:0.6313846707344055,mano_joints3d_loss:0.6764567494392395,manopose_loss:0.21927033364772797,manoshape_loss:0.19187459349632263,mano_total_loss:1.7189861536026,hm_joints2d_loss:0.4031234681606293,obj_reg_loss:18.915592193603516,obj_conf_loss:5.095491886138916,total_loss:26.133188247680664
(epoch: 10, time: Sat Oct  7 02:32:41 2023),mano_mesh3d_loss:0.523613452911377,mano_joints3d_loss:0.5597004890441895,manopose_loss:0.20173479616641998,manoshape_loss:0.1715564727783203,mano_total_loss:1.4566054344177246,hm_joints2d_loss:0.34694531559944153,obj_reg_loss:18.07473373413086,obj_conf_loss:4.9923834800720215,total_loss:24.870689392089844
(epoch: 11, time: Sat Oct  7 02:54:18 2023),mano_mesh3d_loss:0.4169944226741791,mano_joints3d_loss:0.4443188011646271,manopose_loss:0.18351642787456512,manoshape_loss:0.15521594882011414,mano_total_loss:1.2000457048416138,hm_joints2d_loss:0.2933536171913147,obj_reg_loss:16.09233856201172,obj_conf_loss:4.738110542297363,total_loss:22.323837280273438
(epoch: 12, time: Sat Oct  7 03:13:10 2023),mano_mesh3d_loss:0.4134601652622223,mano_joints3d_loss:0.44073936343193054,manopose_loss:0.17495545744895935,manoshape_loss:0.14630506932735443,mano_total_loss:1.175460696220398,hm_joints2d_loss:0.28917309641838074,obj_reg_loss:15.431581497192383,obj_conf_loss:4.642738342285156,total_loss:21.538957595825195
(epoch: 13, time: Sat Oct  7 03:32:06 2023),mano_mesh3d_loss:0.38888412714004517,mano_joints3d_loss:0.41429993510246277,manopose_loss:0.16559498012065887,manoshape_loss:0.13578476011753082,mano_total_loss:1.1045626401901245,hm_joints2d_loss:0.27534645795822144,obj_reg_loss:15.078113555908203,obj_conf_loss:4.583775043487549,total_loss:21.04180145263672
(epoch: 14, time: Sat Oct  7 03:51:07 2023),mano_mesh3d_loss:0.3549215495586395,mano_joints3d_loss:0.37789350748062134,manopose_loss:0.15566569566726685,manoshape_loss:0.12407279014587402,mano_total_loss:1.0125529766082764,hm_joints2d_loss:0.25565218925476074,obj_reg_loss:14.624402046203613,obj_conf_loss:4.510421276092529,total_loss:20.403018951416016
(epoch: 15, time: Sat Oct  7 04:10:10 2023),mano_mesh3d_loss:0.33881744742393494,mano_joints3d_loss:0.3610582649707794,manopose_loss:0.14748990535736084,manoshape_loss:0.11132899671792984,mano_total_loss:0.9586951732635498,hm_joints2d_loss:0.24588024616241455,obj_reg_loss:14.220447540283203,obj_conf_loss:4.439467906951904,total_loss:19.864479064941406
(epoch: 16, time: Sat Oct  7 04:29:12 2023),mano_mesh3d_loss:0.344839483499527,mano_joints3d_loss:0.36794713139533997,manopose_loss:0.1418749988079071,manoshape_loss:0.10055044293403625,mano_total_loss:0.9552118182182312,hm_joints2d_loss:0.2514665722846985,obj_reg_loss:14.002887725830078,obj_conf_loss:4.404102802276611,total_loss:19.613676071166992
(epoch: 17, time: Sat Oct  7 04:48:17 2023),mano_mesh3d_loss:0.31140848994255066,mano_joints3d_loss:0.33215394616127014,manopose_loss:0.13374680280685425,manoshape_loss:0.09187189489603043,mano_total_loss:0.8691810369491577,hm_joints2d_loss:0.23249368369579315,obj_reg_loss:13.677811622619629,obj_conf_loss:4.357553958892822,total_loss:19.13705062866211
(epoch: 18, time: Sat Oct  7 05:07:23 2023),mano_mesh3d_loss:0.3076970875263214,mano_joints3d_loss:0.32838159799575806,manopose_loss:0.12850818037986755,manoshape_loss:0.08531295508146286,mano_total_loss:0.8499000072479248,hm_joints2d_loss:0.23005546629428864,obj_reg_loss:13.268312454223633,obj_conf_loss:4.292179107666016,total_loss:18.640451431274414
(epoch: 19, time: Sat Oct  7 05:26:21 2023),mano_mesh3d_loss:0.28561967611312866,mano_joints3d_loss:0.3048730790615082,manopose_loss:0.12182731181383133,manoshape_loss:0.0790138989686966,mano_total_loss:0.7913343906402588,hm_joints2d_loss:0.21642200648784637,obj_reg_loss:13.026782989501953,obj_conf_loss:4.262256622314453,total_loss:18.296777725219727
(epoch: 20, time: Sat Oct  7 05:45:18 2023),mano_mesh3d_loss:0.277950257062912,mano_joints3d_loss:0.2968460023403168,manopose_loss:0.11732558161020279,manoshape_loss:0.07458312064409256,mano_total_loss:0.7667051553726196,hm_joints2d_loss:0.21429479122161865,obj_reg_loss:12.710926055908203,obj_conf_loss:4.2091264724731445,total_loss:17.901058197021484
(epoch: 21, time: Sat Oct  7 06:06:40 2023),mano_mesh3d_loss:0.22853213548660278,mano_joints3d_loss:0.24356263875961304,manopose_loss:0.10862389206886292,manoshape_loss:0.06617280840873718,mano_total_loss:0.6468917727470398,hm_joints2d_loss:0.19150859117507935,obj_reg_loss:11.651315689086914,obj_conf_loss:4.061398506164551,total_loss:16.55109977722168
(epoch: 22, time: Sat Oct  7 06:25:32 2023),mano_mesh3d_loss:0.22958622872829437,mano_joints3d_loss:0.24495862424373627,manopose_loss:0.10522033274173737,manoshape_loss:0.06243627518415451,mano_total_loss:0.6422010064125061,hm_joints2d_loss:0.1889542043209076,obj_reg_loss:11.409490585327148,obj_conf_loss:4.019417762756348,total_loss:16.260072708129883
(epoch: 23, time: Sat Oct  7 06:44:26 2023),mano_mesh3d_loss:0.2153177112340927,mano_joints3d_loss:0.22962281107902527,manopose_loss:0.10147976875305176,manoshape_loss:0.058818519115448,mano_total_loss:0.6052390336990356,hm_joints2d_loss:0.18056973814964294,obj_reg_loss:11.198007583618164,obj_conf_loss:3.98140025138855,total_loss:15.965216636657715
(epoch: 24, time: Sat Oct  7 07:03:19 2023),mano_mesh3d_loss:0.20651397109031677,mano_joints3d_loss:0.22022728621959686,manopose_loss:0.09777483344078064,manoshape_loss:0.05607279762625694,mano_total_loss:0.580588698387146,hm_joints2d_loss:0.1739843785762787,obj_reg_loss:11.012195587158203,obj_conf_loss:3.9543087482452393,total_loss:15.721080780029297
(epoch: 25, time: Sat Oct  7 07:22:12 2023),mano_mesh3d_loss:0.20141790807247162,mano_joints3d_loss:0.21492783725261688,manopose_loss:0.09459319710731506,manoshape_loss:0.0531650073826313,mano_total_loss:0.5641037821769714,hm_joints2d_loss:0.17087452113628387,obj_reg_loss:10.864304542541504,obj_conf_loss:3.9264392852783203,total_loss:15.52572250366211
(epoch: 26, time: Sat Oct  7 07:41:09 2023),mano_mesh3d_loss:0.201676607131958,mano_joints3d_loss:0.21520575881004333,manopose_loss:0.09257832169532776,manoshape_loss:0.0514155849814415,mano_total_loss:0.5608764886856079,hm_joints2d_loss:0.17022444307804108,obj_reg_loss:10.622261047363281,obj_conf_loss:3.8847124576568604,total_loss:15.238078117370605
(epoch: 27, time: Sat Oct  7 08:00:07 2023),mano_mesh3d_loss:0.19071389734745026,mano_joints3d_loss:0.20348554849624634,manopose_loss:0.08914336562156677,manoshape_loss:0.04889301583170891,mano_total_loss:0.5322357416152954,hm_joints2d_loss:0.16337093710899353,obj_reg_loss:10.549095153808594,obj_conf_loss:3.870743751525879,total_loss:15.115458488464355
(epoch: 28, time: Sat Oct  7 08:19:07 2023),mano_mesh3d_loss:0.23688818514347076,mano_joints3d_loss:0.2534085214138031,manopose_loss:0.0935741439461708,manoshape_loss:0.05119090899825096,mano_total_loss:0.6350612640380859,hm_joints2d_loss:0.19653542339801788,obj_reg_loss:10.403693199157715,obj_conf_loss:3.8390674591064453,total_loss:15.074353218078613
(epoch: 29, time: Sat Oct  7 08:38:06 2023),mano_mesh3d_loss:0.19114631414413452,mano_joints3d_loss:0.20406465232372284,manopose_loss:0.08648949861526489,manoshape_loss:0.04697412624955177,mano_total_loss:0.5286747813224792,hm_joints2d_loss:0.16974963247776031,obj_reg_loss:10.26810073852539,obj_conf_loss:3.820260763168335,total_loss:14.786787033081055
(epoch: 30, time: Sat Oct  7 08:57:06 2023),mano_mesh3d_loss:0.17334526777267456,mano_joints3d_loss:0.1849597543478012,manopose_loss:0.08274952322244644,manoshape_loss:0.04422345012426376,mano_total_loss:0.48527833819389343,hm_joints2d_loss:0.1554250419139862,obj_reg_loss:10.121633529663086,obj_conf_loss:3.7856688499450684,total_loss:14.548008918762207
(epoch: 31, time: Sat Oct  7 09:18:31 2023),mano_mesh3d_loss:0.16478119790554047,mano_joints3d_loss:0.17587342858314514,manopose_loss:0.07944251596927643,manoshape_loss:0.041589926928281784,mano_total_loss:0.4616870880126953,hm_joints2d_loss:0.15273596346378326,obj_reg_loss:9.506138801574707,obj_conf_loss:3.6882781982421875,total_loss:13.80883502960205
(epoch: 32, time: Sat Oct  7 09:37:30 2023),mano_mesh3d_loss:0.15073515474796295,mano_joints3d_loss:0.16063547134399414,manopose_loss:0.07667186111211777,manoshape_loss:0.04007638618350029,mano_total_loss:0.4281182885169983,hm_joints2d_loss:0.14260604977607727,obj_reg_loss:9.351908683776855,obj_conf_loss:3.6598691940307617,total_loss:13.582501411437988
(epoch: 33, time: Sat Oct  7 09:56:27 2023),mano_mesh3d_loss:0.14841628074645996,mano_joints3d_loss:0.15824133157730103,manopose_loss:0.07510595768690109,manoshape_loss:0.0386144183576107,mano_total_loss:0.4203777015209198,hm_joints2d_loss:0.1396702080965042,obj_reg_loss:9.239740371704102,obj_conf_loss:3.633779287338257,total_loss:13.433578491210938
(epoch: 34, time: Sat Oct  7 10:15:24 2023),mano_mesh3d_loss:0.14759379625320435,mano_joints3d_loss:0.1574031263589859,manopose_loss:0.07368716597557068,manoshape_loss:0.03823874145746231,mano_total_loss:0.4169226884841919,hm_joints2d_loss:0.13818441331386566,obj_reg_loss:9.119954109191895,obj_conf_loss:3.6089816093444824,total_loss:13.284035682678223
(epoch: 35, time: Sat Oct  7 10:34:22 2023),mano_mesh3d_loss:0.14904358983039856,mano_joints3d_loss:0.15902993083000183,manopose_loss:0.07242788374423981,manoshape_loss:0.037397585809230804,mano_total_loss:0.4178985357284546,hm_joints2d_loss:0.1392756700515747,obj_reg_loss:9.069344520568848,obj_conf_loss:3.5924813747406006,total_loss:13.219003677368164
(epoch: 36, time: Sat Oct  7 10:53:18 2023),mano_mesh3d_loss:0.14350050687789917,mano_joints3d_loss:0.15311022102832794,manopose_loss:0.0709749087691307,manoshape_loss:0.036276381462812424,mano_total_loss:0.4038615822792053,hm_joints2d_loss:0.13455429673194885,obj_reg_loss:9.051795959472656,obj_conf_loss:3.595832347869873,total_loss:13.186050415039062
(epoch: 37, time: Sat Oct  7 11:12:13 2023),mano_mesh3d_loss:0.14273126423358917,mano_joints3d_loss:0.15233394503593445,manopose_loss:0.06969793140888214,manoshape_loss:0.03588210791349411,mano_total_loss:0.40064552426338196,hm_joints2d_loss:0.13360971212387085,obj_reg_loss:8.948972702026367,obj_conf_loss:3.57106614112854,total_loss:13.054300308227539
(epoch: 38, time: Sat Oct  7 11:31:07 2023),mano_mesh3d_loss:0.13943752646446228,mano_joints3d_loss:0.14888498187065125,manopose_loss:0.0683208778500557,manoshape_loss:0.034927383065223694,mano_total_loss:0.3915705680847168,hm_joints2d_loss:0.1317022144794464,obj_reg_loss:8.835185050964355,obj_conf_loss:3.544879674911499,total_loss:12.903342247009277
(epoch: 39, time: Sat Oct  7 11:50:01 2023),mano_mesh3d_loss:0.13801789283752441,mano_joints3d_loss:0.14734631776809692,manopose_loss:0.06706735491752625,manoshape_loss:0.03384441137313843,mano_total_loss:0.38627585768699646,hm_joints2d_loss:0.13088363409042358,obj_reg_loss:8.772802352905273,obj_conf_loss:3.527719736099243,total_loss:12.817673683166504
(epoch: 40, time: Sat Oct  7 12:08:56 2023),mano_mesh3d_loss:0.13565415143966675,mano_joints3d_loss:0.14483524858951569,manopose_loss:0.06606493145227432,manoshape_loss:0.03335905075073242,mano_total_loss:0.3799135088920593,hm_joints2d_loss:0.12853878736495972,obj_reg_loss:8.71053695678711,obj_conf_loss:3.5165371894836426,total_loss:12.735530853271484
(epoch: 41, time: Sat Oct  7 12:30:16 2023),mano_mesh3d_loss:0.12016043812036514,mano_joints3d_loss:0.12817123532295227,manopose_loss:0.06273456662893295,manoshape_loss:0.031158236786723137,mano_total_loss:0.3422246277332306,hm_joints2d_loss:0.11996433883905411,obj_reg_loss:8.308180809020996,obj_conf_loss:3.449866771697998,total_loss:12.220237731933594
(epoch: 42, time: Sat Oct  7 12:49:10 2023),mano_mesh3d_loss:0.11684741824865341,mano_joints3d_loss:0.1246257871389389,manopose_loss:0.06163860112428665,manoshape_loss:0.030793393030762672,mano_total_loss:0.33390501141548157,hm_joints2d_loss:0.11763712018728256,obj_reg_loss:8.220166206359863,obj_conf_loss:3.4317102432250977,total_loss:12.103408813476562
(epoch: 43, time: Sat Oct  7 13:08:03 2023),mano_mesh3d_loss:0.11615670472383499,mano_joints3d_loss:0.12390806525945663,manopose_loss:0.06090841442346573,manoshape_loss:0.030320031568408012,mano_total_loss:0.3312932252883911,hm_joints2d_loss:0.11643796414136887,obj_reg_loss:8.138731002807617,obj_conf_loss:3.419668436050415,total_loss:12.006118774414062
(epoch: 44, time: Sat Oct  7 13:26:57 2023),mano_mesh3d_loss:0.11400722712278366,mano_joints3d_loss:0.12164226174354553,manopose_loss:0.05996820703148842,manoshape_loss:0.029928108677268028,mano_total_loss:0.32554587721824646,hm_joints2d_loss:0.1151140034198761,obj_reg_loss:8.098417282104492,obj_conf_loss:3.4054768085479736,total_loss:11.944546699523926
(epoch: 45, time: Sat Oct  7 13:45:51 2023),mano_mesh3d_loss:0.11454638093709946,mano_joints3d_loss:0.12228084355592728,manopose_loss:0.05945529043674469,manoshape_loss:0.029216475784778595,mano_total_loss:0.3254990875720978,hm_joints2d_loss:0.11491260677576065,obj_reg_loss:7.9944000244140625,obj_conf_loss:3.383631706237793,total_loss:11.818445205688477
(epoch: 46, time: Sat Oct  7 14:04:47 2023),mano_mesh3d_loss:0.11160285025835037,mano_joints3d_loss:0.1191403791308403,manopose_loss:0.05832337215542793,manoshape_loss:0.028604691848158836,mano_total_loss:0.31767117977142334,hm_joints2d_loss:0.11264491826295853,obj_reg_loss:7.98276424407959,obj_conf_loss:3.376598358154297,total_loss:11.789679527282715
(epoch: 47, time: Sat Oct  7 14:23:42 2023),mano_mesh3d_loss:0.11110903322696686,mano_joints3d_loss:0.11865051835775375,manopose_loss:0.05760474130511284,manoshape_loss:0.028183262795209885,mano_total_loss:0.3155476152896881,hm_joints2d_loss:0.11159872263669968,obj_reg_loss:7.9566850662231445,obj_conf_loss:3.363412380218506,total_loss:11.747257232666016
(epoch: 48, time: Sat Oct  7 14:42:38 2023),mano_mesh3d_loss:0.1091856062412262,mano_joints3d_loss:0.11657179147005081,manopose_loss:0.056735437363386154,manoshape_loss:0.027795489877462387,mano_total_loss:0.3102882504463196,hm_joints2d_loss:0.1106155663728714,obj_reg_loss:7.884998321533203,obj_conf_loss:3.3498823642730713,total_loss:11.655786514282227
(epoch: 49, time: Sat Oct  7 15:01:35 2023),mano_mesh3d_loss:0.1097884252667427,mano_joints3d_loss:0.11723995953798294,manopose_loss:0.05634310096502304,manoshape_loss:0.027560019865632057,mano_total_loss:0.31093165278434753,hm_joints2d_loss:0.11030231416225433,obj_reg_loss:7.853546142578125,obj_conf_loss:3.3441338539123535,total_loss:11.618903160095215
(epoch: 50, time: Sat Oct  7 15:20:32 2023),mano_mesh3d_loss:0.10706812143325806,mano_joints3d_loss:0.11436346173286438,manopose_loss:0.05535992607474327,manoshape_loss:0.026760032400488853,mano_total_loss:0.303551584482193,hm_joints2d_loss:0.1082940325140953,obj_reg_loss:7.794037818908691,obj_conf_loss:3.329094171524048,total_loss:11.534963607788086
(epoch: 51, time: Sat Oct  7 15:41:52 2023),mano_mesh3d_loss:0.09684311598539352,mano_joints3d_loss:0.10332230478525162,manopose_loss:0.053307268768548965,manoshape_loss:0.02556159719824791,mano_total_loss:0.2790343165397644,hm_joints2d_loss:0.1032257229089737,obj_reg_loss:7.533874988555908,obj_conf_loss:3.2844197750091553,total_loss:11.200546264648438
(epoch: 52, time: Sat Oct  7 16:00:49 2023),mano_mesh3d_loss:0.09450680762529373,mano_joints3d_loss:0.10085099190473557,manopose_loss:0.052514947950839996,manoshape_loss:0.025269990786910057,mano_total_loss:0.27314284443855286,hm_joints2d_loss:0.10182569175958633,obj_reg_loss:7.460644245147705,obj_conf_loss:3.267666816711426,total_loss:11.103293418884277
(epoch: 53, time: Sat Oct  7 16:19:46 2023),mano_mesh3d_loss:0.09501060098409653,mano_joints3d_loss:0.1014629378914833,manopose_loss:0.05211701616644859,manoshape_loss:0.025020809844136238,mano_total_loss:0.27361124753952026,hm_joints2d_loss:0.10079546272754669,obj_reg_loss:7.461483001708984,obj_conf_loss:3.261809825897217,total_loss:11.097702980041504
(epoch: 54, time: Sat Oct  7 16:38:42 2023),mano_mesh3d_loss:0.09330987930297852,mano_joints3d_loss:0.09960994124412537,manopose_loss:0.05142093822360039,manoshape_loss:0.024672970175743103,mano_total_loss:0.2690138518810272,hm_joints2d_loss:0.09964569658041,obj_reg_loss:7.3937153816223145,obj_conf_loss:3.2502307891845703,total_loss:11.012606620788574
(epoch: 55, time: Sat Oct  7 16:57:39 2023),mano_mesh3d_loss:0.09286456555128098,mano_joints3d_loss:0.09916429966688156,manopose_loss:0.050903432071208954,manoshape_loss:0.024266956374049187,mano_total_loss:0.2671990692615509,hm_joints2d_loss:0.0990472212433815,obj_reg_loss:7.3620781898498535,obj_conf_loss:3.24031138420105,total_loss:10.968634605407715
(epoch: 56, time: Sat Oct  7 17:16:35 2023),mano_mesh3d_loss:0.09175398200750351,mano_joints3d_loss:0.09801234304904938,manopose_loss:0.05042383447289467,manoshape_loss:0.02417638897895813,mano_total_loss:0.26436638832092285,hm_joints2d_loss:0.09816519170999527,obj_reg_loss:7.323878765106201,obj_conf_loss:3.2299399375915527,total_loss:10.916350364685059
(epoch: 57, time: Sat Oct  7 17:35:32 2023),mano_mesh3d_loss:0.0910763218998909,mano_joints3d_loss:0.09726162254810333,manopose_loss:0.04974101856350899,manoshape_loss:0.023786157369613647,mano_total_loss:0.26186510920524597,hm_joints2d_loss:0.09725120663642883,obj_reg_loss:7.318131446838379,obj_conf_loss:3.2261650562286377,total_loss:10.903412818908691
(epoch: 58, time: Sat Oct  7 17:54:29 2023),mano_mesh3d_loss:0.09058976918458939,mano_joints3d_loss:0.09672299027442932,manopose_loss:0.04962611198425293,manoshape_loss:0.02374994568526745,mano_total_loss:0.2606890797615051,hm_joints2d_loss:0.09684713929891586,obj_reg_loss:7.309973239898682,obj_conf_loss:3.224032402038574,total_loss:10.8915433883667
(epoch: 59, time: Sat Oct  7 18:13:25 2023),mano_mesh3d_loss:0.08985183387994766,mano_joints3d_loss:0.09598299115896225,manopose_loss:0.04902930185198784,manoshape_loss:0.023459285497665405,mano_total_loss:0.25832319259643555,hm_joints2d_loss:0.09613147377967834,obj_reg_loss:7.263236045837402,obj_conf_loss:3.2125003337860107,total_loss:10.830181121826172
(epoch: 60, time: Sat Oct  7 18:32:21 2023),mano_mesh3d_loss:0.08880581706762314,mano_joints3d_loss:0.0948566421866417,manopose_loss:0.04857998341321945,manoshape_loss:0.023149723187088966,mano_total_loss:0.2553921937942505,hm_joints2d_loss:0.09555651247501373,obj_reg_loss:7.233233451843262,obj_conf_loss:3.2053377628326416,total_loss:10.789507865905762
(epoch: 61, time: Sat Oct  7 18:53:40 2023),mano_mesh3d_loss:0.08232354372739792,mano_joints3d_loss:0.08788643777370453,manopose_loss:0.04713120684027672,manoshape_loss:0.022293152287602425,mano_total_loss:0.23963432013988495,hm_joints2d_loss:0.09172297269105911,obj_reg_loss:7.020287036895752,obj_conf_loss:3.166713237762451,total_loss:10.518362045288086
(epoch: 62, time: Sat Oct  7 19:12:36 2023),mano_mesh3d_loss:0.08107398450374603,mano_joints3d_loss:0.0865740180015564,manopose_loss:0.04653767868876457,manoshape_loss:0.022064145654439926,mano_total_loss:0.2362498790025711,hm_joints2d_loss:0.09076698869466782,obj_reg_loss:7.007259368896484,obj_conf_loss:3.1664960384368896,total_loss:10.500771522521973
(epoch: 63, time: Sat Oct  7 19:31:33 2023),mano_mesh3d_loss:0.08061462640762329,mano_joints3d_loss:0.08610554784536362,manopose_loss:0.046216391026973724,manoshape_loss:0.02184167318046093,mano_total_loss:0.23477840423583984,hm_joints2d_loss:0.09029495716094971,obj_reg_loss:6.9472975730896,obj_conf_loss:3.147662878036499,total_loss:10.420034408569336
(epoch: 64, time: Sat Oct  7 19:50:27 2023),mano_mesh3d_loss:0.08001669496297836,mano_joints3d_loss:0.08543546497821808,manopose_loss:0.04600432887673378,manoshape_loss:0.021648744121193886,mano_total_loss:0.23310525715351105,hm_joints2d_loss:0.08920629322528839,obj_reg_loss:6.9754958152771,obj_conf_loss:3.1554527282714844,total_loss:10.453252792358398
(epoch: 65, time: Sat Oct  7 20:09:23 2023),mano_mesh3d_loss:0.07977167516946793,mano_joints3d_loss:0.08519323915243149,manopose_loss:0.045651257038116455,manoshape_loss:0.02133576199412346,mano_total_loss:0.23195204138755798,hm_joints2d_loss:0.08907648921012878,obj_reg_loss:6.944581508636475,obj_conf_loss:3.1451847553253174,total_loss:10.41077995300293
(epoch: 66, time: Sat Oct  7 20:28:18 2023),mano_mesh3d_loss:0.07970717549324036,mano_joints3d_loss:0.08516678214073181,manopose_loss:0.045242391526699066,manoshape_loss:0.021310513839125633,mano_total_loss:0.23142695426940918,hm_joints2d_loss:0.08866064250469208,obj_reg_loss:6.913706302642822,obj_conf_loss:3.1371090412139893,total_loss:10.370906829833984
(epoch: 67, time: Sat Oct  7 20:47:14 2023),mano_mesh3d_loss:0.07800474762916565,mano_joints3d_loss:0.08331823348999023,manopose_loss:0.04487057030200958,manoshape_loss:0.02107924036681652,mano_total_loss:0.22727279365062714,hm_joints2d_loss:0.08763626962900162,obj_reg_loss:6.888713359832764,obj_conf_loss:3.130798578262329,total_loss:10.334418296813965
(epoch: 68, time: Sat Oct  7 21:06:10 2023),mano_mesh3d_loss:0.07723458856344223,mano_joints3d_loss:0.08247040957212448,manopose_loss:0.044599227607250214,manoshape_loss:0.0208301842212677,mano_total_loss:0.22513432800769806,hm_joints2d_loss:0.08709744364023209,obj_reg_loss:6.8570237159729,obj_conf_loss:3.1245005130767822,total_loss:10.293752670288086
(epoch: 69, time: Sat Oct  7 21:25:05 2023),mano_mesh3d_loss:0.07718764990568161,mano_joints3d_loss:0.08243744820356369,manopose_loss:0.04429706931114197,manoshape_loss:0.02068469673395157,mano_total_loss:0.22460657358169556,hm_joints2d_loss:0.08711066842079163,obj_reg_loss:6.865562438964844,obj_conf_loss:3.12186861038208,total_loss:10.299142837524414
(epoch: 70, time: Sat Oct  7 21:44:01 2023),mano_mesh3d_loss:0.07669926434755325,mano_joints3d_loss:0.08193569630384445,manopose_loss:0.04408050328493118,manoshape_loss:0.020810119807720184,mano_total_loss:0.22352568805217743,hm_joints2d_loss:0.08646570146083832,obj_reg_loss:6.827320575714111,obj_conf_loss:3.114396572113037,total_loss:10.251701354980469

I am looking forward to your reply. And thanks in advance for your help!

Hello, during the replication process, cuda has been continuously unavailable. torch. cuda. is-available(): False. Have you encountered this issue? How to solve it?

Modify line 3 of the traineval.py file
os.environ["CUDA_VISIBLE_DEVICES"] = '1,2,3,4'
to
os.environ["CUDA_VISIBLE_DEVICES"] = '0,1,2,3,4'