Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about the input for frame synthesis network #34

Closed
asheroin opened this issue Dec 2, 2019 · 1 comment
Closed

Questions about the input for frame synthesis network #34

asheroin opened this issue Dec 2, 2019 · 1 comment

Comments

@asheroin
Copy link

asheroin commented Dec 2, 2019

As described in figure 3 from the CVPR paper, the input of frame synthesis network consists of five components, including raw interpolation kernels, projected flows, warped depth maps, warped frames and warped context features. However, in line 177 to 181 from DIAN_slowmotion.py , the input for rectifyNet seems not as same as described:

rectify_input = torch.cat((cur_output_temp,ref0,ref2, cur_offset_output[0],cur_offset_output[1], cur_filter_output[0],cur_filter_output[1], ctx0,ctx2 ),dim =1)

It seems that the actual input for the frame synthesis network did not include the warped depth maps while used a blended result from warped frames alternatively.

So which one should be the correct way for the proposed method? Would you pleased give a numerical analysis for such different settings?

@laomao0
Copy link

laomao0 commented Dec 2, 2019

https://github.com/baowenbo/DAIN/blob/master/networks/DAIN.py
Line 133-138
The context features include the depth information.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants