Inclination is incorrect

[Mps24-7uk]

Thanks for the amazing work. I tried the running test.py on nyu dataset and blended the seg to check the alignment. It seems to be going off. Can you suggest how to fix it? Please find the example below.

Blended segmentation and image

segmentation and image

[bertjiazheng]

Hi,

Thanks for your interest in our work. I am not exactly sure what happens, but you could check the 2D detected lines are correct or not.

Best,
Jia

[Mps24-7uk]

@bertjiazheng I checked the 2D lines, getting it wrong. Could you please help, check it once why the output layout is not inclined.

[CYang0515]

What the other cases in the NYU303 dataset?

[Mps24-7uk]

@CYang0515 I tried out on NYU303 as well as custom test set but it didnt worked for me. You have given the padding of (480, 640, 3) to the input image of size (427,561,3) . I did the post processing but it didn't fixed the issue.

[CYang0515]

What resolution of your origin image in NYU303 dataset? Maybe the images you used are not cropped and resized, as the processed images do not have white border.

[Mps24-7uk]

In nyu303 dataset the fullres image size is (480,640,3) and cropped image size is (427,561,3). I checked on nyu303 images and the result is doesn't have correct alignment. In the result you will see that the layout is not exactly aligned with the wall edges

[CYang0515]

We add one case of NYU dataset for debug, you can type python test.py --pretrained DIR --data NYU303 --exam --visual to get right result in ./results.

[CYang0515]

We have updated the code, and provide an --exam parameter to show one example of NYU303 dataset. The input image and reconstruction results are in example/NYU0969 and results separately.

[Mps24-7uk]

Thanks for updating the repo. The NYU303 test set results look promising but it fails in some cases. In the result, the predicted wall is not correct. Is it because we are predicting the layout on the crop image and trying to fit it on fullres image.

Can we use --pretrained NYU303_pretrained.pt --data NYU303 this setting to estimate the layout for custom test image?