-
Notifications
You must be signed in to change notification settings - Fork 2.7k
Artifacts
Artifact Name: A descriptive name.
Description: Describe how the artifact can be identified.
Cause: What causes the artifact to occur.
Solution: How to prevent/mitigate the artifact and it's effects.
Examples: Example images showcasing the artifact.
Artifact Name: Gray Spots/Haze
Description: Gray haze which covers certain regions of the output image, or gray spots which can destroy parts of the output image as they grow.
Cause: Unstable parameters used with the Adam optimizer.
Solution: Using the information from here, setting the beta1 parameter to 0.99 and the epsilon parameter to 1e-1.
Artifact Name: Gray Rectangles
Description: Gray rectangles form horizontally, or vertically, and sometimes with only one hard edge. They can be really short, or long.
Cause: Currently, I suspect that the FCN-32s PASCAL model's training causes these issues, and not any of Neural-Style's parameters.
Solution: Edit the output image in a third party image editor, or try to configure Neural-Style's parameters in a way that mitigates the gray rectangles.
Artifact Name: Geometric Grid Patterns
Description: These can be identified as dots in a grid like pattern across the output image, or as geometric lines resembling the lower layers of some DeepDream models. These artifacts appear especially easy to see on NIN (Network In Network) models, and the ResNet models that I have tested.
Cause: The model architecture and/or size, in addition to training, are the likely causes.
Solution: Use a extremely low -tv_weight that's just large enough to obscure and thus remove the visible artifacts.
Artifact Name: Border Lines
Description: Long lines running parallel to the output image's borders. They are usually not continuous. Do not confuse them with the output images produced by style images with visible borders. They seem to appear most commonly at smaller image sizes.
Cause: I'm not entirely sure, but I think the padding may have something to do with it.
Solution: Using a Multiscale Resolution script can help render these artifacts almost invisible at larger image sizes.