Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate zero padding #13

Open
knkski opened this issue Nov 4, 2017 · 1 comment
Open

Investigate zero padding #13

knkski opened this issue Nov 4, 2017 · 1 comment

Comments

@knkski
Copy link
Owner

knkski commented Nov 4, 2017

Zero padding can sometimes be useful when dealing with CNNs. We should investigate how/where to use them

@knkski
Copy link
Owner Author

knkski commented Nov 4, 2017

This graph shows the effects of zero padding on a simple CNN (2x64 conv, 2x128 conv, 2x4096 dense):

zeropadding

The dark green line shows no zero padding, the yellow line shows zero padding before the initial conv layer, the line green line shows zero padding before each set of conv layers, and the purple line shows zero padding before each conv layer.

Based off of this graph, it looks like zero padding before the initial conv layer is useful and improves performance by about 0.2%. The other zero padding layers either had no effect or worsened performance, however.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant