Skip to content
This repository has been archived by the owner on Jun 10, 2021. It is now read-only.

[WIP] Label smoothing #528

Open
wants to merge 10 commits into
base: master
Choose a base branch
from
Open

Conversation

jsenellart
Copy link
Contributor

  • implement label smoothing as defined in Szegedy, 2015 - uniform distribution

@codecov-io
Copy link

codecov-io commented Mar 25, 2018

Codecov Report

Merging #528 into master will decrease coverage by 0.22%.
The diff coverage is 39.68%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #528      +/-   ##
==========================================
- Coverage   64.25%   64.02%   -0.23%     
==========================================
  Files          77       78       +1     
  Lines        7237     7278      +41     
==========================================
+ Hits         4650     4660      +10     
- Misses       2587     2618      +31
Impacted Files Coverage Δ
onmt/SeqTagger.lua 22.59% <0%> (ø) ⬆️
onmt/modules/init.lua 100% <100%> (ø) ⬆️
onmt/modules/LabelSmoothingCriterion.lua 15.62% <15.62%> (ø)
onmt/Seq2Seq.lua 50% <20%> (+0.35%) ⬆️
onmt/LanguageModel.lua 75.43% <50%> (ø) ⬆️
onmt/modules/ParallelCriterion.lua 80% <80%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 316f82a...55ab651. Read the comment docs.

onmt/Seq2Seq.lua Outdated
@@ -176,12 +180,12 @@ end

function Seq2Seq:setGeneratorVocab(t)
self.models.decoder.generator:setGeneratorVocab(t)
self.criterion.mainCriterion.weights:resize(t:size(1))
self.criterion:updateVocav(t)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Typo: updateVocav -> updateVocab

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants