Skip to content

Commit 0e076be

Browse files
author
Zhao Li
authored
Merge pull request #167 from livc/nce
add reader shuffle
2 parents e88101b + 6fdf44b commit 0e076be

File tree

1 file changed

+6
-3
lines changed

1 file changed

+6
-3
lines changed

nce_cost/train.py

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -43,9 +43,12 @@ def event_handler(event):
4343
parameters.to_tar(f)
4444

4545
trainer.train(
46-
paddle.batch(paddle.dataset.imikolov.train(word_dict, 5), 64),
47-
num_passes=1000,
48-
event_handler=event_handler)
46+
paddle.batch(
47+
paddle.reader.shuffle(
48+
lambda: paddle.dataset.imikolov.train(word_dict, 5)(),
49+
buf_size=1000), 64),
50+
num_passes=1000,
51+
event_handler=event_handler)
4952

5053

5154
if __name__ == "__main__":

0 commit comments

Comments
 (0)