Skip to content

Add tf.keras model implementation #27

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 86 commits into from
Jul 17, 2019
Merged

Add tf.keras model implementation #27

Changes from 1 commit
Commits
Show all changes
86 commits
Select commit Hold shift + click to select a range
624eab6
README minor fixes
eladn Mar 13, 2019
79f5891
train.sh - add #! hash first line
eladn Mar 13, 2019
04efcc5
gitignore: ignore models, data, .idea, and tar.gz
eladn Mar 13, 2019
beb2eda
new: Keras AttentionLayer
eladn Mar 13, 2019
36c69a7
Config / add params: DL_FRAMEWORK & DROPOUT_KEEP_RATE
eladn Mar 14, 2019
b79127d
common::split_to_batches() / use iterator instead of creating a list
eladn Mar 14, 2019
254ee5e
Keras AttentionLayer / minor comments modification
eladn Mar 14, 2019
7ebf1ce
add Keras model impl (not fully implemented yet); dispatch tf/keras i…
eladn Mar 14, 2019
bee8ccb
keras model: use `tf.data` reader [now training works]
eladn Mar 21, 2019
e41730c
export Config to config.py; common.SpecialDictWords(Enum);
eladn Mar 22, 2019
429258e
add common.tf_get_first_true()
eladn Mar 22, 2019
69dc76a
model_base: use common.SpecialDictWords
eladn Mar 22, 2019
9bf16e8
keras model: add prediction tf graph, add evaluation f1 metric; pass …
eladn Mar 22, 2019
290f254
export word prediction calculation from model into WordPredictionLayer
eladn Mar 22, 2019
79fdfe3
impl keras Words Subtoken Metrics (Precision, Recall, F1)
eladn Mar 22, 2019
b832b4e
export the `topk` param into config.TOP_K_WORDS_CONSIDERED_DURING_PRE…
eladn Mar 22, 2019
fd48203
keras model: use 'target_word_prediction' layer output as an addition…
eladn Mar 23, 2019
4a99e60
minor refactor: name for metrics
eladn Mar 23, 2019
6014a33
keras model: impl save+load, use val reader for train, use checkpoint…
eladn Mar 23, 2019
992622a
keras model: minor refactor
eladn Mar 23, 2019
d976f41
keras model: add code_vectors to output, impl evaluate()+predict()
eladn Mar 23, 2019
e80cc9b
base model redactor; OOV+PAD special words instead of NoSuch; impl sa…
eladn Mar 24, 2019
4ca69ca
fix store+load model (to use RELEASE param correctly); fix transform …
eladn Mar 25, 2019
8ea4851
SpecialDictWords: each word has its string representation and its index
eladn Mar 26, 2019
8db1d7d
subtoken metrics: fix subtoken separator
eladn Mar 26, 2019
d191727
impl Vocab class; refactor SpecialVocabWords
eladn Mar 26, 2019
ffd416a
reader: minor refactor + fix csv_record_defaults
eladn Mar 27, 2019
5122495
export vocabs management into `vocabularies.py`; new Code2VecVocabs c…
eladn Mar 28, 2019
c97d6c3
keras model store+load: use tf checkpoint to store optimizer status; …
eladn Apr 2, 2019
98a0b1b
move VocabType to vocabularies; move `save_word2vec_format()` to base…
eladn Apr 3, 2019
ec93a81
reader: add option `repeat_endlessly`; use in keras model.
eladn Apr 3, 2019
48965d3
tensorflow model: adapt to the new model base and the new reader; NOT…
eladn Apr 3, 2019
c062e64
add `framework` option to argparse; use unified `ModelEvaluationResul…
eladn Apr 4, 2019
058443c
tensorflow model: make it work correctly with the new reader and new …
eladn Apr 4, 2019
3c31a73
add log.txt to .gitignore
eladn Apr 4, 2019
91ff0d6
reader: support input lines + support predict; keras model: fix predi…
eladn Apr 4, 2019
89fcfe5
keras model: don't use `WordPredictionLayer` anymore, fix subtoken wo…
eladn Apr 5, 2019
b350596
make tensorflow the default impl; fix help descriptions in argparser.
eladn Apr 5, 2019
225d6f2
tensorflow model: `TopKAccuracyEvaluationMetric` refactor: use numpy …
eladn Apr 6, 2019
b682143
keras model: pass target word string in input pipeline for estimation
eladn Apr 6, 2019
d806f81
tensorflow model minor refactor
eladn Apr 15, 2019
5ab7672
update README: paper-version, dependencies, configuration params
eladn May 26, 2019
87b5b1a
Merge remote-tracking branch 'upstream/master'
eladn May 26, 2019
2acd3ba
update README: mention keras impl; fix links
eladn May 26, 2019
1db70f1
update README: add section in Features about choosing impl
eladn May 26, 2019
5d0ff2f
train.sh: remove accidentally added line before EOF
eladn May 26, 2019
143d2a6
config: minor refactor to params names & order
eladn May 26, 2019
c09e588
old reader: remove impl & remove its old config params
eladn May 26, 2019
1e368c1
keras WordsSubtokenMetric: fix duplicates preserve
eladn May 26, 2019
e105e66
add logger; use tensorboard; refactor config; tf: fix subtoken metric
eladn May 27, 2019
de5305c
keras words subtokens metric: fix
eladn May 27, 2019
915f3a3
config: rename prop; keras model: add logging on load model
eladn May 27, 2019
4545b02
config: rename param; add method to iter all params
eladn May 27, 2019
3a5f77b
logging format; log creating model; log config
eladn May 27, 2019
97e752f
keras model: refactor ckpt saver cb; refactor eval cb; cancel re-comp…
eladn May 27, 2019
64f30d4
main file minor refactor
eladn Jun 2, 2019
81d22bd
vocabs: add tiny doc line
eladn Jun 2, 2019
27b7e22
keras model: tiny fix
eladn Jun 2, 2019
365bc36
config: change default values
eladn Jun 2, 2019
46ae7ad
migrate to TF-2.0.0-alpha; now keras model works with BS=1024 + TP=12…
eladn Jun 2, 2019
5891587
config: refactor: add annotations + optional strings + `is_saving` + …
eladn Jun 3, 2019
df3b0ca
reader: fix `process_input_row()` to adapt TF2
eladn Jun 3, 2019
cbe8fa6
vocabs: fix minor issue (field initialization position)
eladn Jun 3, 2019
7da5dc4
keras modeL: save only when needed; adapt save+load+predict to TF2
eladn Jun 3, 2019
2547420
docs: add some docs to classes
eladn Jun 3, 2019
b79789e
keras model: refactor: add `_create_train_callbacks()`; add docs
eladn Jun 3, 2019
69b41b6
logger fix: don't print twice (turn off propagate)
eladn Jun 3, 2019
6edde7a
model base tiny refactor
eladn Jun 3, 2019
8242e6e
keras model save fix (to also save vocabs)
eladn Jun 3, 2019
49bbd64
tensorflow model: print # trainable params
eladn Jun 27, 2019
0aa498e
add requirements.txt
eladn Jul 15, 2019
f710132
README: add keras impl title, update requirements
eladn Jul 15, 2019
38ffab5
model base: create model save dir if not exists
eladn Jul 15, 2019
d43d0d0
update version: TF2.0.0-alpha ==> TF2.0.0-beta1 (use tf.compat.v1.str…
eladn Jul 15, 2019
1bc14d4
tensorflow model: make it work in TF2.0.0-beta1 (train+eval+predict+s…
eladn Jul 15, 2019
cb7df2b
add & support option `config.SEPARATE_OOV_AND_PAD` and `vocab.special…
eladn Jul 15, 2019
63a8019
README: minor bold-updates order fix
eladn Jul 15, 2019
41e13ec
vocabs: fix save&load to match old format (without special words); no…
eladn Jul 16, 2019
dfba714
config: rename param "NUM_BATCHES_TO_LOG_PROGRESS"
eladn Jul 16, 2019
cf716b5
vocabs: refactor error msg on failed load due to wrong min word idx
eladn Jul 16, 2019
b68f0e9
tf model: use logger instead of print()s
eladn Jul 16, 2019
cbc6487
vocabs: fix save_to_file() to adapt to old format
eladn Jul 16, 2019
86d5b43
keras & tf models: refactor - move aux classes below main model class
eladn Jul 16, 2019
419c7eb
config: make logging go to stdout instead of stderr
eladn Jul 17, 2019
1c92dab
readme: remove paper-version note. We just added new functionalities.…
eladn Jul 17, 2019
64bebf7
Merge remote-tracking branch 'upstream/master'
eladn Jul 17, 2019
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add requirements.txt
  • Loading branch information
@eladn
eladn committed Jul 15, 2019
commit 0aa498ee860a5fe89bea9f242f785ea9fb1f878f
2 changes: 2 additions & 0 deletions requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
tensorflow==2.0.0-beta1
numpy