Unofficial implementation of ALBERT.
python setup.py installor
# Install latest version: pip install git+https://github.com/TinkerMob/keras_albert_model.git # Install specific version: pip install git+https://github.com/TinkerMob/keras_albert_model.git@v0.1.0Current versions of dependencies:
- keras==2.3.0
- tensorflow==2.0.0
from keras_albert_model import build_albert model = build_albert(token_num=30000, training=True) model.summary()You can load pretrained model provided by brightmart/albert_zh:
from keras_albert_model import load_brightmart_albert_zh_checkpoint model = load_brightmart_albert_zh_checkpoint('path_to_checkpoint_folder') model.summary()from keras_albert_model import build_albert model = build_albert(token_num=30000, training=False, output_layers=[-1, -2, -3, -4]) model.summary()