charlesyju f19211b1f5
support adding keywords to model tokenizer (#1622)
* support adding keywords to model tokenizer

* add keyword_preprocess.py usage doc

* init new token with good weights

---------

Co-authored-by: Charles Ju <charlesyju@gmail.com>
2023-10-27 13:57:14 +08:00
..
2023-10-20 23:32:30 +08:00
2023-10-22 00:00:15 +08:00
2023-10-25 21:59:26 +08:00