mirror of
https://github.com/elder-plinius/L1B3RT4S.git
synced 2026-07-09 21:23:09 +03:00
pliny
11 lines
292 B
Markdown
11 lines
292 B
Markdown
# Special Tokens
|
|
- **\<SOS> : Start of Sequence**
|
|
- **\<EOS> : End of Sequence**
|
|
- **\<CLS> : Classification Token**
|
|
- **\<SEP> : Separator Token**
|
|
- **\<UNK> : Unknown Token**
|
|
- **\<REASONING_START> : Begin Reasoning**
|
|
- **\<REASONING_END> : End Reasoning**
|
|
- **\<ANSWER> : Begin Answer**
|
|
|