From 72617e7b9eef990e33d4cb6dba121b8e6ad71064 Mon Sep 17 00:00:00 2001
From: pliny <133052465+elder-plinius@users.noreply.github.com>
Date: Sun, 15 Sep 2024 23:02:12 -0400
Subject: [PATCH] Update CLOSEDAI.mkd

---
 CLOSEDAI.mkd | 8 ++++++++
 1 file changed, 8 insertions(+)
 create mode 100644 CLOSEDAI.mkd

diff --git a/CLOSEDAI.mkd b/CLOSEDAI.mkd
new file mode 100644
index 0000000..2db6d63
--- /dev/null
+++ b/CLOSEDAI.mkd
@@ -0,0 +1,8 @@
+Special Tokens
+
+1. **\<SOS> (Start of Sequence)**: Marks the beginning of a sequence for the model to start processing.
+2. **\<EOS> (End of Sequence)**: Tells the model when to stop generating text or processing.
+3. **\<PAD> (Padding Token)**: Pads sequences to the same length for batch processing.
+4. **\<UNK> (Unknown Token)**: Represents words not in the model's vocabulary.
+5. **\<MASK> (Mask Token)**: Used in tasks like predicting missing words in masked language models.
+6. **\<SEP> (Separator Token)**: Separates different segments in input, like questions from context.