add readme

Signed-off-by: peter szemraj <peterszemraj@gmail.com>

Author: pszemraj

README.md

@@ -0,0 +1,17 @@
+# samba-pytorch
+
+> Implementation of [Samba by Microsoft](https://arxiv.org/abs/2406.07522) in PyTorch.
+
+This aims to be a simpler implementation of the [original repo](https://github.com/microsoft/Samba).
+
+## Citations
+
+```bibtex
+@article{ren2024samba,
+      title={Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling},
+      author={Liliang Ren and Yang Liu and Yadong Lu and Yelong Shen and Chen Liang and Weizhu Chen},
+      journal = {arXiv preprint},
+      year={2024},
+      url={https://arxiv.org/abs/2406.07522}
+}
+```