Merge branch 'main' into main

Author: BBC-Esq

README.md

@@ -2,10 +2,9 @@
 
 This is a fork for the Instructor model becuase the original repository isn't kept up anymore.  I've also made some improvements to their source code:
 
-1) Fixing it to work with versions of the ```sentence-transformers``` library after version 2.2.2
-   > The original only supports version 2.2.2.
-2) Properly download the models from huggingface.
-3) Ability to use the model downloaded to a folder on your computer - not ALWAYS having to download from Huggingface.
+1) Fixing it to work with the ```sentence-transformers``` library above 2.2.2.
+2) Properly download the models from huggingface using the new "snapshot download" API.
+3) Ability to specify where you want the model donwloaded with the "cache_dir" parameter.
 
 ## What follows is the original repository's readme file.  Ignore the quantization section, however, becuase pytorch has changed its API since then.
 

requirements.txt

@@ -1,14 +1,12 @@
-transformers==4.20.0
-datasets>=2.2.0
-pyarrow==8.0.0
-jsonlines
-numpy
-requests>=2.26.0
-scikit_learn>=1.0.2
-scipy
-sentence_transformers>=2.3.0
-torch
-tqdm
-rich
-tensorboard
-huggingface-hub>=0.19.0
+transformers>=4.20,<5.0
+datasets>=2.20,<3.0
+pyarrow>=17.0,<18.0
+numpy>=1.0,<=1.26.4
+requests>=2.26,<3.0
+scikit_learn>=1.0.2,<2.0
+scipy>=1.14,<2.0
+sentence-transformers>=3.0.1,<4.0
+torch>=2.0
+tqdm>=4.0,<5.0
+rich>=13.0,<14.0
+huggingface-hub>=0.24.1