We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
nltk.download("punkt") fails for nltk v 3.9.x
nltk.download("punkt")
@staticmethod def nltk_setup() -> None: try: nltk.data.find("tokenizers/punkt") except LookupError: nltk.download("punkt") try: nltk.data.find("corpora/stopwords") except LookupError: nltk.download("stopwords")
Here's a full explanation nltk/nltk#3293
pinecone-text should work with the latest nltk version
nltk/nltk#3293
No response
- **OS**: - **Language version**: - **Pinecone client version**:
The text was updated successfully, but these errors were encountered:
Apparently it seems to be enough to just modify sparse\bm25_tokenizer.py, replacing punkt with punkt_tab.
sparse\bm25_tokenizer.py
punkt
punkt_tab
@staticmethod def nltk_setup() -> None: try: nltk.data.find("tokenizers/punkt_tab") except LookupError: nltk.download("punkt_tab") try: nltk.data.find("corpora/stopwords") except LookupError: nltk.download("stopwords")```
Sorry, something went wrong.
#83
No branches or pull requests
Is this a new bug?
Current Behavior
nltk.download("punkt")
fails for nltk v 3.9.xHere's a full explanation nltk/nltk#3293
Expected Behavior
pinecone-text should work with the latest nltk version
Steps To Reproduce
nltk/nltk#3293
Relevant log output
No response
Environment
Additional Context
No response
The text was updated successfully, but these errors were encountered: