Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update to python3.9, scipy and migrate gensim 3 to 4 #5

Merged
merged 4 commits into from
Nov 3, 2023

Conversation

shihono
Copy link
Owner

@shihono shihono commented Nov 3, 2023

resolve #4

test eval.py

% poetry run python eval.py /XXX/latest-ja-word2vec-gensim-model/word2vec.gensim.model /XXX/JWSAN/jwsan-1400.csv -v --col 1 2 4 -m --mecab_dict /usr/local/lib/mecab/dic/mecab-ipadic-neologd
[2023-11-03 20:43:04,989] [__main__] [INFO] set logger
[2023-11-03 20:43:11,941] [__main__] [INFO] Word vector 50 dim, Vocab size 335476
[2023-11-03 20:43:11,942] [__main__] [INFO] Use mecab : dict setting is /usr/local/lib/mecab/dic/mecab-ipadic-neologd
[2023-11-03 20:43:11,963] [__main__] [INFO] load filepath : /XXX/JWSAN/jwsan-1400.csv, 1400 data
[2023-11-03 20:43:12,044] [__main__] [INFO] Evaluate 1359 data
[2023-11-03 20:43:12,046] [__main__] [INFO] spearmanr SignificanceResult(statistic=0.4155930561711437, pvalue=6.97399627506598e-58)
Data	1400
OOV	41
Corr	0.416

@shihono shihono merged commit 3595e01 into master Nov 3, 2023
@shihono shihono deleted the update-python3.9 branch November 3, 2023 12:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

python3.9に更新する
1 participant