Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Vowpal Wabbit kwargs + improvements #692

Merged
merged 18 commits into from
Sep 17, 2019

Conversation

eisber
Copy link
Collaborator

@eisber eisber commented Sep 13, 2019

fixed VW kwargs (setLearningRate, setPowerT, ...)
updated to VW 8.7.0.3
exposing VW internal performance statistics
implemented VW native model export
track timing metrics (learn, ingest, sync,...)

updated to VW 8.7.0.3
exposing VW internal performance statistics
implemented VW native model export
track timing metrics (learn, ingest, sync,...)
@eisber
Copy link
Collaborator Author

eisber commented Sep 13, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@codecov
Copy link

codecov bot commented Sep 13, 2019

Codecov Report

Merging #692 into master will decrease coverage by 44.81%.
The diff coverage is 94.21%.

Impacted file tree graph

@@             Coverage Diff             @@
##           master     #692       +/-   ##
===========================================
- Coverage   79.61%   34.79%   -44.82%     
===========================================
  Files         226      176       -50     
  Lines        9011     7920     -1091     
  Branches      480      483        +3     
===========================================
- Hits         7174     2756     -4418     
- Misses       1837     5164     +3327
Impacted Files Coverage Δ
...crosoft/ml/spark/vw/VowpalWabbitInteractions.scala 90.9% <ø> (ø) ⬆️
...n/scala/com/microsoft/ml/spark/vw/HasNumBits.scala 85.71% <ø> (-5.2%) ⬇️
...a/com/microsoft/ml/spark/vw/HasSumcollisions.scala 100% <100%> (ø)
...microsoft/ml/spark/vw/VowpalWabbitClassifier.scala 86.36% <100%> (ø) ⬆️
...microsoft/ml/spark/vw/VowpalWabbitFeaturizer.scala 85.93% <100%> (+0.22%) ⬆️
.../microsoft/ml/spark/vw/VowpalWabbitRegressor.scala 70% <100%> (ø) ⬆️
.../com/microsoft/ml/spark/core/utils/StopWatch.scala 77.77% <77.77%> (ø)
.../microsoft/ml/spark/vw/VowpalWabbitBaseModel.scala 94.44% <94.44%> (ø)
...a/com/microsoft/ml/spark/vw/VowpalWabbitBase.scala 90.11% <95.52%> (+4.3%) ⬆️
...cala/com/microsoft/ml/spark/lime/BreezeUtils.scala 0% <0%> (-100%) ⬇️
... and 169 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3ea5bc5...76fd5ce. Read the comment docs.

@eisber
Copy link
Collaborator Author

eisber commented Sep 13, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723
Copy link
Collaborator

@markus if you add WIP to the name it makes it so that it fails the WIP status check so others know when you are finished

@eisber eisber changed the title fix: Vowpal Wabbit kwargs + improvements (not ready) fix: Vowpal Wabbit kwargs + improvements WIP Sep 16, 2019
@eisber
Copy link
Collaborator Author

eisber commented Sep 16, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber
Copy link
Collaborator Author

eisber commented Sep 16, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber
Copy link
Collaborator Author

eisber commented Sep 16, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber
Copy link
Collaborator Author

eisber commented Sep 16, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber
Copy link
Collaborator Author

eisber commented Sep 16, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber
Copy link
Collaborator Author

eisber commented Sep 16, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber
Copy link
Collaborator Author

eisber commented Sep 16, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber
Copy link
Collaborator Author

eisber commented Sep 16, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber eisber changed the title fix: Vowpal Wabbit kwargs + improvements WIP fix: Vowpal Wabbit kwargs + improvements Sep 16, 2019
Copy link
Collaborator

@mhamilton723 mhamilton723 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Only minor nits!

@mhamilton723
Copy link
Collaborator

Also @eisber this page will help you eliminate some redundancy in test code

https://app.codacy.com/manual/mhamilton723/mmlspark/pullRequest?prid=4158746

@eisber
Copy link
Collaborator Author

eisber commented Sep 16, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber
Copy link
Collaborator Author

eisber commented Sep 16, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber
Copy link
Collaborator Author

eisber commented Sep 17, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber
Copy link
Collaborator Author

eisber commented Sep 17, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eisber
Copy link
Collaborator Author

eisber commented Sep 17, 2019

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@mhamilton723 mhamilton723 merged commit 95061d0 into microsoft:master Sep 17, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants