-
Notifications
You must be signed in to change notification settings - Fork 393
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
MLeap for local model scoring #249
Conversation
Codecov Report
@@ Coverage Diff @@
## master #249 +/- ##
==========================================
- Coverage 86.41% 28.4% -58.02%
==========================================
Files 312 312
Lines 10187 8316 -1871
Branches 336 420 +84
==========================================
- Hits 8803 2362 -6441
- Misses 1384 5954 +4570
Continue to review full report at Codecov.
|
Codecov Report
@@ Coverage Diff @@
## master #249 +/- ##
==========================================
+ Coverage 86.41% 86.49% +0.08%
==========================================
Files 312 312
Lines 10187 10184 -3
Branches 336 336
==========================================
+ Hits 8803 8809 +6
+ Misses 1384 1375 -9
Continue to review full report at Codecov.
|
local/README.md
Outdated
@@ -44,6 +39,6 @@ val scoreFn = new OpWorkflowRunnerLocal(workflow).score(opParams) | |||
Below is an example of measured scoring performance on 6m records with 10 fields and 12 transformations applied. | |||
Executed on MacBook Pro i7 3.5Ghz in a single thread. | |||
``` | |||
Scored 6,000,000 records in 239s | |||
Average time per record: 0.0399215ms | |||
Scored 6,000,000 records in 710s |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
interesting that there is 3x throughput difference
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I had to warm up the JVM. Updated the numbers.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's slightly faster.
/** | ||
* Internal PFA model representation | ||
* Internal OP model representation |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
MLeap?
Related issues
Aardpfark is no longer supported.
Describe the proposed solution
Switching to MLeap runtime instead.
Describe alternatives you've considered
N/A