Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

AutoML #790

Merged
merged 141 commits into from
Jul 23, 2019
Merged

AutoML #790

merged 141 commits into from
Jul 23, 2019

Conversation

bluesjjw
Copy link
Collaborator

@bluesjjw bluesjjw commented Jun 17, 2019 •
edited
Loading

#422 #788

  1. Parameter tuner for ML algorithms, with standalone lib.
  2. Spark Pipeline constructor.
  3. Feature selector and feature engineering.

bluesjjw and others added 30 commits November 8, 2018 16:09
@bluesjjw
auto ml framework
bef4f1d
@bluesjjw
initial work of RF in Angel
1a504c5
@bluesjjw
DT learner and params
10835df
@bluesjjw
compile clean version
004a56f
@bluesjjw
format code
2befb12
@bluesjjw
RFLearner, refine strategy, add MLConf
8eeecc9
@bluesjjw
parse random forest configs
e8f5b51
@bluesjjw
param parser
91b9407
@bluesjjw
add conf and strategy
b11114b
@bluesjjw
basic data structure
8ae7f62
@bluesjjw
models for DT and RF
ae89439
@bluesjjw
improve basic data structure
fdb7990
@bluesjjw
chech tree num and assign trees
a236c34
@bluesjjw
error of task assignment
2886848
@bluesjjw
bug fix of config parser
30929f2
@bluesjjw
bug fix, rm log
6262f2a
@bluesjjw
reconstruct automl framework
2744e62
@bluesjjw
import error
78b34e6
@bluesjjw
Revert "import error"
948b351 
This reverts commit 78b34e6.
@bluesjjw
Revert "reconstruct automl framework"
2115a89 
This reverts commit 2744e62.
@bluesjjw
reconstruct to spark.ml API
4ce9861
@bluesjjw
conf of preprocess, dataframe loader, a start of preprocess
4c4227d
@bluesjjw
add tokenizer and stopwordremover
56efbc3
@bluesjjw
bug fix
caa0c7b
@bluesjjw
bug fix
557b1ee
@bluesjjw
implement Sampler with Transformer
0d74c0b
@bluesjjw
add seed to Sampler
fa00dab
@bluesjjw
wrapper of spark.ml transformer
0a38e82
@bluesjjw
code format
d194a94
@paynie
Merge pull request #583 from bluesjjw/Auto-ML-jeremy
256b413 
 wrapper of spark.ml transformer 0a38e82
bluesjjw and others added 28 commits March 19, 2019 20:09
@bluesjjw
refine ut test for feature cross
e6ad92d
@bluesjjw
add UT for three order feature cross
6e99fc6
@bluesjjw
bug fix: support grid search for continuous space
ffd74ab
@bluesjjw
bug fix: selector should output sparse vector
7df9146
@bluesjjw
refine example and ut
9b096a8
@bluesjjw
bug fix: BinaryLogisticRegressionSummary interface error
6bbcc73
@bluesjjw
bug fix: one param returns a simgle vector
87780bd
@bluesjjw
reduce tolerance of LBFGS for GP
c5b5fa4
@xuehuanran
Add FtestSelector, fix the problem of the filterIndices, add setNumTo…
9fd6712 
…pFeatures for each fitted selector,
@bluesjjw
Merge pull request #700 from xuehuanran/Auto-ML
44e690c 
Add FtestSelector and setNumTopFeatures method
@bluesjjw
handle not converge exception
cca7419
@bluesjjw
fix convergence failure in GP EM algorithm
2452dbd
@bluesjjw
change log
1294506
@xuehuanran
1 add the PipelineWrapperModel in the PileWrapper to drop Intermediat…
27211af 
…e dataframe

2 complete the basic structure of recording the derivation information of cross-features
@bluesjjw
change spark version, auto offline learner and runner
df62b53
@bluesjjw
change scope of lib for automl
2339790
@bluesjjw
integration of Angel and auto tuning
00f7a0d
@bluesjjw
parse conf to set params of auto tuner
6346229
@bluesjjw
Merge pull request #772 from xuehuanran/Auto-ML
d29e2a7 
Basic Structure of recording derivation information of cross-features
@zwt233
Solve conflicts
437a6d7
@bluesjjw
Merge pull request #776 from zwt233/Auto-ML
8e2fac5 
Add Early Stopping Function and a new acquisition function(GP-UCB)
@bluesjjw
refactor earsly stopping
bbb6f94
@bluesjjw
dependency error
4b521b3
@bluesjjw
fix bug: firstFlow might be reversed if not set split(0)
b01417d
@bluesjjw
Revert "fix bug: firstFlow might be reversed if not set split(0)"
4d42fe9 
This reverts commit b01417d.
@bluesjjw
merge branch-2.2.0, fix conflits
604033f
@bluesjjw
trainer returns metrics
8a37afd
@bluesjjw
tune the hyper-parameters of GBDT
d984d22
@bluesjjw bluesjjw requested a review from paynie June 17, 2019 06:22
@paynie paynie merged commit b765b0f into develop Jul 23, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@paynie paynie Awaiting requested review from paynie

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@bluesjjw @kimi132009 @paynie @xuehuanran @zwt233