-
Notifications
You must be signed in to change notification settings - Fork 2.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support Point-in-time Data Operation #343
Conversation
This PR is stale because it has been open for a year with no activity. Remove the stale label or comment on the PR otherwise this will be closed in 5 days |
report_list = [] | ||
while (rs_report.error_code == "0") & rs_report.next(): | ||
report_list.append(rs_report.get_row_data()) | ||
# 获取一条记录,将记录合并在一起 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please use english
requests | ||
pandas | ||
lxml | ||
loguru |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
duplicated logurr
scripts/data_collector/pit/README.md
Outdated
```bash | ||
|
||
# download from baostock.com | ||
python collector.py download_data --source_dir /data1/v-xiabi/qlib/pit/csv_2 --start 2000-01-01 --end 2020-01-01 --interval quarterly |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Using a more general path will be better
qlib/data/base.py
Outdated
@@ -224,3 +229,362 @@ class ExpressionOps(Expression): | |||
""" | |||
|
|||
pass | |||
|
|||
|
|||
class PExpression(abc.ABC): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
MetaClass
我想在本地把这个pr合并到当前主分支来用,但是有大量的代码冲突。请问这个pr还在开发中吗?没有的话我准备在当前主分支版本的基础上按照这个pr的逻辑进行开发来支持时点数据。 |
@Chaoyingz 还在开发中, 这几天我把这些梳理梳理 整理 一版 出来, 回头咱一起讨论讨论 后面持续优化 :) |
The development of this PR is finished and it is ready for review now. It will be merged to master soon! |
* add period ops class * black format * add pit data read * fix bug in period ops * update ops runnable * update PIT test example * black format * update PIT test * update tets_PIT * update code format * add check_feature_exist * black format * optimize the PIT Algorithm * fix bug * update example * update test_PIT name * add pit collector * black format * fix bugs * fix try * fix bug & add dump_pit.py * Successfully run and understand PIT * Add some docs and remove a bug * mv crypto collector * black format * Run succesfully after merging master * Pass test and fix code * remove useless PIT code * fix PYlint * Rename Co-authored-by: Young <[email protected]>
Description
Support Point-in-time Data Operation
Motivation and Context
How Has This Been Tested?
pytest qlib/tests/test_all_pipeline.py
under upper directory ofqlib
.Screenshots of Test Results (if appropriate):
Types of changes