Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[dbnode] Fast block rotations, zero-copy of ID and fields on series index metadata re-indexing #2423

Merged
merged 39 commits into from
Jul 1, 2020
+2,543 −1,891
Merged

[dbnode] Fast block rotations, zero-copy of ID and fields on series index metadata re-indexing #2423

Show file tree
Hide file tree
Changes from 24 commits
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
9835cb1
WIP [dbnode] Less allocations for block rotations
robskillington Jun 21, 2020
bcbab92
Flow index inserts through CPU local insert queue in batch, avoid sha…
robskillington Jun 21, 2020
660794a
Fix integration tests build
robskillington Jun 21, 2020
0df4663
Fix complicated build
robskillington Jun 21, 2020
ee65fb8
Rename to index_cpu
robskillington Jun 21, 2020
a41d97c
Add metrics for each CPU queue
robskillington Jun 21, 2020
e6ad37e
Use RDTSCP for queue selection
robskillington Jun 21, 2020
0f2d9d4
Do not check if empty
robskillington Jun 21, 2020
50c9dac
Fix metadata creation when inserting into shard results
robskillington Jun 21, 2020
f9a063d
Remove debug sleep
robskillington Jun 21, 2020
0b198d9
Fix tag slice duplicate
robskillington Jun 21, 2020
e0aef83
Fix pending index insert
robskillington Jun 21, 2020
b028037
Only encode tags if set
robskillington Jun 21, 2020
d6d4dc7
Fix rewind
robskillington Jun 22, 2020
487c4e1
Revert to using duplicate for newShardEntry
robskillington Jun 22, 2020
6d73d82
Add reminder about bootstrap path
robskillington Jun 22, 2020
7687c95
Update dashboard
robskillington Jun 22, 2020
030d788
Add closing tag
robskillington Jun 22, 2020
2a7c95a
Gen mocks and fix build for verify_data_files
robskillington Jun 30, 2020
1aa0577
Fix query mock
robskillington Jun 30, 2020
18486cf
Fix persist/fs package
robskillington Jun 30, 2020
8698f18
Fix peers test
robskillington Jun 30, 2020
8e9a2bd
Fix ts/writes package
robskillington Jun 30, 2020
e287b8f
Fix storage tests
robskillington Jun 30, 2020
0affb08
Fix tests.
notbdu Jul 1, 2020
d440940
Address feedback
robskillington Jul 1, 2020
5684a87
Merge branch 'master' into r/wip-avoid-heavy-block-rotations
robskillington Jul 1, 2020
f5e1fae
Fix mock
robskillington Jul 1, 2020
4a6805e
Fix more tests.
notbdu Jul 1, 2020
3d287b0
Fix x/ident tests.
notbdu Jul 1, 2020
c9d670d
Fix TestCommitLogBatchWriteDoesNotAddErroredOrSkippedSeries
robskillington Jul 1, 2020
e7ab552
Fix commit log big tests.
notbdu Jul 1, 2020
876b68e
Fix commit log prop test.
notbdu Jul 1, 2020
fee9fa2
Fix dbnode/storage and dbnode/network/server/tchannelthrift/node
robskillington Jul 1, 2020
36a458c
Merge branch 'r/wip-avoid-heavy-block-rotations' of github.com:m3db/m…
robskillington Jul 1, 2020
fd49a28
Fix convert fn.
notbdu Jul 1, 2020
cd59420
Fix dbnode/storage/index/convert
robskillington Jul 1, 2020
1a61f11
Fix bootstrap fs test.
notbdu Jul 1, 2020
fe4b2f9
Fix nit
robskillington Jul 1, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion go.mod
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ require (
github.com/go-playground/locales v0.12.2-0.20190430153329-630ebbb60284 // indirect
github.com/go-playground/universal-translator v0.16.1-0.20170327191703-71201497bace // indirect
github.com/gogo/protobuf v1.3.1
github.com/golang/mock v1.3.1-0.20190508161146-9fa652df1129
github.com/golang/mock v1.4.3
github.com/golang/protobuf v1.3.3
github.com/golang/snappy v0.0.1
github.com/google/go-cmp v0.4.0
Expand Down
7 changes: 5 additions & 2 deletions go.sum
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -260,8 +260,8 @@ github.com/golang/groupcache v0.0.0-20190702054246-869f871628b6 h1:ZgQEtGgCBiWRM
github.com/golang/groupcache v0.0.0-20190702054246-869f871628b6/go.mod h1:cIg4eruTrX1D+g88fzRXU5OdNfaM+9IcxsU14FzY7Hc=
github.com/golang/mock v1.1.1/go.mod h1:oTYuIxOrZwtPieC+H1uAHpcLFnEyAGVDL/k47Jfbm0A=
github.com/golang/mock v1.2.0/go.mod h1:oTYuIxOrZwtPieC+H1uAHpcLFnEyAGVDL/k47Jfbm0A=
github.com/golang/mock v1.3.1-0.20190508161146-9fa652df1129 h1:tT8iWCYw4uOem71yYA3htfH+LNopJvcqZQshm56G5L4=
github.com/golang/mock v1.3.1-0.20190508161146-9fa652df1129/go.mod h1:sBzyDLLjw3U8JLTeZvSv8jJB+tU5PVekmnlKIyFUx0Y=
github.com/golang/mock v1.4.3 h1:GV+pQPG/EUUbkh47niozDcADz6go/dUwhVzdUQHIVRw=
github.com/golang/mock v1.4.3/go.mod h1:UOMv5ysSaYNkG+OFQykRIcU/QvvxJf3p21QfJ2Bt3cw=
github.com/golang/protobuf v0.0.0-20161109072736-4bd1920723d7/go.mod h1:6lQm79b+lXiMfvg/cZm0SGofjICqVBUtrP5yJMmIC1U=
github.com/golang/protobuf v1.2.0/go.mod h1:6lQm79b+lXiMfvg/cZm0SGofjICqVBUtrP5yJMmIC1U=
github.com/golang/protobuf v1.3.1/go.mod h1:6lQm79b+lXiMfvg/cZm0SGofjICqVBUtrP5yJMmIC1U=
Expand Down Expand Up @@ -904,6 +904,7 @@ golang.org/x/sys v0.0.0-20200124204421-9fbb57f87de9/go.mod h1:h1NjWce9XRLGQEsW7w
golang.org/x/sys v0.0.0-20200302150141-5c8b2ff67527 h1:uYVVQ9WP/Ds2ROhcaGPeIdVq0RIXVLwsHlnvJ+cT1So=
golang.org/x/sys v0.0.0-20200302150141-5c8b2ff67527/go.mod h1:h1NjWce9XRLGQEsW7wpKNCjG9DtNlClVuFLEZdDNbEs=
golang.org/x/text v0.0.0-20160726164857-2910a502d2bf/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=
golang.org/x/text v0.0.0-20170915032832-14c0d48ead0c/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=
golang.org/x/text v0.3.0/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=
golang.org/x/text v0.3.1-0.20180807135948-17ff2d5776d2/go.mod h1:NqM8EUOU14njkJ3fqMW+pc6Ldnwhi/IjpwHt7yyuwOQ=
golang.org/x/text v0.3.2 h1:tW2bmiBqwgJj/UpqtC8EpXEZVYOwU0yG4iWbprSVAcs=
Expand Down Expand Up @@ -1033,6 +1034,8 @@ k8s.io/klog v0.3.0/go.mod h1:Gq+BEi5rUBO/HRz0bTSXDUcqjScdoY3a9IHpCEIOOfk=
k8s.io/klog v1.0.0/go.mod h1:4Bi6QPql/J/LkTDqv7R/cd3hPo4k2DG6Ptcz060Ez5I=
k8s.io/kube-openapi v0.0.0-20191107075043-30be4d16710a/go.mod h1:1TqjTSzOxsLGIKfj0lK8EeCP7K1iUG65v09OM0/WG5E=
k8s.io/utils v0.0.0-20191114184206-e782cd3c129f/go.mod h1:sZAwmy6armz5eXlNoLmJcl4F1QuKu7sr+mFQ0byX7Ew=
rsc.io/quote/v3 v3.1.0/go.mod h1:yEA65RcK8LyAZtP9Kv3t0HmxON59tX3rD+tICJqUlj0=
rsc.io/sampler v1.3.0/go.mod h1:T1hPZKmBbMNahiBKFy5HrXp6adAjACjK9JXDnKaTXpA=
sigs.k8s.io/structured-merge-diff v0.0.0-20190525122527-15d366b2352e/go.mod h1:wWxsB5ozmmv/SG7nM11ayaAW51xMvak/t1r0CSlcokI=
sigs.k8s.io/yaml v1.1.0 h1:4A07+ZFc2wgJwo8YNlQpr1rVlgUDlxXHhPJciaPY5gs=
sigs.k8s.io/yaml v1.1.0/go.mod h1:UJmg0vDUVViEyp3mgSv9WPwZCDxu4rQW1olrI1uml+o=
Expand Down
Loading