New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ability to merge ranges and create a larger token range to reduce number of tasks #141

Open

parekuti opened this issue Feb 22, 2017 · 0 comments

Assignees

Labels

Contributor

parekuti commented Feb 22, 2017

FiloDB is very good at parallelism and performance, but if someone wants to increase concurrency they should have options to control number of tasks.

Please refer to the link for spark connector code on how to control the number of tasks getting created during full table scan.

https://github.com/datastax/spark-cassandra-connector/blob/master/spark-cassandra-connector/src/main/scala/com/datastax/spark/connector/rdd/partitioner/CassandraPartitionGenerator.scala

velvia self-assigned this

velvia added the enhancement label

velvia pushed a commit that referenced this issue


          Added dynamic client id with namespace + shard (#141)

0ed3a31

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment