Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-8998][MLlib] Distribute PrefixSpan computation for large projected databases #7783

Closed
wants to merge 30 commits into from
Closed

[SPARK-8998][MLlib] Distribute PrefixSpan computation for large projected databases #7783

wants to merge 30 commits into from

Commits on Jul 7, 2015

  1. Add new algorithm PrefixSpan and test file.

    @zhangjiajin
    zhangjiajin committed Jul 7, 2015
    Configuration menu
    Copy the full SHA
    91fd7e6 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2015

  1. Modified the code according to the review comments.

    @zhangjiajin
    zhangjiajin committed Jul 8, 2015
    Configuration menu
    Copy the full SHA
    575995f View commit details
    Browse the repository at this point in the history

  2. Delete Prefixspan.scala 

    Use PrefixSpan.scala instead of Prefixspan.scala. Delete Prefixspan.scala
    @zhangjiajin
    zhangjiajin committed Jul 8, 2015
    Configuration menu
    Copy the full SHA
    951fd42 View commit details
    Browse the repository at this point in the history

  3. Delete PrefixspanSuite.scala 

    Use PrefixSpanSuite.scala instead of PrefixspanSuite.scala, Delete PrefixspanSuite.scala.
    @zhangjiajin
    zhangjiajin committed Jul 8, 2015
    Configuration menu
    Copy the full SHA
    a2eb14c View commit details
    Browse the repository at this point in the history

  4. Fixed a Scala style error.

    @zhangjiajin
    zhangjiajin committed Jul 8, 2015
    Configuration menu
    Copy the full SHA
    89bc368 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2015

  1. Modified the code according to the review comments.

    @zhangjiajin
    zhangjiajin committed Jul 9, 2015
    Configuration menu
    Copy the full SHA
    1dd33ad View commit details
    Browse the repository at this point in the history

  2. Fix some Scala style errors.

    @zhangjiajin
    zhangjiajin committed Jul 9, 2015
    Configuration menu
    Copy the full SHA
    4c60fb3 View commit details
    Browse the repository at this point in the history

  3. Fix a Scala style error.

    @zhangjiajin
    zhangjiajin committed Jul 9, 2015
    Configuration menu
    Copy the full SHA
    ba5df34 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2015

  1. Add new object LocalPrefixSpan, and do some optimization.

    @zhangjiajin
    zhangjiajin committed Jul 10, 2015
    Configuration menu
    Copy the full SHA
    574e56c View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2015

  1. Modified the code according to the review comments.

    @zhangjiajin
    zhangjiajin committed Jul 11, 2015
    Configuration menu
    Copy the full SHA
    ca9c4c8 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2015

  1. Add feature: Collect enough frequent prefixes before projection in Pr… 

    …efixSpan.
    @zhangjiajin
    zhangjiajin committed Jul 14, 2015
    Configuration menu
    Copy the full SHA
    22b0ef4 View commit details
    Browse the repository at this point in the history

  2. fix a scala style error.

    @zhangjiajin
    zhangjiajin committed Jul 14, 2015
    Configuration menu
    Copy the full SHA
    078d410 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2015

  1. initialize file before rebase.

    @zhangjiajin
    zhangjiajin committed Jul 15, 2015
    Configuration menu
    Copy the full SHA
    4dd1c8a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/apache/spark 

    Initilize local master branch.
    @zhangjiajin
    zhangjiajin committed Jul 15, 2015
    Configuration menu
    Copy the full SHA
    a8fde87 View commit details
    Browse the repository at this point in the history

  3. Add feature: Collect enough frequent prefixes before projection in Pr… 

    …efixeSpan
    @zhangjiajin
    zhangjiajin committed Jul 15, 2015
    Configuration menu
    Copy the full SHA
    6560c69 View commit details
    Browse the repository at this point in the history

  4. Modified the code according to the review comments.

    @zhangjiajin
    zhangjiajin committed Jul 15, 2015
    Configuration menu
    Copy the full SHA
    baa2885 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2015

  1. Modified the code according to the review comments.

    @zhangjiajin
    zhangjiajin committed Jul 16, 2015
    Configuration menu
    Copy the full SHA
    095aa3a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/apache/spark into Collect… 

    …EnoughPrefixes
    @zhangjiajin
    zhangjiajin committed Jul 16, 2015
    Configuration menu
    Copy the full SHA
    b07e20c View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2015

  1. remove minPatternsBeforeLocalProcessing, add maxSuffixesBeforeLocalPr… 

    …ocessing.
    @zhangjiajin
    zhangjiajin committed Jul 18, 2015
    Configuration menu
    Copy the full SHA
    d2250b7 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2015

  1. Modified codes according to comments.

    @zhangjiajin
    zhangjiajin committed Jul 27, 2015
    Configuration menu
    Copy the full SHA
    64271b3 View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2015

  1. Fix splitPrefixSuffixPairs

    Feynman Liang committed Jul 28, 2015
    Configuration menu
    Copy the full SHA
    6e149fa View commit details
    Browse the repository at this point in the history

  2. Add getters

    Feynman Liang committed Jul 28, 2015
    Configuration menu
    Copy the full SHA
    01c9ae9 View commit details
    Browse the repository at this point in the history

  3. Inline code for readability

    Feynman Liang committed Jul 28, 2015
    Configuration menu
    Copy the full SHA
    cb2a4fc View commit details
    Browse the repository at this point in the history

  4. Use lists for prefixes to reuse data

    Feynman Liang committed Jul 28, 2015
    Configuration menu
    Copy the full SHA
    da0091b View commit details
    Browse the repository at this point in the history

  5. Use Iterable[Array[_]] over Array[Array[_]] for database

    Feynman Liang committed Jul 28, 2015
    Configuration menu
    Copy the full SHA
    1235cfc View commit details
    Browse the repository at this point in the history

  6. Readability improvements and comments

    Feynman Liang committed Jul 28, 2015
    Configuration menu
    Copy the full SHA
    c2caa5c View commit details
    Browse the repository at this point in the history

  7. Improve extend prefix readability

    Feynman Liang committed Jul 28, 2015
    Configuration menu
    Copy the full SHA
    87fa021 View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2015

  1. Merge pull request #1 from feynmanliang/SPARK-8998-collectBeforeLocal 

    [Spark-8998]Collect Enough Prefixes Improvements
    @zhangjiajin
    zhangjiajin committed Jul 29, 2015
    Configuration menu
    Copy the full SHA
    ad23aa9 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2015

  1. Parallelize freqItemCounts

    Feynman Liang committed Jul 30, 2015
    Configuration menu
    Copy the full SHA
    4ddf479 View commit details
    Browse the repository at this point in the history

  2. Collect small patterns to local

    Feynman Liang committed Jul 30, 2015
    Configuration menu
    Copy the full SHA
    a61943d View commit details
    Browse the repository at this point in the history