Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Queue requests from createRemoteFileNode and control concurrency of requests #4616

Merged
merged 12 commits into from
Apr 3, 2018

Commits on Mar 19, 2018

  1. Chunk the requests to download media objects from WP.

    The blog I work on has over 9,000 media objects and currently, it tries
    to download them all. This PR chunks them in groups of 100, but that
    setting can be increased.
    TJ Simons committed Mar 19, 2018
    Configuration menu
    Copy the full SHA
    ac950f1 View commit details
    Browse the repository at this point in the history
  2. Remove prettier forrmatting from the readme

    TJ Simons committed Mar 19, 2018
    Configuration menu
    Copy the full SHA
    638cf43 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2018

  1. Clean up and document create-remote-file-node

    Add Better Queue for more control over processing
    TJ Simons committed Mar 23, 2018
    Configuration menu
    Copy the full SHA
    4c30e8b View commit details
    Browse the repository at this point in the history
  2. Rollback changes to wp source files

    TJ Simons committed Mar 23, 2018
    Configuration menu
    Copy the full SHA
    b8e5fe6 View commit details
    Browse the repository at this point in the history
  3. Add queue for requesting wp objects

    update readme with new config option
    TJ Simons committed Mar 23, 2018
    Configuration menu
    Copy the full SHA
    fd277de View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2018

  1. Revert files to master

    TJ Simons committed Mar 27, 2018
    Configuration menu
    Copy the full SHA
    3a3b569 View commit details
    Browse the repository at this point in the history
  2. No longer throw an exception when an error occurs. Just resolve with

    null and move on
    TJ Simons committed Mar 27, 2018
    Configuration menu
    Copy the full SHA
    b163b89 View commit details
    Browse the repository at this point in the history
  3. Remove file lock lookup for now. 200 concurrent requests is a safe

    number and we can look to change this in the future
    TJ Simons committed Mar 27, 2018
    Configuration menu
    Copy the full SHA
    559fc0f View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2018

  1. Merge branch 'master' of github.com:gatsbyjs/gatsby into topics/wp-me…

    …dia-config
    TJ Simons committed Mar 29, 2018
    Configuration menu
    Copy the full SHA
    95fcf46 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2018

  1. Merge branch 'master' of github.com:gatsbyjs/gatsby into topics/wp-me…

    …dia-config
    TJ Simons committed Apr 2, 2018
    Configuration menu
    Copy the full SHA
    43e061c View commit details
    Browse the repository at this point in the history
  2. Cosmoetic updates

    TJ Simons committed Apr 2, 2018
    Configuration menu
    Copy the full SHA
    be11702 View commit details
    Browse the repository at this point in the history
  3. Remove console.log

    TJ Simons committed Apr 2, 2018
    Configuration menu
    Copy the full SHA
    cc7fa55 View commit details
    Browse the repository at this point in the history