Skip to content
This repository has been archived by the owner on Oct 9, 2023. It is now read-only.

Refactor rate limiter for read/write requests #76

Merged
merged 4 commits into from
Apr 6, 2020
Merged

Conversation

lu4nm3
Copy link
Contributor

@lu4nm3 lu4nm3 commented Apr 4, 2020

TL;DR

This is to split the rate limiter for read and write requests. This PR only includes configuration changes. Actual usage of the rate limiters themselves will reside in the Presto client itself.

Also included the change to use the GetRawOutputPrefix from the OutputWriter for the location where the external table gets saved so as it's pretty much a one-liner.

Type

  • Bug Fix
  • Feature
  • Plugin

Are all requirements met?

  • Code completed
  • Smoke tested
  • Unit tests added
  • Code documentation added
  • Any pending items have an associated Issue

Tracking Issue

flyteorg/flyte#240

@lu4nm3 lu4nm3 requested a review from wild-endeavor April 5, 2020 02:12
wild-endeavor
wild-endeavor previously approved these changes Apr 6, 2020
wild-endeavor
wild-endeavor previously approved these changes Apr 6, 2020
@lu4nm3 lu4nm3 merged commit 8aba473 into master Apr 6, 2020
eapolinario pushed a commit that referenced this pull request Sep 6, 2023
* Refactor rate limiter for read/write requests

* update config comment

* update config comment and external path

* remove unused function
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants