add http_server and doc #1321
Merged
add http_server and doc #1321
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Thanks for your contribution! |
Fix Doc bug
zhangjun
reviewed
Aug 4, 2021
| @@ -280,6 +280,7 @@ class PdsCodeGenerator : public CodeGenerator { | |||
| " baidu::rpc::ClosureGuard done_guard(done);\n" | |||
| " baidu::rpc::Controller* cntl = \n" | |||
| " static_cast<baidu::rpc::Controller*>(cntl_base);\n" | |||
| " cntl->set_response_compress_type(brpc::COMPRESS_TYPE_GZIP);\n" | |||
There was a problem hiding this comment.
不会，这是返回值压缩，只有当客户端设置了Accept-Encoding:gzip的时候才会将返回值进行压缩。
doc/HTTP_SERVICE_CN.md
Outdated
Comment on lines
124
to
142
| #### Server端Response压缩 | ||
|
|
||
| 当Http请求头中设置了Accept-encoding: gzip时，Server端会尝试用gzip压缩Response的数据，“尝试“指的是压缩有可能不发生，条件有： | ||
|
|
||
| - 请求中没有设置Accept-encoding: gzip。 | ||
|
|
||
| - body尺寸小于-http_body_compress_threshold指定的字节数，默认是512。gzip并不是一个很快的压缩算法，当body较小时，压缩增加的延时可能比网络传输省下的还多。当包较小时不做压缩可能是个更好的选项。 | ||
|
|
||
| 这时server总是会返回不压缩的结果。 | ||
|
|
||
| 如果使用curl，通常推荐使用--compressed参数来设置Response压缩，--compressed参数会自动地在http请求中设置Accept-encoding: gzip，并在收到压缩后的Response后自动解压，对于用户而言，整个压缩/解压过程就像透明的一样。 | ||
| ```shell | ||
| curl --data-binary @data.txt.gz -H'Content-Encoding: gzip' --compressed -XPOST http://127.0.0.1:9393/GeneralModelService/inference | ||
| ``` | ||
|
|
||
| 若使用-H'Accept-encoding: gzip'，收到的将是压缩后的Response,您需要手动解压。 | ||
| ```shell | ||
| curl --data-binary @data.txt.gz -H'Content-Encoding: gzip' -H'Accept-encoding: gzip' -XPOST http://127.0.0.1:9393/GeneralModelService/inference | gunzip | ||
| ``` |
There was a problem hiding this comment.
当数据量较小时，不建议压缩。
压缩的逻辑，目前已经在HttpClient中支持了，这种curl的方式只是示意并说明原理。
在HttpClient中只需要set_request_compress或者set_response_compress即可
There was a problem hiding this comment.
文档中可能有表述不清的地方，我更新一下。
--compressed = 设置请求头+自动解压。
一般而言，不推荐 单独设置请求头 + 手动解压
示例仅是为了说明原理，加上可以提供，验证。否则用户无法验证你的返回是否真的压缩了。
| from . import serve | ||
| from . import version | ||
|
|
||
| __all__ = ["version", "server", "serve", "monitor", "rpc_service", "dag"] | ||
| __all__ = ["version", "server", "serve", "monitor", "dag"] |
There was a problem hiding this comment.
这个rpc_service是之前的MultiLang，也就是GRPC->（BRPCClient）->BRPC-Server 的方式
目前是各种语言的Http请求->BRPC-Server.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
1、增加Server支持Http Response压缩的代码。
2、增加了Http文档说明。doc/HTTP_SERVICE_CN.md
3、增加了PythonHttpClient（与原有方式基本相同，支持Numpy,多层List,Tuple输入，支持模型加密，Req压缩 Response压缩）
4、增加了JavaHttpClient（与原有方式基本相同，支持Numpy,多层List,以及数组输入，支持模型加密，Req压缩 Response压缩）
5、修改了Proto结构以及相关的代码，使结构更清晰。Request->多个FeedVar(即Tensor)->{Tensor.data Tensor.name等}
6、给出了Python通过Http直接访问C++Server的示例，python/examples/fit_a_line/test_httpclient.py
7、给出了Java通过Http直接访问的示例。java/examples/src/main/java/PaddleServingClientExample.java
8、删除了MultiLangClient相关内容和示例。
9、删除了serve中Flask启动的代码。
其他相关工作：
1、Pipeline中仍有代码依赖于Flask和MultiLang，建议全部更换为Http直接访问。
2、示例中，--name方式启动的已失效，但有的示例是通过import WebService的方式使用Flask，建议全部干掉更换为直接访问。
3、C++封一个Client能够BRPC+HTTP