Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

yapapi is not picking up offers from market sometimes #304

Closed
azawlocki opened this issue Mar 30, 2021 · 4 comments · Fixed by #306
Closed

yapapi is not picking up offers from market sometimes #304

azawlocki opened this issue Mar 30, 2021 · 4 comments · Fixed by #306
Assignees
@azawlocki @filipgolem
Labels
beta.1.patch.3

Comments

@azawlocki
Copy link
Contributor

azawlocki commented Mar 30, 2021 •
edited
Loading

Currently market operations (collecting offers, scoring them, rejecting / countering) are performed sequentially by a single asyncio task find_offers(). It turns out that some market API calls can take well over a minute to complete (confirmed for RejectProposalOffer and CounterProposalDemand with yagna-0.6.3 with > 100 proposals on public-beta / mainnet).

yapapi should not wait for such long-running calls to return before processing next offers.

Alternatively, we could just set a request timeout for (some) market operations to 5 s, as in yajsapi, this could be the best solution.
@azawlocki
Copy link
Contributor Author

Example log snippet ending with a call to CounterProposalDemand:

[2021-03-30 09:15:20,497 INFO yapapi.rest.market] Got proposal R-c2d031efb715f39ffcfcb08ce47ea5f4f29dacd3142a6a288c27
c948f6dfdf75 from market
[2021-03-30 09:15:20,497 DEBUG yapapi.executor.strategy.LeastExpensiveLinearPayuMS] Scoring offer R-c2d031efb715f39ff
cfcb08ce47ea5f4f29dacd3142a6a288c27c948f6dfdf75, parameters: ComLinear(scheme=<BillingScheme.PAYU: 'payu'>, price_mod
el=<PriceModel.LINEAR: 'linear'>, fixed_price=0.0, price_for={<Counter.TIME: 'golem.usage.duration_sec'>: 4.166666666
6666665e-05, <Counter.CPU: 'golem.usage.cpu_sec'>: 0.0001388888888888889})
[2021-03-30 09:15:20,498 DEBUG yapapi.executor] Scored offer R-c2d031efb715f39ffcfcb08ce47ea5f4f29dacd3142a6a288c27c948f6dfdf75, provider: cheLAOPT01, strategy: DecreaseScoreForUnconfirmedAgreement, score: 97.959184
...
[2021-03-30 09:15:20,503 DEBUG ya_market.rest] request: {'method': 'POST', 'url': 'http://127.0.0.1:7465/market-api/v1/demands/0685fa46be3a4bfab56bb743a2f839ea-dfa13c42423a7c70910e9d955f19ace71bd490aa96a74d5189e5ea5cb4b39971/proposals/R-c2d031efb715f39ffcfcb08ce47ea5f4f29dacd3142a6a288c27c948f6dfdf75', 'timeout': 300, 'headers': {'Accept': 'application/json', 'Content-Type': 'application/json', 'authorization': 'Bearer ed037956f1f74613b6f658875142fd2f', 'User-Agent': 'OpenAPI-Generator//python'}, 'data': '{"properties": {"golem.srv.comp.expiration": 1617089418804, "golem.srv.caps.multi-activity": true, "golem.node.debug.subnet": "public-beta", "golem.com.payment.platform.zksync-mainnet-glm.address": "0xb929ac45b74e182b287d9ce1142e5bda76d1a3d0", "golem.srv.comp.task_package": "hash:sha3:9a3b5d67b0b27746283cb5f287c13eab1beaa12d92a9f536b747c7ae:http://yacn2.dev.golem.network:8000/local-image-c76719083b.gvmi\\n", "golem.srv.comp.vm.package_format": "gvmkit-squash", "golem.com.payment.chosen-platform": "zksync-mainnet-glm", "golem.com.payment.debit-notes.accept-timeout?": 240}, "constraints": "(&(golem.node.debug.subnet=public-beta)\\n\\t(golem.com.payment.platform.zksync-mainnet-glm.address=*)\\n\\t(&(golem.inf.mem.gib>=0.5)\\n\\t(golem.inf.storage.gib>=2.0)\\n\\t(golem.runtime.name=vm))\\n\\t(golem.com.pricing.model=linear))"}'}

to which yagna responds after 124 seconds:

[2021-03-30T07:17:24Z INFO  ya_market::negotiation::requestor] Requestor 'test-mainnet' [0xb929ac45b74e182b287d9ce1142e5bda76d1a3d0] countered Proposal [R-c2d031efb715f39ffcfcb08ce47ea5f4f29dacd3142a6a288c27c948f6dfdf75] with [R-78439a8dbc1f98b3e0302aceaaac4aa3ca2f0682db138670ff87e1c65e8c7a7f]
[2021-03-30T07:17:24Z INFO  actix_web::middleware::logger] 127.0.0.1:38098 "POST /market-api/v1/demands/0685fa46be3a4bfab56bb743a2f839ea-dfa13c42423a7c70910e9d955f19ace71bd490aa96a74d5189e5ea5cb4b39971/proposals/R-c2d031efb715f39ffcfcb08ce47ea5f4f29dacd3142a6a288c27c948f6dfdf75 HTTP/1.1" 200 68 "-" "OpenAPI-Generator//python" 124.127256

@azawlocki azawlocki changed the title Make market operations more concurrent Make market operationsconcurrent Mar 30, 2021
@azawlocki azawlocki changed the title Make market operationsconcurrent Make market operations concurrent Mar 30, 2021
@azawlocki
Copy link
Contributor Author

azawlocki commented Mar 30, 2021 •
edited
Loading

Timings for CounterProposalDemand and a corresponding yagna log:

[2021-03-30 09:15:20,092 INFO yapapi.executor] RESPONDED TO R-5071fbec45a7d4a58f49e6266cea9123557d67772e96da62fd6ba194693d6ef8 IN 0.3
[2021-03-30 09:15:20,093 INFO yapapi.executor] RESPONDED TO R-5c037ec3784e73c98372374b15d85676ed9cd028e5e3ee16026f5722af8c3e4f IN 0.2
[2021-03-30 09:15:20,094 INFO yapapi.executor] RESPONDED TO R-dc1de5dffd23a7fc209b06a017cd28d76d8e913a88668481f9a920d0d3f45298 IN 0.3
[2021-03-30 09:15:20,094 INFO yapapi.executor] RESPONDED TO R-a88b6021f3ba31653e934ef14d1c26899ea97bc0cd5c421a5c39c2f3c9436191 IN 0.2
[2021-03-30 09:15:20,094 INFO yapapi.executor] RESPONDED TO R-b7af95c9c71de0d4b93d5ec3788dbab427c0e86e622b1e325639b0459a2c9356 IN 0.2
[2021-03-30 09:15:20,094 INFO yapapi.executor] RESPONDED TO R-cae171a9ef68b34a5e6cf8c50768b4407821a245d49dcf2a4b12044ce8879f5f IN 0.2
[2021-03-30 09:15:20,111 INFO yapapi.executor] RESPONDED TO R-9d9c85c0f3f5c1307a55fb06e933070f887a8cdea760b5e786a908f160f29bd3 IN 0.2
[2021-03-30 09:15:20,111 INFO yapapi.executor] RESPONDED TO R-5eebeaa2c3c80df366bc95fc70efb8b8798e0bcedd98ce5fb71c840bb64ff129 IN 0.2
[2021-03-30 09:15:20,112 INFO yapapi.executor] RESPONDED TO R-ca2af1bfc8c7f89533259aca58cfd872c777402f2eb2c3f55d82af7f0f338599 IN 0.2
[2021-03-30 09:15:20,112 INFO yapapi.executor] RESPONDED TO R-5a707269b29245651e1fa7e714d7abafbdaa2cba3985ca0f57cde3c23d2f7103 IN 0.2
[2021-03-30 09:15:20,139 INFO yapapi.executor] RESPONDED TO R-b51af3507f848e53a1a3f63c2ae6b9782447e984b6f181c249859ff9e0d22cec IN 0.3
[2021-03-30 09:15:20,206 INFO yapapi.executor] RESPONDED TO R-c4f328fff80ce0963dc2c6b605e56b6fd4f376015664cff884b0a142c34f5b67 IN 0.3
[2021-03-30 09:15:20,209 INFO yapapi.executor] RESPONDED TO R-4c36a1f418b3a71d7c5eb8308afdcb9ddc41cf1daa93194362dbc207e568007e IN 0.3
[2021-03-30 09:15:20,252 INFO yapapi.executor] RESPONDED TO R-a4bbd8ebe69cc54e16e86e021317fe421e7aa847d2b961440ff19f47e7d4b2c2 IN 0.4
[2021-03-30 09:15:20,253 INFO yapapi.executor] RESPONDED TO R-d31701205c9add560c167fea12c85369f56dc66a1744932e2fe284971cc40159 IN 0.3
[2021-03-30 09:15:20,280 INFO yapapi.executor] RESPONDED TO R-ed6bed05cd13305ac20e3d8874d471c0f6bf0b40c9e53e3eea11917211807415 IN 0.4
[2021-03-30 09:15:20,280 INFO yapapi.executor] RESPONDED TO R-e84f30a3275d24b33183ddebf518c4cd132ef5bff3d20316e958afdeda18147e IN 0.4
[2021-03-30 09:15:20,283 INFO yapapi.executor] RESPONDED TO R-940675d40259909da36ae206702cb916e243542c96463883590ac24fa6c11f91 IN 0.4
[2021-03-30 09:15:20,285 INFO yapapi.executor] RESPONDED TO R-4e8918a56220f7e84e5dcbf43115990e92a9af84f7eb81b01dc1cb1abd779a08 IN 0.4
[2021-03-30 09:15:20,286 INFO yapapi.executor] RESPONDED TO R-b26b761649317ca48796ce31c110e5c8f6848de2fbe6e28db4b73df254d8b140 IN 0.4
[2021-03-30 09:15:20,286 INFO yapapi.executor] RESPONDED TO R-20aad48c78f046abf1fbe5c342b7162a819f882bc832745b0f439c4b465fb7d9 IN 0.4
[2021-03-30 09:15:20,287 INFO yapapi.executor] RESPONDED TO R-57d5682b03ec906b095ba1bc0ef4335ea70d2db96209902eaebad75f26292b92 IN 0.4
[2021-03-30 09:15:20,289 INFO yapapi.executor] RESPONDED TO R-9cba95fdabd7d4fa5b4da62f98d2766956fa6106267c16a28632ef40f39fac9c IN 0.4
[2021-03-30 09:15:20,290 INFO yapapi.executor] RESPONDED TO R-9024ef8c7c2e02429ecef87c36492a5cb0ab18532a2ceb25b844b5569d708467 IN 0.4
[2021-03-30 09:15:20,291 INFO yapapi.executor] RESPONDED TO R-c7b335c991167c520b8ff28a34e795428d4a17755ff4bc0bb7bb174341c9ed55 IN 0.4
[2021-03-30 09:15:20,357 INFO yapapi.executor] RESPONDED TO R-02b1d4aa9d7c7d6f823553f73e35167d05270a7ef0fb33e0f42157a9c8909541 IN 0.5
[2021-03-30 09:15:20,358 INFO yapapi.executor] RESPONDED TO R-2bc0499a73d903965e2304e29f1a478c70418b18feac1d4d0ed92264f8efb95f IN 0.4
[2021-03-30 09:15:20,444 INFO yapapi.executor] RESPONDED TO R-89f8bccf0bf0fdefbe941771713727489c4441ad398a4c603bf6abab7b187f33 IN 0.5
[2021-03-30 09:15:20,455 INFO yapapi.executor] RESPONDED TO R-887cfa471937838227093f06245e4fe57e767624527bcff6b193a8988cc337eb IN 0.6
[2021-03-30 09:15:20,457 INFO yapapi.executor] RESPONDED TO R-6a5eabf4566d4560ba91686ed6007bdb890e8ea5da0402e37fa41c02ee5a175b IN 0.5
[2021-03-30 09:15:20,458 INFO yapapi.executor] RESPONDED TO R-9e43b4eeae746b4d67e6292ce941492f463c953b9661d8b9784b5f8236a75010 IN 0.5
[2021-03-30 09:15:20,459 INFO yapapi.executor] RESPONDED TO R-5457ae8b1862b97ff8d4498fb0a302d282354da81512040dc67456acb28e5202 IN 0.5
[2021-03-30 09:15:20,460 INFO yapapi.executor] RESPONDED TO R-6c77bb22db808f825b112ccc9132dc7220529368e91a8815933fabf3b2d90ff8 IN 0.5
[2021-03-30 09:15:20,462 INFO yapapi.executor] RESPONDED TO R-c179035a8381f0f28215d9a0b714bdc1c60ffd131a6a3825c3c80e76c7d1d857 IN 0.5
[2021-03-30 09:15:20,475 INFO yapapi.executor] RESPONDED TO R-8eb8c222d192c5eb0e6d8472cd28221017976c6ee7599840dc83360640a9c9df IN 0.5
[2021-03-30 09:15:20,476 INFO yapapi.executor] RESPONDED TO R-976f4d8732c4049c5956abb15c78dcce186be0b02d844f5f25eaba90933f8ef7 IN 0.5
[2021-03-30 09:15:20,507 INFO yapapi.executor] RESPONDED TO R-f1dea7d9a0d860caa71f74c0bf4c0ccea59ccc75b6366b7dd7b7888c2b02c2c4 IN 0.5
[2021-03-30 09:15:20,507 INFO yapapi.executor] RESPONDED TO R-6019d489aa3e312d781e2eb1fc16da47ea232cb297d3559742d849de306b6ab1 IN 0.5
[2021-03-30 09:15:20,508 INFO yapapi.executor] RESPONDED TO R-26b00090da4d702f76ef286c61b251fb8617091d0bdc27b58affbbfefe70c1e8 IN 0.5
[2021-03-30 09:15:20,508 INFO yapapi.executor] RESPONDED TO R-b431287a8ed21b4a20cf52f07a6ea7222d3e93e9740e0fe5c0215fadf885ac38 IN 0.6
[2021-03-30 09:15:20,509 INFO yapapi.executor] RESPONDED TO R-06cfdfaec01ffcfe12fbe6d3df30ea4e956264b208cc3ba1be4f2bf756c6cd41 IN 0.5
[2021-03-30 09:15:20,514 INFO yapapi.executor] RESPONDED TO R-daa9a6be96cbd199490038b1e97e30589cfc892d6d80f18587767fcec980be42 IN 0.5
[2021-03-30 09:15:20,514 INFO yapapi.executor] RESPONDED TO R-2961f29183a07787b1e8d40d3d269bc439b865e3c8aa4f26b17e889085b11414 IN 0.6
[2021-03-30 09:15:20,515 INFO yapapi.executor] RESPONDED TO R-8c0e3a53199da9e198f942ab8fb62b3c572d77c0c2be20e314e60c050c8224c4 IN 0.5
[2021-03-30 09:15:20,515 INFO yapapi.executor] RESPONDED TO R-51c992c9bd99a4ae2db54544638f0519676c08fcca43629dc2c50850ddb1b956 IN 0.5
[2021-03-30 09:15:20,515 INFO yapapi.executor] RESPONDED TO R-e60a36a9adf13b5197e4700fbde82ba5381fc51ebf98d1e27ad8439dae206c31 IN 0.5
[2021-03-30 09:15:20,515 INFO yapapi.executor] RESPONDED TO R-59a852f750f401ba51228f9e7e056a9e34939919091e7b7165589c66c57ea418 IN 0.5
[2021-03-30 09:15:20,516 INFO yapapi.executor] RESPONDED TO R-b8a8fc2de13843e7361cb59c9b092bc32b001d24c07f4b7b3758d93e3c15ec64 IN 0.5
[2021-03-30 09:15:20,516 INFO yapapi.executor] RESPONDED TO R-6f7eb1c26319fc221e1dc71f05fe8b71d49567a1e2c9db19ec189a7ed762b06d IN 0.6
[2021-03-30 09:15:20,516 INFO yapapi.executor] RESPONDED TO R-9dce938f1ef89a7eb2e1226e7828a0181f42e1ba00940ff8569a46c08ed0c97e IN 0.6
[2021-03-30 09:15:20,517 INFO yapapi.executor] RESPONDED TO R-2af1a84a071f08ea6025db33e3ed359aa7337daa44d71a65907d902dd69d5617 IN 0.6
[2021-03-30 09:15:20,517 INFO yapapi.executor] RESPONDED TO R-ab08e0122f1070135340918af3a995106baa3838120e1282e5b77f8532097e66 IN 0.5
[2021-03-30 09:15:20,517 INFO yapapi.executor] RESPONDED TO R-3b26a72c558a178e1cae253fa98b78a7c99677562f6cca28a3d7d8bf0e116104 IN 0.5
[2021-03-30 09:15:20,517 INFO yapapi.executor] RESPONDED TO R-d2d0c10cf305abdc43fd59f6efcc3fa7b50c2b3c09b69e743ff2ec3626fe5c1b IN 0.5
[2021-03-30 09:15:20,518 INFO yapapi.executor] RESPONDED TO R-ef6d4c2fb7991b9e9ff109c6e77606fa6db28022785e769cab2a85796c602a4c IN 0.6
[2021-03-30 09:15:20,580 INFO yapapi.executor] RESPONDED TO R-4f653dd0723d0dbb5b9cf9c7cc5523895a157011089d1b7a50a55159dc499826 IN 0.6
[2021-03-30 09:15:20,580 INFO yapapi.executor] RESPONDED TO R-822aba781184130a270878fb3bf431ee822cf76909852e1a60a0b68b033abafd IN 0.6
[2021-03-30 09:15:20,581 INFO yapapi.executor] RESPONDED TO R-413efaee23b764131e40b9e7a9dd026ad6df37870be92e9cfd3726616d97ce89 IN 0.6
[2021-03-30 09:15:20,581 INFO yapapi.executor] RESPONDED TO R-bef2998a4bbfc4c085cb9a72a626400d777a43bf3e019940fb44c47d27f1a315 IN 0.5
[2021-03-30 09:15:20,581 INFO yapapi.executor] RESPONDED TO R-7b96aaf48807490186360f7e73c7e1d7a12d6f645373b809b9ae427d666cceea IN 0.6
[2021-03-30 09:15:20,582 INFO yapapi.executor] RESPONDED TO R-e014f5bdb95be541234af52ca155ff3091073933120d207895f7569aac5ecbc3 IN 0.6
[2021-03-30 09:15:20,582 INFO yapapi.executor] RESPONDED TO R-8338b56c7d696c985547ae2c482a0851234012bfac31262712dd4c609dcd8a35 IN 0.5
[2021-03-30 09:15:20,583 INFO yapapi.executor] RESPONDED TO R-ba3c056cebd5c185dc1186cd5aab6ba5c2749d41aafbb1e0b2dcd3300e6c513e IN 0.5
[2021-03-30 09:15:20,583 INFO yapapi.executor] RESPONDED TO R-a33c075df1e343c6603084baeebf567fe1bf94a4261cafbff4e4e32eadad8971 IN 0.6
[2021-03-30 09:15:20,583 INFO yapapi.executor] RESPONDED TO R-05b04106e596ddefdd6d2f1e82931bcd71a816caebc80447e0b61c27ff3e484b IN 0.7
[2021-03-30 09:15:20,600 INFO yapapi.executor] RESPONDED TO R-b221384386b135c8ecbf2453b39885ca18e71fb12a44dd55e8e7acd2227572a4 IN 0.6
[2021-03-30 09:15:20,600 INFO yapapi.executor] RESPONDED TO R-25183cf4ea93344124da9eba33a2f41836b3ba45d9e9b6f786956279fe0a2dd6 IN 0.5
[2021-03-30 09:15:20,601 INFO yapapi.executor] RESPONDED TO R-4178ba04eda0d8175c492eb048fc43f3683ba2faf66b17c35d267c8446d0ea7a IN 0.6
[2021-03-30 09:15:20,610 INFO yapapi.executor] RESPONDED TO R-fd52f4eff1e41c324d3b635c1dc03d806d43121ae11347318a8c177bab00aaf7 IN 0.6
[2021-03-30 09:15:20,617 INFO yapapi.executor] RESPONDED TO R-1abe1155b57ee52e5e4824983734e7b0875a482209a549f634876c33b488c090 IN 0.7
[2021-03-30 09:15:20,617 INFO yapapi.executor] RESPONDED TO R-d563d7a735653f4ac307d2738dba9baed4179b85bc8afcbd4b3402d6f53e5d30 IN 0.6
[2021-03-30 09:15:20,618 INFO yapapi.executor] RESPONDED TO R-018611bd3098c3e85256ae91f1af03f259058cd27e282329ba1231b3f49245ac IN 0.6
[2021-03-30 09:15:20,618 INFO yapapi.executor] RESPONDED TO R-70f318bfb7e81ada8a60af31655486a217a78f6e0f26de4fa5b17112dcede23c IN 0.6
[2021-03-30 09:15:20,618 INFO yapapi.executor] RESPONDED TO R-b15d3cb268ce4d127e30b17e2befbb8aff172f89426514c6e0bc2c5c311f908c IN 0.6
[2021-03-30 09:15:20,619 INFO yapapi.executor] RESPONDED TO R-f578c2f37a9ee90f536d075bf356c0106ec5459942896a4570ef960c556ad048 IN 0.7
[2021-03-30 09:15:20,619 INFO yapapi.executor] RESPONDED TO R-ff6eea99127c8785918207b43010822d99479994544abfdae3709156b88a61f1 IN 0.7
[2021-03-30 09:15:20,619 INFO yapapi.executor] RESPONDED TO R-6cb4e51f9f738871cbeaaa60cce3d42549d301e4a45ffdcdd702e5b6eb456424 IN 0.6
[2021-03-30 09:15:20,620 INFO yapapi.executor] RESPONDED TO R-964223fff99d581982d895c782f1cb38ca11777ef397d2df88009dfcacb9ac69 IN 0.7
[2021-03-30 09:15:20,620 INFO yapapi.executor] RESPONDED TO R-88290d0ba8c520eb2b2ef8cd7e83db7615606ced19858ce50ceb5bf9a74ea425 IN 0.6
[2021-03-30 09:15:20,649 INFO yapapi.executor] RESPONDED TO R-a5df7219745b0a815c4a85f122bcd33a6735c7d8074e89d110d1e83b7ead3b4e IN 0.6
[2021-03-30 09:15:20,650 INFO yapapi.executor] RESPONDED TO R-e8caa297ea69c6e3477b319336e12a0a6a29e9e9907332afbc41bbcc2eb0930a IN 0.7
[2021-03-30 09:15:20,650 INFO yapapi.executor] RESPONDED TO R-7797fe085e596d5903dc0b4079182e8e4de2797759cb006071c26347098b7d52 IN 0.4
[2021-03-30 09:15:20,650 INFO yapapi.executor] RESPONDED TO R-3e892a09f5d553f0fb3c2acaab526b6ad6c93b48934b165937eb2a8d2bf3da79 IN 0.7
[2021-03-30 09:15:20,659 INFO yapapi.executor] RESPONDED TO R-b9bad98ed694e0cc6bbbdc787ce44fa95e6a0aab24f3553d4c76636090b8e085 IN 0.7
[2021-03-30 09:15:20,660 INFO yapapi.executor] RESPONDED TO R-f7da05398f56ec694344b0555a0d6c07e3f8b7782e8e08dd3a0c0fc58669ceb8 IN 0.7
[2021-03-30 09:15:20,660 INFO yapapi.executor] RESPONDED TO R-83fae22a1e7aea2eb97a978d5d4c77d3c24e4f5ee2293557cd4724361417e758 IN 0.6
[2021-03-30 09:15:20,660 INFO yapapi.executor] RESPONDED TO R-e688571e36d64058c240ec5f8a4b1b16de9ab1508f22eea8201107fb4f0731f1 IN 0.6
[2021-03-30 09:15:20,665 INFO yapapi.executor] RESPONDED TO R-1176163f0a3953c772a45bf92d69bb653fee9bc398efa698cb67a33b0c7a9a87 IN 0.6
[2021-03-30 09:15:20,707 INFO yapapi.executor] RESPONDED TO R-0263ce4c8bd8fdd23ee4ef6b6fe47cc9d5bced6ae6f7f348dfa88e83445f1206 IN 0.9
[2021-03-30 09:15:20,709 INFO yapapi.executor] RESPONDED TO R-a888c10a04343faf9d9d48f61a72d9e455fb47b8c8f495d5c7f9d82313547357 IN 0.2
[2021-03-30 09:15:20,711 INFO yapapi.executor] RESPONDED TO R-ac15a64813d69e638603ca4465e55ee1dfe0912ffe40129ea4c4a895133dcc33 IN 0.7
[2021-03-30 09:15:20,712 INFO yapapi.executor] RESPONDED TO R-ab754dfb34076ed58c26278375aac81da1284c470fcba86da273157c5f251c62 IN 0.8
[2021-03-30 09:15:20,715 INFO yapapi.executor] RESPONDED TO R-268116dfb4d5d3140e19762ac86080f7f20d5354e08415126f432bfe2f999f8c IN 0.7
[2021-03-30 09:15:20,733 INFO yapapi.executor] RESPONDED TO R-7b76787b282d2320bc355af1dda8af0e87841ca04e09fd5b94465052d07adc94 IN 0.6
[2021-03-30 09:15:20,733 INFO yapapi.executor] RESPONDED TO R-10782f4311d68b44b5b87e7353ef478a3ebbeb5d4dddd5279048da4914b71e9d IN 0.7
[2021-03-30 09:15:20,734 INFO yapapi.executor] RESPONDED TO R-61ab82fecb1500f3d2368ad89579729ddde3b8a50cf94f7f1007f76728cfbe8e IN 0.7
[2021-03-30 09:15:20,734 INFO yapapi.executor] RESPONDED TO R-bcb904aaa45e07c8c4cc7516f297ef83be196d3a7503a4d77a351fde082fe3ab IN 0.2
[2021-03-30 09:15:20,735 INFO yapapi.executor] RESPONDED TO R-e71670d5616d75ff4b13d4289495fb2e433efa1e19019f1e37ff0023f94af4e6 IN 0.8
[2021-03-30 09:15:20,735 INFO yapapi.executor] RESPONDED TO R-b921c61b28531e5dc2c2d042a3ef58c7b3fa5f4935f9d165a7c78c553db20787 IN 0.8
[2021-03-30 09:15:20,736 INFO yapapi.executor] RESPONDED TO R-f1ef94a785efc0694baea72bd0790cf30b76a57c04acd0eca784da684107cb8e IN 0.2
[2021-03-30 09:15:20,773 INFO yapapi.executor] RESPONDED TO R-954ac86bdf1bf54990426863b558620f5dbdfad8238bbbce31884f4ee82337a7 IN 0.2
[2021-03-30 09:15:20,774 INFO yapapi.executor] RESPONDED TO R-d5c79a5d8f6c4dcc6e717162ec3314e4bf98edbf84f767fa01df8fecee648922 IN 0.2
[2021-03-30 09:15:20,775 INFO yapapi.executor] RESPONDED TO R-2a3e3c60851b43d245da7e59c0ab72d12b13056bfa0ec722efcb81b7d7a55b63 IN 0.9
[2021-03-30 09:15:20,775 INFO yapapi.executor] RESPONDED TO R-381e848d06e7e8273ed54c96e9b91e68e215aa069e77d29f0491eebc7f919637 IN 0.3
[2021-03-30 09:15:20,793 INFO yapapi.executor] RESPONDED TO R-fc022eaca676eec11d8e427770649ebd65cc4578c74b881a69b55b08edc9fb16 IN 0.2
[2021-03-30 09:15:20,794 INFO yapapi.executor] RESPONDED TO R-007549c150bdd8aa4c1df56e5805e0b5a643fde55d0a82ef4a5a30793eaf8076 IN 0.2
[2021-03-30 09:15:20,795 INFO yapapi.executor] RESPONDED TO R-3772ebdc0da0503387a25320b12e31622f8c4102c3f45fb66121b36739e55740 IN 0.2
[2021-03-30 09:15:20,795 INFO yapapi.executor] RESPONDED TO R-cff74b9fe328d1ba7a79350595dc39304505225bb4536fcd49179d39b1931c2f IN 0.3
[2021-03-30 09:15:20,796 INFO yapapi.executor] RESPONDED TO R-b0dfcf6edabb2cd4aff172b8aafd746c191361edba049e608606a6bf4478cb00 IN 0.2
[2021-03-30 09:15:20,796 INFO yapapi.executor] RESPONDED TO R-d6afd2f0d39fe9c1fe78dd113a5c5831b1a0adb1d9f69423cc1b2efb6b84160c IN 0.2
[2021-03-30 09:15:20,797 INFO yapapi.executor] RESPONDED TO R-40745f9bd67c16c92275c799e201dd9c6f14032f5bbc74e2c232cd65825466ae IN 0.2
[2021-03-30 09:15:20,797 INFO yapapi.executor] RESPONDED TO R-62b0c1ea3031ab2ee9ce0252b57327423a01d62eaab312ce81307f80c1b7bf69 IN 0.2
[2021-03-30 09:15:20,797 INFO yapapi.executor] RESPONDED TO R-0cacc6a77d1501147129c2d18c32fc420b2056618f9ac70dc1eaf5b3c528594b IN 0.2
[2021-03-30 09:15:20,797 INFO yapapi.executor] RESPONDED TO R-30fc44a693e6576753cd19aa2e23099a1698e229aed444660b766d83c3766f8a IN 0.2
[2021-03-30 09:15:20,805 INFO yapapi.executor] RESPONDED TO R-f1a27f3c2cc44a7777c19b6bd1929023abc8830392f483b403f773886c4ef7b9 IN 0.2
[2021-03-30 09:15:20,806 INFO yapapi.executor] RESPONDED TO R-df5730541ed5ed1f139728f975d8c76d53d0167a5e838cb6c62e4614a2e7025c IN 0.2
[2021-03-30 09:15:20,806 INFO yapapi.executor] RESPONDED TO R-7afed9b2d0b7410c8cf8cdb3f0b870d386464b036b3b7caca67e38e7fff38c70 IN 0.3
[2021-03-30 09:15:20,806 INFO yapapi.executor] RESPONDED TO R-ad173d7116e947691ad64bc8d155f0079cabc81d4de2e25ee548de9581a98a97 IN 0.9
[2021-03-30 09:15:20,807 INFO yapapi.executor] RESPONDED TO R-0b73436f8a379730fe9157bf9cfd9f4f8f5ebfd31dbe72ca23d87e662fdf0a04 IN 0.3
[2021-03-30 09:15:20,807 INFO yapapi.executor] RESPONDED TO R-38b99067d9e39036668fe47173600f30002f09cd0d3cd34ef971c098e707a9a3 IN 0.2
[2021-03-30 09:15:20,807 INFO yapapi.executor] RESPONDED TO R-fdb35c82ae5dfd8331dbcac1292c9a20a0d517ee930f188bcc6a83255ea8acc6 IN 0.2
[2021-03-30 09:15:20,808 INFO yapapi.executor] RESPONDED TO R-77aac8eb460f0c1e98f50bf11236545ff0b733671e64ac5aec79530a79a6efc7 IN 0.2
[2021-03-30 09:15:20,809 INFO yapapi.executor] RESPONDED TO R-5029f01ce6c758fae543ecb4f53a7f16997c63d0cf1271286bfafa92197feea1 IN 0.2
[2021-03-30 09:15:20,809 INFO yapapi.executor] RESPONDED TO R-1c1793ec7ace9cd22043f340432fef12e0393d68bcae9a7ceac80e7e6e09db53 IN 0.2
[2021-03-30 09:15:20,810 INFO yapapi.executor] RESPONDED TO R-f0a4ca90ce90445e58f6636e67cac882a987225da5460baff79596ad75112102 IN 0.2
[2021-03-30 09:15:20,810 INFO yapapi.executor] RESPONDED TO R-0b7fb2928ee1b21852c1f7cbadac81f12794ed6ccd30db1cc2c7ba18663eb10f IN 0.2
[2021-03-30 09:15:20,871 INFO yapapi.executor] RESPONDED TO R-c145798b2a8bb95aa453884486bcf2a302f522f225f5971b61bdbd4427bfcb17 IN 0.3
[2021-03-30 09:15:20,872 INFO yapapi.executor] RESPONDED TO R-368cc679e7f09eb64b6e0c5a433e2466bd698445310855aeb036eeabfc126900 IN 0.3
[2021-03-30 09:15:20,873 INFO yapapi.executor] RESPONDED TO R-93e77559cef838557391cfbb0aebfdc90b7c3c6c5cc22d37946dff6b56d0d7c8 IN 0.3
[2021-03-30 09:15:20,874 INFO yapapi.executor] RESPONDED TO R-ee986eaa069f8f6af0fa7342394d65142c582e7de4bc03cbe7717ba4d056d2a7 IN 0.3
[2021-03-30 09:15:20,875 INFO yapapi.executor] RESPONDED TO R-aabbdd361bb2ad76c1f8d0250010e7ade1c05e5a9b3fb10c6bc94169380b059f IN 0.9
[2021-03-30 09:15:20,896 INFO yapapi.executor] RESPONDED TO R-a9b4cd6fa0de514319f88873b7ed402592759d59cc23f46f9772c6410fcca856 IN 0.2
[2021-03-30 09:15:20,900 INFO yapapi.executor] RESPONDED TO R-7e07fdb7f9d7e3fa5597f8a84881e895fb7c3ba01650eb68d32d80db394c74f0 IN 0.3
[2021-03-30 09:15:20,901 INFO yapapi.executor] RESPONDED TO R-314e8eddd0d693737426611a453310a8c0eb7b0e0ddb95f027bc6608d7a09003 IN 0.3
[2021-03-30 09:15:20,901 INFO yapapi.executor] RESPONDED TO R-3d0a81887fcd9bf367127ec2acc70dd341fa31ed97e72bf53e447b5063ed90c7 IN 0.9
[2021-03-30 09:15:20,911 INFO yapapi.executor] RESPONDED TO R-d369391492987b7f2cada30a1ede8d89a322edecc745737e230a45961afb6c76 IN 0.4
[2021-03-30 09:15:20,912 INFO yapapi.executor] RESPONDED TO R-d88ffb0dc106978d9854252714056c489d3ac79b7f87e362d42327226fc048c3 IN 0.3
[2021-03-30 09:15:20,913 INFO yapapi.executor] RESPONDED TO R-36cb1feb4e197a1f86c86fac8a1a5bda37089ff5017ccc0b9a0efb3c5c9f5a6b IN 0.3
[2021-03-30 09:15:20,930 INFO yapapi.executor] RESPONDED TO R-de09db79e5914cc8b11095f41a6f241da1397ada2b8210d98ce1c07ace9fd114 IN 0.3
[2021-03-30 09:15:20,932 INFO yapapi.executor] RESPONDED TO R-9fa8e9c34cc527b6fc00a409aad2d384957f65b95526186311c9fc8d83af2345 IN 0.3
[2021-03-30 09:15:20,989 INFO yapapi.executor] RESPONDED TO R-3aec7bd56dc9c3b8dce3cfae4a7528bba5b28de43f7ab37ef0688919e4229db8 IN 0.4
[2021-03-30 09:15:21,109 INFO yapapi.executor] RESPONDED TO R-adfc23927d4cc62e726a753f360a48d6f95736f6e86db4a6b862d4d0323fda14 IN 0.5
[2021-03-30 09:15:21,109 INFO yapapi.executor] RESPONDED TO R-df732823618a0809014e464b4a9456937819a256c2f7ee31ae2f5b28e02c8486 IN 0.5
[2021-03-30 09:15:21,109 INFO yapapi.executor] RESPONDED TO R-c286c7a6ca3010f9db415c43c5c6d90d79379f56488f183c25fe023732190a22 IN 0.6
[2021-03-30 09:15:21,141 INFO yapapi.executor] RESPONDED TO R-6acd2e64f12f94d5663610e4160d6fdd455dc1c998a4d4ec7a291612f1af1ff6 IN 0.5
[2021-03-30 09:15:22,474 INFO yapapi.executor] RESPONDED TO R-1d0a617a2d5820abaf116d401fad3629a442906c1b26bba31b57de0f1f80564c IN 2.5
[2021-03-30 09:15:22,774 INFO yapapi.executor] RESPONDED TO R-c7d3feb0fc0f6316fb15494020373a0068ae1cba4f33a646b3cb46972b90fa64 IN 2.7
[2021-03-30 09:15:24,507 INFO yapapi.executor] RESPONDED TO R-81e1e1833fc2bbd07e23587184d7bedbcef3e0ff757ea02d182344ff4ea6045b IN 3.9
[2021-03-30 09:15:28,335 INFO yapapi.executor] RESPONDED TO R-b2a92751a58ecd62c0f169be909ca1561360bbbcc10e6473edcfd6b8fbcfaebe IN 8.5
[2021-03-30 09:15:30,793 INFO yapapi.executor] RESPONDED TO R-a36e569114c5bbe6711ce39eabb67052c8ca353bcedc774f247484d36e7cb3cd IN 10.9
[2021-03-30 09:15:32,261 INFO yapapi.executor] RESPONDED TO R-467617458c8f3887282f9a72e542bbca51ce409b91fbdff338bea76b30fa9c5e IN 12.4
[2021-03-30 09:15:32,634 INFO yapapi.executor] RESPONDED TO R-012fa9103d79e50d4604e434425a065c7fa517b673fca7b4eecdf0747828baaa IN 12.5
[2021-03-30 09:15:42,011 INFO yapapi.executor] RESPONDED TO R-0b2f517c4726463dd270314925f3e8c9fcb1fdaaa1caa10a0cc67da63ccdeea0 IN 0.3
[2021-03-30 09:15:47,393 INFO yapapi.executor] RESPONDED TO R-0c3771a88d1a58586f44d6d4909187c2acf7e5cc919881a6430e91916351c336 IN 27.5
[2021-03-30 09:16:01,206 INFO yapapi.executor] RESPONDED TO R-6ff0f5c81cfe5e23ebcc70f40074172854fd568e605642030bfb813c4b728326 IN 0.3
[2021-03-30 09:16:11,595 INFO yapapi.executor] RESPONDED TO R-a801f450d62e0c69cf169b3b844f0d221f012dab576d334472528aeb1202865e IN 51.5
[2021-03-30 09:16:29,149 INFO yapapi.executor] RESPONDED TO R-7d8591dadabfc04abafa6c81ac48bbf1a1c321aea81d42956b788518221dc0dc IN 31.5
[2021-03-30 09:16:32,740 INFO yapapi.executor] RESPONDED TO R-fee45c7bf8694eaf577a1bb4bb5978f83770c10391c131e41c318b88c16ed827 IN 72.8
[2021-03-30 09:17:03,164 INFO yapapi.executor] RESPONDED TO R-69e33679e01b8e6065a2f5a024abb5170a5a253917af2fa63a4f73fcd184010e IN 21.1
[2021-03-30 09:17:12,653 INFO yapapi.executor] RESPONDED TO R-f2c12ec059f0bfc60b57d742ae905191272b9d33069acd45ce11361b2f0e4b10 IN 93.6
[2021-03-30 09:17:24,033 INFO yapapi.executor] RESPONDED TO R-243f133feaccf143d7cb5e9352bd9ff88533f72dc079d0289a3d3c868c70648e IN 124.0
[2021-03-30 09:17:24,632 INFO yapapi.executor] RESPONDED TO R-c2d031efb715f39ffcfcb08ce47ea5f4f29dacd3142a6a288c27c948f6dfdf75 IN 124.1

yagna_rCURRENT.log.gz

@azawlocki azawlocki changed the title Make market operations concurrent yapapi is not picking up offers from market sometimes Mar 30, 2021
@azawlocki azawlocki self-assigned this Mar 30, 2021
@filipgolem
Copy link
Contributor

Timeouts and other fixes for yajsapi:
golemfactory/golem-js#155

This was referenced Mar 30, 2021
Merged
Merged
@etam
Copy link
Contributor

etam commented Mar 31, 2021

Another example: 2021-03-30_19:23:13.zip

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@azawlocki azawlocki

@filipgolem filipgolem

Labels
beta.1.patch.3
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Make find_offers() an Executor method; handle offer proposals concurrently golemfactory/yapapi
4 participants
@etam @azawlocki @mateuszsrebrny @filipgolem