Preheat successful, but does not appear to be working properly #1367
Comments
|
When I deleted the line: https://github.com/dragonflyoss/Dragonfly2/blob/v2.0.3/scheduler/job/job.go#L154 curl --location --request POST 'http://xx.xx.xx.xx:8080/api/v1/jobs' \
--header 'Content-Type: application/json' \
--data-raw '{
"type": "preheat",
"args": {
"type": "image",
"url": "https://registry-1.docker.io/v2/library/python/manifests/3.6",
"tag": "d7y/proxy"
}
}'When the number of seedpeer is 1, looks like it's working properly. |
|
Preheat with the following command: curl --location --request POST 'http://101.42.243.65:30808/api/v1/jobs' \
--header 'Content-Type: application/json' \
--data-raw '{
"type": "preheat",
"args": {
"type": "image",
"url": "https://registry-1.docker.io/v2/bitnami/golang/manifests/1.18.3",
"tag": "d7y/proxy"
}
}'After preheating is complete. On crictl pull golang:1.18.3The logs are as follows, the scheduler cluster has three schedulers, and the seedpeer cluster has one seedpeer. Thank you very much for your help! |
|
I will fix this issue, thx. |
|
I have removed If the client is # proxy service detail option
proxy:
defaultFilter: 'Expires&Signature&ns' |
Bug report:
I used the preheat feature, and although the preheat was successful. But when I pulling the image, I found that the seedpeer node was still back to source and did not use the preheat cached data.
Expected behavior:
Pulling the image after a successful preheat will not perform a pull back to the source.
How to reproduce it:
Start with docekr-compose via the reference documentation
1. Create Task
Use console
2. View manager core.log
{"level":"info","ts":"2022-06-09 06:19:57.723","caller":"job/preheat.go:128","msg":"preheat https://registry-1.docker.io/v2/library/python/manifests/latest file url: https://registry-1.docker.io/v2/library/python/blobs/sha256:2767dbfeeb87f9bd53889a475797724caee223dd3d9eb6b7e088ab6c24971b99 queues: [scheduler_1_node0]"} {"level":"info","ts":"2022-06-09 06:19:57.723","caller":"job/preheat.go:128","msg":"preheat https://registry-1.docker.io/v2/library/python/manifests/latest file url: https://registry-1.docker.io/v2/library/python/blobs/sha256:9d5e973c5e10aa521d82c2604eff33d9d6a01db8cabc2dd6c5ede7873cd4d714 queues: [scheduler_1_node0]"} {"level":"info","ts":"2022-06-09 06:19:57.723","caller":"job/preheat.go:128","msg":"preheat https://registry-1.docker.io/v2/library/python/manifests/latest file url: https://registry-1.docker.io/v2/library/python/blobs/sha256:45f2aca7694f66817e68ee1def95117318cb16417bbfa6c5e4fdb7308cefd57d queues: [scheduler_1_node0]"} {"level":"info","ts":"2022-06-09 06:19:57.723","caller":"job/preheat.go:128","msg":"preheat https://registry-1.docker.io/v2/library/python/manifests/latest file url: https://registry-1.docker.io/v2/library/python/blobs/sha256:1123e010bf8054349c6b2716c820a205c830588720a2626321d76d8200dfe8ca queues: [scheduler_1_node0]"} {"level":"info","ts":"2022-06-09 06:19:57.727","caller":"job/preheat.go:166","msg":"create preheat group job successfully, group uuid: group_c71faca1-7d6c-4f64-b841-5409fb668342， urls: [https://registry-1.docker.io/v2/library/python/blobs/sha256:6bb8bdb609b697dfbb897199c2869bc47fcc9fbf7a7370494c42458e15244df9 https://registry-1.docker.io/v2/library/python/blobs/sha256:e756f3fdd6a378aa16205b0f75d178b7532b110e86be7659004fc6a21183226c https://registry-1.docker.io/v2/library/python/blobs/sha256:bf168a6748997eb97b48cc86234b7ff7d8bc907645b9be99013158b3f146b272 https://registry-1.docker.io/v2/library/python/blobs/sha256:e604223835ccf02d097187b5a58ca73e8598cadbb16a36202ca1943e97f56f1f https://registry-1.docker.io/v2/library/python/blobs/sha256:6d5c91c4cd86dde23108ab3af91e9eae838d0059a380ee7dfd4f370b6d985523 https://registry-1.docker.io/v2/library/python/blobs/sha256:2cc8d88542628a7668ee653a4c00f2cfef5f9ea24f407227b6b63508c56eba3e https://registry-1.docker.io/v2/library/python/blobs/sha256:2767dbfeeb87f9bd53889a475797724caee223dd3d9eb6b7e088ab6c24971b99 https://registry-1.docker.io/v2/library/python/blobs/sha256:9d5e973c5e10aa521d82c2604eff33d9d6a01db8cabc2dd6c5ede7873cd4d714 https://registry-1.docker.io/v2/library/python/blobs/sha256:45f2aca7694f66817e68ee1def95117318cb16417bbfa6c5e4fdb7308cefd57d https://registry-1.docker.io/v2/library/python/blobs/sha256:1123e010bf8054349c6b2716c820a205c830588720a2626321d76d8200dfe8ca]"}3. View Data Catalog
(base) [root@node0 docker-compose]# docker exec seed-peer tree -hD /var/lib/dragonfly/ /var/lib/dragonfly/ ├── [ 71 Jun 9 06:45] 0a52b53a8e4d5412111e02b327d5c37eecb819e80ad3533104e813cf614f754d │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-a4410be5-455f-4242-b057-6d1a1e386f22_Seed │ ├── [ 52M Jun 9 06:46] data │ └── [2.5K Jun 9 06:46] metadata ├── [ 71 Jun 9 06:45] 5e0b4f07688cf052d0d38afc3041a8ec22a81ee3a836e99a2416b6162aaa7ac2 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-7c981541-e1b2-4519-b9bf-875b151baced_Seed │ ├── [ 10M Jun 9 06:45] data │ └── [1.0K Jun 9 06:45] metadata ├── [ 71 Jun 9 06:45] 902999501470f1c6d1d7dc49ed0d3dc8beeac33693f990224c0e1ac5983697a7 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-b9e69be0-ad75-45c6-95b3-0aaaa0955b25_Seed │ ├── [ 19M Jun 9 06:45] data │ └── [1.3K Jun 9 06:45] metadata ├── [ 71 Jun 9 06:45] 95257d20a342fcefabc499a6276e2133118b2405b7b3a04739fedad0d03aba21 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-553bc38b-bbcd-4270-841d-1c70bf476a5d_Seed │ ├── [6.0M Jun 9 06:45] data │ └── [ 925 Jun 9 06:45] metadata ├── [ 71 Jun 9 06:45] c28b7a40cfa3d44d19496c00788df1675f7f749b985fe199a6680cb1f6b324cd │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-c9042176-908f-4970-8681-c0996e0b545e_Seed │ ├── [ 233 Jun 9 06:45] data │ └── [ 779 Jun 9 06:45] metadata ├── [ 71 Jun 9 06:45] cf072b8ca1d9b92496ede0565f72322209207e0b85f2c09dbee7e93a6d36e319 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-e34ba120-4385-411b-8fe4-6857a9340ae0_Seed │ ├── [4.9M Jun 9 06:45] data │ └── [ 924 Jun 9 06:45] metadata ├── [ 71 Jun 9 06:45] d0c1fe587b96d98f106a827f43c0667e9576f641117f81a09b543cca62ef9501 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-d30dba24-73f2-429d-831d-13c8f0c1026f_Seed │ ├── [2.7M Jun 9 06:45] data │ └── [ 792 Jun 9 06:45] metadata ├── [ 71 Jun 9 06:45] e0a1b35f47ba7cb403d7fce2c2ad439efcdaa2baeeb20d89b26cb48a2d0d2544 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-97dc71fb-d704-492a-8c63-eeb141ffc348_Seed │ ├── [ 52M Jun 9 06:46] data │ └── [2.5K Jun 9 06:46] metadata ├── [ 71 Jun 9 06:45] e2da9f4c46bf48a52023e1f48af5b7ec4fca17334ca0e66653ec7e6b9107c36a │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-9caf22fe-d4d4-405a-ae64-a2ac0aa6a83b_Seed │ ├── [8.3K Jun 9 06:45] data │ └── [ 781 Jun 9 06:45] metadata └── [ 71 Jun 9 06:45] efe37b4654b073deef1aef2ff2e2978a39f74998d833e32cc890f940734e4ec5 └── [ 34 Jun 9 06:45] 172.20.163.12-1-085d1bc4-b508-4b9b-9386-e3c48cc228c3_Seed ├── [188M Jun 9 06:46] data └── [7.0K Jun 9 06:46] metadata 20 directories, 20 files4. Pull image
5. Review Data Catalog
(base) [root@node0 docker-compose]# docker exec seed-peer tree -hD /var/lib/dragonfly/ /var/lib/dragonfly/ ├── [ 71 Jun 9 06:48] 007859f1cc160a28e9c5cfa8c52499284427abafe311b6898759ac42b4572fec │ └── [ 34 Jun 9 06:48] 172.20.163.12-1-f48615ec-1650-47b5-a549-f6644f941dd7_Seed │ ├── [2.7M Jun 9 06:48] data │ └── [ 791 Jun 9 06:48] metadata ├── [ 71 Jun 9 06:48] 00b64f40b54a9a3f521caa8c631e37588ba4061f35e5e23ad748bf6fdc36eb14 │ └── [ 34 Jun 9 06:48] 172.20.163.12-1-bb89dae5-03fa-4fc9-8f63-3e61c558277e_Seed │ ├── [ 10M Jun 9 06:48] data │ └── [1.0K Jun 9 06:48] metadata ├── [ 71 Jun 9 06:45] 0a52b53a8e4d5412111e02b327d5c37eecb819e80ad3533104e813cf614f754d │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-a4410be5-455f-4242-b057-6d1a1e386f22_Seed │ ├── [ 52M Jun 9 06:46] data │ └── [2.5K Jun 9 06:46] metadata ├── [ 71 Jun 9 06:48] 144737ad893a5b3a9694e8c124ade2ccf22c01a887e750deb8ad4226be256342 │ └── [ 34 Jun 9 06:48] 172.20.163.12-1-c4b9e5f4-ee36-4b4a-b3c3-2e7c43203000_Seed │ ├── [8.3K Jun 9 06:48] data │ └── [ 781 Jun 9 06:48] metadata ├── [ 71 Jun 9 06:48] 176cf97e951382307368deb0a081d25d0f480effad5e7b4c46192b2815a78cd2 │ └── [ 34 Jun 9 06:48] 172.20.163.12-1-b6da61c9-4b54-4e8d-b92c-c73f5e7053ea_Seed │ ├── [4.9M Jun 9 06:48] data │ └── [ 923 Jun 9 06:48] metadata ├── [ 71 Jun 9 06:48] 2334cf07b7e877d96140bfe4fd59a798c3d370e3ae6be901ea044871fae52717 │ └── [ 34 Jun 9 06:48] 172.20.163.12-1-4e467399-c54e-4614-8016-9588cc558801_Seed │ ├── [ 52M Jun 9 06:48] data │ └── [2.5K Jun 9 06:48] metadata ├── [ 71 Jun 9 06:45] 5e0b4f07688cf052d0d38afc3041a8ec22a81ee3a836e99a2416b6162aaa7ac2 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-7c981541-e1b2-4519-b9bf-875b151baced_Seed │ ├── [ 10M Jun 9 06:45] data │ └── [1.0K Jun 9 06:45] metadata ├── [ 71 Jun 9 06:48] 6434431a0f8e1dd257c62c7b81027babe36bd7895bef7430a117ee2255fd444d │ └── [ 34 Jun 9 06:48] 172.20.163.12-1-bdf76c24-07e2-47d1-b6bd-62f24b82f91d_Seed │ ├── [ 52M Jun 9 06:48] data │ └── [2.5K Jun 9 06:48] metadata ├── [ 71 Jun 9 06:48] 82524546509c682b2235eef401ef080e61deece702c8bd3641054610b598413e │ └── [ 34 Jun 9 06:48] 172.20.163.12-1-1a50baa6-6158-4135-86d2-121623f213a7_Seed │ ├── [ 19M Jun 9 06:48] data │ └── [1.3K Jun 9 06:48] metadata ├── [ 71 Jun 9 06:48] 826ceda049e5498b3ebe4091ebc0d53ce6243a20d397ec8bb754d947dd360e2f │ └── [ 34 Jun 9 06:48] 172.20.163.12-1-ac47c650-c569-4c6c-8ecc-0efffe13a0cb_Seed │ ├── [ 233 Jun 9 06:48] data │ └── [ 779 Jun 9 06:48] metadata ├── [ 71 Jun 9 06:45] 902999501470f1c6d1d7dc49ed0d3dc8beeac33693f990224c0e1ac5983697a7 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-b9e69be0-ad75-45c6-95b3-0aaaa0955b25_Seed │ ├── [ 19M Jun 9 06:45] data │ └── [1.3K Jun 9 06:45] metadata ├── [ 71 Jun 9 06:45] 95257d20a342fcefabc499a6276e2133118b2405b7b3a04739fedad0d03aba21 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-553bc38b-bbcd-4270-841d-1c70bf476a5d_Seed │ ├── [6.0M Jun 9 06:45] data │ └── [ 925 Jun 9 06:45] metadata ├── [ 71 Jun 9 06:48] b48fe2cb45b8a916109118fdf27e7baa7833ffcaa8b0edfb2e7d742e7aa2bfbf │ └── [ 34 Jun 9 06:48] 172.20.163.12-1-e70a00f9-d87a-4e83-beb4-74ae3204a14f_Seed │ ├── [6.0M Jun 9 06:48] data │ └── [ 924 Jun 9 06:48] metadata ├── [ 71 Jun 9 06:45] c28b7a40cfa3d44d19496c00788df1675f7f749b985fe199a6680cb1f6b324cd │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-c9042176-908f-4970-8681-c0996e0b545e_Seed │ ├── [ 233 Jun 9 06:45] data │ └── [ 779 Jun 9 06:45] metadata ├── [ 71 Jun 9 06:45] cf072b8ca1d9b92496ede0565f72322209207e0b85f2c09dbee7e93a6d36e319 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-e34ba120-4385-411b-8fe4-6857a9340ae0_Seed │ ├── [4.9M Jun 9 06:45] data │ └── [ 924 Jun 9 06:45] metadata ├── [ 71 Jun 9 06:45] d0c1fe587b96d98f106a827f43c0667e9576f641117f81a09b543cca62ef9501 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-d30dba24-73f2-429d-831d-13c8f0c1026f_Seed │ ├── [2.7M Jun 9 06:45] data │ └── [ 792 Jun 9 06:45] metadata ├── [ 71 Jun 9 06:48] dd490f861e1461ee60fc8b14282ea11daad5cf22ec0cce731c1b6a13989f9317 │ └── [ 34 Jun 9 06:48] 172.20.163.12-1-3d361df9-471e-445a-a7db-c9fb01b5cb05_Seed │ ├── [188M Jun 9 06:49] data │ └── [7.0K Jun 9 06:49] metadata ├── [ 71 Jun 9 06:45] e0a1b35f47ba7cb403d7fce2c2ad439efcdaa2baeeb20d89b26cb48a2d0d2544 │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-97dc71fb-d704-492a-8c63-eeb141ffc348_Seed │ ├── [ 52M Jun 9 06:46] data │ └── [2.5K Jun 9 06:46] metadata ├── [ 71 Jun 9 06:45] e2da9f4c46bf48a52023e1f48af5b7ec4fca17334ca0e66653ec7e6b9107c36a │ └── [ 34 Jun 9 06:45] 172.20.163.12-1-9caf22fe-d4d4-405a-ae64-a2ac0aa6a83b_Seed │ ├── [8.3K Jun 9 06:45] data │ └── [ 781 Jun 9 06:45] metadata └── [ 71 Jun 9 06:45] efe37b4654b073deef1aef2ff2e2978a39f74998d833e32cc890f940734e4ec5 └── [ 34 Jun 9 06:45] 172.20.163.12-1-085d1bc4-b508-4b9b-9386-e3c48cc228c3_Seed ├── [188M Jun 9 06:46] data └── [7.0K Jun 9 06:46] metadata 40 directories, 40 filesRequest log
I see that the taskID generated by preheat and pulling the image is different, I do not know if it is related to this.
Preheat log in scheduler
{ "level": "info", "ts": "2022-06-09 03:59:55.455", "caller": "job/job.go:167", "msg": "preheat https://registry-1.docker.io/v2/library/python/blobs/sha256:20cadc1653dfac9f6409b072a776240c529c275775c56c5600c5b7b877512319 headers: map[string]string{\"Accept\":\"application/vnd.docker.distribution.manifest.v2+json\", \"Authorization\":\"Bearer eyJhbGciOiJSUzI1NiIsInR5cCI6IkpXVCIsIng1YyI6WyJNSUlDK1RDQ0FwK2dBd0lCQWdJQkFEQUtCZ2dxaGtqT1BRUURBakJHTVVRd1FnWURWUVFERXp0U1RVbEdPbEZNUmpRNlEwZFFNenBSTWtWYU9sRklSRUk2VkVkRlZUcFZTRlZNT2taTVZqUTZSMGRXV2pwQk5WUkhPbFJMTkZNNlVVeElTVEFlRncweU1qQXhNVEF5TWpJeE5EbGFGdzB5TXpBeE1qVXlNakl4TkRsYU1FWXhSREJDQmdOVkJBTVRPMUJaUTFJNlNWQmFRanBJUWxGWE9qZE1SVms2UWtGV1FqcEhTRGRhT2xWSVZ6TTZVa3RMVWpwRE4wNHpPbGxOTkZJNlNWaE5TRHBLVkZCQ01JSUJJakFOQmdrcWhraUc5dzBCQVFFRkFBT0NBUThBTUlJQkNnS0NBUUVBbE5JOGFtMlBERnZzNndOeVl2d0dkZWZXVXJXQWdMZ3N2MzA2MnZycG5VNkN0WUpEZDZ2K2NEVG1FN1FlTllEaFMyaU1wU3djZkRCL2RFclEwdnhIZE4ycDIvODZmZy9TeWlIMnhmMGFVTjlDV1dud0JPaTIvS3hLditpbFNlQ01HYXRwRlg3SmYxcWI4N0Q5NUxOVDBvOU9OTmYxT3RidjY5ck9tL1RIVFh3clUvV3dTZlUyWktUbEw4SVRXRkRXN09ZK3hXdUJ0WUpteVhqcVpsaWRBbUNTdTdHY0Y0MVB5em9KTFFTMnJCdXJwOXc0cWgxMFk1bUNIcWdsaEI1Rk9aOUs0T2pUaVhUUHJFUk5WcnArUFVIR3JBYVRPRTBwQzgyUHBuWVZhNzNDUkdsMEdDdC9RckJwVjRpdmswdzF0eEtkV1NiSDNnRmtqZ2g1N0tOcDhRSURBUUFCbzRHeU1JR3ZNQTRHQTFVZER3RUIvd1FFQXdJSGdEQVBCZ05WSFNVRUNEQUdCZ1JWSFNVQU1FUUdBMVVkRGdROUJEdFFXVU5TT2tsUVdrSTZTRUpSVnpvM1RFVlpPa0pCVmtJNlIwZzNXanBWU0Zjek9sSkxTMUk2UXpkT016cFpUVFJTT2tsWVRVZzZTbFJRUWpCR0JnTlZIU01FUHpBOWdEdFNUVWxHT2xGTVJqUTZRMGRRTXpwUk1rVmFPbEZJUkVJNlZFZEZWVHBWU0ZWTU9rWk1WalE2UjBkV1dqcEJOVlJIT2xSTE5GTTZVVXhJU1RBS0JnZ3Foa2pPUFFRREFnTklBREJGQWlFQTdIY1VyVm1namo1cE01MXhZVHd2eGE1VnRqd2hub0dRZjFxTU52UGVHeVlDSUFwYm4vWFkvS1F5WWFWRnRjMWtsb0lmZzd4L3hlbkZhbkp4L0F2cURGdFgiXX0.eyJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImxpYnJhcnkvcHl0aG9uIiwiYWN0aW9ucyI6WyJwdWxsIl0sInBhcmFtZXRlcnMiOnsicHVsbF9saW1pdCI6IjEwMCIsInB1bGxfbGltaXRfaW50ZXJ2YWwiOiIyMTYwMCJ9fV0sImF1ZCI6InJlZ2lzdHJ5LmRvY2tlci5pbyIsImV4cCI6MTY1NDc0NzQ5MywiaWF0IjoxNjU0NzQ3MTkzLCJpc3MiOiJhdXRoLmRvY2tlci5pbyIsImp0aSI6IlY1NEJhZWxrYUpvV2M2ekxPcHkzIiwibmJmIjoxNjU0NzQ2ODkzLCJzdWIiOiIifQ.i9TeBJLVEulmQSnrURQTml5nRmgH7yL0yGuBWmW8-Oz293PrDR33luV5zkdf7Hgs3vemvgmJjsdQrf4yjfAjmIY3-sSHS-VQktMIW-BifSV5g8sxt5eMU-5iMhqO1VnQYOSntKk95LubenyhxSgCp3dkZdVj4-XGcQZX2tWnOdcdbewJxTfVa1w5Dbgm_TyAJWTbY2znU3GrNmGWeo1Ft4s0Lmv84Z2B0lhRZwTHBWzXsQ4z7DE7CHBQfbCEZBMK5PbgnBcDco_Up-gd05irCHYcxkdY2hKrlBGvlht53L7-zvT9IEsSuEqONDwxuflF4mPXiOGDKuxxovgPePlQMg\"}, tag: , range: , filter: , digest: sha256:20cadc1653dfac9f6409b072a776240c529c275775c56c5600c5b7b877512319", "taskID": "8d8cb5e458fa7fd23ef0059e3dc6b9402a73374678f05dd17a5b19d50af7e011", "url": "https://registry-1.docker.io/v2/library/python/blobs/sha256:20cadc1653dfac9f6409b072a776240c529c275775c56c5600c5b7b877512319" }Pull image peer task log
Finally
I can also see the traffic on the external network with the iftop command when I pull the image.
Or maybe I made a configuration error, i would be grateful for any tips on how to proceed.
Thanks!
Environment:
uname -a): Linux node0 5.4.156-1.el7.elrepo.x86_64The text was updated successfully, but these errors were encountered: