-
Notifications
You must be signed in to change notification settings - Fork 3
/
release-notes-9.1
1293 lines (820 loc) · 53.8 KB
/
release-notes-9.1
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
HTML header: <title>dCache 9.1 Release Notes</title>
<!--#include virtual="/template/default-head.shtml" -->
<meta name="viewport" content="width=device-width, initial-scale=1.0"/>
<!-- Bootstrap -->
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.6/css/bootstrap.min.css"
integrity="sha384-1q8mTJOASx8j1Au+a5WDVnPi2lkFfwwEAa8hDDdjZlpLegxhjVME1fgjWPGmkzs7" crossorigin="anonymous"/>
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.6/css/bootstrap-theme.min.css"
integrity="sha384-fLW2N01lMqjakBkx3l/M9EahuwpSfeNvV63J5ezn3uZzapT0u7EYsXMjQV+0En5r" crossorigin="anonymous"/>
<!--link type="text/css" rel="stylesheet" href="jquery.tocify.css" /-->
<style type="text/css">
h5 {
font-size: 15px;
font-style: italic;
margin-top: 20px;
}
body {
padding-top: 20px;
}
@media (max-width: 767px) {
#toc {
position: relative;
width: 100%;
margin: 0px 0px 20px 0px;
}
}
@media print {
#toc {
display: none;
}
}
</style>
<div class="container">
<div id="banner">
<div id="bird_large">
<img src="/images/dcache-banner.png" class="bird"></img>
</div>
<div id="sidebar-b">
<span class="dcache-nav-bar">
<a href="/index.shtml">home</a>
|
<a href="/news.shtml">news</a>
|
<a href="/manuals/index.shtml">documentation</a>
|
<a href="/downloads/IAgree.shtml">downloads</a>
|
<a href="/feedback.shtml">feedback</a>
|
<a href="/manuals/googlesearch.shtml">search</a>
|
<a href="/imprint.shtml">imprint </a>
</span>
</div>
</div>
<div id="content">
<div class="row">
<div class="page-header">
<h1>What's new in dCache 9.1<br/>
<small>Release notes</small></h1>
</div>
## Highlights
- Improve concurrent file create rate in a single directory
## Incompatibilities
- Starting with version 9.1 the nlink count for directories shows only number of subdirectories. Thus, the existing
nlink count can be out-of-sync with we no automatic re-synchronization is performed
- dropped gplazma support for XACML
- pool binds TCP port for `http` and `xroot` movers on startup
- With version 9.1.16+, empty and non-existent banfiles will be treated the same
## Release 9.1.19
### ci
CI pipeline improvements.
### dependencies
Update build dependency to be compatible with modern tools.
### Changelog 9.1.18..9.1.19
<!-- git log 9.1.18..9.1.19 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[3209a98a35](https://github.com/dcache/dcache/commit/3209a98a35f880e2f6c1f0e036378df90b9638d7)
: [maven-release-plugin] prepare release 9.1.19
[30f28ebb7a](https://github.com/dcache/dcache/commit/30f28ebb7a0ae66c0572aeb1f8f3213a580b70e3)
: dependencies: update modernizer plugin to be compatible with maven 3.9
[11acd0e3fc](https://github.com/dcache/dcache/commit/11acd0e3fcaa9382465e7d2e3471faf022bf3190)
: ci: add property to control upload options
[4606b4c5b0](https://github.com/dcache/dcache/commit/4606b4c5b03727c0c805c2beb816efca4d04ff77)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.18
### bulk
Bulk truncates path to 256 characters and this seems to be causing problemsd.
This is now fixed.
### Changelog 9.1.17..9.1.18
<!-- git log 9.1.17..9.1.18 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[c2a7cc628c](https://github.com/dcache/dcache/commit/c2a7cc628c3a853f473e26d2b35661e32a462e10)
: [maven-release-plugin] prepare release 9.1.18
[698c4a49e1](https://github.com/dcache/dcache/commit/698c4a49e1724087ac6cb74d40095dc796503549)
: bulk: do not truncate target paths
[1d8fa5d99c](https://github.com/dcache/dcache/commit/1d8fa5d99c75735e61635dad0bfd54f13c1ad686)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.17
### chimera
Fixed a bug that made it possible to create a loop on directory move.
### Changelog 9.1.16..9.1.17
<!-- git log 9.1.16..9.1.17 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[b98a037678](https://github.com/dcache/dcache/commit/b98a0376784cce57ee82b228cc5ecd65902879dc)
: [maven-release-plugin] prepare release 9.1.17
[78f13b366f](https://github.com/dcache/dcache/commit/78f13b366fdf6e93e44ed7e31f4b0320d52800cf)
: chimera: fix loop creation on directory move
[7c130c0f8d](https://github.com/dcache/dcache/commit/7c130c0f8d2b47f3101d862a101b1e71fc62e317)
: ci: drop --ftp-create-dirs option (as we switch to https)
[61b552dba8](https://github.com/dcache/dcache/commit/61b552dba842cde01f9c2418d38ae19ef169cad5)
: ci: use minimal almalinux-9 to upload packages
[913944e9da](https://github.com/dcache/dcache/commit/913944e9dae6298a4dd12cfdad09c4c25c7d00fc)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.16
### gplazma
Previously, a missing banfile would result in every successive login attempt failing with an NPE. Now, even if configured, an empty or inexistent banfile will be ignored and logins should succeed.
WARNING: This changes the banfile plugin behaviour! Empty and non-existent banfiles will be treated the same.
### system-test
Increases the small default direct memory value for system-test: NFS on system-test works again.
### xroot
A recent commit introduced handling of relative paths in xrootd with inadvertent side effect of dropping support xroot.root variable. This patch reverts that commit: pre-9.2 behavior is restored.
### Changelog 9.1.15..9.1.16
<!-- git log 9.1.15..9.1.16 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[150b9c84ba](https://github.com/dcache/dcache/commit/150b9c84bae69c4f45672e983532997a308607bc)
: [maven-release-plugin] prepare release 9.1.16
[84b4a42c42](https://github.com/dcache/dcache/commit/84b4a42c42bed0e38b01254ddf4b4e6cd4b325ac)
: Fix unit test for commit 6b47354
[4d6c8cf12a](https://github.com/dcache/dcache/commit/4d6c8cf12a3edd2112c577d81a64f1803ba1d90d)
: gplazma: configured banfile plugin should ignore non-existent ban file
[d12f0e2687](https://github.com/dcache/dcache/commit/d12f0e2687d1df55caa29a85c11b653d94f8843e)
: system-test: increase direct memory
[bcacea859d](https://github.com/dcache/dcache/commit/bcacea859de46c02e8b9bbc7c2631d1550dece9a)
: xrootd: fix xrootd.root regression
[4995c4a329](https://github.com/dcache/dcache/commit/4995c4a329ac08878ade5ec341fe79848630ef07)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.15
### cleaner-disk
No more occasional ConcurrentHashMap exceptions in cleaner-disk
runs due to concurrent pool status changes.
### core
Admin commands with hyphen-containing arguments are no longer trunkated
prematurely, they are now properly shown and autocompleted.
### xroot
The change to use effectiveRoot did not take into account Subject = Nobody.
Regression eliminated, previous behavior with anonymous read restored.
Fixes previous fix for xroot descriptor: NPE risk mitigated.
### Changelog 9.1.14..9.1.15
<!-- git log 9.1.14..9.1.15 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[c12054fd27](https://github.com/dcache/dcache/commit/c12054fd27b80c743e32b1cd8b8f472dd1081593)
: [maven-release-plugin] prepare release 9.1.15
[6e0bf1bcb7](https://github.com/dcache/dcache/commit/6e0bf1bcb7c19804a8b507df68e70aeba248dc97)
: dcache-xroot: check that descriptor is not null before calling close -- fix
[4029f935fa](https://github.com/dcache/dcache/commit/4029f935faf1bb827fe470c1eab5fb09c42a90cd)
: dcache-xroot: check that descriptor is not null before calling close
[5f2bbbfb6c](https://github.com/dcache/dcache/commit/5f2bbbfb6c62e49d20b096f7ce669e567dc0a29f)
: cleaner-disk: prevent ConcurrentModificationException in cleaning run
[1f868b3224](https://github.com/dcache/dcache/commit/1f868b3224be5ddc35da66286cbe0c2dc1402466)
: dcache-xroot: fix effective root when subject is nobody
[1a63817e9d](https://github.com/dcache/dcache/commit/1a63817e9d7d1dfa29e339f67ea6c935d7ca5f1a)
: dcache-core: fix admin command completion
[e870b5ea6b](https://github.com/dcache/dcache/commit/e870b5ea6b45fc8b2d84b692a88a7c5103458e58)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.14
### dependencies
The MongoDB driver was updated. This might lead to different log messages.
### Changelog 9.1.13..9.1.14
<!-- git log 9.1.13..9.1.14 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[f30ba2a8ae](https://github.com/dcache/dcache/commit/f30ba2a8ae4b098b80b8e64806d70148a61bd2b5)
: [maven-release-plugin] prepare release 9.1.14
[3af0c7834d](https://github.com/dcache/dcache/commit/3af0c7834d0c463e298c499c68821fbda67b4c6d)
: pom: Update mongodb-driver
[939d3167a4](https://github.com/dcache/dcache/commit/939d3167a43c02b97175f54cc95cee452721540a)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.13
### bulk
The current releae fixed handling of uncaught exception during perform.
### Changelog 9.1.12..9.1.13
<!-- git log 9.1.12..9.1.13 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[625afc755a](https://github.com/dcache/dcache/commit/625afc755a56ea4e57139f60a5d6464c60d8e4f5)
: [maven-release-plugin] prepare release 9.1.13
[575fc17d1b](https://github.com/dcache/dcache/commit/575fc17d1baa4524454183cfef1dcd22900fb1c7)
: dcache-frontend,common: check parsing of Duration in STAGE
[d1dc7b5e35](https://github.com/dcache/dcache/commit/d1dc7b5e35a8e824a45279a22083f17100887509)
: dcache-bulk: fix handling of uncaught exception during perform
[f6cd9f591a](https://github.com/dcache/dcache/commit/f6cd9f591ad48eb2e7fd31eba9c5c04fc51b57f4)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.12
### chimera
The rollback of 9.1 to 9.0 db schema was fixed and possibility to rollback namespace db to an earlier schema version is restored now.
### webdav
The urls similar to this `https://door.domain.foo:1234//pnfs/domain.foo/path/to/file`
were strip into `/domain.foo/path/to/file`.
The current release fixed the parsing of urls with two slashes in the path.
### Changelog 9.1.11..9.1.12
<!-- git log 9.1.11..9.1.12 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[12a3f096d1](https://github.com/dcache/dcache/commit/12a3f096d1dde33badf6192656e17b057881fd3c)
: [maven-release-plugin] prepare release 9.1.12
[00acf52639](https://github.com/dcache/dcache/commit/00acf526394f651381b312517091b31d5241e1ca)
: chimera: fix rollback of 9.1 to 9.0 db schema
[4632708ac7](https://github.com/dcache/dcache/commit/4632708ac7d7edb6b7e7d12f7ff23aad9e494e96)
: webdav: fix infinite recursion in Requests.stripToPath
[99d2444750](https://github.com/dcache/dcache/commit/99d24447508abaebe99b2a9d1795e6c152b42bc2)
: webdav: fix parsing of urls with two slashes in the path
[e1f399429b](https://github.com/dcache/dcache/commit/e1f399429b1d4980ac0ce90d7f45c9b2f4a66a6e)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.11
### door
Exception handling is improuved for Kafka.
### oidc
`Storgae scopes` without path will be rejected now.
### Changelog 9.1.10..9.1.11
<!-- git log 9.1.10..9.1.11 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[4ef0107374](https://github.com/dcache/dcache/commit/4ef01073744d92a86a0a109251227b624c46ebee)
: [maven-release-plugin] prepare release 9.1.11
[a5d2093e21](https://github.com/dcache/dcache/commit/a5d2093e21aa7465c2eea54118d2f088dcd42f95)
: oidc: fix remove invalid testcase
[1288355e51](https://github.com/dcache/dcache/commit/1288355e51764e1759fcbbd07eb1d47ecd32bd5c)
: oidc: reject storage scopes without path
[b862c1243c](https://github.com/dcache/dcache/commit/b862c1243c41612b4c8e4cad69ab08e37a233fb4)
: door,pool: handle multiple possible KafkaExceptions
[a99125de16](https://github.com/dcache/dcache/commit/a99125de1668b3f8884ff83e95eecbce204ce410)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.10
### webdav
This patch fixes a bug that led to wrong paths on redirects.
### Changelog 9.1.9..9.1.10
<!-- git log 9.1.9..9.1.10 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[273933e37e](https://github.com/dcache/dcache/commit/273933e37e2a696f2cc3f5f17d45cf3e4ca58e3a)
: [maven-release-plugin] prepare release 9.1.10
[436cb80e9e](https://github.com/dcache/dcache/commit/436cb80e9e7b65bda8dc03a3e98552927fa3d4c7)
: dcache-qos: correction to the threshold warning
[c7da795ebd](https://github.com/dcache/dcache/commit/c7da795ebda8139fec539e6051db86f22f9cd489)
: wevdav: fix redirect path
[04fc6d2731](https://github.com/dcache/dcache/commit/04fc6d2731f90f0700f1ab2e1927f765d14fd69b)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.9
### bulk
No more NPE/stack trace in the bulk `PIN` activity.
Online files should not accumulate useless user pins anymore.
### cli
No more false stack trace/bug output on the admin shell.
### gplazma
dCache will now accept non-targeted explicit AuthZ statements in the scope claim (e.g., storage.read). dCache will consider tokens containing compute explicit AuthZ statements but without any storage explicit AuthZ statements as tokens with explicit authorisation; the lack of any storage explicit authorisation statements will result in all requests with that token being denied.
dCache should continue to accept JWTs for longer, if there is a problem with the OP.
### pool
No more logged stack traces due to IllegalStateException: Attribute is not defined: SIZE errors.
### Changelog 9.1.8..9.1.9
<!-- git log 9.1.8..9.1.9 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[9a52ef9433](https://github.com/dcache/dcache/commit/9a52ef94332e2c6b03249f18895404edf0c19026)
: [maven-release-plugin] prepare release 9.1.9
[5a4c01806b](https://github.com/dcache/dcache/commit/5a4c01806bdb8f576fa743d870cc321ae6a0bf3d)
: dcache-cli: convert IllegalArgumentException to CommandException on call()
[91410ac562](https://github.com/dcache/dcache/commit/91410ac56218996d348567359b13e3b0a56aac96)
: dcache-bulk: guard against erroneous argument names
[d3f71c58bb](https://github.com/dcache/dcache/commit/d3f71c58bbd38b4440d2196caa9ed8c2d0e0d19e)
: pool: on failed upload set file size to zero for space reporting
[8449ad94be](https://github.com/dcache/dcache/commit/8449ad94be6c55eea2f823f495f8427733232e64)
: dcache-bulk: do not PIN or STAGE files with AL ONLINE
[adeb676519](https://github.com/dcache/dcache/commit/adeb6765193015cd085942a2354eaf825b97bc7d)
: gplazma: oidc increase cache duration for OP public key material
[6fe07d61c0](https://github.com/dcache/dcache/commit/6fe07d61c0366b46c9e848dca9ac7a7fb3719d4f)
: gplazma: oidc update explicit AuthZ parsing
[858d748ad0](https://github.com/dcache/dcache/commit/858d748ad0b5ffa9a6fb6678697d41d5f8d52522)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.8
### packages
A problem was fixed that prevented `system-test` to run on MacOS.
### webdav
This patch reverts the efficiency improvement of the last patch as it may lead
to failing requests if set to PERFORMANCE.
### Changelog 9.1.7..9.1.8
<!-- git log 9.1.7..9.1.8 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[38ba16024d](https://github.com/dcache/dcache/commit/38ba16024d9199f4d4937c6998e073f1cb7a0b73)
: [maven-release-plugin] prepare release 9.1.8
[1107b6d0d2](https://github.com/dcache/dcache/commit/1107b6d0d243bd45ae1d8d0aaaa0f0f31f96b36e)
: packages: fix system test populate sed expression
[ad59f486d4](https://github.com/dcache/dcache/commit/ad59f486d42d7a5b87d25b58fd67d96500423dc7)
: dcache-webdav: revert improve efficiency of directory listing (14085/14088)
[9d40ee1d88](https://github.com/dcache/dcache/commit/9d40ee1d88ffca1aef53c0d944466e70fd6e81a7)
: doc: clean up the multiple protocol configuration explanation for xroot
[6f9597c964](https://github.com/dcache/dcache/commit/6f9597c964bda90240495742726396381980b50a)
: ci: pin all jobs to dcache-dev runners (temporary)
[18a1fcbe21](https://github.com/dcache/dcache/commit/18a1fcbe21590af6bbe1a6f87a4c813a249addad)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.7
### logback
Redundant replications of unused log files are removed and the qos activity is now recorded as well.
### qos
A bug was fixed that let to the message queue being blocked.
### webdav
This patch speeds up listing of directories through webdav.
All attributes are no longer supported/returned from PROPFIND, unless you set the following property on the WebDav door:
```
# --- Default PROPFIND properties
#
# The PROPFIND request allows a client to discover information
# (properties) of dCache content. When making a PROPFIND request,
# the client normally indicates which properties are of interest. If
# not specified then the WebDAV server (dCache) is free to return a
# default set of information.
#
# Certain clients make PROPFIND requests without specifying
# the desired set of properties, triggering a default set of
# properties. There are two problems with this: first, the
# clients may react badly if information is missing from this default;
# second, some of the required properties may have an adverse
# performance impact for dCache.
#
# This property controls whether to support client-side requests for
# properties beyond a minimal set or not.
#
# PERFORMANCE -- always return only a minimal set of information that does
# not incur any additional overhead. (These are basically
# the same as what a POSIX list request would proviode).
#
# CLIENT_COMPATIBLE -- return the set of information required by
# the clients. If the client does not specify the properties,
# it will get a maximal default set.
#
# Because the performance impact of the latter under the most common usage scenarios
# could be considerable, the default is set to PERFORMANCE.
#
(one-of?PERFORMANCE|CLIENT_COMPATIBLE)webdav.default-propfind-properties = PERFORMANCE
```
### Changelog 9.1.6..9.1.7
<!-- git log 9.1.6..9.1.7 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[f1c7029e56](https://github.com/dcache/dcache/commit/f1c7029e56c7113164be408fb28055f132450bc0)
: [maven-release-plugin] prepare release 9.1.7
[55981a828f](https://github.com/dcache/dcache/commit/55981a828f70b8e011781878b3995ac4d0faa8b4)
: dcache-webdav: fix incorrect parameter value given to DcacheDirectoryResource constructor
[abaa7f63a9](https://github.com/dcache/dcache/commit/abaa7f63a95b85c17e5332973cfafcc5a582ff48)
: dcache-webdav: improve efficiency of directory listing
[f9ee722ed0](https://github.com/dcache/dcache/commit/f9ee722ed07525f69952ddb3d77f51abf10d2333)
: dcache-qos,dcache-bulk: allow qos update to call engine asynchronously
[bfe7659908](https://github.com/dcache/dcache/commit/bfe76599082e80dde9c104130e8614579d47f0c0)
: skel,logback: make the .resilience and .qos log files singletons
[2cd9410bda](https://github.com/dcache/dcache/commit/2cd9410bda1076ec5899f20f71793fb972853ed3)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.6
### bulk
Each time a bulk request is started, the container is given a new semaphore based on the number of permits defined for the activity in question.
This patch sets the default per-container permit values to something more reasonable.
### pool
Removes hidden default values for pool properties.
### Changelog 9.1.5..9.1.6
<!-- git log 9.1.5..9.1.6 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[b6bae48ae4](https://github.com/dcache/dcache/commit/b6bae48ae492758e141ae18db7f894e9b145f147)
: [maven-release-plugin] prepare release 9.1.6
[5757f0f8a7](https://github.com/dcache/dcache/commit/5757f0f8a76fd49b1d668c62511b293026b184e5)
: pool: remove hidden defaults for rh/rm/sh operations
[0383bd9ae9](https://github.com/dcache/dcache/commit/0383bd9ae90b301a8cddaa1286bfcf6aa7bfb4dd)
: dcache-bulk: adjust semaphore permits to something more reasonable
[4b58dfc336](https://github.com/dcache/dcache/commit/4b58dfc3366560de2b1d57d6fed0897861ce08ed)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.5
### dcache-bulk
Changes were recently made to hold statistical
counts of requests and targets in memory for
the sake of efficiency. However, running target
counts are still problematic. This is
especially true if a request is cancelled.
This is now fixed and the `running` count, which can be confusing
and inaccurate, is not longer displayed.
RT 10496: Odd errors in Bulk logs for some requests in 9.1.0
This ticket uncovered a bug in the abort procedure.
The stored targets were not cancelled on abort. this is now fixed.
### dcache-xroot
Improve efficiency of stat list (`ls -l`) has been introduced.
`ls -l` returns in approximately the
same amount of time as a non-stat listing
`ls`.
### pool
When a hsm provider was dynamically loaded, it doesn't appear in the pools setup file after using save.
this is now fixed and When executing save, hsm load is written to the setup-file.
### xrootd4j
Upgraded to 4.5.8 which improves handling/logging of Ssl exceptions.
### Changelog 9.1.4..9.1.5
<!-- git log 9.1.4..9.1.5 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[3ba4149ce9](https://github.com/dcache/dcache/commit/3ba4149ce95faefdbfe4db01e6365a494f6f22b2)
: [maven-release-plugin] prepare release 9.1.5
[a8e5594bcd](https://github.com/dcache/dcache/commit/a8e5594bcdf5d516baeabdb210a286ae097b7bd6)
: docs: fix external link to nfsmapid and DNS TXT Records docs
[30f772f2ea](https://github.com/dcache/dcache/commit/30f772f2eab7949ecb996c9c398999a92ce7c7ea)
: dcache-bulk: cancel all stored targets on abort
[3292162b75](https://github.com/dcache/dcache/commit/3292162b75850692bef44eeb4b9523b2f1a150fa)
: dcache-bulk: remove in memory running state counts
[5cad241b0e](https://github.com/dcache/dcache/commit/5cad241b0ead8c12065384e380f9ea543cae8fdc)
: common: modify the way the flag on isRestricted works
[5c2d3f33c5](https://github.com/dcache/dcache/commit/5c2d3f33c57a7129d046746a32d4e5dde86745f8)
: pool: Save hsm load provider to setup file
[feb3fe1088](https://github.com/dcache/dcache/commit/feb3fe1088150aed9b6a137c2b8d67b1e4464cf6)
: dcache-xroot: improve efficiency of stat list (ls -l)
[0d20bbb99f](https://github.com/dcache/dcache/commit/0d20bbb99f46a4ffb983ef59dece62ff210c44a3)
: pom.xml: upgrade to xrootd4j 4.5.8
[980bd2194e](https://github.com/dcache/dcache/commit/980bd2194eeee53e3713c9000d014b82e77084e0)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.4
### dchache
By default dcache provides very conservative heap and direct memory sizes, namely 512m. Many sites have adjusted the heap size, but usually keep the direct memory size as-is.
The recent nfs changes require the direct memory to at least 3% of the heap sizes direct memory shared by xroot mover pools have hard times to serve the data and fail with OOME.
This is now fixed.
### pnfsmanager
List scheduling behavior is now optional.
`pnfsmanager.enable.parallel-listing` property variable allows to restore previous behavior - listing requests
are dispatched to a single queue that is prrocessed by multiple parallel workers.
dCache admin can change behavior of listing scheduler.
### Changelog 9.1.3..9.1.4
<!-- git log 9.1.3..9.1.4 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[85256fc96e](https://github.com/dcache/dcache/commit/85256fc96e8a9aeba206e35aad80036b6091db09)
: [maven-release-plugin] prepare release 9.1.4
[8f26701d88](https://github.com/dcache/dcache/commit/8f26701d8868b8fc1bfd394895130ff8f7f2fbfa)
: pnfsmanager: make list scheduling behavior optional (selectable)
[368f419f84](https://github.com/dcache/dcache/commit/368f419f84c7279974acebcdc6c058eb49285c78)
: scripts: update default heap and mempry sizes
[17596c314c](https://github.com/dcache/dcache/commit/17596c314cce3c8974c7824f62f12e467be05353)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.3
### dcache-bulk
`prestore` was added as a bulk request option originally in order
to allow immediate retrieval of target paths. When it was then
discovered that lazy storing of the initial paths was not a
workable idea, this option applied only to targets discovered
via recursion.
However, the rationale for storing the entire tree of targets before beginning the processing does not really exist.
The additional semantics, which complicate modifications (should they be desirable), of prestorage are no longer maintained.
### gplazma
gPlazma incompatibiliti detween version before and after 8.2.13 has been detected.
This is now fixed.
### pool
If http client issues two GET requests then zero-copy enabled http mover will try to remove the IdleStateHandler
twice and fail with NoSuchElementException.
This is now fixed.
### qos
A bug in storing and retrieving `tried` value for verify operation has been fixed.
### xroot
Modify mkdir to ignore dir exists on make parent option. The result conforms to vanilla xroot server.
### Changelog 9.1.2..9.1.3
<!-- git log 9.1.2..9.1.3 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[2b41e92b85](https://github.com/dcache/dcache/commit/2b41e92b859ef1baefee4c8b08fe2d2eac821b67)
: [maven-release-plugin] prepare release 9.1.3
[3e1424902f](https://github.com/dcache/dcache/commit/3e1424902faa34a65537c18f3486916b348aaa50)
: dcache-bulk: deprecate "prestore" option and remove related container
[7f1413aefb](https://github.com/dcache/dcache/commit/7f1413aefb92b2595fcda279cdfb33f7a2b6b8b0)
: dcache-gplazma: add serialVersionUID to MultiTargetedRestriction
[fbc86ee198](https://github.com/dcache/dcache/commit/fbc86ee19838469a424ddbeea8aed2de9cbd0da0)
: pool: handle double remove of IdleStateHandler
[47279ff295](https://github.com/dcache/dcache/commit/47279ff295dbb2e2036792543623b779c803ce19)
: add desc to OIDC properties
[fa863e4cdd](https://github.com/dcache/dcache/commit/fa863e4cddd48908c746b6617b8876110bb3258c)
: dcache-qos: fix bug in storing and retrieving 'tried' value for verify operation
[1cd071eae5](https://github.com/dcache/dcache/commit/1cd071eae5d4cc10ae9ab3cc4b53eb19d2557ed2)
: dcache-xroot: modify mkdir to ignore dir exists on make parent option
[ad635f4465](https://github.com/dcache/dcache/commit/ad635f4465bccc9b4f16f76f2b3016e45ad2568e)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.2
### rpm
The java dependency was changed as dCache is not a desktop application and therefore java-11-headless is sufficient.
### vehicles
This patch fixes a bug where an Exception was thrown while handling relative paths in resolve symlink messages.
### Changelog 9.1.1..9.1.2
<!-- git log 9.1.1..9.1.2 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[5ef250b3bd](https://github.com/dcache/dcache/commit/5ef250b3bd1153e98d64ba9f9e310b98ec67160b)
: [maven-release-plugin] prepare release 9.1.2
[1c27092019](https://github.com/dcache/dcache/commit/1c27092019675dd4e7f6f81ab7c47ada12e61bc4)
: Reformat code in HsmSet.java
[b1e423230c](https://github.com/dcache/dcache/commit/b1e423230c5aae2276482fca1446f1ce14744ef5)
: rpm: depend on java-11-headless
[7ed7e29f6c](https://github.com/dcache/dcache/commit/7ed7e29f6c210e09905d549f099d6ce5a84f67ec)
: dcache-vehicles: fix NPE in resolve symlink message
[cd72fa2d24](https://github.com/dcache/dcache/commit/cd72fa2d24534f617e164ac8845d4881fa3ad052)
: [maven-release-plugin] prepare for next development iteration
## Release 9.1.1
### bulk
RuntimeExceptions should not cause the request ls to fail globally.
### frontend
If the user root contains a symlink, or the target path contains a symlink pertaining
to the user root, some REST calls to /api/v1/namespace and /api/v1/id failed. This is fixed now.
All of the REST GET methods now allow anonymous
users to get the data if the global property
allows it. In the case of NONE, 401 not authorized
is returned at login.
### nfs
A race condition was fixed that let to sending a READ request to a pool when the mover was alreay stopped.
### pnfs
With this version, symlinks are skipped when checking restrictions to speed-up directory listing.
### qos
Two small incompatibilities with subject and attributes are fixed.
The behaviour was changed to not scan all pools on startup or periodic rescanning of all pools outside
the periodic window.
Improvements in triggering QoS operation queues, which reduces the potential for queue starvation.
A bug was fixed that prevented the bulk request to complete.
The error reporting of aborted verification was improved to get a better understanding, what went wrong.
### xrootd
A missing vomsdir is now throwing an exception instead of a stacktrace.
### xrootd4j
Update xrootd4j to a new version, that fixes a byte buffer leak in ZTNCredentialUtils.
### Changelog 9.1.0..9.1.1
<!-- git log 9.1.0..9.1.1 -no-merges -format='[%h](https://github.com/dcache/dcache/commit/%H)%n: %s%n' -->
[7797034d32](https://github.com/dcache/dcache/commit/7797034d32b9521ccabaf37d8621b12045e395ec)
: [maven-release-plugin] prepare release 9.1.1
[f9c1b058f7](https://github.com/dcache/dcache/commit/f9c1b058f76b0d21d796c2cb00a4cf4d5ed9adf9)
: nfs: fix race condition of LAYOUTRETURN and LAYOUTGET
[0088606c7b](https://github.com/dcache/dcache/commit/0088606c7b35b48650291534639e75d23da7b86e)
: xrootd: throw FileNotFoundException if vomsdir doesn't exist
[e955fc02bc](https://github.com/dcache/dcache/commit/e955fc02bcee2472c75b6f651c8d33b604200b84)
: dcache-qos: fix adjuster task cloning to reset state
[4b6817d723](https://github.com/dcache/dcache/commit/4b6817d72387bfcd067ce7babe042de20f605a0b)
: dcache-qos: improve exception reported on aborted verification
[3148d2a72d](https://github.com/dcache/dcache/commit/3148d2a72d577067b3b1002aa371d29498288785)
: ci: add gitlab-ci.yml
[a6fea9419c](https://github.com/dcache/dcache/commit/a6fea9419cd71726af2648d385de500c83f698d5)
: dcache-frontend: add symlink resolution to /api/v1/id GET and /api/v1/namespace
[74147a3c4e](https://github.com/dcache/dcache/commit/74147a3c4e97922c4e1d7f13c0fcf1177b0b5f1d)
: dcache-frontend: remove authz checks in Quota GET methods
[468a7a9ccb](https://github.com/dcache/dcache/commit/468a7a9ccb630a7c787fe2fdc7b48deba36d1dc6)
: dcache-qos: remove trigger to rescan pools on tag change
[70b9a4361f](https://github.com/dcache/dcache/commit/70b9a4361feab3aae3149295714dfe790b5f3629)
: Revert "dcache-qos: remove trigger to rescan pools on tag change"
[d06cf517a3](https://github.com/dcache/dcache/commit/d06cf517a3a22fa8969bbe59f97f9bfe23bd9bac)
: pom.xml: bump xrootd4j to next version (4.5.7, 4.4.8, 4.3.9, 4.2.13)
[310889c5a5](https://github.com/dcache/dcache/commit/310889c5a5e4fa61616f6f600377ba6dc7e61b0d)
: dcache-qos: remove trigger to rescan pools on tag change
[7f54a5d52c](https://github.com/dcache/dcache/commit/7f54a5d52ce8ba71b2cc1a0db796c0b875603c49)
: dcache,pnfs: skip symlink resolution when checking restrictions on directory children during listing
[fb0acb2965](https://github.com/dcache/dcache/commit/fb0acb29655fad87c1fec925d6bebc1499c2681f)
: dcache-qos: repair faulty queue refresh algorithm in verifier
[507f8407bf](https://github.com/dcache/dcache/commit/507f8407bf39a42cb923910218e87b95a60c7267)
: dcache-qos(verifier,engine): fix incompatibility issues with Subject and attributes
[dba3b07251](https://github.com/dcache/dcache/commit/dba3b07251d47ab87a2ac830fca1805976c5d779)
: [maven-release-plugin] prepare for next development iteration
[d4b25a5c8f](https://github.com/dcache/dcache/commit/d4b25a5c8f91888266d4d1b5ec3c088a077953b0)
: dcache-bulk: catch Exception from getSubject()
## Release 9.1.0
### Bulk
There have been a few smaller bug fixes which improve consistency in the request info returned to the user,
in treating non-existent vs invalid paths differently, and in counting targets according to state
in the admin shell. Propagation of the Subject has also been added to PIN and STAGE requests so
as to assure that PinManager does the correct permission checks. Finally, the request policy
defaults have been changed to conform with the most prevalent usage (WLCG TAPE); concurrent requests per user
is now set to 5000, with the size of each request set to 500 targets.
### Chimera, Core, Security, Bulk, Frontend, Xroot
With dCache 9 we have introduced symlink resolution on both target paths and user roots/prefixes.
This means that restrictions for ACLs as well as token claims will now resolve both
the allowable path as well as the target path before making a determination as to permissions.
### Frontend
A new REST API has been added which allows one to retrieve information concerning pool migration jobs,
`/api/v1//migrations`. See the SWAGGER page for description and parameters.
Several other enhancements have been made, including a more detailed description of Bulk request objects,
improved error messages, improved SWAGGER annotations for the TAPE API and for paging offsets on Bulk requests.
Finally, support for relative paths in the target list of Bulk and TAPE API requests has been enabled.
### gPlazma
Besides dropping the XACML plugin and discontinuing gPlazma 1 (making Revocation entries defunct),
the OIDC plugin has been modified to support the suppress option, to allow suppression of offline
verification, and to allow the suppression of audience claim verification. Documentation
on OIDC has been added ("Introduction to multimap and OIDC Plug-ins in dCache") to `The Book`.
Selected JWT claims are now also printed for failed logins.
### Packaging
The rpm package will call `systemctl daemon-reload` after install or update.
### Pinmanager
### PnfsManager
The chimera layer supports two new Java properties that control parent directory attribute update on create:
- chimera_lazy_wcc
- chimera_soft_update
The `chimera_lazy_wcc` option instructs dCache not to update directory attributes immediately. Instead, the desired information is stored
in an additional `t_lazy_wcc` table that is periodically merged into `t_inodes`. This behavior improves the concurrent file creation rate for a single directory.
The attribute syncronization time is hard-coded to 30 seconds.
The `chimera_soft_update` option tells dCache to check for pending updates in `t_lazy_wcc` on `stat` calls. This option should be enabled if the 30-second
attribute merge time can't be used (typically for NFS write based workloads).
### Pool
Added possibility to dynamically add and remove nearline storage providers; this allows one to update the provider without
restarting dCache:
```
(pool_write@dCacheDomain) admin > hsm show providers
PROVIDER DESCRIPTION DYNAMIC
script Calls out to an HSM integration script. no
link Hard links flushed files in another directory. no
copy Copies files to and from another directory. no
tar Bundles files into tar archives (not ready for production). no
(pool_write@dCacheDomain) admin > hsm load provider /tmp/dcache-cta-0.6.0
New providers:
PROVIDER DESCRIPTION
dcache-cta dCache Nearline Storage Driver for CTA. Version: 0.6.0 2022-07-20T09:33:38Z
(pool_write@dCacheDomain) admin > hsm show providers
PROVIDER DESCRIPTION DYNAMIC
script Calls out to an HSM integration script. no
link Hard links flushed files in another directory. no
copy Copies files to and from another directory. no
tar Bundles files into tar archives (not ready for production). no
dcache-cta dCache Nearline Storage Driver for CTA. Version: 0.6.0 2022-07-20T09:33:38Z yes
(pool_write@dCacheDomain) admin > hsm unload provider dcache-cta
Removed providers:
PROVIDER DESCRIPTION
dcache-cta dCache Nearline Storage Driver for CTA. Version: 0.6.0 2022-07-20T09:33:38Z
(pool_write@dCacheDomain) admin > hsm show providers
PROVIDER DESCRIPTION DYNAMIC
script Calls out to an HSM integration script. no
link Hard links flushed files in another directory. no
copy Copies files to and from another directory. no
tar Bundles files into tar archives (not ready for production). no
(pool_write@dCacheDomain) admin > hsm load provider /tmp/dcache-cta-0.7.0
New providers:
PROVIDER DESCRIPTION
dcache-cta dCache Nearline Storage Driver for CTA. Version: 0.7.0 2022-11-04T08:32:39Z
(pool_write@dCacheDomain) admin > hsm show providers
PROVIDER DESCRIPTION DYNAMIC
script Calls out to an HSM integration script. no
link Hard links flushed files in another directory. no
copy Copies files to and from another directory. no
tar Bundles files into tar archives (not ready for production). no
dcache-cta dCache Nearline Storage Driver for CTA. Version: 0.7.0 2022-11-04T08:32:39Z yes
```
The `mover ls` command has been updated to display the remote peer's IP address for Xroot and HTTP movers.
The `st/rh/rm kill` admin commands accept `*` to cancel all running requests.
The Kafka message includes the pool's local socket address used by the transfer.
Before release 9.1, Xroot and HTTP movers were binding their TCP port upon the first request, shutting down the
socket when no movers were left running. Henceforward, dCache will bind these ports on startup and keep them
for the entire JVM lifetime.
### SystemCell
The system cell provides two new commands, `jfr start` and `jfr stop`, to start and stop the Java Flight
Recorder directly from the admin interface. More Information about Flight Recorder and dCache can be found at
[debug section](https://github.com/dCache/dcache/blob/master/docs/TheBook/src/main/markdown/cookbook-debugging.md) in the dCache Book.
The JFR can be started with one of the pre-defined JVM-supplied configurations or with a custom configuration file.
### WebDav
Subsequent to an upgrade of the bootstrap library, certain visual features of the GUI were broken; these
have now been repaired. Two other bugs were fixed (return empty list instead of null for
empty collections; preserving URL of the request in protocol information).
### Xroot
Two bug fixes have been made, one to restore the proper handling of single-slash paths, the
other to fix erroneous permission denied exceptions when `POSC` (`persist on successful close`)
is used.
Xroot now also supports the use of user-root relative paths like other doors (e.g., WebDav and FTP).