Improve test performance #3052

bmesuere · 2021-08-30T18:46:42Z

This pull request tries to improve test performance.

Running test-prof shows that over half of the time is spent in factories. We will try to remedy this in several ways:

improve factories to create fewer associations
add fixtures where possible
go over the test in detail to see if all setup is needed
replace create by build where possible

Before


[TEST PROF INFO] Factories usage

 Total: 13895
 Total top-level: 4280
 Total time: 04:02.756 (out of 06:35.342)
 Total uniq factories: 37

   total   top-level     total time      time per call      top-level time               name

    2703          58        7.5253s            0.0028s             0.1457s        institution
    1535          62       15.0473s            0.0098s             0.6016s              judge
    1473         109       35.9524s            0.0244s            11.5190s         repository
    1464         435       13.9845s            0.0096s             3.9024s               user
    1293          11        3.9118s            0.0030s             0.0266s programming_language
    1283         262       81.8711s            0.0638s            13.9337s           exercise
     806         806       84.8227s            0.1052s            84.8227s         submission
     592         155       77.3136s            0.1306s            17.2639s correct_submission
     543         325       22.1759s            0.0408s            19.1588s             course
     496         496        4.1697s            0.0084s             4.1697s            student
     384         269       59.3347s            0.1545s            38.7392s             series
     381         381        3.2038s            0.0084s             3.2038s              staff
     280         280        2.3202s            0.0083s             2.3202s               zeus
      97          97        1.1388s            0.0117s             1.1388s           question
      90          90        1.5297s            0.0170s             1.5297s         score_item
      60          60       30.5477s            0.5091s            30.5477s         evaluation
      59          59        0.9644s            0.0163s             0.9644s              score
      48          48        4.7336s            0.0986s             4.7336s   wrong_submission
      42          15        0.7341s            0.0175s             0.3631s       content_page
      33          33        0.1048s            0.0032s             0.1048s           identity
      33          33        0.9652s            0.0292s             0.9652s activity_read_state
      32          32        0.2318s            0.0072s             0.2318s           provider
      26          26        0.1908s            0.0073s             0.1908s         annotation
      18          18        0.1475s            0.0082s             0.1475s       lti_provider
      16          16        0.1326s            0.0083s             0.1326s office365_provider
      16          16        0.1549s            0.0097s             0.1549s smartschool_provider
      15          15        0.1157s            0.0077s             0.1157s    gsuite_provider
      15          15        0.1435s            0.0096s             0.1435s          api_token
      13          13        0.0929s            0.0071s             0.0929s      saml_provider
      11          11        0.0202s            0.0018s             0.0202s              label
       9           9        0.2549s            0.0283s             0.2549s     rights_request
       7           7        0.7576s            0.1082s             0.7576s  course_submission
       6           6        0.0312s            0.0052s             0.0312s     temporary_user
       5           1        0.0585s            0.0117s             0.0087s             export
       5           5        0.2369s            0.0474s             0.2369s evaluation_exercise
       4           4        0.0715s            0.0179s             0.0715s       notification
       2           2        0.0108s            0.0054s             0.0108s    activity_status

After

[TEST PROF INFO] Factories usage

 Total: 2973
 Total top-level: 2132
 Total time: 00:41.293 (out of 02:13.412)
 Total uniq factories: 37

   total   top-level     total time      time per call      top-level time               name

     396         124        9.2689s            0.0234s             2.2574s           exercise
     389         147       10.8842s            0.0280s             3.4910s correct_submission
     355         219        2.1821s            0.0061s             1.1838s               user
     317         262       10.0952s            0.0318s             8.0331s             series
     267         267        6.7233s            0.0252s             6.7233s         submission
     151         140        2.1120s            0.0140s             2.0212s             course
     127         127        0.5323s            0.0042s             0.5323s            student
     120         120        0.5075s            0.0042s             0.5075s              staff
     115          23        0.1942s            0.0017s             0.0374s        institution
      91          90        5.3420s            0.0587s             5.3373s         repository
      72          72        0.4102s            0.0057s             0.4102s         score_item
      67          67        0.2378s            0.0035s             0.2378s           question
      61          44        0.4190s            0.0069s             0.3006s              judge
      49          49        6.6304s            0.1353s             6.6304s         evaluation
      49          49        0.2608s            0.0053s             0.2608s              score
      40          40        1.2446s            0.0311s             1.2446s   wrong_submission
      33          33        0.6736s            0.0204s             0.6736s activity_read_state
      33          33        0.0692s            0.0021s             0.0692s           identity
      27          27        0.1333s            0.0049s             0.1333s           provider
      24          13        0.2171s            0.0090s             0.0833s       content_page
      20          20        0.0889s            0.0044s             0.0889s               zeus
      19          19        0.1031s            0.0054s             0.1031s         annotation
      18          18        0.1155s            0.0064s             0.1155s       lti_provider
      16          16        0.0775s            0.0048s             0.0775s office365_provider
      16          16        0.0794s            0.0050s             0.0794s smartschool_provider
      15          15        0.0792s            0.0053s             0.0792s    gsuite_provider
      14          14        0.0472s            0.0034s             0.0472s          api_token
      13          13        0.0781s            0.0060s             0.0781s      saml_provider
      11          11        0.0194s            0.0018s             0.0194s programming_language
      11          11        0.0147s            0.0013s             0.0147s              label
       9           9        0.1590s            0.0177s             0.1590s     rights_request
       6           6        0.1636s            0.0273s             0.1636s  course_submission
       6           6        0.0201s            0.0033s             0.0201s     temporary_user
       5           1        0.0143s            0.0029s             0.0020s             export
       5           5        0.0434s            0.0087s             0.0434s evaluation_exercise
       4           4        0.0257s            0.0064s             0.0257s       notification
       2           2        0.0090s            0.0045s             0.0090s    activity_status

Total institutions created went from 2703 to 157 [TEST PROF INFO] Factories usage Total: 11343 Total top-level: 4276 Total time: 02:41.449 (out of 04:37.450) Total uniq factories: 37 total top-level total time time per call top-level time name 1535 62 10.4243s 0.0068s 0.4916s judge 1473 109 25.6807s 0.0174s 9.1480s repository 1458 435 7.9550s 0.0055s 2.2409s user 1293 11 2.5787s 0.0020s 0.0200s programming_language 1283 262 52.8969s 0.0412s 9.2936s exercise 806 806 53.3182s 0.0662s 53.3182s submission 592 155 53.8062s 0.0909s 12.5099s correct_submission 543 325 14.9243s 0.0275s 12.7668s course 496 496 2.2443s 0.0045s 2.2443s student 384 269 40.3077s 0.1050s 26.7965s series 381 381 1.6770s 0.0044s 1.6770s staff 280 280 1.2987s 0.0046s 1.2987s zeus 157 54 0.3056s 0.0019s 0.1023s institution 97 97 0.8352s 0.0086s 0.8352s question 90 90 0.9235s 0.0103s 0.9235s score_item 60 60 21.0340s 0.3506s 21.0340s evaluation 59 59 0.6514s 0.0110s 0.6514s score 48 48 3.3033s 0.0688s 3.3033s wrong_submission 42 15 0.5570s 0.0133s 0.2356s content_page 33 33 0.6919s 0.0210s 0.6919s activity_read_state 33 33 0.0729s 0.0022s 0.0729s identity 32 32 0.1560s 0.0049s 0.1560s provider 26 26 0.1411s 0.0054s 0.1411s annotation 18 18 0.1241s 0.0069s 0.1241s lti_provider 16 16 0.0876s 0.0055s 0.0876s smartschool_provider 16 16 0.0872s 0.0054s 0.0872s office365_provider 15 15 0.1081s 0.0072s 0.1081s api_token 15 15 0.0838s 0.0056s 0.0838s gsuite_provider 13 13 0.0808s 0.0062s 0.0808s saml_provider 11 11 0.0174s 0.0016s 0.0174s label 9 9 0.1696s 0.0188s 0.1696s rights_request 7 7 0.5408s 0.0773s 0.5408s course_submission 6 6 0.0242s 0.0040s 0.0242s temporary_user 5 1 0.0328s 0.0066s 0.0060s export 5 5 0.1128s 0.0226s 0.1128s evaluation_exercise 4 4 0.0424s 0.0106s 0.0424s notification 2 2 0.0126s 0.0063s 0.0126s activity_status

Total programming languages created went from 1293 to 11 Total: 10061 Total top-level: 4276 Total time: 02:58.203 (out of 05:00.185) Total uniq factories: 37 total top-level total time time per call top-level time name 1535 62 12.3575s 0.0081s 0.5157s judge 1473 109 29.4422s 0.0200s 9.7948s repository 1458 435 8.4758s 0.0058s 2.5445s user 1283 262 60.3953s 0.0471s 9.5759s exercise 806 806 61.6564s 0.0765s 61.6564s submission 592 155 57.4303s 0.0970s 13.4443s correct_submission 543 325 15.6532s 0.0288s 13.3003s course 496 496 2.2953s 0.0046s 2.2953s student 384 269 44.1073s 0.1149s 29.7707s series 381 381 1.7075s 0.0045s 1.7075s staff 280 280 1.4901s 0.0053s 1.4901s zeus 157 54 0.3344s 0.0021s 0.1278s institution 97 97 0.7426s 0.0077s 0.7426s question 90 90 0.9796s 0.0109s 0.9796s score_item 60 60 23.0017s 0.3834s 23.0017s evaluation 59 59 0.6801s 0.0115s 0.6801s score 48 48 3.5863s 0.0747s 3.5863s wrong_submission 42 15 0.5463s 0.0130s 0.2416s content_page 33 33 0.0818s 0.0025s 0.0818s identity 33 33 0.7324s 0.0222s 0.7324s activity_read_state 32 32 0.1969s 0.0062s 0.1969s provider 26 26 0.1562s 0.0060s 0.1562s annotation 18 18 0.1190s 0.0066s 0.1190s lti_provider 16 16 0.0944s 0.0059s 0.0944s smartschool_provider 16 16 0.0994s 0.0062s 0.0994s office365_provider 15 15 0.0927s 0.0062s 0.0927s gsuite_provider 15 15 0.1058s 0.0071s 0.1058s api_token 13 13 0.0771s 0.0059s 0.0771s saml_provider 11 11 0.0215s 0.0020s 0.0215s programming_language 11 11 0.0166s 0.0015s 0.0166s label 9 9 0.1759s 0.0195s 0.1759s rights_request 7 7 0.5734s 0.0819s 0.5734s course_submission 6 6 0.0257s 0.0043s 0.0257s temporary_user 5 1 0.0338s 0.0068s 0.0058s export 5 5 0.1214s 0.0243s 0.1214s evaluation_exercise 4 4 0.0403s 0.0101s 0.0403s notification 2 2 0.0120s 0.0060s 0.0120s activity_status

Total judge creations went from 1535 to 73 [TEST PROF INFO] Factories usage Total: 8599 Total top-level: 4270 Total time: 03:54.862 (out of 06:43.941) Total uniq factories: 37 total top-level total time time per call top-level time name 1473 109 24.3592s 0.0165s 11.2835s repository 1458 435 12.0872s 0.0083s 3.8035s user 1283 262 73.5874s 0.0574s 13.7818s exercise 806 806 71.1712s 0.0883s 71.1712s submission 592 155 83.8848s 0.1417s 19.8428s correct_submission 543 325 22.0437s 0.0406s 17.8401s course 496 496 3.3731s 0.0068s 3.3731s student 384 269 61.0696s 0.1590s 42.7817s series 381 381 2.5946s 0.0068s 2.5946s staff 280 280 2.1584s 0.0077s 2.1584s zeus 157 54 0.4005s 0.0026s 0.1364s institution 97 97 1.0500s 0.0108s 1.0500s question 90 90 1.5166s 0.0169s 1.5166s score_item 73 56 1.0448s 0.0143s 0.7232s judge 60 60 31.9354s 0.5323s 31.9354s evaluation 59 59 0.9784s 0.0166s 0.9784s score 48 48 5.7290s 0.1194s 5.7290s wrong_submission 42 15 0.8719s 0.0208s 0.3302s content_page 33 33 1.4321s 0.0434s 1.4321s activity_read_state 33 33 0.1128s 0.0034s 0.1128s identity 32 32 0.1947s 0.0061s 0.1947s provider 26 26 0.2237s 0.0086s 0.2237s annotation 18 18 0.1316s 0.0073s 0.1316s lti_provider 16 16 0.1104s 0.0069s 0.1104s smartschool_provider 16 16 0.1182s 0.0074s 0.1182s office365_provider 15 15 0.1127s 0.0075s 0.1127s api_token 15 15 0.1908s 0.0127s 0.1908s gsuite_provider 13 13 0.0995s 0.0077s 0.0995s saml_provider 11 11 0.0212s 0.0019s 0.0212s label 11 11 0.0399s 0.0036s 0.0399s programming_language 9 9 0.2052s 0.0228s 0.2052s rights_request 7 7 0.5774s 0.0825s 0.5774s course_submission 6 6 0.0429s 0.0072s 0.0429s temporary_user 5 5 0.1066s 0.0213s 0.1066s evaluation_exercise 5 1 0.0730s 0.0146s 0.0175s export 4 4 0.0827s 0.0207s 0.0827s notification 2 2 0.0127s 0.0064s 0.0127s activity_status

Total repo creations went from 1473 to 110 [TEST PROF INFO] Factories usage Total: 7236 Total top-level: 4270 Total time: 02:49.453 (out of 05:02.467) Total uniq factories: 37 total top-level total time time per call top-level time name 1458 435 8.9098s 0.0061s 2.4670s user 1283 262 49.6278s 0.0387s 7.7295s exercise 806 806 49.4764s 0.0614s 49.4764s submission 592 155 64.9395s 0.1097s 14.6166s correct_submission 543 325 15.7088s 0.0289s 12.9130s course 496 496 2.5864s 0.0052s 2.5864s student 384 269 44.1825s 0.1151s 31.5109s series 381 381 1.9889s 0.0052s 1.9889s staff 280 280 1.6451s 0.0059s 1.6451s zeus 157 54 0.3419s 0.0022s 0.1347s institution 110 109 9.2148s 0.0838s 9.2095s repository 97 97 0.8647s 0.0089s 0.8647s question 90 90 1.2293s 0.0137s 1.2293s score_item 73 56 0.7525s 0.0103s 0.6037s judge 60 60 24.0069s 0.4001s 24.0069s evaluation 59 59 0.8365s 0.0142s 0.8365s score 48 48 4.4368s 0.0924s 4.4368s wrong_submission 42 15 0.5212s 0.0124s 0.1424s content_page 33 33 1.1048s 0.0335s 1.1048s activity_read_state 33 33 0.0825s 0.0025s 0.0825s identity 32 32 0.1983s 0.0062s 0.1983s provider 26 26 0.1747s 0.0067s 0.1747s annotation 18 18 0.1188s 0.0066s 0.1188s lti_provider 16 16 0.0942s 0.0059s 0.0942s smartschool_provider 16 16 0.0981s 0.0061s 0.0981s office365_provider 15 15 0.0994s 0.0066s 0.0994s api_token 15 15 0.0889s 0.0059s 0.0889s gsuite_provider 13 13 0.0743s 0.0057s 0.0743s saml_provider 11 11 0.0270s 0.0025s 0.0270s programming_language 11 11 0.0217s 0.0020s 0.0217s label 9 9 0.1797s 0.0200s 0.1797s rights_request 7 7 0.5216s 0.0745s 0.5216s course_submission 6 6 0.0210s 0.0035s 0.0210s temporary_user 5 5 0.0685s 0.0137s 0.0685s evaluation_exercise 5 1 0.0580s 0.0116s 0.0198s export 4 4 0.0528s 0.0132s 0.0528s notification 2 2 0.0086s 0.0043s 0.0086s activity_status

bmesuere · 2021-08-31T16:27:48Z

Most of the factories are now optimized. The next step is going over the tests.

[TEST PROF INFO] Factories usage

 Total: 5800
 Total top-level: 4240
 Total time: 01:31.029 (out of 03:40.175)
 Total uniq factories: 37

   total   top-level     total time      time per call      top-level time               name

     806         806       18.0200s            0.0224s            18.0200s         submission
     688         421        5.3123s            0.0077s             2.8225s               user
     618         247       22.4584s            0.0363s             4.7895s           exercise
     592         155       22.4001s            0.0378s             4.7899s correct_submission
     543         325       11.7923s            0.0217s             9.0615s             course
     496         496        2.5912s            0.0052s             2.5912s            student
     384         269       25.1697s            0.0655s            15.8759s             series
     381         381        2.0298s            0.0053s             2.0298s              staff
     280         280        1.5473s            0.0055s             1.5473s               zeus
     157          54        0.4009s            0.0026s             0.1101s        institution
     110         109        9.0501s            0.0823s             9.0450s         repository
      97          97        0.4489s            0.0046s             0.4489s           question
      90          90        0.6898s            0.0077s             0.6898s         score_item
      73          56        0.6565s            0.0090s             0.5220s              judge
      60          60       13.9723s            0.2329s            13.9723s         evaluation
      59          59        0.4670s            0.0079s             0.4670s              score
      48          48        1.6266s            0.0339s             1.6266s   wrong_submission
      41          14        0.4463s            0.0109s             0.0895s       content_page
      33          33        0.8273s            0.0251s             0.8273s activity_read_state
      33          33        0.0834s            0.0025s             0.0834s           identity
      32          32        0.1714s            0.0054s             0.1714s           provider
      26          26        0.1662s            0.0064s             0.1662s         annotation
      18          18        0.1342s            0.0075s             0.1342s       lti_provider
      16          16        0.0881s            0.0055s             0.0881s smartschool_provider
      16          16        0.0847s            0.0053s             0.0847s office365_provider
      15          15        0.0822s            0.0055s             0.0822s    gsuite_provider
      15          15        0.1513s            0.0101s             0.1513s          api_token
      13          13        0.0923s            0.0071s             0.0923s      saml_provider
      11          11        0.0289s            0.0026s             0.0289s programming_language
      11          11        0.0212s            0.0019s             0.0212s              label
       9           9        0.1662s            0.0185s             0.1662s     rights_request
       7           7        0.2916s            0.0417s             0.2916s  course_submission
       6           6        0.0235s            0.0039s             0.0235s     temporary_user
       5           5        0.0834s            0.0167s             0.0834s evaluation_exercise
       5           1        0.0137s            0.0027s             0.0037s             export
       4           4        0.0204s            0.0051s             0.0204s       notification
       2           2        0.0109s            0.0054s             0.0109s    activity_status

28 -> 14; 1.5s

9 -> 5; 1.5s

38 -> 10; 1.5s

12 -> 5; 1.5s

113 -> 70; 3s

82 -> 18; 2s

265 -> 134; 20s repository stuff is slow

36 -> 19; 1.5s

62 -> 44; 24s

638 -> 74; 4s

135 -> 80; 3s

bmesuere · 2021-09-01T17:38:13Z

After going over the model tests, this is the result:

[TEST PROF INFO] Factories usage

 Total: 4552
 Total top-level: 3316
 Total time: 01:03.972 (out of 02:52.600)
 Total uniq factories: 37

   total   top-level     total time      time per call      top-level time               name

     541         155       18.3567s            0.0339s             4.7396s correct_submission
     532         184       17.5621s            0.0330s             3.5094s           exercise
     524         290        3.7573s            0.0072s             1.7162s               user
     487         487        2.2346s            0.0046s             2.2346s            student
     378         378        1.7208s            0.0046s             1.7208s              staff
     369         265       18.6435s            0.0505s            12.3490s             series
     275         261        7.2931s            0.0265s             7.1509s             course
     272         272        1.4159s            0.0052s             1.4159s               zeus
     267         267        8.2523s            0.0309s             8.2523s         submission
     137          34        0.2951s            0.0022s             0.0640s        institution
      97          97        0.4250s            0.0044s             0.4250s           question
      91          90        6.8471s            0.0752s             6.8414s         repository
      72          72        0.4979s            0.0069s             0.4979s         score_item
      61          44        0.5576s            0.0091s             0.3818s              judge
      49          49        8.3128s            0.1696s             8.3128s         evaluation
      49          49        0.3305s            0.0067s             0.3305s              score
      48          48        1.6108s            0.0336s             1.6108s   wrong_submission
      38          13        0.3989s            0.0105s             0.0797s       content_page
      33          33        0.0820s            0.0025s             0.0820s           identity
      33          33        0.8317s            0.0252s             0.8317s activity_read_state
      27          27        0.1432s            0.0053s             0.1432s           provider
      20          20        0.1175s            0.0059s             0.1175s         annotation
      18          18        0.1305s            0.0073s             0.1305s       lti_provider
      16          16        0.0952s            0.0060s             0.0952s office365_provider
      16          16        0.1131s            0.0071s             0.1131s smartschool_provider
      15          15        0.0896s            0.0060s             0.0896s    gsuite_provider
      14          14        0.0660s            0.0047s             0.0660s          api_token
      13          13        0.0875s            0.0067s             0.0875s      saml_provider
      11          11        0.0243s            0.0022s             0.0243s programming_language
      11          11        0.0169s            0.0015s             0.0169s              label
       9           9        0.1618s            0.0180s             0.1618s     rights_request
       7           7        0.2572s            0.0367s             0.2572s  course_submission
       6           6        0.0228s            0.0038s             0.0228s     temporary_user
       5           1        0.0187s            0.0037s             0.0078s             export
       5           5        0.0626s            0.0125s             0.0626s evaluation_exercise
       4           4        0.0213s            0.0053s             0.0213s       notification
       2           2        0.0095s            0.0048s             0.0095s    activity_status

221 -> 95; 14.5s

283 -> 190; 11s

1084 -> 313; 23s

bmesuere · 2021-09-02T16:39:19Z

Final result

[TEST PROF INFO] Factories usage

 Total: 2973
 Total top-level: 2132
 Total time: 00:41.293 (out of 02:13.412)
 Total uniq factories: 37

   total   top-level     total time      time per call      top-level time               name

     396         124        9.2689s            0.0234s             2.2574s           exercise
     389         147       10.8842s            0.0280s             3.4910s correct_submission
     355         219        2.1821s            0.0061s             1.1838s               user
     317         262       10.0952s            0.0318s             8.0331s             series
     267         267        6.7233s            0.0252s             6.7233s         submission
     151         140        2.1120s            0.0140s             2.0212s             course
     127         127        0.5323s            0.0042s             0.5323s            student
     120         120        0.5075s            0.0042s             0.5075s              staff
     115          23        0.1942s            0.0017s             0.0374s        institution
      91          90        5.3420s            0.0587s             5.3373s         repository
      72          72        0.4102s            0.0057s             0.4102s         score_item
      67          67        0.2378s            0.0035s             0.2378s           question
      61          44        0.4190s            0.0069s             0.3006s              judge
      49          49        6.6304s            0.1353s             6.6304s         evaluation
      49          49        0.2608s            0.0053s             0.2608s              score
      40          40        1.2446s            0.0311s             1.2446s   wrong_submission
      33          33        0.6736s            0.0204s             0.6736s activity_read_state
      33          33        0.0692s            0.0021s             0.0692s           identity
      27          27        0.1333s            0.0049s             0.1333s           provider
      24          13        0.2171s            0.0090s             0.0833s       content_page
      20          20        0.0889s            0.0044s             0.0889s               zeus
      19          19        0.1031s            0.0054s             0.1031s         annotation
      18          18        0.1155s            0.0064s             0.1155s       lti_provider
      16          16        0.0775s            0.0048s             0.0775s office365_provider
      16          16        0.0794s            0.0050s             0.0794s smartschool_provider
      15          15        0.0792s            0.0053s             0.0792s    gsuite_provider
      14          14        0.0472s            0.0034s             0.0472s          api_token
      13          13        0.0781s            0.0060s             0.0781s      saml_provider
      11          11        0.0194s            0.0018s             0.0194s programming_language
      11          11        0.0147s            0.0013s             0.0147s              label
       9           9        0.1590s            0.0177s             0.1590s     rights_request
       6           6        0.1636s            0.0273s             0.1636s  course_submission
       6           6        0.0201s            0.0033s             0.0201s     temporary_user
       5           1        0.0143s            0.0029s             0.0020s             export
       5           5        0.0434s            0.0087s             0.0434s evaluation_exercise
       4           4        0.0257s            0.0064s             0.0257s       notification
       2           2        0.0090s            0.0045s             0.0090s    activity_status

add test-prof

59a0097

bmesuere added the chore Repository/build/dependency maintenance label Aug 30, 2021

bmesuere force-pushed the feature/faster-tests branch from a156dd0 to 1c05c89 Compare August 31, 2021 09:16

bmesuere added 2 commits August 31, 2021 11:24

bmesuere force-pushed the feature/faster-tests branch from 8c6635f to 43d6f20 Compare August 31, 2021 11:17

bmesuere force-pushed the feature/faster-tests branch from 7c25626 to 980608c Compare August 31, 2021 12:42

bmesuere added 2 commits August 31, 2021 15:40

add user fixtures

7ac9974

simplify submission factory

1eeaa49

bmesuere force-pushed the feature/faster-tests branch 2 times, most recently from c6fd29a to 381d345 Compare August 31, 2021 15:42

use user and exercise fixtures when generating submissions

208e109

bmesuere force-pushed the feature/faster-tests branch from 381d345 to 208e109 Compare August 31, 2021 16:02

add course fixture

78b0bec

bmesuere force-pushed the feature/faster-tests branch from de6d0f9 to 78b0bec Compare August 31, 2021 18:02

bmesuere added 11 commits September 1, 2021 14:10

optimize activity test

2d6bfd8

28 -> 14; 1.5s

optimize activity status test

fdbf5db

9 -> 5; 1.5s

optimize annotation test

e6dcc75

38 -> 10; 1.5s

rubocop

19de66e

optimize api_token test

a2d23f3

12 -> 5; 1.5s

optimize course test

9e85809

113 -> 70; 3s

optimize evaluation exercise test

146af27

82 -> 18; 2s

optimize evaluation test

15afd1f

82 -> 18; 2s

optimize exercise test

2a1dd5f

265 -> 134; 20s repository stuff is slow

optimize institution test

0f75a1b

36 -> 19; 1.5s

optimize repo test

f5ead85

62 -> 44; 24s

bmesuere force-pushed the feature/faster-tests branch from 9ad5ef0 to f5ead85 Compare September 1, 2021 15:34

bmesuere added 2 commits September 1, 2021 18:44

optimize submission test

11c6eb6

638 -> 74; 4s

optimize user tests

951e9f6

135 -> 80; 3s

optimize activities controller test

eff4bb0

221 -> 95; 14.5s

bmesuere force-pushed the feature/faster-tests branch from 5c1a2b1 to eff4bb0 Compare September 2, 2021 08:24

bmesuere added 4 commits September 2, 2021 11:03

optimize annotations controller test

2368447

283 -> 190; 11s

optimize courses controller tests

1f28bfb

1084 -> 313; 23s

opzitmize e* controller tests

136e4d4

optimize the rest of the controller tests

5f7b2f2

add info to the readme on how to run tests

208691b

bmesuere marked this pull request as ready for review September 2, 2021 16:48

bmesuere requested review from chvp and a team as code owners September 2, 2021 16:48

bmesuere requested review from niknetniko and removed request for a team September 2, 2021 16:48

chvp approved these changes Sep 6, 2021

View reviewed changes

niknetniko approved these changes Sep 6, 2021

View reviewed changes

bmesuere merged commit f99cf47 into develop Sep 6, 2021

bmesuere deleted the feature/faster-tests branch September 6, 2021 16:28

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Improve test performance #3052

Improve test performance #3052

bmesuere commented Aug 30, 2021 •

edited

Loading

bmesuere commented Aug 31, 2021

bmesuere commented Sep 1, 2021

bmesuere commented Sep 2, 2021

Improve test performance #3052

Improve test performance #3052

Conversation

bmesuere commented Aug 30, 2021 • edited Loading

bmesuere commented Aug 31, 2021

bmesuere commented Sep 1, 2021

bmesuere commented Sep 2, 2021

bmesuere commented Aug 30, 2021 •

edited

Loading