You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 13:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri Aug 07, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23032991083,97cyclictest0-21swapper/009:53:520
23040991075,13cyclictest0-21swapper/310:48:443
23032991013,89cyclictest25628-21tune2fs10:43:510
23040991005,14cyclictest0-21swapper/308:10:063
2304099995,14cyclictest0-21swapper/310:40:313
2304099994,13cyclictest0-21swapper/309:30:443
2303299994,52cyclictest26996-21kworker/0:209:23:360
2304099984,69cyclictest0-21swapper/311:13:443
2304099984,13cyclictest18301-21munin-node10:33:433
2303299983,89cyclictest0-21swapper/009:59:200
2304099975,13cyclictest0-21swapper/309:27:593
2304099974,15cyclictest0-21swapper/308:18:513
2303299973,87cyclictest0-21swapper/011:21:230
2303299973,86cyclictest0-21swapper/010:18:450
2304099964,64cyclictest7224-21ssh11:04:003
2304099964,64cyclictest7224-21ssh11:04:003
2304099964,14cyclictest0-21swapper/311:13:323
2304099964,13cyclictest0-21swapper/311:28:483
23040999613,9cyclictest1447-21ssh10:08:343
2303799966,14cyclictest0-21swapper/108:10:541
2304099955,68cyclictest0-21swapper/310:59:453
2304099955,15cyclictest0-21swapper/310:24:333
2304099954,13cyclictest0-21swapper/309:58:573
2304099945,14cyclictest0-21swapper/310:23:333
2304099945,13cyclictest0-21swapper/309:43:403
2304099944,14cyclictest0-21swapper/309:15:383
2303299943,85cyclictest0-21swapper/007:58:560
2303299943,78cyclictest1227-21runrttasks10:24:210
2304099936,70cyclictest0-21swapper/309:01:003
2304099935,69cyclictest0-21swapper/308:36:563
2304099934,73cyclictest0-21swapper/310:14:293
2304099934,70cyclictest0-21swapper/308:27:473
2304099934,64cyclictest0-21swapper/309:13:363
2304099934,64cyclictest0-21swapper/309:13:363
2303299934,82cyclictest0-21swapper/008:27:110
2303299934,69cyclictest0-21swapper/008:39:000
2304099926,10cyclictest12878-21ssh09:34:103
2304099925,14cyclictest0-21swapper/309:50:323
2304099925,14cyclictest0-21swapper/309:50:323
2304099924,15cyclictest0-21swapper/310:08:503
23040999217,52cyclictest0-21swapper/311:26:103
23040999211,9cyclictest107550irq/46-eth011:18:503
2303799925,44cyclictest0-21swapper/108:49:081
2303299924,81cyclictest0-21swapper/009:14:080
2303299924,80cyclictest0-21swapper/010:48:590
2303299924,79cyclictest0-21swapper/009:25:350
2304099915,71cyclictest0-21swapper/308:33:113
2304099915,71cyclictest0-21swapper/308:33:113
2304099915,63cyclictest0-21swapper/306:13:543
2304099915,62cyclictest0-21swapper/309:07:303
2304099915,61cyclictest0-21swapper/308:53:413
2304099914,63cyclictest0-21swapper/309:43:213
2304099914,14cyclictest0-21swapper/308:13:513
2304099914,13cyclictest0-21swapper/309:21:153
2304099914,13cyclictest0-21swapper/308:44:093
2304099914,13cyclictest0-21swapper/307:38:183
2303299914,73cyclictest0-21swapper/006:19:210
2304099905,65cyclictest0-21swapper/310:46:133
2304099905,13cyclictest0-21swapper/306:23:593
2304099905,13cyclictest0-21swapper/306:23:593
23040999021,49cyclictest16049-21ssh10:28:553
23040999015,52cyclictest0-21swapper/308:08:243
23037999037,10cyclictest11544-21tr07:53:531
2303299904,79cyclictest0-21swapper/009:00:170
2303299904,78cyclictest0-21swapper/008:54:070
2303299904,68cyclictest0-21swapper/011:03:450
2303299904,68cyclictest0-21swapper/011:03:450
2303299903,79cyclictest0-21swapper/008:43:530
2303299903,79cyclictest0-21swapper/008:36:140
2304099895,14cyclictest0-21swapper/306:28:573
2304099894,15cyclictest0-21swapper/307:54:093
2304099894,13cyclictest0-21swapper/310:58:333
23040998916,51cyclictest0-21swapper/307:00:213
2303299896,67cyclictest0-21swapper/010:03:440
2303299894,78cyclictest0-21swapper/010:54:040
2303299894,60cyclictest0-21swapper/010:59:250
2303299893,79cyclictest0-21swapper/009:45:440
2303299893,78cyclictest0-21swapper/010:32:170
2303299893,77cyclictest0-21swapper/011:17:550
2303299893,50cyclictest0-21swapper/008:10:090
2304099884,70cyclictest0-21swapper/308:51:103
2304099884,65cyclictest0-21swapper/309:54:073
2303299884,77cyclictest0-21swapper/010:08:560
2303299884,77cyclictest0-21swapper/006:49:000
2303299884,76cyclictest0-21swapper/006:38:590
2303299884,67cyclictest0-21swapper/011:08:440
2303299883,78cyclictest0-21swapper/008:52:060
2303299883,77cyclictest0-21swapper/008:19:460
2304099874,63cyclictest0-21swapper/308:38:593
2304099874,59cyclictest0-21swapper/307:08:533
2304099874,59cyclictest0-21swapper/307:08:533
23040998718,46cyclictest0-21swapper/306:19:143
23040998715,50cyclictest0-21swapper/307:18:153
23032998740,41cyclictest0-21swapper/009:08:590
23032998740,41cyclictest0-21swapper/009:08:590
2303299874,77cyclictest0-21swapper/006:59:030
2303299874,76cyclictest12486-21kworker/0:008:08:150
2303299873,76cyclictest0-21swapper/008:28:470
2303299873,76cyclictest0-21swapper/008:28:470
2303299873,53cyclictest20799-21missed_timers07:04:060
2304099865,67cyclictest0-21swapper/307:19:443
2304099865,58cyclictest0-21swapper/307:08:143
2303799865,14cyclictest0-21swapper/108:23:541
2303299864,75cyclictest0-21swapper/009:41:440
2303299864,75cyclictest0-21swapper/006:24:020
2303299864,75cyclictest0-21swapper/006:24:020
2303299864,74cyclictest0-21swapper/009:28:500
2303299863,76cyclictest0-21swapper/008:14:030
2303299863,68cyclictest0-21swapper/010:39:140
2303299863,66cyclictest0-21swapper/009:33:380
2303299854,63cyclictest0-21swapper/009:03:400
2303299853,74cyclictest0-21swapper/006:33:430
23040998418,52cyclictest0-21swapper/306:09:043
2303299844,8cyclictest26664-21cat07:18:410
2303299844,73cyclictest0-21swapper/011:24:060
2303299844,73cyclictest0-21swapper/006:04:030
2303299844,72cyclictest0-21swapper/007:48:510
2303299844,72cyclictest0-21swapper/007:48:510
2303299843,74cyclictest0-21swapper/010:33:470
2303299843,62cyclictest0-21swapper/010:13:360
2304099834,59cyclictest0-21swapper/306:43:533
2304099834,54cyclictest0-21swapper/307:33:403
2303299834,72cyclictest0-21swapper/006:33:550
2303299834,71cyclictest0-21swapper/006:13:440
2303299833,73cyclictest0-21swapper/009:52:520
2303299833,73cyclictest0-21swapper/009:52:520
2303299833,72cyclictest23367-21ssh11:28:540
2303299824,70cyclictest12956-21grep07:54:120
2304099815,16cyclictest0-21swapper/306:53:413
2304099814,13cyclictest0-21swapper/307:43:523
2303299813,69cyclictest0-21swapper/007:29:030
2303299813,49cyclictest0-21swapper/007:23:540
2304099805,14cyclictest0-21swapper/306:38:533
2304099804,14cyclictest0-21swapper/306:54:123
23040998022,51cyclictest1227-21runrttasks07:27:353
2303299804,68cyclictest23034-21basename06:03:430
2304099798,61cyclictest0-21swapper/307:43:403
2304099795,13cyclictest0-21swapper/307:48:493
2304099795,13cyclictest0-21swapper/307:48:493
2304099794,55cyclictest0-21swapper/307:58:503
2304099794,55cyclictest0-21swapper/306:33:543
2303299784,67cyclictest8600-21latency_hist07:48:400
2303299784,67cyclictest0-21swapper/007:08:550
2303299784,67cyclictest0-21swapper/007:08:550
2303299774,54cyclictest0-21swapper/006:53:510
23040997621,46cyclictest0-21swapper/306:04:143
2303299763,48cyclictest5214-21missed_timers07:39:040
2303299763,37cyclictest0-21swapper/006:14:130
2303299754,63cyclictest0-21swapper/006:43:540
2303299753,45cyclictest0-21swapper/007:23:160
2303299743,64cyclictest0-21swapper/007:38:070
219499720,6rtkit-daemon0-21swapper/206:14:122
2304099716,11cyclictest23106-21runrttasks06:03:443
219499640,6rtkit-daemon2193-21rtkit-daemon08:14:141
2303999629,32cyclictest6304-21ssh10:13:592
2303999615,49cyclictest0-21swapper/211:13:552
23039996110,43cyclictest1227-21runrttasks10:44:392
2303799615,37cyclictest0-21swapper/111:05:121
2303799615,37cyclictest0-21swapper/111:05:121
219499610,4rtkit-daemon2193-21rtkit-daemon07:03:551
2303999606,33cyclictest0-21swapper/209:08:532
2303999606,33cyclictest0-21swapper/209:08:532
23039996010,43cyclictest1227-21runrttasks07:24:002
219499600,6rtkit-daemon2193-21rtkit-daemon06:28:561
219499600,10rtkit-daemon0-21swapper/107:48:381
2303999594,47cyclictest0-21swapper/210:38:502
2303999594,22cyclictest0-21swapper/209:55:562
2303999586,45cyclictest0-21swapper/209:18:282
2303999586,42cyclictest0-21swapper/211:04:372
2303999586,42cyclictest0-21swapper/211:04:372
2303999585,15cyclictest23464-21tail11:28:552
23039995812,38cyclictest10499-21basename08:43:502
23039995811,31cyclictest18852-21grep08:54:112
41792572,48sleep10-21swapper/110:11:001
2303999577,42cyclictest0-21swapper/208:14:102
2303999576,44cyclictest0-21swapper/206:19:022
2303999576,43cyclictest0-21swapper/210:54:182
2303999575,22cyclictest0-21swapper/210:35:552
2303999574,46cyclictest0-21swapper/208:08:492
263892563,11sleep10-21swapper/110:44:051
2303999569,41cyclictest20183-21needreboot11:23:562
2303999566,44cyclictest0-21swapper/210:03:452
2303999565,32cyclictest0-21swapper/208:31:122
2303999565,32cyclictest0-21swapper/208:31:122
2303999562,34cyclictest0-21swapper/210:58:522
23039995615,26cyclictest0-21swapper/210:32:532
23039995610,39cyclictest17907-21ssh09:43:472
23039995610,38cyclictest0-21swapper/209:28:562
23037995639,10cyclictest17422-21unixbench_multi11:19:051
2303799563,46cyclictest0-21swapper/109:47:381
107902562,11sleep10-21swapper/107:51:151
107902562,11sleep10-21swapper/107:51:151
2303999559,39cyclictest23947-21uniq06:04:012
2303999559,38cyclictest26283-21seq09:07:042
2303999558,40cyclictest0-21swapper/209:39:542
2303999556,41cyclictest15731-21taskset08:49:312
2303999555,31cyclictest31692-21taskset07:28:542
2303999554,43cyclictest0-21swapper/208:39:022
2303999554,30cyclictest0-21swapper/206:33:552
2303999554,29cyclictest0-21swapper/210:48:512
23039995539,10cyclictest0-21swapper/210:08:572
23039995517,21cyclictest17468-21gzip08:04:082
23039995514,35cyclictest0-21swapper/209:59:102
23039995510,28cyclictest9591-21fschecks_time07:48:572
23039995510,28cyclictest9591-21fschecks_time07:48:572
2303799555,42cyclictest0-21swapper/109:39:331
2303799554,43cyclictest0-21swapper/109:19:021
2303799554,43cyclictest0-21swapper/108:53:461
2303799554,31cyclictest0-21swapper/110:38:331
130082553,11sleep10-21swapper/109:34:231
65932542,11sleep10-21swapper/109:24:561
231852543,45sleep10-21swapper/109:50:401
231852543,45sleep10-21swapper/109:50:401
2303999545,42cyclictest0-21swapper/209:49:022
2303999545,42cyclictest0-21swapper/209:49:022
2303999543,44cyclictest0-21swapper/208:25:352
23039995413,27cyclictest0-21swapper/208:38:292
23039995411,35cyclictest29248-21crond08:23:382
23039995410,37cyclictest9728-21munin-node10:19:012
23039995410,37cyclictest12357-21latency_hist06:48:422
2303799546,15cyclictest0-21swapper/110:14:441
2303799545,30cyclictest0-21swapper/108:59:071
2303799545,28cyclictest0-21swapper/109:28:541
2303799544,42cyclictest0-21swapper/108:19:061
2303799544,13cyclictest19522-21df_abs11:23:471
58872533,11sleep10-21swapper/107:39:351
258662532,43sleep125641-21munin-node06:08:581
2303999537,39cyclictest6508-21telnet07:43:512
2303999534,43cyclictest0-21swapper/209:36:102
2303999534,42cyclictest0-21swapper/211:18:432
2303999534,33cyclictest0-21swapper/209:00:082
23039995337,11cyclictest0-21swapper/211:08:482
2303999533,33cyclictest0-21swapper/209:23:432
2303799535,28cyclictest0-21swapper/106:19:151
2303799535,27cyclictest0-21swapper/110:38:451
2303799534,30cyclictest0-21swapper/110:53:511
23037995332,12cyclictest28872-21gltestperf06:14:031
23037995321,12cyclictest1124-21snmpd11:08:541
23037995319,12cyclictest16647-21yum06:54:171
34742522,43sleep10-21swapper/108:33:041
34742522,43sleep10-21swapper/108:33:041
2303999527,39cyclictest11680-21ssh10:23:382
2303999527,37cyclictest24410-21munin-node07:14:072
2303999523,35cyclictest0-21swapper/206:38:522
23039995216,21cyclictest3012-21unixbench_multi09:19:102
2303799525,28cyclictest0-21swapper/109:13:511
2303799525,28cyclictest0-21swapper/107:19:161
2303799525,27cyclictest0-21swapper/109:59:061
2303799525,10cyclictest30045-21yum10:49:111
2303799524,31cyclictest0-21swapper/111:16:311
2303799524,29cyclictest0-21swapper/107:28:541
2303799524,28cyclictest0-21swapper/106:24:071
2303799524,28cyclictest0-21swapper/106:24:071
23037995231,13cyclictest29968-21crond09:13:361
23037995231,13cyclictest29968-21crond09:13:361
2303799523,27cyclictest0-21swapper/106:43:421
23037995229,15cyclictest0-21swapper/108:44:451
23037995220,13cyclictest0-21swapper/109:58:361
256092512,7sleep11555-21nscd09:04:281
2303999517,11cyclictest1124-21snmpd07:08:582
2303999517,11cyclictest1124-21snmpd07:08:582
2303999514,29cyclictest0-21swapper/206:24:132
2303999514,29cyclictest0-21swapper/206:24:132
2303799515,27cyclictest0-21swapper/108:34:021
2303799514,41cyclictest0-21swapper/111:01:121
2303799514,31cyclictest0-21swapper/110:27:121
2303799514,28cyclictest0-21swapper/108:42:311
2303799514,27cyclictest0-21swapper/110:32:351
2303799514,27cyclictest0-21swapper/110:04:001
2303799514,27cyclictest0-21swapper/106:43:581
23037995120,13cyclictest0-21swapper/110:20:401
252382502,41sleep10-21swapper/106:06:361
2303999505,38cyclictest4393-21grep07:38:542
2303999504,28cyclictest0-21swapper/207:03:592
2303799505,25cyclictest0-21swapper/108:03:441
2303799504,28cyclictest0-21swapper/111:28:421
2303799503,28cyclictest0-21swapper/106:48:551
191342504,7sleep10-21swapper/107:00:211
71022494,39sleep10-21swapper/106:34:211
37342492,41sleep10-21swapper/107:37:411
2303999497,35cyclictest0-21swapper/207:18:522
2303999495,27cyclictest0-21swapper/208:03:232
2303999494,28cyclictest0-21swapper/207:54:082
2303999494,28cyclictest0-21swapper/206:54:072
23039994920,13cyclictest0-21swapper/207:03:412
23039994920,12cyclictest0-21swapper/207:34:002
2303799494,27cyclictest0-21swapper/107:14:091
2303999484,27cyclictest0-21swapper/206:03:442
2303999483,21cyclictest25701-21tail06:08:552
23039994810,33cyclictest3429-21df_abs06:28:592
157022482,11sleep10-21swapper/108:02:521
2303999477,12cyclictest12504-21aten_r1power_en06:48:542
225932473,39sleep10-21swapper/107:09:001
225932473,39sleep10-21swapper/107:09:001
227192464,35sleep10-21swapper/106:00:041
2303799455,33cyclictest0-21swapper/107:23:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional