You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 05:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Jul 29, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1452599984,67cyclictest0-21swapper/021:18:090
1452599984,67cyclictest0-21swapper/021:18:090
1452599965,84cyclictest2697-21cpuspeed_turbos21:42:450
1452599964,86cyclictest0-21swapper/021:57:430
1452599964,86cyclictest0-21swapper/021:57:430
1452599964,85cyclictest0-21swapper/023:37:220
1452599954,85cyclictest0-21swapper/023:12:420
1452599954,84cyclictest0-21swapper/023:37:530
1452599953,85cyclictest0-21swapper/023:27:520
1452599945,81cyclictest0-21swapper/021:40:380
1452599945,71cyclictest0-21swapper/022:52:470
1452599944,84cyclictest0-21swapper/022:26:250
1452599944,83cyclictest0-21swapper/019:22:480
14529999335,51cyclictest9829-21taskset21:52:501
14529999329,57cyclictest16386-21cpuspeed_turbos22:52:441
1452599935,81cyclictest0-21swapper/022:02:520
1452599935,50cyclictest0-21swapper/022:28:250
1452599934,83cyclictest0-21swapper/020:18:080
1452599934,82cyclictest0-21swapper/023:11:440
1452599925,81cyclictest1227-21runrttasks20:48:030
1452599924,68cyclictest0-21swapper/020:12:500
1452599916,68cyclictest0-21swapper/022:15:020
1452599915,66cyclictest0-21swapper/018:17:520
1452599915,52cyclictest1166-21munin-node23:17:530
1452599915,52cyclictest1166-21munin-node23:17:530
1452599914,80cyclictest0-21swapper/021:05:570
1452599914,71cyclictest0-21swapper/021:34:580
1452599914,68cyclictest28376-21gltestperf20:42:530
1452599913,81cyclictest0-21swapper/022:37:450
1452599906,50cyclictest10834-21yum-updatesd-he21:53:140
1452599904,79cyclictest0-21swapper/022:42:590
1452599904,79cyclictest0-21swapper/022:42:590
1452599904,68cyclictest0-21swapper/023:24:570
1452599904,66cyclictest0-21swapper/021:23:000
1452599895,77cyclictest0-21swapper/021:47:440
1452599894,78cyclictest0-21swapper/022:18:430
1452599894,78cyclictest0-21swapper/020:27:460
1452599894,69cyclictest0-21swapper/022:33:270
1452599894,61cyclictest0-21swapper/020:54:370
1452599893,79cyclictest14186-21processes22:48:000
14529998827,52cyclictest10681-21ssh21:04:531
1452599889,50cyclictest0-21swapper/020:25:580
1452599884,56cyclictest0-21swapper/021:08:030
1452599884,54cyclictest0-21swapper/018:58:500
1452599883,69cyclictest0-21swapper/022:07:440
14529998734,29cyclictest5473-21latency_hist21:47:311
1452599875,67cyclictest0-21swapper/023:01:210
1452599874,57cyclictest0-21swapper/020:35:000
1452599874,50cyclictest0-21swapper/020:41:440
1452599874,50cyclictest0-21swapper/020:41:440
1452599873,77cyclictest0-21swapper/021:13:070
1452599873,64cyclictest25535-21fschecks_time21:27:480
1452599873,52cyclictest107550irq/46-eth023:03:040
14529998632,47cyclictest29174-21cut18:42:501
1452599864,51cyclictest0-21swapper/018:12:540
1452599863,61cyclictest0-21swapper/021:01:300
1452599862,78cyclictest0-21swapper/019:52:090
14529998535,43cyclictest15166-21unixbench_singl23:38:001
1452599845,58cyclictest0-21swapper/020:09:280
1452599844,59cyclictest0-21swapper/019:28:080
1452599834,73cyclictest0-21swapper/018:32:510
1452599834,73cyclictest0-21swapper/018:32:510
1452599834,49cyclictest0-21swapper/018:38:090
14529998234,41cyclictest16741-21unixbench_singl21:13:061
1452599824,71cyclictest0-21swapper/019:57:510
14529998134,41cyclictest1227-21runrttasks20:45:011
1452599814,70cyclictest0-21swapper/019:02:550
219499800,4rtkit-daemon2193-21rtkit-daemon21:02:533
1452599804,70cyclictest0-21swapper/019:08:440
1452599804,69cyclictest0-21swapper/019:17:500
1452599804,69cyclictest0-21swapper/018:43:110
1452599804,51cyclictest107550irq/46-eth019:53:210
14525998038,34cyclictest2107-21cut18:52:560
14529997929,43cyclictest12650-21munin-node21:57:471
14529997929,43cyclictest12650-21munin-node21:57:471
1452599794,69cyclictest0-21swapper/019:37:510
14529997831,39cyclictest28563-21fschecks_time19:47:551
14529997830,41cyclictest23232-21diskstats23:02:451
14529997824,47cyclictest0-21swapper/120:02:351
1452599784,57cyclictest0-21swapper/018:29:110
14525997835,37cyclictest754-21unixbench_singl18:48:140
14529997737,34cyclictest1227-21runrttasks20:18:491
14529997732,27cyclictest1227-21runrttasks23:23:471
14529997730,40cyclictest28307-21sort21:32:451
1452599775,66cyclictest0-21swapper/019:17:370
1452599775,66cyclictest0-21swapper/019:17:370
1452599774,67cyclictest0-21swapper/019:37:360
1452599774,66cyclictest0-21swapper/020:07:360
14529997631,39cyclictest7274-21diskmemload22:38:021
14529997629,31cyclictest3516-21entropy22:32:471
14529997628,41cyclictest147421ssh22:48:261
14529997627,42cyclictest0-21swapper/122:13:431
14529997625,11cyclictest11384-21awk19:12:511
14529997625,11cyclictest11384-21awk19:12:511
14529997623,46cyclictest0-21swapper/120:55:071
14529997529,38cyclictest20902-21ssh22:09:021
14529997528,41cyclictest31677-21cpuspeed_turbos21:37:441
14529997528,40cyclictest15094-21munin-node20:22:551
14529997524,15cyclictest0-21swapper/121:48:491
14529997522,47cyclictest0-21swapper/123:12:281
1452599754,62cyclictest14514-21cyclictest18:12:390
1452599754,62cyclictest0-21swapper/018:23:030
14529997435,34cyclictest23384-21awk21:23:071
14529997421,46cyclictest0-21swapper/120:33:131
1452599744,60cyclictest0-21swapper/019:47:250
14529997330,37cyclictest10304-21rm22:42:471
14529997330,37cyclictest10304-21rm22:42:471
14529997330,36cyclictest18216-21munin-node21:18:041
14529997330,36cyclictest18216-21munin-node21:18:041
14529997329,37cyclictest14843-21aten2.4-expect18:12:551
14529997326,40cyclictest0-21swapper/120:32:341
14529997322,43cyclictest0-21swapper/123:22:271
14529997322,43cyclictest0-21swapper/123:22:271
219499720,10rtkit-daemon0-21swapper/018:43:212
14529997229,37cyclictest12788-21memory21:07:561
14529997229,36cyclictest7563-21chrt21:00:361
14529997228,37cyclictest9969-21latency_hist23:32:281
14529997225,41cyclictest18378-21ssh22:06:581
14529997224,42cyclictest0-21swapper/122:17:461
14529997223,43cyclictest0-21swapper/118:32:551
14529997223,43cyclictest0-21swapper/118:32:551
14529997220,44cyclictest0-21swapper/121:27:431
14529997128,37cyclictest29607-21sh23:12:411
14529997127,37cyclictest9703-21runrttasks20:14:561
14529997126,11cyclictest1227-21runrttasks22:29:511
14529997125,40cyclictest30604-21ssh22:23:311
1453099704,29cyclictest0-21swapper/223:32:272
14529997038,26cyclictest24799-21unixbench_singl19:38:091
14529997027,37cyclictest1227-21runrttasks22:59:321
14529997026,38cyclictest12229-21sh23:34:091
14529996933,29cyclictest1227-21runrttasks18:53:171
14529996931,17cyclictest21293-21munin-node18:23:131
14529996927,25cyclictest31499-21ntp_states19:53:051
14529996923,29cyclictest0-21swapper/120:37:481
14529996923,29cyclictest0-21swapper/120:37:481
14529996922,38cyclictest0-21swapper/120:02:521
14529996825,37cyclictest30803-21awk20:47:451
14529996821,41cyclictest0-21swapper/119:42:481
219499670,6rtkit-daemon0-21swapper/118:40:061
219499670,5rtkit-daemon2193-21rtkit-daemon23:12:412
14529996726,11cyclictest21905-21munin-node18:27:501
14529996720,30cyclictest0-21swapper/118:59:161
14529996627,11cyclictest16368-21df_abs19:22:511
14529996623,37cyclictest18805-21unixbench-2d18:18:141
219499650,5rtkit-daemon2193-21rtkit-daemon20:42:542
14530996520,23cyclictest0-21swapper/222:12:102
14529996527,32cyclictest9751-21iostat_ios19:07:591
52712644,13sleep30-21swapper/322:34:553
219499630,18rtkit-daemon2193-21rtkit-daemon22:52:113
1453099634,35cyclictest0-21swapper/222:52:472
14530996320,26cyclictest1227-21runrttasks21:17:242
14529996331,25cyclictest7418-21latency19:03:001
14529996323,15cyclictest0-21swapper/119:22:381
14529996235,19cyclictest19064-21fschecks_time19:27:561
14529996218,38cyclictest0-21swapper/120:07:471
267922614,50sleep30-21swapper/320:40:523
267922614,50sleep30-21swapper/320:40:523
219499610,5rtkit-daemon2193-21rtkit-daemon20:27:552
1453099618,32cyclictest0-21swapper/222:06:412
1453099614,36cyclictest0-21swapper/223:36:372
1453099613,37cyclictest0-21swapper/221:50:282
14530996127,27cyclictest7519-21munin-node20:12:562
14530996112,27cyclictest0-21swapper/222:42:442
14530996112,27cyclictest0-21swapper/222:42:442
14529996140,15cyclictest32045-21fschecks_count18:47:581
14529996136,18cyclictest22745-21runrttasks19:36:411
219499600,9rtkit-daemon0-21swapper/221:29:152
219499600,7rtkit-daemon0-21swapper/219:54:032
219499600,4rtkit-daemon29-21ksoftirqd/222:35:572
219499600,3rtkit-daemon0-21swapper/223:20:482
219499600,3rtkit-daemon0-21swapper/223:20:482
219499600,3rtkit-daemon0-21swapper/221:27:222
219499600,2rtkit-daemon0-21swapper/223:00:262
219499600,19rtkit-daemon2193-21rtkit-daemon22:48:262
1453199604,41cyclictest0-21swapper/323:00:483
1453099604,37cyclictest0-21swapper/221:37:302
14530996022,30cyclictest6340-21aten_r1power_vo22:37:422
219499590,9rtkit-daemon0-21swapper/222:16:352
219499590,9rtkit-daemon0-21swapper/221:41:222
219499590,9rtkit-daemon0-21swapper/220:48:162
219499590,5rtkit-daemon26-21rcuc/222:20:432
219499590,4rtkit-daemon29-21ksoftirqd/223:11:412
219499590,4rtkit-daemon2193-21rtkit-daemon21:55:442
219499590,3rtkit-daemon0-21swapper/219:10:052
219499580,6rtkit-daemon26-21rcuc/221:20:302
219499580,6rtkit-daemon26-21rcuc/221:20:302
219499580,4rtkit-daemon2193-21rtkit-daemon22:31:202
219499580,3rtkit-daemon0-21swapper/222:23:122
219499580,3rtkit-daemon0-21swapper/220:36:242
219499580,2rtkit-daemon0-21swapper/223:39:542
219499580,2rtkit-daemon0-21swapper/221:10:082
219499580,2rtkit-daemon0-21swapper/220:58:382
219499580,2rtkit-daemon0-21swapper/219:50:032
219499580,2rtkit-daemon0-21swapper/219:44:042
1453199584,40cyclictest0-21swapper/322:25:343
14530995842,9cyclictest4242-21awk21:43:062
219499570,6rtkit-daemon2193-21rtkit-daemon18:53:283
219499570,3rtkit-daemon12-21rcu_preempt19:32:572
219499570,2rtkit-daemon0-21swapper/222:01:582
219499570,2rtkit-daemon0-21swapper/222:01:582
219499570,2rtkit-daemon0-21swapper/220:41:242
219499570,2rtkit-daemon0-21swapper/220:41:242
219499570,2rtkit-daemon0-21swapper/219:22:202
1453199573,50cyclictest361ktimersoftd/321:26:523
219499560,3rtkit-daemon29-21ksoftirqd/219:16:572
219499560,3rtkit-daemon29-21ksoftirqd/219:16:572
1453199554,43cyclictest0-21swapper/321:32:453
14531995523,13cyclictest16248-21open_files21:13:003
14529995532,18cyclictest0-21swapper/118:12:391
122752552,10sleep30-21swapper/323:34:213
219499540,4rtkit-daemon2193-21rtkit-daemon20:03:032
1453099548,38cyclictest0-21swapper/223:02:422
7822532,10sleep30-21swapper/319:57:563
219499530,5rtkit-daemon2193-21rtkit-daemon21:48:063
219499530,5rtkit-daemon2193-21rtkit-daemon20:53:242
219499530,5rtkit-daemon2193-21rtkit-daemon19:03:052
1453199533,34cyclictest0-21swapper/322:10:333
14531995320,27cyclictest21419-21fschecks_time19:32:553
1453099535,40cyclictest0-21swapper/218:42:382
1453099534,41cyclictest0-21swapper/221:03:022
1453099534,30cyclictest0-21swapper/219:22:582
52592522,43sleep30-21swapper/321:47:033
51012523,42sleep20-21swapper/220:07:382
301182522,10sleep30-21swapper/320:46:083
219499520,5rtkit-daemon2193-21rtkit-daemon19:57:482
219499520,5rtkit-daemon2193-21rtkit-daemon19:40:342
179792522,10sleep30-21swapper/319:26:493
1453199524,33cyclictest0-21swapper/323:38:223
1453199524,29cyclictest0-21swapper/320:15:493
1453199523,30cyclictest0-21swapper/322:43:283
1453199523,30cyclictest0-21swapper/322:43:283
14531995217,12cyclictest0-21swapper/322:52:423
14531995210,25cyclictest0-21swapper/322:30:223
14530995222,10cyclictest15632-21ssh20:23:042
14530995221,12cyclictest0-21swapper/218:52:572
219499510,5rtkit-daemon2193-21rtkit-daemon23:22:482
193152513,41sleep30-21swapper/319:28:013
1453199515,29cyclictest0-21swapper/323:17:283
1453199514,26cyclictest0-21swapper/323:07:003
1453199514,23cyclictest1227-21runrttasks20:34:593
1453099515,29cyclictest0-21swapper/219:28:132
1453099515,28cyclictest0-21swapper/220:21:032
1453099514,27cyclictest0-21swapper/218:20:322
62482502,11sleep30-21swapper/323:26:273
59192502,9sleep20-21swapper/219:00:282
1453199504,27cyclictest0-21swapper/318:58:083
1453199504,26cyclictest0-21swapper/322:04:453
14531995035,10cyclictest22941-21tail22:12:503
14531995029,15cyclictest0-21swapper/323:08:273
14531995019,18cyclictest3192-21taskset23:22:183
14531995019,18cyclictest3192-21taskset23:22:183
1453099505,28cyclictest0-21swapper/218:33:022
1453099505,28cyclictest0-21swapper/218:33:022
1453099505,28cyclictest0-21swapper/218:22:572
144372502,9sleep30-21swapper/321:59:283
144372502,9sleep30-21swapper/321:59:283
142862503,41sleep314289-21ssh21:11:113
256902493,40sleep325791-21df22:17:463
219499490,4rtkit-daemon2193-21rtkit-daemon18:48:132
1453199499,34cyclictest361ktimersoftd/321:38:043
1453199497,28cyclictest0-21swapper/321:54:453
1453199494,32cyclictest0-21swapper/322:38:083
1453199494,28cyclictest0-21swapper/320:03:063
1453199494,28cyclictest0-21swapper/318:43:023
1453199494,11cyclictest0-21swapper/320:22:573
14531994933,10cyclictest28190-21cpuspeed_turbos19:47:513
1453199493,27cyclictest0-21swapper/320:27:503
1453099494,27cyclictest0-21swapper/218:12:572
219499480,4rtkit-daemon2193-21rtkit-daemon20:07:553
1453199484,27cyclictest0-21swapper/320:47:463
1453199484,27cyclictest0-21swapper/319:02:583
14531994832,10cyclictest5954-21head20:57:543
1453199483,31cyclictest0-21swapper/321:19:243
1453199483,31cyclictest0-21swapper/321:19:243
1453199483,24cyclictest7804-21ssh23:27:503
1453199483,24cyclictest0-21swapper/321:28:243
1453099484,27cyclictest0-21swapper/218:31:312
106842482,10sleep30-21swapper/320:17:383
1453199474,26cyclictest0-21swapper/319:42:573
14531994731,10cyclictest25171-21sed18:32:583
14531994731,10cyclictest25171-21sed18:32:583
1453199473,27cyclictest0-21swapper/318:47:573
1453199473,25cyclictest0-21swapper/320:54:463
130602472,9sleep30-21swapper/319:15:003
130602472,9sleep30-21swapper/319:15:003
322532462,10sleep30-21swapper/319:56:103
1453199464,24cyclictest0-21swapper/318:27:503
1453199464,24cyclictest0-21swapper/318:17:403
1453199464,16cyclictest0-21swapper/319:19:323
1453199454,26cyclictest0-21swapper/318:24:103
1453199453,26cyclictest0-21swapper/319:38:303
14531994529,10cyclictest18897-21sed18:18:153
14530994519,7cyclictest14505-21latency_hist18:12:392
106742452,36sleep30-21swapper/319:10:003
287422423,32sleep30-21swapper/318:41:393
1453199413,25cyclictest0-21swapper/318:12:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional