You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-21 - 02:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sun Dec 21, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1754799954,28cyclictest0-21swapper/119:32:381
1754599953,57cyclictest0-21swapper/022:37:450
1754799944,29cyclictest0-21swapper/123:47:451
1754799944,29cyclictest0-21swapper/123:47:451
1754599924,12cyclictest0-21swapper/020:02:590
17547999110,24cyclictest0-21swapper/120:17:361
17545999119,53cyclictest80971munin-node20:58:070
1754599904,12cyclictest0-21swapper/023:22:500
1754599903,12cyclictest0-21swapper/022:07:430
1754599894,12cyclictest0-21swapper/020:42:510
1754599893,13cyclictest0-21swapper/019:57:540
1754599893,12cyclictest0-21swapper/023:12:490
1754599884,12cyclictest0-21swapper/022:32:530
1754599884,12cyclictest0-21swapper/000:27:260
1754599883,12cyclictest0-21swapper/021:37:330
1754599873,59cyclictest5467-21munin-run20:52:340
1754599873,12cyclictest0-21swapper/019:28:010
1754599873,12cyclictest0-21swapper/019:02:400
1754599864,12cyclictest0-21swapper/023:52:530
1754599864,12cyclictest0-21swapper/022:58:040
1754599863,12cyclictest0-21swapper/020:13:050
1754599863,11cyclictest0-21swapper/000:32:260
17545998615,56cyclictest0-21swapper/021:12:470
1754599854,9cyclictest23014-21diskstats21:27:500
1754599854,12cyclictest0-21swapper/020:11:490
1754599854,12cyclictest0-21swapper/019:17:380
1754599854,12cyclictest0-21swapper/000:07:550
1754599853,11cyclictest0-21swapper/021:47:470
1754599844,13cyclictest0-21swapper/021:07:580
1754599844,12cyclictest0-21swapper/019:08:000
1754599844,12cyclictest0-21swapper/019:03:060
1754599844,11cyclictest0-21swapper/020:53:040
1754599834,12cyclictest0-21swapper/021:37:460
1754599834,12cyclictest0-21swapper/000:12:540
1754599833,12cyclictest0-21swapper/023:52:270
1754599833,12cyclictest0-21swapper/023:52:270
1754599823,61cyclictest0-21swapper/022:13:040
1754599823,11cyclictest0-21swapper/020:27:360
1754599814,12cyclictest0-21swapper/023:17:520
1754599814,12cyclictest0-21swapper/021:44:470
1754599814,12cyclictest0-21swapper/021:44:470
1754599814,12cyclictest0-21swapper/021:17:530
1754599814,12cyclictest0-21swapper/019:23:060
1754599813,62cyclictest0-21swapper/022:02:560
1754599813,12cyclictest0-21swapper/019:18:040
17545998111,8cyclictest30757-21munin-node22:52:430
1754599804,12cyclictest0-21swapper/020:32:520
1754599804,12cyclictest0-21swapper/019:52:500
1754599804,12cyclictest0-21swapper/019:38:040
1754599803,13cyclictest0-21swapper/019:43:070
1754599803,12cyclictest0-21swapper/023:27:440
1754599803,12cyclictest0-21swapper/021:57:590
1754599794,56cyclictest0-21swapper/021:07:340
1754599794,12cyclictest0-21swapper/023:07:510
1754599794,11cyclictest0-21swapper/019:47:540
1754599793,14cyclictest0-21swapper/020:37:550
1754599793,12cyclictest0-21swapper/023:58:020
17545997922,50cyclictest3793-21unixbench_multi21:53:040
17545997912,59cyclictest0-21swapper/020:17:520
1754599783,12cyclictest0-21swapper/023:37:470
1754599783,12cyclictest0-21swapper/023:37:470
1754599773,67cyclictest7626-21gltestperf00:17:480
17545997718,53cyclictest26307-21tr22:42:460
17545997713,9cyclictest30329-21taskset22:50:070
1754599764,12cyclictest0-21swapper/000:05:130
1754599764,11cyclictest0-21swapper/022:32:300
1754599763,12cyclictest0-21swapper/023:42:470
17545997616,45cyclictest16423-21munin-node22:22:590
17545997616,45cyclictest16423-21munin-node22:22:590
17545997616,43cyclictest4072-21gltestperf23:02:480
17545997616,43cyclictest4072-21gltestperf23:02:480
1754599758,10cyclictest0-21swapper/023:32:510
1754599755,10cyclictest0-21swapper/021:22:580
1754599754,12cyclictest0-21swapper/022:17:480
1754599753,11cyclictest0-21swapper/019:33:080
1754599753,11cyclictest0-21swapper/019:33:080
17545997113,51cyclictest0-21swapper/020:27:510
20522650,6sleep2281ktimersoftd/200:07:382
245562604,12sleep20-21swapper/222:37:532
168102600,4sleep3361ktimersoftd/321:13:063
17549995813,39cyclictest24645-21cut21:32:333
248599570,6rtkit-daemon2484-21rtkit-daemon22:18:212
248599570,4rtkit-daemon2484-21rtkit-daemon23:45:182
77312562,9sleep20-21swapper/223:11:462
248599560,6rtkit-daemon2484-21rtkit-daemon22:58:052
248599560,5rtkit-daemon2484-21rtkit-daemon23:38:032
248599560,5rtkit-daemon2484-21rtkit-daemon23:38:032
248599560,10rtkit-daemon2484-21rtkit-daemon21:12:462
1754999566,43cyclictest0-21swapper/300:17:403
1754999564,45cyclictest0-21swapper/323:17:303
17548995630,12cyclictest0-21swapper/220:27:522
1754799565,28cyclictest493-21yum-updatesd-he20:42:471
248599550,6rtkit-daemon2484-21rtkit-daemon23:52:472
248599550,6rtkit-daemon2484-21rtkit-daemon22:17:062
248599550,6rtkit-daemon2484-21rtkit-daemon19:48:122
248599550,6rtkit-daemon2484-21rtkit-daemon19:32:582
248599550,6rtkit-daemon2484-21rtkit-daemon19:32:582
248599550,6rtkit-daemon2484-21rtkit-daemon19:27:582
248599550,5rtkit-daemon2484-21rtkit-daemon21:42:382
248599550,5rtkit-daemon2484-21rtkit-daemon21:42:382
1754899553,46cyclictest9789-21grep23:13:052
17548995527,13cyclictest0-21swapper/223:22:592
1754799555,32cyclictest0-21swapper/121:13:031
248599540,7rtkit-daemon2484-21rtkit-daemon20:57:472
248599540,6rtkit-daemon2484-21rtkit-daemon23:32:482
248599540,6rtkit-daemon2484-21rtkit-daemon23:31:032
248599540,6rtkit-daemon2484-21rtkit-daemon19:37:422
248599540,5rtkit-daemon2484-21rtkit-daemon20:52:542
210782544,42sleep30-21swapper/321:22:583
17549995423,12cyclictest0-21swapper/320:07:583
1754799545,29cyclictest0-21swapper/122:42:301
17547995421,14cyclictest0-21swapper/122:18:051
248599530,6rtkit-daemon2484-21rtkit-daemon21:22:462
248599530,6rtkit-daemon2484-21rtkit-daemon19:22:502
248599530,5rtkit-daemon2484-21rtkit-daemon23:02:572
248599530,5rtkit-daemon2484-21rtkit-daemon23:02:572
248599530,5rtkit-daemon2484-21rtkit-daemon22:22:512
248599530,5rtkit-daemon2484-21rtkit-daemon22:22:512
248599530,5rtkit-daemon2484-21rtkit-daemon22:07:442
248599530,5rtkit-daemon2484-21rtkit-daemon21:52:452
248599530,5rtkit-daemon2484-21rtkit-daemon21:27:532
248599530,5rtkit-daemon2484-21rtkit-daemon21:18:082
1754799535,29cyclictest0-21swapper/123:28:001
1754799534,28cyclictest0-21swapper/120:18:041
17547995322,13cyclictest0-21swapper/119:43:071
17547995322,12cyclictest0-21swapper/121:37:331
17547995321,13cyclictest0-21swapper/123:57:501
17547995318,12cyclictest0-21swapper/120:51:511
17547995318,10cyclictest17519-21iostat_ios20:08:011
17547995315,13cyclictest0-21swapper/123:12:291
173332533,44sleep10-21swapper/122:22:521
173332533,44sleep10-21swapper/122:22:521
248599520,6rtkit-daemon2484-21rtkit-daemon22:32:432
248599520,5rtkit-daemon2484-21rtkit-daemon22:27:432
248599520,5rtkit-daemon2484-21rtkit-daemon21:37:452
248599520,5rtkit-daemon2484-21rtkit-daemon20:22:482
248599520,5rtkit-daemon2484-21rtkit-daemon20:18:032
248599520,5rtkit-daemon2484-21rtkit-daemon00:02:402
248599520,4rtkit-daemon2484-21rtkit-daemon18:57:512
17549995237,9cyclictest1414-21fschecks_count20:42:523
17549995235,11cyclictest11174-21sshd21:02:503
17548995210,24cyclictest1051-21rs:main2
1754799525,29cyclictest0-21swapper/121:18:051
1754799525,28cyclictest0-21swapper/123:26:011
1754799525,28cyclictest0-21swapper/122:47:471
1754799525,28cyclictest0-21swapper/121:03:041
1754799525,28cyclictest0-21swapper/120:33:101
1754799525,28cyclictest0-21swapper/119:03:041
1754799525,28cyclictest0-21swapper/100:27:401
1754799525,27cyclictest0-21swapper/121:52:421
1754799525,27cyclictest0-21swapper/119:52:501
1754799524,29cyclictest0-21swapper/123:02:461
1754799524,29cyclictest0-21swapper/123:02:461
1754799524,29cyclictest0-21swapper/119:47:571
1754799524,28cyclictest0-21swapper/121:42:331
1754799524,27cyclictest1419-21runrttasks20:58:021
1754799524,26cyclictest0-21swapper/119:34:291
1754799524,26cyclictest0-21swapper/119:34:291
17547995233,13cyclictest21281-21aten_r1power_fr22:32:421
17547995221,13cyclictest0-21swapper/122:12:581
17547995220,14cyclictest0-21swapper/121:28:021
17547995220,13cyclictest0-21swapper/122:27:531
17547995220,13cyclictest0-21swapper/120:03:031
17547995220,13cyclictest0-21swapper/100:08:011
17547995219,14cyclictest0-21swapper/119:07:541
17547995219,13cyclictest0-21swapper/121:23:101
17547995218,12cyclictest0-21swapper/119:57:481
17547995217,13cyclictest0-21swapper/119:14:251
17547995217,12cyclictest0-21swapper/122:52:591
17547995216,12cyclictest0-21swapper/122:47:301
39612512,10sleep30-21swapper/321:53:493
292232512,9sleep30-21swapper/323:56:163
268322513,42sleep10-21swapper/119:19:561
248599510,5rtkit-daemon2484-21rtkit-daemon19:42:502
17549995124,8cyclictest20965-21crond22:32:303
17549995122,9cyclictest31836-21cat00:02:283
1754899519,35cyclictest0-21swapper/221:07:502
1754899514,40cyclictest0-21swapper/221:32:452
17548995134,11cyclictest19775-21gltestperf20:12:582
17548995133,11cyclictest18626-21grep19:02:592
1754799515,27cyclictest0-21swapper/123:52:481
1754799515,27cyclictest0-21swapper/121:42:541
1754799515,27cyclictest0-21swapper/121:42:541
1754799515,26cyclictest0-21swapper/122:04:531
1754799514,28cyclictest0-21swapper/120:27:561
1754799514,28cyclictest0-21swapper/119:27:381
1754799514,28cyclictest0-21swapper/100:17:401
1754799514,28cyclictest0-21swapper/100:02:471
1754799514,27cyclictest0-21swapper/123:37:461
1754799514,27cyclictest0-21swapper/123:37:461
1754799513,26cyclictest0-21swapper/100:23:021
17547995121,12cyclictest0-21swapper/120:39:391
17547995115,12cyclictest0-21swapper/123:42:521
64872502,10sleep30-21swapper/319:45:013
301142503,41sleep330216-21users20:33:093
268862502,41sleep30-21swapper/321:36:283
257392502,10sleep30-21swapper/322:42:293
248599500,5rtkit-daemon2484-21rtkit-daemon19:53:122
248599500,5rtkit-daemon2484-21rtkit-daemon19:12:512
17549995035,8cyclictest27757-21unixbench_singl22:43:053
17549995023,9cyclictest22871-21unixbench-2d22:33:033
17549995020,12cyclictest0-21swapper/322:53:013
17548995033,10cyclictest26315-21cut22:42:462
17548995021,13cyclictest0-21swapper/220:38:002
1754799506,25cyclictest0-21swapper/123:15:041
1754799505,28cyclictest0-21swapper/119:37:561
1754799504,28cyclictest0-21swapper/123:17:431
1754799504,28cyclictest0-21swapper/122:08:041
1754799504,28cyclictest0-21swapper/121:07:471
1754799504,27cyclictest0-21swapper/121:47:451
1754799504,27cyclictest0-21swapper/120:52:481
1754799504,26cyclictest0-21swapper/123:35:081
1754799504,26cyclictest0-21swapper/120:23:101
1754799503,26cyclictest0-21swapper/100:16:431
1754799503,23cyclictest3032-21awk23:02:291
281512492,10sleep30-21swapper/320:32:043
248599490,5rtkit-daemon2484-21rtkit-daemon23:47:402
248599490,5rtkit-daemon2484-21rtkit-daemon23:47:402
248599490,5rtkit-daemon2484-21rtkit-daemon22:53:052
1754999498,37cyclictest1740-21awk21:52:323
1754999495,26cyclictest0-21swapper/323:50:103
1754999495,26cyclictest0-21swapper/323:50:103
1754999495,26cyclictest0-21swapper/320:39:393
1754999494,26cyclictest0-21swapper/322:22:323
1754999494,12cyclictest0-21swapper/319:32:503
1754999494,12cyclictest0-21swapper/319:32:503
17549994934,9cyclictest8668-21sed19:48:123
17547994921,11cyclictest0-21swapper/121:57:511
172332492,41sleep30-21swapper/323:31:093
130442493,7sleep313187-21cstates23:22:433
113792492,41sleep30-21swapper/319:56:213
88092482,9sleep20-21swapper/222:04:482
40352482,9sleep30-21swapper/319:39:133
290502482,39sleep30-21swapper/321:38:383
248599480,5rtkit-daemon2484-21rtkit-daemon00:27:392
1754999485,25cyclictest9772-21df_inode00:22:433
1754999485,25cyclictest0-21swapper/322:57:403
1754999484,36cyclictest0-21swapper/323:42:513
1754999484,26cyclictest0-21swapper/300:27:423
17549994833,9cyclictest27645-21cpuspeed_turbos19:22:543
17549994829,10cyclictest20520-21cut19:07:543
17549994813,8cyclictest361ktimersoftd/321:07:513
17548994820,13cyclictest0-21swapper/200:22:432
122332483,9sleep30-21swapper/323:18:163
251902472,39sleep30-21swapper/320:23:093
248599470,4rtkit-daemon2484-21rtkit-daemon00:17:462
193962472,9sleep30-21swapper/323:33:073
1754999479,19cyclictest0-21swapper/323:37:433
1754999479,19cyclictest0-21swapper/323:37:433
1754999475,25cyclictest0-21swapper/322:04:533
1754999475,25cyclictest0-21swapper/319:29:283
1754999474,26cyclictest0-21swapper/323:02:583
1754999474,26cyclictest0-21swapper/323:02:583
1754999474,25cyclictest0-21swapper/300:10:133
17549994719,8cyclictest24900-21cat19:17:393
1754899473,27cyclictest0-21swapper/200:12:442
17548994720,12cyclictest0-21swapper/223:17:472
76432463,10sleep30-21swapper/323:10:383
248599460,5rtkit-daemon2484-21rtkit-daemon19:07:512
1754999465,26cyclictest0-21swapper/320:57:533
1754999464,36cyclictest0-21swapper/300:02:413
1754999464,35cyclictest0-21swapper/320:22:353
1754999464,25cyclictest0-21swapper/320:49:413
1754999464,25cyclictest0-21swapper/319:58:043
1754999464,24cyclictest0-21swapper/321:57:493
1754999463,11cyclictest0-21swapper/300:12:383
1754999462,9cyclictest0-21swapper/319:17:543
17549994617,8cyclictest11582-21cat22:12:323
17549994617,12cyclictest0-21swapper/319:07:393
17549994613,27cyclictest19481-21forks20:12:563
1754899464,35cyclictest0-21swapper/220:42:582
17548994630,11cyclictest0-21swapper/220:32:472
17548994620,11cyclictest0-21swapper/220:03:022
1754899462,39cyclictest0-21swapper/219:18:082
104902462,9sleep20-21swapper/221:02:422
314472452,9sleep30-21swapper/321:43:413
314472452,9sleep30-21swapper/321:43:413
1754899454,34cyclictest0-21swapper/223:57:522
17548994530,9cyclictest12552-21gltestperf19:57:562
1754899453,26cyclictest0-21swapper/220:08:072
171952454,35sleep10-21swapper/118:58:331
64582442,9sleep20-21swapper/222:00:172
1754999445,33cyclictest28491-21aten2.4-expect22:47:443
1754999444,33cyclictest0-21swapper/322:22:433
1754999444,33cyclictest0-21swapper/322:22:433
1754999444,25cyclictest0-21swapper/320:04:343
17548994429,10cyclictest29075-21tune2fs22:47:492
17548994419,11cyclictest0-21swapper/220:47:572
1754999434,33cyclictest0-21swapper/321:17:573
1754999433,25cyclictest0-21swapper/320:52:463
126752423,33sleep30-21swapper/322:12:553
1754999404,31cyclictest0-21swapper/319:02:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional