You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 11:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sun May 31, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
733621150,4sleep229-21ksoftirqd/200:22:172
11897991034,92cyclictest0-21swapper/021:33:170
11902991015,27cyclictest1227-21runrttasks19:59:431
2239821000,4sleep2281ktimersoftd/222:19:392
119029910022,14cyclictest0-21swapper/119:48:181
219499990,7rtkit-daemon0-21swapper/121:57:361
219499990,6rtkit-daemon6742-21yum21:08:381
219499990,6rtkit-daemon0-21swapper/121:52:071
1190299975,26cyclictest0-21swapper/123:08:151
1190299975,26cyclictest0-21swapper/123:08:151
1190299964,26cyclictest0-21swapper/100:08:121
11902999519,10cyclictest13774-21ssh22:54:441
1189799953,84cyclictest1881-21ssh22:38:140
1190299946,24cyclictest0-21swapper/121:23:181
1190299945,26cyclictest16357-21ssh00:33:291
1190299945,24cyclictest1227-21runrttasks22:44:251
1189799944,81cyclictest0-21swapper/023:23:220
1190299935,13cyclictest25243-21crond21:38:011
1189799934,66cyclictest1146-21ssh00:13:090
1189799933,82cyclictest0-21swapper/021:40:370
1189799933,82cyclictest0-21swapper/020:55:290
1189799932,85cyclictest0-21swapper/019:33:070
1190299925,25cyclictest0-21swapper/100:05:321
11902999223,10cyclictest10091-21ssh00:25:031
11902999221,9cyclictest26727-21latency_hist22:28:001
11902999218,13cyclictest0-21swapper/123:28:141
1189799924,71cyclictest0-21swapper/023:12:110
1189799924,71cyclictest0-21swapper/023:12:110
1189799923,83cyclictest0-21swapper/022:21:230
1189799923,82cyclictest0-21swapper/022:46:020
1189799923,81cyclictest0-21swapper/023:59:120
11902999130,50cyclictest27356-21systemd-cgroups20:48:031
1189799913,81cyclictest0-21swapper/022:03:180
1189799913,80cyclictest31325-21idleruntime22:33:200
1189799913,80cyclictest0-21swapper/023:33:270
1189799913,80cyclictest0-21swapper/023:29:290
1190299904,29cyclictest0-21swapper/122:08:341
1190299904,26cyclictest0-21swapper/121:58:231
1190299904,23cyclictest8461-21ssh22:48:111
1190299904,14cyclictest0-21swapper/119:56:281
1190299903,25cyclictest19906-21aten_r1power_en23:53:091
11902999020,14cyclictest0-21swapper/123:06:401
11902999020,14cyclictest0-21swapper/123:06:401
11902999013,21cyclictest0-21swapper/122:03:191
11902999011,13cyclictest0-21swapper/122:38:301
1189799905,66cyclictest0-21swapper/023:03:150
1189799905,66cyclictest0-21swapper/023:03:150
1189799903,81cyclictest16957-21runrttasks00:35:240
1189799903,81cyclictest0-21swapper/021:50:130
1189799903,80cyclictest16657-21sa119:18:060
1189799903,80cyclictest0-21swapper/023:16:580
1189799903,80cyclictest0-21swapper/000:20:520
1189799903,79cyclictest0-21swapper/023:38:250
1189799903,63cyclictest0-21swapper/022:09:070
1190299895,34cyclictest0-21swapper/122:18:001
1190299894,35cyclictest0-21swapper/123:37:571
1190299894,26cyclictest0-21swapper/100:17:491
1190299893,28cyclictest29825-21hwlatdetect21:43:221
1190299893,28cyclictest29825-21hwlatdetect21:43:221
11902998929,9cyclictest14393-21wc20:18:281
11902998915,10cyclictest27273-21unixbench_multi21:38:351
1189799893,79cyclictest0-21swapper/023:18:400
1189799893,79cyclictest0-21swapper/021:09:580
1189799893,78cyclictest30573-21timerwakeupswit21:43:340
1189799893,78cyclictest30573-21timerwakeupswit21:43:340
1189799893,78cyclictest0-21swapper/022:28:240
1190299885,28cyclictest0-21swapper/120:03:181
1190299885,26cyclictest0-21swapper/119:44:411
1190299885,11cyclictest2220-21udisks-daemon23:46:221
1190299884,26cyclictest0-21swapper/100:19:191
1190299884,23cyclictest0-21swapper/123:21:081
11902998813,12cyclictest9605-21nfs_client21:13:311
1189799884,76cyclictest0-21swapper/023:54:170
1189799883,78cyclictest13842-21grep23:43:160
1189799882,79cyclictest0-21swapper/021:19:070
1190299875,25cyclictest0-21swapper/122:28:011
1190299874,26cyclictest0-21swapper/120:28:381
1190299874,23cyclictest0-21swapper/122:22:451
1189799874,77cyclictest8985-21fschecks_count21:13:230
1189799874,76cyclictest0-21swapper/023:49:550
1189799874,76cyclictest0-21swapper/023:49:550
1189799874,76cyclictest0-21swapper/022:58:180
1189799874,76cyclictest0-21swapper/022:02:280
1189799873,77cyclictest23904-21ls22:23:130
1189799873,77cyclictest0-21swapper/021:23:140
1189799873,75cyclictest29282-21tail20:48:350
1190599863,75cyclictest5408-21diskstats22:43:163
1190299864,38cyclictest0-21swapper/123:13:321
1190299863,26cyclictest17330-21gltestperf23:48:171
1190299863,26cyclictest17330-21gltestperf23:48:171
11902998625,14cyclictest0-21swapper/120:38:041
1189799863,76cyclictest0-21swapper/022:53:520
1189799862,77cyclictest19057-21cpuspeed21:28:140
1189799862,76cyclictest7751-21ssh00:22:570
1190599853,74cyclictest0-21swapper/322:17:183
1190299855,35cyclictest0-21swapper/123:23:101
1190299855,16cyclictest21197-21sshd21:30:331
1190299855,10cyclictest16842-21taskset22:58:361
1190299854,24cyclictest0-21swapper/122:34:531
1190299853,33cyclictest0-21swapper/120:48:291
11902998524,12cyclictest20354-21latency19:23:291
1189799854,73cyclictest0-21swapper/022:48:170
1189799853,75cyclictest0-21swapper/000:08:060
1189799853,73cyclictest0-21swapper/020:23:200
1189799853,73cyclictest0-21swapper/020:23:200
1189799853,66cyclictest0-21swapper/019:09:350
1189799853,46cyclictest0-21swapper/021:53:310
219499840,5rtkit-daemon2193-21rtkit-daemon00:36:532
1190299844,34cyclictest0-21swapper/120:53:231
11902998417,13cyclictest0-21swapper/121:20:251
1189799844,73cyclictest0-21swapper/000:28:180
1189799844,73cyclictest0-21swapper/000:28:180
1190599833,71cyclictest0-21swapper/300:03:343
1190299835,34cyclictest0-21swapper/121:03:361
1190299835,34cyclictest0-21swapper/121:03:361
1190299834,26cyclictest0-21swapper/123:42:291
11902998321,12cyclictest24151-21hwlatdetect23:58:161
1189799835,70cyclictest16835-21munin-node22:13:270
1189799834,73cyclictest0-21swapper/020:13:150
1189799834,71cyclictest0-21swapper/020:03:280
1189799833,74cyclictest0-21swapper/000:04:510
1190599824,70cyclictest0-21swapper/322:27:333
1190599823,69cyclictest0-21swapper/322:28:123
1190599822,74cyclictest0-21swapper/319:38:173
1190599822,74cyclictest0-21swapper/319:38:173
1190299827,21cyclictest0-21swapper/120:38:051
11902998212,13cyclictest0-21swapper/119:08:281
1189799824,71cyclictest0-21swapper/021:02:180
1189799824,71cyclictest0-21swapper/020:45:130
1190599814,70cyclictest0-21swapper/323:48:513
1190599814,70cyclictest0-21swapper/323:48:513
1190599814,57cyclictest0-21swapper/321:44:063
1190599814,57cyclictest0-21swapper/321:44:063
1190599813,70cyclictest6262-21ssh21:57:243
1190599813,70cyclictest3974-21kernelversion23:28:193
11905998113,49cyclictest0-21swapper/323:03:163
11905998113,49cyclictest0-21swapper/323:03:163
11902998123,11cyclictest9341-21head20:08:231
11902998120,13cyclictest0-21swapper/100:29:501
11902998120,13cyclictest0-21swapper/100:29:501
219499800,4rtkit-daemon2193-21rtkit-daemon22:43:122
1190599804,68cyclictest0-21swapper/323:42:093
1190599804,67cyclictest0-21swapper/322:33:163
1190599804,66cyclictest9714-21munin-node21:13:343
1190599804,66cyclictest1124-21snmpd21:19:573
1190599803,69cyclictest4618-21diskmemload23:33:113
1190599803,69cyclictest25674-21munin-node23:13:153
1190599803,69cyclictest0-21swapper/321:27:593
1190599803,69cyclictest0-21swapper/300:24:483
1190599803,69cyclictest0-21swapper/300:14:433
1190599795,67cyclictest0-21swapper/300:30:093
1190599795,67cyclictest0-21swapper/300:30:093
1190599794,67cyclictest0-21swapper/321:32:553
1190599793,68cyclictest25519-21munin-node21:38:333
1190299795,27cyclictest0-21swapper/119:13:291
1189799794,45cyclictest29748-21sort19:43:260
1189799793,69cyclictest0-21swapper/020:09:560
1190599784,67cyclictest0-21swapper/321:48:293
1190599784,66cyclictest0-21swapper/320:28:053
1190599784,66cyclictest0-21swapper/320:28:053
1190599784,57cyclictest0-21swapper/319:48:183
1190599784,51cyclictest0-21swapper/322:08:563
1190599783,67cyclictest0-21swapper/322:38:203
1190599783,65cyclictest5013-21aten_r1power_vo21:08:153
1190599774,55cyclictest0-21swapper/322:49:573
1190599774,52cyclictest14971-21kworker/3:223:23:253
1190599773,53cyclictest0-21swapper/323:20:423
1189799773,52cyclictest31332-21tail19:48:180
1189799773,47cyclictest0-21swapper/020:39:350
1190599765,54cyclictest0-21swapper/300:18:053
1190599764,55cyclictest0-21swapper/300:08:393
1190599763,65cyclictest15902-21ls22:58:193
11902997623,11cyclictest24922-21gltestperf19:33:251
1189799763,67cyclictest0-21swapper/019:36:050
1189799763,66cyclictest0-21swapper/019:42:370
1189799763,66cyclictest0-21swapper/019:42:370
1189799763,59cyclictest0-21swapper/020:19:460
1190599754,63cyclictest8243-21crond20:08:043
1190599754,63cyclictest0-21swapper/322:55:303
1190599753,65cyclictest4618-21diskmemload21:58:213
1190599753,65cyclictest2709-21munin-node19:53:343
1189799753,66cyclictest0-21swapper/021:03:180
1189799753,66cyclictest0-21swapper/021:03:180
1190599744,63cyclictest0-21swapper/322:07:563
1190599744,62cyclictest0-21swapper/323:43:143
1190599744,61cyclictest0-21swapper/323:53:273
1190599744,54cyclictest0-21swapper/319:13:083
1190599743,48cyclictest23282-21ssh21:33:253
1190299747,19cyclictest0-21swapper/119:08:081
1189799743,66cyclictest0-21swapper/019:23:340
1189799743,65cyclictest0-21swapper/020:28:220
1189799743,65cyclictest0-21swapper/019:56:080
1189799743,64cyclictest0-21swapper/019:21:380
1190599734,62cyclictest0-21swapper/323:58:133
1190599734,53cyclictest0-21swapper/300:32:573
1190599734,51cyclictest0-21swapper/323:09:443
1190599734,51cyclictest0-21swapper/323:09:443
1190599733,64cyclictest0-21swapper/319:43:183
1190599733,63cyclictest9350-21gltestperf20:08:233
1190599733,63cyclictest18157-21ntp_offset19:18:323
1190599733,63cyclictest12126-21nfs_client20:13:313
1190299734,22cyclictest0-21swapper/120:58:321
1190299734,13cyclictest0-21swapper/119:28:261
1189799733,63cyclictest0-21swapper/020:33:240
1189799733,54cyclictest0-21swapper/019:58:250
1190599724,51cyclictest0-21swapper/320:48:163
1190599723,49cyclictest0-21swapper/321:03:183
1190599723,49cyclictest0-21swapper/321:03:183
11905997218,39cyclictest27203-21yum-updatesd-he20:46:243
1190599714,36cyclictest0-21swapper/322:18:303
1190599713,61cyclictest24045-21munin-node19:33:173
1190599713,61cyclictest21857-21python20:33:353
11905997119,32cyclictest0-21swapper/320:40:153
1190599693,59cyclictest22328-21fschecks_count19:28:243
1190599693,50cyclictest19684-21cat19:23:203
1190599692,30cyclictest0-21swapper/320:18:313
1190599683,58cyclictest32347-21munin-node20:58:243
1190599683,31cyclictest16863-21latency_hist19:18:073
1190599674,56cyclictest18315-21cat20:28:163
11902996711,16cyclictest27299-21gltestperf19:38:251
11902996711,16cyclictest27299-21gltestperf19:38:251
1189799676,52cyclictest11888-21munin-run19:08:070
1190599654,33cyclictest31212-21awk20:53:293
1190599653,53cyclictest0-21swapper/320:03:003
178932643,12sleep20-21swapper/222:13:232
1190599635,40cyclictest0-21swapper/319:08:083
1190499624,43cyclictest0-21swapper/200:30:462
1190499624,43cyclictest0-21swapper/200:30:462
1190499618,26cyclictest0-21swapper/222:38:212
1190499615,48cyclictest0-21swapper/223:33:282
11904996141,12cyclictest3216-21cpuspeed_turbos23:28:102
1190499614,43cyclictest0-21swapper/200:01:472
11904996117,33cyclictest0-21swapper/219:48:362
1190499605,24cyclictest0-21swapper/221:46:382
1190499605,24cyclictest0-21swapper/221:46:382
1190499604,24cyclictest0-21swapper/200:06:042
1190299604,16cyclictest0-21swapper/120:13:221
219499580,7rtkit-daemon0-21swapper/322:32:272
219499580,6rtkit-daemon0-21swapper/323:05:192
219499580,6rtkit-daemon0-21swapper/323:05:192
11904995812,28cyclictest0-21swapper/221:18:152
11904995812,27cyclictest0-21swapper/223:53:282
41342573,46sleep24139-21crond00:17:542
1190499572,50cyclictest0-21swapper/221:41:212
219499560,5rtkit-daemon0-21swapper/319:45:412
11904995637,12cyclictest22318-21tune2fs23:08:152
11904995637,12cyclictest22318-21tune2fs23:08:152
97572553,10sleep28480-21munin-node20:08:312
11904995518,10cyclictest16568-21crond22:12:592
11902995519,28cyclictest1227-21runrttasks19:22:311
248042543,45sleep20-21swapper/221:36:262
153132542,9sleep20-21swapper/221:23:122
1190499544,43cyclictest0-21swapper/223:48:142
1190499544,43cyclictest0-21swapper/223:48:142
1190499543,44cyclictest0-21swapper/222:48:152
1190499543,35cyclictest0-21swapper/200:12:052
11904995417,21cyclictest0-21swapper/221:52:382
11904995416,24cyclictest0-21swapper/222:34:272
11904995412,26cyclictest0-21swapper/223:45:182
248412533,9sleep20-21swapper/220:41:412
207782532,10sleep20-21swapper/221:29:012
123032533,8sleep21124-21snmpd23:41:142
11904995331,15cyclictest0-21swapper/221:08:172
1190299534,29cyclictest0-21swapper/120:23:311
1190299534,29cyclictest0-21swapper/120:23:311
1190499523,45cyclictest0-21swapper/223:24:312
1190499523,43cyclictest0-21swapper/222:57:372
90592512,9sleep20-21swapper/222:00:172
1190499517,26cyclictest0-21swapper/220:53:392
1190499514,25cyclictest0-21swapper/221:13:172
1190499513,24cyclictest0-21swapper/223:18:102
11904995112,9cyclictest3743-21ssh21:53:142
80772502,9sleep20-21swapper/220:05:582
259072502,10sleep20-21swapper/219:34:262
164362502,41sleep20-21swapper/219:15:232
1190499505,28cyclictest0-21swapper/220:33:302
1190499504,38cyclictest0-21swapper/222:03:312
1190499504,28cyclictest0-21swapper/222:23:232
11904995034,10cyclictest22527-21gltestperf19:28:262
1190499494,39cyclictest0-21swapper/222:58:162
1190499494,28cyclictest0-21swapper/220:48:332
1190499494,28cyclictest0-21swapper/220:28:312
1190499494,27cyclictest0-21swapper/220:58:172
1190499493,40cyclictest0-21swapper/219:58:182
1190499493,31cyclictest0-21swapper/200:23:062
1190499492,42cyclictest0-21swapper/223:14:262
11904994831,11cyclictest19592-21grep19:23:192
1190499483,29cyclictest0-21swapper/219:53:372
1190499483,24cyclictest0-21swapper/220:44:352
1190499483,24cyclictest0-21swapper/220:18:152
1190499474,26cyclictest0-21swapper/220:25:442
1190499474,26cyclictest0-21swapper/220:25:442
1190499474,26cyclictest0-21swapper/220:13:402
11904994728,11cyclictest2586-21aten2.4-expect21:03:142
11904994728,11cyclictest2586-21aten2.4-expect21:03:142
1190499464,24cyclictest0-21swapper/219:08:192
1190499463,26cyclictest0-21swapper/219:18:382
1190499454,25cyclictest0-21swapper/219:38:222
1190499454,25cyclictest0-21swapper/219:38:222
11904993714,18cyclictest26-21rcuc/219:08:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional