You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 07:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Sep 16, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
115399260,2cyclictest4903-21ssh22:45:552
1153992523,2cyclictest23410-21ssh00:00:142
115399250,24cyclictest27882-21sh22:37:252
115399250,24cyclictest26814-21diskmemload21:26:352
115399250,24cyclictest0-21swapper/223:53:332
115099250,24cyclictest11600-21apt-get22:52:251
115099250,24cyclictest0-21swapper/121:17:241
114599250,1cyclictest26814-21diskmemload00:02:340
1156992424,0cyclictest0-21swapper/321:36:273
1156992422,1cyclictest0-21swapper/322:52:573
115699240,24cyclictest0-21swapper/323:25:383
115699240,23cyclictest0-21swapper/322:43:003
1153992422,1cyclictest0-21swapper/222:57:582
1153992419,0cyclictest0-21swapper/221:55:562
115399240,24cyclictest31659-21apt-get22:12:232
115399240,23cyclictest26814-21diskmemload23:56:302
115399240,1cyclictest0-21swapper/223:18:052
115399240,1cyclictest0-21swapper/223:09:322
115399240,1cyclictest0-21swapper/200:34:492
115399240,0cyclictest26814-21diskmemload22:33:222
1150992424,0cyclictest0-21swapper/122:22:291
1150992422,1cyclictest313-21systemd-journal21:55:001
1150992422,1cyclictest2199-21forks23:12:261
115099242,21cyclictest13810-21awk23:22:291
115099240,24cyclictest0-21swapper/121:31:301
115099240,23cyclictest15848-21ssh22:55:281
115099240,23cyclictest0-21swapper/122:16:091
115099240,1cyclictest313-21systemd-journal00:20:001
115099240,0cyclictest26814-21diskmemload21:26:051
114599240,24cyclictest0-21swapper/000:21:490
114599240,23cyclictest26814-21diskmemload21:15:590
114599240,1cyclictest594-21ssh21:43:050
1156992323,0cyclictest0-21swapper/323:56:003
1156992323,0cyclictest0-21swapper/323:54:033
1156992323,0cyclictest0-21swapper/323:32:163
1156992323,0cyclictest0-21swapper/322:56:143
1156992323,0cyclictest0-21swapper/300:26:123
1156992323,0cyclictest0-21swapper/300:01:283
1156992321,1cyclictest442-21dump-pmu-power21:15:003
1156992321,1cyclictest0-21swapper/323:38:383
1156992321,1cyclictest0-21swapper/321:31:323
115699230,2cyclictest13832-21sh00:20:593
115699230,23cyclictest0-21swapper/322:30:193
115699230,23cyclictest0-21swapper/322:26:273
115699230,23cyclictest0-21swapper/322:03:123
115699230,23cyclictest0-21swapper/300:13:523
115699230,22cyclictest8769-21apt-get19:27:243
115699230,22cyclictest5176-21sh20:25:003
115699230,22cyclictest30380-21perf20:10:003
115699230,22cyclictest26814-21diskmemload23:05:283
115699230,22cyclictest10195-21cat00:17:273
115699230,22cyclictest0-21swapper/321:42:183
115699230,22cyclictest0-21swapper/321:05:003
115699230,1cyclictest0-21swapper/322:17:463
115699230,0cyclictest0-21swapper/323:21:263
1153992323,0cyclictest0-21swapper/222:52:562
1153992323,0cyclictest0-21swapper/221:43:262
1153992323,0cyclictest0-21swapper/200:16:492
1153992321,1cyclictest23976-21cron00:30:002
1153992321,1cyclictest0-21swapper/222:27:502
1153992321,1cyclictest0-21swapper/221:24:472
115399230,2cyclictest22042-21sh23:00:472
115399230,23cyclictest0-21swapper/223:38:012
115399230,23cyclictest0-21swapper/221:54:032
115399230,22cyclictest5201-21ssh23:14:492
115399230,22cyclictest3501-21sh22:44:062
115399230,22cyclictest0-21swapper/221:31:432
115399230,1cyclictest19554-1kworker/u9:023:27:362
115399230,0cyclictest26814-21diskmemload00:20:062
1150992323,0cyclictest0-21swapper/123:04:351
1150992323,0cyclictest0-21swapper/122:46:571
1150992323,0cyclictest0-21swapper/121:11:031
1150992322,0cyclictest26814-21diskmemload23:25:081
1150992321,1cyclictest2603-21apt-get23:42:251
1150992321,1cyclictest20910-21sh22:31:041
1150992321,1cyclictest13507-21ssh21:55:011
1150992321,1cyclictest0-21swapper/122:10:391
1150992321,1cyclictest0-21swapper/100:00:011
1150992320,2cyclictest1982-21cat22:42:301
115099230,2cyclictest26227-21sh22:07:181
115099230,23cyclictest0-21swapper/121:45:341
115099230,22cyclictest28852-21rm00:05:151
115099230,22cyclictest22776-21sh23:30:431
115099230,22cyclictest15412-21ssh22:26:071
115099230,22cyclictest14825-21awk20:45:011
115099230,1cyclictest27738-21ssh23:06:071
115099230,0cyclictest0-21swapper/100:21:281
115099230,0cyclictest0-21swapper/100:04:171
1145992323,0cyclictest2563-21ssh22:42:540
1145992323,0cyclictest0-21swapper/023:57:190
1145992323,0cyclictest0-21swapper/023:29:560
1145992323,0cyclictest0-21swapper/022:08:110
1145992321,1cyclictest7687-21ssh22:47:320
1145992321,1cyclictest29501-21latency_hist00:35:000
1145992321,1cyclictest20433-21sh22:01:580
1145992321,1cyclictest0-21swapper/021:10:010
1145992320,2cyclictest6681-21rm23:16:310
1145992320,2cyclictest31633-21sh23:38:050
1145992320,2cyclictest11954-21ssh23:21:030
114599230,23cyclictest0-21swapper/023:33:230
114599230,22cyclictest8370-21ssh00:16:070
114599230,22cyclictest5183-21awk20:25:000
114599230,22cyclictest30708-21ssh22:11:020
114599230,22cyclictest30021-21ssh00:35:230
114599230,22cyclictest28494-21sh21:39:220
114599230,22cyclictest18711-21cron22:00:000
114599230,22cyclictest12880-21ssh21:26:060
114599230,22cyclictest1169-21ssh23:40:280
114599230,1cyclictest16405-21rm22:56:110
114599230,1cyclictest0-21swapper/021:31:570
114599230,0cyclictest0-21swapper/022:52:100
114599230,0cyclictest0-21swapper/022:39:560
1156992222,0cyclictest0-21swapper/321:51:343
1156992222,0cyclictest0-21swapper/321:45:073
1156992220,1cyclictest15958-21cron19:40:003
1156992220,1cyclictest14196-21ssh21:56:033
1156992220,1cyclictest0-21swapper/323:41:213
115699220,22cyclictest25573-21perf20:00:013
115699220,22cyclictest0-21swapper/322:38:483
115699220,22cyclictest0-21swapper/321:21:033
115699220,21cyclictest30249-21ssh00:07:133
115699220,21cyclictest30200-21ssh00:35:373
115699220,21cyclictest26814-21diskmemload22:05:073
115699220,21cyclictest21651-21ssh23:00:173
115699220,21cyclictest0-21swapper/323:10:253
115699220,21cyclictest0-21swapper/322:46:323
115699220,21cyclictest0-21swapper/322:20:163
115699220,21cyclictest0-21swapper/322:12:083
115699220,21cyclictest0-21swapper/320:32:253
115699220,1cyclictest0-21swapper/323:15:093
115699220,1cyclictest0-21swapper/321:16:413
115699220,0cyclictest0-21swapper/321:26:343
1153992222,0cyclictest0-21swapper/222:05:342
1153992222,0cyclictest0-21swapper/221:46:342
1153992220,1cyclictest782-21apt-get20:17:252
1153992220,1cyclictest1502-21apt-get00:10:022
1153992220,1cyclictest0-21swapper/221:35:162
1153992219,0cyclictest0-21swapper/200:35:052
115399220,21cyclictest32755-21dump-pmu-power20:15:002
115399220,21cyclictest26814-21diskmemload22:00:132
115399220,21cyclictest26814-21diskmemload00:07:142
115399220,21cyclictest23159-21ssh23:31:252
115399220,21cyclictest18821-21apt-get19:47:242
115399220,21cyclictest11586-21ssh23:20:392
115399220,21cyclictest0-21swapper/222:20:022
115399220,21cyclictest0-21swapper/221:10:162
115399220,1cyclictest852-21ssh21:15:122
115399220,1cyclictest8022-21apt-get20:32:252
115399220,1cyclictest0-21swapper/223:47:052
1150992222,0cyclictest26814-21diskmemload23:45:421
1150992222,0cyclictest26814-21diskmemload22:01:431
1150992222,0cyclictest0-21swapper/121:22:241
1150992221,1cyclictest26814-21diskmemload00:31:581
1150992220,1cyclictest10914-21munin-run23:20:011
115099220,22cyclictest19554-1kworker/u9:021:35:571
115099220,21cyclictest26814-21diskmemload00:10:021
115099220,21cyclictest26043-21ssh22:35:261
115099220,21cyclictest12314-21ssh23:50:251
115099220,21cyclictest0-21swapper/100:35:111
115099220,1cyclictest0-21swapper/123:37:311
115099220,0cyclictest0-21swapper/121:07:271
1145992222,0cyclictest26814-21diskmemload22:30:040
1145992222,0cyclictest0-21swapper/022:25:450
1145992221,1cyclictest28909-21ssh00:05:190
1145992221,1cyclictest0-21swapper/023:05:140
114599220,22cyclictest0-21swapper/021:50:090
114599220,22cyclictest0-21swapper/021:45:450
114599220,22cyclictest0-21swapper/000:27:430
114599220,21cyclictest1728-21apt-get23:12:240
114599220,21cyclictest1479-21cron00:10:030
114599220,21cyclictest0-21swapper/023:02:290
114599220,20cyclictest26814-21diskmemload23:47:540
114599220,1cyclictest12931-21ssh23:51:240
114599220,1cyclictest0-21swapper/022:15:020
1156992119,1cyclictest0-21swapper/320:15:003
115699210,20cyclictest0-21swapper/320:47:243
115699210,20cyclictest0-21swapper/320:02:253
115699210,0cyclictest0-21swapper/323:46:423
115699210,0cyclictest0-21swapper/321:07:273
115699210,0cyclictest0-21swapper/320:17:253
115699210,0cyclictest0-21swapper/319:52:243
115699210,0cyclictest0-21swapper/319:12:233
1153992119,1cyclictest0-21swapper/219:35:002
115399210,21cyclictest0-21swapper/220:52:252
115399210,20cyclictest6376-21apt-get19:22:252
115399210,20cyclictest0-21swapper/219:57:242
115399210,20cyclictest0-21swapper/219:27:242
115399210,0cyclictest5623-21apt-get20:27:252
1150992121,0cyclictest0-21swapper/119:52:241
1150992121,0cyclictest0-21swapper/119:17:241
1150992119,1cyclictest10706-21sh19:30:001
115099210,20cyclictest26814-21diskmemload00:25:501
1145992121,0cyclictest24884-21apt-get21:07:280
1145992119,1cyclictest0-21swapper/019:37:240
114599210,21cyclictest0-21swapper/022:20:150
114599210,20cyclictest0-21swapper/020:07:240
1156992019,1cyclictest0-21swapper/319:42:223
115699200,0cyclictest0-21swapper/320:57:233
1153992018,1cyclictest14013-21apt-get19:37:242
1150992020,0cyclictest10718-21apt-get19:30:021
1150992020,0cyclictest0-21swapper/120:32:251
1150992018,1cyclictest606-21dbus-daemon19:40:001
1145992020,0cyclictest0-21swapper/020:47:250
1145992020,0cyclictest0-21swapper/020:17:260
1145992020,0cyclictest0-21swapper/020:02:250
1145992020,0cyclictest0-21swapper/019:52:240
1145992020,0cyclictest0-21swapper/019:22:250
1145992019,1cyclictest25581-21latency_hist20:00:010
1145992018,1cyclictest0-21swapper/019:35:000
114599200,20cyclictest0-21swapper/020:12:240
114599200,0cyclictest0-21swapper/020:27:260
1156991919,0cyclictest0-21swapper/319:32:253
1153991919,0cyclictest0-21swapper/221:07:282
1150991919,0cyclictest0-21swapper/120:37:241
1150991919,0cyclictest0-21swapper/119:57:241
1150991918,0cyclictest0-21swapper/119:15:011
1150991917,1cyclictest30816-21apt-get20:12:241
1145991919,0cyclictest1547-21apt-get19:12:220
1145991919,0cyclictest0-21swapper/020:57:230
1145991918,1cyclictest14849-21perf20:45:010
114599190,6cyclictest10797-21gpgv19:30:000
1156991816,1cyclictest12456-21munin-run20:40:013
1153991818,0cyclictest1547-21apt-get19:12:222
1153991818,0cyclictest0-21swapper/220:22:232
1153991818,0cyclictest0-21swapper/220:07:242
1153991817,1cyclictest5906-21latency_hist19:20:002
1153991817,1cyclictest0-21swapper/221:00:002
1150991818,0cyclictest0-21swapper/119:47:241
1150991817,0cyclictest0-21swapper/120:27:261
1145991818,0cyclictest0-21swapper/021:02:240
1145991816,1cyclictest0-21swapper/020:32:250
114599180,17cyclictest0-21swapper/019:42:220
1153991717,0cyclictest0-21swapper/220:42:242
1153991713,2cyclictest313-21systemd-journal21:05:002
1145991717,0cyclictest0-21swapper/019:47:240
1156991616,0cyclictest0-21swapper/319:47:243
115399160,1cyclictest0-21swapper/219:52:242
115099162,14cyclictest2723-21munin-node20:46:321
1150991616,0cyclictest0-21swapper/121:02:241
1150991616,0cyclictest0-21swapper/120:57:231
1150991616,0cyclictest0-21swapper/120:17:251
1150991614,1cyclictest0-21swapper/120:05:011
115099160,15cyclictest18398-21munin-run19:45:001
114599163,13cyclictest0-21swapper/020:52:240
1156991512,1cyclictest0-21swapper/320:42:233
1153991515,0cyclictest0-21swapper/220:02:252
1150991515,0cyclictest0-21swapper/120:07:241
1150991513,1cyclictest313-21systemd-journal19:25:001
1145991512,2cyclictest4478-21perl19:17:260
115699140,0cyclictest0-21swapper/320:51:033
115699140,0cyclictest0-21swapper/320:26:433
115699140,0cyclictest0-21swapper/319:21:053
115699140,0cyclictest0-21swapper/319:15:513
1153991414,0cyclictest0-21swapper/219:42:072
115399140,14cyclictest0-21swapper/220:45:172
115399140,14cyclictest0-21swapper/220:35:292
1150991414,0cyclictest0-21swapper/120:50:041
114599140,0cyclictest0-21swapper/020:35:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional