You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 19:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Sat May 30, 2026 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13159993129,1cyclictest22-21ksoftirqd/108:40:001
13159992826,1cyclictest22-21ksoftirqd/112:10:011
13159992826,1cyclictest22-21ksoftirqd/112:10:011
1316599250,24cyclictest7293-21diskmemload10:11:513
13161992523,2cyclictest16083-21ssh11:19:042
13161992519,1cyclictest12870-21ssh10:16:022
1316199250,24cyclictest1304-21sed10:35:012
1316199250,24cyclictest1304-21sed10:35:012
1316199250,24cyclictest0-21swapper/209:12:002
1315499250,24cyclictest0-21swapper/011:47:200
1315499250,24cyclictest0-21swapper/011:41:110
13165992422,1cyclictest7293-21diskmemload09:30:073
1316599240,23cyclictest7293-21diskmemload12:25:183
1316599240,23cyclictest7293-21diskmemload10:37:503
1316599240,23cyclictest0-21swapper/309:28:243
1316599240,1cyclictest1366-21apt-get07:53:273
13161992424,0cyclictest0-21swapper/210:41:532
13161992420,0cyclictest0-21swapper/210:07:442
1316199240,2cyclictest21988-21cron11:25:012
1316199240,23cyclictest2020-21ssh10:35:472
1316199240,1cyclictest0-21swapper/212:22:432
13159992424,0cyclictest14197-21kworker/1:111:30:441
13159992424,0cyclictest0-21swapper/111:35:381
13159992422,1cyclictest0-21swapper/110:32:011
13159992422,1cyclictest0-21swapper/110:32:011
1315999240,23cyclictest7293-21diskmemload09:41:291
1315999240,23cyclictest7293-21diskmemload09:41:291
1315999240,23cyclictest0-21swapper/111:23:191
1315999240,1cyclictest0-21swapper/110:16:321
1315999240,0cyclictest0-21swapper/112:32:291
13154992424,0cyclictest0-21swapper/011:29:470
13154992422,1cyclictest17885-21cron07:20:010
1315499240,2cyclictest32651-21awk11:35:010
1315499240,24cyclictest0-21swapper/009:40:150
1315499240,24cyclictest0-21swapper/009:40:150
1315499240,23cyclictest7293-21diskmemload11:55:020
1315499240,23cyclictest7293-21diskmemload09:56:170
1315499240,23cyclictest0-21swapper/012:17:300
1315499240,1cyclictest0-21swapper/011:03:290
13165992323,0cyclictest7293-21diskmemload11:13:213
13165992323,0cyclictest7293-21diskmemload11:03:503
13165992323,0cyclictest0-21swapper/310:06:333
13165992322,0cyclictest0-21swapper/309:13:443
13165992320,2cyclictest14021-21sh10:17:463
1316599230,2cyclictest1802-21ssh11:36:583
1316599230,2cyclictest14023-21ssh10:47:583
1316599230,23cyclictest7293-21diskmemload11:16:083
1316599230,23cyclictest7293-21diskmemload10:50:133
1316599230,23cyclictest7293-21diskmemload09:39:193
1316599230,23cyclictest0-21swapper/312:10:493
1316599230,23cyclictest0-21swapper/311:31:143
1316599230,22cyclictest7293-21diskmemload11:21:373
1316599230,22cyclictest27810-21ssh12:31:213
1316599230,22cyclictest25387-21ssh10:28:153
1316599230,22cyclictest21257-21kernelversion09:53:303
1316599230,22cyclictest1367-21ssh11:05:323
1316599230,22cyclictest10140-21sh11:43:523
1316599230,22cyclictest0-21swapper/310:04:393
1316599230,0cyclictest27714-21ssh10:59:493
1316599230,0cyclictest0-21swapper/312:04:273
1316599230,0cyclictest0-21swapper/310:31:453
1316599230,0cyclictest0-21swapper/310:31:453
1316599230,0cyclictest0-21swapper/310:21:203
13161992323,0cyclictest0-21swapper/210:04:112
13161992323,0cyclictest0-21swapper/209:43:522
13161992323,0cyclictest0-21swapper/209:43:522
13161992319,4cyclictest0-21swapper/212:15:572
1316199230,2cyclictest27101-21rm11:29:402
1316199230,23cyclictest10671-21kworker/u8:011:45:282
1316199230,23cyclictest0-21swapper/211:50:042
1316199230,23cyclictest0-21swapper/211:30:042
1316199230,23cyclictest0-21swapper/211:01:032
1316199230,23cyclictest0-21swapper/210:58:582
1316199230,23cyclictest0-21swapper/210:53:552
1316199230,23cyclictest0-21swapper/209:50:512
1316199230,23cyclictest0-21swapper/209:16:182
1316199230,22cyclictest8443-21ssh10:12:122
1316199230,22cyclictest7293-21diskmemload11:56:332
1316199230,22cyclictest6811-21ssh11:10:452
1316199230,22cyclictest29603-21ssh09:31:122
1316199230,22cyclictest1621-21rm12:06:532
1316199230,22cyclictest1621-21rm12:06:532
1316199230,22cyclictest13904-21ssh10:47:482
1316199230,0cyclictest7293-21diskmemload12:26:072
1316199230,0cyclictest7293-21diskmemload09:59:462
1316199230,0cyclictest0-21swapper/212:14:002
13159992323,0cyclictest0-21swapper/111:51:371
13159992323,0cyclictest0-21swapper/111:25:351
13159992323,0cyclictest0-21swapper/110:45:031
13159992323,0cyclictest0-21swapper/110:26:061
13159992321,1cyclictest26903-21cut09:28:341
13159992321,1cyclictest0-21swapper/111:41:161
13159992321,1cyclictest0-21swapper/111:15:041
13159992321,1cyclictest0-21swapper/110:23:481
13159992321,1cyclictest0-21swapper/109:11:061
13159992320,2cyclictest21757-21ptp4l09:53:341
1315999230,2cyclictest24523-21ssh10:57:441
1315999230,23cyclictest7293-21diskmemload11:55:361
1315999230,23cyclictest7293-21diskmemload09:35:521
1315999230,23cyclictest0-21swapper/110:39:151
1315999230,23cyclictest0-21swapper/109:55:501
1315999230,23cyclictest0-21swapper/109:15:531
1315999230,22cyclictest7293-21diskmemload10:51:251
1315999230,22cyclictest7293-21diskmemload10:02:221
1315999230,22cyclictest381-21ssh12:35:501
1315999230,22cyclictest29602-21ssh11:02:161
1315999230,22cyclictest16738-21rm09:48:501
1315999230,1cyclictest151rcu_preempt10:12:351
1315999230,0cyclictest0-21swapper/112:11:551
1315999230,0cyclictest0-21swapper/110:09:251
1315999230,0cyclictest0-21swapper/108:48:281
1315499234,19cyclictest62550irq/127-eno112:27:560
13154992323,0cyclictest0-21swapper/011:23:010
13154992323,0cyclictest0-21swapper/011:11:350
13154992323,0cyclictest0-21swapper/010:53:560
13154992323,0cyclictest0-21swapper/009:31:200
13154992322,1cyclictest0-21swapper/009:49:480
13154992321,1cyclictest0-21swapper/010:37:540
1315499231,0cyclictest0-21swapper/010:27:150
1315499230,2cyclictest28636-21perf09:30:000
1315499230,2cyclictest27841-21diskmemload12:00:300
1315499230,2cyclictest23187-21latency_hist09:25:000
1315499230,23cyclictest7293-21diskmemload10:45:000
1315499230,23cyclictest0-21swapper/011:39:250
1315499230,23cyclictest0-21swapper/011:07:410
1315499230,23cyclictest0-21swapper/010:02:510
1315499230,22cyclictest16583-21sh10:49:060
1315499230,22cyclictest13551-21ssh11:17:490
1315499230,22cyclictest0-21swapper/010:55:220
1315499230,22cyclictest0-21swapper/009:15:580
1315499230,0cyclictest0-21swapper/007:58:270
13165992222,0cyclictest8585-21apt-get08:08:263
13165992222,0cyclictest7293-21diskmemload11:45:293
13165992222,0cyclictest0-21swapper/309:17:373
13165992221,1cyclictest18480-21ssh11:52:293
13165992221,1cyclictest0-21swapper/312:20:223
13165992221,1cyclictest0-21swapper/310:44:383
13165992220,1cyclictest567-21ssh12:05:203
13165992220,1cyclictest567-21ssh12:05:203
13165992220,1cyclictest28063-21apt-get07:40:003
13165992220,1cyclictest22786-21rm11:56:033
1316599220,22cyclictest0-21swapper/312:38:583
1316599220,22cyclictest0-21swapper/312:15:223
1316599220,21cyclictest7460-21ssh09:40:373
1316599220,21cyclictest7460-21ssh09:40:373
1316599220,21cyclictest7293-21diskmemload09:20:273
1316599220,21cyclictest28063-21apt-get07:40:023
1316599220,21cyclictest0-21swapper/311:25:363
1316599220,1cyclictest24631-21sh09:56:523
13161992222,0cyclictest0-21swapper/212:01:222
13161992222,0cyclictest0-21swapper/211:37:432
13161992222,0cyclictest0-21swapper/209:25:422
13161992221,1cyclictest7293-21diskmemload12:35:512
13161992221,1cyclictest20735-21grep07:25:012
13161992220,1cyclictest25509-21latency_hist07:35:002
13161992220,1cyclictest13014-21ssh09:45:592
1316199221,0cyclictest0-21swapper/210:20:332
1316199220,21cyclictest7293-21diskmemload10:27:042
1316199220,21cyclictest7293-21diskmemload09:35:322
1316199220,21cyclictest27724-21turbostat.cron08:45:002
1316199220,21cyclictest20988-21apt-get08:33:262
1316199220,21cyclictest18784-21ssh09:20:532
1316199220,1cyclictest3045-21ssh11:07:592
1316199220,1cyclictest27013-21ssh12:30:102
1316199220,1cyclictest0-21swapper/208:48:282
13159992220,1cyclictest7293-21diskmemload09:20:061
13159992220,1cyclictest0-21swapper/108:10:011
13159992219,2cyclictest29850-21ssh09:31:321
1315999220,22cyclictest2906-21ssh11:07:481
1315999220,21cyclictest29371-21ssh12:02:491
1315999220,21cyclictest0-21swapper/111:45:351
1315999220,21cyclictest0-21swapper/111:13:111
1315999220,21cyclictest0-21swapper/108:13:261
1315999220,21cyclictest0-21swapper/107:40:021
13154992222,0cyclictest0-21swapper/012:20:310
13154992222,0cyclictest0-21swapper/010:05:030
13154992221,1cyclictest24104-21kworker/u8:110:31:050
13154992221,1cyclictest24104-21kworker/u8:110:31:050
13154992220,1cyclictest20734-21munin-run07:25:010
13154992220,1cyclictest0-21swapper/012:37:400
1315499220,21cyclictest7293-21diskmemload12:30:060
1315499220,21cyclictest7293-21diskmemload10:15:190
1315499220,21cyclictest0-21swapper/010:21:100
1315499220,21cyclictest0-21swapper/009:50:020
1315499220,21cyclictest0-21swapper/009:36:000
1315499220,21cyclictest0-21swapper/009:10:050
1315499220,21cyclictest0-21swapper/008:08:260
1315499220,21cyclictest0-21swapper/007:48:290
1315499220,1cyclictest32533-21munin-run08:55:010
1315499220,1cyclictest0-21swapper/012:10:320
1315499220,1cyclictest0-21swapper/012:05:110
1315499220,1cyclictest0-21swapper/012:05:110
1315499220,0cyclictest0-21swapper/010:10:010
1315499220,0cyclictest0-21swapper/008:33:260
13165992120,1cyclictest0-21swapper/307:18:273
1316599210,21cyclictest0-21swapper/309:45:033
1316599210,21cyclictest0-21swapper/307:58:273
1316599210,20cyclictest25488-21sh07:35:003
1316599210,20cyclictest10978-21apt-get08:13:263
1316599210,20cyclictest0-21swapper/309:10:013
1316599210,20cyclictest0-21swapper/308:23:263
1316599210,20cyclictest0-21swapper/308:18:263
1316599210,1cyclictest30640-21apt-get08:53:263
13161992121,0cyclictest0-21swapper/208:53:262
13161992120,0cyclictest6190-21apt-get08:03:282
13161992118,2cyclictest15523-21idleruntime-cro07:15:012
1316199210,20cyclictest0-21swapper/209:08:282
1316199210,0cyclictest0-21swapper/211:40:192
13159992121,0cyclictest0-21swapper/108:30:021
13159992121,0cyclictest0-21swapper/107:38:251
13159992120,1cyclictest30640-21apt-get08:53:251
13159992120,1cyclictest0-21swapper/107:53:271
13159992120,0cyclictest0-21swapper/108:03:281
13159992119,1cyclictest856-21munin-run07:50:001
1315999210,21cyclictest0-21swapper/110:40:311
13154992121,0cyclictest0-21swapper/008:43:260
13154992120,0cyclictest0-21swapper/008:13:260
13165992020,0cyclictest0-21swapper/308:38:263
13165992020,0cyclictest0-21swapper/307:20:023
13159992020,0cyclictest0-21swapper/109:08:281
13159992020,0cyclictest0-21swapper/108:18:261
13154992020,0cyclictest0-21swapper/008:23:260
13154992020,0cyclictest0-21swapper/008:18:260
13154992020,0cyclictest0-21swapper/008:03:280
13154992020,0cyclictest0-21swapper/007:43:260
1315499200,0cyclictest0-21swapper/008:38:260
13161991919,0cyclictest23383-21apt-get08:38:262
13161991919,0cyclictest21240-21apt-get07:28:262
13161991919,0cyclictest0-21swapper/208:58:252
13159991919,0cyclictest0-21swapper/107:28:261
13159991917,1cyclictest18196-21apt-get08:28:261
13154991919,0cyclictest13636-21apt-get07:13:260
13154991918,1cyclictest0-21swapper/008:28:260
13161991818,0cyclictest0-21swapper/208:13:262
13161991818,0cyclictest0-21swapper/207:58:272
13159991818,0cyclictest0-21swapper/107:33:251
13159991814,2cyclictest313-21systemd-journal09:05:011
13154991818,0cyclictest0-21swapper/009:03:270
13161991716,1cyclictest3042-21apt-get09:03:272
1316199170,17cyclictest0-21swapper/207:38:252
13159991717,0cyclictest0-21swapper/108:23:261
13154991717,0cyclictest0-21swapper/007:28:260
13165991614,1cyclictest23094-21cron07:30:013
1316199168,7cyclictest15410-21munin-node07:48:142
13161991616,0cyclictest17919-21dpkg07:20:012
13161991616,0cyclictest0-21swapper/208:08:262
13159991616,0cyclictest0-21swapper/107:13:261
13159991614,1cyclictest22-21ksoftirqd/108:43:321
13159991614,1cyclictest17947-21munin-run07:20:011
13159991613,2cyclictest3707-21taskset07:57:591
13154991616,0cyclictest0-21swapper/007:33:250
13154991614,1cyclictest5617-21cpuspeed_turbos09:08:290
13165991515,0cyclictest0-21swapper/308:03:283
1316599150,1cyclictest0-21swapper/308:28:343
13161991515,0cyclictest28998-21apt-get07:43:262
13161991512,2cyclictest17657-21cron08:25:002
13165991414,0cyclictest0-21swapper/309:00:253
1316599140,14cyclictest0-21swapper/308:56:233
1316599140,14cyclictest0-21swapper/308:45:393
1316599140,14cyclictest0-21swapper/308:31:073
1316599140,14cyclictest0-21swapper/307:45:113
1316599140,0cyclictest0-21swapper/307:10:413
1316199140,14cyclictest0-21swapper/208:25:152
1316199140,14cyclictest0-21swapper/207:52:572
1316199140,0cyclictest0-21swapper/208:15:152
13154991414,0cyclictest0-21swapper/008:45:400
1315499140,14cyclictest0-21swapper/008:56:150
1315499140,0cyclictest0-21swapper/007:50:180
1315499140,0cyclictest0-21swapper/007:35:450
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional