You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 01:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Jul 05, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28820992523,1cyclictest15442-21sh11:57:283
28817992522,2cyclictest4112-21ssh11:47:002
2881799250,24cyclictest23171-21ssh09:38:282
28814992525,0cyclictest0-21swapper/111:11:161
2881499250,2cyclictest24161-21ssh12:06:241
2881499250,24cyclictest25381-21ssh11:08:281
2881499250,0cyclictest0-21swapper/111:47:261
28810992523,1cyclictest62550irq/127-eno110:30:010
2881099250,1cyclictest0-21swapper/009:38:280
28820992423,0cyclictest0-21swapper/307:21:253
28820992422,1cyclictest22949-21diskmemload09:18:493
2882099240,24cyclictest0-21swapper/311:10:303
2882099240,23cyclictest24481-21apt-get08:06:243
2882099240,23cyclictest22949-21diskmemload10:06:013
2882099240,23cyclictest0-21swapper/311:05:243
2882099240,23cyclictest0-21swapper/310:42:353
2882099240,23cyclictest0-21swapper/309:11:153
2882099240,1cyclictest0-21swapper/309:33:383
2882099240,0cyclictest22949-21diskmemload12:39:053
28817992423,1cyclictest21619-21sh12:03:142
28817992423,1cyclictest21619-21sh12:03:142
28817992422,1cyclictest0-21swapper/210:47:212
2881799240,24cyclictest0-21swapper/210:52:272
2881799240,23cyclictest6479-21apt-get08:36:252
2881799240,23cyclictest3526-21ssh09:50:482
2881799240,23cyclictest0-21swapper/211:35:412
2881799240,0cyclictest0-21swapper/208:06:232
28814992423,1cyclictest6785-21ssh11:50:271
2881499240,2cyclictest607-21in:imuxsock12:00:001
2881499240,24cyclictest0-21swapper/111:27:291
2881499240,24cyclictest0-21swapper/110:59:071
2881499240,23cyclictest18974-21sh12:30:511
2881499240,1cyclictest22949-21diskmemload10:30:131
2881499240,0cyclictest0-21swapper/109:23:261
28810992423,1cyclictest0-21swapper/011:46:260
28810992422,2cyclictest26880-21taskset08:11:240
28810992422,2cyclictest0-21swapper/010:32:320
2881099241,1cyclictest62550irq/127-eno109:22:210
2881099240,24cyclictest22949-21diskmemload12:29:530
2881099240,24cyclictest0-21swapper/010:37:270
2881099240,24cyclictest0-21swapper/010:19:010
2881099240,23cyclictest22949-21diskmemload10:44:070
2881099240,23cyclictest0-21swapper/012:16:350
2881099240,23cyclictest0-21swapper/009:27:080
2881099240,1cyclictest22949-21diskmemload11:09:260
2881099240,1cyclictest0-21swapper/011:42:010
2881099240,1cyclictest0-21swapper/009:50:480
28820992323,0cyclictest22949-21diskmemload11:00:293
28820992323,0cyclictest0-21swapper/310:55:153
28820992322,1cyclictest22949-21diskmemload10:54:543
28820992322,1cyclictest0-21swapper/311:31:123
28820992322,0cyclictest0-21swapper/310:10:093
28820992321,1cyclictest0-21swapper/311:42:153
28820992321,1cyclictest0-21swapper/309:51:323
2882099230,23cyclictest0-21swapper/312:29:213
2882099230,23cyclictest0-21swapper/312:00:063
2882099230,23cyclictest0-21swapper/312:00:063
2882099230,23cyclictest0-21swapper/311:24:343
2882099230,23cyclictest0-21swapper/309:28:353
2882099230,22cyclictest22949-21diskmemload10:31:053
2882099230,22cyclictest22949-21diskmemload10:01:573
2882099230,22cyclictest2077-21ssh10:47:153
2882099230,22cyclictest1888-21ssh12:15:143
2882099230,22cyclictest15766-21turbostat08:55:013
2882099230,22cyclictest0-21swapper/312:21:163
2882099230,22cyclictest0-21swapper/311:46:273
2882099230,22cyclictest0-21swapper/309:56:303
28817992323,0cyclictest0-21swapper/210:37:272
28817992323,0cyclictest0-21swapper/209:44:112
28817992321,1cyclictest12928-21users10:56:342
28817992320,2cyclictest32277-21rm12:12:412
2881799230,23cyclictest30988-21ssh11:42:012
2881799230,23cyclictest22949-21diskmemload12:25:482
2881799230,23cyclictest0-21swapper/212:23:222
2881799230,23cyclictest0-21swapper/211:09:262
2881799230,22cyclictest8628-21ssh09:55:152
2881799230,22cyclictest19531-21ssh10:05:032
2881799230,1cyclictest3823-21ssh10:20:132
2881799230,1cyclictest14132-21rm10:00:132
2881799230,0cyclictest0-21swapper/211:50:412
2881799230,0cyclictest0-21swapper/211:31:182
2881799230,0cyclictest0-21swapper/211:11:272
2881799230,0cyclictest0-21swapper/210:41:332
2881799230,0cyclictest0-21swapper/210:15:062
2881799230,0cyclictest0-21swapper/209:29:042
28814992323,0cyclictest22949-21diskmemload11:02:011
28814992323,0cyclictest0-21swapper/112:27:521
28814992323,0cyclictest0-21swapper/110:51:311
28814992323,0cyclictest0-21swapper/110:38:551
28814992323,0cyclictest0-21swapper/109:38:411
28814992322,1cyclictest22949-21diskmemload11:21:351
2881499230,23cyclictest0-21swapper/112:39:141
2881499230,23cyclictest0-21swapper/112:04:251
2881499230,23cyclictest0-21swapper/112:04:251
2881499230,23cyclictest0-21swapper/110:19:521
2881499230,22cyclictest6347-21cron07:30:011
2881499230,22cyclictest29523-21sh12:11:151
2881499230,22cyclictest22949-21diskmemload09:40:581
2881499230,22cyclictest19943-21ssh11:32:061
2881499230,22cyclictest10424-21ssh09:26:391
2881499230,0cyclictest0-21swapper/111:41:381
2881499230,0cyclictest0-21swapper/110:24:051
28810992323,0cyclictest22949-21diskmemload12:21:480
28810992323,0cyclictest0-21swapper/012:38:410
28810992323,0cyclictest0-21swapper/012:00:380
28810992323,0cyclictest0-21swapper/012:00:380
28810992323,0cyclictest0-21swapper/011:38:340
28810992323,0cyclictest0-21swapper/010:08:590
28810992323,0cyclictest0-21swapper/009:13:370
28810992322,1cyclictest62550irq/127-eno109:43:020
28810992321,1cyclictest0-21swapper/010:22:100
28810992321,1cyclictest0-21swapper/010:14:200
28810992321,1cyclictest0-21swapper/010:03:110
2881099230,23cyclictest0-21swapper/011:56:540
2881099230,23cyclictest0-21swapper/011:50:570
2881099230,23cyclictest0-21swapper/011:30:430
2881099230,23cyclictest0-21swapper/010:46:110
2881099230,22cyclictest17902-21taskset09:34:240
2881099230,22cyclictest14353-21ssh11:27:330
2881099230,22cyclictest13536-21ssh10:57:200
2881099230,1cyclictest20937-21cron11:05:000
2881099230,1cyclictest0-21swapper/009:55:150
2881099230,0cyclictest0-21swapper/010:50:060
28820992222,0cyclictest0-21swapper/309:45:583
28820992221,1cyclictest21152-21apt-get10:36:263
28820992220,2cyclictest18193-21grep09:00:013
28820992220,1cyclictest1154-21apt-get07:20:013
28820992220,1cyclictest0-21swapper/311:36:003
2882099220,21cyclictest4211-21diskmemload10:20:423
2882099220,21cyclictest22990-21ssh09:10:013
2882099220,21cyclictest22949-21diskmemload10:15:053
2882099220,21cyclictest20566-21cron09:05:013
2882099220,21cyclictest0-21swapper/312:30:383
2882099220,21cyclictest0-21swapper/312:05:293
2882099220,21cyclictest0-21swapper/311:52:373
2882099220,21cyclictest0-21swapper/311:26:113
2882099220,21cyclictest0-21swapper/308:21:243
2882099220,1cyclictest0-21swapper/311:15:053
2882099220,1cyclictest0-21swapper/310:28:223
2882099220,1cyclictest0-21swapper/309:41:233
2882099220,0cyclictest22949-21diskmemload12:10:443
28817992222,0cyclictest22949-21diskmemload11:16:182
28817992222,0cyclictest0-21swapper/212:38:122
28817992222,0cyclictest0-21swapper/211:56:532
28817992220,2cyclictest5631-21ssh11:20:232
28817992220,2cyclictest31656-21/usr/sbin/munin09:46:262
28817992220,1cyclictest0-21swapper/208:11:242
28817992219,2cyclictest13037-21nvmesmart_nvme011:26:302
2881799220,22cyclictest31848-21ssh09:16:432
2881799220,22cyclictest22949-21diskmemload12:19:382
2881799220,22cyclictest0-21swapper/212:30:412
2881799220,22cyclictest0-21swapper/210:34:072
2881799220,21cyclictest16641-21apt-get11:01:272
2881799220,21cyclictest0-21swapper/209:20:152
2881799220,1cyclictest13687-21sh09:30:472
28814992222,0cyclictest22949-21diskmemload10:47:171
28814992222,0cyclictest0-21swapper/111:39:401
28814992222,0cyclictest0-21swapper/110:00:261
28814992222,0cyclictest0-21swapper/109:50:511
28814992221,1cyclictest32362-21ssh11:15:121
28814992221,1cyclictest10112-21apt-get10:26:251
28814992220,1cyclictest32175-21ntp_states09:46:291
28814992220,1cyclictest0-21swapper/110:14:581
2881499220,22cyclictest0-21swapper/112:17:361
2881499220,21cyclictest0-21swapper/108:56:251
2881499220,21cyclictest0-21swapper/107:51:221
2881499220,1cyclictest606-21dbus-daemon09:10:011
2881499220,1cyclictest16692-21sh09:32:311
2881499220,1cyclictest0-21swapper/110:08:181
2881499220,0cyclictest22958-21apt-get09:10:021
2881499220,0cyclictest0-21swapper/110:41:231
28810992222,0cyclictest0-21swapper/009:17:180
28810992221,1cyclictest62550irq/127-eno111:20:070
28810992221,0cyclictest29140-21apt-get07:11:240
28810992220,1cyclictest0-21swapper/009:45:240
2881099220,21cyclictest0-21swapper/012:31:530
2881099220,21cyclictest0-21swapper/011:17:310
2881099220,1cyclictest24154-21apt-get12:06:240
2881099220,0cyclictest0-21swapper/011:10:310
28820992120,1cyclictest4080-21apt-get08:31:243
2882099210,20cyclictest18392-21apt-get09:35:023
2882099210,20cyclictest0-21swapper/307:46:243
2882099210,0cyclictest22949-21diskmemload09:20:533
28817992120,1cyclictest0-21swapper/207:11:242
2881799210,21cyclictest23176-21ssh12:05:022
2881799210,21cyclictest0-21swapper/210:10:262
28814992120,1cyclictest31530-21apt-get07:16:231
28814992119,1cyclictest1938-21apt-get07:21:251
2881499210,21cyclictest75-21kswapd009:56:251
2881499210,21cyclictest18549-21apt-get09:01:261
2881499210,21cyclictest0-21swapper/109:15:141
2881499210,21cyclictest0-21swapper/108:41:251
2881499210,20cyclictest31181-21munin-run07:15:011
2881499210,20cyclictest0-21swapper/107:41:261
28810992121,0cyclictest0-21swapper/007:16:240
2881099210,21cyclictest0-21swapper/009:06:260
2881099210,0cyclictest0-21swapper/007:36:260
28820992020,0cyclictest0-21swapper/307:36:263
28817992020,0cyclictest0-21swapper/209:06:262
28817992020,0cyclictest0-21swapper/208:56:252
28817992020,0cyclictest0-21swapper/207:16:242
28817992019,0cyclictest0-21swapper/207:21:252
2881799200,0cyclictest0-21swapper/208:01:252
28814992020,0cyclictest0-21swapper/108:06:241
28814992020,0cyclictest0-21swapper/107:35:021
28810992020,0cyclictest4329-21apt-get07:26:240
28810992020,0cyclictest0-21swapper/008:01:250
28810992019,1cyclictest0-21swapper/007:41:250
2881099200,0cyclictest0-21swapper/008:36:260
28820991919,0cyclictest0-21swapper/307:56:243
28817991917,1cyclictest6159-21sed08:35:002
28814991918,1cyclictest0-21swapper/108:55:011
28810991919,0cyclictest0-21swapper/008:31:250
28820991818,0cyclictest16878-21apt-get07:51:223
28820991818,0cyclictest0-21swapper/308:01:253
28820991818,0cyclictest0-21swapper/307:11:243
28820991816,1cyclictest28926-21perf08:15:013
28817991818,0cyclictest0-21swapper/207:26:242
28814991818,0cyclictest0-21swapper/108:46:251
28810991818,0cyclictest0-21swapper/008:06:230
28810991817,1cyclictest11342-21apt-get08:46:250
2881099180,1cyclictest0-21swapper/007:51:290
2881099180,17cyclictest0-21swapper/007:21:250
28820991717,0cyclictest0-21swapper/307:31:243
28820991716,1cyclictest29279-21apt-get08:16:233
28817991717,0cyclictest0-21swapper/208:46:252
28817991717,0cyclictest0-21swapper/207:41:252
28814991717,0cyclictest31699-21apt-get08:21:241
28814991717,0cyclictest14487-21apt-get07:46:241
28810991717,0cyclictest0-21swapper/008:41:250
28810991717,0cyclictest0-21swapper/008:26:240
28810991717,0cyclictest0-21swapper/008:21:240
28810991715,2cyclictest20588-21grep09:05:010
28820991616,0cyclictest0-21swapper/308:50:003
28820991616,0cyclictest0-21swapper/307:26:243
28817991616,0cyclictest0-21swapper/208:26:242
28817991615,1cyclictest8895-21apt-get08:41:252
28817991614,2cyclictest8760-21apt-get07:35:012
28814991616,0cyclictest0-21swapper/108:16:231
2881499160,15cyclictest23782-21grep08:01:341
28810991616,0cyclictest0-21swapper/008:16:240
2881099160,1cyclictest15745-21cron08:55:010
2881099160,15cyclictest0-21swapper/007:31:300
28820991515,0cyclictest0-21swapper/308:36:253
2882099150,14cyclictest10993-21munin-run08:45:003
28817991515,0cyclictest0-21swapper/209:01:262
28817991515,0cyclictest0-21swapper/208:21:242
2881799150,14cyclictest622-21gdbus08:55:012
28814991515,0cyclictest0-21swapper/108:31:241
2881499150,14cyclictest0-21swapper/107:56:261
28810991515,0cyclictest0-21swapper/007:46:240
28820991414,0cyclictest0-21swapper/308:25:003
2882099140,0cyclictest0-21swapper/307:41:203
28817991414,0cyclictest0-21swapper/208:16:242
2881799140,14cyclictest0-21swapper/207:55:312
2881799140,14cyclictest0-21swapper/207:45:212
2881799140,0cyclictest0-21swapper/207:50:182
2881799140,0cyclictest0-21swapper/207:35:492
2881499140,14cyclictest0-21swapper/108:25:361
2881499140,14cyclictest0-21swapper/108:10:191
28810991414,0cyclictest0-21swapper/008:55:370
28810991414,0cyclictest0-21swapper/007:55:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional