You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 20:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Wed Apr 22, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22901212396,21sleep00-21swapper/007:09:230
228992120109,6sleep30-21swapper/307:09:223
22192211597,12sleep20-21swapper/207:05:332
22002211294,11sleep10-21swapper/107:05:161
1237521100,0sleep10-21swapper/112:35:531
126602770,0sleep00-21swapper/010:55:280
14082740,1sleep1221ktimersoftd/108:55:161
167072660,0sleep00-21swapper/009:20:080
203742310,0sleep00-21swapper/012:10:310
132062310,0sleep20-21swapper/212:36:342
142262230,1sleep123-21ksoftirqd/109:16:371
2297599211,18cyclictest66982sleep110:50:111
2297599211,18cyclictest0-21swapper/108:20:121
2297599210,2cyclictest0-21swapper/111:50:111
2297499210,19cyclictest0-21swapper/008:35:110
2297799200,2cyclictest0-21swapper/311:50:103
2297599200,2cyclictest0-21swapper/107:45:111
2297599200,18cyclictest207150irq/24-eth111:00:111
22976991916,2cyclictest8189-21kworker/u8:209:16:042
2297699190,14cyclictest0-21swapper/212:21:042
22976991815,2cyclictest8189-21kworker/u8:209:22:052
22976991815,2cyclictest4539-21kworker/u8:212:28:042
22976991815,2cyclictest30500-21kworker/u8:109:46:012
22976991815,2cyclictest23258-21kworker/u8:207:25:052
22976991815,2cyclictest17211-21kworker/u8:108:26:052
22976991815,2cyclictest1504-21kworker/u8:211:36:012
22976991714,2cyclictest17211-21kworker/u8:108:36:042
22976991714,2cyclictest1504-21kworker/u8:211:41:052
2297699170,2cyclictest0-21swapper/210:40:052
2297699170,12cyclictest0-21swapper/211:55:052
22976991613,2cyclictest8136-21kworker/u8:111:32:022
22976991613,2cyclictest32331-21kworker/u8:110:48:012
22976991613,2cyclictest23204-21kworker/u8:210:01:052
22976991613,2cyclictest16219-21kworker/u8:011:01:042
22976991613,2cyclictest11911-21kworker/u8:009:59:042
2297699161,13cyclictest5963-21iostat10:15:162
22976991611,3cyclictest0-21swapper/211:16:042
2297599161,3cyclictest29361-21apt-get10:40:121
2297599161,3cyclictest0-21swapper/111:22:291
2297599161,3cyclictest0-21swapper/107:40:131
22975991611,3cyclictest0-21swapper/111:19:401
22975991611,3cyclictest0-21swapper/108:01:001
2297599160,14cyclictest0-21swapper/109:14:291
2297499160,14cyclictest1017-21cpuspeed_turbos08:55:130
302292150,2sleep00-21swapper/011:47:280
2297799151,12cyclictest403-21python09:36:023
2297799150,13cyclictest0-21swapper/310:45:123
2297699151,2cyclictest0-21swapper/207:20:142
22976991512,2cyclictest9572-21kworker/u8:310:58:052
22976991512,2cyclictest6768-21diskmemload11:12:462
22976991512,2cyclictest32331-21kworker/u8:110:29:052
22976991512,2cyclictest30500-21kworker/u8:109:44:042
22976991512,2cyclictest25642-21kworker/u8:011:50:042
2297699150,2cyclictest0-21swapper/212:34:042
2297599152,8cyclictest29068-21copy07:25:001
22975991512,2cyclictest0-21swapper/110:58:291
22975991510,3cyclictest15867-21sh10:25:181
2297599150,13cyclictest0-21swapper/112:33:191
22974991510,3cyclictest29833-21modprobe08:45:140
22974991510,3cyclictest0-21swapper/010:45:140
2297499150,13cyclictest0-21swapper/009:46:530
22977991410,2cyclictest24853-21df10:35:123
2297799140,12cyclictest8318-21python10:51:023
2297799140,12cyclictest0-21swapper/311:55:123
2297799140,12cyclictest0-21swapper/310:58:463
2297799140,12cyclictest0-21swapper/308:05:103
22976991411,2cyclictest6057-21kworker/u8:312:00:052
22976991411,2cyclictest6057-21kworker/u8:312:00:042
22976991411,2cyclictest4975-21kworker/u8:009:37:042
22976991411,2cyclictest464-21kworker/u8:208:12:042
22976991411,2cyclictest23258-21kworker/u8:207:16:042
22976991411,2cyclictest23204-21kworker/u8:210:05:042
22976991411,2cyclictest0-21swapper/212:18:472
22976991411,2cyclictest0-21swapper/210:10:162
2297699140,2cyclictest0-21swapper/209:13:042
2297699140,2cyclictest0-21swapper/208:40:022
2297699140,13cyclictest10038-21ssh10:20:062
2297699140,13cyclictest0-21swapper/211:46:162
2297699140,13cyclictest0-21swapper/211:22:062
2297699140,12cyclictest8814-21iostat_ios11:25:152
2297699140,12cyclictest8289-21python07:51:002
2297699140,12cyclictest19983-21ssh12:10:162
2297599149,3cyclictest0-21swapper/109:30:391
2297599149,3cyclictest0-21swapper/108:40:161
2297599141,2cyclictest6768-21diskmemload10:10:291
22975991411,2cyclictest0-21swapper/110:01:291
22975991410,2cyclictest0-21swapper/112:15:501
2297599140,2cyclictest0-21swapper/109:58:191
2297599140,13cyclictest0-21swapper/111:40:091
2297599140,13cyclictest0-21swapper/110:22:091
2297599140,12cyclictest0-21swapper/112:10:181
2297599140,12cyclictest0-21swapper/111:06:011
22974991411,2cyclictest0-21swapper/012:17:550
22974991411,2cyclictest0-21swapper/010:05:040
22974991411,2cyclictest0-21swapper/008:25:130
22974991410,2cyclictest0-21swapper/009:55:160
2297499140,3cyclictest12369-21ssh12:02:250
2297499140,3cyclictest12369-21ssh12:02:250
2297499140,13cyclictest0-21swapper/010:35:140
2297499140,12cyclictest0-21swapper/011:40:000
2297499140,12cyclictest0-21swapper/010:22:140
2297499140,12cyclictest0-21swapper/007:30:100
2297799131,2cyclictest29978-21sh12:20:283
22977991310,2cyclictest6768-21diskmemload11:10:123
22977991310,2cyclictest20658-21ssh11:37:373
22977991310,2cyclictest0-21swapper/312:16:013
22977991310,2cyclictest0-21swapper/312:12:383
22977991310,2cyclictest0-21swapper/311:43:073
22977991310,2cyclictest0-21swapper/310:21:583
22977991310,2cyclictest0-21swapper/310:01:083
22977991310,2cyclictest0-21swapper/309:52:383
22977991310,2cyclictest0-21swapper/309:41:283
22977991310,2cyclictest0-21swapper/309:31:583
22977991310,2cyclictest0-21swapper/308:00:173
2297799130,2cyclictest6768-21diskmemload11:05:003
2297799130,2cyclictest0-21swapper/311:30:473
2297799130,2cyclictest0-21swapper/310:05:273
2297799130,2cyclictest0-21swapper/307:10:173
2297799130,12cyclictest0-21swapper/311:28:563
2297799130,12cyclictest0-21swapper/310:10:483
2297799130,12cyclictest0-21swapper/309:18:363
2297799130,11cyclictest0-21swapper/310:32:283
2297699132,6cyclictest0-21swapper/209:10:002
2297699132,6cyclictest0-21swapper/208:00:002
22976991310,2cyclictest464-21kworker/u8:208:15:052
22976991310,2cyclictest22651-21kworker/u8:308:48:012
22976991310,2cyclictest0-21swapper/211:05:062
22976991310,2cyclictest0-21swapper/210:54:332
22976991310,2cyclictest0-21swapper/209:34:272
22976991310,2cyclictest0-21swapper/209:00:022
2297699130,2cyclictest0-21swapper/208:20:162
2297699130,12cyclictest26717-21ssh10:36:252
2297699130,12cyclictest0-21swapper/212:06:012
2297599139,2cyclictest0-21swapper/107:11:031
2297599138,3cyclictest6768-21diskmemload09:20:161
2297599138,3cyclictest12894-21munin-node1
2297599132,6cyclictest0-21swapper/107:35:001
2297599131,10cyclictest0-21swapper/107:25:061
22975991310,2cyclictest0-21swapper/112:05:001
22975991310,2cyclictest0-21swapper/111:58:411
22975991310,2cyclictest0-21swapper/111:49:401
22975991310,2cyclictest0-21swapper/111:35:191
22975991310,2cyclictest0-21swapper/110:07:291
22975991310,2cyclictest0-21swapper/109:28:301
2297599130,2cyclictest0-21swapper/112:28:531
2297599130,12cyclictest0-21swapper/112:20:291
2297599130,12cyclictest0-21swapper/111:25:091
2297599130,12cyclictest0-21swapper/110:30:391
2297599130,12cyclictest0-21swapper/110:16:101
2297599130,12cyclictest0-21swapper/109:53:101
2297599130,11cyclictest0-21swapper/109:40:181
2297599130,11cyclictest0-21swapper/108:35:281
2297499131,7cyclictest0-21swapper/009:25:000
22974991310,2cyclictest0-21swapper/012:29:540
22974991310,2cyclictest0-21swapper/012:07:150
22974991310,2cyclictest0-21swapper/011:55:550
22974991310,2cyclictest0-21swapper/011:13:440
22974991310,2cyclictest0-21swapper/009:40:440
22974991310,2cyclictest0-21swapper/009:18:560
2297499130,2cyclictest0-21swapper/011:09:150
2297499130,2cyclictest0-21swapper/010:50:340
2297499130,12cyclictest18951-21ssh11:02:040
2297499130,12cyclictest0-21swapper/012:38:340
2297499130,12cyclictest0-21swapper/011:41:040
2297499130,12cyclictest0-21swapper/011:18:240
2297499130,12cyclictest0-21swapper/010:40:060
2297499130,12cyclictest0-21swapper/010:29:350
2297499130,12cyclictest0-21swapper/009:34:430
2297499130,12cyclictest0-21swapper/009:12:330
92342120,2sleep00-21swapper/010:19:140
2297799129,2cyclictest18044-21ssh12:08:483
2297799129,2cyclictest0-21swapper/312:30:273
2297799129,2cyclictest0-21swapper/310:25:123
2297799129,2cyclictest0-21swapper/309:55:153
2297799120,9cyclictest4562-21gdm-simple-gree08:24:583
2297799120,2cyclictest0-21swapper/312:26:383
2297799120,2cyclictest0-21swapper/311:20:483
2297799120,2cyclictest0-21swapper/309:46:263
2297799120,2cyclictest0-21swapper/309:27:193
2297799120,2cyclictest0-21swapper/309:22:483
2297799120,2cyclictest0-21swapper/309:11:003
2297799120,11cyclictest0-21swapper/312:36:173
2297799120,11cyclictest0-21swapper/312:01:093
2297799120,11cyclictest0-21swapper/312:01:083
2297799120,11cyclictest0-21swapper/311:46:183
2297799120,11cyclictest0-21swapper/311:16:573
2297799120,11cyclictest0-21swapper/310:42:173
2297799120,11cyclictest0-21swapper/310:16:373
2297799120,11cyclictest0-21swapper/307:40:173
2297799120,11cyclictest0-21swapper/307:30:123
2297799120,11cyclictest0-21swapper/307:20:133
2297699129,2cyclictest6015-21kworker/u8:107:10:052
2297699129,2cyclictest464-21kworker/u8:208:02:062
2297699129,2cyclictest464-21kworker/u8:207:45:042
2297699129,2cyclictest0-21swapper/208:58:042
2297699122,7cyclictest0-21swapper/208:07:582
2297699122,6cyclictest0-21swapper/207:40:012
2297699120,2cyclictest0-21swapper/210:30:362
2297699120,11cyclictest0-21swapper/209:50:022
2297699120,11cyclictest0-21swapper/207:30:182
2297599129,2cyclictest6768-21diskmemload11:10:011
2297599129,2cyclictest0-21swapper/107:55:001
2297599129,2cyclictest0-21swapper/107:36:001
2297599121,9cyclictest0-21swapper/108:55:011
2297599121,9cyclictest0-21swapper/108:55:001
2297599121,3cyclictest5038-21aten2.4-expect09:05:111
2297599121,3cyclictest17048-21munin-node1
2297599120,2cyclictest0-21swapper/110:45:381
2297599120,2cyclictest0-21swapper/110:35:151
2297599120,2cyclictest0-21swapper/109:45:431
2297599120,11cyclictest0-21swapper/112:02:301
2297599120,11cyclictest0-21swapper/112:02:301
2297599120,11cyclictest0-21swapper/109:35:531
2297599120,11cyclictest0-21swapper/108:30:191
2297599120,10cyclictest0-21swapper/107:51:001
2297499129,2cyclictest0-21swapper/012:34:250
2297499129,2cyclictest0-21swapper/012:20:440
2297499129,2cyclictest0-21swapper/011:27:440
2297499129,2cyclictest0-21swapper/009:50:140
2297499129,2cyclictest0-21swapper/009:35:110
2297499122,7cyclictest0-21swapper/008:32:590
2297499122,7cyclictest0-21swapper/007:54:590
2297499121,6cyclictest0-21swapper/008:45:010
2297499120,2cyclictest0-21swapper/011:32:160
2297499120,2cyclictest0-21swapper/010:04:450
2297499120,11cyclictest0-21swapper/011:53:150
2297499120,11cyclictest0-21swapper/011:22:360
2297499120,11cyclictest0-21swapper/010:32:250
2297499120,11cyclictest0-21swapper/010:14:450
2297499120,11cyclictest0-21swapper/009:08:040
2297499120,11cyclictest0-21swapper/007:17:040
2297499120,10cyclictest0-21swapper/007:25:180
2297799118,2cyclictest0-21swapper/309:05:593
2297799112,7cyclictest0-21swapper/308:26:593
2297799112,6cyclictest0-21swapper/308:14:583
2297799112,6cyclictest0-21swapper/307:46:013
2297799112,6cyclictest0-21swapper/307:26:033
2297799111,8cyclictest24898-21munin-run08:35:003
2297799110,8cyclictest0-21swapper/307:17:583
2297799110,10cyclictest0-21swapper/311:08:023
2297699119,1cyclictest0-21swapper/209:25:112
2297699113,5cyclictest0-21swapper/208:51:012
2297699113,5cyclictest0-21swapper/208:51:002
2297599116,3cyclictest0-21swapper/108:45:101
2297599111,8cyclictest0-21swapper/109:00:061
2297599111,2cyclictest0-21swapper/108:25:121
2297599110,9cyclictest25196-21munin-node1
2297599110,3cyclictest0-21swapper/108:05:161
2297499118,2cyclictest0-21swapper/007:20:140
150382110,2sleep115042-21apt-get08:10:101
2297799102,7cyclictest0-21swapper/308:46:013
2297799102,6cyclictest0-21swapper/307:51:003
2297799102,5cyclictest0-21swapper/307:59:583
2297799100,9cyclictest0-21swapper/307:35:133
2297699107,2cyclictest26924-21kworker/u8:007:40:012
2297699105,3cyclictest23630-21grep08:30:152
2297499107,2cyclictest0-21swapper/008:03:230
2297499100,9cyclictest0-21swapper/009:00:170
229779992,6cyclictest0-21swapper/308:56:013
229749996,2cyclictest0-21swapper/007:35:120
229749994,3cyclictest20866-21sh08:25:000
229749994,3cyclictest17304-21cpuspeed_turbos08:15:130
229749994,3cyclictest15151-21aten2.4_r3power08:10:110
229749991,5cyclictest0-21swapper/007:10:110
229749991,3cyclictest0-21swapper/007:40:150
229779985,2cyclictest0-21swapper/308:15:143
229779983,3cyclictest32103-21open_inodes08:50:183
229779983,3cyclictest32103-21open_inodes08:50:173
229779983,3cyclictest27201-21aten2.4-expect08:40:123
229779981,5cyclictest0-21swapper/309:01:023
229749983,3cyclictest9243-21aten2.4_r3power07:55:110
229749983,3cyclictest31225-21aten2.4_r3power08:50:120
229749983,3cyclictest31225-21aten2.4_r3power08:50:110
229749983,3cyclictest13367-21chrt08:05:120
229749981,5cyclictest5279-21aten2.4-expect07:45:130
229779974,2cyclictest25208-21aten2.4-expect08:35:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional