You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 20:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Wed Apr 15, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19046212298,19sleep30-21swapper/307:06:223
19239211894,19sleep00-21swapper/007:08:520
19303211294,12sleep10-21swapper/107:09:411
19159210796,6sleep20-21swapper/207:07:502
64122910,2sleep121-21rcuc/112:35:131
29802740,1sleep10-21swapper/110:15:451
225842730,0sleep2301ktimersoftd/211:45:002
284352710,1sleep228436-21cron12:25:012
284352710,1sleep228436-21cron12:25:002
201522700,0sleep00-21swapper/011:07:510
60992600,1sleep30-21swapper/311:26:333
11632270,1sleep2301ktimersoftd/211:55:302
1935799240,22cyclictest0-21swapper/310:45:123
19357992110,3cyclictest27801-21aten2.4_r3power11:50:133
19354992119,1cyclictest0-21swapper/009:30:110
1935799200,2cyclictest0-21swapper/309:25:113
19356992017,2cyclictest9734-21kworker/u8:112:14:062
1935699201,2cyclictest0-21swapper/209:33:052
1935699200,16cyclictest0-21swapper/211:36:042
1935699200,15cyclictest0-21swapper/212:06:052
1935499201,17cyclictest9-21ksoftirqd/008:25:110
1935499200,18cyclictest0-21swapper/011:00:120
160152200,0sleep00-21swapper/011:37:130
1935699190,15cyclictest0-21swapper/209:56:042
1935699182,2cyclictest0-21swapper/210:49:042
1935699180,2cyclictest0-21swapper/210:38:012
1935699180,17cyclictest0-21swapper/211:03:042
1935499181,2cyclictest0-21swapper/008:50:090
3722170,0sleep30-21swapper/311:20:563
19356991714,2cyclictest3498-21kworker/u8:009:28:052
1935699170,2cyclictest0-21swapper/211:32:052
1935699170,2cyclictest0-21swapper/207:43:052
1935699170,12cyclictest0-21swapper/209:18:052
19356991613,2cyclictest9699-21kworker/u8:208:09:052
1935699160,2cyclictest0-21swapper/212:17:042
1935699160,2cyclictest0-21swapper/211:53:042
1935699160,2cyclictest0-21swapper/209:48:042
1935699160,2cyclictest0-21swapper/208:54:052
1935699160,15cyclictest0-21swapper/209:04:052
1935699160,15cyclictest0-21swapper/209:04:042
1935599161,3cyclictest9657-21sh11:30:191
1935599161,2cyclictest0-21swapper/109:47:211
1935599161,13cyclictest350-21fgrep07:41:001
1935499161,13cyclictest0-21swapper/011:18:570
1935799151,3cyclictest10532-21hddtemp_smartct09:50:153
1935799151,12cyclictest12269-21ssh11:33:493
1935799150,13cyclictest18905-21ssh09:59:293
1935799150,13cyclictest0-21swapper/309:36:243
19356991512,2cyclictest9699-21kworker/u8:209:11:052
19356991512,2cyclictest29494-21kworker/u8:211:28:042
19356991512,2cyclictest13235-21kworker/u8:210:28:052
19356991512,2cyclictest0-21swapper/207:26:022
1935699150,7cyclictest0-21swapper/212:32:592
1935699150,2cyclictest0-21swapper/211:20:292
1935699150,13cyclictest0-21swapper/208:58:022
1935699150,10cyclictest0-21swapper/208:49:052
1935599151,12cyclictest0-21swapper/111:01:221
1935599151,12cyclictest0-21swapper/110:45:131
19355991510,3cyclictest2794-21ssh09:42:101
19355991510,3cyclictest20568-21cut10:35:001
19355991510,3cyclictest19058-21munin-node1
1935599150,2cyclictest0-21swapper/111:26:011
1935599150,13cyclictest0-21swapper/111:10:121
1935499151,12cyclictest19730-21apt-get08:30:120
19354991510,3cyclictest0-21swapper/009:20:170
23562140,2sleep00-21swapper/009:41:300
19357991411,2cyclictest31095-21ssh12:26:403
19357991411,2cyclictest0-21swapper/307:55:143
1935799141,11cyclictest0-21swapper/310:14:273
19357991410,2cyclictest0-21swapper/311:45:173
1935799140,2cyclictest0-21swapper/309:15:503
1935799140,2cyclictest0-21swapper/308:02:203
1935799140,13cyclictest15437-21ssh09:21:193
1935799140,13cyclictest0-21swapper/312:32:193
1935799140,13cyclictest0-21swapper/310:32:503
1935799140,13cyclictest0-21swapper/310:25:403
1935799140,12cyclictest8029-21ssh12:02:533
1935799140,12cyclictest24126-21pzem09:30:283
19356991411,2cyclictest9699-21kworker/u8:208:14:042
19356991411,2cyclictest4023-21kworker/u8:210:03:052
19356991411,2cyclictest27818-21kworker/u8:109:39:052
19356991411,2cyclictest10118-21kworker/u8:107:12:052
19356991411,2cyclictest0-21swapper/212:36:082
1935699140,2cyclictest0-21swapper/207:53:052
1935699140,12cyclictest1459-21ssh10:15:012
1935699140,12cyclictest0-21swapper/210:53:402
1935699140,12cyclictest0-21swapper/210:42:332
1935699140,12cyclictest0-21swapper/208:20:142
1935599149,3cyclictest8005-21cut08:00:141
19355991411,2cyclictest0-21swapper/111:08:481
19355991410,2cyclictest0-21swapper/110:00:101
1935599140,3cyclictest0-21swapper/112:11:391
1935599140,2cyclictest0-21swapper/111:44:421
1935599140,2cyclictest0-21swapper/109:53:521
1935599140,13cyclictest0-21swapper/111:59:221
1935599140,12cyclictest0-21swapper/112:30:361
1935599140,12cyclictest0-21swapper/112:06:011
1935599140,12cyclictest0-21swapper/111:54:091
1935599140,12cyclictest0-21swapper/110:24:221
147022140,2sleep00-21swapper/010:28:270
132462140,3sleep00-21swapper/009:53:120
96812130,2sleep00-21swapper/012:38:490
68682130,2sleep03196-21diskmemload10:54:280
19357991310,2cyclictest0-21swapper/312:35:273
19357991310,2cyclictest0-21swapper/312:10:133
19357991310,2cyclictest0-21swapper/311:15:013
19357991310,2cyclictest0-21swapper/311:07:133
19357991310,2cyclictest0-21swapper/310:05:143
19357991310,2cyclictest0-21swapper/307:50:153
1935799130,2cyclictest4611-21ssh09:44:453
1935799130,2cyclictest0-21swapper/311:00:153
1935799130,2cyclictest0-21swapper/308:11:003
1935799130,12cyclictest0-21swapper/312:20:013
1935799130,12cyclictest0-21swapper/312:20:003
1935799130,12cyclictest0-21swapper/311:58:403
1935799130,12cyclictest0-21swapper/311:40:073
1935799130,12cyclictest0-21swapper/311:36:023
1935799130,12cyclictest0-21swapper/310:40:163
1935799130,12cyclictest0-21swapper/309:48:413
1935799130,12cyclictest0-21swapper/309:13:503
19356991310,2cyclictest29378-21kworker/u8:010:55:052
19356991310,2cyclictest23988-21kworker/u8:112:25:052
19356991310,2cyclictest0-21swapper/210:12:382
19356991310,2cyclictest0-21swapper/208:36:032
1935699130,8cyclictest0-21swapper/209:50:052
1935699130,2cyclictest0-21swapper/211:07:092
1935699130,2cyclictest0-21swapper/210:30:552
1935699130,2cyclictest0-21swapper/209:24:042
1935699130,2cyclictest0-21swapper/209:08:052
1935699130,2cyclictest0-21swapper/207:45:162
1935699130,12cyclictest0-21swapper/211:10:452
1935699130,12cyclictest0-21swapper/207:16:022
1935599139,2cyclictest207150irq/24-eth108:10:101
1935599138,3cyclictest22440-21kernelversion08:35:141
1935599138,3cyclictest0-21swapper/112:25:141
1935599138,3cyclictest0-21swapper/110:25:111
1935599131,3cyclictest0-21swapper/108:31:021
19355991310,2cyclictest0-21swapper/111:45:421
19355991310,2cyclictest0-21swapper/111:37:571
19355991310,2cyclictest0-21swapper/110:08:221
19355991310,2cyclictest0-21swapper/109:16:021
1935599130,2cyclictest0-21swapper/111:20:281
1935599130,2cyclictest0-21swapper/110:56:491
1935599130,2cyclictest0-21swapper/109:00:501
1935599130,2cyclictest0-21swapper/109:00:491
1935599130,2cyclictest0-21swapper/108:50:131
1935599130,2cyclictest0-21swapper/107:55:151
1935599130,12cyclictest0-21swapper/110:54:481
1935599130,12cyclictest0-21swapper/110:38:181
1935599130,11cyclictest0-21swapper/109:31:121
1935599130,11cyclictest0-21swapper/109:20:161
1935599130,11cyclictest0-21swapper/108:45:291
1935599130,11cyclictest0-21swapper/107:35:481
1935499137,5cyclictest11-21rcuc/007:11:580
1935499133,6cyclictest0-21swapper/009:06:010
1935499132,7cyclictest0-21swapper/012:25:010
1935499132,7cyclictest0-21swapper/012:25:010
1935499132,7cyclictest0-21swapper/010:09:590
1935499132,7cyclictest0-21swapper/008:10:010
1935499132,6cyclictest0-21swapper/010:20:000
1935499132,6cyclictest0-21swapper/007:25:000
1935499131,7cyclictest0-21swapper/007:30:000
1935499131,6cyclictest0-21swapper/008:40:010
1935499130,7cyclictest0-21swapper/011:55:000
1935499130,2cyclictest0-21swapper/008:55:120
1935499130,2cyclictest0-21swapper/008:46:020
1935499130,12cyclictest0-21swapper/012:17:470
1935499130,12cyclictest0-21swapper/010:40:580
1935499130,11cyclictest0-21swapper/011:50:010
1935799129,2cyclictest0-21swapper/310:55:123
1935799129,2cyclictest0-21swapper/310:39:413
1935799129,2cyclictest0-21swapper/307:45:173
1935799129,2cyclictest0-21swapper/307:42:113
1935799120,2cyclictest0-21swapper/311:10:173
1935799120,2cyclictest0-21swapper/310:15:173
1935799120,2cyclictest0-21swapper/307:15:013
1935799120,1cyclictest0-21swapper/312:05:113
1935799120,11cyclictest0-21swapper/312:16:113
1935799120,11cyclictest0-21swapper/310:51:503
1935799120,11cyclictest0-21swapper/310:21:103
1935799120,11cyclictest0-21swapper/310:00:453
1935799120,11cyclictest0-21swapper/308:15:183
1935799120,11cyclictest0-21swapper/307:30:373
1935799120,11cyclictest0-21swapper/307:20:103
1935699129,2cyclictest9699-21kworker/u8:208:44:052
1935699129,2cyclictest4956-21kworker/u8:207:57:052
1935699129,2cyclictest15774-21kworker/u8:008:29:052
1935699129,2cyclictest0-21swapper/211:45:152
1935699129,2cyclictest0-21swapper/210:22:162
1935699129,2cyclictest0-21swapper/209:40:162
1935699120,2cyclictest0-21swapper/210:06:082
1935699120,2cyclictest0-21swapper/208:01:032
1935699120,2cyclictest0-21swapper/207:20:162
1935699120,11cyclictest0-21swapper/212:00:342
1935699120,11cyclictest0-21swapper/211:15:052
1935699120,11cyclictest0-21swapper/208:30:142
1935699120,11cyclictest0-21swapper/207:35:172
1935599129,2cyclictest0-21swapper/112:20:121
1935599129,2cyclictest0-21swapper/112:20:111
1935599129,2cyclictest0-21swapper/110:12:481
1935599129,2cyclictest0-21swapper/109:36:211
1935599129,2cyclictest0-21swapper/107:45:141
1935599129,2cyclictest0-21swapper/107:20:171
1935599127,3cyclictest26566-21munin-node1
1935599127,3cyclictest1456-21aten2.4-expect09:05:131
1935599127,3cyclictest13676-21munin-node1
1935599121,9cyclictest3196-21diskmemload12:00:151
1935599121,9cyclictest0-21swapper/109:10:131
1935599121,9cyclictest0-21swapper/108:55:301
1935599121,9cyclictest0-21swapper/107:25:171
1935599121,3cyclictest0-21swapper/108:40:131
1935599120,2cyclictest0-21swapper/112:17:521
1935599120,2cyclictest0-21swapper/108:06:021
1935599120,11cyclictest0-21swapper/109:55:021
1935599120,11cyclictest0-21swapper/107:11:021
1935599120,10cyclictest0-21swapper/107:50:491
1935499129,2cyclictest0-21swapper/009:18:280
1935499127,3cyclictest0-21swapper/009:35:400
1935499122,7cyclictest0-21swapper/011:42:010
1935499122,7cyclictest0-21swapper/008:44:020
1935499122,6cyclictest0-21swapper/012:10:000
1935499121,9cyclictest32469-21if_eth009:00:150
1935499121,9cyclictest32469-21if_eth009:00:150
1935499120,2cyclictest0-21swapper/010:01:070
1935499120,11cyclictest0-21swapper/009:45:140
256302110,2sleep00-21swapper/010:05:350
1935799118,2cyclictest0-21swapper/308:41:013
1935799118,2cyclictest0-21swapper/308:30:163
1935799111,7cyclictest0-21swapper/307:27:593
1935799110,2cyclictest0-21swapper/308:24:103
1935699118,2cyclictest9699-21kworker/u8:208:19:052
1935599111,8cyclictest27647-21munin-node1
1935599111,8cyclictest22300-21cat07:15:151
1935599111,8cyclictest0-21swapper/108:25:291
1935599110,9cyclictest0-21swapper/110:41:021
1935599110,10cyclictest0-21swapper/108:20:191
1935499118,2cyclictest0-21swapper/008:20:180
1935499117,2cyclictest634-21ethtool11:55:150
1935499116,3cyclictest16954-21ssh10:30:180
1935499116,3cyclictest1202-21telnet12:30:110
1935499111,8cyclictest0-21swapper/010:17:310
1935499111,8cyclictest0-21swapper/009:26:040
1935499111,6cyclictest0-21swapper/007:43:080
1935499110,9cyclictest0-21swapper/007:45:130
1935499110,8cyclictest9320-21sh12:04:590
1935499110,2cyclictest0-21swapper/007:36:020
113052110,2sleep00-21swapper/010:58:580
243372100,2sleep00-21swapper/010:38:380
1935799107,2cyclictest0-21swapper/309:06:043
1935799107,2cyclictest0-21swapper/308:25:183
1935799103,6cyclictest0-21swapper/308:36:013
1935699107,2cyclictest25778-21kworker/u8:007:30:052
1935499107,2cyclictest9-21ksoftirqd/009:11:570
1935499107,2cyclictest2250-21ssh11:23:170
1935499107,2cyclictest0-21swapper/011:30:050
1935499107,2cyclictest0-21swapper/011:25:140
1935499107,2cyclictest0-21swapper/007:50:180
1935499105,3cyclictest29184-21diskstats12:25:140
1935499101,8cyclictest3728-21runrttasks12:11:240
1935499100,9cyclictest9-21ksoftirqd/009:56:240
1935499100,9cyclictest0-21swapper/010:49:000
1935499100,6cyclictest0-21swapper/007:58:110
1935499100,6cyclictest0-21swapper/007:18:030
1935499100,4cyclictest0-21swapper/007:34:060
1935499100,2cyclictest0-21swapper/008:02:230
193579996,2cyclictest0-21swapper/308:55:523
193579996,2cyclictest0-21swapper/308:05:133
193579990,8cyclictest0-21swapper/307:11:203
193549996,2cyclictest0-21swapper/008:15:580
193549994,3cyclictest22174-21df11:10:140
193549994,3cyclictest12513-21expr08:10:170
193579984,3cyclictest0-21swapper/309:00:163
193579984,3cyclictest0-21swapper/309:00:153
193579983,3cyclictest30181-21fschecks_time07:35:143
193579980,7cyclictest0-21swapper/308:54:003
193579970,4cyclictest0-21swapper/308:45:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional