You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 05:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Tue Sep 15, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
248812115104,6sleep10-21swapper/119:08:501
1650421100,0sleep1221ktimersoftd/120:11:031
1650421100,0sleep1221ktimersoftd/120:11:031
24860210988,16sleep00-21swapper/019:08:330
24954210897,6sleep20-21swapper/219:09:472
24843210897,6sleep30-21swapper/319:08:203
184472860,1sleep10-21swapper/123:00:001
124922750,0sleep20-21swapper/223:58:412
228502680,1sleep00-21swapper/023:04:160
326552540,0sleep30-21swapper/322:40:583
25001992926,2cyclictest28866-21kworker/u8:221:23:042
25001992926,2cyclictest16912-21kworker/u8:222:48:042
25001992926,2cyclictest15190-21kworker/u8:023:18:042
25001992825,2cyclictest30095-21kworker/u8:123:44:042
25001992825,2cyclictest23052-21kworker/u8:321:27:042
25001992825,2cyclictest1547-21kworker/u8:122:29:042
25001992825,2cyclictest15190-21kworker/u8:023:08:042
25001992724,2cyclictest9126-21kworker/u8:122:02:042
25001992724,2cyclictest8777-21kworker/u8:100:04:042
25001992724,2cyclictest28502-21kworker/u8:222:07:042
25001992724,2cyclictest2481-21kworker/u8:019:19:042
25001992724,2cyclictest22998-21kworker/u8:219:38:042
25001992724,2cyclictest15392-21kworker/u8:200:13:032
25000992623,2cyclictest15190-21kworker/u8:023:30:041
193622260,0sleep30-21swapper/320:20:113
25001992522,2cyclictest8831-21kworker/u8:122:54:042
25001992522,2cyclictest3366-21kworker/u8:223:25:042
25001992522,2cyclictest23052-21kworker/u8:321:43:042
25001992522,2cyclictest22998-21kworker/u8:219:27:042
25001992522,2cyclictest15260-21kworker/u8:220:29:042
25001992522,2cyclictest15190-21kworker/u8:023:14:042
25001992522,2cyclictest10077-21kworker/u8:120:07:042
32222240,1sleep30-21swapper/321:39:213
25001992421,2cyclictest3116-21kworker/u8:023:50:042
25001992421,2cyclictest28866-21kworker/u8:220:57:042
25001992421,2cyclictest26293-21kworker/u8:120:45:042
25001992421,2cyclictest22998-21kworker/u8:219:52:012
25001992421,2cyclictest1809-21kworker/u8:020:03:042
25001992421,2cyclictest1809-21kworker/u8:019:49:042
25001992421,2cyclictest15392-21kworker/u8:200:26:042
25001992421,2cyclictest15260-21kworker/u8:220:37:042
25001992421,2cyclictest15190-21kworker/u8:023:24:042
25001992320,2cyclictest29554-21kworker/u8:119:24:042
25001992320,2cyclictest2354-21kworker/u8:022:15:042
25001992219,2cyclictest8831-21kworker/u8:122:55:042
25001992219,2cyclictest32458-21kworker/u8:021:14:042
25001992219,2cyclictest23052-21kworker/u8:321:45:042
25001992219,2cyclictest1809-21kworker/u8:019:57:042
25001992219,2cyclictest10077-21kworker/u8:120:24:042
25001992219,2cyclictest10077-21kworker/u8:120:16:042
25000992219,2cyclictest27499-21kworker/u8:000:23:041
78032210,1sleep3381ktimersoftd/323:54:063
2500299210,19cyclictest0-21swapper/321:20:123
25001992118,2cyclictest22998-21kworker/u8:219:41:042
25001992118,2cyclictest10077-21kworker/u8:120:11:042
25001992118,2cyclictest10077-21kworker/u8:120:11:042
2500099210,17cyclictest0-21swapper/122:36:041
2499999210,4cyclictest0-21swapper/021:44:040
2499999210,4cyclictest0-21swapper/020:37:040
2499999210,4cyclictest0-21swapper/020:07:040
25001992017,2cyclictest32458-21kworker/u8:021:01:042
25000992017,2cyclictest23052-21kworker/u8:321:32:041
2500099200,15cyclictest0-21swapper/123:42:041
2499999200,3cyclictest0-21swapper/023:45:040
2499999200,3cyclictest0-21swapper/023:17:040
2499999200,3cyclictest0-21swapper/022:48:040
2499999200,3cyclictest0-21swapper/022:02:040
2499999200,3cyclictest0-21swapper/020:16:040
2499999200,3cyclictest0-21swapper/020:04:050
2499999200,3cyclictest0-21swapper/019:50:050
2499999200,3cyclictest0-21swapper/000:26:040
2499999200,3cyclictest0-21swapper/000:14:010
84422190,0sleep10-21swapper/121:44:291
25001991916,2cyclictest32458-21kworker/u8:021:16:042
25001991916,2cyclictest30095-21kworker/u8:123:45:032
25000991916,2cyclictest9126-21kworker/u8:121:52:041
25000991916,2cyclictest21306-21kworker/u8:223:03:041
25000991916,2cyclictest15392-21kworker/u8:200:27:041
25000991916,2cyclictest15392-21kworker/u8:200:18:041
2500099190,2cyclictest207150irq/24-eth100:01:041
2500099190,2cyclictest0-21swapper/122:10:051
2499999190,2cyclictest0-21swapper/023:41:040
2499999190,2cyclictest0-21swapper/020:25:040
2499999190,2cyclictest0-21swapper/019:58:040
2500199180,16cyclictest0-21swapper/221:05:112
25000991815,2cyclictest2354-21kworker/u8:022:19:041
25000991815,2cyclictest1547-21kworker/u8:122:22:041
25000991815,2cyclictest15190-21kworker/u8:023:20:041
25000991815,2cyclictest15190-21kworker/u8:023:09:041
25000991810,4cyclictest221ktimersoftd/122:44:011
2499999180,4cyclictest0-21swapper/019:46:010
2499999180,1cyclictest0-21swapper/022:55:040
25000991714,2cyclictest9126-21kworker/u8:121:58:041
25000991714,2cyclictest1547-21kworker/u8:122:27:041
25000991714,2cyclictest14804-21kworker/u8:000:38:041
2500099170,2cyclictest0-21swapper/121:19:041
25000991613,2cyclictest8831-21kworker/u8:122:52:041
25000991613,2cyclictest30625-21kworker/u8:123:12:031
25000991613,2cyclictest22998-21kworker/u8:219:26:011
25000991613,2cyclictest15392-21kworker/u8:200:33:041
2500099160,13cyclictest0-21swapper/122:05:181
2500099160,11cyclictest0-21swapper/119:18:041
2499999160,14cyclictest0-21swapper/023:05:120
2500299157,5cyclictest29697-21ssh22:05:163
2500299151,12cyclictest14767-21sendmail-mta22:24:163
25002991511,2cyclictest0-21swapper/300:00:123
2500199151,12cyclictest2169-21ssh00:20:202
2500199150,13cyclictest0-21swapper/223:35:442
25000991512,2cyclictest2354-21kworker/u8:021:46:041
25000991512,2cyclictest23052-21kworker/u8:321:35:041
25000991512,2cyclictest22998-21kworker/u8:219:39:041
2500099150,2cyclictest0-21swapper/123:38:011
2500099150,14cyclictest0-21swapper/121:20:051
2500099150,13cyclictest24066-21apt-get22:00:121
2500099150,13cyclictest0-21swapper/123:54:021
2500099150,11cyclictest0-21swapper/119:56:041
2499999151,12cyclictest9153-21apt-get21:45:100
2499999151,12cyclictest32761-21sensors22:41:000
2499999150,3cyclictest0-21swapper/019:28:010
257002140,3sleep00-21swapper/021:29:210
2500299149,3cyclictest0-21swapper/319:55:153
2500299140,3cyclictest4506-21hddtemp_smartct19:40:163
2500299140,12cyclictest12253-21sendmail-mta22:53:523
2500299140,12cyclictest0-21swapper/323:44:013
2500299140,12cyclictest0-21swapper/322:14:493
2500299140,12cyclictest0-21swapper/300:21:033
2500199140,2cyclictest0-21swapper/221:37:132
2500199140,2cyclictest0-21swapper/219:30:102
2500099149,3cyclictest0-21swapper/123:57:101
2500099149,3cyclictest0-21swapper/122:30:191
2500099142,6cyclictest0-21swapper/120:30:011
2500099141,7cyclictest0-21swapper/120:20:011
25000991411,2cyclictest32458-21kworker/u8:021:13:041
25000991411,2cyclictest2649-21kworker/u8:022:45:031
25000991411,2cyclictest1809-21kworker/u8:019:46:051
25000991411,2cyclictest0-21swapper/119:30:151
2500099140,3cyclictest27580-21ntpq20:40:201
2500099140,2cyclictest0-21swapper/120:35:061
2500099140,12cyclictest6263-21diskmemload00:06:451
2500099140,12cyclictest24960-21ssh21:28:151
2499999141,12cyclictest3728-21runrttasks21:39:100
24999991411,2cyclictest22150irq/25-ahci[00022:15:100
24999991411,2cyclictest0-21swapper/000:05:400
2499999140,3cyclictest30786-21ssh21:34:300
2499999140,3cyclictest16655-21fschecks_count23:30:140
2499999140,3cyclictest0-21swapper/022:21:080
2499999140,3cyclictest0-21swapper/022:14:160
2499999140,3cyclictest0-21swapper/021:08:050
2500299138,3cyclictest0-21swapper/321:20:003
25002991310,2cyclictest0-21swapper/323:14:373
25002991310,2cyclictest0-21swapper/321:13:263
25002991310,2cyclictest0-21swapper/320:26:003
25002991310,2cyclictest0-21swapper/319:15:173
2500299130,2cyclictest6263-21diskmemload23:35:173
2500299130,12cyclictest0-21swapper/319:30:153
2500299130,11cyclictest4310-21gnome-settings-00:36:263
2500299130,11cyclictest0-21swapper/322:30:403
25001991310,2cyclictest0-21swapper/222:23:342
25001991310,2cyclictest0-21swapper/221:53:372
2500199130,2cyclictest0-21swapper/222:13:042
2500199130,2cyclictest0-21swapper/200:17:242
2500199130,11cyclictest19118-21aten2.4-expect21:55:112
2500199130,11cyclictest0-21swapper/200:32:132
2500099132,6cyclictest0-21swapper/121:10:011
2500099131,3cyclictest0-21swapper/120:30:181
25000991310,2cyclictest29554-21kworker/u8:119:23:041
25000991310,2cyclictest22998-21kworker/u8:219:53:041
25000991310,2cyclictest10077-21kworker/u8:120:09:041
25000991310,2cyclictest0-21swapper/123:15:291
2500099130,2cyclictest30826-21copy23:45:021
2500099130,11cyclictest0-21swapper/123:26:161
2500099130,11cyclictest0-21swapper/121:00:521
2499999139,2cyclictest0-21swapper/023:35:460
2499999138,3cyclictest13773-21ssh21:16:250
24999991310,2cyclictest0-21swapper/023:52:410
24999991310,2cyclictest0-21swapper/022:35:350
24999991310,2cyclictest0-21swapper/022:05:120
24999991310,2cyclictest0-21swapper/021:55:520
24999991310,2cyclictest0-21swapper/000:37:110
2499999130,2cyclictest0-21swapper/000:30:190
2499999130,12cyclictest6263-21diskmemload22:25:310
2499999130,12cyclictest0-21swapper/023:25:260
2499999130,12cyclictest0-21swapper/022:34:090
2499999130,12cyclictest0-21swapper/021:22:370
2499999130,12cyclictest0-21swapper/021:13:310
2499999130,12cyclictest0-21swapper/021:00:150
2499999130,12cyclictest0-21swapper/020:55:120
2499999130,12cyclictest0-21swapper/000:24:570
172962130,2sleep017306-21ssh00:03:240
2500299129,2cyclictest0-21swapper/323:34:123
2500299129,2cyclictest0-21swapper/323:25:123
2500299129,2cyclictest0-21swapper/322:35:173
2500299129,2cyclictest0-21swapper/321:51:443
2500299129,2cyclictest0-21swapper/321:45:013
2500299129,2cyclictest0-21swapper/320:35:203
2500299129,2cyclictest0-21swapper/320:15:153
2500299129,2cyclictest0-21swapper/320:10:183
2500299129,2cyclictest0-21swapper/320:10:183
2500299129,2cyclictest0-21swapper/300:16:223
2500299129,2cyclictest0-21swapper/300:10:163
2500299127,3cyclictest5225-21sed21:05:163
2500299120,2cyclictest6263-21diskmemload21:25:263
2500299120,2cyclictest0-21swapper/323:06:523
2500299120,2cyclictest0-21swapper/323:03:463
2500299120,2cyclictest0-21swapper/322:55:063
2500299120,2cyclictest0-21swapper/322:26:083
2500299120,2cyclictest0-21swapper/321:43:193
2500299120,2cyclictest0-21swapper/321:33:323
2500299120,11cyclictest0-21swapper/323:16:113
2500299120,11cyclictest0-21swapper/322:45:323
2500299120,11cyclictest0-21swapper/322:00:203
2500299120,11cyclictest0-21swapper/319:53:193
2500299120,11cyclictest0-21swapper/319:25:593
2500199129,2cyclictest0-21swapper/222:35:182
2500199129,2cyclictest0-21swapper/222:30:052
2500199120,2cyclictest0-21swapper/223:00:242
2500199120,11cyclictest0-21swapper/223:32:352
2500199120,11cyclictest0-21swapper/222:43:032
2500199120,11cyclictest0-21swapper/221:32:082
2500199120,11cyclictest0-21swapper/200:37:472
2500199120,11cyclictest0-21swapper/200:08:432
2500099129,2cyclictest0-21swapper/100:12:051
2500099121,3cyclictest25212-21munin-node1
25000991210,1cyclictest0-21swapper/120:15:171
2500099120,2cyclictest0-21swapper/119:40:411
2500099120,10cyclictest0-21swapper/120:55:391
2500099120,10cyclictest0-21swapper/120:50:181
2499999129,2cyclictest0-21swapper/023:20:290
2499999129,2cyclictest0-21swapper/021:50:180
2499999129,2cyclictest0-21swapper/019:20:120
2499999127,3cyclictest0-21swapper/020:41:050
2499999120,2cyclictest0-21swapper/023:56:100
2499999120,2cyclictest0-21swapper/023:10:270
2499999120,2cyclictest0-21swapper/019:31:020
2499999120,11cyclictest0-21swapper/022:50:120
2499999120,11cyclictest0-21swapper/000:15:350
99432110,1sleep30-21swapper/323:55:313
2500299118,2cyclictest0-21swapper/321:56:193
2500299118,2cyclictest0-21swapper/320:40:163
2500299118,2cyclictest0-21swapper/319:36:053
2500299117,2cyclictest6263-21diskmemload22:15:553
2500299116,3cyclictest18834-21telnet00:05:133
2500299112,5cyclictest0-21swapper/300:30:013
2500299110,2cyclictest0-21swapper/323:21:413
2500299110,10cyclictest0-21swapper/300:31:023
2500199118,2cyclictest0-21swapper/220:51:012
2500199110,2cyclictest0-21swapper/219:14:332
2500099118,2cyclictest28866-21kworker/u8:220:48:041
2499999110,1cyclictest0-21swapper/019:41:040
2499999110,10cyclictest0-21swapper/019:36:580
2500299107,2cyclictest0-21swapper/320:46:053
2500299106,2cyclictest0-21swapper/320:05:063
2500299105,3cyclictest2816-21tune2fs21:00:163
2500299104,4cyclictest24059-21cat20:30:173
2500299102,6cyclictest0-21swapper/320:51:003
2500299100,1cyclictest0-21swapper/323:46:313
2500099100,8cyclictest0-21swapper/120:00:171
2499999107,2cyclictest0-21swapper/020:45:100
2499999104,4cyclictest26640-21head19:11:020
2499999101,7cyclictest0-21swapper/020:20:100
2499999100,9cyclictest0-21swapper/020:53:380
2499999100,3cyclictest28223-21cut19:15:190
243172100,1sleep224320-21pzem_current20:30:202
250029994,3cyclictest5605-21sendmail-mta19:45:353
250029994,3cyclictest555-21cut20:55:123
250029994,3cyclictest11642-21aten2.4-expect20:00:133
250019990,2cyclictest0-21swapper/220:43:252
249999994,3cyclictest3728-21runrttasks20:30:380
249999990,7cyclictest0-21swapper/020:10:530
249999990,7cyclictest0-21swapper/020:10:530
250029984,3cyclictest28949-21aten2.4_r3power19:20:123
250029984,3cyclictest25305-21aten2.4-expect19:10:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional