You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 06:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sun Jul 26, 2026 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2165211292,15sleep00-21swapper/019:05:550
2589211192,14sleep30-21swapper/319:06:183
2859210695,6sleep20-21swapper/219:09:412
2853210594,6sleep10-21swapper/119:09:361
80962920,1sleep1221ktimersoftd/122:05:311
82472300,0sleep10-21swapper/123:12:201
70022300,0sleep10-21swapper/100:17:411
234582260,2sleep3381ktimersoftd/321:15:193
2914992212,3cyclictest18307-21munin-node3
291499221,19cyclictest0-21swapper/320:00:143
291499210,2cyclictest0-21swapper/322:04:523
291499210,13cyclictest17614-21diskmemload00:18:123
291499210,13cyclictest0-21swapper/300:38:023
2912992017,2cyclictest4500-21kworker/u8:121:32:061
291299200,18cyclictest0-21swapper/121:35:011
291499198,2cyclictest0-21swapper/321:10:183
2914991911,2cyclictest0-21swapper/321:43:533
2912991916,2cyclictest25236-21kworker/u8:021:17:051
2912991916,2cyclictest21383-21kworker/u8:322:20:051
2912991916,2cyclictest14776-21kworker/u8:222:30:021
2914991810,2cyclictest0-21swapper/323:28:523
291499180,2cyclictest0-21swapper/321:38:123
291499180,12cyclictest0-21swapper/323:15:223
2912991815,2cyclictest657-21kworker/u8:223:40:041
2912991815,2cyclictest657-21kworker/u8:223:39:041
2912991815,2cyclictest27427-21kworker/u8:000:09:041
2912991815,2cyclictest23179-21kworker/u8:123:00:041
2912991815,2cyclictest14776-21kworker/u8:222:29:041
2912991815,2cyclictest11985-21kworker/u8:019:39:051
291299180,2cyclictest0-21swapper/121:26:041
291499171,6cyclictest0-21swapper/300:15:003
291499171,3cyclictest7323-21munin-node3
2912991715,1cyclictest0-21swapper/122:48:041
2912991714,2cyclictest9522-21kworker/u8:122:14:041
2912991714,2cyclictest7763-21kworker/u8:120:47:041
2912991714,2cyclictest28614-21kworker/u8:122:00:041
2912991714,2cyclictest25236-21kworker/u8:020:13:041
2912991714,2cyclictest25236-21kworker/u8:020:09:041
2912991714,2cyclictest19026-21kworker/u8:119:59:041
312362160,0sleep30-21swapper/321:56:023
291499161,3cyclictest0-21swapper/323:10:143
2914991611,3cyclictest28005-21rm23:00:103
2914991611,3cyclictest0-21swapper/323:42:323
2912991613,2cyclictest9630-21kworker/u8:021:54:011
2912991613,2cyclictest7321-21kworker/u8:219:47:041
2912991613,2cyclictest7318-21kworker/u8:123:46:051
2912991613,2cyclictest30788-21kworker/u8:100:35:051
2912991613,2cyclictest25236-21kworker/u8:021:05:051
2912991613,2cyclictest25236-21kworker/u8:020:59:041
2912991613,2cyclictest23179-21kworker/u8:123:26:051
2912991613,2cyclictest19026-21kworker/u8:120:02:021
2912991613,2cyclictest17508-21kworker/u8:121:44:051
291299161,13cyclictest10303-21munin-node1
291299160,2cyclictest0-21swapper/122:16:011
291299160,12cyclictest0-21swapper/121:58:051
291499151,3cyclictest0-21swapper/320:30:163
2914991511,2cyclictest30750-21apt-get20:20:123
2914991510,3cyclictest0-21swapper/300:05:223
291499150,2cyclictest0-21swapper/319:15:123
291499150,13cyclictest0-21swapper/322:19:133
291399151,12cyclictest13184-21sshd23:50:282
291399150,13cyclictest15143-21aten2.4_r3power19:40:262
2912991512,2cyclictest7321-21kworker/u8:219:42:041
2912991512,2cyclictest30788-21kworker/u8:100:32:041
2912991512,2cyclictest30788-21kworker/u8:100:20:041
2912991512,2cyclictest25236-21kworker/u8:021:03:041
2912991512,2cyclictest25236-21kworker/u8:020:36:041
2912991512,2cyclictest19367-21kworker/u8:123:58:041
2912991512,2cyclictest19367-21kworker/u8:100:02:041
2912991512,2cyclictest17508-21kworker/u8:121:45:041
2912991512,2cyclictest13562-21kworker/u8:022:50:041
2912991512,2cyclictest1185-21kworker/u8:019:15:041
2912991512,2cyclictest1185-21kworker/u8:019:14:041
291299150,2cyclictest3728-21runrttasks21:22:051
291199151,2cyclictest2111-21apt-get23:40:110
2911991511,2cyclictest4432-21iostat_ios22:35:160
291199151,12cyclictest17614-21diskmemload21:19:010
291199151,12cyclictest0-21swapper/000:30:150
2911991510,3cyclictest682-21chrt21:58:410
226392150,1sleep00-21swapper/022:20:290
291499149,3cyclictest21948-21ssh21:46:233
291499142,7cyclictest0-21swapper/321:00:003
2914991411,2cyclictest0-21swapper/323:46:223
2914991411,2cyclictest0-21swapper/300:34:423
291499140,2cyclictest0-21swapper/322:49:123
291499140,2cyclictest0-21swapper/322:24:023
291499140,13cyclictest0-21swapper/322:14:023
291499140,12cyclictest12680-21ssh22:44:193
291499140,12cyclictest1022-21ssh23:38:523
291499140,12cyclictest0-21swapper/320:40:113
291399140,12cyclictest20096-21ssh22:18:262
291399140,12cyclictest15932-21ssh00:26:292
291399140,12cyclictest13383-21ssh22:45:032
291399140,12cyclictest0-21swapper/223:28:372
291399140,12cyclictest0-21swapper/222:40:162
291399140,12cyclictest0-21swapper/200:15:092
2912991411,2cyclictest7321-21kworker/u8:220:33:041
2912991411,2cyclictest7321-21kworker/u8:220:27:051
2912991411,2cyclictest7321-21kworker/u8:219:27:051
2912991411,2cyclictest25236-21kworker/u8:021:10:051
2912991411,2cyclictest1550-21kworker/u8:122:40:041
2912991411,2cyclictest0-21swapper/122:59:341
291299140,2cyclictest0-21swapper/123:20:341
291299140,13cyclictest0-21swapper/123:54:531
291299140,13cyclictest0-21swapper/123:06:031
291299140,12cyclictest27532chrt00:13:531
291199141,2cyclictest5156-21ssh21:30:130
291199140,3cyclictest20779-21ssh21:45:200
291199140,13cyclictest0-21swapper/022:10:000
291199140,12cyclictest29157-21latency_hist21:55:000
291199140,12cyclictest0-21swapper/023:26:400
32722130,2sleep00-21swapper/021:27:500
291499138,2cyclictest0-21swapper/322:56:043
2914991311,1cyclictest0-21swapper/322:28:423
2914991310,2cyclictest0-21swapper/323:22:023
2914991310,2cyclictest0-21swapper/322:33:423
2914991310,2cyclictest0-21swapper/320:10:213
2914991310,2cyclictest0-21swapper/319:55:003
2914991310,2cyclictest0-21swapper/300:21:433
291499130,2cyclictest0-21swapper/323:52:523
291499130,2cyclictest0-21swapper/321:34:263
291499130,2cyclictest0-21swapper/320:06:033
291499130,12cyclictest0-21swapper/323:08:333
291499130,12cyclictest0-21swapper/322:05:203
291499130,12cyclictest0-21swapper/321:54:133
291499130,12cyclictest0-21swapper/321:25:233
291499130,12cyclictest0-21swapper/319:30:163
291499130,11cyclictest0-21swapper/322:36:373
2913991310,2cyclictest10909-21ssh23:15:162
2913991310,2cyclictest0-21swapper/223:42:082
2913991310,2cyclictest0-21swapper/223:35:182
2913991310,2cyclictest0-21swapper/223:20:402
2913991310,2cyclictest0-21swapper/223:11:552
2913991310,2cyclictest0-21swapper/223:00:162
2913991310,2cyclictest0-21swapper/222:55:102
2913991310,2cyclictest0-21swapper/221:55:052
2913991310,2cyclictest0-21swapper/221:44:202
2913991310,2cyclictest0-21swapper/221:30:242
2913991310,2cyclictest0-21swapper/221:15:592
2913991310,2cyclictest0-21swapper/221:12:072
2913991310,2cyclictest0-21swapper/220:20:172
2913991310,2cyclictest0-21swapper/200:38:272
2913991310,2cyclictest0-21swapper/200:20:052
291399130,2cyclictest26928-21ssh23:31:142
291399130,2cyclictest25087-21ssh22:23:362
291399130,2cyclictest0-21swapper/222:50:192
291399130,2cyclictest0-21swapper/220:50:152
291399130,2cyclictest0-21swapper/200:02:332
291399130,12cyclictest0-21swapper/223:48:382
291399130,12cyclictest0-21swapper/223:05:352
291399130,12cyclictest0-21swapper/222:36:592
291399130,12cyclictest0-21swapper/222:03:272
291399130,12cyclictest0-21swapper/221:54:082
291399130,12cyclictest0-21swapper/221:36:272
291399130,12cyclictest0-21swapper/220:10:182
291399130,12cyclictest0-21swapper/219:30:182
291399130,12cyclictest0-21swapper/200:10:132
291399130,11cyclictest27843-21ssh00:05:362
291399130,11cyclictest0-21swapper/223:55:042
2912991310,2cyclictest0-21swapper/123:30:061
291299130,2cyclictest17614-21diskmemload22:38:041
291299130,2cyclictest0-21swapper/100:27:101
2911991310,2cyclictest0-21swapper/023:38:420
2911991310,2cyclictest0-21swapper/022:51:400
2911991310,2cyclictest0-21swapper/022:41:300
2911991310,2cyclictest0-21swapper/021:13:360
2911991310,2cyclictest0-21swapper/020:45:170
2911991310,2cyclictest0-21swapper/020:41:020
2911991310,2cyclictest0-21swapper/000:37:320
2911991310,2cyclictest0-21swapper/000:26:320
2911991310,2cyclictest0-21swapper/000:16:000
291199130,2cyclictest17614-21diskmemload22:02:500
291199130,2cyclictest0-21swapper/023:56:410
291199130,2cyclictest0-21swapper/023:10:170
291199130,2cyclictest0-21swapper/000:09:310
291199130,2cyclictest0-21swapper/000:02:010
291199130,12cyclictest0-21swapper/023:51:410
291199130,12cyclictest0-21swapper/019:30:490
291199130,11cyclictest31621-21ssh22:30:170
168762130,2sleep00-21swapper/022:48:200
106612130,2sleep010672-21ssh23:48:280
291499129,2cyclictest0-21swapper/321:05:133
291499122,7cyclictest0-21swapper/320:17:013
291499120,2cyclictest30107-21ssh21:21:443
291499120,2cyclictest0-21swapper/300:26:063
291499120,11cyclictest0-21swapper/323:33:173
291499120,11cyclictest0-21swapper/320:36:293
291499120,11cyclictest0-21swapper/319:10:413
291399129,2cyclictest14756-21munin-run19:40:012
291399129,2cyclictest0-21swapper/222:26:362
291399129,2cyclictest0-21swapper/222:10:142
291399129,2cyclictest0-21swapper/221:25:062
291399129,2cyclictest0-21swapper/219:50:112
291399129,2cyclictest0-21swapper/219:10:182
291399129,2cyclictest0-21swapper/200:30:192
291399120,2cyclictest0-21swapper/221:45:152
291399120,2cyclictest0-21swapper/220:35:182
291399120,11cyclictest0-21swapper/222:32:472
291399120,11cyclictest0-21swapper/222:07:342
291399120,11cyclictest0-21swapper/221:20:092
291299129,2cyclictest0-21swapper/120:40:181
291299129,2cyclictest0-21swapper/120:20:501
291299128,3cyclictest7321-21kworker/u8:219:31:041
291299128,2cyclictest0-21swapper/119:50:161
291299122,7cyclictest0-21swapper/120:51:591
291199129,2cyclictest0-21swapper/023:20:110
291199129,2cyclictest0-21swapper/023:00:140
291199129,2cyclictest0-21swapper/021:20:310
291199129,2cyclictest0-21swapper/020:20:400
291199128,3cyclictest23739-21iostat_ios20:00:170
291199121,10cyclictest3728-21runrttasks22:17:060
291199120,2cyclictest17614-21diskmemload22:26:560
291199120,2cyclictest0-21swapper/023:05:100
291199120,2cyclictest0-21swapper/000:12:570
291199120,11cyclictest16812-21copy19:45:010
291199120,11cyclictest0-21swapper/023:32:410
291199120,11cyclictest0-21swapper/021:44:000
291199120,11cyclictest0-21swapper/019:20:390
291199120,10cyclictest0-21swapper/000:20:050
152752120,2sleep00-21swapper/021:01:050
291499118,2cyclictest0-21swapper/323:57:363
291499118,2cyclictest0-21swapper/319:45:203
291499118,2cyclictest0-21swapper/300:00:483
291499116,3cyclictest21343-21tr19:55:143
291499112,6cyclictest0-21swapper/320:52:593
291399118,2cyclictest0-21swapper/220:30:182
291399118,2cyclictest0-21swapper/220:06:282
291399116,3cyclictest23917-21tr20:00:192
291399110,1cyclictest0-21swapper/219:55:162
291299110,9cyclictest0-21swapper/119:21:021
291299110,3cyclictest28716-21munin-node1
291199118,2cyclictest0-21swapper/023:15:260
291199110,2cyclictest0-21swapper/022:12:080
291199110,2cyclictest0-21swapper/020:33:410
291199110,1cyclictest0-21swapper/020:51:030
291199110,1cyclictest0-21swapper/019:35:120
291199110,10cyclictest13315-21ssh21:38:050
291499104,4cyclictest2850-21rsyslogd19:30:003
291499102,6cyclictest0-21swapper/320:25:593
291399107,2cyclictest0-21swapper/220:15:192
291399107,2cyclictest0-21swapper/219:23:342
291199107,2cyclictest0-21swapper/021:06:050
291199107,2cyclictest0-21swapper/020:55:140
291199107,2cyclictest0-21swapper/020:25:180
291199107,2cyclictest0-21swapper/019:55:200
291199105,3cyclictest6685-21tail19:16:040
261912100,2sleep00-21swapper/022:57:460
29149996,2cyclictest0-21swapper/321:00:183
29149994,3cyclictest15039-21aten2.4_r3power19:40:253
29149991,5cyclictest0-21swapper/319:35:123
29149991,3cyclictest3649-21snmpd20:45:133
29139996,2cyclictest0-21swapper/221:00:182
29139996,2cyclictest0-21swapper/220:57:242
29139994,3cyclictest9905-21grep19:25:162
29139994,3cyclictest17806-21missed_timers19:45:182
29119994,3cyclictest3728-21runrttasks19:52:490
29119994,3cyclictest3728-21runrttasks19:11:120
29119994,3cyclictest3681-21sh20:35:130
29119994,3cyclictest15246-21cpuspeed_turbos19:40:270
29119993,4cyclictest9910-21taskset19:25:160
29119991,3cyclictest29965-21grep20:16:030
29139985,2cyclictest5552-21copy20:40:032
29139984,3cyclictest7859-21aten2.4-expect20:45:122
29139983,3cyclictest5459-21cpu19:15:132
29139983,3cyclictest15878-21aten2.4-expect21:05:132
29139981,5cyclictest736-21fschecks_count20:25:152
29119983,3cyclictest27091-21gdbus20:10:040
29119983,3cyclictest25299-21cpuspeed_turbos20:05:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional