You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 17:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Mon Jun 08, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
60522117106,6sleep10-21swapper/107:06:151
60862116105,6sleep00-21swapper/007:06:420
6248210583,17sleep20-21swapper/207:08:492
6104210285,12sleep30-21swapper/307:06:573
312342700,1sleep10-21swapper/111:38:001
192142670,1sleep019216-21cpuspeed_turbos10:50:120
297692270,0sleep30-21swapper/308:05:173
169332260,0sleep30-21swapper/311:57:103
169332260,0sleep30-21swapper/311:57:103
111722260,0sleep10-21swapper/111:15:511
637099221,19cyclictest0-21swapper/310:10:103
636799220,2cyclictest0-21swapper/007:50:100
281662220,1sleep028167-21fschecks_count09:15:140
636999218,12cyclictest0-21swapper/211:45:132
636799210,2cyclictest0-21swapper/007:40:120
6370992016,2cyclictest0-21swapper/307:55:123
636999200,18cyclictest0-21swapper/208:35:112
637099193,4cyclictest32689-21hostname12:15:123
6368991916,2cyclictest32732-21kworker/u8:012:36:041
6368991916,2cyclictest31577-21kworker/u8:211:30:041
6368991916,2cyclictest26008-21kworker/u8:010:57:051
6368991916,2cyclictest16895-21kworker/u8:212:24:051
636899190,17cyclictest0-21swapper/109:55:131
6367991914,3cyclictest32461-21ssh09:20:110
637099181,15cyclictest0-21swapper/311:43:073
6368991815,2cyclictest8820-21kworker/u8:009:39:031
6368991815,2cyclictest8820-21kworker/u8:009:30:051
6368991815,2cyclictest4711-21kworker/u8:011:54:041
6368991815,2cyclictest4711-21kworker/u8:011:54:041
6368991815,2cyclictest31577-21kworker/u8:211:43:031
6368991815,2cyclictest31577-21kworker/u8:211:24:051
6368991815,2cyclictest24640-21kworker/u8:109:50:011
6368991815,2cyclictest12448-21kworker/u8:108:48:041
636899180,13cyclictest0-21swapper/109:28:011
637099172,13cyclictest0-21swapper/307:49:043
6370991712,3cyclictest0-21swapper/312:20:213
637099171,14cyclictest990-21irqstats11:05:163
6368991714,2cyclictest8820-21kworker/u8:009:44:041
6368991714,2cyclictest31577-21kworker/u8:211:06:041
6368991714,2cyclictest2846-21kworker/u8:010:01:031
6368991714,2cyclictest24457-21kworker/u8:108:18:041
6368991714,2cyclictest18761-21kworker/u8:007:50:041
6368991714,2cyclictest12896-21kworker/u8:010:10:041
637099162,2cyclictest0-21swapper/310:54:063
637099162,12cyclictest0-21swapper/309:25:473
6370991613,2cyclictest381ktimersoftd/310:43:403
6370991613,2cyclictest0-21swapper/311:29:303
6370991613,2cyclictest0-21swapper/309:47:573
6370991613,2cyclictest0-21swapper/308:50:193
637099161,13cyclictest28456-21ssh09:15:163
637099161,13cyclictest0-21swapper/310:55:163
637099160,14cyclictest0-21swapper/310:35:123
637099160,14cyclictest0-21swapper/310:02:163
6369991611,3cyclictest0-21swapper/211:40:092
6368991613,2cyclictest4711-21kworker/u8:012:08:041
6368991613,2cyclictest32732-21kworker/u8:012:29:051
6368991613,2cyclictest30169-21kworker/u8:009:23:041
6368991613,2cyclictest28231-21kworker/u8:111:49:041
6368991613,2cyclictest27506-21kworker/u8:112:12:051
6368991613,2cyclictest27350-21kworker/u8:010:29:041
6368991613,2cyclictest26008-21kworker/u8:011:03:041
6368991613,2cyclictest24457-21kworker/u8:108:11:041
6368991613,2cyclictest24229-21kworker/u8:209:14:001
6368991613,2cyclictest18781-21kworker/u8:110:22:041
6368991613,2cyclictest16895-21kworker/u8:212:03:041
6368991613,2cyclictest16895-21kworker/u8:212:03:041
6368991613,2cyclictest1421-21kworker/u8:107:18:011
6368991613,2cyclictest13944-21kworker/u8:210:34:041
6367991611,3cyclictest0-21swapper/011:25:590
637099154,10cyclictest0-21swapper/311:15:023
637099152,12cyclictest0-21swapper/312:12:073
637099151,3cyclictest29917-21ssh09:51:173
6370991512,2cyclictest22756-21diskmemload12:39:203
6370991510,3cyclictest0-21swapper/310:20:133
6370991510,3cyclictest0-21swapper/308:14:593
637099150,13cyclictest4149-21sshd10:34:123
637099150,13cyclictest22756-21diskmemload11:00:553
637099150,13cyclictest0-21swapper/307:10:183
636999151,3cyclictest8545-21ssh09:29:032
6369991510,3cyclictest0-21swapper/209:15:112
636999150,13cyclictest0-21swapper/212:19:592
636999150,13cyclictest0-21swapper/211:37:392
636999150,13cyclictest0-21swapper/210:27:032
6368991512,2cyclictest5876-21kworker/u8:008:35:041
6368991512,2cyclictest31577-21kworker/u8:211:26:041
6368991512,2cyclictest30169-21kworker/u8:009:19:041
6368991512,2cyclictest26994-21kworker/u8:208:02:041
6368991512,2cyclictest18761-21kworker/u8:007:58:041
6368991512,2cyclictest18761-21kworker/u8:007:48:041
6368991512,2cyclictest10658-21kworker/u8:207:37:041
636899151,12cyclictest22756-21diskmemload10:08:031
636899150,13cyclictest19744-21memory10:50:161
636899150,13cyclictest0-21swapper/111:12:171
636799152,7cyclictest0-21swapper/010:00:010
636799151,3cyclictest1637-21ssh12:15:540
636799150,13cyclictest0-21swapper/012:07:330
77142140,11sleep20-21swapper/210:37:222
637099149,3cyclictest0-21swapper/309:55:173
6370991411,2cyclictest0-21swapper/312:30:373
6370991411,2cyclictest0-21swapper/311:46:123
6370991411,2cyclictest0-21swapper/311:20:353
6370991411,2cyclictest0-21swapper/311:10:463
6370991411,2cyclictest0-21swapper/310:19:473
6370991411,2cyclictest0-21swapper/309:20:593
637099140,3cyclictest30630-21runrttasks11:36:593
637099140,2cyclictest0-21swapper/308:35:153
637099140,13cyclictest0-21swapper/311:31:513
637099140,12cyclictest0-21swapper/309:30:093
636999141,9cyclictest8026-21rm10:03:022
636999141,2cyclictest690-21aten2.4_r3power08:15:112
6369991411,2cyclictest10639-21ssh12:25:182
6369991411,2cyclictest0-21swapper/209:42:482
6369991411,2cyclictest0-21swapper/207:55:182
636999140,2cyclictest26673-21ssh10:23:182
636999140,2cyclictest0-21swapper/210:54:592
636999140,13cyclictest22756-21diskmemload11:27:482
636999140,12cyclictest3063-21ssh09:57:502
636999140,12cyclictest12829-21ssh10:43:122
636999140,12cyclictest0-21swapper/212:06:422
636899149,3cyclictest24893-21sensors09:46:001
6368991411,2cyclictest5876-21kworker/u8:009:02:041
6368991411,2cyclictest27350-21kworker/u8:010:38:041
6368991411,2cyclictest2642-21kworker/u8:208:31:041
6368991411,2cyclictest24457-21kworker/u8:108:06:051
6368991411,2cyclictest19020-21kworker/u8:109:07:041
6368991411,2cyclictest19020-21kworker/u8:109:07:041
6368991411,2cyclictest16895-21kworker/u8:211:58:011
6368991411,2cyclictest16895-21kworker/u8:211:58:011
6368991411,2cyclictest16502-21kworker/u8:208:55:041
636899140,2cyclictest0-21swapper/110:48:041
636899140,2cyclictest0-21swapper/110:15:171
636799142,6cyclictest0-21swapper/009:10:010
636799142,6cyclictest0-21swapper/009:10:010
6367991411,2cyclictest0-21swapper/011:37:230
636799141,11cyclictest17795-21ntp_states08:55:180
636799140,12cyclictest9094-21ssh11:49:230
636799140,12cyclictest0-21swapper/008:35:110
17862140,2sleep01883-21smartctl10:31:020
637099132,8cyclictest0-21swapper/307:42:593
637099131,6cyclictest0-21swapper/307:40:003
637099131,2cyclictest0-21swapper/310:45:323
637099131,2cyclictest0-21swapper/309:40:143
637099131,11cyclictest0-21swapper/308:45:143
6370991310,2cyclictest0-21swapper/312:06:283
6370991310,2cyclictest0-21swapper/309:39:563
6370991310,2cyclictest0-21swapper/309:05:113
6370991310,2cyclictest0-21swapper/309:05:113
637099130,3cyclictest0-21swapper/310:26:433
637099130,12cyclictest0-21swapper/311:50:473
637099130,12cyclictest0-21swapper/311:50:463
636999138,3cyclictest0-21swapper/211:51:212
636999138,3cyclictest0-21swapper/211:51:202
6369991310,2cyclictest11434-21ssh11:16:022
6369991310,2cyclictest0-21swapper/212:36:202
6369991310,2cyclictest0-21swapper/212:31:292
6369991310,2cyclictest0-21swapper/211:32:392
6369991310,2cyclictest0-21swapper/211:22:202
6369991310,2cyclictest0-21swapper/211:02:332
6369991310,2cyclictest0-21swapper/210:55:492
6369991310,2cyclictest0-21swapper/210:15:142
6369991310,2cyclictest0-21swapper/210:10:122
6369991310,2cyclictest0-21swapper/208:30:012
636999130,2cyclictest32666-21ssh10:30:062
636999130,2cyclictest0-21swapper/210:45:222
636999130,12cyclictest0-21swapper/211:55:392
636999130,12cyclictest0-21swapper/211:55:392
636999130,11cyclictest405-21ssh09:20:132
636999130,11cyclictest30574-21ssh12:12:052
636999130,11cyclictest0-21swapper/207:49:172
6368991310,2cyclictest2642-21kworker/u8:208:42:041
6368991310,2cyclictest18761-21kworker/u8:007:41:041
6368991310,2cyclictest12448-21kworker/u8:108:50:031
6368991310,2cyclictest0-21swapper/110:41:511
636899130,11cyclictest0-21swapper/112:30:111
636799132,6cyclictest0-21swapper/008:50:000
636799131,6cyclictest0-21swapper/007:15:000
6367991311,1cyclictest0-21swapper/011:52:330
6367991311,1cyclictest0-21swapper/011:52:330
6367991310,2cyclictest0-21swapper/012:36:430
636799130,2cyclictest0-21swapper/012:35:010
636799130,12cyclictest0-21swapper/007:49:000
636799130,11cyclictest26252-21sed07:56:040
636799130,11cyclictest0-21swapper/012:00:360
636799130,11cyclictest0-21swapper/012:00:360
38742130,2sleep00-21swapper/011:43:320
196302130,2sleep00-21swapper/009:00:160
16092130,1sleep20-21swapper/211:05:472
154772130,2sleep00-21swapper/010:10:420
115252130,1sleep3381ktimersoftd/310:06:113
637099129,2cyclictest0-21swapper/312:26:383
637099129,2cyclictest0-21swapper/307:30:163
637099129,2cyclictest0-21swapper/307:25:513
637099129,2cyclictest0-21swapper/307:20:113
637099121,10cyclictest0-21swapper/309:11:313
637099120,2cyclictest0-21swapper/308:30:113
637099120,11cyclictest0-21swapper/312:00:263
637099120,11cyclictest0-21swapper/312:00:263
637099120,11cyclictest0-21swapper/308:16:023
636999129,2cyclictest0-21swapper/209:51:202
636999129,2cyclictest0-21swapper/208:00:492
636999129,2cyclictest0-21swapper/207:21:012
636999127,3cyclictest23738-21cut09:10:152
636999122,7cyclictest0-21swapper/208:48:592
636999120,2cyclictest0-21swapper/212:04:392
636999120,2cyclictest0-21swapper/212:04:382
636999120,2cyclictest0-21swapper/210:06:102
636999120,2cyclictest0-21swapper/209:45:342
636999120,2cyclictest0-21swapper/209:32:142
636999120,2cyclictest0-21swapper/208:25:152
636999120,2cyclictest0-21swapper/207:30:142
636999120,11cyclictest0-21swapper/209:36:342
636999120,11cyclictest0-21swapper/208:50:162
636999120,11cyclictest0-21swapper/208:10:392
636999120,11cyclictest0-21swapper/207:36:032
636999120,11cyclictest0-21swapper/207:25:152
636899129,2cyclictest24457-21kworker/u8:108:25:031
636899129,2cyclictest0-21swapper/112:15:481
636899129,2cyclictest0-21swapper/107:25:151
636899120,11cyclictest0-21swapper/107:20:161
636799129,2cyclictest22756-21diskmemload09:52:500
636799129,2cyclictest0-21swapper/012:12:260
636799129,2cyclictest0-21swapper/011:55:230
636799129,2cyclictest0-21swapper/011:55:220
636799129,2cyclictest0-21swapper/011:30:120
636799129,2cyclictest0-21swapper/011:10:160
636799123,5cyclictest0-21swapper/008:12:390
636799120,2cyclictest0-21swapper/011:08:530
636799120,11cyclictest0-21swapper/011:20:190
636799120,11cyclictest0-21swapper/011:15:350
270032120,2sleep00-21swapper/010:58:440
117722120,2sleep00-21swapper/012:26:220
637099117,3cyclictest0-21swapper/308:40:153
637099113,6cyclictest17150-21tr08:55:133
637099111,6cyclictest0-21swapper/307:51:003
637099110,10cyclictest0-21swapper/309:00:053
636999118,2cyclictest0-21swapper/212:20:462
636999118,2cyclictest0-21swapper/208:05:122
636999111,6cyclictest0-21swapper/211:15:002
636999111,6cyclictest0-21swapper/207:40:112
636999110,10cyclictest0-21swapper/208:40:152
636899118,2cyclictest24457-21kworker/u8:108:21:041
636899110,9cyclictest0-21swapper/107:10:181
636799119,1cyclictest0-21swapper/009:27:400
636799119,1cyclictest0-21swapper/008:16:010
636799118,2cyclictest0-21swapper/012:20:200
636799118,2cyclictest0-21swapper/010:21:200
636799118,2cyclictest0-21swapper/009:48:020
636799118,2cyclictest0-21swapper/007:35:110
636799116,3cyclictest27419-21munin-run09:15:000
636799112,7cyclictest22756-21diskmemload10:01:020
636799112,6cyclictest0-21swapper/009:42:020
636799111,8cyclictest3649-21snmpd10:38:090
636799111,8cyclictest20604-21taskset10:16:030
636799111,6cyclictest0-21swapper/011:03:140
636799111,6cyclictest0-21swapper/007:32:320
636799111,6cyclictest0-21swapper/007:22:300
636799110,9cyclictest0-21swapper/010:45:330
636799110,1cyclictest0-21swapper/008:20:190
636799110,10cyclictest0-21swapper/009:37:200
119982110,2sleep00-21swapper/010:41:450
119112110,2sleep00-21swapper/008:40:400
637099104,4cyclictest3728-21runrttasks08:20:113
637099103,5cyclictest4917-21telnet08:25:123
637099103,5cyclictest27013-21apt-get08:00:103
637099102,6cyclictest0-21swapper/307:15:113
636999107,2cyclictest0-21swapper/209:00:152
636999107,2cyclictest0-21swapper/207:54:122
636999107,2cyclictest0-21swapper/207:15:152
636999101,5cyclictest0-21swapper/208:25:002
636899100,2cyclictest0-21swapper/107:30:141
636799107,2cyclictest0-21swapper/009:34:270
636799103,3cyclictest3127-21nscd10:07:180
636799101,6cyclictest0-21swapper/007:25:110
636799100,3cyclictest15565-21iostat_ios08:50:170
279882100,2sleep00-21swapper/010:25:090
63699996,2cyclictest0-21swapper/208:55:122
63699991,3cyclictest7468-21grep07:10:172
63699990,6cyclictest0-21swapper/209:07:502
63699990,6cyclictest0-21swapper/209:07:502
63679994,3cyclictest8630-21latency_hist08:35:000
63679994,3cyclictest26781-21turbostat08:04:550
63679991,6cyclictest0-21swapper/007:16:010
63679990,5cyclictest0-21swapper/008:06:020
63679983,3cyclictest4830-21cut08:25:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional