You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 23:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Wed Apr 29, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
305027372,0sleep20-21swapper/206:55:252
304450440,0irq/25-eth10-21swapper/306:57:033
308923321,0sleep00-21swapper/006:55:550
297723324,0sleep10-21swapper/106:54:361
339960,0migration/39731-21munin-node11:22:183
339960,0migration/37989-21sh11:40:303
339960,0migration/327025-21munin-node09:12:183
339960,0migration/326305-21munin-node08:47:243
339960,0migration/325850-21sh09:51:093
339960,0migration/323093-21sh11:48:003
339960,0migration/316636-21kthreadcore08:42:223
32679966,0cyclictest9420-21timerwakeupswit06:57:270
32679960,0cyclictest0-21swapper/010:03:190
29725060,0irq/27-eth0-tx-16961-21munin-node11:27:172
29715060,0irq/26-eth0-rx-9620-21awk10:22:043
29715060,0irq/26-eth0-rx-15130-21awk10:42:233
19160,0ktimersoftd/13081-21mdstat07:17:211
149960,0migration/09159-21sh11:02:060
149960,0migration/08760-21sh11:01:350
149960,0migration/08565-21sh11:21:490
149960,0migration/07306-21sh11:59:320
149960,0migration/026400-21sh09:52:080
339950,0migration/39560-21kthreadcore08:37:203
339950,0migration/39540-21munin-node12:22:203
339950,0migration/37942-21munin-node09:17:253
339950,0migration/35906-21taskset08:08:033
339950,0migration/33060-21latency07:17:203
339950,0migration/32873-21kthreadcore07:42:233
339950,0migration/328461-21kthreadcore10:52:213
339950,0migration/328143-21kthreadcore08:27:213
339950,0migration/32785-21fschecks_count09:37:183
339950,0migration/325494-21fschecks_count11:32:173
339950,0migration/325338-21idleruntime12:12:193
339950,0migration/324050-21munin-node10:07:273
339950,0migration/323331-21latency_hist07:12:043
339950,0migration/321223-21kthreadcore11:27:213
339950,0migration/320051-21kthreadcore10:47:193
339950,0migration/319892-21aten_r1power_cu08:22:143
339950,0migration/319206-21diskmemload09:07:203
339950,0migration/318977-21aten_r1power_vo07:57:163
339950,0migration/317670-21taskset09:24:573
339950,0migration/317555-21kthreadcore08:17:213
339950,0migration/316576-21aten_r1power_fr12:07:163
339950,0migration/31625-21latency_hist08:57:043
339950,0migration/31340-21latency_hist10:37:043
339950,0migration/310344-21munin-node09:02:163
339950,0migration/310066-21latency_hist10:02:043
32709955,0cyclictest0-21swapper/212:12:292
32709955,0cyclictest0-21swapper/210:08:342
32709955,0cyclictest0-21swapper/209:50:352
32709950,0cyclictest0-21swapper/211:49:092
32709950,0cyclictest0-21swapper/211:44:532
32689950,0cyclictest1478-21diskmemload10:44:041
32689950,0cyclictest0-21swapper/111:46:301
32689950,0cyclictest0-21swapper/111:18:171
32689950,0cyclictest0-21swapper/111:04:531
32689950,0cyclictest0-21swapper/110:47:321
32689950,0cyclictest0-21swapper/110:07:581
32689950,0cyclictest0-21swapper/109:08:411
32679950,0cyclictest0-21swapper/010:32:100
32679950,0cyclictest0-21swapper/009:26:350
32679950,0cyclictest0-21swapper/009:03:340
3073250,0sleep34322-21kthreadcore09:57:213
29725050,0irq/27-eth0-tx-9877-21munin-node10:22:192
29725050,0irq/27-eth0-tx-4490-21munin-node07:22:220
29725050,0irq/27-eth0-tx-26769-21ssh10:32:182
29725050,0irq/27-eth0-tx-26682-21munin-node09:32:272
29725050,0irq/27-eth0-tx-18218-21munin-node09:07:262
29725050,0irq/27-eth0-tx-17859-21fschecks_time11:07:162
29725050,0irq/27-eth0-tx-12503-21kthreadcore12:02:212
29725050,0irq/27-eth0-tx-10233-21munin-node07:02:190
29725050,0irq/27-eth0-tx-0-21swapper/211:55:582
29725050,0irq/27-eth0-tx-0-21swapper/211:26:222
29725050,0irq/27-eth0-tx-0-21swapper/210:43:182
29725050,0irq/27-eth0-tx-0-21swapper/209:45:422
29725050,0irq/27-eth0-tx-0-21swapper/008:57:190
29725050,0irq/27-eth0-tx-0-21swapper/008:47:230
29725050,0irq/27-eth0-tx-0-21swapper/008:44:560
29725050,0irq/27-eth0-tx-0-21swapper/008:28:330
29725050,0irq/27-eth0-tx-0-21swapper/007:07:150
29715050,0irq/26-eth0-rx-8987-21kthreadcore08:12:213
29715050,0irq/26-eth0-rx-4552-21tr10:57:203
29715050,0irq/26-eth0-rx-3514-21snmpd10:31:303
29715050,0irq/26-eth0-rx-32520-21telnet12:17:143
29715050,0irq/26-eth0-rx-29978-21kthreadcore11:52:223
29715050,0irq/26-eth0-rx-1209-21entropy11:17:153
29715050,0irq/26-eth0-rx-0-21swapper/312:05:023
29715050,0irq/26-eth0-rx-0-21swapper/311:57:393
29715050,0irq/26-eth0-rx-0-21swapper/311:44:303
29715050,0irq/26-eth0-rx-0-21swapper/311:04:193
29715050,0irq/26-eth0-rx-0-21swapper/310:36:503
29715050,0irq/26-eth0-rx-0-21swapper/310:25:213
29715050,0irq/26-eth0-rx-0-21swapper/309:32:083
29715050,0irq/26-eth0-rx-0-21swapper/309:27:223
27150,0ktimersoftd/20-21swapper/211:07:032
259950,0migration/2886-21aten_r1power_po11:17:142
259950,0migration/2789-21runrttasks10:57:002
259950,0migration/27392-21kthreadcore06:57:212
259950,0migration/26942-21sh12:19:082
259950,0migration/232657-21sh10:13:302
259950,0migration/230305-21kthreadcore11:32:212
259950,0migration/220897-21kthreadcore10:47:202
259950,0migration/210093-21taskset09:42:022
19150,0ktimersoftd/10-21swapper/109:14:121
179950,0migration/16667-21needreboot10:57:211
179950,0migration/12764-21kthreadcore11:37:201
179950,0migration/127185-21kernelversion10:32:201
179950,0migration/126895-21kthreadcore11:12:201
179950,0migration/126246-21ntp_kernel_err08:47:231
179950,0migration/124216-21munin-node09:27:231
179950,0migration/112446-21kthreadcore09:22:201
169950,0watchdog/121101-21sh12:07:221
149950,0migration/09870-21idleruntime-cro10:02:040
149950,0migration/07999-21pmu-power09:37:250
149950,0migration/07927-21munin-node08:37:160
149950,0migration/07254-21taskset12:20:030
149950,0migration/06474-21munin-node07:47:200
149950,0migration/031001-21timerwakeupswit11:32:260
149950,0migration/029896-21kthreadcore08:52:200
149950,0migration/027088-21kthreadcore07:37:200
149950,0migration/026295-21kthreadcore12:12:220
149950,0migration/025766-21sh09:30:160
149950,0migration/025618-21aten_r1power_cu10:52:150
149950,0migration/025472-21runrttasks09:50:040
149950,0migration/021807-21kthreadcore07:57:210
149950,0migration/021118-21irqrtprio08:22:190
149950,0migration/020450-21kthreadcore10:07:210
149950,0migration/02008-21kthreadcore07:42:220
149950,0migration/01986-21irqrtprio08:32:200
149950,0migration/017837-21taskset11:27:180
149950,0migration/014637-21kthreadcore08:17:200
149950,0migration/013681-21kthreadcore10:22:200
149950,0migration/012524-21kthreadcore11:22:210
149950,0migration/011196-21hwlatdetect09:42:200
149950,0migration/010731-21kthreadcore08:12:220
8215040,0irq/24-0000:00:19798-21cat08:22:042
339940,0migration/34142-21fschecks_time06:57:173
339940,0migration/332573-21diskmemload09:52:333
339940,0migration/331084-21timerandwakeup11:12:263
339940,0migration/323643-21timerwakeupswit07:32:263
32709943,0cyclictest5452-21awk07:22:182
32709943,0cyclictest3514-21snmpd10:17:152
32709943,0cyclictest3514-21snmpd08:16:302
32709943,0cyclictest3514-21snmpd07:57:452
32709943,0cyclictest31096-21awk07:17:182
32709943,0cyclictest2440-21awk10:37:212
32709943,0cyclictest14119-21awk08:17:192
32709943,0cyclictest1355-21awk11:57:192
32689944,0cyclictest0-21swapper/112:01:381
32689943,0cyclictest3241-21irqbalance10:37:521
32689943,0cyclictest323-21sadc11:37:041
32689943,0cyclictest32052-21awk07:42:201
32689943,0cyclictest25372-21awk07:37:181
32689943,0cyclictest10896-21awk09:02:191
32679944,0cyclictest32756-21kworker/0:011:42:150
32679944,0cyclictest0-21swapper/012:05:590
32679944,0cyclictest0-21swapper/010:17:120
32679944,0cyclictest0-21swapper/010:14:310
32679943,0cyclictest630-21awk08:07:180
32679943,0cyclictest3514-21snmpd09:12:150
32679943,0cyclictest3275-21awk09:17:200
32679943,0cyclictest3241-21irqbalance09:08:330
32679943,0cyclictest26525-21ps11:12:200
32679943,0cyclictest25643-21awk11:52:180
32679943,0cyclictest24421-21awk07:12:210
32679943,0cyclictest2415-21awk10:37:210
32679943,0cyclictest12044-21awk07:27:200
29725040,0irq/27-eth0-tx-26470-21munin-node09:12:272
29725040,0irq/27-eth0-tx-0-21swapper/212:23:202
29725040,0irq/27-eth0-tx-0-21swapper/211:37:202
29725040,0irq/27-eth0-tx-0-21swapper/210:57:132
29725040,0irq/27-eth0-tx-0-21swapper/210:28:562
29725040,0irq/27-eth0-tx-0-21swapper/210:02:052
29725040,0irq/27-eth0-tx-0-21swapper/209:57:142
29725040,0irq/27-eth0-tx-0-21swapper/209:52:192
29725040,0irq/27-eth0-tx-0-21swapper/209:17:202
29725040,0irq/27-eth0-tx-0-21swapper/209:02:062
29725040,0irq/27-eth0-tx-0-21swapper/208:57:592
29715040,0irq/26-eth0-rx-18926-21kthreadcore11:07:203
29715040,0irq/26-eth0-rx-0-21swapper/310:13:253
29715040,0irq/26-eth0-rx-0-21swapper/309:42:323
29715040,0irq/26-eth0-rx-0-21swapper/307:22:193
259940,0migration/2941-21irqrtprio08:07:192
259940,0migration/25710-21kthreadcore08:32:222
259940,0migration/25366-21latency_hist07:47:042
259940,0migration/2485-21munin-node08:52:232
259940,0migration/231870-21gltestperf07:42:192
259940,0migration/228598-21kthreadcore07:12:242
259940,0migration/225960-21gltestperf11:12:172
259940,0migration/219326-21fschecks_time09:27:182
259940,0migration/218768-21kthreadcore07:07:202
259940,0migration/215114-21kthreadcore07:52:222
259940,0migration/214745-21kthreadcore07:27:232
259940,0migration/214246-21aten_r1power_cu08:42:162
259940,0migration/212037-21kthreadcore09:22:202
249940,0watchdog/226567-21timerandwakeup08:47:272
249940,0watchdog/20-21swapper/212:07:222
179940,0migration/1770-21aten_r1power_en08:32:151
179940,0migration/15050-21kthreadcore09:17:221
179940,0migration/130408-21kthreadcore08:52:211
179940,0migration/130221-21kthreadcore08:27:211
179940,0migration/129642-21kthreadcore10:12:211
179940,0migration/128244-21kthreadcore11:52:211
179940,0migration/126805-21kernelversion08:02:201
179940,0migration/126157-21runrttasks08:25:481
179940,0migration/124325-21sh10:28:221
179940,0migration/123947-21fschecks_count07:12:191
179940,0migration/123367-21sh11:28:051
179940,0migration/119709-21munin-node09:47:211
179940,0migration/119312-21fschecks_count07:57:181
179940,0migration/118995-21kthreadcore07:07:201
179940,0migration/115763-21kthreadcore08:17:211
179940,0migration/115639-21sh12:05:271
179940,0migration/114434-21kthreadcore10:22:201
179940,0migration/113928-21kthreadcore07:52:221
179940,0migration/111580-21df_abs07:27:181
179940,0migration/111366-21kthreadcore08:37:211
169940,0watchdog/18938-21munin-node11:22:221
169940,0watchdog/17509-21load09:57:221
169940,0watchdog/1728-21iostat_ios08:07:191
169940,0watchdog/15799-21kthreadcore07:22:191
169940,0watchdog/132491-21munin-node12:17:261
169940,0watchdog/127344-21cut12:12:221
169940,0watchdog/114753-21ssh12:23:221
169940,0watchdog/10-21swapper/110:17:221
169940,0watchdog/10-21swapper/109:42:221
169940,0watchdog/10-21swapper/109:38:111
169940,0watchdog/10-21swapper/109:33:471
149940,0migration/022328-21kthreadcore10:47:200
149940,0migration/020699-21kthreadcore12:07:220
149940,0migration/011801-21kthreadcore12:22:210
339930,0migration/329724-21runrttasks07:15:093
339930,0migration/316445-21runrttasks07:05:093
32709933,0cyclictest8466-21awk08:37:192
32709932,0cyclictest3241-21irqbalance07:06:132
32709932,0cyclictest30929-21latency_hist07:42:042
32709932,0cyclictest27016-21cut08:27:172
32709932,0cyclictest26417-21awk08:02:192
32709932,0cyclictest18743-21awk07:32:192
32689933,0cyclictest18815-21awk07:32:191
32689932,0cyclictest6457-21wc08:12:041
32689932,0cyclictest2599-21awk08:57:191
32689932,0cyclictest15858-21sensors07:02:261
32689930,0cyclictest6024-21kthreadcore06:57:211
32689930,0cyclictest26727-21cpuspeed_turbos09:52:171
32679933,0cyclictest32756-21kworker/0:011:47:050
32679933,0cyclictest32756-21kworker/0:011:37:050
32679933,0cyclictest31429-21kworker/0:111:07:150
32679933,0cyclictest31429-21kworker/0:110:42:210
32679933,0cyclictest31429-21kworker/0:110:27:050
32679933,0cyclictest31429-21kworker/0:109:32:060
32679933,0cyclictest31429-21kworker/0:108:02:160
32679933,0cyclictest31429-21kworker/0:107:52:160
32679933,0cyclictest31429-21kworker/0:107:32:140
32679932,0cyclictest29906-21latency_hist07:17:040
29715030,0irq/26-eth0-rx-0-21swapper/308:36:063
29715030,0irq/26-eth0-rx-0-21swapper/308:02:243
29715030,0irq/26-eth0-rx-0-21swapper/307:52:163
19130,0ktimersoftd/125579-21sh10:52:131
179930,0migration/110581-21kthreadcore07:47:221
169930,0watchdog/116631-21ssh10:03:341
169930,0watchdog/10-21swapper/111:47:221
169930,0watchdog/10-21swapper/111:10:181
29715020,0irq/26-eth0-rx-0-21swapper/308:53:023
29715020,0irq/26-eth0-rx-0-21swapper/307:47:133
29715020,0irq/26-eth0-rx-0-21swapper/307:37:083
29715020,0irq/26-eth0-rx-0-21swapper/307:27:163
169920,0watchdog/10-21swapper/108:42:071
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional