You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 23:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Jun 09, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1810823927,0sleep30-21swapper/306:53:103
1775423723,0sleep00-21swapper/006:49:030
1806123324,0sleep20-21swapper/206:52:372
1796223324,0sleep10-21swapper/106:51:281
339960,0migration/38385-21munin-node07:58:253
339960,0migration/37036-21sh09:24:313
339960,0migration/36675-21sh09:43:533
339960,0migration/35021-21munin-node11:03:303
339960,0migration/330859-21sh10:40:093
339960,0migration/330676-21sh11:42:143
339960,0migration/323471-21sh08:56:313
339960,0migration/322886-21sh11:16:473
339960,0migration/313616-21sh11:50:043
29715060,0irq/26-eth0-rx-9482-21if_eth1.209:08:273
29715060,0irq/26-eth0-rx-22555-21df08:33:233
29715060,0irq/26-eth0-rx-21313-21munin-node11:33:343
181809960,0cyclictest0-21swapper/209:12:102
181799960,0cyclictest0-21swapper/110:51:461
149960,0migration/025466-21gltestperf09:38:250
8215050,0irq/24-0000:00:31933-21idleruntime-cro10:43:112
8215050,0irq/24-0000:00:31685-40yum-updatesd-he09:41:032
339950,0migration/39980-21kthreadcore11:08:273
339950,0migration/36965-21latency_hist07:33:113
339950,0migration/36902-21runrttasks10:04:583
339950,0migration/35704-21missed_timers09:03:303
339950,0migration/34597-21kthreadcore08:18:273
339950,0migration/33570-21kthreadcore10:23:293
339950,0migration/33570-21kthreadcore10:23:293
339950,0migration/332631-21runrttasks10:43:233
339950,0migration/332210-21latency_hist10:23:113
339950,0migration/331147-21taskset06:59:383
339950,0migration/328668-21munin-node11:58:313
339950,0migration/325530-21munin-node09:38:253
339950,0migration/324100-21fschecks_count11:18:233
339950,0migration/32274-21kthreadcore12:03:293
339950,0migration/32205-21timerandwakeup08:38:353
339950,0migration/31865-21kthreadcore11:43:283
339950,0migration/318646-21kthreadcore10:13:273
339950,0migration/31725-21taskset08:15:373
339950,0migration/315454-21fschecks_count11:53:253
339950,0migration/315236-21fschecks_time08:03:243
29725050,0irq/27-eth0-tx-6658-21ssh11:48:052
29725050,0irq/27-eth0-tx-31956-21munin-node11:03:292
29725050,0irq/27-eth0-tx-30472-21ssh11:20:302
29725050,0irq/27-eth0-tx-28715-21unixbench_multi12:18:352
29725050,0irq/27-eth0-tx-26080-21cut10:58:282
29725050,0irq/27-eth0-tx-25368-21if_eth110:18:282
29725050,0irq/27-eth0-tx-20857-21cut09:53:272
29725050,0irq/27-eth0-tx-14640-21munin-node08:03:320
29725050,0irq/27-eth0-tx-0-21swapper/211:59:222
29725050,0irq/27-eth0-tx-0-21swapper/210:45:412
29725050,0irq/27-eth0-tx-0-21swapper/210:05:432
29725050,0irq/27-eth0-tx-0-21swapper/209:58:302
29725050,0irq/27-eth0-tx-0-21swapper/008:25:240
29725050,0irq/27-eth0-tx-0-21swapper/007:23:300
29725050,0irq/27-eth0-tx-0-21swapper/006:54:390
29715050,0irq/26-eth0-rx-8889-21hwlatdetect10:28:243
29715050,0irq/26-eth0-rx-8457-21tune2fs10:48:243
29715050,0irq/26-eth0-rx-3690-21kthreadcore07:28:293
29715050,0irq/26-eth0-rx-31651-21ssh11:23:173
29715050,0irq/26-eth0-rx-24392-21aten_r1power_en08:58:223
29715050,0irq/26-eth0-rx-20651-21kthreadcore07:18:273
29715050,0irq/26-eth0-rx-15927-21uname12:13:253
29715050,0irq/26-eth0-rx-14625-21ssh11:32:043
29715050,0irq/26-eth0-rx-13823-21sed07:13:273
29715050,0irq/26-eth0-rx-0-21swapper/312:21:253
29715050,0irq/26-eth0-rx-0-21swapper/312:08:313
29715050,0irq/26-eth0-rx-0-21swapper/310:55:113
29715050,0irq/26-eth0-rx-0-21swapper/310:33:153
29715050,0irq/26-eth0-rx-0-21swapper/310:11:153
29715050,0irq/26-eth0-rx-0-21swapper/309:58:263
29715050,0irq/26-eth0-rx-0-21swapper/309:53:213
29715050,0irq/26-eth0-rx-0-21swapper/309:34:263
29715050,0irq/26-eth0-rx-0-21swapper/309:28:283
29715050,0irq/26-eth0-rx-0-21swapper/309:20:013
27150,0ktimersoftd/20-21swapper/212:05:432
27150,0ktimersoftd/20-21swapper/211:16:332
259950,0migration/29859-21kthreadcore10:08:272
259950,0migration/28071-21timerandwakeup08:18:332
259950,0migration/22967-21kthreadcore07:28:282
259950,0migration/216699-21df_abs10:13:222
259950,0migration/213859-21munin-node10:48:342
259950,0migration/213491-21latency_hist07:38:112
249950,0watchdog/215053-21ssh10:31:012
181809954,0cyclictest23674-21crond10:58:102
181809950,0cyclictest0-21swapper/211:36:542
181809950,0cyclictest0-21swapper/209:37:232
181799955,0cyclictest0-21swapper/110:28:261
181799950,0cyclictest0-21swapper/111:35:361
181799950,0cyclictest0-21swapper/110:45:181
181799950,0cyclictest0-21swapper/108:59:221
181789953,0cyclictest2605-21kworker/0:211:24:100
179950,0migration/14725-21munin-node12:03:361
179950,0migration/13823-21fschecks_time08:43:231
179950,0migration/132040-21taskset07:23:551
179950,0migration/130755-21kthreadcore08:13:281
179950,0migration/125479-21taskset10:38:261
179950,0migration/123825-21latency_hist10:58:101
179950,0migration/122652-21sh11:58:061
179950,0migration/119311-21kthreadcore12:13:261
179950,0migration/118319-21rt-features07:13:321
179950,0migration/116528-21aten_r1power_cu09:53:211
179950,0migration/114292-21unixbench-2d10:08:331
179950,0migration/112285-21taskset07:11:341
169950,0watchdog/15924-21ssh09:23:291
149950,0migration/09081-21fschecks_time09:48:260
149950,0migration/09023-21irqcore07:58:280
149950,0migration/08070-21sh09:27:280
149950,0migration/08052-21kthreadcore07:08:270
149950,0migration/07791-21irqcore12:08:270
149950,0migration/07628-21sh10:27:400
149950,0migration/07628-21sh10:27:400
149950,0migration/07121-21kthreadcore08:43:270
149950,0migration/06983-21sendmail_mailqu07:53:290
149950,0migration/0509-21unixbench_singl07:48:350
149950,0migration/03326-21kthreadcore07:28:280
149950,0migration/026595-21kthreadcore08:33:280
149950,0migration/025644-21gltestperf09:18:250
149950,0migration/025608-21fschecks_time06:58:250
149950,0migration/025398-21taskset07:19:020
149950,0migration/024697-21munin-node09:58:210
149950,0migration/024396-21taskset10:18:210
149950,0migration/023580-21fschecks_time11:58:240
149950,0migration/022611-21latency_hist12:18:100
149950,0migration/02048-21kthreadcore09:03:280
149950,0migration/018189-21kthreadcore12:13:260
149950,0migration/017262-21gltestperf08:53:250
149950,0migration/016861-21aten_r1power_vo09:13:220
149950,0migration/016782-21irqcore11:13:260
149950,0migration/01112-21kthreadcore07:03:280
339940,0migration/35988-21taskset07:08:163
339940,0migration/34293-21kthreadcore07:53:253
339940,0migration/327397-21df_abs07:48:243
339940,0migration/325310-21kthreadcore07:43:283
339940,0migration/312937-21kthreadcore09:48:313
29725040,0irq/27-eth0-tx-7391-21gltestperf12:08:242
29725040,0irq/27-eth0-tx-467-21aten_r1power_fr09:23:222
29725040,0irq/27-eth0-tx-32575-21munin-node09:03:242
29725040,0irq/27-eth0-tx-2828-21sshd08:42:390
29725040,0irq/27-eth0-tx-21546-21ssh12:15:402
29725040,0irq/27-eth0-tx-16302-21diskmemload09:19:342
29725040,0irq/27-eth0-tx-16302-21diskmemload08:55:272
29725040,0irq/27-eth0-tx-13676-21munin-node07:38:350
29725040,0irq/27-eth0-tx-0-21swapper/211:28:222
29725040,0irq/27-eth0-tx-0-21swapper/209:48:142
29725040,0irq/27-eth0-tx-0-21swapper/209:13:312
29725040,0irq/27-eth0-tx-0-21swapper/208:58:162
29725040,0irq/27-eth0-tx-0-21swapper/008:28:330
29725040,0irq/27-eth0-tx-0-21swapper/007:43:220
29715040,0irq/26-eth0-rx-0-21swapper/310:58:163
29715040,0irq/26-eth0-rx-0-21swapper/309:13:213
29715040,0irq/26-eth0-rx-0-21swapper/308:48:283
259940,0migration/29833-21irqrtprio09:28:272
259940,0migration/28444-21hwlatdetect11:08:242
259940,0migration/25639-21sh11:24:092
259940,0migration/232494-21munin-node07:48:322
259940,0migration/224530-21munin-node11:38:292
259940,0migration/219942-21mdstat08:03:292
259940,0migration/219301-21latency_hist07:18:112
259940,0migration/216504-21kthreadcore07:38:292
259940,0migration/211304-21kthreadcore08:48:272
249940,0watchdog/20-21swapper/211:48:212
249940,0watchdog/20-21swapper/210:23:252
249940,0watchdog/20-21swapper/210:23:252
249940,0watchdog/20-21swapper/208:43:292
249940,0watchdog/20-21swapper/208:28:292
249940,0watchdog/20-21swapper/207:53:252
181809943,0cyclictest3556-21lldpd09:43:152
181809943,0cyclictest3556-21lldpd08:38:152
181809943,0cyclictest3556-21lldpd07:58:152
181809943,0cyclictest3556-21lldpd07:44:152
181809943,0cyclictest3556-21lldpd07:23:152
181809943,0cyclictest3556-21lldpd07:15:152
181809943,0cyclictest3556-21lldpd07:12:452
181809943,0cyclictest3556-21lldpd07:03:152
181809943,0cyclictest3556-21lldpd06:59:452
181809943,0cyclictest28859-21awk08:13:262
181809943,0cyclictest22207-21awk08:08:252
181809943,0cyclictest17159-21grep10:33:282
181809943,0cyclictest15905-21awk11:53:272
181799944,0cyclictest0-21swapper/112:01:461
181799943,0cyclictest9588-21awk09:28:271
181799943,0cyclictest3556-21lldpd11:13:461
181799943,0cyclictest3556-21lldpd07:40:151
181799943,0cyclictest3556-21lldpd06:53:141
181799943,0cyclictest3241-21irqbalance11:29:191
181799943,0cyclictest3241-21irqbalance09:34:191
181799943,0cyclictest3241-21irqbalance09:13:191
181799943,0cyclictest3241-21irqbalance08:23:301
181799943,0cyclictest3241-21irqbalance07:03:301
181799943,0cyclictest24231-21awk11:38:281
181799943,0cyclictest23620-21awk12:18:271
181799943,0cyclictest23188-21awk08:33:261
181799943,0cyclictest17430-21awk08:53:261
181799943,0cyclictest15483-21awk08:03:251
181799943,0cyclictest1102-21awk10:03:271
181789944,0cyclictest2605-21kworker/0:212:03:300
181789944,0cyclictest2605-21kworker/0:211:53:280
181789944,0cyclictest2605-21kworker/0:211:48:480
181789944,0cyclictest2605-21kworker/0:211:43:560
181789944,0cyclictest2605-21kworker/0:211:38:160
181789944,0cyclictest2605-21kworker/0:211:33:220
181789944,0cyclictest2605-21kworker/0:211:32:180
181789944,0cyclictest2605-21kworker/0:211:18:400
181789944,0cyclictest2605-21kworker/0:210:58:360
181789944,0cyclictest2605-21kworker/0:210:48:300
181789944,0cyclictest2605-21kworker/0:210:43:280
181789944,0cyclictest2605-21kworker/0:210:33:240
181789944,0cyclictest2605-21kworker/0:210:28:260
181789944,0cyclictest2605-21kworker/0:210:15:280
181789944,0cyclictest2605-21kworker/0:209:10:000
181789944,0cyclictest2605-21kworker/0:208:59:580
181789943,0cyclictest3556-21lldpd11:08:450
181789943,0cyclictest3556-21lldpd09:29:160
181789943,0cyclictest3556-21lldpd08:48:160
181789943,0cyclictest2605-21kworker/0:209:54:200
181789943,0cyclictest22255-21awk08:08:250
181789943,0cyclictest16824-21awk10:53:240
181789943,0cyclictest13555-21awk07:13:260
181789943,0cyclictest1177-21awk10:03:280
181789940,0cyclictest0-21swapper/010:38:150
179940,0migration/1862-21fschecks_time07:28:251
179940,0migration/18505-21aten_r1power_cu09:08:221
179940,0migration/131651-21sh11:23:171
179940,0migration/129306-21kthreadcore09:18:291
179940,0migration/127016-21kthreadcore10:18:301
179940,0migration/125197-21fschecks_time09:58:231
179940,0migration/124341-21kthreadcore08:08:271
179940,0migration/123864-21runrttasks10:17:281
179940,0migration/123262-21taskset10:56:561
179940,0migration/122261-21kthreadcore07:18:271
179940,0migration/121138-21proc_pri08:28:331
179940,0migration/11728-21kthreadcore10:23:281
179940,0migration/11728-21kthreadcore10:23:281
179940,0migration/11532-21kthreadcore11:43:281
179940,0migration/11121-21munin-node09:03:261
179940,0migration/110678-21kthreadcore07:33:291
169940,0watchdog/1873-21kthreadcore11:03:291
169940,0watchdog/14260-21kthreadcore07:53:251
169940,0watchdog/131855-21kthreadcore07:48:291
169940,0watchdog/129851-21ssh09:38:291
169940,0watchdog/123699-21aten2.4-expect11:18:211
169940,0watchdog/116791-21fschecks_time10:33:251
169940,0watchdog/115028-21ssh11:12:091
169940,0watchdog/113574-21ssh12:10:561
169940,0watchdog/111446-21kthreadcore07:58:291
169940,0watchdog/10-21swapper/111:48:131
169940,0watchdog/10-21swapper/108:38:291
149940,0migration/05984-21sh11:04:150
149940,0migration/04404-21kthreadcore09:43:280
149940,0migration/028183-21cpuspeed_turbos08:13:230
149940,0migration/021409-21kthreadcore09:33:280
149940,0migration/010106-21kthreadcore10:08:270
339930,0migration/313908-21kthreadcore08:23:293
29715030,0irq/26-eth0-rx-0-21swapper/308:28:223
29715030,0irq/26-eth0-rx-0-21swapper/308:10:213
29715030,0irq/26-eth0-rx-0-21swapper/307:23:233
29715030,0irq/26-eth0-rx-0-21swapper/307:03:223
29715030,0irq/26-eth0-rx-0-21swapper/306:57:533
249930,0watchdog/20-21swapper/206:53:262
181809932,0cyclictest3556-21lldpd08:33:152
181809932,0cyclictest3556-21lldpd08:23:152
181799932,0cyclictest9503-21awk09:48:291
181799932,0cyclictest21207-21awk07:43:251
181799932,0cyclictest1202-21awk09:43:261
181789933,0cyclictest2605-21kworker/0:207:33:230
181789932,0cyclictest3092-21awk08:18:250
169930,0watchdog/12254-21aten_r1power_fr08:18:211
169930,0watchdog/10-21swapper/108:48:291
29715020,0irq/26-eth0-rx-0-21swapper/308:43:273
29715020,0irq/26-eth0-rx-0-21swapper/307:38:153
181799921,0cyclictest25000-21latency_hist06:58:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional