You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 18:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Mon Apr 27, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
584128685,0sleep10-21swapper/106:55:541
304450530,0irq/25-eth10-21swapper/306:54:473
593023625,0sleep00-21swapper/006:56:570
587023425,0sleep20-21swapper/206:56:152
60329999,0cyclictest0-21swapper/008:57:440
60339960,0cyclictest0-21swapper/111:54:201
60339960,0cyclictest0-21swapper/108:17:341
35160,0ktimersoftd/30-21swapper/311:31:593
339960,0migration/33036-21sh10:36:023
339960,0migration/32855-21sh09:54:053
339960,0migration/32697-21sh09:12:433
339960,0migration/32692-21sh10:56:053
339960,0migration/319780-21sh09:24:403
339960,0migration/317794-21sh11:03:143
339960,0migration/312324-21kthreadcore12:02:313
29715060,0irq/26-eth0-rx-9011-21python11:17:383
29715060,0irq/26-eth0-rx-14332-21tr12:22:323
29715060,0irq/26-eth0-rx-12493-21diskstats10:22:293
29715060,0irq/26-eth0-rx-0-21swapper/309:42:293
149960,0migration/05107-21kthreadcore11:17:330
149960,0migration/02143-21sh10:12:490
149960,0migration/019368-21sh09:23:290
60349955,0cyclictest0-21swapper/211:10:552
60349955,0cyclictest0-21swapper/209:46:052
60349950,0cyclictest0-21swapper/212:13:392
60349950,0cyclictest0-21swapper/211:04:172
60349950,0cyclictest0-21swapper/210:52:372
60349950,0cyclictest0-21swapper/210:31:392
60349950,0cyclictest0-21swapper/209:01:092
60349950,0cyclictest0-21swapper/207:22:282
60339955,0cyclictest0-21swapper/111:44:431
60339955,0cyclictest0-21swapper/110:02:051
60339954,0cyclictest27188-21awk07:12:321
60339950,0cyclictest4263-21diskmemload10:02:521
60339950,0cyclictest0-21swapper/112:00:291
60339950,0cyclictest0-21swapper/110:16:261
60339950,0cyclictest0-21swapper/109:33:051
60329954,0cyclictest19933-21tail08:42:340
339950,0migration/37797-21fschecks_count07:22:303
339950,0migration/34949-21kthreadcore08:32:333
339950,0migration/33662-21munin-node07:17:323
339950,0migration/33489-21hwlatdetect11:57:293
339950,0migration/332392-21kthreadcore11:12:333
339950,0migration/328917-21sh09:32:173
339950,0migration/327784-21taskset09:29:363
339950,0migration/327578-21cpuspeed_turbos11:32:283
339950,0migration/325630-21taskset07:07:493
339950,0migration/323896-21munin-node08:47:283
339950,0migration/323704-21kthreadcore09:07:333
339950,0migration/323323-21kthreadcore12:07:323
339950,0migration/322648-21irqcore07:57:323
339950,0migration/321310-21irqcore10:27:333
339950,0migration/319321-21kthreadcore08:42:343
339950,0migration/316114-21unixbench_multi08:37:413
339950,0migration/315591-21fschecks_time07:52:293
339950,0migration/315338-21taskset08:14:053
339950,0migration/313260-21fschecks_time09:02:303
339950,0migration/312174-21munin-node10:42:293
339950,0migration/311117-21aten_r1power_po11:42:263
29725050,0irq/27-eth0-tx-19582-21munin-node07:07:280
29725050,0irq/27-eth0-tx-10185-21munin-node08:37:310
29725050,0irq/27-eth0-tx-0-21swapper/008:12:330
29715050,0irq/26-eth0-rx-9670-21pmu-power10:17:353
29715050,0irq/26-eth0-rx-9013-21kthreadcore10:37:333
29715050,0irq/26-eth0-rx-6845-21kthreadcore09:37:323
29715050,0irq/26-eth0-rx-3193-21runrttasks12:17:283
29715050,0irq/26-eth0-rx-29806-21kthreadcore07:12:343
29715050,0irq/26-eth0-rx-29349-21kthreadcore11:52:313
29715050,0irq/26-eth0-rx-2872-21aten_r1power_cu11:37:263
29715050,0irq/26-eth0-rx-24293-21tr10:07:323
29715050,0irq/26-eth0-rx-23772-21kthreadcore09:47:333
29715050,0irq/26-eth0-rx-17611-21ssh11:23:223
29715050,0irq/26-eth0-rx-0-21swapper/312:12:203
29715050,0irq/26-eth0-rx-0-21swapper/310:06:163
29715050,0irq/26-eth0-rx-0-21swapper/309:59:273
29715050,0irq/26-eth0-rx-0-21swapper/309:21:573
29715050,0irq/26-eth0-rx-0-21swapper/308:57:333
29715050,0irq/26-eth0-rx-0-21swapper/306:57:283
27150,0ktimersoftd/20-21swapper/209:53:112
27150,0ktimersoftd/20-21swapper/207:12:412
259950,0migration/23547-21aten_r1power_po10:57:262
249950,0watchdog/210824-21stty12:02:252
179950,0migration/1620-21timerwakeupswit07:37:381
179950,0migration/11652-21taskset10:53:051
169950,0watchdog/126448-21ls09:47:381
149950,0migration/09590-21kthreadcore07:22:330
149950,0migration/07845-21kthreadcore06:57:320
149950,0migration/06394-21kthreadcore09:37:320
149950,0migration/06109-21kthreadcore09:57:320
149950,0migration/05055-21sh10:17:300
149950,0migration/04759-21if_eth1.210:37:310
149950,0migration/03055-21fschecks_time08:07:300
149950,0migration/029580-21kthreadcore07:37:320
149950,0migration/026690-21unixbench_multi09:47:380
149950,0migration/026346-21kthreadcore07:57:330
149950,0migration/025675-21taskset10:27:370
149950,0migration/025016-21kthreadcore10:07:320
149950,0migration/023612-21aten2.4-expect08:47:270
149950,0migration/02313-21latency_hist12:17:150
149950,0migration/02226-21taskset10:33:450
149950,0migration/022175-21irqrtprio09:27:330
149950,0migration/020781-21kthreadcore11:27:310
149950,0migration/020763-21munin-node10:47:310
149950,0migration/020603-21kthreadcore08:17:340
149950,0migration/018974-21kthreadcore07:52:320
149950,0migration/01710-21taskset11:14:010
149950,0migration/016042-21kthreadcore11:02:320
149950,0migration/015669-21kthreadcore09:42:310
149950,0migration/01455-21taskset11:54:390
149950,0migration/013240-21kthreadcore10:42:330
149950,0migration/012730-21kthreadcore12:02:310
149950,0migration/011805-21hwlatdetect11:42:290
60349944,0cyclictest0-21swapper/210:02:582
60349943,0cyclictest9081-21awk07:47:292
60349943,0cyclictest3556-21lldpd07:34:052
60349943,0cyclictest3514-21snmpd11:38:232
60349943,0cyclictest3514-21snmpd10:37:222
60349943,0cyclictest3514-21snmpd09:38:522
60349943,0cyclictest3514-21snmpd09:33:072
60349943,0cyclictest3514-21snmpd08:48:222
60349943,0cyclictest3514-21snmpd08:32:372
60349943,0cyclictest3514-21snmpd08:17:372
60349943,0cyclictest3514-21snmpd07:27:372
60349943,0cyclictest3241-21irqbalance09:49:342
60349943,0cyclictest3241-21irqbalance07:07:552
60349943,0cyclictest3241-21irqbalance07:02:252
60349943,0cyclictest3241-21irqbalance06:57:352
60349943,0cyclictest31087-21awk08:52:312
60349943,0cyclictest28265-21awk11:32:312
60349943,0cyclictest2394-21awk07:42:322
60349943,0cyclictest15781-21awk07:52:302
60339944,0cyclictest0-21swapper/112:06:381
60339944,0cyclictest0-21swapper/110:40:051
60339944,0cyclictest0-21swapper/110:35:021
60339944,0cyclictest0-21swapper/109:44:261
60339944,0cyclictest0-21swapper/109:07:231
60339943,0cyclictest3556-21lldpd12:11:071
60339943,0cyclictest3556-21lldpd08:57:361
60339943,0cyclictest3556-21lldpd08:44:061
60339943,0cyclictest3556-21lldpd08:35:351
60339943,0cyclictest3556-21lldpd08:02:051
60339943,0cyclictest30134-21awk08:27:321
60339943,0cyclictest28414-21awk11:12:301
60339943,0cyclictest27663-21awk12:12:281
60339943,0cyclictest2466-21awk07:42:321
60339943,0cyclictest21129-21awk10:27:321
60339943,0cyclictest14789-21awk07:27:301
60339943,0cyclictest1452-21awk07:17:301
60339943,0cyclictest12332-21awk11:02:301
60339943,0cyclictest11021-21awk08:37:331
60329943,0cyclictest4464-21awk08:32:320
60329943,0cyclictest3556-21lldpd11:12:070
60329943,0cyclictest3556-21lldpd08:27:350
60329943,0cyclictest3514-21snmpd12:23:530
60329943,0cyclictest3241-21irqbalance11:48:040
60329943,0cyclictest3241-21irqbalance10:06:240
60329943,0cyclictest29068-21awk08:02:310
60329943,0cyclictest28921-21sadc08:27:160
60329943,0cyclictest19634-21awk12:07:290
60329940,0cyclictest0-21swapper/009:35:190
339940,0migration/329947-21kthreadcore08:02:343
339940,0migration/320846-21kthreadcore11:47:323
339940,0migration/315782-21kthreadcore07:27:333
29725040,0irq/27-eth0-tx-30548-21kthreadcore11:52:322
29725040,0irq/27-eth0-tx-25458-21ssh12:09:072
29725040,0irq/27-eth0-tx-2417-21ssh10:13:362
29725040,0irq/27-eth0-tx-19417-21ssh10:47:012
29725040,0irq/27-eth0-tx-10592-21ssh09:57:502
29725040,0irq/27-eth0-tx-10455-21ssh12:02:052
29725040,0irq/27-eth0-tx-0-21swapper/212:20:312
29725040,0irq/27-eth0-tx-0-21swapper/211:27:342
29725040,0irq/27-eth0-tx-0-21swapper/211:12:312
29725040,0irq/27-eth0-tx-0-21swapper/209:12:582
29715040,0irq/26-eth0-rx-0-21swapper/311:07:293
29715040,0irq/26-eth0-rx-0-21swapper/311:00:333
29715040,0irq/26-eth0-rx-0-21swapper/310:49:553
29715040,0irq/26-eth0-rx-0-21swapper/310:13:103
29715040,0irq/26-eth0-rx-0-21swapper/308:52:333
29715040,0irq/26-eth0-rx-0-21swapper/307:42:283
29715040,0irq/26-eth0-rx-0-21swapper/307:02:343
259940,0migration/230322-21kthreadcore07:37:332
259940,0migration/226300-21runrttasks10:48:452
259940,0migration/221364-21munin-node09:27:292
259940,0migration/220902-21aten_r1power_vo09:07:282
259940,0migration/21788-21munin-node07:17:312
259940,0migration/216863-21aten_r1power_cu08:42:282
259940,0migration/214268-21kernelversion09:22:332
259940,0migration/210676-21switchtime09:17:372
249940,0watchdog/2515-21kthreadcore08:27:342
249940,0watchdog/222558-21telnet08:22:262
249940,0watchdog/221338-21if_eth1.310:07:302
249940,0watchdog/219855-21cat11:47:292
249940,0watchdog/21604-21sed10:32:382
249940,0watchdog/212675-21perl10:22:302
249940,0watchdog/210915-21kthreadcore08:12:342
249940,0watchdog/210377-21cpu08:37:302
249940,0watchdog/20-21swapper/211:22:332
249940,0watchdog/20-21swapper/211:17:332
249940,0watchdog/20-21swapper/209:02:342
179940,0migration/19858-21kthreadcore09:17:321
179940,0migration/18550-21kthreadcore10:57:321
179940,0migration/17663-21df_abs07:22:291
179940,0migration/1529-21kthreadcore09:52:341
179940,0migration/14664-21kthreadcore12:17:311
179940,0migration/14483-21fschecks_count10:17:271
179940,0migration/132328-21kthreadcore08:52:331
179940,0migration/12874-21fschecks_count08:07:291
179940,0migration/124775-21kthreadcore07:07:331
179940,0migration/124723-21kthreadcore11:07:331
179940,0migration/124206-21kthreadcore08:22:311
179940,0migration/124021-21kthreadcore09:27:341
179940,0migration/122954-21kthreadcore10:07:311
179940,0migration/121533-21if_eth1.207:32:301
179940,0migration/121163-21kthreadcore10:47:321
179940,0migration/118907-21latency_hist11:47:151
179940,0migration/117187-21kthreadcore07:02:341
179940,0migration/116556-21kthreadcore10:42:341
179940,0migration/11628-21kthreadcore09:12:331
179940,0migration/115422-21fschecks_count07:52:281
179940,0migration/113422-21hwlatdetect09:02:311
179940,0migration/112923-21sh09:22:221
169940,0watchdog/16335-21kthreadcore11:17:331
169940,0watchdog/131684-21grep08:02:341
169940,0watchdog/10-21swapper/111:28:371
169940,0watchdog/10-21swapper/111:22:331
169940,0watchdog/10-21swapper/110:22:341
149940,0migration/07360-21kthreadcore11:37:330
149940,0migration/02587-21idleruntime-cro11:37:150
149940,0migration/02360-21kthreadcore08:52:340
149940,0migration/015487-21kthreadcore09:02:340
8215030,0irq/24-0000:00:0-21swapper/207:57:162
60349932,0cyclictest3514-21snmpd11:42:232
60349932,0cyclictest2545-21cut08:07:282
60349932,0cyclictest10563-21munin-node12:22:282
60339933,0cyclictest3556-21lldpd08:47:361
60339932,0cyclictest9318-21basename08:12:291
60339932,0cyclictest9127-21awk07:47:301
60339932,0cyclictest7156-21if_err_eth1.306:57:301
60339932,0cyclictest3791-21awk11:37:301
60329933,0cyclictest5081-21kworker/0:211:57:180
60329933,0cyclictest5081-21kworker/0:211:22:470
60329933,0cyclictest5081-21kworker/0:210:57:170
60329933,0cyclictest5081-21kworker/0:210:52:170
60329933,0cyclictest5081-21kworker/0:210:22:270
60329933,0cyclictest5004-21kworker/0:209:17:210
60329933,0cyclictest5004-21kworker/0:209:12:170
60329933,0cyclictest5004-21kworker/0:209:07:170
60329933,0cyclictest5004-21kworker/0:207:47:170
60329933,0cyclictest5004-21kworker/0:207:42:170
60329933,0cyclictest5004-21kworker/0:207:32:170
60329933,0cyclictest5004-21kworker/0:207:27:180
60329933,0cyclictest5004-21kworker/0:207:17:180
60329933,0cyclictest5004-21kworker/0:207:12:200
60329933,0cyclictest5004-21kworker/0:207:02:200
60329933,0cyclictest29756-21kworker/0:009:52:250
60329930,0cyclictest0-21swapper/012:12:150
29725030,0irq/27-eth0-tx-0-21swapper/210:17:262
29715030,0irq/26-eth0-rx-0-21swapper/308:28:323
29715030,0irq/26-eth0-rx-0-21swapper/308:17:283
29715030,0irq/26-eth0-rx-0-21swapper/308:09:513
29715030,0irq/26-eth0-rx-0-21swapper/307:47:263
29715030,0irq/26-eth0-rx-0-21swapper/307:32:343
249930,0watchdog/20-21swapper/208:02:342
169930,0watchdog/10-21swapper/112:22:451
169930,0watchdog/10-21swapper/111:32:331
169930,0watchdog/10-21swapper/109:37:301
29715020,0irq/26-eth0-rx-0-21swapper/308:22:343
29715020,0irq/26-eth0-rx-0-21swapper/307:37:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional