You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 20:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Aug 07, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2715123625,0sleep30-21swapper/306:46:403
2694523624,0sleep00-21swapper/006:44:170
2704723425,0sleep10-21swapper/106:45:301
2701323423,0sleep20-21swapper/206:45:032
35160,0ktimersoftd/30-21swapper/311:53:163
339960,0migration/36544-21munin-node11:37:483
339960,0migration/331072-21fschecks_time08:02:473
339960,0migration/330590-21sh10:09:223
339960,0migration/323538-21sh09:03:043
339960,0migration/316349-21sh09:00:393
339960,0migration/316051-21sh09:41:453
339960,0migration/314175-21switchtime06:57:563
29715060,0irq/26-eth0-rx-9616-21df_inode09:17:443
29715060,0irq/26-eth0-rx-476-21iostat_ios10:12:493
29715060,0irq/26-eth0-rx-0-21swapper/309:07:483
273039960,0cyclictest6662-21iperf08:17:472
273039960,0cyclictest0-21swapper/209:19:072
273019966,0cyclictest0-21swapper/009:32:500
27160,0ktimersoftd/20-21swapper/211:53:162
19160,0ktimersoftd/10-21swapper/111:53:161
149960,0migration/07156-21sh09:55:290
149960,0migration/031810-21sh08:48:050
149960,0migration/022787-21sh09:43:040
149960,0migration/020326-21sh11:24:090
149960,0migration/018868-21idleruntime08:17:460
339950,0migration/39564-21kthreadcore10:37:493
339950,0migration/38092-21runrttasks09:57:363
339950,0migration/37456-21kthreadcore08:07:513
339950,0migration/34327-21missed_timers10:32:513
339950,0migration/330775-21aten_r1power_en10:52:433
339950,0migration/330671-21munin-node08:22:563
339950,0migration/329740-21taskset07:57:573
339950,0migration/327910-21munin-node06:47:453
339950,0migration/327326-21kthreadcore10:27:493
339950,0migration/326690-21kthreadcore09:47:493
339950,0migration/323800-21timerandwakeup08:17:543
339950,0migration/323769-21kthreadcore11:07:503
339950,0migration/323064-21timerandwakeup09:22:563
339950,0migration/322838-21munin-node10:47:433
339950,0migration/322271-21fschecks_count07:07:473
339950,0migration/321393-21runrttasks10:44:133
339950,0migration/319885-21munin-node08:42:453
339950,0migration/317267-21fschecks_time09:42:473
339950,0migration/314095-21runrttasks10:19:223
339950,0migration/312621-21kthreadcore07:47:503
339950,0migration/31229-21kthreadcore11:32:513
29725050,0irq/27-eth0-tx-6878-21open_inodes09:12:542
29725050,0irq/27-eth0-tx-28692-21ssh11:52:012
29725050,0irq/27-eth0-tx-11398-21munin-node08:12:490
29725050,0irq/27-eth0-tx-0-21swapper/211:19:462
29725050,0irq/27-eth0-tx-0-21swapper/008:22:530
29725050,0irq/27-eth0-tx-0-21swapper/008:07:490
29725050,0irq/27-eth0-tx-0-21swapper/007:37:470
29725050,0irq/27-eth0-tx-0-21swapper/007:18:090
29715050,0irq/26-eth0-rx-6969-21irqstats08:32:483
29715050,0irq/26-eth0-rx-31638-21grep07:37:493
29715050,0irq/26-eth0-rx-16478-21diskstats10:02:453
29715050,0irq/26-eth0-rx-0-21swapper/312:07:473
29715050,0irq/26-eth0-rx-0-21swapper/312:02:503
29715050,0irq/26-eth0-rx-0-21swapper/311:49:183
29715050,0irq/26-eth0-rx-0-21swapper/311:27:483
29715050,0irq/26-eth0-rx-0-21swapper/311:16:073
29715050,0irq/26-eth0-rx-0-21swapper/311:02:463
29715050,0irq/26-eth0-rx-0-21swapper/310:57:503
29715050,0irq/26-eth0-rx-0-21swapper/309:35:013
29715050,0irq/26-eth0-rx-0-21swapper/309:30:383
29715050,0irq/26-eth0-rx-0-21swapper/309:13:473
29715050,0irq/26-eth0-rx-0-21swapper/308:52:493
29715050,0irq/26-eth0-rx-0-21swapper/308:49:503
29715050,0irq/26-eth0-rx-0-21swapper/307:42:553
29715050,0irq/26-eth0-rx-0-21swapper/307:42:553
273039955,0cyclictest0-21swapper/211:15:372
273039954,0cyclictest330-21awk10:12:472
273039950,0cyclictest0-21swapper/210:56:522
273039950,0cyclictest0-21swapper/210:01:312
273039950,0cyclictest0-21swapper/208:47:442
273039950,0cyclictest0-21swapper/207:57:552
273029955,0cyclictest0-21swapper/110:06:171
273029950,0cyclictest0-21swapper/112:11:381
273029950,0cyclictest0-21swapper/109:23:341
273029950,0cyclictest0-21swapper/108:22:521
273019954,0cyclictest15665-21kworker/0:107:29:270
249950,0watchdog/222542-21idleruntime11:27:462
179950,0migration/18277-21aten_r1power_vo09:57:431
179950,0migration/15998-21cpuspeed_turbos11:17:441
179950,0migration/125568-21latency_hist08:47:321
179950,0migration/12353-21fschecks_time06:52:461
179950,0migration/116250-21timerwakeupswit07:47:551
179950,0migration/114681-21if_eth011:22:481
179950,0migration/111975-21taskset12:01:001
169950,0watchdog/132107-21ssh09:52:111
169950,0watchdog/127039-21cut11:07:511
149950,0migration/08852-21kthreadcore10:37:490
149950,0migration/08758-21taskset09:17:010
149950,0migration/07329-21kthreadcore11:37:480
149950,0migration/06683-21taskset10:16:000
149950,0migration/0545-21kthreadcore08:27:490
149950,0migration/04718-21munin-node07:42:520
149950,0migration/04718-21munin-node07:42:520
149950,0migration/03984-21kthreadcore08:52:470
149950,0migration/029739-21taskset10:50:240
149950,0migration/028325-21idleruntime06:47:470
149950,0migration/024374-21irqcore10:27:470
149950,0migration/021309-21fschecks_time12:07:460
149950,0migration/021086-21kthreadcore07:52:510
149950,0migration/019026-21kthreadcore09:02:490
149950,0migration/016492-21kthreadcore11:42:490
149950,0migration/016194-21irqcore07:02:490
149950,0migration/014778-21munin-node09:37:570
149950,0migration/012524-21kthreadcore08:57:490
339940,0migration/38205-21runrttasks07:17:513
339940,0migration/329173-21sh07:37:333
339940,0migration/316233-21kthreadcore11:22:493
339940,0migration/314300-21kthreadcore07:22:503
339940,0migration/313080-21kthreadcore08:12:513
339940,0migration/31149-21kthreadcore12:12:493
29725040,0irq/27-eth0-tx-9071-40yum-updatesd-he09:37:492
29725040,0irq/27-eth0-tx-699-21tail09:32:442
29725040,0irq/27-eth0-tx-25471-21diskmemload11:37:422
29725040,0irq/27-eth0-tx-21102-21ssh12:07:452
29725040,0irq/27-eth0-tx-15423-21munin-node10:22:462
29725040,0irq/27-eth0-tx-13756-21munin-node11:22:552
29725040,0irq/27-eth0-tx-0-21swapper/211:11:582
29725040,0irq/27-eth0-tx-0-21swapper/210:37:422
29725040,0irq/27-eth0-tx-0-21swapper/007:47:520
29725040,0irq/27-eth0-tx-0-21swapper/007:22:500
29725040,0irq/27-eth0-tx-0-21swapper/007:12:470
29715040,0irq/26-eth0-rx-6080-21ps11:57:503
29715040,0irq/26-eth0-rx-0-21swapper/311:42:523
29715040,0irq/26-eth0-rx-0-21swapper/311:17:443
29715040,0irq/26-eth0-rx-0-21swapper/310:23:293
29715040,0irq/26-eth0-rx-0-21swapper/309:54:073
29715040,0irq/26-eth0-rx-0-21swapper/307:27:443
273039944,0cyclictest0-21swapper/208:39:322
273039943,0cyclictest8495-21awk10:17:492
273039943,0cyclictest6551-21awk08:32:462
273039943,0cyclictest5724-21awk11:57:492
273039943,0cyclictest3556-21lldpd08:28:092
273039943,0cyclictest3514-21snmpd09:09:162
273039943,0cyclictest3514-21snmpd09:04:162
273039943,0cyclictest3514-21snmpd08:58:012
273039943,0cyclictest3514-21snmpd08:45:162
273039943,0cyclictest3514-21snmpd08:14:162
273039943,0cyclictest3514-21snmpd08:03:312
273039943,0cyclictest3514-21snmpd07:50:162
273039943,0cyclictest3514-21snmpd07:43:162
273039943,0cyclictest3514-21snmpd07:43:162
273039943,0cyclictest3514-21snmpd07:30:312
273039943,0cyclictest3514-21snmpd07:21:312
273039943,0cyclictest3241-21irqbalance10:42:412
273039943,0cyclictest3241-21irqbalance09:52:512
273039943,0cyclictest3241-21irqbalance07:02:522
273039943,0cyclictest3241-21irqbalance06:59:022
273039943,0cyclictest3241-21irqbalance06:55:122
273039943,0cyclictest3241-21irqbalance06:48:222
273039943,0cyclictest32184-21awk10:32:472
273039943,0cyclictest25611-21awk08:22:482
273039943,0cyclictest23746-21awk10:47:472
273039943,0cyclictest15303-21awk11:02:482
273039943,0cyclictest10413-21awk07:22:482
273039940,0cyclictest0-21swapper/209:42:502
273029944,0cyclictest0-21swapper/110:15:161
273029944,0cyclictest0-21swapper/109:43:541
273029943,0cyclictest3514-21snmpd11:13:171
273029943,0cyclictest3514-21snmpd10:52:461
273029943,0cyclictest3514-21snmpd10:24:311
273029943,0cyclictest3514-21snmpd10:10:011
273029943,0cyclictest3514-21snmpd09:22:161
273029943,0cyclictest3514-21snmpd08:59:311
273029943,0cyclictest3514-21snmpd08:19:311
273029943,0cyclictest3514-21snmpd08:03:461
273029943,0cyclictest3514-21snmpd07:59:011
273029943,0cyclictest3514-21snmpd07:27:311
273029943,0cyclictest3514-21snmpd06:51:301
273029943,0cyclictest30677-21awk11:32:491
273029943,0cyclictest23638-21awk10:47:461
273029943,0cyclictest23628-21awk07:32:491
273029943,0cyclictest2054-21awk08:52:451
273029943,0cyclictest1011-21awk09:52:491
273029942,0cyclictest31028-21ntpdc09:07:501
273019944,0cyclictest15665-21kworker/0:109:24:020
273019944,0cyclictest0-21swapper/010:35:440
273019943,0cyclictest3556-21lldpd07:58:090
273019943,0cyclictest3514-21snmpd11:55:020
273019943,0cyclictest3514-21snmpd08:37:460
273019943,0cyclictest3514-21snmpd08:05:310
273019943,0cyclictest3241-21irqbalance10:26:310
273019943,0cyclictest3241-21irqbalance09:28:510
273019943,0cyclictest26391-21awk09:07:450
273019943,0cyclictest24695-21grep10:07:450
273019943,0cyclictest23652-21awk07:32:490
273019943,0cyclictest23106-21awk11:07:480
273019943,0cyclictest22047-21awk11:47:460
273019943,0cyclictest1751-21munin-node06:52:470
273019943,0cyclictest13632-21awk12:02:470
273019940,0cyclictest0-21swapper/011:16:150
259940,0migration/26916-21fschecks_time10:57:462
259940,0migration/231079-21kthreadcore11:32:502
259940,0migration/217227-21aten_r1power_cu09:22:442
259940,0migration/214024-21hddtemp_smartct11:42:462
249940,0watchdog/29241-21cut08:07:512
249940,0watchdog/26880-21sendmail_mailqu08:52:512
249940,0watchdog/231540-21kthreadcore07:12:512
249940,0watchdog/228650-21munin-node12:12:422
249940,0watchdog/226062-21kthreadcore07:32:512
249940,0watchdog/225945-21kthreadcore07:07:522
249940,0watchdog/20-21swapper/210:02:472
249940,0watchdog/20-21swapper/209:47:392
249940,0watchdog/20-21swapper/207:52:472
179940,0migration/18545-21kthreadcore10:57:491
179940,0migration/15717-21kthreadcore07:42:541
179940,0migration/15717-21kthreadcore07:42:541
179940,0migration/132317-21irqcore10:32:481
179940,0migration/130264-21kthreadcore12:12:481
179940,0migration/12826-21munin-node07:17:441
179940,0migration/124058-21kthreadcore11:27:491
179940,0migration/123155-21swap09:02:541
179940,0migration/122347-21irqcore11:47:471
179940,0migration/119677-21mdstat11:02:501
179940,0migration/119669-21diskmemload11:43:451
179940,0migration/119548-21sh12:04:531
179940,0migration/113363-21kthreadcore09:37:511
169940,0watchdog/16689-21iostat08:32:471
169940,0watchdog/13090-21cut09:12:511
169940,0watchdog/123403-21awk10:27:431
169940,0watchdog/117616-21fschecks_time07:52:471
169940,0watchdog/114278-21kthreadcore08:12:511
169940,0watchdog/111269-21unixbench-2d11:37:541
169940,0watchdog/110674-21kthreadcore10:17:511
169940,0watchdog/10-21swapper/108:07:471
169940,0watchdog/10-21swapper/107:12:511
149940,0migration/09914-21kthreadcore08:32:490
149940,0migration/09329-21kthreadcore10:57:500
149940,0migration/05896-21runrttasks10:57:140
149940,0migration/031358-21kthreadcore12:12:480
149940,0migration/022419-21fschecks_time11:27:460
149940,0migration/018332-21kthreadcore10:42:520
149940,0migration/015339-21runrttasks10:01:110
149940,0migration/010347-21irqcore09:17:480
339930,0migration/319645-21kthreadcore07:02:513
29715030,0irq/26-eth0-rx-0-21swapper/308:37:443
29715030,0irq/26-eth0-rx-0-21swapper/308:29:383
29715030,0irq/26-eth0-rx-0-21swapper/307:12:453
29715030,0irq/26-eth0-rx-0-21swapper/306:52:453
273039932,0cyclictest25471-21diskmemload09:27:342
273039930,0cyclictest30333-21if_eth107:37:472
273029933,0cyclictest3556-21lldpd08:47:391
273029932,0cyclictest9463-21awk06:57:491
273029932,0cyclictest8318-21kthreadcore10:37:491
273029932,0cyclictest3556-21lldpd08:37:401
273029932,0cyclictest25973-21awk09:27:491
273029932,0cyclictest17019-21awk07:27:471
273029932,0cyclictest16040-21awk07:02:481
273029932,0cyclictest1568-21kthreadcore08:27:501
273019933,0cyclictest23557-21kworker/0:211:57:420
273019933,0cyclictest23557-21kworker/0:211:17:340
273019933,0cyclictest23557-21kworker/0:211:02:340
273019933,0cyclictest15665-21kworker/0:110:17:380
273019933,0cyclictest15665-21kworker/0:109:47:440
273019933,0cyclictest15665-21kworker/0:108:42:360
273019933,0cyclictest15665-21kworker/0:107:07:370
273019933,0cyclictest15665-21kworker/0:106:57:370
273019932,0cyclictest30628-21awk11:32:490
273019932,0cyclictest16941-21awk10:02:470
249930,0watchdog/20-21swapper/212:02:342
249930,0watchdog/20-21swapper/210:27:432
249930,0watchdog/20-21swapper/210:07:472
169930,0watchdog/10-21swapper/110:42:391
169930,0watchdog/10-21swapper/109:36:511
169930,0watchdog/10-21swapper/107:07:521
29715020,0irq/26-eth0-rx-0-21swapper/307:52:433
273029920,0cyclictest29170-21latency_hist07:37:341
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional