You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 17:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Mon May 04, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450410,0irq/25-eth10-21swapper/306:51:533
562123626,0sleep20-21swapper/206:52:262
594723430,0sleep00-21swapper/006:56:130
586822824,0sleep10-21swapper/106:55:181
60549966,0cyclictest4228-21diskmemload11:43:482
60549965,0cyclictest30506-21tr11:31:532
60549960,0cyclictest0-21swapper/210:14:152
60549960,0cyclictest0-21swapper/208:58:252
60499965,0cyclictest13908-21ps09:01:530
339960,0migration/36768-21taskset06:56:503
339960,0migration/318835-21sh10:22:373
339960,0migration/31671-21sh11:33:363
29715060,0irq/26-eth0-rx-18192-21ssh11:44:573
60549955,0cyclictest0-21swapper/212:01:562
60549954,0cyclictest22828-21tr07:56:532
60549954,0cyclictest20588-21crond09:06:362
60549954,0cyclictest2009-21crond12:16:352
60549950,0cyclictest0-21swapper/212:21:382
60549950,0cyclictest0-21swapper/207:42:072
60519955,0cyclictest0-21swapper/107:31:571
60499955,0cyclictest0-21swapper/009:16:480
60499950,0cyclictest0-21swapper/009:51:580
4150,0ktimersoftd/00-21swapper/009:28:460
4150,0ktimersoftd/00-21swapper/007:16:390
339950,0migration/38826-21fschecks_time07:46:503
339950,0migration/36966-21kthreadcore11:36:543
339950,0migration/36241-21kthreadcore12:16:533
339950,0migration/35114-21kthreadcore07:41:523
339950,0migration/34975-21fschecks_time10:16:483
339950,0migration/33856-21taskset08:52:293
339950,0migration/331061-21kthreadcore07:36:533
339950,0migration/330828-21kthreadcore11:51:523
339950,0migration/327275-21fschecks_time12:11:493
339950,0migration/326413-21kthreadcore08:21:533
339950,0migration/325865-21diskmemload10:26:543
339950,0migration/325341-21kthreadcore07:56:543
339950,0migration/321454-21kthreadcore07:06:533
339950,0migration/320868-21kthreadcore11:26:503
339950,0migration/31976-21taskset10:52:393
339950,0migration/319068-21switchtime09:22:003
339950,0migration/316708-21kthreadcore11:01:543
339950,0migration/313972-21if_eth009:41:513
339950,0migration/313404-21kthreadcore11:21:533
339950,0migration/312837-21munin-node10:01:473
339950,0migration/311582-21taskset09:38:103
29725050,0irq/27-eth0-tx-4387-21munin-node10:16:462
29725050,0irq/27-eth0-tx-28746-21ssh09:11:282
29725050,0irq/27-eth0-tx-2461-21telnet08:06:480
29725050,0irq/27-eth0-tx-22036-21kthreadcore11:06:522
29725050,0irq/27-eth0-tx-19696-21if_eth1.212:06:502
29725050,0irq/27-eth0-tx-10323-21sendmail_mailqu08:56:580
29725050,0irq/27-eth0-tx-0-21swapper/210:39:122
29725050,0irq/27-eth0-tx-0-21swapper/209:40:202
29725050,0irq/27-eth0-tx-0-21swapper/209:33:142
29725050,0irq/27-eth0-tx-0-21swapper/209:21:302
29715050,0irq/26-eth0-rx-6559-21runrttasks11:16:473
29715050,0irq/26-eth0-rx-5774-21interrupts09:56:523
29715050,0irq/26-eth0-rx-3482-21ssh10:35:413
29715050,0irq/26-eth0-rx-29830-21sort09:31:493
29715050,0irq/26-eth0-rx-2931-21cpuspeed_turbos11:56:473
29715050,0irq/26-eth0-rx-27090-21munin-node09:26:573
29715050,0irq/26-eth0-rx-26438-21open_files09:06:563
29715050,0irq/26-eth0-rx-20013-21irqstats12:06:513
29715050,0irq/26-eth0-rx-1756-21ssh11:12:553
29715050,0irq/26-eth0-rx-12841-21gltestperf10:41:503
29715050,0irq/26-eth0-rx-0-21swapper/312:03:193
29715050,0irq/26-eth0-rx-0-21swapper/311:50:523
29715050,0irq/26-eth0-rx-0-21swapper/311:08:463
29715050,0irq/26-eth0-rx-0-21swapper/310:58:163
29715050,0irq/26-eth0-rx-0-21swapper/310:11:523
29715050,0irq/26-eth0-rx-0-21swapper/309:46:533
29715050,0irq/26-eth0-rx-0-21swapper/309:06:053
29715050,0irq/26-eth0-rx-0-21swapper/308:59:463
29715050,0irq/26-eth0-rx-0-21swapper/308:46:523
27150,0ktimersoftd/20-21swapper/207:16:392
259950,0migration/24701-21latency_hist09:16:362
259950,0migration/232709-21latency_hist07:16:372
259950,0migration/229267-21hwlatdetect10:31:512
259950,0migration/22595-21latency_hist11:56:352
259950,0migration/22244-21taskset12:16:382
259950,0migration/210731-21taskset11:20:292
249950,0watchdog/24228-21diskmemload10:56:502
19150,0ktimersoftd/10-21swapper/112:06:361
19150,0ktimersoftd/10-21swapper/109:28:461
19150,0ktimersoftd/10-21swapper/107:16:391
179950,0migration/16133-21kthreadcore08:06:541
179950,0migration/15820-21kthreadcore11:56:521
179950,0migration/131849-21kthreadcore09:51:531
179950,0migration/131324-21kthreadcore09:11:531
179950,0migration/127611-21kthreadcore08:21:531
179950,0migration/126466-21munin-node09:06:571
179950,0migration/120289-21taskset10:05:591
179950,0migration/120099-21fschecks_count11:06:481
179950,0migration/120015-21taskset09:44:191
179950,0migration/114222-21if_eth1.309:21:521
169950,0watchdog/12815-21kthreadcore08:51:541
169950,0watchdog/115855-21aten_r1power_cu08:16:471
149950,0migration/019445-21sh09:22:110
149950,0migration/016509-21kthreadcore09:41:530
60549944,0cyclictest0-21swapper/209:41:462
60549943,0cyclictest4427-21awk08:31:532
60549943,0cyclictest3514-21snmpd07:31:492
60549943,0cyclictest29146-21awk08:01:522
60549943,0cyclictest16774-21awk08:16:512
60549943,0cyclictest0-21swapper/211:01:482
60519943,0cyclictest5093-21awk10:36:511
60519943,0cyclictest4564-21awk10:56:501
60519943,0cyclictest3514-21snmpd12:23:521
60519943,0cyclictest3514-21snmpd10:47:211
60519943,0cyclictest3514-21snmpd07:46:491
60519943,0cyclictest3367-21sadc10:56:351
60519943,0cyclictest27918-21awk11:51:491
60519943,0cyclictest13651-21sadc07:26:371
60499944,0cyclictest0-21swapper/012:11:010
60499943,0cyclictest4579-21awk10:56:500
60499943,0cyclictest3556-21lldpd11:23:360
60499943,0cyclictest3556-21lldpd10:33:350
60499943,0cyclictest3514-21snmpd10:14:350
60499943,0cyclictest3514-21snmpd10:09:050
60499943,0cyclictest3514-21snmpd10:01:500
60499943,0cyclictest3514-21snmpd08:29:340
60499943,0cyclictest3447-21munin-node08:31:510
60499943,0cyclictest3241-21irqbalance12:22:540
60499943,0cyclictest3241-21irqbalance12:17:540
60499943,0cyclictest3241-21irqbalance12:14:240
60499943,0cyclictest3241-21irqbalance12:05:140
60499943,0cyclictest3241-21irqbalance11:47:040
60499943,0cyclictest3241-21irqbalance11:41:440
60499943,0cyclictest3241-21irqbalance11:37:240
60499943,0cyclictest3241-21irqbalance10:52:040
60499943,0cyclictest28146-21awk07:36:510
60499943,0cyclictest21362-21awk10:26:510
60499943,0cyclictest14886-21munin-node07:51:490
60499943,0cyclictest14886-21munin-node07:51:490
60499943,0cyclictest12589-21awk11:01:510
60499943,0cyclictest0-21swapper/009:09:050
60499940,0cyclictest7250-21munin-node07:21:490
339940,0migration/32783-21kthreadcore07:16:533
339940,0migration/316460-21fschecks_time08:16:493
339940,0migration/316091-21kthreadcore07:26:533
29725040,0irq/27-eth0-tx-8348-21aten2.4-expect07:46:480
29725040,0irq/27-eth0-tx-18082-21ssh11:23:342
29725040,0irq/27-eth0-tx-0-21swapper/211:46:502
29725040,0irq/27-eth0-tx-0-21swapper/210:41:472
29725040,0irq/27-eth0-tx-0-21swapper/210:26:372
29725040,0irq/27-eth0-tx-0-21swapper/210:21:392
29725040,0irq/27-eth0-tx-0-21swapper/210:04:342
29725040,0irq/27-eth0-tx-0-21swapper/209:52:272
29725040,0irq/27-eth0-tx-0-21swapper/209:26:422
29725040,0irq/27-eth0-tx-0-21swapper/209:21:472
29725040,0irq/27-eth0-tx-0-21swapper/008:51:480
29725040,0irq/27-eth0-tx-0-21swapper/008:21:490
29725040,0irq/27-eth0-tx-0-21swapper/007:31:540
29725040,0irq/27-eth0-tx-0-21swapper/007:26:510
29725040,0irq/27-eth0-tx-0-21swapper/007:11:470
29715040,0irq/26-eth0-rx-5595-21kthreadcore10:36:523
29715040,0irq/26-eth0-rx-0-21swapper/312:21:453
29715040,0irq/26-eth0-rx-0-21swapper/310:46:363
29715040,0irq/26-eth0-rx-0-21swapper/310:06:593
29715040,0irq/26-eth0-rx-0-21swapper/309:53:193
29715040,0irq/26-eth0-rx-0-21swapper/309:16:473
29715040,0irq/26-eth0-rx-0-21swapper/309:11:523
29715040,0irq/26-eth0-rx-0-21swapper/308:31:543
29715040,0irq/26-eth0-rx-0-21swapper/308:26:483
29715040,0irq/26-eth0-rx-0-21swapper/308:11:533
29715040,0irq/26-eth0-rx-0-21swapper/308:06:483
29715040,0irq/26-eth0-rx-0-21swapper/307:15:013
27140,0ktimersoftd/20-21swapper/207:47:382
259940,0migration/29959-21sh08:11:492
259940,0migration/25207-21fschecks_count09:56:492
259940,0migration/230363-21irqrtprio08:26:532
259940,0migration/227839-21fschecks_time07:36:492
259940,0migration/227290-21cpuspeed_turbos11:51:472
259940,0migration/222785-21kthreadcore09:46:532
259940,0migration/222706-21kthreadcore10:46:532
259940,0migration/220656-21latency_hist10:06:362
259940,0migration/219949-21df_abs07:06:492
259940,0migration/215675-21kthreadcore07:01:532
259940,0migration/215276-21kthreadcore07:26:532
259940,0migration/210961-21kthreadcore06:56:542
249940,0watchdog/23129-21perl08:06:512
249940,0watchdog/229357-21kthreadcore10:51:542
249940,0watchdog/22814-21kthreadcore08:51:542
249940,0watchdog/20-21swapper/211:36:542
249940,0watchdog/20-21swapper/211:26:462
249940,0watchdog/20-21swapper/211:11:582
249940,0watchdog/20-21swapper/208:36:502
19140,0ktimersoftd/10-21swapper/107:07:071
179940,0migration/17896-21runrttasks07:45:591
179940,0migration/16744-21kthreadcore12:16:531
179940,0migration/15116-21fschecks_time08:56:501
179940,0migration/1445-21runrttasks12:12:111
179940,0migration/132438-21kthreadcore09:31:531
179940,0migration/132332-21taskset07:13:001
179940,0migration/12537-21taskset11:36:081
179940,0migration/120463-21sh10:26:441
179940,0migration/119862-21idleruntime11:46:481
179940,0migration/119133-21sshd07:03:591
179940,0migration/11736-21sh11:12:521
179940,0migration/115924-21kthreadcore07:26:531
179940,0migration/114306-21kthreadcore08:36:511
179940,0migration/114075-21kthreadcore11:41:521
179940,0migration/113168-21gltestperf10:21:491
179940,0migration/111451-21runrttasks10:19:291
179940,0migration/111343-21taskset09:58:061
179940,0migration/111091-21taskset11:21:321
169940,0watchdog/15550-21fschecks_count09:36:501
169940,0watchdog/132412-21cut08:26:541
169940,0watchdog/132154-21kthreadcore10:31:541
169940,0watchdog/126802-21latency07:56:551
169940,0watchdog/119599-21cpu11:26:461
169940,0watchdog/118700-21ssh10:43:301
169940,0watchdog/10-21swapper/112:01:541
169940,0watchdog/10-21swapper/111:36:541
169940,0watchdog/10-21swapper/111:21:541
169940,0watchdog/10-21swapper/111:01:541
169940,0watchdog/10-21swapper/110:13:061
169940,0watchdog/10-21swapper/110:06:541
169940,0watchdog/10-21swapper/109:46:541
169940,0watchdog/10-21swapper/109:01:381
169940,0watchdog/10-21swapper/108:31:541
149940,0migration/09946-21needreboot10:16:540
149940,0migration/07071-21hwlatdetect06:56:510
149940,0migration/06434-21kthreadcore07:41:530
149940,0migration/06003-21kthreadcore11:56:530
149940,0migration/04694-21fschecks_time10:36:490
149940,0migration/023862-21kthreadcore07:56:540
149940,0migration/023442-21kthreadcore10:46:530
149940,0migration/023380-21latency_hist08:46:360
149940,0migration/023289-21kthreadcore11:06:530
149940,0migration/019795-21kthreadcore08:16:530
149940,0migration/019601-21taskset07:06:460
149940,0migration/018136-21proc_pri10:21:560
149940,0migration/017299-21kthreadcore10:41:540
149940,0migration/013495-21kthreadcore08:11:530
149940,0migration/01228-21runrttasks08:01:560
149940,0migration/011614-21taskset09:58:530
149940,0migration/011098-21munin-node08:36:490
60549933,0cyclictest0-21swapper/208:25:002
60549932,0cyclictest3514-21snmpd07:21:492
60549932,0cyclictest24386-21awk08:46:512
60549932,0cyclictest15768-21awk07:51:512
60549932,0cyclictest15768-21awk07:51:512
60519933,0cyclictest7132-21awk06:56:511
60519932,0cyclictest32735-21awk07:36:561
60519932,0cyclictest28216-21munin-node08:01:551
60519930,0cyclictest0-21swapper/109:16:491
60499932,0cyclictest3675-21tr11:16:480
60499932,0cyclictest3556-21lldpd11:12:050
60499932,0cyclictest3514-21snmpd09:36:500
60499932,0cyclictest2966-21grep09:31:590
60499932,0cyclictest28023-21awk11:51:500
60499932,0cyclictest21765-21tune2fs09:46:490
60499932,0cyclictest21534-21grep11:26:510
60499932,0cyclictest13552-21perl07:01:500
60499931,0cyclictest0-21swapper/011:31:530
339930,0migration/38199-21if_eth1.207:21:523
29715030,0irq/26-eth0-rx-0-21swapper/308:41:523
29715030,0irq/26-eth0-rx-0-21swapper/308:39:243
29715030,0irq/26-eth0-rx-0-21swapper/307:51:473
29715030,0irq/26-eth0-rx-0-21swapper/307:51:473
29715030,0irq/26-eth0-rx-0-21swapper/307:31:483
29715030,0irq/26-eth0-rx-0-21swapper/307:04:003
249930,0watchdog/20-21swapper/208:41:462
179930,0migration/117707-21kthreadcore07:51:541
179930,0migration/117707-21kthreadcore07:51:541
169930,0watchdog/10-21swapper/108:43:021
169930,0watchdog/10-21swapper/108:11:591
60499921,0cyclictest28951-21latency_hist09:11:360
60499921,0cyclictest16896-21aten_r1power_fr08:41:460
29715020,0irq/26-eth0-rx-0-21swapper/308:01:383
169920,0watchdog/10-21swapper/108:46:381
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional