You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 11:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Apr 24, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450660,0irq/25-eth10-21swapper/318:56:543
1383624940,0sleep20-21swapper/218:52:392
1984223524,0sleep00-21swapper/018:53:170
2014723324,0sleep10-21swapper/118:56:541
2028699100,0cyclictest0-21swapper/220:57:562
202799981,0cyclictest11244-21aten2.4-expect21:32:460
4160,0ktimersoftd/00-21swapper/021:22:580
35160,0ktimersoftd/30-21swapper/300:09:063
339960,0migration/38792-21sh22:49:363
339960,0migration/332631-21sh00:27:063
339960,0migration/324418-21sh23:19:173
339960,0migration/319395-21idleruntime22:17:493
339960,0migration/316974-21sh23:36:373
339960,0migration/315860-21sh00:14:563
29715060,0irq/26-eth0-rx-21818-21diskstats19:22:493
29715060,0irq/26-eth0-rx-0-21swapper/322:35:553
202869960,0cyclictest18447-21diskmemload23:05:262
202869960,0cyclictest0-21swapper/223:20:342
202799960,0cyclictest0-21swapper/022:33:380
202799960,0cyclictest0-21swapper/021:21:440
19160,0ktimersoftd/10-21swapper/121:22:581
8215050,0irq/24-0000:00:8104-21cat19:12:362
8215050,0irq/24-0000:00:11050-21cat21:32:362
4150,0ktimersoftd/00-21swapper/000:13:420
339950,0migration/39661-21kthreadcore20:47:533
339950,0migration/36365-21kthreadcore19:32:523
339950,0migration/33708-21taskset20:18:063
339950,0migration/33205-21latency_hist19:57:363
339950,0migration/331512-21kthreadcore22:02:553
339950,0migration/329379-21munin-node19:27:523
339950,0migration/323104-21unixbench_multi00:17:583
339950,0migration/320912-21kthreadcore22:37:503
339950,0migration/318954-21aten_r1power_fr21:57:473
339950,0migration/318911-21runrttasks23:37:513
339950,0migration/318588-21if_eth020:32:513
339950,0migration/312401-21kthreadcore21:52:513
339950,0migration/310697-21aten_r1power_fr22:12:473
29725050,0irq/27-eth0-tx-9372-21munin-node23:52:582
29725050,0irq/27-eth0-tx-8926-21munin-node21:47:592
29725050,0irq/27-eth0-tx-25629-21ssh21:59:442
29725050,0irq/27-eth0-tx-19900-21kthreadcore22:17:522
29725050,0irq/27-eth0-tx-17598-21munin-node23:37:582
29725050,0irq/27-eth0-tx-10914-21munin-node21:52:542
29725050,0irq/27-eth0-tx-0-21swapper/223:30:382
29725050,0irq/27-eth0-tx-0-21swapper/223:07:382
29725050,0irq/27-eth0-tx-0-21swapper/222:47:562
29725050,0irq/27-eth0-tx-0-21swapper/222:08:002
29725050,0irq/27-eth0-tx-0-21swapper/221:13:562
29725050,0irq/27-eth0-tx-0-21swapper/221:04:322
29715050,0irq/26-eth0-rx-8433-21nfs4_client21:47:543
29715050,0irq/26-eth0-rx-3542-21lldpd22:23:373
29715050,0irq/26-eth0-rx-31608-21grep20:42:483
29715050,0irq/26-eth0-rx-27249-21if_err_eth122:42:503
29715050,0irq/26-eth0-rx-21989-21grep20:57:533
29715050,0irq/26-eth0-rx-2053-21perl23:27:473
29715050,0irq/26-eth0-rx-13171-21grep23:12:533
29715050,0irq/26-eth0-rx-0-21swapper/323:57:483
29715050,0irq/26-eth0-rx-0-21swapper/323:52:583
29715050,0irq/26-eth0-rx-0-21swapper/323:48:243
29715050,0irq/26-eth0-rx-0-21swapper/323:46:133
29715050,0irq/26-eth0-rx-0-21swapper/322:27:523
29715050,0irq/26-eth0-rx-0-21swapper/322:09:373
29715050,0irq/26-eth0-rx-0-21swapper/321:30:043
29715050,0irq/26-eth0-rx-0-21swapper/321:24:233
29715050,0irq/26-eth0-rx-0-21swapper/321:13:003
29715050,0irq/26-eth0-rx-0-21swapper/321:03:023
29715050,0irq/26-eth0-rx-0-21swapper/320:37:583
29715050,0irq/26-eth0-rx-0-21swapper/320:12:533
29715050,0irq/26-eth0-rx-0-21swapper/319:39:393
29715050,0irq/26-eth0-rx-0-21swapper/318:57:523
27150,0ktimersoftd/20-21swapper/221:42:402
27150,0ktimersoftd/20-21swapper/221:42:402
27150,0ktimersoftd/20-21swapper/221:32:232
27150,0ktimersoftd/20-21swapper/221:22:582
259950,0migration/29750-21latency_hist23:12:352
259950,0migration/29530-21fschecks_count00:12:482
259950,0migration/26736-21latency19:07:512
259950,0migration/23632-21munin-node21:07:502
259950,0migration/225611-21cpuspeed_turbos00:02:452
259950,0migration/224974-21kthreadcore19:47:522
259950,0migration/224110-21idleruntime-cro20:37:362
259950,0migration/222457-21switchtime20:07:582
259950,0migration/222210-21idleruntime-cro19:47:362
259950,0migration/215128-21kthreadcore20:52:532
249950,0watchdog/21428-21wc19:27:582
202869955,0cyclictest0-21swapper/200:18:452
202869950,0cyclictest0-21swapper/222:55:302
202819955,0cyclictest0-21swapper/123:45:421
202819955,0cyclictest0-21swapper/123:03:181
202819950,0cyclictest0-21swapper/123:08:391
202819950,0cyclictest0-21swapper/121:44:281
202819950,0cyclictest0-21swapper/121:44:281
202799955,0cyclictest41ktimersoftd/021:28:500
202799955,0cyclictest0-21swapper/000:00:490
202799954,0cyclictest8378-21ssh22:48:270
202799954,0cyclictest1954-21awk00:07:500
202799954,0cyclictest0-21swapper/023:13:320
202799951,0cyclictest28098-21munin-node19:27:560
202799950,0cyclictest41ktimersoftd/023:22:400
202799950,0cyclictest0-21swapper/022:58:230
202799950,0cyclictest0-21swapper/021:43:490
202799950,0cyclictest0-21swapper/021:43:490
202799950,0cyclictest0-21swapper/021:42:140
19150,0ktimersoftd/10-21swapper/122:19:561
179950,0migration/18709-21sh22:49:211
179950,0migration/16638-21munin-node00:07:561
179950,0migration/14658-21kthreadcore22:27:521
179950,0migration/13517-21fschecks_time21:47:481
179950,0migration/132266-21sh00:05:121
179950,0migration/12968-21taskset19:56:151
179950,0migration/127137-21taskset19:02:441
179950,0migration/116922-21irqcore19:42:521
179950,0migration/116601-21munin-node21:32:541
179950,0migration/112366-21kthreadcore22:12:521
179950,0migration/110613-21fschecks_count22:52:481
169950,0watchdog/114890-21kthreadcore21:12:541
8215040,0irq/24-0000:00:29997-21cat20:17:362
339940,0migration/34915-21fschecks_time20:22:493
339940,0migration/331671-21kthreadcore19:02:533
339940,0migration/322197-21ntp_offset20:07:563
339940,0migration/321148-21taskset19:22:153
339940,0migration/316229-21taskset20:04:263
339940,0migration/315457-21kthreadcore21:32:533
339940,0migration/312277-21cpuspeed_turbos20:52:483
29725040,0irq/27-eth0-tx-23744-21ssh23:58:392
29725040,0irq/27-eth0-tx-18059-21ssh22:57:392
29725040,0irq/27-eth0-tx-0-21swapper/223:47:372
29725040,0irq/27-eth0-tx-0-21swapper/223:43:282
29725040,0irq/27-eth0-tx-0-21swapper/223:32:472
29725040,0irq/27-eth0-tx-0-21swapper/223:22:552
29725040,0irq/27-eth0-tx-0-21swapper/222:22:372
29725040,0irq/27-eth0-tx-0-21swapper/222:15:502
29725040,0irq/27-eth0-tx-0-21swapper/222:02:552
29725040,0irq/27-eth0-tx-0-21swapper/200:08:022
29715040,0irq/26-eth0-rx-22358-21kthreadcore21:17:553
29715040,0irq/26-eth0-rx-0-21swapper/323:22:413
29715040,0irq/26-eth0-rx-0-21swapper/323:07:513
29715040,0irq/26-eth0-rx-0-21swapper/323:02:503
29715040,0irq/26-eth0-rx-0-21swapper/322:57:383
29715040,0irq/26-eth0-rx-0-21swapper/322:53:083
29715040,0irq/26-eth0-rx-0-21swapper/321:42:503
29715040,0irq/26-eth0-rx-0-21swapper/321:42:503
29715040,0irq/26-eth0-rx-0-21swapper/321:38:003
29715040,0irq/26-eth0-rx-0-21swapper/321:07:463
29715040,0irq/26-eth0-rx-0-21swapper/300:02:353
259940,0migration/28938-21pmu-power19:57:562
259940,0migration/24191-21kthreadcore22:27:522
259940,0migration/222373-21if_eth1.219:22:512
259940,0migration/219208-21aten_r1power_fr21:17:482
259940,0migration/21588-21kthreadcore20:42:522
259940,0migration/211566-21irqrtprio22:32:532
259940,0migration/210376-21kernelversion19:37:522
249940,0watchdog/229517-21kthreadcore22:42:532
249940,0watchdog/20-21swapper/221:37:542
249940,0watchdog/20-21swapper/200:22:492
202869943,0cyclictest3556-21lldpd22:37:372
202869943,0cyclictest3556-21lldpd20:29:082
202869943,0cyclictest3556-21lldpd19:04:362
202869943,0cyclictest3269-21awk19:32:502
202869943,0cyclictest15630-21awk19:17:492
202869943,0cyclictest10942-21awk20:02:502
202869942,0cyclictest24282-21awk20:12:512
202819943,0cyclictest3958-21awk21:27:511
202819943,0cyclictest3558-21awk21:07:501
202819943,0cyclictest3556-21lldpd23:39:091
202819943,0cyclictest3556-21lldpd23:27:381
202819943,0cyclictest3514-21snmpd23:20:471
202819943,0cyclictest3241-21irqbalance23:48:231
202819943,0cyclictest3241-21irqbalance20:57:441
202819943,0cyclictest3241-21irqbalance20:17:541
202819943,0cyclictest27868-21sadc19:27:361
202819943,0cyclictest27263-21awk22:42:501
202819943,0cyclictest17551-21sadc23:17:351
202819943,0cyclictest16259-21grep22:33:001
202819943,0cyclictest10368-21awk23:52:501
202799943,0cyclictest3556-21lldpd23:32:390
202799943,0cyclictest3556-21lldpd00:02:390
202799943,0cyclictest25251-21awk20:37:500
202799942,0cyclictest9652-21memory20:22:540
202799942,0cyclictest9499-21forks19:37:480
202799942,0cyclictest8461-21munin-node19:12:480
202799942,0cyclictest6737-21memory23:47:540
202799942,0cyclictest5702-21diskstats20:47:480
202799942,0cyclictest4142-21hddtemp_smartct19:57:500
202799942,0cyclictest3514-21snmpd20:12:360
202799942,0cyclictest3389-21iostat19:32:500
202799942,0cyclictest3181-21df_inode21:47:470
202799942,0cyclictest31772-21gltestperf20:42:490
202799942,0cyclictest30179-21aten2.4-expect20:17:470
202799942,0cyclictest27839-21perl19:02:490
202799942,0cyclictest27503-21perl21:02:490
202799942,0cyclictest27470-21if_err_eth1.222:22:510
202799942,0cyclictest2730-21basename21:07:460
202799942,0cyclictest26946-21sh22:42:490
202799942,0cyclictest26870-21sh22:02:410
202799942,0cyclictest26785-21grep23:02:480
202799942,0cyclictest25857-21which00:22:510
202799942,0cyclictest25820-21aten2.4-expect23:42:460
202799942,0cyclictest2569-21munin-node23:07:480
202799942,0cyclictest25567-21sh22:40:590
202799942,0cyclictest2438-21ssh22:07:390
202799942,0cyclictest22454-21aten2.4-expect19:47:460
202799942,0cyclictest2174-21ssh22:27:450
202799942,0cyclictest21511-21aten2.4-expect19:22:470
202799942,0cyclictest21486-21iostat18:57:510
202799942,0cyclictest19281-21df_inode21:57:480
202799942,0cyclictest19087-21diskstats20:57:480
202799942,0cyclictest18662-21aten2.4-expect22:17:460
202799942,0cyclictest18527-21tune2fs23:17:490
202799942,0cyclictest1800-21df23:27:460
202799942,0cyclictest17713-21perl00:17:480
202799942,0cyclictest17661-21sh23:37:460
202799942,0cyclictest17068-21df20:07:490
202799942,0cyclictest16166-21diskstats19:42:490
202799942,0cyclictest1519-21cpu19:07:450
202799942,0cyclictest15159-21diskstats19:17:480
202799942,0cyclictest12359-21df20:52:480
202799942,0cyclictest11244-21df21:52:470
202799942,0cyclictest11112-21iostat_ios22:52:500
202799942,0cyclictest10859-21sh21:12:370
202799942,0cyclictest10655-21aten2.4-expect22:12:470
202799942,0cyclictest10415-21df20:02:480
202799942,0cyclictest10057-21perl23:52:480
202799941,0cyclictest29095-21munin-node19:52:550
202799941,0cyclictest18080-21diskstats20:32:490
202799941,0cyclictest0-21swapper/020:27:480
19140,0ktimersoftd/10-21swapper/100:13:421
179940,0migration/19350-21kthreadcore20:47:531
179940,0migration/16210-21kthreadcore20:22:521
179940,0migration/1539-21kthreadcore20:42:521
179940,0migration/13830-21kthreadcore19:32:511
179940,0migration/129067-21kthreadcore22:02:551
179940,0migration/126486-21kthreadcore20:37:521
179940,0migration/125384-21kthreadcore20:12:531
179940,0migration/124999-21taskset23:00:011
179940,0migration/123648-21kthreadcore21:57:531
179940,0migration/120707-21kthreadcore21:17:541
179940,0migration/120290-21kthreadcore20:07:531
179940,0migration/119046-21kthreadcore20:32:521
179940,0migration/116344-21kthreadcore19:17:511
179940,0migration/114131-21kthreadcore20:27:521
169940,0watchdog/17725-21cut22:07:541
169940,0watchdog/130939-21grep22:22:531
169940,0watchdog/128385-21sed19:47:581
169940,0watchdog/121014-21kthreadcore21:37:541
169940,0watchdog/11752-21diskstats19:07:461
169940,0watchdog/11426-21cat19:27:581
169940,0watchdog/10-21swapper/123:57:451
169940,0watchdog/10-21swapper/120:02:541
169940,0watchdog/10-21swapper/100:22:531
339930,0migration/325028-21kthreadcore19:47:523
29715030,0irq/26-eth0-rx-0-21swapper/320:27:463
29715030,0irq/26-eth0-rx-0-21swapper/319:57:473
29715030,0irq/26-eth0-rx-0-21swapper/319:44:453
29715030,0irq/26-eth0-rx-0-21swapper/319:12:503
29715030,0irq/26-eth0-rx-0-21swapper/319:07:493
249930,0watchdog/20-21swapper/220:37:462
202869932,0cyclictest5180-21awk20:22:502
202869932,0cyclictest29962-21awk19:52:502
202869932,0cyclictest20491-21munin-node18:57:482
202819932,0cyclictest9113-21awk19:12:511
202819932,0cyclictest3556-21lldpd23:22:381
202819932,0cyclictest3514-21snmpd20:52:471
202819932,0cyclictest17935-21awk00:17:501
202819932,0cyclictest15330-21sensors23:32:541
179930,0migration/17001-21kthreadcore19:57:531
179930,0migration/126864-21aten_r1power_en21:02:471
169930,0watchdog/10-21swapper/122:37:491
169930,0watchdog/10-21swapper/121:52:541
169930,0watchdog/10-21swapper/119:38:101
169930,0watchdog/10-21swapper/118:57:541
249920,0watchdog/20-21swapper/220:47:382
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional