You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 15:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed Jan 07, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450640,0irq/25-eth10-21swapper/307:07:153
2253923526,0sleep20-21swapper/207:07:322
2249423424,0sleep10-21swapper/107:06:591
2226023423,0sleep00-21swapper/007:04:180
226229980,0cyclictest0-21swapper/208:18:042
226229975,0cyclictest0-21swapper/212:21:582
339960,0migration/37372-21switchtime10:12:593
339960,0migration/37372-21switchtime10:12:593
339960,0migration/330041-21sh11:47:193
339960,0migration/324982-21sh10:24:443
339960,0migration/320067-21munin-node09:23:003
339960,0migration/315398-21sh12:35:043
339960,0migration/314140-21munin-node11:37:473
339960,0migration/314116-21sh12:14:193
29715060,0irq/26-eth0-rx-5481-21iostat_ios11:12:513
29715060,0irq/26-eth0-rx-32603-21cut09:12:563
29715060,0irq/26-eth0-rx-12525-21unixbench_multi11:53:003
226229961,0cyclictest0-21swapper/208:32:492
226229960,0cyclictest0-21swapper/212:34:542
226189966,0cyclictest29086-21timerwakeupswit12:03:001
226189960,0cyclictest0-21swapper/111:28:191
226189960,0cyclictest0-21swapper/111:10:491
226189960,0cyclictest0-21swapper/110:01:171
226179965,0cyclictest17579-21ssh10:39:340
226179960,0cyclictest0-21swapper/010:44:460
226179960,0cyclictest0-21swapper/009:07:480
19160,0ktimersoftd/10-21swapper/111:22:101
149960,0migration/05732-21kthreadcore10:12:540
149960,0migration/05732-21kthreadcore10:12:540
149960,0migration/029745-21sh11:46:360
149960,0migration/016809-21gltestperf09:42:490
149960,0migration/010857-21df_abs07:22:500
4150,0ktimersoftd/00-21swapper/010:35:280
339950,0migration/37950-21kthreadcore10:52:563
339950,0migration/37168-21df_abs08:32:493
339950,0migration/329821-21runrttasks12:04:213
339950,0migration/326736-21munin-node08:22:523
339950,0migration/32515-21aten_r1power_vo10:32:483
339950,0migration/324320-21kthreadcore09:07:553
339950,0migration/321491-21munin-node09:42:533
339950,0migration/318850-21taskset08:16:293
339950,0migration/314670-21latency_hist11:57:363
339950,0migration/312031-21kthreadcore09:57:543
339950,0migration/311579-21switchtime09:17:593
29715050,0irq/26-eth0-rx-6808-21ssh12:29:213
29715050,0irq/26-eth0-rx-6172sleep308:50:313
29715050,0irq/26-eth0-rx-5904-21aten_r1power_po08:07:493
29715050,0irq/26-eth0-rx-5892-21fschecks_count11:32:473
29715050,0irq/26-eth0-rx-5731-21ssh12:09:093
29715050,0irq/26-eth0-rx-3159-21taskset11:10:143
29715050,0irq/26-eth0-rx-29335-21kthreadcore10:27:553
29715050,0irq/26-eth0-rx-28489-21open_inodes09:27:563
29715050,0irq/26-eth0-rx-26564-21crond08:47:373
29715050,0irq/26-eth0-rx-24656-21cut11:02:543
29715050,0irq/26-eth0-rx-20615-21kthreadcore12:17:543
29715050,0irq/26-eth0-rx-1469-21kthreadcore09:32:543
29715050,0irq/26-eth0-rx-12257-21kthreadcore10:17:543
29715050,0irq/26-eth0-rx-0-21swapper/311:47:543
29715050,0irq/26-eth0-rx-0-21swapper/311:27:543
29715050,0irq/26-eth0-rx-0-21swapper/311:26:083
29715050,0irq/26-eth0-rx-0-21swapper/310:57:583
29715050,0irq/26-eth0-rx-0-21swapper/310:02:563
29715050,0irq/26-eth0-rx-0-21swapper/309:54:193
29715050,0irq/26-eth0-rx-0-21swapper/309:49:433
29715050,0irq/26-eth0-rx-0-21swapper/309:38:093
249950,0watchdog/219771-21fschecks_time10:42:512
226229955,0cyclictest0-21swapper/212:04:572
226229955,0cyclictest0-21swapper/209:41:572
226229955,0cyclictest0-21swapper/208:12:522
226229950,0cyclictest0-21swapper/207:13:542
226189955,0cyclictest0-21swapper/111:51:581
226189955,0cyclictest0-21swapper/110:54:541
226189955,0cyclictest0-21swapper/110:34:141
226189950,0cyclictest0-21swapper/111:52:451
226189950,0cyclictest0-21swapper/109:54:491
226189950,0cyclictest0-21swapper/109:19:491
226179955,0cyclictest20912-21diskmemload10:57:410
226179955,0cyclictest0-21swapper/012:24:150
226179955,0cyclictest0-21swapper/011:33:570
226179955,0cyclictest0-21swapper/011:32:230
226179950,0cyclictest0-21swapper/010:27:440
226179950,0cyclictest0-21swapper/009:21:310
19150,0ktimersoftd/10-21swapper/109:24:241
179950,0migration/15306-21kthreadcore10:12:541
179950,0migration/15306-21kthreadcore10:12:541
179950,0migration/14854-21munin-node11:12:481
179950,0migration/129686-21munin-node12:22:561
149950,0migration/0627-21proc_pri10:47:580
149950,0migration/05196-21kthreadcore08:52:550
149950,0migration/04904-21timerandwakeup08:02:590
149950,0migration/03881-21kthreadcore12:27:530
149950,0migration/032166-21kthreadcore07:12:550
149950,0migration/031814-21kthreadcore11:07:550
149950,0migration/024608-21taskset10:23:480
149950,0migration/024148-21munin-node12:02:530
149950,0migration/023014-21taskset12:20:400
149950,0migration/018191-21aten_r1power_cu07:52:480
149950,0migration/018001-21idleruntime07:27:530
149950,0migration/015657-21irqcore09:02:530
149950,0migration/014700-21latency_hist11:57:360
149950,0migration/014326-21kthreadcore08:12:560
149950,0migration/011559-21kthreadcore09:57:530
149950,0migration/010631-21taskset11:13:050
149950,0migration/010114-21taskset07:20:440
339940,0migration/331417-21if_err_eth1.307:37:543
339940,0migration/329519-21kthreadcore10:07:543
339940,0migration/325820-21kthreadcore07:32:553
339940,0migration/316135-21kthreadcore07:47:553
339940,0migration/311571-21sh10:37:503
29725040,0irq/27-eth0-tx-6559-21runrttasks10:27:482
29725040,0irq/27-eth0-tx-23956-21kthreadcore11:22:542
29725040,0irq/27-eth0-tx-0-21swapper/211:37:462
29725040,0irq/27-eth0-tx-0-21swapper/210:12:512
29725040,0irq/27-eth0-tx-0-21swapper/210:12:512
29725040,0irq/27-eth0-tx-0-21swapper/210:09:452
29725040,0irq/27-eth0-tx-0-21swapper/209:59:392
29725040,0irq/27-eth0-tx-0-21swapper/209:48:032
29725040,0irq/27-eth0-tx-0-21swapper/209:42:492
29725040,0irq/27-eth0-tx-0-21swapper/209:22:582
29725040,0irq/27-eth0-tx-0-21swapper/209:11:032
29725040,0irq/27-eth0-tx-0-21swapper/209:02:492
29715040,0irq/26-eth0-rx-0-21swapper/312:22:393
29715040,0irq/26-eth0-rx-0-21swapper/311:17:533
29715040,0irq/26-eth0-rx-0-21swapper/310:47:423
29715040,0irq/26-eth0-rx-0-21swapper/310:42:553
29715040,0irq/26-eth0-rx-0-21swapper/308:56:553
29715040,0irq/26-eth0-rx-0-21swapper/308:02:563
29715040,0irq/26-eth0-rx-0-21swapper/307:42:473
249940,0watchdog/26154-21grep12:27:592
249940,0watchdog/231738-21kthreadcore11:07:552
249940,0watchdog/224088-21munin-node12:22:512
249940,0watchdog/220912-21diskmemload11:06:232
249940,0watchdog/20-21swapper/211:17:552
249940,0watchdog/20-21swapper/210:37:592
249940,0watchdog/20-21swapper/210:17:552
249940,0watchdog/20-21swapper/208:37:552
249940,0watchdog/20-21swapper/207:32:562
226229943,0cyclictest6617-21awk09:17:512
226229943,0cyclictest3514-21snmpd11:44:522
226229943,0cyclictest3514-21snmpd10:54:212
226229943,0cyclictest3514-21snmpd09:55:512
226229943,0cyclictest3514-21snmpd09:27:512
226229943,0cyclictest3514-21snmpd09:12:512
226229943,0cyclictest3514-21snmpd08:02:502
226229943,0cyclictest3514-21snmpd07:57:502
226229943,0cyclictest3514-21snmpd07:22:502
226229943,0cyclictest3241-21irqbalance11:59:252
226229943,0cyclictest3241-21irqbalance11:47:552
226229943,0cyclictest3241-21irqbalance11:33:052
226229943,0cyclictest3241-21irqbalance10:57:452
226229943,0cyclictest3241-21irqbalance10:32:452
226229943,0cyclictest3241-21irqbalance09:33:452
226229943,0cyclictest3241-21irqbalance08:07:462
226229943,0cyclictest3241-21irqbalance07:53:562
226229943,0cyclictest3241-21irqbalance07:47:462
226229943,0cyclictest3241-21irqbalance07:43:262
226229943,0cyclictest3241-21irqbalance07:38:562
226229943,0cyclictest23674-21awk07:07:532
226229943,0cyclictest17980-21awk10:02:542
226229940,0cyclictest0-21swapper/207:27:502
226189943,0cyclictest9280-21awk12:32:511
226189943,0cyclictest3556-21lldpd12:18:291
226189943,0cyclictest3556-21lldpd11:04:591
226189943,0cyclictest3556-21lldpd11:01:291
226189943,0cyclictest3556-21lldpd10:02:581
226189943,0cyclictest3556-21lldpd09:44:581
226189943,0cyclictest3556-21lldpd09:37:581
226189943,0cyclictest3556-21lldpd09:33:581
226189943,0cyclictest3556-21lldpd09:28:281
226189943,0cyclictest3556-21lldpd09:07:581
226189943,0cyclictest3556-21lldpd08:58:581
226189943,0cyclictest3556-21lldpd08:44:581
226189943,0cyclictest30293-21awk09:12:531
226189943,0cyclictest26311-21awk10:07:511
226189943,0cyclictest25276-21awk09:47:511
226189943,0cyclictest23743-21awk07:07:541
226189943,0cyclictest1948-21awk08:52:521
226189943,0cyclictest15670-21awk11:57:511
226189943,0cyclictest11407-21awk07:22:521
226179944,0cyclictest0-21swapper/012:10:030
226179944,0cyclictest0-21swapper/011:20:140
226179944,0cyclictest0-21swapper/010:07:520
226179943,0cyclictest8619-21awk09:37:520
226179943,0cyclictest7798-21awk08:32:520
226179943,0cyclictest4344-21awk10:52:540
226179943,0cyclictest3556-21lldpd08:18:280
226179943,0cyclictest3556-21lldpd08:01:580
226179943,0cyclictest3514-21snmpd08:23:050
226179943,0cyclictest3241-21irqbalance09:32:450
226179943,0cyclictest3241-21irqbalance09:27:450
226179943,0cyclictest24814-21awk07:32:540
226179943,0cyclictest18085-21awk10:02:540
226179943,0cyclictest15134-21awk09:22:530
226179943,0cyclictest14743-21awk11:37:490
226179943,0cyclictest14341-21awk08:37:530
226179943,0cyclictest1193-21awk09:52:520
179940,0migration/16341-21fschecks_count08:07:511
179940,0migration/16208-21taskset08:28:211
179940,0migration/15496-21kthreadcore07:17:541
179940,0migration/129513-21kthreadcore08:47:541
179940,0migration/129140-21kthreadcore10:27:551
179940,0migration/129076-21taskset11:44:561
179940,0migration/126513-21fschecks_time08:22:511
179940,0migration/126115-21kernelversion07:57:541
179940,0migration/124312-21fschecks_count07:32:521
179940,0migration/12058-21sh10:50:141
179940,0migration/117960-21gltestperf07:27:521
179940,0migration/112572-21aten_r1power_cu08:12:501
179940,0migration/111489-21taskset07:47:431
179940,0migration/111336-21kthreadcore12:12:531
169940,0watchdog/15178-21unixbench_singl12:07:591
169940,0watchdog/127546-21sh11:23:351
169940,0watchdog/125553-21sh10:43:431
169940,0watchdog/122609-21kthreadcore10:22:551
169940,0watchdog/120356-21chrt11:39:031
169940,0watchdog/116637-21cat10:37:591
169940,0watchdog/114247-21cut10:17:551
169940,0watchdog/10-21swapper/112:29:551
169940,0watchdog/10-21swapper/108:37:551
169940,0watchdog/10-21swapper/108:02:561
169940,0watchdog/10-21swapper/107:12:561
149940,0migration/06875-21kthreadcore07:42:520
149940,0migration/028011-21sh11:24:440
149940,0migration/026665-21kthreadcore09:47:530
149940,0migration/024758-21kthreadcore07:07:550
149940,0migration/024265-21kthreadcore08:42:540
149940,0migration/01602-21kthreadcore07:37:560
149940,0migration/015064-21kthreadcore10:17:550
149940,0migration/010545-21kthreadcore08:07:550
29725030,0irq/27-eth0-tx-0-21swapper/211:27:462
29725030,0irq/27-eth0-tx-0-21swapper/207:17:562
29715030,0irq/26-eth0-rx-0-21swapper/309:03:413
29715030,0irq/26-eth0-rx-0-21swapper/308:57:493
29715030,0irq/26-eth0-rx-0-21swapper/308:27:513
29715030,0irq/26-eth0-rx-0-21swapper/307:27:503
29715030,0irq/26-eth0-rx-0-21swapper/307:07:533
249930,0watchdog/20-21swapper/212:07:472
226229932,0cyclictest8853-21kthreadcore12:12:532
226229932,0cyclictest7819-21munin-node08:57:592
226229932,0cyclictest3514-21snmpd10:22:512
226229932,0cyclictest3514-21snmpd08:27:502
226229932,0cyclictest32502-21sensors08:47:582
226229932,0cyclictest27023-21ps08:22:542
226229932,0cyclictest1933-21awk08:52:522
226229932,0cyclictest0-21swapper/211:52:512
226229930,0cyclictest27421-21munin-node10:47:512
226229930,0cyclictest20160-21munin-node08:42:572
226229930,0cyclictest0-21swapper/211:12:382
226189933,0cyclictest3556-21lldpd09:05:581
226189932,0cyclictest5807-21awk07:42:511
226189932,0cyclictest3514-21snmpd08:34:351
226189932,0cyclictest3514-21snmpd07:38:501
226189932,0cyclictest19017-21awk07:52:521
226179932,0cyclictest8656-21awk08:57:510
226179932,0cyclictest3556-21lldpd09:13:580
226179932,0cyclictest25779-21sed11:02:570
226179932,0cyclictest14594-21kthreadcore07:47:550
226179932,0cyclictest13341-21ssh11:54:450
226179932,0cyclictest13212-21sensors12:12:570
226179932,0cyclictest1087-21awk08:27:520
226179930,0cyclictest0-21swapper/011:49:240
226179930,0cyclictest0-21swapper/008:49:230
169930,0watchdog/10-21swapper/111:32:471
169930,0watchdog/10-21swapper/108:17:481
339920,0migration/330511-21iostat_ios07:12:543
29715020,0irq/26-eth0-rx-0-21swapper/308:37:433
29715020,0irq/26-eth0-rx-0-21swapper/308:17:493
29715020,0irq/26-eth0-rx-0-21swapper/307:57:503
29715020,0irq/26-eth0-rx-0-21swapper/307:52:393
29715020,0irq/26-eth0-rx-0-21swapper/307:22:493
29715020,0irq/26-eth0-rx-0-21swapper/307:17:393
226179921,0cyclictest8345-21latency_hist12:32:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional