You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-09 - 01:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu Jan 08, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450650,0irq/25-eth10-21swapper/307:04:313
1383723725,0sleep10-21swapper/107:05:581
1365023524,0sleep00-21swapper/007:03:450
1364723526,0sleep20-21swapper/207:03:432
140449970,0cyclictest18432-40yum-updatesd-he08:49:210
35160,0ktimersoftd/30-21swapper/310:17:353
35160,0ktimersoftd/30-21swapper/310:17:353
339960,0migration/36528-21aten2.4-expect10:47:413
339960,0migration/36399-21idleruntime08:42:443
339960,0migration/327408-21sh10:00:123
339960,0migration/321085-21cpuspeed_turbos12:17:413
339960,0migration/319241-21sh09:55:333
339960,0migration/318897-21munin-node08:27:483
29715060,0irq/26-eth0-rx-7068-21diskstats09:07:443
29715060,0irq/26-eth0-rx-5813-21sed09:22:543
29715060,0irq/26-eth0-rx-4778-21chrt12:27:263
29715060,0irq/26-eth0-rx-21474-21kthreadcore10:57:443
29715060,0irq/26-eth0-rx-13189-21cut11:52:463
19160,0ktimersoftd/10-21swapper/109:32:071
140469965,0cyclictest21362-21aten2.4-expect10:17:422
140469965,0cyclictest21362-21aten2.4-expect10:17:422
140469965,0cyclictest15061-21ls07:32:322
140459960,0cyclictest0-21swapper/109:38:351
140449966,0cyclictest16129-21ssh11:32:500
140449963,0cyclictest3867-21kworker/0:211:51:080
140449963,0cyclictest3867-21kworker/0:210:47:390
140449963,0cyclictest28942-21kworker/0:012:17:320
140449963,0cyclictest28942-21kworker/0:012:10:080
140449963,0cyclictest17051-21kworker/0:010:38:390
140449963,0cyclictest17051-21kworker/0:010:30:390
140449963,0cyclictest17051-21kworker/0:010:23:090
140449963,0cyclictest17051-21kworker/0:009:51:390
140449963,0cyclictest17051-21kworker/0:009:35:090
140449963,0cyclictest17051-21kworker/0:009:27:330
140449963,0cyclictest17051-21kworker/0:009:16:090
140449963,0cyclictest17051-21kworker/0:009:10:390
140449963,0cyclictest17051-21kworker/0:009:02:450
149960,0migration/032706-21sh09:40:410
8215050,0irq/24-0000:00:6098-21crond10:47:322
339950,0migration/38875-21kthreadcore08:17:483
339950,0migration/34047-21sh10:07:003
339950,0migration/331673-21sh11:03:243
339950,0migration/331465-21munin-node08:37:433
339950,0migration/329281-21sendmail_mailtr08:07:493
339950,0migration/32838-21latency_hist07:47:323
339950,0migration/32725-21taskset11:47:143
339950,0migration/31963-21aten_r1power_po07:22:433
339950,0migration/318907-21munin-node11:17:463
339950,0migration/318725-21kthreadcore07:32:483
339950,0migration/317656-21kthreadcore10:12:453
339950,0migration/317029-21gltestperf07:57:473
339950,0migration/315582-21fschecks_time09:12:443
339950,0migration/314728-21kthreadcore12:12:473
339950,0migration/314112-21munin-node09:27:523
339950,0migration/313284-21latency_hist12:32:303
29725050,0irq/27-eth0-tx-8892-21uname11:47:502
29725050,0irq/27-eth0-tx-3671-21ssh12:24:442
29725050,0irq/27-eth0-tx-28591-21munin-node07:42:532
29725050,0irq/27-eth0-tx-28253-21ssh10:02:182
29725050,0irq/27-eth0-tx-2813-21ssh11:47:272
29725050,0irq/27-eth0-tx-2707-21ssh12:04:532
29725050,0irq/27-eth0-tx-25423-21munin-node09:37:462
29725050,0irq/27-eth0-tx-17968-21munin-node08:27:462
29725050,0irq/27-eth0-tx-16720-21users11:32:542
29725050,0irq/27-eth0-tx-12994-21kthreadcore11:52:462
29725050,0irq/27-eth0-tx-12264-21munin-node08:47:502
29725050,0irq/27-eth0-tx-0-21swapper/212:31:092
29725050,0irq/27-eth0-tx-0-21swapper/212:20:032
29725050,0irq/27-eth0-tx-0-21swapper/211:18:482
29725050,0irq/27-eth0-tx-0-21swapper/211:15:252
29725050,0irq/27-eth0-tx-0-21swapper/210:59:222
29725050,0irq/27-eth0-tx-0-21swapper/210:36:592
29725050,0irq/27-eth0-tx-0-21swapper/210:08:162
29725050,0irq/27-eth0-tx-0-21swapper/209:54:452
29725050,0irq/27-eth0-tx-0-21swapper/209:35:162
29725050,0irq/27-eth0-tx-0-21swapper/209:22:542
29725050,0irq/27-eth0-tx-0-21swapper/209:12:472
29715050,0irq/26-eth0-rx-6559-21runrttasks11:16:183
29715050,0irq/26-eth0-rx-4234-21ssh10:42:533
29715050,0irq/26-eth0-rx-3067-21if_err_eth111:27:443
29715050,0irq/26-eth0-rx-26188-21ssh11:58:253
29715050,0irq/26-eth0-rx-26041-21ssh11:40:223
29715050,0irq/26-eth0-rx-25927-21df08:57:433
29715050,0irq/26-eth0-rx-17191-21ssh11:34:023
29715050,0irq/26-eth0-rx-10706-21ethtool09:47:463
29715050,0irq/26-eth0-rx-0-21swapper/312:32:433
29715050,0irq/26-eth0-rx-0-21swapper/312:04:163
29715050,0irq/26-eth0-rx-0-21swapper/311:23:593
29715050,0irq/26-eth0-rx-0-21swapper/311:12:293
29715050,0irq/26-eth0-rx-0-21swapper/310:33:063
29715050,0irq/26-eth0-rx-0-21swapper/310:28:243
29715050,0irq/26-eth0-rx-0-21swapper/310:24:063
29715050,0irq/26-eth0-rx-0-21swapper/309:17:483
27150,0ktimersoftd/20-21swapper/209:30:332
27150,0ktimersoftd/20-21swapper/209:07:512
259950,0migration/27341-21unixbench-2d11:07:532
259950,0migration/24014-21irqcore07:47:472
259950,0migration/229975-21sh09:18:292
259950,0migration/229441-21latency_hist10:22:322
259950,0migration/216308-21sh09:48:542
259950,0migration/210635-21irqcore07:52:472
249950,0watchdog/217610-21kthreadcore10:12:452
179950,0migration/18383-21sh09:44:531
179950,0migration/15024-21latency_hist12:27:311
179950,0migration/124454-21ntp_kernel_pll_11:37:501
179950,0migration/121523-21cpuspeed_turbos10:17:421
179950,0migration/121523-21cpuspeed_turbos10:17:421
179950,0migration/11355-21taskset07:19:351
169950,0watchdog/132484-21ssh11:23:011
140469955,0cyclictest0-21swapper/212:01:542
140469955,0cyclictest0-21swapper/210:57:262
140469950,0cyclictest0-21swapper/211:05:372
140469950,0cyclictest0-21swapper/210:06:112
140459955,0cyclictest6382-21diskmemload12:21:451
140459955,0cyclictest6382-21diskmemload10:53:091
140459955,0cyclictest0-21swapper/109:47:431
140459950,0cyclictest0-21swapper/111:48:481
140449955,0cyclictest0-21swapper/011:43:430
140449955,0cyclictest0-21swapper/010:03:260
140449953,0cyclictest7232-21kworker/0:207:47:330
140449953,0cyclictest7232-21kworker/0:207:22:470
140449953,0cyclictest7232-21kworker/0:207:17:330
140449953,0cyclictest3867-21kworker/0:211:28:080
140449953,0cyclictest3867-21kworker/0:211:23:380
140449953,0cyclictest3867-21kworker/0:210:59:380
140449953,0cyclictest28942-21kworker/0:012:33:380
140449953,0cyclictest28942-21kworker/0:012:27:380
140449953,0cyclictest28942-21kworker/0:012:24:380
140449953,0cyclictest28942-21kworker/0:012:04:380
140449953,0cyclictest17051-21kworker/0:010:18:390
140449953,0cyclictest17051-21kworker/0:010:18:390
140449953,0cyclictest17051-21kworker/0:010:12:390
140449953,0cyclictest17051-21kworker/0:010:07:390
140449953,0cyclictest17051-21kworker/0:010:00:390
140449953,0cyclictest17051-21kworker/0:009:55:090
140449953,0cyclictest17051-21kworker/0:009:44:390
140449953,0cyclictest17051-21kworker/0:009:25:090
140449953,0cyclictest17051-21kworker/0:008:55:390
140449953,0cyclictest17051-21kworker/0:008:37:330
140449953,0cyclictest17051-21kworker/0:008:27:330
140449953,0cyclictest17051-21kworker/0:008:17:330
140449953,0cyclictest17051-21kworker/0:008:12:390
140449953,0cyclictest17051-21kworker/0:008:07:330
140449950,0cyclictest0-21swapper/010:53:530
149950,0migration/06435-21kthreadcore11:07:470
149950,0migration/032704-21kthreadcore10:42:450
149950,0migration/030420-21kthreadcore11:02:490
149950,0migration/029708-21kthreadcore08:32:480
149950,0migration/028264-21kthreadcore08:57:480
149950,0migration/024721-21switchtime11:37:530
149950,0migration/024215-21fschecks_time09:17:440
149950,0migration/023599-21kthreadcore11:57:470
149950,0migration/020732-21munin-node07:32:500
149950,0migration/020039-21kthreadcore11:17:480
149950,0migration/013438-21kthreadcore07:52:480
149950,0migration/013243-21kthreadcore11:52:460
149950,0migration/012467-21irqcore08:22:470
8215040,0irq/24-0000:00:0-21swapper/210:47:432
35140,0ktimersoftd/30-21swapper/308:16:023
339940,0migration/322029-21latency_hist10:37:323
29725040,0irq/27-eth0-tx-3151-21if_eth1.211:27:442
29725040,0irq/27-eth0-tx-26315-21ssh11:22:412
29725040,0irq/27-eth0-tx-15029-21kthreadcore12:32:472
29725040,0irq/27-eth0-tx-0-21swapper/212:07:342
29725040,0irq/27-eth0-tx-0-21swapper/210:27:442
29725040,0irq/27-eth0-tx-0-21swapper/209:42:332
29725040,0irq/27-eth0-tx-0-21swapper/208:52:432
29715040,0irq/26-eth0-rx-17937-21sendmail_mailtr08:47:533
29715040,0irq/26-eth0-rx-1562-21cpuspeed_turbos09:42:423
29715040,0irq/26-eth0-rx-0-21swapper/312:07:403
29715040,0irq/26-eth0-rx-0-21swapper/311:47:343
29715040,0irq/26-eth0-rx-0-21swapper/310:53:333
29715040,0irq/26-eth0-rx-0-21swapper/310:08:383
29715040,0irq/26-eth0-rx-0-21swapper/309:38:053
29715040,0irq/26-eth0-rx-0-21swapper/309:32:453
259940,0migration/27763-21kthreadcore08:42:472
259940,0migration/225733-21kthreadcore10:37:472
259940,0migration/21881-21kthreadcore08:37:482
259940,0migration/216151-21munin-node07:32:452
249940,0watchdog/25731-21sed09:02:542
179940,0migration/18430-21kthreadcore10:47:471
179940,0migration/17404-21kthreadcore10:27:461
179940,0migration/1636-21kthreadcore07:42:491
179940,0migration/15255-21fschecks_time10:07:451
179940,0migration/128653-21fschecks_count12:02:431
179940,0migration/125212-21latency_hist11:02:311
179940,0migration/124676-21kthreadcore10:37:471
179940,0migration/124309-21kthreadcore07:12:501
179940,0migration/124021-21fschecks_count09:17:441
179940,0migration/120181-21kthreadcore07:57:511
179940,0migration/119822-21taskset11:57:391
179940,0migration/117207-21kthreadcore10:32:481
179940,0migration/11720-21kthreadcore09:22:481
179940,0migration/116104-21kthreadcore11:52:471
179940,0migration/111242-21latency_hist08:22:321
179940,0migration/110417-21munin-node07:52:451
169940,0watchdog/15556-21if_eth1.208:17:461
169940,0watchdog/12482-21cut11:27:411
169940,0watchdog/120059-21cat07:07:541
169940,0watchdog/119670-21gltestperf08:52:461
169940,0watchdog/113154-21cut07:27:501
169940,0watchdog/11220-21kthreadcore10:42:451
169940,0watchdog/110789-21ssh12:09:011
140469943,0cyclictest3556-21lldpd08:35:072
140469943,0cyclictest3556-21lldpd08:20:372
140469943,0cyclictest3556-21lldpd08:10:382
140469943,0cyclictest3556-21lldpd07:26:072
140469943,0cyclictest3514-21snmpd07:57:562
140469943,0cyclictest26485-21awk08:57:462
140469943,0cyclictest19778-21awk11:37:452
140469943,0cyclictest15109-21awk07:07:462
140469943,0cyclictest12489-21munin-node12:12:482
140459944,0cyclictest0-21swapper/109:09:531
140459943,0cyclictest6425-21awk08:42:451
140459943,0cyclictest3556-21lldpd08:13:081
140459943,0cyclictest3514-21snmpd12:36:111
140459943,0cyclictest3514-21snmpd11:35:111
140459943,0cyclictest3514-21snmpd11:11:261
140459943,0cyclictest3514-21snmpd10:07:111
140459943,0cyclictest3514-21snmpd09:58:111
140459943,0cyclictest3514-21snmpd08:50:111
140459943,0cyclictest3514-21snmpd08:02:411
140459943,0cyclictest3514-21snmpd07:38:111
140459943,0cyclictest3514-21snmpd07:33:111
140459943,0cyclictest3514-21snmpd07:25:561
140459943,0cyclictest3241-21irqbalance12:23:291
140459943,0cyclictest3241-21irqbalance12:14:291
140459943,0cyclictest3241-21irqbalance10:24:101
140459943,0cyclictest3241-21irqbalance10:12:401
140459943,0cyclictest32056-21crond09:02:321
140459943,0cyclictest28078-21awk11:42:451
140459943,0cyclictest18908-21awk11:17:461
140459943,0cyclictest17962-21awk10:57:421
140459943,0cyclictest10576-21awk11:12:441
140449943,0cyclictest3556-21lldpd08:04:380
140449942,0cyclictest7232-21kworker/0:207:57:330
140449942,0cyclictest7232-21kworker/0:207:42:390
140449942,0cyclictest7232-21kworker/0:207:37:390
140449942,0cyclictest7232-21kworker/0:207:27:390
140449942,0cyclictest7232-21kworker/0:207:14:390
140449942,0cyclictest7232-21kworker/0:207:11:390
140449942,0cyclictest3867-21kworker/0:211:14:380
140449942,0cyclictest17051-21kworker/0:010:34:390
140449942,0cyclictest17051-21kworker/0:008:47:090
149940,0migration/018849-21sh12:13:230
339930,0migration/321068-21aten_r1power_po07:12:443
29715030,0irq/26-eth0-rx-0-21swapper/308:52:473
29715030,0irq/26-eth0-rx-0-21swapper/308:22:433
29715030,0irq/26-eth0-rx-0-21swapper/307:53:493
29715030,0irq/26-eth0-rx-0-21swapper/307:42:423
29715030,0irq/26-eth0-rx-0-21swapper/307:18:233
29715030,0irq/26-eth0-rx-0-21swapper/307:07:423
169930,0watchdog/132290-21munin-node09:02:461
169930,0watchdog/10-21swapper/109:32:341
169930,0watchdog/10-21swapper/108:32:421
169930,0watchdog/10-21swapper/108:27:501
140469932,0cyclictest832-21sensors07:17:542
140469932,0cyclictest3556-21lldpd08:13:382
140469932,0cyclictest3556-21lldpd08:02:382
140469932,0cyclictest3556-21lldpd07:37:372
140469932,0cyclictest21282-21df_abs07:12:452
140469932,0cyclictest12199-21awk08:22:462
140459933,0cyclictest3514-21snmpd07:49:111
140459933,0cyclictest15943-21awk09:12:461
140459932,0cyclictest6382-21diskmemload09:52:471
140459932,0cyclictest3556-21lldpd08:09:081
329920,0watchdog/31147-21irqstats09:02:473
29715020,0irq/26-eth0-rx-0-21swapper/308:32:423
29715020,0irq/26-eth0-rx-0-21swapper/308:03:233
29715020,0irq/26-eth0-rx-0-21swapper/307:37:433
29715020,0irq/26-eth0-rx-0-21swapper/307:27:543
169920,0watchdog/10-21swapper/108:37:421
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional