You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 19:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Wed Aug 19, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450680,0irq/25-eth10-21swapper/306:44:133
2097626564,0sleep00-21swapper/006:42:410
2097723625,0sleep10-21swapper/106:42:421
1774223324,0sleep20-21swapper/206:41:432
339960,0migration/33231-21aten_r1power_cu08:56:353
339960,0migration/329847-21sh11:33:403
339960,0migration/329037-21sh11:52:573
339960,0migration/323779-21munin-node07:11:413
339960,0migration/322717-21sh11:09:053
339960,0migration/315063-21sh11:04:533
29715060,0irq/26-eth0-rx-23244-21ssh10:48:483
213659960,0cyclictest0-21swapper/210:06:362
213649960,0cyclictest0-21swapper/110:02:211
149960,0migration/08827-21sh09:37:590
149960,0migration/030976-21sh10:53:070
149960,0migration/017966-21sh09:03:300
149960,0migration/014403-21taskset11:24:510
8215050,0irq/24-0000:00:25905-21cat09:51:242
8215050,0irq/24-0000:00:18531-21idleruntime-cro08:21:252
339950,0migration/38461-21unixbench_multi06:56:493
339950,0migration/332591-21munin-node09:31:483
339950,0migration/332124-21aten_r1power_en08:31:363
339950,0migration/330458-21cpuspeed_turbos07:41:373
339950,0migration/329578-21fschecks_count07:16:383
339950,0migration/328361-21aten_r1power_vo06:51:363
339950,0migration/326940-21kthreadcore11:11:433
339950,0migration/323636-21kthreadcore09:26:393
339950,0migration/323630-21sh10:28:203
339950,0migration/321093-21kthreadcore09:06:413
339950,0migration/319792-21munin-node08:46:363
339950,0migration/316554-21taskset07:31:153
339950,0migration/316525-21munin-node09:21:483
339950,0migration/31581-21latency_hist09:56:253
339950,0migration/31581-21latency_hist09:56:253
339950,0migration/314588-21kthreadcore08:41:423
339950,0migration/31233-21kthreadcore11:56:413
339950,0migration/310132-21munin-node07:01:403
29725050,0irq/27-eth0-tx-8195-21memory09:16:422
29725050,0irq/27-eth0-tx-6639-21munin-node11:41:392
29725050,0irq/27-eth0-tx-32060-21munin-node08:31:400
29725050,0irq/27-eth0-tx-29354-21ssh12:15:452
29725050,0irq/27-eth0-tx-24025-21latency09:26:402
29725050,0irq/27-eth0-tx-23464-21munin-node07:36:430
29725050,0irq/27-eth0-tx-21574-21munin-node06:46:470
29725050,0irq/27-eth0-tx-12073-21munin-node08:16:430
29725050,0irq/27-eth0-tx-0-21swapper/008:06:350
29725050,0irq/27-eth0-tx-0-21swapper/006:58:160
29715050,0irq/26-eth0-rx-9043-21cat11:21:383
29715050,0irq/26-eth0-rx-7850-21kthreadcore08:11:413
29715050,0irq/26-eth0-rx-775-21munin-run10:16:243
29715050,0irq/26-eth0-rx-7735-21latency_hist11:01:233
29715050,0irq/26-eth0-rx-6559-21runrttasks11:46:353
29715050,0irq/26-eth0-rx-402-21basename10:36:363
29715050,0irq/26-eth0-rx-28771-21tr09:51:433
29715050,0irq/26-eth0-rx-19612-21kthreadcore07:31:413
29715050,0irq/26-eth0-rx-0-21swapper/311:26:393
29715050,0irq/26-eth0-rx-0-21swapper/310:43:343
29715050,0irq/26-eth0-rx-0-21swapper/310:31:373
29715050,0irq/26-eth0-rx-0-21swapper/309:15:133
29715050,0irq/26-eth0-rx-0-21swapper/308:52:353
259950,0migration/26340-21latency_hist08:36:252
259950,0migration/24712-21cpuspeed_turbos07:46:362
259950,0migration/24471-21switchtime08:06:472
259950,0migration/224737-21latency_hist10:31:232
249950,0watchdog/221864-21ssh11:50:102
213649955,0cyclictest0-21swapper/111:51:261
213649955,0cyclictest0-21swapper/111:11:521
213649955,0cyclictest0-21swapper/110:44:361
213649955,0cyclictest0-21swapper/110:31:591
213649955,0cyclictest0-21swapper/109:21:311
213649950,0cyclictest0-21swapper/111:36:281
213649950,0cyclictest0-21swapper/110:13:421
213639955,0cyclictest0-21swapper/011:20:070
213639955,0cyclictest0-21swapper/008:54:360
213639950,0cyclictest0-21swapper/011:46:260
179950,0migration/19676-21kthreadcore11:41:411
179950,0migration/18833-21latency_hist10:21:241
179950,0migration/13995-21timerandwakeup11:56:471
179950,0migration/129719-21taskset07:39:231
179950,0migration/126104-21fschecks_time08:26:381
179950,0migration/124452-21sendmail_mailqu09:26:431
179950,0migration/123547-21latency_hist11:11:231
179950,0migration/122816-21munin-node10:26:461
179950,0migration/119565-21idleruntime08:21:391
179950,0migration/116526-21sh09:42:241
149950,0migration/09572-21kthreadcore11:01:410
149950,0migration/09234-21aten_r1power_vo10:21:370
149950,0migration/09028-21kthreadcore12:01:410
149950,0migration/08858-21kthreadcore11:41:400
149950,0migration/07896-21kthreadcore08:11:410
149950,0migration/05858-21kthreadcore09:16:410
149950,0migration/032387-21kthreadcore07:41:420
149950,0migration/030086-21kthreadcore10:31:440
149950,0migration/029787-21unixbench_multi11:11:480
149950,0migration/029239-21kthreadcore10:11:410
149950,0migration/028149-21pmu-power11:51:460
149950,0migration/026594-21kthreadcore08:01:420
149950,0migration/021918-21aten_r1power_cu12:11:340
149950,0migration/021359-21kthreadcore08:46:410
149950,0migration/01942-21sh10:16:390
149950,0migration/019081-21kthreadcore12:06:420
149950,0migration/017740-21taskset07:56:310
149950,0migration/017330-21fschecks_count07:31:380
149950,0migration/014966-21kthreadcore07:26:420
149950,0migration/014843-21sendmail_mailst07:01:450
149950,0migration/011646-21fschecks_time07:51:390
149950,0migration/010836-21fschecks_time09:41:380
8215040,0irq/24-0000:00:0-21swapper/208:01:252
8079240,0sleep28359-21unixbench_singl09:36:492
339940,0migration/326413-21kthreadcore08:01:423
339940,0migration/326074-21kthreadcore12:11:413
339940,0migration/317902-21aten2.4-expect07:56:363
339940,0migration/313056-21diskmemload11:42:353
29725040,0irq/27-eth0-tx-30282-21cat10:51:482
29725040,0irq/27-eth0-tx-26751-21ssh08:49:452
29725040,0irq/27-eth0-tx-26501-21ssh09:51:392
29725040,0irq/27-eth0-tx-0-21swapper/212:06:282
29725040,0irq/27-eth0-tx-0-21swapper/211:36:462
29725040,0irq/27-eth0-tx-0-21swapper/211:28:192
29725040,0irq/27-eth0-tx-0-21swapper/211:11:262
29725040,0irq/27-eth0-tx-0-21swapper/210:43:342
29725040,0irq/27-eth0-tx-0-21swapper/210:34:042
29725040,0irq/27-eth0-tx-0-21swapper/210:21:292
29725040,0irq/27-eth0-tx-0-21swapper/210:16:362
29725040,0irq/27-eth0-tx-0-21swapper/210:13:482
29725040,0irq/27-eth0-tx-0-21swapper/209:58:402
29725040,0irq/27-eth0-tx-0-21swapper/209:58:402
29725040,0irq/27-eth0-tx-0-21swapper/209:21:432
29725040,0irq/27-eth0-tx-0-21swapper/209:12:042
29725040,0irq/27-eth0-tx-0-21swapper/209:01:282
29715040,0irq/26-eth0-rx-32339-21fschecks_time11:16:393
29715040,0irq/26-eth0-rx-31513-21sshd08:27:483
29715040,0irq/26-eth0-rx-0-21swapper/312:08:203
29715040,0irq/26-eth0-rx-0-21swapper/312:02:143
29715040,0irq/26-eth0-rx-0-21swapper/311:36:363
29715040,0irq/26-eth0-rx-0-21swapper/310:51:363
29715040,0irq/26-eth0-rx-0-21swapper/310:21:413
29715040,0irq/26-eth0-rx-0-21swapper/310:19:593
29715040,0irq/26-eth0-rx-0-21swapper/310:06:423
29715040,0irq/26-eth0-rx-0-21swapper/310:04:113
29715040,0irq/26-eth0-rx-0-21swapper/309:46:333
29715040,0irq/26-eth0-rx-0-21swapper/309:42:193
29715040,0irq/26-eth0-rx-0-21swapper/309:36:313
29715040,0irq/26-eth0-rx-0-21swapper/309:18:583
29715040,0irq/26-eth0-rx-0-21swapper/309:02:123
29715040,0irq/26-eth0-rx-0-21swapper/308:16:413
29715040,0irq/26-eth0-rx-0-21swapper/307:51:403
29715040,0irq/26-eth0-rx-0-21swapper/307:06:413
259940,0migration/2927-21kthreadcore06:51:432
259940,0migration/27469-21kthreadcore12:01:402
259940,0migration/27404-21aten_r1power_vo11:21:332
259940,0migration/26266-21kthreadcore07:21:412
259940,0migration/228510-21kthreadcore08:01:432
259940,0migration/223055-21fschecks_count11:51:392
259940,0migration/218931-21kthreadcore11:06:402
259940,0migration/21767-21kthreadcore07:41:422
259940,0migration/212022-21kthreadcore09:41:412
259940,0migration/211186-21kthreadcore11:01:422
249940,0watchdog/26780-21ssh10:37:062
249940,0watchdog/2350-21kthreadcore08:51:432
249940,0watchdog/228859-21kthreadcore09:31:422
249940,0watchdog/216398-21runrttasks07:29:272
249940,0watchdog/20-21swapper/209:06:432
249940,0watchdog/20-21swapper/207:36:392
213659943,0cyclictest6308-21awk08:11:392
213659943,0cyclictest483-21awk08:31:402
213659943,0cyclictest3556-21lldpd11:34:352
213659943,0cyclictest3556-21lldpd11:16:362
213659943,0cyclictest3556-21lldpd10:46:352
213659943,0cyclictest3556-21lldpd10:01:352
213659943,0cyclictest3556-21lldpd08:57:052
213659943,0cyclictest3556-21lldpd08:26:342
213659943,0cyclictest3556-21lldpd07:51:332
213659943,0cyclictest3556-21lldpd07:33:342
213659943,0cyclictest3556-21lldpd07:21:042
213659943,0cyclictest3374-21awk06:56:402
213659943,0cyclictest31623-21ps11:56:402
213659943,0cyclictest25176-21sadc08:26:252
213659943,0cyclictest22510-21awk06:46:402
213659943,0cyclictest13946-21awk08:41:402
213659940,0cyclictest0-21swapper/210:56:252
213649943,0cyclictest7310-21awk08:36:391
213649943,0cyclictest3514-21snmpd11:49:101
213649943,0cyclictest3514-21snmpd11:32:101
213649943,0cyclictest3514-21snmpd11:27:101
213649943,0cyclictest3514-21snmpd10:39:091
213649943,0cyclictest3514-21snmpd09:40:541
213649943,0cyclictest3514-21snmpd08:20:391
213649943,0cyclictest3514-21snmpd08:12:091
213649943,0cyclictest3514-21snmpd08:09:091
213649943,0cyclictest3514-21snmpd07:45:091
213649943,0cyclictest3514-21snmpd07:02:091
213649943,0cyclictest3514-21snmpd06:47:091
213649943,0cyclictest29139-21awk06:51:401
213649943,0cyclictest26964-21awk09:51:411
213649943,0cyclictest17330-21awk10:46:391
213649943,0cyclictest10991-21awk07:26:391
213639944,0cyclictest0-21swapper/011:36:110
213639943,0cyclictest3556-21lldpd11:39:050
213639943,0cyclictest3514-21snmpd08:29:240
213639943,0cyclictest3514-21snmpd08:23:090
213639943,0cyclictest3514-21snmpd07:48:390
213639943,0cyclictest3514-21snmpd07:19:540
213639943,0cyclictest3241-21irqbalance10:48:320
213639943,0cyclictest3241-21irqbalance10:38:520
213639943,0cyclictest3241-21irqbalance10:10:320
213639943,0cyclictest27662-21awk09:31:410
213639943,0cyclictest21274-21tr09:46:410
213639943,0cyclictest17232-21kworker/0:211:28:270
179940,0migration/15981-21unixbench-2d10:56:461
179940,0migration/15826-21kthreadcore09:56:421
179940,0migration/15826-21kthreadcore09:56:421
179940,0migration/129567-21kthreadcore08:01:431
179940,0migration/124673-21kthreadcore08:46:421
179940,0migration/123271-21kthreadcore09:06:421
179940,0migration/120952-21kthreadcore07:31:421
179940,0migration/119344-21kthreadcore07:56:411
179940,0migration/118765-21fschecks_time09:46:371
179940,0migration/115063-21timerwakeupswit10:21:491
179940,0migration/113452-21kthreadcore09:01:421
179940,0migration/111848-21hddtemp_smartct07:51:391
179940,0migration/111227-21kthreadcore11:01:421
179940,0migration/111047-21kthreadcore12:01:421
179940,0migration/110616-21taskset07:48:551
169940,0watchdog/17237-21ssh11:21:301
169940,0watchdog/14967-21proc_pri11:16:461
169940,0watchdog/129978-21if_err_eth007:16:391
169940,0watchdog/1288372sleep107:15:431
169940,0watchdog/127322-21cat10:51:421
169940,0watchdog/124962-21ssh10:10:261
169940,0watchdog/121746-21unixbench-2d07:06:471
169940,0watchdog/10-21swapper/112:06:421
169940,0watchdog/10-21swapper/109:31:421
169940,0watchdog/10-21swapper/108:51:431
169940,0watchdog/10-21swapper/108:41:431
169940,0watchdog/10-21swapper/106:56:431
149940,0migration/026575-21fschecks_count09:51:390
149940,0migration/024855-21kthreadcore07:11:420
149940,0migration/017898-21kthreadcore08:41:430
339930,0migration/33487-21aten_r1power_en07:21:353
29715030,0irq/26-eth0-rx-0-21swapper/308:36:353
29715030,0irq/26-eth0-rx-0-21swapper/308:23:333
29715030,0irq/26-eth0-rx-0-21swapper/308:06:463
29715030,0irq/26-eth0-rx-0-21swapper/307:46:363
213659932,0cyclictest3556-21lldpd07:13:032
213659932,0cyclictest16723-21awk07:06:392
213649932,0cyclictest3514-21snmpd08:32:391
213649932,0cyclictest3514-21snmpd07:26:091
213639933,0cyclictest8780-21kworker/0:110:41:270
213639933,0cyclictest8780-21kworker/0:110:26:290
213639933,0cyclictest17232-21kworker/0:211:56:290
213639933,0cyclictest17232-21kworker/0:211:06:270
213639933,0cyclictest1677-21kworker/0:110:01:250
213639933,0cyclictest1677-21kworker/0:109:26:280
213639933,0cyclictest1677-21kworker/0:109:21:460
213639933,0cyclictest1677-21kworker/0:109:11:260
213639933,0cyclictest1677-21kworker/0:109:06:260
213639933,0cyclictest1677-21kworker/0:108:56:260
213639933,0cyclictest1677-21kworker/0:108:36:260
213639933,0cyclictest1677-21kworker/0:107:21:280
213639933,0cyclictest1677-21kworker/0:107:06:320
213639933,0cyclictest1677-21kworker/0:106:51:320
213639932,0cyclictest4842-21sh09:56:420
213639932,0cyclictest4842-21sh09:56:420
179930,0migration/127173-21sh09:11:321
169930,0watchdog/10-21swapper/112:11:381
169930,0watchdog/10-21swapper/108:56:431
149930,0migration/032320-21runrttasks10:56:340
339920,0migration/323867-21diskstats07:36:383
29715020,0irq/26-eth0-rx-0-21swapper/306:46:403
213659921,0cyclictest8963-21latency_hist07:01:252
213649920,0cyclictest19507-21diskmemload09:16:331
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional