You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 23:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Sat May 16, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1174023829,0sleep10-21swapper/106:53:441
304450350,0irq/25-eth10-21swapper/306:51:353
1180223425,0sleep20-21swapper/206:54:252
1182523228,0sleep00-21swapper/006:54:430
339960,0migration/39261-21sh10:34:413
339960,0migration/39185-21sh10:13:393
339960,0migration/3696-21sh11:09:313
339960,0migration/324051-21sh11:42:233
339960,0migration/323797-21munin-node10:00:453
29725060,0irq/27-eth0-tx-8873-21munin-run11:55:282
29725060,0irq/27-eth0-tx-29412-21munin-node08:45:420
29725060,0irq/27-eth0-tx-21772-21munin-node08:15:480
29725060,0irq/27-eth0-tx-20814-21munin-node07:50:510
29715060,0irq/26-eth0-rx-2478-21hddtemp_smartct08:00:433
29715060,0irq/26-eth0-rx-18534-21diskstats10:20:413
29715060,0irq/26-eth0-rx-1541-21ssh09:08:273
29715060,0irq/26-eth0-rx-0-21swapper/309:16:053
149960,0migration/07513-21sh12:12:120
149960,0migration/016144-21sh11:37:470
119639963,0cyclictest10209-21awk08:55:280
8215050,0irq/24-0000:00:1663-21kthreadcore07:10:452
35150,0ktimersoftd/30-21swapper/309:35:193
35150,0ktimersoftd/30-21swapper/308:35:403
339950,0migration/37531-21taskset11:10:513
339950,0migration/37470-21munin-node07:15:453
339950,0migration/33375-21irqcore09:50:453
339950,0migration/331807-21taskset07:09:313
339950,0migration/329823-21kthreadcore09:45:463
339950,0migration/328880-21fschecks_count08:20:423
339950,0migration/328252-21kthreadcore10:45:443
339950,0migration/327325-21proc_pri08:15:483
339950,0migration/325398-21aten_r1power_cu11:45:373
339950,0migration/325034-21latency_hist12:05:283
339950,0migration/322970-21kthreadcore07:25:443
339950,0migration/31937-21munin-node10:50:413
339950,0migration/318608-21gltestperf10:40:423
339950,0migration/318301-21munin-node12:20:443
339950,0migration/317870-21munin-node06:55:513
339950,0migration/317678-21sh08:58:573
339950,0migration/311025-21kthreadcore10:55:423
29725050,0irq/27-eth0-tx-9821-21munin-node10:35:512
29725050,0irq/27-eth0-tx-7481-21munin-node07:40:520
29725050,0irq/27-eth0-tx-6656-21grep10:30:462
29725050,0irq/27-eth0-tx-3524-21sshd08:41:150
29725050,0irq/27-eth0-tx-3514-21snmpd08:03:150
29725050,0irq/27-eth0-tx-26677-21munin-node09:45:492
29725050,0irq/27-eth0-tx-17769-21ssh08:59:102
29725050,0irq/27-eth0-tx-17204-21munin-node12:00:452
29725050,0irq/27-eth0-tx-10102-21munin-node10:15:442
29725050,0irq/27-eth0-tx-0-21swapper/212:15:202
29725050,0irq/27-eth0-tx-0-21swapper/211:04:092
29725050,0irq/27-eth0-tx-0-21swapper/210:47:032
29725050,0irq/27-eth0-tx-0-21swapper/210:26:042
29725050,0irq/27-eth0-tx-0-21swapper/210:20:552
29725050,0irq/27-eth0-tx-0-21swapper/210:08:052
29725050,0irq/27-eth0-tx-0-21swapper/209:52:242
29725050,0irq/27-eth0-tx-0-21swapper/006:58:020
29715050,0irq/26-eth0-rx-6625-21rt-features12:10:493
29715050,0irq/26-eth0-rx-536-21if_err_eth1.307:10:433
29715050,0irq/26-eth0-rx-27865-21entropy07:55:423
29715050,0irq/26-eth0-rx-24961-21kthreadcore08:40:463
29715050,0irq/26-eth0-rx-2472-21cut11:50:443
29715050,0irq/26-eth0-rx-15565-21sh11:36:073
29715050,0irq/26-eth0-rx-14583-21kthreadcore11:15:453
29715050,0irq/26-eth0-rx-12291-21munin-node11:55:443
29715050,0irq/26-eth0-rx-0-21swapper/311:21:283
29715050,0irq/26-eth0-rx-0-21swapper/310:39:003
29715050,0irq/26-eth0-rx-0-21swapper/310:25:403
29715050,0irq/26-eth0-rx-0-21swapper/310:05:473
29715050,0irq/26-eth0-rx-0-21swapper/309:57:493
29715050,0irq/26-eth0-rx-0-21swapper/309:45:143
29715050,0irq/26-eth0-rx-0-21swapper/309:00:283
29715050,0irq/26-eth0-rx-0-21swapper/307:45:403
259950,0migration/28605-21sh10:53:192
259950,0migration/22181-21sh09:10:152
259950,0migration/221721-21kthreadcore09:40:432
249950,0watchdog/227487-21switchtime08:15:502
249950,0watchdog/216137-21cut07:20:472
179950,0migration/14840-21kthreadcore11:10:451
179950,0migration/132102-21munin-node07:30:511
179950,0migration/128761-21kthreadcore10:25:441
179950,0migration/123513-21runrttasks12:21:541
179950,0migration/123203-21sh12:00:501
179950,0migration/121695-21munin-node07:50:451
179950,0migration/113284-21aten2.4-expect07:20:411
169950,0watchdog/131703-21swap10:45:501
169950,0watchdog/131679-21kthreadcore07:55:461
169950,0watchdog/123486-21python11:00:501
149950,0migration/09683-21taskset11:55:400
149950,0migration/06421-21latency11:50:460
149950,0migration/05971-21kthreadcore10:10:450
149950,0migration/05100-21kthreadcore10:50:450
149950,0migration/0401-21sh09:46:030
149950,0migration/030391-21kthreadcore08:20:460
149950,0migration/029950-21kthreadcore11:25:450
149950,0migration/028900-21kthreadcore10:25:440
149950,0migration/028781-21kthreadcore12:05:450
149950,0migration/025056-21sh09:01:420
149950,0migration/024736-21taskset11:23:530
149950,0migration/022500-21kthreadcore09:20:470
149950,0migration/021042-21kthreadcore10:20:450
149950,0migration/020317-21kthreadcore11:40:440
149950,0migration/01748-21df_abs11:10:400
149950,0migration/017442-21taskset08:58:200
149950,0migration/016636-21kthreadcore07:20:470
149950,0migration/012260-21kthreadcore11:15:440
149950,0migration/01197-21taskset07:57:200
119669955,0cyclictest0-21swapper/211:30:502
119669950,0cyclictest0-21swapper/211:22:382
119669950,0cyclictest0-21swapper/210:42:542
119669950,0cyclictest0-21swapper/209:21:432
119659955,0cyclictest0-21swapper/110:53:561
119659955,0cyclictest0-21swapper/110:13:341
119659955,0cyclictest0-21swapper/110:07:161
119659955,0cyclictest0-21swapper/109:11:371
119659955,0cyclictest0-21swapper/109:01:311
119659954,0cyclictest3514-21snmpd10:18:071
119659954,0cyclictest3514-21snmpd09:15:521
119659950,0cyclictest0-21swapper/111:31:371
119659950,0cyclictest0-21swapper/111:19:001
119659950,0cyclictest0-21swapper/108:10:551
119659950,0cyclictest0-21swapper/107:44:161
119639955,0cyclictest0-21swapper/012:19:160
119639955,0cyclictest0-21swapper/010:47:210
119639955,0cyclictest0-21swapper/010:19:550
119639950,0cyclictest0-21swapper/009:14:200
8215040,0irq/24-0000:00:16902-21cat12:20:282
339940,0migration/38942-21runrttasks09:11:163
339940,0migration/324221-21kthreadcore09:20:473
339940,0migration/318780-21latency_hist07:00:283
339940,0migration/312450-21kthreadcore07:40:473
29725040,0irq/27-eth0-tx-9621-21munin-node10:55:382
29725040,0irq/27-eth0-tx-10684-21munin-node09:35:412
29725040,0irq/27-eth0-tx-10204-21diskmemload12:05:422
29725040,0irq/27-eth0-tx-0-21swapper/211:55:362
29725040,0irq/27-eth0-tx-0-21swapper/211:46:132
29725040,0irq/27-eth0-tx-0-21swapper/210:10:452
29725040,0irq/27-eth0-tx-0-21swapper/210:00:302
29725040,0irq/27-eth0-tx-0-21swapper/209:55:282
29725040,0irq/27-eth0-tx-0-21swapper/209:30:312
29725040,0irq/27-eth0-tx-0-21swapper/209:25:412
29725040,0irq/27-eth0-tx-0-21swapper/209:15:282
29725040,0irq/27-eth0-tx-0-21swapper/209:00:432
29725040,0irq/27-eth0-tx-0-21swapper/007:05:400
29715040,0irq/26-eth0-rx-0-21swapper/312:15:463
29715040,0irq/26-eth0-rx-0-21swapper/312:05:453
29715040,0irq/26-eth0-rx-0-21swapper/311:30:383
29715040,0irq/26-eth0-rx-0-21swapper/311:25:513
29715040,0irq/26-eth0-rx-0-21swapper/311:00:343
29715040,0irq/26-eth0-rx-0-21swapper/310:15:453
29715040,0irq/26-eth0-rx-0-21swapper/309:35:393
29715040,0irq/26-eth0-rx-0-21swapper/309:28:163
259940,0migration/29722-21munin-node12:15:422
259940,0migration/27464-21latency_hist07:40:282
259940,0migration/229698-21kthreadcore07:55:462
259940,0migration/229375-21kthreadcore07:30:472
259940,0migration/222800-21kthreadcore07:00:462
259940,0migration/221636-21munin-node07:50:442
259940,0migration/220365-21fschecks_time07:25:402
259940,0migration/217727-21df_abs11:40:392
259940,0migration/21327-21fschecks_time07:35:422
259940,0migration/211233-21kthreadcore11:15:442
249940,0watchdog/28732-21grep09:10:502
249940,0watchdog/25590-21kthreadcore08:50:462
249940,0watchdog/226853-21kthreadcore08:40:462
249940,0watchdog/20-21swapper/211:35:422
249940,0watchdog/20-21swapper/207:15:472
179940,0migration/19563-21fschecks_time12:15:411
179940,0migration/15352-21kthreadcore09:50:471
179940,0migration/15234-21kthreadcore12:10:451
179940,0migration/131361-21kthreadcore09:05:461
179940,0migration/12863-21kthreadcore07:35:451
179940,0migration/128586-21kthreadcore11:45:431
179940,0migration/121992-21kthreadcore07:25:441
179940,0migration/119342-21kthreadcore11:40:431
179940,0migration/118378-21cpuspeed_turbos10:20:411
169940,0watchdog/19128-21aten_r1power_cu11:55:381
169940,0watchdog/1885-21ssh09:26:341
169940,0watchdog/16875-21sensors11:50:501
169940,0watchdog/16870-21diskstats07:15:431
169940,0watchdog/14723-21kthreadcore08:00:461
169940,0watchdog/132322-21port_sshpriv09:45:501
169940,0watchdog/129130-21kthreadcore12:05:451
169940,0watchdog/127488-21switchtime08:15:501
169940,0watchdog/125079-21ssh09:20:541
169940,0watchdog/124214-21ssh10:41:221
169940,0watchdog/117505-21ssh11:20:341
169940,0watchdog/116469-21python09:35:501
169940,0watchdog/115255-21memory10:35:461
169940,0watchdog/10-21swapper/109:55:461
169940,0watchdog/10-21swapper/109:30:461
169940,0watchdog/10-21swapper/108:40:461
149940,0migration/08105-21munin-node09:50:500
149940,0migration/06002-21kthreadcore07:35:460
149940,0migration/021835-21switchtime08:35:500
149940,0migration/014593-21kthreadcore10:35:450
149940,0migration/014216-21kthreadcore09:15:450
119669944,0cyclictest0-21swapper/208:00:412
119669943,0cyclictest3556-21lldpd11:26:182
119669943,0cyclictest3556-21lldpd08:24:472
119669943,0cyclictest3514-21snmpd08:37:222
119669943,0cyclictest3514-21snmpd08:30:522
119669943,0cyclictest26613-21awk11:05:422
119669943,0cyclictest2250-21awk11:10:422
119659944,0cyclictest0-21swapper/108:07:171
119659943,0cyclictest5062-21tail08:50:461
119659943,0cyclictest3556-21lldpd10:56:171
119659943,0cyclictest3556-21lldpd08:37:171
119659943,0cyclictest3556-21lldpd08:26:471
119659943,0cyclictest3556-21lldpd07:13:171
119659943,0cyclictest3514-21snmpd08:32:371
119659943,0cyclictest3514-21snmpd07:02:071
119659943,0cyclictest30343-21awk08:45:431
119659943,0cyclictest2659-21awk10:30:431
119659943,0cyclictest26437-21awk11:25:421
119659943,0cyclictest26334-21awk07:05:431
119659943,0cyclictest2458-21sadc08:25:281
119659943,0cyclictest15074-21awk07:45:441
119659943,0cyclictest10247-21awk11:35:431
119639944,0cyclictest0-21swapper/009:36:430
119639943,0cyclictest3581-21awk08:25:420
119639943,0cyclictest3556-21lldpd07:28:170
119639943,0cyclictest27840-21awk09:25:430
119639943,0cyclictest19562-21awk09:40:410
119639943,0cyclictest18179-21awk12:00:420
119639943,0cyclictest1154-21kworker/0:211:07:270
119639943,0cyclictest1154-21kworker/0:211:03:350
119639943,0cyclictest1154-21kworker/0:209:06:190
119639943,0cyclictest11288-21awk09:55:420
119639943,0cyclictest10606-21awk10:55:410
29715030,0irq/26-eth0-rx-0-21swapper/308:45:503
29715030,0irq/26-eth0-rx-0-21swapper/308:30:473
29715030,0irq/26-eth0-rx-0-21swapper/308:25:393
29715030,0irq/26-eth0-rx-0-21swapper/308:10:403
29715030,0irq/26-eth0-rx-0-21swapper/308:05:383
29715030,0irq/26-eth0-rx-0-21swapper/307:50:413
29715030,0irq/26-eth0-rx-0-21swapper/307:39:323
29715030,0irq/26-eth0-rx-0-21swapper/307:33:043
29715030,0irq/26-eth0-rx-0-21swapper/307:25:073
249930,0watchdog/20-21swapper/208:05:382
249930,0watchdog/20-21swapper/207:05:432
169930,0watchdog/10-21swapper/111:07:501
169930,0watchdog/10-21swapper/106:55:311
119669932,0cyclictest3627-21awk08:25:422
119669932,0cyclictest30249-21awk08:45:432
119669932,0cyclictest14144-21munin-node07:45:412
119659932,0cyclictest21949-21cut09:40:431
119659932,0cyclictest19275-21awk10:00:421
119659932,0cyclictest10449-21munin-node08:55:441
119639933,0cyclictest15050-21awk07:45:440
119639933,0cyclictest1154-21kworker/0:212:20:450
119639933,0cyclictest1154-21kworker/0:210:30:370
119639933,0cyclictest1154-21kworker/0:210:05:450
119639933,0cyclictest1154-21kworker/0:209:30:470
119639933,0cyclictest1154-21kworker/0:208:10:400
119639933,0cyclictest1154-21kworker/0:208:05:460
119639933,0cyclictest1154-21kworker/0:207:30:420
119639933,0cyclictest1154-21kworker/0:207:15:420
119639933,0cyclictest1154-21kworker/0:207:11:280
119639933,0cyclictest1154-21kworker/0:207:00:460
119639932,0cyclictest28163-21grep11:45:430
119639932,0cyclictest2218-21awk11:30:430
119639932,0cyclictest22011-21cut10:40:460
119639932,0cyclictest1154-21kworker/0:210:00:370
119639930,0cyclictest9465-21munin-node08:30:400
29715020,0irq/26-eth0-rx-0-21swapper/308:50:423
249920,0watchdog/20-21swapper/206:55:312
119669921,0cyclictest0-21swapper/208:10:312
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional