You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 16:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Jul 05, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
523826867,0sleep00-21swapper/006:50:330
516224847,0sleep10-21swapper/106:49:421
516923625,0sleep30-21swapper/306:49:483
523023228,0sleep20-21swapper/206:50:272
8215060,0irq/24-0000:00:3520-21munin-run08:50:422
53209960,0cyclictest5733-21tr11:10:581
35160,0ktimersoftd/30-21swapper/309:34:033
339960,0migration/34275-21munin-node11:10:553
339960,0migration/32759-21sh09:47:583
339960,0migration/327155-21sh10:44:143
339960,0migration/325990-21sh11:01:233
339960,0migration/325719-21sh11:41:363
339960,0migration/32268-21sh11:28:483
339960,0migration/321572-21turbostat08:15:423
339960,0migration/319340-21sh09:38:503
339960,0migration/318844-21sh11:40:053
339960,0migration/318108-21sh10:56:473
339960,0migration/313074-21kthreadcore08:55:583
339960,0migration/311893-21latency_hist10:15:413
179960,0migration/128216-21idleruntime-cro08:20:421
149960,0migration/05985-21kthreadcore10:30:590
149960,0migration/04774-21gltestperf09:50:550
149960,0migration/016713-21sh11:36:000
149960,0migration/011162-21sh09:13:150
53219955,0cyclictest0-21swapper/211:42:202
53219955,0cyclictest0-21swapper/211:32:052
53219955,0cyclictest0-21swapper/210:37:042
53219955,0cyclictest0-21swapper/209:27:042
53199954,0cyclictest3514-21snmpd11:58:370
53199954,0cyclictest14891-21idleruntime-cro08:10:420
4150,0ktimersoftd/00-21swapper/009:03:370
339950,0migration/37879-21kthreadcore09:50:593
339950,0migration/37371-21kthreadcore12:10:583
339950,0migration/36097-21kthreadcore09:11:003
339950,0migration/33795-21aten_r1power_en10:30:533
339950,0migration/33793-21aten_r1power_cu08:50:523
339950,0migration/3313-21taskset07:34:433
339950,0migration/33109-21sh10:50:043
339950,0migration/327361-21munin-node12:05:533
339950,0migration/325338-21kthreadcore10:21:013
339950,0migration/322558-21kthreadcore12:00:573
339950,0migration/321520-21kthreadcore10:00:583
339950,0migration/321262-21munin-node09:00:563
339950,0migration/317337-21taskset12:16:333
339950,0migration/317050-21kthreadcore07:21:003
339950,0migration/315789-21taskset08:34:283
339950,0migration/314071-21latency_hist07:45:423
339950,0migration/311895-21munin-node07:16:033
29725050,0irq/27-eth0-tx-4226-21hostname11:10:552
29725050,0irq/27-eth0-tx-28634-21diskstats10:05:542
29725050,0irq/27-eth0-tx-27951-21munin-node10:46:052
29725050,0irq/27-eth0-tx-24104-21cut09:00:582
29725050,0irq/27-eth0-tx-2102-21yum09:46:072
29725050,0irq/27-eth0-tx-20808-21munin-node07:50:540
29725050,0irq/27-eth0-tx-12596-21fschecks_count09:55:532
29725050,0irq/27-eth0-tx-12007-21munin-node10:16:042
29725050,0irq/27-eth0-tx-11716-21aten_r1power_cu10:55:522
29725050,0irq/27-eth0-tx-11305-21munin-node11:36:002
29725050,0irq/27-eth0-tx-11231-21munin-node11:55:582
29725050,0irq/27-eth0-tx-0-21swapper/212:12:312
29725050,0irq/27-eth0-tx-0-21swapper/210:53:082
29725050,0irq/27-eth0-tx-0-21swapper/210:29:122
29725050,0irq/27-eth0-tx-0-21swapper/210:13:102
29725050,0irq/27-eth0-tx-0-21swapper/209:16:082
29725050,0irq/27-eth0-tx-0-21swapper/007:46:040
29725050,0irq/27-eth0-tx-0-21swapper/007:20:540
29715050,0irq/26-eth0-rx-5194-21kthreadcore11:51:003
29715050,0irq/26-eth0-rx-3514-21snmpd09:07:503
29715050,0irq/26-eth0-rx-32421-21kthreadcore09:25:583
29715050,0irq/26-eth0-rx-29082-21kernelversion11:05:573
29715050,0irq/26-eth0-rx-2497-21ssh11:49:513
29715050,0irq/26-eth0-rx-17748-21rm11:16:203
29715050,0irq/26-eth0-rx-0-21swapper/311:31:003
29715050,0irq/26-eth0-rx-0-21swapper/311:21:223
29715050,0irq/26-eth0-rx-0-21swapper/310:36:323
29715050,0irq/26-eth0-rx-0-21swapper/310:26:523
29715050,0irq/26-eth0-rx-0-21swapper/310:10:543
29715050,0irq/26-eth0-rx-0-21swapper/309:20:573
29715050,0irq/26-eth0-rx-0-21swapper/309:20:573
29715050,0irq/26-eth0-rx-0-21swapper/309:16:483
29715050,0irq/26-eth0-rx-0-21swapper/307:05:593
259950,0migration/26845-21kthreadcore11:51:002
259950,0migration/230775-21mdstat07:06:002
259950,0migration/225421-21mdstat10:21:012
259950,0migration/225338-21munin-node07:26:022
259950,0migration/225264-21kthreadcore09:40:592
259950,0migration/222515-21kthreadcore09:20:582
259950,0migration/222515-21kthreadcore09:20:582
259950,0migration/213121-21kthreadcore08:55:582
259950,0migration/211639-21latency_hist10:35:412
19150,0ktimersoftd/10-21swapper/109:11:371
179950,0migration/19030-21kthreadcore07:16:011
179950,0migration/17561-21aten_r1power_po07:40:541
179950,0migration/14168-21aten_r1power_en09:30:531
179950,0migration/119805-21latency_hist10:20:411
149950,0migration/0595-21kthreadcore08:20:590
149950,0migration/05492-21kthreadcore08:25:590
149950,0migration/05373-21kthreadcore08:00:580
149950,0migration/04368-21fschecks_time08:50:550
149950,0migration/029927-21fschecks_count08:45:560
149950,0migration/028949-21kernelversion11:25:580
149950,0migration/028204-21latency_hist09:25:420
149950,0migration/028204-21latency_hist09:25:420
149950,0migration/027598-21sh10:04:440
149950,0migration/025284-21sh11:01:000
149950,0migration/025280-21kthreadcore10:21:000
149950,0migration/023996-21kthreadcore09:40:590
149950,0migration/02364-21taskset10:27:490
149950,0migration/022426-21kthreadcore07:25:590
149950,0migration/021796-21munin-node08:36:040
149950,0migration/015405-21kthreadcore11:16:000
149950,0migration/015401-21kthreadcore08:55:590
149950,0migration/015129-21aten_r1power_cu08:10:530
149950,0migration/015059-21kthreadcore10:55:580
149950,0migration/01501-21munin-node09:46:010
149950,0migration/013325-21kthreadcore12:15:580
149950,0migration/01324-21taskset07:59:110
13066250,0sleep012155-21munin-node09:55:570
8215040,0irq/24-0000:00:13896-21latency_hist07:45:422
53219943,0cyclictest3556-21lldpd07:58:362
53219943,0cyclictest3514-21snmpd08:42:052
53219943,0cyclictest3514-21snmpd08:34:352
53219943,0cyclictest3514-21snmpd08:17:052
53219943,0cyclictest3514-21snmpd08:13:052
53219943,0cyclictest3514-21snmpd07:43:352
53219943,0cyclictest3514-21snmpd07:40:352
53219943,0cyclictest28597-21awk11:25:572
53219943,0cyclictest21715-21awk07:50:572
53209943,0cyclictest9410-21awk08:05:561
53209943,0cyclictest3556-21lldpd07:13:361
53209943,0cyclictest3514-21snmpd12:02:521
53209943,0cyclictest3514-21snmpd11:50:521
53209943,0cyclictest3514-21snmpd11:40:521
53209943,0cyclictest3514-21snmpd11:22:521
53209943,0cyclictest3514-21snmpd11:05:521
53209943,0cyclictest3514-21snmpd11:03:521
53209943,0cyclictest3514-21snmpd10:56:521
53209943,0cyclictest3514-21snmpd10:46:211
53209943,0cyclictest3514-21snmpd10:28:211
53209943,0cyclictest3514-21snmpd09:23:351
53209943,0cyclictest3514-21snmpd09:23:351
53209943,0cyclictest3514-21snmpd06:56:051
53209943,0cyclictest29144-21awk09:05:571
53209943,0cyclictest29079-21awk10:05:561
53209943,0cyclictest23622-21awk08:40:571
53199943,0cyclictest4110-21awk11:50:580
53199943,0cyclictest3556-21lldpd08:44:060
53199943,0cyclictest3514-21snmpd10:37:510
53199943,0cyclictest3514-21snmpd07:42:050
53199943,0cyclictest3514-21snmpd07:02:050
53199943,0cyclictest3241-21irqbalance12:12:390
53199943,0cyclictest3241-21irqbalance11:05:500
53199943,0cyclictest3241-21irqbalance09:15:500
53199943,0cyclictest26188-21kworker/0:012:02:280
53199943,0cyclictest26188-21kworker/0:011:46:020
53199943,0cyclictest26188-21kworker/0:011:30:570
53199943,0cyclictest26188-21kworker/0:009:33:110
53199943,0cyclictest1630-21awk07:35:570
53199943,0cyclictest13157-21awk09:35:570
53199943,0cyclictest13077-21awk06:55:560
339940,0migration/39016-21kthreadcore07:40:593
339940,0migration/36337-21proc_pri07:36:023
339940,0migration/36052-21fschecks_count06:50:563
339940,0migration/324465-21kthreadcore08:16:003
339940,0migration/315501-21kthreadcore09:55:583
339940,0migration/310043-21diskmemload10:51:463
29725040,0irq/27-eth0-tx-3525-21diskmemload11:00:552
29725040,0irq/27-eth0-tx-19262-21munin-node12:01:042
29725040,0irq/27-eth0-tx-0-21swapper/212:15:492
29725040,0irq/27-eth0-tx-0-21swapper/211:46:012
29725040,0irq/27-eth0-tx-0-21swapper/211:21:382
29725040,0irq/27-eth0-tx-0-21swapper/211:15:442
29725040,0irq/27-eth0-tx-0-21swapper/211:05:582
29725040,0irq/27-eth0-tx-0-21swapper/210:40:462
29725040,0irq/27-eth0-tx-0-21swapper/209:51:132
29725040,0irq/27-eth0-tx-0-21swapper/209:30:492
29725040,0irq/27-eth0-tx-0-21swapper/209:10:452
29725040,0irq/27-eth0-tx-0-21swapper/209:05:542
29725040,0irq/27-eth0-tx-0-21swapper/008:15:580
29715040,0irq/26-eth0-rx-29016-21ssh10:05:563
29715040,0irq/26-eth0-rx-0-21swapper/311:58:333
29715040,0irq/26-eth0-rx-0-21swapper/309:40:593
29715040,0irq/26-eth0-rx-0-21swapper/308:45:543
259940,0migration/28350-21kthreadcore08:50:592
259940,0migration/26842-21kthreadcore08:25:592
259940,0migration/231322-21kthreadcore08:20:592
259940,0migration/228644-21kthreadcore07:30:562
259940,0migration/222939-21kthreadcore07:01:002
259940,0migration/222503-21runrttasks08:40:282
259940,0migration/220671-21fschecks_count10:00:542
259940,0migration/213516-21kthreadcore08:05:592
249940,0watchdog/232138-21kthreadcore12:05:592
249940,0watchdog/216779-21kthreadcore07:21:002
249940,0watchdog/212873-21chrt07:19:562
249940,0watchdog/20-21swapper/209:35:482
249940,0watchdog/20-21swapper/206:50:562
179940,0migration/19515-21switchtime10:51:031
179940,0migration/16315-21kthreadcore08:50:591
179940,0migration/14863-21sshd07:35:591
179940,0migration/14691-21fschecks_time09:50:551
179940,0migration/13360-21fschecks_time08:25:551
179940,0migration/13274-21cpuspeed_turbos12:10:531
179940,0migration/131619-21kthreadcore09:25:581
179940,0migration/131598-21taskset07:07:211
179940,0migration/131060-21kthreadcore11:25:591
179940,0migration/127557-21taskset10:25:051
179940,0migration/123806-21kthreadcore09:00:571
179940,0migration/121398-21taskset08:13:491
179940,0migration/120168-21sh10:00:491
179940,0migration/119843-21aten_r1power_cu07:25:531
179940,0migration/115825-21kthreadcore11:55:581
179940,0migration/115646-21kthreadcore12:15:581
179940,0migration/115160-21kthreadcore07:21:001
179940,0migration/115030-21kthreadcore09:15:581
179940,0migration/113989-21kthreadcore11:15:591
179940,0migration/113602-21kthreadcore10:35:581
179940,0migration/112365-21kthreadcore08:30:591
179940,0migration/112142-21latency_hist09:35:421
169940,0watchdog/1942-21kthreadcore08:46:001
169940,0watchdog/127423-21ssh11:45:471
169940,0watchdog/127263-21ssh12:05:431
169940,0watchdog/119235-21ssh09:58:481
169940,0watchdog/118058-21ssh11:37:511
169940,0watchdog/11730-21aten_r1power_en08:00:521
169940,0watchdog/11333-21load09:46:001
169940,0watchdog/110777-21ssh11:34:591
169940,0watchdog/10-21swapper/110:31:001
169940,0watchdog/10-21swapper/107:45:561
169940,0watchdog/10-21swapper/107:30:561
169940,0watchdog/10-21swapper/106:50:561
149940,0migration/030157-21kthreadcore10:05:580
149940,0migration/027588-21irqcore07:30:560
149940,0migration/026140-21sh11:22:170
149940,0migration/026023-21diskmemload11:42:250
149940,0migration/02302-21sh09:26:290
149940,0migration/022734-21kthreadcore10:41:000
149940,0migration/01549-21kthreadcore07:10:590
149940,0migration/010592-21irqcore08:30:580
9475230,0sleep30-21swapper/308:05:583
53219932,0cyclictest3514-21snmpd08:01:352
53209933,0cyclictest3556-21lldpd07:59:361
53209933,0cyclictest0-21swapper/107:02:011
53209932,0cyclictest9719-21sensors10:11:021
53209932,0cyclictest20750-21awk10:40:581
53199933,0cyclictest26188-21kworker/0:011:10:470
53199933,0cyclictest26188-21kworker/0:010:50:430
53199933,0cyclictest26188-21kworker/0:010:10:550
53199933,0cyclictest13307-21kworker/0:209:05:570
53199933,0cyclictest13307-21kworker/0:207:16:000
53199933,0cyclictest13307-21kworker/0:207:05:580
53199932,0cyclictest28824-21awk10:45:560
53199932,0cyclictest28356-21irqcore12:05:580
53199930,0cyclictest0-21swapper/010:15:490
53199930,0cyclictest0-21swapper/006:50:560
339930,0migration/35805-21kthreadcore08:25:593
29715030,0irq/26-eth0-rx-0-21swapper/308:40:553
29715030,0irq/26-eth0-rx-0-21swapper/308:01:103
29715030,0irq/26-eth0-rx-0-21swapper/307:56:023
29715030,0irq/26-eth0-rx-0-21swapper/307:50:563
29715030,0irq/26-eth0-rx-0-21swapper/307:25:533
29715030,0irq/26-eth0-rx-0-21swapper/307:11:003
29715030,0irq/26-eth0-rx-0-21swapper/307:00:543
29715030,0irq/26-eth0-rx-0-21swapper/306:55:533
249930,0watchdog/20-21swapper/206:56:042
179930,0migration/121674-21if_err_eth1.207:50:561
179930,0migration/116302-21cpu08:35:531
179930,0migration/111718-21sh08:55:521
169930,0watchdog/10-21swapper/109:41:161
53219921,0cyclictest6559-21runrttasks07:10:442
29715020,0irq/26-eth0-rx-0-21swapper/308:35:533
29715020,0irq/26-eth0-rx-0-21swapper/308:20:533
169920,0watchdog/10-21swapper/108:20:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional