You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 22:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sun Jun 14, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1829324029,0sleep00-21swapper/006:49:340
1825723726,0sleep30-21swapper/306:49:133
1219423728,0sleep20-21swapper/206:47:522
1218823329,0sleep10-21swapper/106:47:471
339960,0migration/36750-21sh11:45:113
339960,0migration/36540-21munin-node07:28:063
339960,0migration/330473-21munin-node07:48:023
339960,0migration/323974-21sh09:35:173
339960,0migration/323125-21sh10:13:363
339960,0migration/316317-21taskset10:12:153
29725060,0irq/27-eth0-tx-21726-21munin-node08:08:020
29725060,0irq/27-eth0-tx-16316-21munin-node11:12:552
29715060,0irq/26-eth0-rx-6565-21awk09:43:043
29715060,0irq/26-eth0-rx-10372-21iostat_ios08:22:583
186369965,0cyclictest24140-21ssh09:56:082
149960,0migration/030035-21taskset12:18:280
149960,0migration/023382-21kthreadcore07:17:590
149960,0migration/016445-21sh09:52:110
149960,0migration/013814-21sh10:48:010
35150,0ktimersoftd/30-21swapper/310:32:263
339950,0migration/38964-21sh09:47:573
339950,0migration/37779-21aten_r1power_cu12:07:513
339950,0migration/36478-21kthreadcore08:42:593
339950,0migration/33416-21hddtemp_smartct08:17:563
339950,0migration/331061-21kthreadcore07:23:003
339950,0migration/330792-21runrttasks10:58:323
339950,0migration/325274-21sh09:17:443
339950,0migration/323923-21aten_r1power_vo12:17:533
339950,0migration/322294-21fschecks_time08:07:573
339950,0migration/321518-21kthreadcore08:53:013
339950,0migration/320940-21kthreadcore09:13:003
339950,0migration/317544-21irqcore10:52:563
339950,0migration/316891-21cpuspeed_turbos10:32:543
339950,0migration/316603-21taskset12:12:543
339950,0migration/316345-21sh11:12:513
339950,0migration/314218-21timerandwakeup11:08:053
339950,0migration/313663-21munin-node11:28:023
339950,0migration/313353-21kthreadcore09:08:003
339950,0migration/313097-21kthreadcore11:47:593
339950,0migration/312401-21kthreadcore07:33:003
29725050,0irq/27-eth0-tx-532-21munin-node10:02:542
29725050,0irq/27-eth0-tx-437-21if_err_eth112:02:562
29725050,0irq/27-eth0-tx-28790-21kthreadcore11:57:582
29725050,0irq/27-eth0-tx-25966-21iostat_ios08:57:582
29725050,0irq/27-eth0-tx-16408-21ssh10:52:432
29725050,0irq/27-eth0-tx-0-21swapper/212:13:292
29725050,0irq/27-eth0-tx-0-21swapper/211:55:022
29725050,0irq/27-eth0-tx-0-21swapper/211:48:362
29725050,0irq/27-eth0-tx-0-21swapper/008:54:210
29725050,0irq/27-eth0-tx-0-21swapper/008:12:550
29715050,0irq/26-eth0-rx-8229-21ssh10:27:293
29715050,0irq/26-eth0-rx-25307-21irqcore11:37:583
29715050,0irq/26-eth0-rx-0-21swapper/312:03:043
29715050,0irq/26-eth0-rx-0-21swapper/311:57:513
29715050,0irq/26-eth0-rx-0-21swapper/311:20:153
29715050,0irq/26-eth0-rx-0-21swapper/310:44:093
29715050,0irq/26-eth0-rx-0-21swapper/310:42:323
29715050,0irq/26-eth0-rx-0-21swapper/309:57:593
29715050,0irq/26-eth0-rx-0-21swapper/309:52:463
29715050,0irq/26-eth0-rx-0-21swapper/309:27:423
29715050,0irq/26-eth0-rx-0-21swapper/309:03:453
29715050,0irq/26-eth0-rx-0-21swapper/308:58:293
29715050,0irq/26-eth0-rx-0-21swapper/308:48:023
29715050,0irq/26-eth0-rx-0-21swapper/308:37:573
29715050,0irq/26-eth0-rx-0-21swapper/308:27:533
29715050,0irq/26-eth0-rx-0-21swapper/308:27:533
259950,0migration/27075-21taskset11:25:352
259950,0migration/26613-21timerwakeupswit07:28:062
259950,0migration/231886-21sh09:19:202
259950,0migration/227419-21switchtime08:08:062
259950,0migration/225460-21fschecks_count09:57:552
259950,0migration/217789-21fschecks_time09:12:562
259950,0migration/217064-21sh08:52:542
259950,0migration/214156-21munin-node10:28:022
249950,0watchdog/231368-21sh09:38:292
249950,0watchdog/213788-21netstat07:58:012
19150,0ktimersoftd/10-21swapper/110:31:331
186369955,0cyclictest16754-21diskmemload11:43:302
186369955,0cyclictest0-21swapper/210:08:162
186369950,0cyclictest0-21swapper/210:19:182
186349950,0cyclictest0-21swapper/111:52:261
186349950,0cyclictest0-21swapper/109:09:251
179950,0migration/17752-21munin-node07:53:061
179950,0migration/15413-21munin-node07:03:041
179950,0migration/112660-21kthreadcore10:48:001
169950,0watchdog/130384-21unixbench_multi11:18:041
169950,0watchdog/113447-21latency11:28:001
149950,0migration/09256-21latency_hist08:22:430
149950,0migration/07408-21if_eth107:07:580
149950,0migration/07384-21munin-node07:53:040
149950,0migration/05152-21kthreadcore08:42:590
149950,0migration/0467-21hwlatdetect07:02:580
149950,0migration/03852-21kthreadcore10:42:580
149950,0migration/031883-21runrttasks07:02:260
149950,0migration/028461-21irqcore07:48:010
149950,0migration/027707-21kthreadcore09:57:590
149950,0migration/026368-21sendmail_mailqu07:43:060
149950,0migration/026339-21munin-node09:17:580
149950,0migration/025443-21cpuspeed_turbos09:37:550
149950,0migration/023839-21sh09:14:280
149950,0migration/022643-21latency_hist08:32:430
149950,0migration/022605-21taskset11:54:280
149950,0migration/019902-21kthreadcore09:52:590
149950,0migration/017778-21irqcore10:32:580
149950,0migration/017330-21kthreadcore08:27:580
149950,0migration/017330-21kthreadcore08:27:580
149950,0migration/015848-21sh09:30:040
149950,0migration/012661-21kthreadcore11:28:000
149950,0migration/010007-21kthreadcore07:57:590
339940,0migration/329347-21kthreadcore06:58:013
339940,0migration/323335-21fschecks_time08:32:563
339940,0migration/320355-21kthreadcore11:32:593
339940,0migration/315041-21runrttasks08:02:483
29725040,0irq/27-eth0-tx-8900-21munin-node09:48:072
29725040,0irq/27-eth0-tx-2054-21kthreadcore09:42:592
29725040,0irq/27-eth0-tx-1219-21ssh10:22:562
29725040,0irq/27-eth0-tx-0-21swapper/212:17:462
29725040,0irq/27-eth0-tx-0-21swapper/211:38:032
29725040,0irq/27-eth0-tx-0-21swapper/211:33:352
29725040,0irq/27-eth0-tx-0-21swapper/211:27:542
29725040,0irq/27-eth0-tx-0-21swapper/211:03:522
29725040,0irq/27-eth0-tx-0-21swapper/210:58:222
29725040,0irq/27-eth0-tx-0-21swapper/210:44:572
29725040,0irq/27-eth0-tx-0-21swapper/210:12:592
29725040,0irq/27-eth0-tx-0-21swapper/209:24:022
29715040,0irq/26-eth0-rx-0-21swapper/311:52:553
29715040,0irq/26-eth0-rx-0-21swapper/311:22:473
29715040,0irq/26-eth0-rx-0-21swapper/311:02:533
29715040,0irq/26-eth0-rx-0-21swapper/310:48:073
29715040,0irq/26-eth0-rx-0-21swapper/310:19:093
29715040,0irq/26-eth0-rx-0-21swapper/310:02:593
29715040,0irq/26-eth0-rx-0-21swapper/309:37:543
29715040,0irq/26-eth0-rx-0-21swapper/309:22:523
29715040,0irq/26-eth0-rx-0-21swapper/307:57:593
29715040,0irq/26-eth0-rx-0-21swapper/307:08:003
29715040,0irq/26-eth0-rx-0-21swapper/307:02:543
259940,0migration/29397-21switchtime08:43:042
259940,0migration/29346-21cpuspeed_turbos09:27:542
259940,0migration/27425-21runrttasks07:32:442
259940,0migration/232151-21aten_r1power_cu07:02:542
259940,0migration/230516-21kthreadcore07:48:022
259940,0migration/229807-21kthreadcore08:12:592
259940,0migration/226668-21irqcore06:57:592
259940,0migration/224412-21kthreadcore08:32:592
259940,0migration/219355-21runrttasks07:15:192
259940,0migration/218557-21kthreadcore09:32:592
259940,0migration/217673-21kthreadcore08:02:592
259940,0migration/21041-21kthreadcore08:37:582
249940,0watchdog/222150-21kthreadcore07:43:012
249940,0watchdog/21560-21munin-node09:02:572
249940,0watchdog/211574-21kthreadcore10:48:002
249940,0watchdog/20-21swapper/210:37:522
186369944,0cyclictest0-21swapper/209:08:032
186369943,0cyclictest8613-21awk12:07:542
186369943,0cyclictest3556-21lldpd06:52:592
186369943,0cyclictest3514-21snmpd08:26:372
186369943,0cyclictest3514-21snmpd07:56:372
186369943,0cyclictest3514-21snmpd07:24:222
186369943,0cyclictest3514-21snmpd07:22:222
186369943,0cyclictest25362-21awk11:17:572
186369943,0cyclictest22426-21sadc08:32:432
186369943,0cyclictest22426-21sadc08:32:432
186369943,0cyclictest17479-21awk10:32:562
186369943,0cyclictest14980-21awk07:37:582
186369941,0cyclictest0-21swapper/211:07:532
186349944,0cyclictest0-21swapper/110:32:491
186349944,0cyclictest0-21swapper/109:41:161
186349943,0cyclictest9930-21awk09:27:571
186349943,0cyclictest9708-21awk10:07:591
186349943,0cyclictest957-21awk11:22:591
186349943,0cyclictest4594-21awk08:42:571
186349943,0cyclictest3556-21lldpd12:09:001
186349943,0cyclictest3556-21lldpd11:41:291
186349943,0cyclictest3556-21lldpd11:13:591
186349943,0cyclictest3556-21lldpd11:08:281
186349943,0cyclictest3556-21lldpd10:38:591
186349943,0cyclictest3556-21lldpd08:57:591
186349943,0cyclictest3556-21lldpd07:42:591
186349943,0cyclictest3553-21awk08:17:571
186349943,0cyclictest3514-21snmpd09:44:371
186349943,0cyclictest24674-21awk12:17:561
186349943,0cyclictest20726-21awk07:17:571
186349943,0cyclictest17915-21awk09:32:571
186349943,0cyclictest17378-21awk10:52:551
186349943,0cyclictest16905-21awk08:27:571
186349943,0cyclictest16905-21awk08:27:571
186349943,0cyclictest16675-21awk12:12:551
186349943,0cyclictest16638-21sadc09:52:421
186349943,0cyclictest14911-21awk07:37:581
186339943,0cyclictest8825-21awk11:47:560
186339943,0cyclictest438-21awk12:02:560
186339943,0cyclictest3556-21lldpd10:26:290
186339943,0cyclictest3241-21irqbalance11:38:500
186339943,0cyclictest3241-21irqbalance11:13:200
186339943,0cyclictest3241-21irqbalance09:44:310
186339943,0cyclictest3241-21irqbalance09:33:110
186339943,0cyclictest3241-21irqbalance09:08:010
186339943,0cyclictest3241-21irqbalance09:07:110
186339943,0cyclictest24910-21awk11:57:550
186339943,0cyclictest19822-21awk06:52:570
186339943,0cyclictest17850-21kworker/0:211:08:490
186339943,0cyclictest17323-21awk10:52:550
186339940,0cyclictest0-21swapper/010:07:410
179940,0migration/1762-21kthreadcore08:13:001
179940,0migration/14447-21kthreadcore10:23:001
179940,0migration/13721-21kthreadcore10:42:581
179940,0migration/131075-21kthreadcore07:23:001
179940,0migration/130971-21taskset10:18:091
179940,0migration/127339-21kthreadcore06:58:001
179940,0migration/127293-21kthreadcore09:17:591
179940,0migration/124868-21df_abs10:57:531
179940,0migration/122363-21kthreadcore09:13:001
179940,0migration/121483-21runrttasks08:07:381
179940,0migration/121386-21kthreadcore06:52:591
179940,0migration/119804-21kthreadcore11:32:591
179940,0migration/119417-21kthreadcore09:52:591
169940,0watchdog/17202-21ssh11:05:281
169940,0watchdog/15513-21ps11:43:041
169940,0watchdog/10-21swapper/110:12:561
169940,0watchdog/10-21swapper/110:02:321
169940,0watchdog/10-21swapper/109:23:051
169940,0watchdog/10-21swapper/108:53:011
169940,0watchdog/10-21swapper/108:08:011
169940,0watchdog/10-21swapper/107:58:011
149940,0migration/09986-21runrttasks10:27:580
149940,0migration/07856-21sh09:25:060
149940,0migration/032351-21aten_r1power_vo11:42:540
149940,0migration/027963-21kthreadcore07:22:590
149940,0migration/025668-21kernelversion11:17:580
149940,0migration/021030-21kthreadcore10:12:570
149940,0migration/020552-21kthreadcore11:32:590
149940,0migration/01592-21kthreadcore11:23:000
149940,0migration/014818-21kthreadcore08:48:000
149940,0migration/01459-21kthreadcore11:02:580
149940,0migration/013130-21kthreadcore10:08:010
4130,0ktimersoftd/09364-21runrttasks08:22:490
29715030,0irq/26-eth0-rx-0-21swapper/308:14:443
29715030,0irq/26-eth0-rx-0-21swapper/307:53:463
29715030,0irq/26-eth0-rx-0-21swapper/307:43:233
29715030,0irq/26-eth0-rx-0-21swapper/307:38:413
29715030,0irq/26-eth0-rx-0-21swapper/307:17:533
29715030,0irq/26-eth0-rx-0-21swapper/307:15:223
259930,0migration/212109-21kthreadcore08:47:592
186369932,0cyclictest7413-21awk07:07:582
186369930,0cyclictest3983-21kthreadcore08:17:592
186349933,0cyclictest3556-21lldpd08:48:591
186349932,0cyclictest3556-21lldpd08:37:001
186349932,0cyclictest3556-21lldpd07:48:001
186349932,0cyclictest3556-21lldpd07:28:001
186349932,0cyclictest21755-21sensors11:53:021
186349932,0cyclictest18802-21sensors07:13:051
186349932,0cyclictest10237-21awk08:22:571
186349930,0cyclictest7833-21diskstats07:32:551
186339933,0cyclictest7656-21kworker/0:008:57:580
186339933,0cyclictest7656-21kworker/0:008:37:460
186339933,0cyclictest7656-21kworker/0:008:02:460
186339933,0cyclictest7656-21kworker/0:007:37:440
186339933,0cyclictest7656-21kworker/0:007:32:440
186339933,0cyclictest7656-21kworker/0:007:27:480
186339933,0cyclictest7656-21kworker/0:007:12:440
186339933,0cyclictest17850-21kworker/0:212:12:550
186339933,0cyclictest17850-21kworker/0:212:07:430
186339933,0cyclictest17850-21kworker/0:210:57:450
186339933,0cyclictest17850-21kworker/0:210:37:460
186339933,0cyclictest17850-21kworker/0:210:17:440
169930,0watchdog/116754-21diskmemload09:03:251
169930,0watchdog/112484-21ksmtuned07:08:131
169930,0watchdog/10-21swapper/112:03:041
169930,0watchdog/10-21swapper/112:01:201
169930,0watchdog/10-21swapper/110:03:041
169930,0watchdog/10-21swapper/108:37:531
29715020,0irq/26-eth0-rx-0-21swapper/306:52:493
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional