You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 00:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Dec 26, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
314429190,0sleep10-21swapper/107:07:541
304450660,0irq/25-eth10-21swapper/307:05:183
321723627,0sleep20-21swapper/207:08:432
297423423,0sleep00-21swapper/007:05:560
32949970,0cyclictest14195-21grep09:14:021
35160,0ktimersoftd/30-21swapper/310:50:383
339960,0migration/325228-21cpuspeed_turbos10:38:573
339960,0migration/323586-21latency_hist10:18:443
339960,0migration/319614-21sh11:49:203
339960,0migration/319479-21sh09:35:503
339960,0migration/318687-21sh11:30:103
339960,0migration/318496-21sh09:18:443
339960,0migration/313129-21sh10:09:263
32959960,0cyclictest0-21swapper/210:44:272
32959960,0cyclictest0-21swapper/210:29:002
32959960,0cyclictest0-21swapper/210:14:012
32959960,0cyclictest0-21swapper/209:52:162
32939960,0cyclictest0-21swapper/011:13:050
29715060,0irq/26-eth0-rx-4437-21sed10:04:083
29715060,0irq/26-eth0-rx-23539-21diskstats12:13:563
29715060,0irq/26-eth0-rx-0-21swapper/312:23:013
4150,0ktimersoftd/00-21swapper/009:56:000
339950,0migration/39109-21kthreadcore09:49:013
339950,0migration/3803-21taskset11:01:053
339950,0migration/330728-21taskset07:51:483
339950,0migration/329337-21kthreadcore09:24:013
339950,0migration/328114-21fschecks_time11:18:583
339950,0migration/326872-21munin-node09:39:083
339950,0migration/321616-21diskmemload09:57:413
339950,0migration/321432-21fschecks_time08:58:583
339950,0migration/321068-21sendmail_mailst10:14:063
339950,0migration/319647-21idleruntime09:18:573
339950,0migration/318690-21proc_pri08:29:043
32959955,0cyclictest0-21swapper/211:34:442
32959955,0cyclictest0-21swapper/211:20:242
32959955,0cyclictest0-21swapper/210:28:132
32959955,0cyclictest0-21swapper/210:13:142
32959955,0cyclictest0-21swapper/208:24:082
32959954,0cyclictest22676-21awk11:53:592
32959950,0cyclictest0-21swapper/211:51:082
32949955,0cyclictest0-21swapper/109:39:541
32949954,0cyclictest21447-21ssh12:10:281
32949950,0cyclictest0-21swapper/111:52:011
32949950,0cyclictest0-21swapper/110:33:021
32949950,0cyclictest0-21swapper/110:06:511
32939955,0cyclictest0-21swapper/010:24:220
32939952,0cyclictest3241-21irqbalance11:44:220
32939950,0cyclictest0-21swapper/010:35:060
32939950,0cyclictest0-21swapper/010:07:400
32939950,0cyclictest0-21swapper/009:33:460
29725050,0irq/27-eth0-tx-3707-21sh11:23:562
29725050,0irq/27-eth0-tx-30183-21munin-node11:59:012
29725050,0irq/27-eth0-tx-223842sleep209:58:552
29725050,0irq/27-eth0-tx-20222-21ssh09:54:222
29725050,0irq/27-eth0-tx-12565-21munin-node09:33:582
29725050,0irq/27-eth0-tx-11205-21ssh09:31:332
29725050,0irq/27-eth0-tx-0-21swapper/212:04:072
29725050,0irq/27-eth0-tx-0-21swapper/209:25:412
29715050,0irq/26-eth0-rx-4802-21kthreadcore10:24:013
29715050,0irq/26-eth0-rx-4043-21munin-node09:28:583
29715050,0irq/26-eth0-rx-4017-21ssh11:42:193
29715050,0irq/26-eth0-rx-28653-21grep07:24:023
29715050,0irq/26-eth0-rx-23622-21ssh12:32:333
29715050,0irq/26-eth0-rx-2126-21ssh11:03:443
29715050,0irq/26-eth0-rx-19175-21kthreadcore10:54:003
29715050,0irq/26-eth0-rx-15886-21sensors07:14:073
29715050,0irq/26-eth0-rx-13699-21ssh12:06:583
29715050,0irq/26-eth0-rx-11934-21ssh11:46:043
29715050,0irq/26-eth0-rx-0-21swapper/312:37:583
29715050,0irq/26-eth0-rx-0-21swapper/312:24:433
29715050,0irq/26-eth0-rx-0-21swapper/312:01:113
29715050,0irq/26-eth0-rx-0-21swapper/311:54:163
29715050,0irq/26-eth0-rx-0-21swapper/311:25:193
29715050,0irq/26-eth0-rx-0-21swapper/311:14:023
29715050,0irq/26-eth0-rx-0-21swapper/310:35:303
29715050,0irq/26-eth0-rx-0-21swapper/310:03:273
29715050,0irq/26-eth0-rx-0-21swapper/309:45:463
29715050,0irq/26-eth0-rx-0-21swapper/309:12:483
29715050,0irq/26-eth0-rx-0-21swapper/307:09:033
29715050,0irq/26-eth0-rx-0-21swapper/307:09:033
27150,0ktimersoftd/20-21swapper/210:50:552
259950,0migration/220844-21kthreadcore12:29:022
259950,0migration/219336-21kthreadcore10:34:022
259950,0migration/216455-21munin-node07:39:022
249950,0watchdog/211388-21kthreadcore12:24:022
19150,0ktimersoftd/10-21swapper/110:50:551
179950,0migration/131800-21idleruntime-cro10:23:441
179950,0migration/120841-21sh09:55:501
179950,0migration/118477-21fschecks_time10:53:571
149950,0migration/09148-21latency_hist10:48:440
149950,0migration/03982-21cpuspeed_turbos11:23:580
149950,0migration/032690-21sh10:42:550
149950,0migration/032168-21fschecks_time12:18:570
149950,0migration/031766-21missed_timers08:39:050
149950,0migration/031111-21kthreadcore09:44:000
149950,0migration/028090-21kthreadcore10:19:030
149950,0migration/027976-21fschecks_count09:23:580
149950,0migration/027519-21sh09:39:490
149950,0migration/026582-21kthreadcore07:49:020
149950,0migration/025517-21kthreadcore09:59:020
149950,0migration/024827-21kthreadcore12:14:000
149950,0migration/021163-21munin-node08:58:570
149950,0migration/017563-21kthreadcore12:29:010
149950,0migration/015600-21needreboot07:14:040
149950,0migration/010618-21sh09:30:210
339940,0migration/35794-21kthreadcore08:44:013
339940,0migration/3463-21kthreadcore07:54:023
339940,0migration/327259-21kthreadcore08:14:033
339940,0migration/323810-21kthreadcore08:34:033
339940,0migration/319231-21kthreadcore07:44:013
339940,0migration/310511-21unixbench_multi07:34:103
339940,0migration/310176-21kthreadcore08:49:023
32959943,0cyclictest3514-21snmpd11:39:032
32959943,0cyclictest3514-21snmpd07:26:172
32959943,0cyclictest3241-21irqbalance12:19:022
32959943,0cyclictest3241-21irqbalance12:13:522
32959943,0cyclictest3241-21irqbalance09:04:332
32959943,0cyclictest3241-21irqbalance07:58:532
32959943,0cyclictest3241-21irqbalance07:54:132
32959943,0cyclictest3241-21irqbalance07:48:532
32959943,0cyclictest3241-21irqbalance07:30:432
32959943,0cyclictest3241-21irqbalance07:19:532
32959943,0cyclictest31757-21awk10:04:002
32959943,0cyclictest20132-21awk11:14:012
32959943,0cyclictest19789-21awk08:09:002
32959943,0cyclictest15072-21awk08:54:002
32949944,0cyclictest0-21swapper/110:33:491
32949944,0cyclictest0-21swapper/109:49:311
32949943,0cyclictest5778-21awk11:43:561
32949943,0cyclictest3556-21lldpd09:29:071
32949943,0cyclictest3514-21snmpd11:38:481
32949943,0cyclictest3514-21snmpd11:21:331
32949943,0cyclictest3514-21snmpd10:10:021
32949943,0cyclictest3514-21snmpd07:44:021
32949943,0cyclictest3514-21snmpd07:12:471
32949943,0cyclictest3514-21snmpd07:12:471
32949943,0cyclictest32551-21sadc12:38:441
32949943,0cyclictest3241-21irqbalance11:29:521
32949943,0cyclictest3241-21irqbalance08:59:231
32949943,0cyclictest3241-21irqbalance08:53:531
32949943,0cyclictest3241-21irqbalance08:43:531
32949943,0cyclictest28440-21awk09:04:011
32949943,0cyclictest22718-21awk11:53:591
32949943,0cyclictest19717-21awk08:08:591
32949943,0cyclictest17866-21awk07:19:001
32949943,0cyclictest14071-21awk08:28:591
32949943,0cyclictest0-21swapper/108:48:581
32939944,0cyclictest0-21swapper/011:58:490
32939943,0cyclictest8479-21awk12:23:590
32939943,0cyclictest7841-21awk10:09:000
32939943,0cyclictest4413-21awk07:08:590
32939943,0cyclictest4413-21awk07:08:590
32939943,0cyclictest3514-21snmpd07:36:020
32939943,0cyclictest3241-21irqbalance12:03:520
32939943,0cyclictest3241-21irqbalance11:48:520
32939943,0cyclictest3241-21irqbalance11:04:030
32939943,0cyclictest3241-21irqbalance10:59:230
32939943,0cyclictest3241-21irqbalance08:28:530
32939943,0cyclictest3241-21irqbalance08:25:430
32939943,0cyclictest31996-21awk07:54:000
32939943,0cyclictest29849-21awk11:39:020
32939943,0cyclictest28392-21awk09:04:010
32939943,0cyclictest26339-21sort11:34:070
32939943,0cyclictest1579-21awk08:43:580
32939943,0cyclictest11131-21awk09:14:000
32939940,0cyclictest0-21swapper/009:49:510
29725040,0irq/27-eth0-tx-7441-21munin-node08:48:572
29725040,0irq/27-eth0-tx-30029-21ssh10:19:372
29725040,0irq/27-eth0-tx-25009-21fschecks_time12:33:542
29725040,0irq/27-eth0-tx-1493-21diskmemload11:03:532
29725040,0irq/27-eth0-tx-1493-21diskmemload10:53:552
29725040,0irq/27-eth0-tx-0-21swapper/211:28:472
29725040,0irq/27-eth0-tx-0-21swapper/211:09:022
29725040,0irq/27-eth0-tx-0-21swapper/210:38:472
29725040,0irq/27-eth0-tx-0-21swapper/209:44:002
29725040,0irq/27-eth0-tx-0-21swapper/209:18:542
29725040,0irq/27-eth0-tx-0-21swapper/209:09:542
29725040,0irq/27-eth0-tx-0-21swapper/208:14:062
29715040,0irq/26-eth0-rx-27857-21cat08:39:033
29715040,0irq/26-eth0-rx-0-21swapper/312:09:013
29715040,0irq/26-eth0-rx-0-21swapper/311:34:023
29715040,0irq/26-eth0-rx-0-21swapper/311:09:203
29715040,0irq/26-eth0-rx-0-21swapper/310:44:013
29715040,0irq/26-eth0-rx-0-21swapper/310:29:013
29715040,0irq/26-eth0-rx-0-21swapper/308:19:083
27538244,0sleep00-21swapper/011:18:550
259940,0migration/26708-21kthreadcore07:09:022
259940,0migration/26708-21kthreadcore07:09:022
259940,0migration/24797-21latency_hist11:43:442
259940,0migration/220844-21unixbench_singl12:09:082
259940,0migration/217830-21latency_hist07:43:452
259940,0migration/213114-21aten_r1power_cu08:28:552
259940,0migration/211887-21kthreadcore09:14:022
249940,0watchdog/24315-21tr08:19:032
249940,0watchdog/226147-21ssh10:58:462
249940,0watchdog/223179-21kthreadcore09:39:032
249940,0watchdog/220338-21fschecks_time08:33:592
249940,0watchdog/215008-21cut07:14:032
249940,0watchdog/20-21swapper/208:39:072
249940,0watchdog/20-21swapper/207:33:592
179940,0migration/19299-21sh09:12:311
179940,0migration/14350-21sh11:59:521
179940,0migration/129966-21fschecks_count09:43:571
179940,0migration/128097-21rt-features09:59:061
179940,0migration/127393-21latency_hist09:23:441
179940,0migration/126151-21fschecks_time08:14:001
179940,0migration/122307-21kthreadcore09:19:001
179940,0migration/117888-21switchtime08:04:071
179940,0migration/11336-21kthreadcore12:19:001
179940,0migration/113008-21sh12:05:191
179940,0migration/110879-21fschecks_time07:13:581
169940,0watchdog/19851-21ssh11:24:101
169940,0watchdog/15812-21tail10:24:061
169940,0watchdog/14907-21df_abs07:33:591
169940,0watchdog/14479-21kthreadcore11:03:581
169940,0watchdog/131980-21pmu-power08:39:071
169940,0watchdog/120332-21fschecks_time08:33:591
169940,0watchdog/111713-21awk11:08:581
169940,0watchdog/110731-21kthreadcore12:24:021
169940,0watchdog/10-21swapper/107:28:591
149940,0migration/08831-21fschecks_time10:28:580
149940,0migration/08671-21kthreadcore07:59:020
149940,0migration/027075-21kthreadcore12:33:580
149940,0migration/022544-21kthreadcore09:19:000
149940,0migration/019822-21kthreadcore07:19:020
149940,0migration/018366-21fschecks_count10:53:570
149940,0migration/015113-21df_abs12:08:560
149940,0migration/014206-21aten_r1power_en08:53:560
149940,0migration/011808-21kthreadcore10:49:020
339930,0migration/322788-21kthreadcore08:09:023
32959932,0cyclictest6398-21sendmail_mailst08:44:042
32959932,0cyclictest20770-21munin-node08:58:572
32959932,0cyclictest13030-21awk08:04:002
32949932,0cyclictest6327-21awk07:59:001
32949932,0cyclictest4465-21sensors07:54:071
32949932,0cyclictest29186-21sensors07:24:061
32949932,0cyclictest16690-21grep10:14:021
32949932,0cyclictest12679-21basename09:33:571
32949932,0cyclictest11542-21tr07:38:571
32949931,0cyclictest7077-21fschecks_time08:23:591
32949930,0cyclictest29938-21ntp_states07:49:051
32949930,0cyclictest25299-21df10:38:571
32939932,0cyclictest8372-21awk08:49:000
32939932,0cyclictest556-21awk08:19:010
32939932,0cyclictest3556-21lldpd09:12:070
32939932,0cyclictest3241-21irqbalance11:28:520
32939932,0cyclictest31092-21awk07:28:580
32939932,0cyclictest26301-21awk08:14:010
32939932,0cyclictest24523-21kthreadcore11:54:010
32939932,0cyclictest20051-21awk11:14:000
32939932,0cyclictest16034-21sed10:13:590
32939931,0cyclictest15240-21kthreadcore08:04:020
32939930,0cyclictest19208-21diskstats08:08:570
29715030,0irq/26-eth0-rx-0-21swapper/309:04:003
29715030,0irq/26-eth0-rx-0-21swapper/308:55:383
29715030,0irq/26-eth0-rx-0-21swapper/308:23:573
29715030,0irq/26-eth0-rx-0-21swapper/308:05:133
29715030,0irq/26-eth0-rx-0-21swapper/307:58:583
29715030,0irq/26-eth0-rx-0-21swapper/307:38:563
29715030,0irq/26-eth0-rx-0-21swapper/307:29:053
29715030,0irq/26-eth0-rx-0-21swapper/307:18:563
169930,0watchdog/119794-21kthreadcore12:29:021
169930,0watchdog/10-21swapper/112:13:581
169930,0watchdog/10-21swapper/111:33:581
169930,0watchdog/10-21swapper/111:14:021
169930,0watchdog/10-21swapper/110:58:461
169930,0watchdog/10-21swapper/110:44:021
169930,0watchdog/10-21swapper/108:19:031
149930,0migration/023528-21ksmtuned07:23:510
32939921,0cyclictest17805-21latency_hist07:43:450
32939921,0cyclictest11963-21gltestperf07:38:580
32939920,0cyclictest0-21swapper/008:33:440
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional