You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 01:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Sun Aug 30, 2026 00:42:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3956357995040,7cyclictest4017896-21needreboot21:51:010
3956358994941,5cyclictest3978877-21systemd-run20:25:011
395635899483,35cyclictest4060418-21ssh23:01:091
3956358994739,4cyclictest0-21swapper/119:36:021
3956359994639,4cyclictest4095331-21munin-run00:00:012
3956359994639,4cyclictest4095331-21munin-run00:00:012
3956357994641,3cyclictest12750irq/33-eth022:09:550
3956357994629,14cyclictest4047609-21sh22:40:550
3956359994537,5cyclictest421-21dbus-daemon22:05:012
3956359994537,5cyclictest3986355-21systemd-run20:50:012
3956359994537,5cyclictest3986355-21systemd-run20:50:012
3956358994437,4cyclictest4028906-21ssh22:10:011
3956358994334,5cyclictest3971342-21idleruntime-cro20:00:011
3956357994230,10cyclictest265-21systemd-journal00:00:530
3956359994129,8cyclictest4057658-21switchtime22:56:182
3956357994134,4cyclictest4095331-21munin-run00:00:010
3956357994134,4cyclictest4095331-21munin-run00:00:010
395635799413,29cyclictest4045222-21ssh22:36:040
3956358994031,5cyclictest4047862-21sort22:40:581
3956358994029,8cyclictest4018245-21mailstats21:51:141
395635799403,32cyclictest4084546-21ssh23:41:060
3956357994030,7cyclictest421-21dbus-daemon21:30:010
3956357994030,4cyclictest0-21swapper/022:15:010
395635799402,31cyclictest665-21snmpd22:46:060
395635799402,31cyclictest665-21snmpd22:46:060
395635799401,32cyclictest4105740-21ssh00:16:090
3956358993933,3cyclictest0-21swapper/122:20:011
395635899393,28cyclictest4090579-21ssh23:51:061
3956358993932,3cyclictest0-21swapper/100:00:011
3956358993932,3cyclictest0-21swapper/100:00:011
3956358993931,5cyclictest4081031-21fschecks_count23:35:571
3956358993930,6cyclictest3956356-21cyclictest20:36:051
395635799395,28cyclictest4075393-21sh23:26:040
395635799394,31cyclictest4102629-21ssh00:11:040
3956357993831,4cyclictest4108198-21cpuspeed00:20:540
3956359993728,6cyclictest4084739-21mailstats23:41:122
395635899373,24cyclictest4063296-21ssh23:06:021
3956357993729,5cyclictest4113609-21latency_hist00:30:020
3956357993729,5cyclictest4113609-21latency_hist00:30:020
3956357993729,4cyclictest12650irq/32-eth022:21:050
3956357993728,6cyclictest4041507-21/usr/sbin/munin22:30:530
3956357993727,4cyclictest0-21swapper/023:24:280
3956357993722,10cyclictest12650irq/32-eth022:01:050
3956359993627,5cyclictest3980417-21latency_hist20:30:022
3956359993627,5cyclictest3960889-21wc19:25:012
3956359993626,6cyclictest4036721-21grep22:21:152
3956359993625,8cyclictest694-21cron20:55:002
3956359993625,8cyclictest694-21cron20:55:002
395635999361,29cyclictest4060403-21ssh23:01:092
395635899363,25cyclictest3999760-21ssh21:21:061
3956358993629,4cyclictest3966369-21proc_pri19:41:091
3956358993628,5cyclictest4118309-21unixbench_singl00:36:171
3956358993628,5cyclictest4072918-21unixbench-2d23:21:181
3956358993627,6cyclictest420-21avahi-daemon21:46:121
3956357993626,7cyclictest3966864-21sh19:45:010
3956357993619,14cyclictest4007688-21cron21:35:010
3956359993527,5cyclictest4095404-21cups-browsed00:26:162
3956359993527,5cyclictest4095404-21cups-browsed00:26:162
3956359993527,5cyclictest3959332-21cron19:20:012
3956359993522,10cyclictest4032949-21latency22:16:002
3956359993521,9cyclictest1003-21mta-sts-daemon20:36:052
3956358993528,4cyclictest4037987-21grep22:25:011
3956358993526,6cyclictest4050682-21head22:45:561
3956358993526,6cyclictest4050682-21head22:45:561
3956358993526,6cyclictest2164266-21cups-browsed21:11:061
3956358993526,6cyclictest2164266-21cups-browsed21:11:061
3956357993530,3cyclictest3956356-21cyclictest20:26:020
3956357993528,4cyclictest12650irq/32-eth023:46:040
3956357993527,3cyclictest0-21swapper/000:40:000
3956359993428,3cyclictest0-21swapper/223:35:012
3956359993427,4cyclictest3977361-21sendmail20:20:012
3956359993426,5cyclictest4115255-21grep00:31:162
3956359993426,5cyclictest4044941-21kernelversion22:35:582
3956359993426,5cyclictest3984762-21sed20:41:132
3956359993426,5cyclictest0-21swapper/220:00:012
3956358993427,4cyclictest4047022-21cron22:40:011
3956358993427,4cyclictest0-21swapper/120:20:011
3956358993427,3cyclictest0-21swapper/121:06:081
3956358993427,3cyclictest0-21swapper/121:06:081
3956358993426,5cyclictest3998468-21cron21:20:001
3956358993426,4cyclictest4012537-21unixbench_multi21:41:231
3956358993424,7cyclictest4103164-21unixbench_multi00:11:141
395635899342,24cyclictest4105755-21ssh00:16:101
3956357993427,4cyclictest4071197-21awk23:20:010
3956357993427,4cyclictest3988060-21kworker/u8:15+xprtiod21:20:010
3956357993427,3cyclictest0-21swapper/022:27:330
3956357993426,5cyclictest3974358-21systemd-run20:10:010
3956357993426,3cyclictest0-21swapper/023:30:590
3956357993424,7cyclictest420-21avahi-daemon23:36:110
3956357993421,10cyclictest265-21systemd-journal21:35:520
3956357993416,5cyclictest171rcu_preempt20:21:040
3956357993413,16cyclictest4099623-21ssh00:06:050
3956359993326,4cyclictest1003-21mta-sts-daemon00:37:332
3956359993325,5cyclictest3961389-21fschecks_time19:25:562
3956359993324,6cyclictest3975785-21unixbench_singl20:11:142
3956358993326,4cyclictest4059118-21idleruntime-cro23:00:001
3956358993325,5cyclictest1-21systemd22:55:011
3956358993325,5cyclictest1-21systemd22:55:011
3956358993324,7cyclictest3984852-21/usr/sbin/munin20:45:011
395635899331,22cyclictest4087561-21ssh23:46:081
395635799335,6cyclictest171rcu_preempt21:41:100
395635799333,24cyclictest665-21snmpd23:51:040
3956357993326,4cyclictest3992991-21telnet21:10:560
3956357993326,4cyclictest3992991-21telnet21:10:560
3956357993326,4cyclictest1001-21mta-sts-daemon22:58:550
3956357993321,9cyclictest3957830-21cron19:15:000
3956357993320,10cyclictest4062691-21aten_r2power_en23:05:530
3956357993317,12cyclictest12750irq/33-eth021:46:070
3956359993226,3cyclictest0-21swapper/221:10:012
3956359993226,3cyclictest0-21swapper/221:10:012
3956359993225,5cyclictest421-21dbus-daemon23:20:592
3956359993225,4cyclictest1001-21mta-sts-daemon22:51:372
3956359993225,4cyclictest1001-21mta-sts-daemon22:51:372
3956359993224,6cyclictest4075416-21ntp_kernel_pll_23:26:052
3956359993224,5cyclictest4071172-21ssh23:20:012
3956359993224,5cyclictest3978851-21sh20:25:012
3956359993224,4cyclictest0-21swapper/222:11:042
3956359993223,6cyclictest421-21dbus-daemon23:47:122
3956359993222,7cyclictest2164266-21cups-browsed21:59:352
3956358993224,5cyclictest0-21swapper/119:55:011
3956358993223,6cyclictest4100145-21unixbench_multi00:06:161
395635799328,19cyclictest4033270-21ssh22:16:100
395635799324,18cyclictest171rcu_preempt23:04:480
3956357993223,5cyclictest3992342-21grep21:10:010
3956357993223,5cyclictest3992342-21grep21:10:010
3956357993222,8cyclictest0-21swapper/019:25:010
3956357993216,12cyclictest12650irq/32-eth019:51:040
395635799321,26cyclictest2164266-21cups-browsed20:20:020
3956359993124,4cyclictest3990850-21munin-run21:05:002
3956359993124,4cyclictest1002-21mta-sts-daemon22:08:572
3956359993124,4cyclictest1002-21mta-sts-daemon21:10:552
3956359993124,4cyclictest1002-21mta-sts-daemon21:10:552
3956359993124,4cyclictest1001-21mta-sts-daemon21:24:002
3956359993123,5cyclictest3968707-21aten_r2power_po19:50:542
3956359993121,7cyclictest3998499-21sendmail21:20:012
3956359993120,9cyclictest4096671-21sh00:01:102
3956359993119,8cyclictest4008770-21missed_timers21:36:042
3956358993124,4cyclictest421-21dbus-daemon20:15:011
3956358993124,4cyclictest1001-21mta-sts-daemon21:36:051
3956358993123,5cyclictest4006111-21systemctl21:31:131
3956358993123,5cyclictest3968364-21systemd-run19:50:021
395635899312,24cyclictest4030210-21ssh22:11:091
395635899311,23cyclictest4108698-21ssh00:21:041
3956357993125,4cyclictest3965276-21unixbench_singl19:36:140
3956357993124,3cyclictest0-21swapper/021:00:000
3956357993121,5cyclictest0-21swapper/020:11:030
3956357993120,8cyclictest3990156-21needreboot21:01:010
3956357993117,3cyclictest171rcu_preempt20:51:030
3956357993117,3cyclictest171rcu_preempt20:51:030
395635799310,7cyclictest3992339-21diskmemload23:11:090
3956359993025,2cyclictest0-21swapper/219:40:002
3956359993023,5cyclictest3988293-21cpuspeed20:55:532
395635999302,22cyclictest4012120-21ssh21:41:172
3956359993021,7cyclictest3963157-21needreboot19:31:022
3956359993021,7cyclictest3963157-21needreboot19:31:022
3956359993019,8cyclictest4108895-21mailstats00:21:102
3956358993022,5cyclictest265-21systemd-journal20:30:011
3956358993021,6cyclictest420-21avahi-daemon23:26:071
3956357993023,5cyclictest0-21swapper/020:50:010
3956357993023,5cyclictest0-21swapper/020:50:010
3956357993017,9cyclictest420-21avahi-daemon21:21:480
3956359992924,2cyclictest0-21swapper/222:40:552
3956359992922,4cyclictest4039355-21proc_pri22:26:112
3956359992921,5cyclictest4004405-21ssh21:29:192
3956359992920,5cyclictest1000-21mta-sts-daemon23:36:182
3956359992918,8cyclictest4102461-21missed_timers00:10:582
3956358992924,2cyclictest0-21swapper/123:15:011
3956358992923,3cyclictest0-21swapper/123:16:041
3956358992923,3cyclictest0-21swapper/121:26:061
3956358992922,3cyclictest0-21swapper/123:31:021
3956358992922,3cyclictest0-21swapper/122:31:091
3956358992921,3cyclictest0-21swapper/122:01:061
3956358992920,4cyclictest0-21swapper/121:58:521
3956357992923,4cyclictest3981862-21systemd-run20:35:010
3956357992921,5cyclictest485-21in:imuxsock21:58:520
3956357992921,4cyclictest0-21swapper/022:50:540
3956357992921,4cyclictest0-21swapper/022:50:540
3956357992921,4cyclictest0-21swapper/000:31:350
3956357992920,7cyclictest3981857-21kworker/u8:8+rpciod20:40:010
395635999282,20cyclictest4005877-21ssh21:31:052
3956359992821,4cyclictest4019965-21latency_hist21:55:032
3956359992821,4cyclictest1000-21mta-sts-daemon23:54:302
3956359992820,5cyclictest566-21gmain19:15:012
3956359992820,5cyclictest485-21in:imuxsock19:50:012
3956359992820,5cyclictest4101395-21cron00:10:012
3956359992820,5cyclictest3992339-21diskmemload23:11:032
3956358992823,3cyclictest0-21swapper/100:26:171
3956358992823,3cyclictest0-21swapper/100:26:171
3956358992820,5cyclictest3986869-21fschecks_time20:50:571
3956358992820,5cyclictest3986869-21fschecks_time20:50:571
3956358992818,7cyclictest421-21dbus-daemon20:35:011
3956358992818,7cyclictest3972727-21unixbench_multi20:01:431
3956357992821,4cyclictest3984896-21latency_hist20:45:020
3956357992817,8cyclictest0-21swapper/020:05:010
395635799281,22cyclictest14-21ksoftirqd/019:26:060
3956359992721,3cyclictest0-21swapper/222:46:172
3956359992721,3cyclictest0-21swapper/222:46:172
3956359992718,7cyclictest4041776-21entropy22:30:562
395635999271,6cyclictest171rcu_preempt20:06:032
3956359992716,8cyclictest4106039-21timerandwakeup00:16:152
3956358992721,3cyclictest3210211-21kworker/u8:13-xprtiod19:31:161
3956358992721,3cyclictest3210211-21kworker/u8:13-xprtiod19:31:161
3956358992721,3cyclictest0-21swapper/123:41:101
3956358992721,3cyclictest0-21swapper/100:01:101
3956358992720,4cyclictest4116498-21cron00:35:001
3956358992719,5cyclictest3960849-21cron19:25:001
3956358992718,7cyclictest4039790-21unixbench_singl22:26:161
3956357992721,3cyclictest0-21swapper/019:45:570
3956357992719,6cyclictest3959345-21sendmail19:20:010
3956357992715,10cyclictest0-21swapper/019:35:000
3956357992715,10cyclictest0-21swapper/019:35:000
395635899266,5cyclictest62750lldpd19:29:451
395635899266,3cyclictest171rcu_preempt19:11:041
3956358992620,3cyclictest0-21swapper/119:20:011
3956358992618,5cyclictest1-21systemd21:00:011
395635999255,11cyclictest428-21mta-sts-daemon20:31:022
3956359992518,3cyclictest0-21swapper/223:06:062
3956358992520,2cyclictest0-21swapper/121:05:001
3956358992516,7cyclictest3985113-21aten_r2power_cu20:45:531
3956358992516,7cyclictest3985113-21aten_r2power_cu20:45:531
3956359992416,4cyclictest0-21swapper/221:46:112
3956359992316,4cyclictest1000-21mta-sts-daemon19:41:032
395635899239,10cyclictest421-21dbus-daemon20:06:051
395635799233,3cyclictest171rcu_preempt19:56:120
3956359992216,2cyclictest0-21swapper/220:01:022
395635799227,5cyclictest14-21ksoftirqd/019:10:010
395635999198,8cyclictest421-21dbus-daemon19:10:012
395636099182,8cyclictest0-21swapper/321:11:073
395636099182,8cyclictest0-21swapper/321:11:073
395635899188,7cyclictest3956367-21systemctl19:10:011
395636099174,5cyclictest0-21swapper/322:36:023
395636099163,6cyclictest0-21swapper/320:40:003
395636099162,9cyclictest0-21swapper/323:46:033
395636099162,9cyclictest0-21swapper/300:25:533
395636099162,9cyclictest0-21swapper/300:25:533
395636099162,8cyclictest0-21swapper/322:11:123
395636099162,8cyclictest0-21swapper/321:20:013
395636099162,8cyclictest0-21swapper/300:11:023
395636099162,8cyclictest0-21swapper/300:01:043
395636099162,7cyclictest0-21swapper/321:36:063
395636099161,8cyclictest0-21swapper/323:56:123
395636099161,8cyclictest0-21swapper/323:56:123
395636099153,8cyclictest0-21swapper/322:46:063
395636099153,8cyclictest0-21swapper/322:46:063
395636099153,7cyclictest0-21swapper/322:51:073
395636099153,7cyclictest0-21swapper/322:51:073
395636099153,5cyclictest0-21swapper/300:31:043
395636099152,8cyclictest0-21swapper/323:16:093
395636099152,7cyclictest0-21swapper/323:20:553
395636099152,7cyclictest0-21swapper/321:46:113
395636099152,6cyclictest0-21swapper/321:25:533
395636099152,5cyclictest0-21swapper/320:41:053
395636099151,9cyclictest0-21swapper/323:01:073
395636099151,8cyclictest0-21swapper/323:31:093
395636099151,8cyclictest0-21swapper/322:21:033
395636099151,8cyclictest0-21swapper/322:16:113
395636099151,8cyclictest0-21swapper/319:41:083
395636099151,8cyclictest0-21swapper/300:22:473
395636099151,7cyclictest0-21swapper/320:06:083
395636099151,7cyclictest0-21swapper/319:26:073
395636099143,6cyclictest0-21swapper/321:01:053
395636099142,8cyclictest0-21swapper/322:41:053
395636099142,8cyclictest0-21swapper/322:06:013
395636099142,8cyclictest0-21swapper/321:21:153
395636099142,7cyclictest0-21swapper/323:05:533
395636099142,7cyclictest0-21swapper/322:00:563
395636099141,8cyclictest0-21swapper/323:26:003
395636099141,8cyclictest0-21swapper/322:30:533
395636099141,8cyclictest0-21swapper/321:41:073
395636099141,8cyclictest0-21swapper/319:20:013
395636099141,7cyclictest0-21swapper/323:50:533
395636099141,7cyclictest0-21swapper/320:01:073
395636099141,7cyclictest0-21swapper/300:35:563
395636099141,6cyclictest0-21swapper/320:26:033
395636099141,6cyclictest0-21swapper/319:46:033
395636099141,6cyclictest0-21swapper/319:36:033
395636099135,5cyclictest0-21swapper/321:51:023
395636099133,5cyclictest0-21swapper/319:35:003
395636099133,5cyclictest0-21swapper/319:35:003
395636099133,4cyclictest0-21swapper/319:25:003
395636099132,8cyclictest0-21swapper/322:25:573
395636099132,6cyclictest0-21swapper/323:40:533
395636099132,6cyclictest0-21swapper/323:10:563
395636099132,6cyclictest0-21swapper/321:10:013
395636099132,6cyclictest0-21swapper/321:10:013
395636099131,8cyclictest0-21swapper/322:55:533
395636099131,8cyclictest0-21swapper/321:56:093
395636099131,8cyclictest0-21swapper/300:05:543
395636099131,6cyclictest0-21swapper/323:35:533
395636099131,6cyclictest0-21swapper/320:31:053
395636099131,6cyclictest0-21swapper/320:21:033
395636099131,6cyclictest0-21swapper/319:11:073
395636099123,4cyclictest0-21swapper/320:16:093
395636099122,7cyclictest0-21swapper/320:11:033
395636099122,5cyclictest0-21swapper/319:51:043
395636099121,8cyclictest0-21swapper/300:16:123
395636099121,6cyclictest0-21swapper/321:00:013
395636099121,6cyclictest0-21swapper/320:51:023
395636099121,6cyclictest0-21swapper/320:51:023
395636099121,6cyclictest0-21swapper/319:56:013
395636099115,4cyclictest0-21swapper/320:46:033
395636099115,4cyclictest0-21swapper/320:46:033
395636099112,6cyclictest0-21swapper/321:31:033
395636099112,5cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional