You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 08:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sun Aug 16, 2026 00:43:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2201240996234,25cyclictest2307676-21/usr/sbin/munin23:05:020
2201241995643,9cyclictest2341350-21cups-browsed00:25:011
220124099562,27cyclictest2250887-21ssh21:31:030
2201240995326,24cyclictest12650irq/32-eth022:51:010
2201240995225,4cyclictest2210256-21systemd-run19:40:010
2201240995128,2cyclictest0-21swapper/021:40:010
2201240995128,2cyclictest0-21swapper/021:40:010
2201240995034,12cyclictest0-21swapper/021:20:580
2201242994839,5cyclictest2226749-21systemd-run20:35:022
2201240994822,3cyclictest0-21swapper/023:46:080
2201242994738,6cyclictest2292385-21munin-run22:40:012
220124099476,13cyclictest2296636-21ssh22:45:590
2201242994636,7cyclictest2341350-21cups-browsed00:09:202
2201240994621,5cyclictest420-21avahi-daemon19:25:010
2201241994536,6cyclictest2364447-21grep00:36:091
220124099454,18cyclictest12650irq/32-eth000:31:040
2201242994436,5cyclictest0-21swapper/223:40:012
2201241994435,5cyclictest2217759-21systemd-run20:05:011
2201241994434,6cyclictest421-21dbus-daemon22:20:011
2201240994422,14cyclictest12650irq/32-eth022:36:070
2201242994336,3cyclictest0-21swapper/223:20:012
2201242994335,5cyclictest2365764-21ssh00:40:012
2201242994333,6cyclictest2217753-21systemd-run20:05:012
2201242994330,6cyclictest0-21swapper/223:41:052
2201240994331,5cyclictest151ktimers/023:25:570
2201242994231,5cyclictest0-21swapper/221:36:032
2201242994231,5cyclictest0-21swapper/221:36:032
2201240994233,5cyclictest2349015-21grep00:11:100
220124299417,21cyclictest428-21mta-sts-daemon23:26:012
220124299413,32cyclictest665-21snmpd21:05:552
2201242994131,6cyclictest2344418-21munin-run00:05:012
2201242994131,6cyclictest2344418-21munin-run00:05:012
2201241994133,5cyclictest2341347-21cupsd00:00:011
2201241994133,5cyclictest2341347-21cupsd00:00:011
2201241994131,6cyclictest421-21dbus-daemon19:40:011
2201241994130,6cyclictest1001-21mta-sts-daemon23:37:041
2201240994131,5cyclictest151ktimers/020:05:570
2201240994131,5cyclictest151ktimers/020:05:570
2201240994126,11cyclictest459389-21cups-browsed22:30:590
2201242994033,4cyclictest0-21swapper/222:35:012
2201242994021,3cyclictest171rcu_preempt20:20:562
220124199407,22cyclictest750-21ntpd20:26:001
2201241994030,6cyclictest0-21swapper/123:05:011
2201240994033,5cyclictest485-21in:imuxsock00:20:010
2201242993931,5cyclictest2298585-21latency_hist22:50:022
2201242993929,5cyclictest0-21swapper/222:21:042
2201242993928,7cyclictest421-21dbus-daemon00:20:112
2201242993924,3cyclictest171rcu_preempt00:11:012
2201242993923,9cyclictest2237220-21diskmemload22:25:542
2201241993931,5cyclictest2362923-21wc00:35:021
2201241993931,5cyclictest2268107-21latency_hist22:00:021
2201241993931,5cyclictest2240291-21cron21:15:011
220124099391,28cyclictest2330277-21ssh23:41:000
220124299387,18cyclictest428-21mta-sts-daemon23:46:012
220124299383,28cyclictest2339554-21ssh23:56:042
220124299383,28cyclictest2339554-21ssh23:56:042
2201242993831,4cyclictest694-21cron20:15:002
2201242993830,4cyclictest0-21swapper/221:35:012
2201242993827,7cyclictest2341347-21cupsd00:28:062
2201241993831,3cyclictest0-21swapper/121:55:011
2201241993830,5cyclictest2255716-21systemctl21:40:011
2201241993830,5cyclictest2255716-21systemctl21:40:011
2201241993829,6cyclictest421-21dbus-daemon21:05:011
220124299373,29cyclictest2272259-21ssh22:05:592
2201242993730,4cyclictest2228351-21latency_hist20:40:022
2201242993729,5cyclictest2313806-21/usr/sbin/munin23:15:012
2201242993725,7cyclictest2247079-21aten_r2power_po21:25:472
2201241993729,5cyclictest2359789-21latency_hist00:30:021
2201241993728,6cyclictest2237257-21latency_hist21:10:021
2201240993730,3cyclictest2222269-21kworker/u8:4-rpciod22:41:070
2201240993729,4cyclictest151ktimers/023:30:580
220124099371,30cyclictest2302775-21ssh22:56:010
2201242993629,3cyclictest0-21swapper/222:15:012
2201242993626,8cyclictest2211109-21ntp_kernel_pll_19:40:572
2201242993624,7cyclictest420-21avahi-daemon21:23:042
2201242993623,9cyclictest2233522-21needreboot20:55:522
2201242993616,16cyclictest351ktimers/219:26:012
2201241993629,4cyclictest2353550-21sh00:20:011
2201241993629,3cyclictest0-21swapper/121:26:041
2201241993627,6cyclictest2272971-21sshd22:06:361
220124199361,30cyclictest265-21systemd-journal23:52:511
2201240993629,4cyclictest2356625-21munin-plugin-st00:25:010
2201240993627,7cyclictest1-21systemd00:00:010
2201240993627,7cyclictest1-21systemd00:00:010
2201240993627,6cyclictest2259920-21ssh21:45:560
220124099362,29cyclictest2284477-21ntpq22:25:580
220124299356,18cyclictest428-21mta-sts-daemon22:51:002
220124299355,23cyclictest2293615-21ssh22:40:592
2201242993527,5cyclictest2308622-21latency23:05:532
2201242993527,5cyclictest2238953-21unixbench_multi21:11:102
2201242993527,5cyclictest2213766-21gltestperf19:50:512
2201242993526,5cyclictest2260544-21unixbench_singl21:46:092
2201242993523,8cyclictest421-21dbus-daemon23:21:282
2201241993529,4cyclictest2332174-21latency_hist23:45:021
2201241993527,5cyclictest459389-21cups-browsed20:41:351
2201241993526,6cyclictest2314402-21aten_r2power_po23:15:491
2201241993524,8cyclictest2312496-21unixbench_singl23:11:091
2201240993529,3cyclictest151ktimers/020:31:020
2201240993528,5cyclictest2280177-21munin-run22:20:010
2201240993528,5cyclictest1002-21mta-sts-daemon23:06:420
2201240993527,5cyclictest2275441-21wc22:11:040
2201240993527,5cyclictest2217926-21latency_hist20:05:020
2201240993515,13cyclictest12650irq/32-eth023:11:000
2201242993426,5cyclictest265-21systemd-journal19:25:012
2201241993426,5cyclictest2320483-21aten_r2power_fr23:25:461
2201241993426,5cyclictest2257490-21head21:41:081
2201241993426,5cyclictest2257490-21head21:41:081
2201241993426,5cyclictest2202745-21systemd-run19:15:021
2201241993426,5cyclictest1001-21mta-sts-daemon00:06:491
2201241993426,4cyclictest0-21swapper/120:16:001
220124199342,24cyclictest2275204-21ssh22:10:561
2201240993425,7cyclictest2319918-21munin-plugin-st23:25:010
2201240993425,6cyclictest420-21avahi-daemon00:07:200
2201240993422,9cyclictest0-21swapper/021:00:010
2201240993420,9cyclictest2256997-21sh21:41:000
2201240993420,9cyclictest2256997-21sh21:41:000
220124099341,25cyclictest421-21dbus-daemon21:50:590
220124299335,5cyclictest351ktimers/221:15:572
2201242993326,3cyclictest0-21swapper/220:55:012
2201242993324,7cyclictest2280214-21sh22:20:012
2201242993324,6cyclictest0-21swapper/221:55:002
2201241993328,3cyclictest2261692-21kworker/u8:2-xprtiod22:35:011
2201241993327,3cyclictest0-21swapper/122:51:091
2201241993326,4cyclictest1000-21mta-sts-daemon23:30:581
2201240993326,4cyclictest2231114-21tail20:46:090
2201240993325,5cyclictest2268506-21aten_r2power_en22:00:500
2201240993323,7cyclictest2266624-21unixbench_multi21:56:080
2201242993225,4cyclictest0-21swapper/223:30:492
2201242993224,4cyclictest0-21swapper/223:05:012
2201242993224,3cyclictest0-21swapper/222:56:012
2201242993222,5cyclictest0-21swapper/200:20:002
2201242993218,3cyclictest171rcu_preempt20:16:002
220124199328,14cyclictest2308801-21ssh23:05:561
220124199324,23cyclictest2293543-21sh22:40:561
2201241993226,3cyclictest0-21swapper/123:21:081
2201241993226,3cyclictest0-21swapper/120:11:011
2201241993224,4cyclictest0-21swapper/122:20:521
2201241993223,7cyclictest2201197-21/usr/sbin/munin19:10:021
2201241993222,6cyclictest2341350-21cups-browsed00:04:121
2201241993222,6cyclictest2341350-21cups-browsed00:04:121
2201241993222,6cyclictest0-21swapper/122:01:001
2201240993225,4cyclictest2229737-21munin-plugin-st20:45:010
2201240993225,4cyclictest2215390-21latency19:55:530
2201240993219,10cyclictest2228265-21systemd20:40:020
2201240993214,14cyclictest151ktimers/023:16:030
220124299319,4cyclictest171rcu_preempt22:01:102
2201242993126,3cyclictest57-21kcompactd020:41:012
2201242993124,4cyclictest1000-21mta-sts-daemon00:31:032
2201241993125,3cyclictest0-21swapper/120:40:011
2201241993125,3cyclictest0-21swapper/120:35:011
2201241993125,3cyclictest0-21swapper/119:55:011
2201241993124,3cyclictest0-21swapper/121:21:051
2201241993123,5cyclictest2302262-21cpuspeed22:55:501
2201241993123,4cyclictest0-21swapper/121:30:561
2201241993123,3cyclictest0-21swapper/121:46:561
2201240993122,5cyclictest459389-21cups-browsed21:14:270
2201242993022,4cyclictest0-21swapper/221:55:582
2201242993017,7cyclictest171rcu_preempt23:50:572
2201242993014,3cyclictest171rcu_preempt21:01:012
2201242993014,3cyclictest171rcu_preempt19:46:032
2201241993024,3cyclictest0-21swapper/121:15:551
2201241993024,3cyclictest0-21swapper/100:15:011
2201241993022,5cyclictest421-21dbus-daemon20:10:011
2201241993022,5cyclictest421-21dbus-daemon20:10:011
2201241993022,5cyclictest2231224-21latency_hist20:50:031
2201241993022,5cyclictest0-21swapper/122:40:011
2201241993021,4cyclictest0-21swapper/120:55:531
220124099309,6cyclictest2281450-21ntpq22:21:010
2201240993024,3cyclictest0-21swapper/019:30:020
2201242992922,5cyclictest459389-21cups-browsed20:05:502
2201242992922,5cyclictest459389-21cups-browsed20:05:502
220124299292,20cyclictest665-21snmpd21:40:542
220124299292,20cyclictest665-21snmpd21:40:542
2201242992920,6cyclictest2204259-21systemd-run19:20:022
2201242992915,3cyclictest171rcu_preempt19:36:112
2201240992923,3cyclictest0-21swapper/000:40:010
2201240992920,7cyclictest2274063-21/usr/sbin/munin22:10:020
2201240992913,11cyclictest12650irq/32-eth000:25:580
2201242992816,3cyclictest171rcu_preempt19:56:002
2201242992815,3cyclictest171rcu_preempt20:26:042
220124199284,14cyclictest2284425-21ssh22:25:571
2201241992818,7cyclictest694-21cron19:35:011
2201240992821,4cyclictest2326691-21cpu23:35:490
2201240992821,4cyclictest0-21swapper/000:05:010
2201240992821,4cyclictest0-21swapper/000:05:010
2201240992820,5cyclictest459389-21cups-browsed21:16:270
2201240992820,5cyclictest2223615-21unixbench_multi20:21:060
2201240992820,5cyclictest2208605-21tail19:31:090
2201242992718,4cyclictest351ktimers/219:30:592
2201242992711,3cyclictest171rcu_preempt19:11:012
220124199274,18cyclictest2296636-21ssh22:45:591
2201241992718,5cyclictest1001-21mta-sts-daemon19:56:021
2201241992715,9cyclictest0-21swapper/123:46:071
2201240992720,5cyclictest265-21systemd-journal21:10:010
2201240992719,5cyclictest2202557-21unixbench-2d19:11:090
2201240992713,9cyclictest12650irq/32-eth021:25:590
2201242992613,2cyclictest171rcu_preempt20:45:572
2201241992621,3cyclictest1002-21mta-sts-daemon19:15:491
2201241992618,5cyclictest2210766-21fschecks_time19:40:501
2201241992617,7cyclictest2206387-21kernelversion19:25:511
2201241992617,6cyclictest459389-21cups-browsed20:54:261
2201240992616,8cyclictest2212256-21fschecks_count19:45:500
2201240992614,10cyclictest1001-21mta-sts-daemon19:15:580
2201241992517,5cyclictest2222775-21fschecks_time20:20:481
220124099251,6cyclictest487-21rs:main0
2201240992516,4cyclictest0-21swapper/023:55:030
2201241992417,4cyclictest2198510-21kworker/u8:2-xprtiod19:20:311
2201240992419,2cyclictest0-21swapper/020:50:550
2201240992418,4cyclictest2235335-21systemctl21:01:050
220124099233,4cyclictest2211621-21unixbench_multi19:41:080
2201240992315,5cyclictest0-21swapper/019:51:030
220124199221,3cyclictest171rcu_preempt19:46:081
2201240992217,3cyclictest1001-21mta-sts-daemon20:14:380
2201240992215,5cyclictest2225123-21unixbench_multi20:26:110
220124299217,3cyclictest171rcu_preempt19:10:022
220124399202,10cyclictest0-21swapper/323:00:573
220124399193,9cyclictest0-21swapper/300:35:563
220124399192,9cyclictest0-21swapper/300:06:033
220124399184,6cyclictest0-21swapper/323:51:003
220124399183,9cyclictest0-21swapper/322:26:003
220124399183,9cyclictest0-21swapper/321:30:573
220124399183,9cyclictest0-21swapper/300:00:013
220124399183,9cyclictest0-21swapper/300:00:013
220124399183,7cyclictest0-21swapper/323:15:583
220124399182,8cyclictest0-21swapper/321:55:593
220124399173,7cyclictest0-21swapper/323:21:013
220124399172,9cyclictest0-21swapper/322:21:003
220124399172,9cyclictest0-21swapper/300:25:533
220124399172,8cyclictest0-21swapper/322:15:573
220124399172,7cyclictest0-21swapper/323:26:003
220124399172,7cyclictest0-21swapper/323:10:563
220124399172,7cyclictest0-21swapper/323:06:023
220124399172,6cyclictest0-21swapper/320:35:583
220124399171,9cyclictest0-21swapper/323:40:593
220124399171,9cyclictest0-21swapper/322:11:003
220124399171,8cyclictest0-21swapper/320:20:563
2201240991712,2cyclictest0-21swapper/019:10:020
220124399163,8cyclictest0-21swapper/322:36:053
220124399163,7cyclictest0-21swapper/321:50:573
220124399162,9cyclictest0-21swapper/322:46:063
220124399162,8cyclictest0-21swapper/323:36:023
220124399162,7cyclictest0-21swapper/322:00:593
220124399162,7cyclictest0-21swapper/321:40:563
220124399162,7cyclictest0-21swapper/321:40:563
220124399162,6cyclictest0-21swapper/320:25:593
220124399161,9cyclictest0-21swapper/323:45:553
220124399161,8cyclictest0-21swapper/300:11:053
220124399161,7cyclictest0-21swapper/320:46:023
220124399161,7cyclictest0-21swapper/320:40:563
220124399153,7cyclictest0-21swapper/321:36:033
220124399153,7cyclictest0-21swapper/321:36:033
220124399152,6cyclictest0-21swapper/319:20:543
220124399152,5cyclictest0-21swapper/319:40:573
220124399151,9cyclictest0-21swapper/321:46:023
220124399143,7cyclictest0-21swapper/322:40:583
220124399142,8cyclictest0-21swapper/323:30:563
220124399142,8cyclictest0-21swapper/322:55:513
220124399142,7cyclictest0-21swapper/320:50:573
220124399142,7cyclictest0-21swapper/300:20:593
220124399142,6cyclictest0-21swapper/319:31:013
220124399142,5cyclictest0-21swapper/319:35:563
220124399141,7cyclictest0-21swapper/322:05:553
220124399141,7cyclictest0-21swapper/321:05:543
220124399141,7cyclictest0-21swapper/320:06:003
220124399141,7cyclictest0-21swapper/320:06:003
220124399141,7cyclictest0-21swapper/319:50:593
220124399141,6cyclictest0-21swapper/319:45:553
220124399134,6cyclictest0-21swapper/322:30:563
220124399134,6cyclictest0-21swapper/321:25:553
220124399134,6cyclictest0-21swapper/321:10:583
220124399132,6cyclictest0-21swapper/300:30:503
220124399132,5cyclictest0-21swapper/320:55:543
220124399131,7cyclictest0-21swapper/321:15:543
220124399131,6cyclictest0-21swapper/320:30:593
220124399131,6cyclictest0-21swapper/320:10:553
220124399131,6cyclictest0-21swapper/319:25:563
220124399131,6cyclictest0-21swapper/319:15:573
220124399124,5cyclictest0-21swapper/300:00:573
220124399124,5cyclictest0-21swapper/300:00:573
220124399122,5cyclictest0-21swapper/321:20:583
220124399121,7cyclictest0-21swapper/319:10:593
220124399121,6cyclictest0-21swapper/319:55:563
220124399121,6cyclictest0-21swapper/300:15:483
220124399111,7cyclictest0-21swapper/322:50:563
220124399111,7cyclictest0-21swapper/320:00:583
220124399111,6cyclictest0-21swapper/321:00:593
220124399101,6cyclictest0-21swapper/320:15:573
22012439993,5cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional