You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-27 - 07:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Thu Aug 27, 2026 00:42:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2249222995443,7cyclictest2309905-21latency_hist21:50:021
2249222995344,4cyclictest0-21swapper/121:51:131
2249223995125,22cyclictest2283763-21kworker/u8:7+xprtiod21:05:012
224922399492,9cyclictest2402628-21ssh00:21:052
224922399492,25cyclictest2339107-21ssh22:36:162
2249223994840,5cyclictest2270278-21systemd-run20:20:012
2249223994737,8cyclictest2389172-21idleruntime-cro00:00:012
2249223994723,2cyclictest0-21swapper/222:41:042
2249223994721,3cyclictest0-21swapper/221:10:012
2249223994719,4cyclictest2256089-21ntp_kernel_pll_19:31:032
2249222994735,8cyclictest2360425-21grep23:11:151
224922399463,14cyclictest2396432-21ssh00:11:002
2249223994626,17cyclictest0-21swapper/221:11:132
2249223994622,2cyclictest0-21swapper/220:40:012
2249223994621,3cyclictest0-21swapper/223:25:022
224922399452,16cyclictest2381202-21awk23:46:032
2249222994436,5cyclictest421-21dbus-daemon19:20:011
2249222994433,8cyclictest2303612-21sshd21:39:481
224922399437,15cyclictest534123-21munin-node21:56:032
224922399433,30cyclictest2353744-21ssh23:01:022
2249223994320,3cyclictest0-21swapper/222:30:592
2249223994320,3cyclictest0-21swapper/222:30:592
2249222994334,6cyclictest2380629-21aten_r2power_po23:45:521
2249221994334,7cyclictest2303680-21ssh21:40:010
2249223994235,3cyclictest0-21swapper/200:01:072
2249223994234,4cyclictest0-21swapper/223:51:082
224922399422,19cyclictest2323324-21ssh22:11:062
2249223994218,5cyclictest0-21swapper/222:21:142
2249223994218,5cyclictest0-21swapper/222:21:142
2249222994234,6cyclictest1-21systemd22:50:011
2249222994233,6cyclictest2395926-21basename00:10:521
2249223994134,4cyclictest2303688-21munin-plugin-st21:40:012
2249223994134,4cyclictest2291390-21cron21:20:002
2249222994133,5cyclictest2319958-21grep22:05:571
2249222994117,15cyclictest421-21dbus-daemon20:51:061
2249222994117,15cyclictest421-21dbus-daemon20:51:061
224922299411,5cyclictest171rcu_preempt20:11:001
2249221994131,7cyclictest2366174-21mailstats23:21:110
2249222994035,3cyclictest0-21swapper/122:30:571
2249222994035,3cyclictest0-21swapper/122:30:571
2249222994032,5cyclictest1-21systemd22:05:011
2249222994031,5cyclictest2340297-21ssh22:40:001
2249222994028,9cyclictest2332607-21mailstats22:26:091
2249222994028,9cyclictest2332607-21mailstats22:26:091
2249221994027,4cyclictest2298228-21aten_r2power_vo21:30:530
2249223993933,3cyclictest2345397-21kworker/u8:4-xprtiod23:34:492
224922299393,29cyclictest2362826-21ssh23:16:031
2249222993931,5cyclictest2300635-21munin-plugin-st21:35:011
2249222993930,5cyclictest1002-21mta-sts-daemon00:06:091
2249222993927,6cyclictest0-21swapper/119:41:141
2249221993933,3cyclictest0-21swapper/019:55:010
2249221993933,3cyclictest0-21swapper/019:55:010
2249221993931,5cyclictest2288832-21aten_r2power_cu21:15:510
2249223993831,4cyclictest0-21swapper/223:06:042
2249222993833,4cyclictest2249220-21cyclictest23:41:101
2249222993831,4cyclictest2328148-21kworker/u8:9+rpciod00:35:011
2249222993828,6cyclictest420-21avahi-daemon21:41:011
224922199383,29cyclictest2356879-21ssh23:06:060
2249221993832,3cyclictest151ktimers/020:41:020
2249221993828,3cyclictest0-21swapper/022:00:010
2249221993824,11cyclictest2295059-21aten_r2power_en21:25:520
2249223993728,6cyclictest2282220-21cron21:00:002
2249223993728,6cyclictest2277750-21munin-plugin-st20:45:012
224922399372,28cyclictest2408713-21ssh00:31:012
2249222993729,5cyclictest2403167-21unixbench_multi00:21:201
2249222993728,6cyclictest420-21avahi-daemon21:59:221
2249222993728,6cyclictest2271779-21systemd-run20:25:011
2249221993729,5cyclictest420-21avahi-daemon19:45:020
2249221993727,6cyclictest12650irq/32-eth023:31:060
2249221993725,9cyclictest1-21systemd00:10:520
2249223993628,4cyclictest0-21swapper/221:26:032
224922299365,25cyclictest2353706-21cron23:01:011
2249222993627,6cyclictest2274755-21systemd-run20:35:011
2249221993622,12cyclictest2369141-21proc_pri23:26:080
2249221993620,12cyclictest12650irq/32-eth000:21:040
2249223993529,3cyclictest0-21swapper/200:40:012
2249222993528,4cyclictest2250682-21kworker/u8:0-xprtiod19:58:011
2249222993527,5cyclictest2325073-21munin-plugin-st22:15:011
2249222993527,5cyclictest2291916-21sh21:20:521
2249222993527,5cyclictest2265762-21munin-plugin-st20:05:001
2249222993526,6cyclictest421-21dbus-daemon22:55:571
2249222993525,3cyclictest0-21swapper/123:23:291
2249222993524,7cyclictest265-21systemd-journal23:26:481
2249222993521,12cyclictest2295940-21sh21:26:111
2249221993527,5cyclictest539-21wpa_supplicant23:41:080
2249221993525,7cyclictest0-21swapper/022:21:030
2249221993525,7cyclictest0-21swapper/022:21:030
2249221993524,8cyclictest2256853-21latency_hist19:35:020
2249221993512,17cyclictest2405613-21ssh00:26:010
224922399345,25cyclictest2344646-21ssh22:46:062
2249223993428,3cyclictest0-21swapper/223:36:082
2249223993428,3cyclictest0-21swapper/221:31:062
224922299344,6cyclictest171rcu_preempt23:51:061
2249222993427,4cyclictest2328110-21latency_hist22:20:031
2249222993427,4cyclictest2328110-21latency_hist22:20:031
2249222993427,4cyclictest1001-21mta-sts-daemon23:36:331
2249222993426,4cyclictest0-21swapper/122:41:041
2249222993425,4cyclictest1003-21mta-sts-daemon23:05:271
224922199345,21cyclictest428-21mta-sts-daemon19:58:030
2249221993428,3cyclictest0-21swapper/020:06:100
2249221993427,3cyclictest0-21swapper/020:01:010
2249221993426,6cyclictest2328116-21munin-run22:20:000
2249221993426,6cyclictest2328116-21munin-run22:20:000
2249221993426,5cyclictest12750irq/33-eth022:01:010
2249221993425,7cyclictest2270243-21munin-run20:20:010
2249221993423,8cyclictest2353515-21latency23:00:570
224922199342,26cyclictest2411778-21ssh00:36:040
2249223993324,6cyclictest434882-21cups-browsed23:40:522
2249223993324,6cyclictest1000-21mta-sts-daemon23:10:162
2249222993327,3cyclictest2380474-21kworker/u8:6-xprtiod00:20:011
2249222993327,3cyclictest2380474-21kworker/u8:6-xprtiod00:20:011
2249222993326,4cyclictest2413582-21ssh00:40:011
2249222993325,5cyclictest0-21swapper/123:56:081
2249221993326,4cyclictest2331970-21fschecks_count22:25:550
2249221993326,4cyclictest2331970-21fschecks_count22:25:550
2249221993317,12cyclictest151ktimers/023:46:020
2249221993314,13cyclictest12650irq/32-eth022:31:090
2249221993314,13cyclictest12650irq/32-eth022:31:090
224922399323,17cyclictest428-21mta-sts-daemon19:10:592
2249223993222,7cyclictest0-21swapper/222:25:512
2249223993222,7cyclictest0-21swapper/222:25:512
2249223993216,11cyclictest421-21dbus-daemon00:16:072
2249223993216,11cyclictest421-21dbus-daemon00:16:072
2249222993226,3cyclictest0-21swapper/121:10:011
2249222993225,4cyclictest1001-21mta-sts-daemon00:01:541
2249222993224,5cyclictest420-21avahi-daemon21:01:131
2249222993224,5cyclictest2258207-21idleruntime-cro19:40:011
2249222993223,6cyclictest434882-21cups-browsed22:53:011
2249222993222,4cyclictest0-21swapper/123:35:001
2249222993222,4cyclictest0-21swapper/122:21:041
2249222993222,4cyclictest0-21swapper/122:21:041
224922199323,19cyclictest2390505-21ssh00:01:130
2249221993225,4cyclictest2309816-21ssh21:50:010
2249221993225,4cyclictest2287007-21tail21:11:120
2249221993224,5cyclictest1000-21mta-sts-daemon00:19:430
2249221993224,5cyclictest1000-21mta-sts-daemon00:19:430
2249221993224,4cyclictest151ktimers/022:56:040
2249221993223,6cyclictest2393310-21missed_timers00:06:030
224922199321,28cyclictest2375050-21ssh23:36:010
2249223993126,2cyclictest0-21swapper/221:41:042
2249223993125,3cyclictest0-21swapper/221:55:012
2249223993124,4cyclictest2259714-21munin-plugin-st19:45:012
2249223993124,4cyclictest0-21swapper/221:21:032
2249223993123,5cyclictest0-21swapper/220:00:002
224922299319,7cyclictest2285236-21diskmemload00:26:021
2249222993124,3cyclictest0-21swapper/121:16:031
2249222993123,3cyclictest0-21swapper/121:10:551
2249222993121,8cyclictest2266803-21processes20:06:101
2249222993117,12cyclictest271ktimers/120:45:591
224922199313,21cyclictest2347756-21ssh22:51:110
2249221993125,3cyclictest0-21swapper/000:00:020
2249221993124,3cyclictest0-21swapper/022:41:020
2249221993122,6cyclictest2344740-21proc_pri22:46:100
224922199312,26cyclictest2305314-21timerandwakeup21:41:180
2249221993117,11cyclictest420-21avahi-daemon23:19:250
2249221993114,11cyclictest151ktimers/019:26:000
224922199311,25cyclictest2338470-21ssh22:36:020
2249223993024,3cyclictest0-21swapper/222:51:102
2249223993024,3cyclictest0-21swapper/220:30:562
2249223993022,5cyclictest421-21dbus-daemon22:10:022
2249223993020,8cyclictest694-21cron20:05:002
2249222993023,4cyclictest2270127-21unixbench_multi20:16:131
2249221993023,4cyclictest0-21swapper/019:15:020
2249221993022,5cyclictest0-21swapper/022:15:040
224922199302,24cyclictest151ktimers/019:20:590
2249223992922,4cyclictest1003-21mta-sts-daemon22:16:052
2249223992922,4cyclictest1003-21mta-sts-daemon22:16:052
2249223992920,7cyclictest2252894-21latency19:20:552
2249223992920,4cyclictest0-21swapper/200:26:012
2249222992922,4cyclictest2255119-21unixbench_multi19:26:131
2249222992921,5cyclictest2282226-21grep21:00:001
2249222992921,5cyclictest2276235-21munin-run20:40:011
2249221992923,4cyclictest2285126-21unixbench_multi21:06:140
2249221992923,3cyclictest2245183-21kworker/u8:4-xprtiod19:40:010
2249221992923,3cyclictest0-21swapper/020:55:010
2249221992923,3cyclictest0-21swapper/020:55:010
224922199292,21cyclictest2292587-21ssh21:21:020
224922199291,13cyclictest2408661-21ntpq00:30:590
224922399283,18cyclictest2369024-21ssh23:26:052
2249223992821,4cyclictest2271755-21debian-sa120:25:012
2249223992820,5cyclictest1003-21mta-sts-daemon22:02:182
2249223992817,8cyclictest70-21kswapd023:16:092
224922299283,18cyclictest421-21dbus-daemon19:21:011
224922199288,12cyclictest151ktimers/020:21:020
2249221992821,4cyclictest2274763-21systemd-run20:35:020
2249221992820,5cyclictest0-21swapper/020:50:010
2249221992819,6cyclictest2359236-21ssh23:10:510
2249221992817,8cyclictest2310351-21tail21:50:510
2249221992816,7cyclictest12650irq/32-eth023:51:020
224922399275,18cyclictest2252205-21munin-run19:20:012
2249223992721,3cyclictest0-21swapper/221:46:052
2249223992721,3cyclictest0-21swapper/220:15:022
2249223992715,7cyclictest0-21swapper/220:06:052
2249222992719,5cyclictest434882-21cups-browsed19:34:471
2249222992719,4cyclictest1000-21mta-sts-daemon19:50:011
224922199275,14cyclictest151ktimers/022:06:030
2249221992716,8cyclictest2283647-21unixbench_multi21:01:140
2249223992621,3cyclictest0-21swapper/222:55:572
2249223992619,4cyclictest2280730-21grep20:55:002
2249223992619,4cyclictest2280730-21grep20:55:002
2249223992615,7cyclictest0-21swapper/200:06:062
224922199263,17cyclictest665-21snmpd19:16:010
2249221992621,3cyclictest1003-21mta-sts-daemon20:55:590
2249221992619,4cyclictest2276226-21cron20:40:010
2249221992619,3cyclictest0-21swapper/019:45:550
2249221992617,7cyclictest2273226-21sshd20:27:480
2249223992519,3cyclictest0-21swapper/219:10:022
2249223992517,5cyclictest434882-21cups-browsed20:46:532
2249222992518,5cyclictest2272152-21aten_r2power_vo20:25:541
2249223992416,5cyclictest434882-21cups-browsed19:45:142
2249223992415,6cyclictest567-21gdbus19:38:162
2249222992417,4cyclictest2261844-21kernelversion19:50:571
2249222992417,4cyclictest2261844-21kernelversion19:50:571
2249223992318,2cyclictest0-21swapper/220:30:012
224922299238,4cyclictest28-21ksoftirqd/119:14:481
224922299222,14cyclictest2277141-21ntpq20:41:011
2249221992212,8cyclictest0-21swapper/019:10:020
2249223992112,6cyclictest567-21gdbus19:25:592
224922399211,15cyclictest2262216-21ps19:51:082
224922399211,15cyclictest2262216-21ps19:51:082
2249221992117,2cyclictest0-21swapper/020:11:130
224922499183,8cyclictest0-21swapper/322:01:023
224922499183,7cyclictest0-21swapper/322:16:053
224922499183,7cyclictest0-21swapper/322:16:053
224922499182,8cyclictest0-21swapper/321:56:003
224922499173,5cyclictest0-21swapper/300:01:133
224922499172,8cyclictest0-21swapper/322:36:043
224922499172,6cyclictest0-21swapper/300:21:033
224922499171,9cyclictest0-21swapper/321:46:013
224922499163,7cyclictest0-21swapper/322:41:023
224922499163,7cyclictest0-21swapper/321:26:053
224922499163,6cyclictest0-21swapper/300:16:073
224922499163,6cyclictest0-21swapper/300:16:073
224922499162,8cyclictest0-21swapper/323:46:023
224922499162,8cyclictest0-21swapper/323:11:023
224922499162,8cyclictest0-21swapper/321:21:043
224922499162,8cyclictest0-21swapper/300:26:013
224922499162,7cyclictest0-21swapper/323:06:043
224922499162,7cyclictest0-21swapper/322:51:063
224922299161,12cyclictest2249231-21systemctl19:10:021
224922499154,6cyclictest0-21swapper/322:06:093
224922499153,7cyclictest0-21swapper/300:11:053
224922499152,8cyclictest0-21swapper/321:36:033
224922499152,7cyclictest0-21swapper/323:51:083
224922499152,6cyclictest0-21swapper/319:56:023
224922499151,6cyclictest0-21swapper/320:51:073
224922499151,6cyclictest0-21swapper/320:51:073
224922499151,6cyclictest0-21swapper/320:31:063
224922499151,6cyclictest0-21swapper/320:26:083
224922499151,6cyclictest0-21swapper/319:31:033
224922499151,6cyclictest0-21swapper/319:11:003
224922499144,7cyclictest0-21swapper/323:01:053
224922499144,6cyclictest0-21swapper/323:26:023
224922499144,6cyclictest0-21swapper/323:21:063
224922499143,6cyclictest0-21swapper/323:36:013
224922499143,6cyclictest0-21swapper/323:31:033
224922499143,6cyclictest0-21swapper/321:11:053
224922499142,7cyclictest0-21swapper/322:21:053
224922499142,7cyclictest0-21swapper/322:21:053
224922499142,7cyclictest0-21swapper/321:51:113
224922499142,7cyclictest0-21swapper/321:31:063
224922499142,7cyclictest0-21swapper/300:35:553
224922499142,5cyclictest0-21swapper/321:06:033
224922499141,7cyclictest0-21swapper/322:26:013
224922499141,7cyclictest0-21swapper/322:26:013
224922499141,6cyclictest0-21swapper/319:51:043
224922499141,6cyclictest0-21swapper/319:51:043
224922499141,6cyclictest0-21swapper/319:36:063
224922499141,6cyclictest0-21swapper/319:16:003
224922499133,7cyclictest0-21swapper/321:40:593
224922499132,6cyclictest0-21swapper/322:31:023
224922499132,6cyclictest0-21swapper/322:31:023
224922499131,8cyclictest0-21swapper/323:16:123
224922499131,5cyclictest0-21swapper/320:00:593
224922499123,6cyclictest0-21swapper/323:56:033
224922499123,5cyclictest0-21swapper/320:20:013
224922499122,7cyclictest0-21swapper/322:55:513
224922499122,6cyclictest0-21swapper/321:15:573
224922499122,5cyclictest0-21swapper/321:01:023
224922499121,7cyclictest0-21swapper/319:46:043
224922499121,7cyclictest0-21swapper/300:30:493
224922499121,6cyclictest0-21swapper/320:21:033
224922499121,6cyclictest0-21swapper/319:26:023
224922499121,5cyclictest0-21swapper/320:55:583
224922499112,6cyclictest0-21swapper/323:40:583
224922499112,6cyclictest0-21swapper/320:15:013
224922499112,5cyclictest0-21swapper/322:10:513
224922499111,6cyclictest0-21swapper/320:50:013
224922499111,6cyclictest0-21swapper/320:05:563
224922499111,6cyclictest0-21swapper/300:05:543
224922499102,5cyclictest0-21swapper/320:40:543
224922499101,6cyclictest0-21swapper/322:45:563
224922499101,6cyclictest0-21swapper/320:36:083
224922499101,5cyclictest0-21swapper/319:41:053
224922499101,5cyclictest0-21swapper/319:20:543
224922499101,4cyclictest0-21swapper/319:10:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional