You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 06:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Thu May 28, 2026 00:42:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
538083995748,6cyclictest1-21systemd22:10:011
538083995543,8cyclictest635476-21cat22:25:551
538083995543,8cyclictest635476-21cat22:25:551
538083995142,6cyclictest1-21systemd21:35:011
538083995142,6cyclictest1-21systemd21:35:011
538083995129,19cyclictest562586-21fschecks_count20:30:531
538083995126,21cyclictest719453-21aten_r2power_cu00:10:481
538083995021,7cyclictest698589-21sh23:45:011
538084994940,5cyclictest0-21swapper/222:46:002
53808399491,20cyclictest583553-21ssh21:21:041
538082994939,6cyclictest151ktimers/020:41:030
53808399484,26cyclictest724245-21ssh00:16:031
53808499475,32cyclictest671910-21ssh23:11:042
53808499475,32cyclictest671910-21ssh23:11:042
538084994738,6cyclictest420-21avahi-daemon22:05:012
538084994737,6cyclictest600037-21unixbench_singl21:41:102
538083994725,18cyclictest0-21swapper/123:15:001
538083994725,18cyclictest0-21swapper/123:15:001
53808399472,21cyclictest687951-21ssh23:31:011
53808499464,33cyclictest623675-21rm22:11:022
538083994637,5cyclictest694535-21cron23:40:011
53808399463,36cyclictest683889-21ssh23:26:001
538083994621,3cyclictest0-21swapper/123:25:001
538083994621,2cyclictest0-21swapper/119:55:011
538082994615,25cyclictest724378-21ssh00:16:090
538084994537,3cyclictest0-21swapper/200:10:022
538084994535,7cyclictest586025-21cron21:25:012
538083994537,5cyclictest630254-21systemd-run22:20:021
538083994537,5cyclictest630254-21systemd-run22:20:021
53808399452,36cyclictest599553-21ssh21:41:041
538083994521,3cyclictest0-21swapper/100:25:531
53808399451,22cyclictest615670-21ssh22:01:031
538084994436,5cyclictest575043-21fschecks_time21:10:522
538084994436,5cyclictest261-21systemd-journal23:25:012
538084994435,4cyclictest0-21swapper/221:06:092
538084994431,9cyclictest2903711-21cups-browsed23:35:012
538084994430,10cyclictest643734-21ntp_offset22:36:022
53808499442,31cyclictest663816-21ssh23:01:022
538083994435,5cyclictest0-21swapper/123:00:011
538083994422,3cyclictest694806-21kworker/u8:6-xprtiod23:45:461
53808399432,30cyclictest643700-21ssh22:36:011
538082994324,15cyclictest0-21swapper/000:05:540
538082994322,12cyclictest574061-21diskmemload22:46:010
538084994235,3cyclictest0-21swapper/200:05:002
538084994234,5cyclictest670438-21systemd-run23:10:012
538084994231,7cyclictest421-21dbus-daemon20:45:012
538083994233,6cyclictest642282-21grep22:35:001
538083994233,6cyclictest634318-21latency_hist22:25:011
538083994233,6cyclictest634318-21latency_hist22:25:011
538083994233,6cyclictest420-21avahi-daemon20:05:021
538082994233,4cyclictest12450irq/33-eth023:41:030
538082994232,7cyclictest439-21systemd-logind21:50:010
538082994232,6cyclictest614194-21unin-run22:00:010
538082994212,25cyclictest659-21snmpd20:36:020
538083994129,9cyclictest712242-21sh00:01:061
538083994121,4cyclictest0-21swapper/100:40:001
538082994134,5cyclictest421-21dbus-daemon22:05:010
538082994134,4cyclictest568081-21systemd-run20:50:010
538082994133,5cyclictest672055-21mailstats23:11:070
538082994133,5cyclictest672055-21mailstats23:11:070
538082994133,5cyclictest547104-21systemd-run19:40:010
538082994119,14cyclictest12350irq/32-eth021:21:020
538084994033,4cyclictest0-21swapper/222:41:162
538084994032,5cyclictest728847-21unixbench_singl00:21:112
538084994032,5cyclictest683194-21aten_r2power_fr23:25:482
538084994031,5cyclictest582007-21ssh21:20:012
538084994029,7cyclictest420-21avahi-daemon21:51:182
538084994027,9cyclictest635632-21ntp_kernel_pll_22:26:012
538084994027,9cyclictest635632-21ntp_kernel_pll_22:26:012
53808499402,32cyclictest627538-21ssh22:15:572
53808499402,32cyclictest627538-21ssh22:15:572
538083994032,5cyclictest606109-21idleruntime-cro21:50:011
538083994029,8cyclictest647725-21ntp_kernel_pll_22:41:101
538083993932,4cyclictest582023-21munin-run21:20:011
538083993930,6cyclictest439-21systemd-logind20:00:021
538082993933,4cyclictest706635-21cron23:55:010
538082993932,4cyclictest12350irq/32-eth000:11:050
538082993931,6cyclictest538081-21cyclictest00:01:060
538082993930,5cyclictest607057-21fschecks_time21:50:510
538082993928,8cyclictest707881-21missed_timers23:55:560
538084993830,5cyclictest1054-21mta-sts-daemon23:38:392
538084993830,5cyclictest0-21swapper/222:00:012
538084993830,5cyclictest0-21swapper/219:40:012
538084993828,7cyclictest738913-21true00:35:012
538084993828,6cyclictest696539-21unixbench_multi23:41:112
538083993830,5cyclictest562088-21systemd-run20:30:011
538083993830,4cyclictest0-21swapper/120:46:011
538083993829,5cyclictest611492-21ntp_kernel_pll_21:55:591
538083993828,7cyclictest727644-21aten_r2power_vo00:20:491
538082993830,5cyclictest647988-21mailstats22:41:170
538082993825,5cyclictest690525-21cron23:35:000
538084993731,3cyclictest0-21swapper/200:40:012
538084993729,5cyclictest724443-21ssh00:16:102
538084993729,5cyclictest598005-21cron21:40:002
538084993728,6cyclictest1-21systemd19:25:022
538084993728,4cyclictest0-21swapper/223:45:572
538084993726,8cyclictest568869-21needreboot20:50:562
538083993731,4cyclictest678442-21munin-run23:20:001
538083993728,6cyclictest421-21dbus-daemon21:10:011
538082993731,4cyclictest676170-21cat23:16:130
538082993727,7cyclictest657862-21sshd22:54:100
538082993727,5cyclictest151ktimers/021:11:000
53808499363,27cyclictest603498-21ssh21:46:012
538084993630,3cyclictest0-21swapper/219:20:002
53808499362,27cyclictest587480-21ssh21:26:042
53808499362,27cyclictest587480-21ssh21:26:042
538083993628,4cyclictest1054-21mta-sts-daemon21:50:531
53808399362,24cyclictest651649-21ssh22:46:001
538083993621,8cyclictest655733-21sh22:51:011
538082993628,5cyclictest551583-21systemd-run19:55:010
538082993623,10cyclictest662332-21munin-run23:00:010
538082993620,12cyclictest12350irq/32-eth023:01:040
538084993526,6cyclictest420-21avahi-daemon21:32:142
538084993526,6cyclictest420-21avahi-daemon21:32:142
538084993526,6cyclictest2903711-21cups-browsed22:58:392
538083993528,3cyclictest0-21swapper/100:00:011
538083993527,6cyclictest574061-21diskmemload23:50:541
53808399352,26cyclictest575444-21ssh21:10:591
538083993519,11cyclictest421-21dbus-daemon00:31:011
53808299355,20cyclictest420-21avahi-daemon21:33:310
53808299355,20cyclictest420-21avahi-daemon21:33:310
538082993528,4cyclictest631134-21sh22:20:510
538082993528,4cyclictest631134-21sh22:20:510
538082993527,5cyclictest599390-21ntp_kernel_pll_21:40:580
538082993524,8cyclictest261-21systemd-journal21:35:030
538082993522,10cyclictest571028-21kworker/u8:4-xprtiod23:27:270
538084993428,3cyclictest0-21swapper/223:55:012
538084993426,5cyclictest538589-21fschecks_count19:10:522
538084993425,5cyclictest1056-21mta-sts-daemon00:29:502
538084993424,7cyclictest420-21avahi-daemon22:30:452
538084993423,6cyclictest678478-21systemd-run23:20:012
538083993425,7cyclictest547061-21/usr/sbin/munin19:40:021
538082993428,4cyclictest622253-21systemd-run22:10:010
538082993428,4cyclictest557575-21systemd-run20:15:010
538082993425,7cyclictest638569-21kworker/u8:7-nfsiod23:10:020
538082993425,6cyclictest420-21avahi-daemon23:37:440
538082993414,13cyclictest12350irq/32-eth022:26:010
538082993414,13cyclictest12350irq/32-eth022:26:010
538084993326,3cyclictest0-21swapper/220:01:062
538084993325,5cyclictest634244-21munin-run22:25:002
538084993325,5cyclictest634244-21munin-run22:25:002
538084993325,5cyclictest571091-21systemd-run21:00:012
538084993325,5cyclictest563576-21systemd-run20:35:012
538083993328,2cyclictest0-21swapper/120:45:011
538083993325,5cyclictest598020-21munin-plugin-st21:40:001
538082993328,3cyclictest640227-21unixbench_multi22:31:100
538082993326,4cyclictest544088-21systemd-run19:30:010
538082993323,6cyclictest12350irq/32-eth022:16:050
538082993323,6cyclictest12350irq/32-eth022:16:050
53808299331,29cyclictest0-21swapper/000:20:570
53808499323,22cyclictest2903711-21cups-browsed20:16:022
53808499323,19cyclictest710647-21ssh23:59:592
538084993225,3cyclictest0-21swapper/219:35:012
538084993224,5cyclictest720223-21ssh00:11:022
53808499322,21cyclictest655777-21ssh22:51:032
538083993224,6cyclictest261-21systemd-journal19:30:011
538083993224,5cyclictest538583-21fschecks_count19:10:521
538083993224,5cyclictest538081-21cyclictest21:25:261
538083993224,5cyclictest538081-21cyclictest21:25:261
53808399322,25cyclictest667845-21ssh23:06:021
53808299328,4cyclictest14-21ksoftirqd/000:31:060
538082993225,5cyclictest261-21systemd-journal23:50:010
538082993225,4cyclictest544467-21aten_r2power_vo19:30:500
538082993222,8cyclictest421-21dbus-daemon19:50:010
53808299322,24cyclictest579450-21rm21:16:010
538082993220,4cyclictest553605-21fschecks_time20:00:520
538082993217,12cyclictest643316-21if_eth022:35:530
538082993211,5cyclictest14-21ksoftirqd/019:15:590
538084993123,5cyclictest572558-21cron21:05:012
538084993123,5cyclictest547414-21aten_r2power_fr19:40:482
538084993122,6cyclictest568075-21systemd-run20:50:012
538084993122,5cyclictest0-21swapper/220:20:592
538084993122,5cyclictest0-21swapper/220:20:592
538084993121,5cyclictest0-21swapper/222:08:222
538083993123,5cyclictest548151-21systemctl19:41:051
538083993123,3cyclictest0-21swapper/100:06:031
538082993124,3cyclictest0-21swapper/020:20:590
538082993124,3cyclictest0-21swapper/020:20:590
538082993122,3cyclictest0-21swapper/021:10:010
538082993112,4cyclictest14-21ksoftirqd/020:16:020
538082993111,11cyclictest14-21ksoftirqd/000:35:590
538084993024,3cyclictest0-21swapper/219:10:012
538084993024,3cyclictest0-21swapper/219:10:012
538084993022,5cyclictest261-21systemd-journal19:50:012
53808299309,5cyclictest14-21ksoftirqd/000:26:020
538082993025,2cyclictest0-21swapper/021:00:010
538082993017,12cyclictest151ktimers/019:10:590
538084992920,6cyclictest565051-21cron20:40:012
538084992919,7cyclictest561939-21unixbench_multi20:26:082
538083992920,6cyclictest420-21avahi-daemon20:51:081
538083992919,6cyclictest439-21systemd-logind19:50:021
53808399291,25cyclictest663868-21ssh23:01:041
53808299297,5cyclictest14-21ksoftirqd/020:51:000
538082992920,5cyclictest191rcuc/022:10:570
538082992916,9cyclictest12350irq/32-eth021:26:000
538082992916,9cyclictest12350irq/32-eth021:26:000
538082992913,5cyclictest14-21ksoftirqd/019:55:570
538082992910,4cyclictest14-21ksoftirqd/020:25:560
538083992821,3cyclictest0-21swapper/122:10:571
53808299286,5cyclictest14-21ksoftirqd/020:30:590
538082992821,4cyclictest679544-21kernelversion23:20:540
538084992720,4cyclictest556385-21aten_r2power_fr20:10:492
538084992720,4cyclictest554907-21aten_r2power_fr20:05:492
538084992716,8cyclictest439-21systemd-logind19:55:012
538083992720,4cyclictest1055-21mta-sts-daemon20:06:111
538083992720,3cyclictest0-21swapper/120:40:021
538083992719,5cyclictest541060-21cron19:20:001
538082992719,6cyclictest554874-21aten_r2power_en20:05:490
538082992719,5cyclictest2903711-21cups-browsed21:02:090
538084992618,5cyclictest2903711-21cups-browsed19:55:372
538083992621,2cyclictest0-21swapper/120:15:011
538083992618,5cyclictest0-21swapper/121:01:021
538083992617,7cyclictest570793-21timerandwakeup20:56:081
53808299268,5cyclictest14-21ksoftirqd/019:21:030
538082992519,3cyclictest0-21swapper/019:40:580
538083992417,3cyclictest0-21swapper/119:10:011
538083992417,3cyclictest0-21swapper/119:10:011
538083992416,5cyclictest2903711-21cups-browsed20:22:261
538083992416,5cyclictest2903711-21cups-browsed20:22:261
538084992318,3cyclictest538081-21cyclictest19:27:342
538083992316,4cyclictest541725-21kernelversion19:20:561
53808399222,14cyclictest558429-21ntpq20:15:591
538083992116,2cyclictest0-21swapper/119:30:501
53808599193,7cyclictest0-21swapper/321:15:583
53808599192,9cyclictest0-21swapper/322:06:013
53808599182,9cyclictest0-21swapper/300:25:573
53808599182,7cyclictest0-21swapper/320:00:583
53808299182,9cyclictest526979-21kworker/u8:5+xprtiod19:10:020
53808299182,9cyclictest526979-21kworker/u8:5+xprtiod19:10:020
53808599172,8cyclictest0-21swapper/300:30:593
53808599172,7cyclictest0-21swapper/323:16:023
53808599164,8cyclictest0-21swapper/321:41:013
53808599163,9cyclictest0-21swapper/322:11:103
53808599162,9cyclictest0-21swapper/300:10:583
53808599162,8cyclictest0-21swapper/323:41:003
53808599162,8cyclictest0-21swapper/322:45:513
53808599162,8cyclictest0-21swapper/322:30:563
53808599162,8cyclictest0-21swapper/321:56:023
53808599162,7cyclictest0-21swapper/322:41:053
53808599161,8cyclictest0-21swapper/321:10:573
53808599161,7cyclictest0-21swapper/322:00:573
53808599161,7cyclictest0-21swapper/320:46:003
53808599161,7cyclictest0-21swapper/300:20:543
53808599161,6cyclictest0-21swapper/319:36:023
53808599153,7cyclictest0-21swapper/322:56:003
53808599153,7cyclictest0-21swapper/321:36:003
53808599153,7cyclictest0-21swapper/321:21:013
53808599152,8cyclictest0-21swapper/323:00:593
53808599152,8cyclictest0-21swapper/322:16:013
53808599152,8cyclictest0-21swapper/322:16:013
53808599152,7cyclictest0-21swapper/323:45:593
53808599152,7cyclictest0-21swapper/322:51:023
53808599152,7cyclictest0-21swapper/322:25:593
53808599152,7cyclictest0-21swapper/322:25:593
53808599151,9cyclictest0-21swapper/323:51:013
53808599143,8cyclictest0-21swapper/321:46:063
53808599143,7cyclictest0-21swapper/323:25:563
53808599143,7cyclictest0-21swapper/323:11:003
53808599143,7cyclictest0-21swapper/323:11:003
53808599143,7cyclictest0-21swapper/322:20:583
53808599143,7cyclictest0-21swapper/322:20:583
53808599143,6cyclictest0-21swapper/323:31:013
53808599142,8cyclictest0-21swapper/323:05:573
53808599142,7cyclictest0-21swapper/323:56:113
53808599142,7cyclictest0-21swapper/323:20:573
53808599142,7cyclictest0-21swapper/321:26:033
53808599142,7cyclictest0-21swapper/321:26:033
53808599142,7cyclictest0-21swapper/300:05:543
53808599142,6cyclictest0-21swapper/321:30:513
53808599142,6cyclictest0-21swapper/321:30:513
53808599142,6cyclictest0-21swapper/321:05:583
53808599142,5cyclictest0-21swapper/320:50:583
53808599141,8cyclictest0-21swapper/319:46:033
53808599141,7cyclictest0-21swapper/321:50:563
53808599141,7cyclictest0-21swapper/300:16:013
53808599132,7cyclictest0-21swapper/323:35:493
53808599132,7cyclictest0-21swapper/322:35:503
53808599132,7cyclictest0-21swapper/300:00:573
53808599132,6cyclictest0-21swapper/319:50:593
53808599131,7cyclictest0-21swapper/320:21:053
53808599131,7cyclictest0-21swapper/320:21:053
53808599131,6cyclictest0-21swapper/320:10:573
53808599131,6cyclictest0-21swapper/319:25:583
53808599131,6cyclictest0-21swapper/319:20:563
53808599131,6cyclictest0-21swapper/319:16:043
53808599122,7cyclictest0-21swapper/300:35:503
53808599121,6cyclictest0-21swapper/320:55:573
53808599121,6cyclictest0-21swapper/320:41:043
53808599121,6cyclictest0-21swapper/320:15:593
53808599121,6cyclictest0-21swapper/319:55:583
53808599121,5cyclictest0-21swapper/319:10:493
53808599113,5cyclictest0-21swapper/319:40:573
53808599112,5cyclictest0-21swapper/320:25:583
53808599112,5cyclictest0-21swapper/319:31:023
53808599111,6cyclictest0-21swapper/320:36:003
53808599102,5cyclictest0-21swapper/320:35:013
53808599101,6cyclictest0-21swapper/321:01:003
53808599101,5cyclictest0-21swapper/320:05:523
5380859981,3cyclictest0-21swapper/319:10:023
5380859981,3cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional