You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 08:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Sat Aug 22, 2026 00:42:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
981583994941,5cyclictest1014601-21latency_hist21:00:021
981584994835,5cyclictest0-21swapper/222:01:002
981582994636,7cyclictest1-21systemd22:20:010
981584994537,5cyclictest485-21in:imuxsock22:40:012
981584994335,5cyclictest1020651-21systemd-run21:15:022
981584994335,5cyclictest1020651-21systemd-run21:15:022
981583994335,5cyclictest1004082-21munin-plugin-st20:25:011
981583994334,5cyclictest1118486-21munin-run23:55:001
981582994336,4cyclictest1121644-21cups-browsed00:00:020
981582994335,5cyclictest1024933-21ssh21:21:050
981584994234,5cyclictest1054373-21systemd-run22:10:022
98158499423,33cyclictest1079970-21rm22:50:582
981584994232,4cyclictest0-21swapper/222:55:562
981583994237,2cyclictest0-21swapper/100:00:001
981582994236,4cyclictest1-21systemd22:40:010
981584994033,3cyclictest0-21swapper/221:25:012
981584994032,5cyclictest1-21systemd00:00:012
981584994032,5cyclictest1106285-21ssh23:35:022
981584994031,5cyclictest1095879-21unixbench_singl23:16:182
981582994029,8cyclictest989063-21cron19:35:000
981582994029,8cyclictest989063-21cron19:35:000
981582994026,5cyclictest265-21systemd-journal23:01:010
98158499393,29cyclictest1058594-21ssh22:16:012
981584993931,4cyclictest1002-21mta-sts-daemon21:43:392
98158499391,31cyclictest1128895-21ssh00:11:012
981583993931,5cyclictest1025195-21mailstats21:21:121
981583993931,4cyclictest1000-21mta-sts-daemon22:30:301
981584993829,5cyclictest1008557-21cron20:40:002
981584993826,8cyclictest1055938-21timerandwakeup22:11:102
981584993826,8cyclictest1055938-21timerandwakeup22:11:102
981584993824,10cyclictest1132044-21sh00:16:042
981583993833,2cyclictest0-21swapper/100:31:051
981583993830,4cyclictest1001-21mta-sts-daemon22:56:051
981583993826,8cyclictest3397920-21cups-browsed22:08:471
981584993729,5cyclictest1097930-21fschecks_time23:20:542
981583993730,4cyclictest1097165-21latency_hist23:20:021
981583993730,4cyclictest1003-21mta-sts-daemon00:19:491
981583993729,5cyclictest3397920-21cups-browsed21:11:091
981583993729,5cyclictest3397920-21cups-browsed21:11:091
981583993729,5cyclictest1103762-21aten_r2power_en23:30:501
981583993728,7cyclictest1-21systemd00:10:011
981583993728,6cyclictest421-21dbus-daemon19:31:001
981583993728,6cyclictest421-21dbus-daemon19:31:001
981582993729,6cyclictest3397920-21cups-browsed21:27:200
981584993629,3cyclictest0-21swapper/223:01:062
981583993630,3cyclictest0-21swapper/123:20:541
981583993630,3cyclictest0-21swapper/121:01:011
981583993627,6cyclictest1-21systemd22:00:021
981583993625,8cyclictest1113479-21needreboot23:45:561
981582993630,4cyclictest1075772-21idleruntime-cro22:45:010
981582993628,5cyclictest1109362-21systemd-run23:40:020
981582993626,7cyclictest1012371-21needreboot20:50:580
981584993529,3cyclictest0-21swapper/221:20:012
981584993527,6cyclictest421-21dbus-daemon22:25:012
981584993526,6cyclictest3397920-21cups-browsed21:30:592
981583993527,5cyclictest1022400-21unixbench_singl21:16:131
981582993525,7cyclictest3397917-21cupsd20:56:030
981584993428,3cyclictest0-21swapper/221:55:012
981584993428,3cyclictest0-21swapper/221:00:012
981584993427,4cyclictest999565-21munin-plugin-st20:10:012
981584993426,5cyclictest421-21dbus-daemon00:25:012
981584993426,5cyclictest1001-21mta-sts-daemon21:10:022
981583993428,3cyclictest0-21swapper/121:26:111
981583993427,3cyclictest0-21swapper/119:15:011
981583993426,5cyclictest265-21systemd-journal22:16:541
981583993426,5cyclictest1139948-21systemd-run00:30:021
981583993423,8cyclictest1006380-21needreboot20:30:571
981582993427,4cyclictest1097245-21latency_hist23:20:020
981582993419,3cyclictest1017567-21diskmemload22:11:020
981582993419,3cyclictest1017567-21diskmemload22:11:020
981584993327,3cyclictest0-21swapper/223:51:052
981584993326,4cyclictest1004078-21debian-sa120:25:012
981584993326,4cyclictest1000-21mta-sts-daemon22:29:352
981584993325,5cyclictest995061-21munin-plugin-st19:55:012
981584993325,5cyclictest1040096-21missed_timers21:45:552
981583993325,5cyclictest1042322-21latency_hist21:50:031
981583993325,5cyclictest0-21swapper/119:20:011
981583993323,7cyclictest1085879-21latency23:00:541
981583993323,6cyclictest1112376-21cron23:45:011
981582993327,4cyclictest1018369-21fschecks_time21:10:550
981582993327,4cyclictest1018369-21fschecks_time21:10:550
981582993326,4cyclictest1139960-21latency_hist00:30:020
981582993325,5cyclictest1121621-21cups-browsed00:12:530
981582993324,7cyclictest1022372-21grep21:16:130
981584993224,5cyclictest1140134-21latency_hist00:30:032
981584993223,4cyclictest0-21swapper/220:30:592
981584993221,8cyclictest1015437-21ntp_kernel_pll_21:01:002
981583993226,3cyclictest0-21swapper/123:11:081
981583993226,3cyclictest0-21swapper/122:45:571
981583993226,3cyclictest0-21swapper/120:16:051
981583993225,4cyclictest1045175-21cron21:55:011
981583993225,4cyclictest1036179-21latency_hist21:40:021
981583993225,4cyclictest0-21swapper/120:40:011
981583993223,6cyclictest983289-21kworker/u8:0+xprtiod19:45:001
981583993222,6cyclictest3397920-21cups-browsed22:23:161
981582993226,4cyclictest1081874-21systemd-run22:55:010
981582993224,5cyclictest1091492-21/usr/sbin/munin23:10:530
981582993223,6cyclictest694-21cron00:20:010
981582993222,8cyclictest0-21swapper/021:51:110
981582993222,7cyclictest421-21dbus-daemon23:28:410
981582993222,7cyclictest3397920-21cups-browsed19:50:480
981582993222,4cyclictest1051329-21systemd-run22:05:020
981582993218,3cyclictest0-21swapper/023:00:010
981584993125,3cyclictest0-21swapper/221:40:012
981584993125,3cyclictest0-21swapper/221:25:522
981584993124,3cyclictest0-21swapper/223:50:012
981584993124,3cyclictest0-21swapper/200:36:102
981584993124,3cyclictest0-21swapper/200:36:102
981584993123,5cyclictest0-21swapper/220:00:012
981584993119,9cyclictest988383-21needreboot19:30:562
981584993119,9cyclictest988383-21needreboot19:30:562
981583993125,3cyclictest0-21swapper/122:26:071
981583993123,5cyclictest990566-21idleruntime-cro19:40:001
981583993123,5cyclictest990566-21idleruntime-cro19:40:001
98158399312,25cyclictest420-21avahi-daemon22:13:331
98158399312,25cyclictest420-21avahi-daemon22:13:331
981583993121,7cyclictest1089436-21mailstats23:06:111
981582993125,4cyclictest1000-21mta-sts-daemon20:16:030
981582993124,4cyclictest1016093-21systemd-run21:05:020
981582993123,6cyclictest1032928-21idleruntime-cro21:35:010
981582993118,10cyclictest0-21swapper/000:40:010
981582993118,10cyclictest0-21swapper/000:40:010
981584993025,2cyclictest0-21swapper/222:50:022
981584993024,3cyclictest0-21swapper/222:45:012
981584993024,3cyclictest0-21swapper/219:15:022
981584993023,4cyclictest1003-21mta-sts-daemon22:30:492
981584993022,5cyclictest1107075-21gltestperf23:35:532
981584993022,5cyclictest1002-21mta-sts-daemon00:35:022
981584993021,6cyclictest990598-21systemd-run19:40:012
981584993021,6cyclictest990598-21systemd-run19:40:012
981584993020,8cyclictest1112401-21sh23:45:022
98158399303,20cyclictest1101382-21ssh23:26:001
981583993025,2cyclictest0-21swapper/100:40:021
981583993025,2cyclictest0-21swapper/100:40:021
981583993023,3cyclictest0-21swapper/121:41:011
981583993022,5cyclictest996488-21unixbench_singl19:56:101
981583993022,5cyclictest1048834-21aten_r2power_fr22:00:491
981583993022,3cyclictest0-21swapper/122:50:571
981582993024,4cyclictest1110536-21ntp_kernel_pll_23:41:000
981582993024,4cyclictest1061042-21aten_r2power_en22:20:500
981582993024,3cyclictest1037804-21unixbench_singl21:41:100
981582993024,3cyclictest0-21swapper/022:00:010
981582993023,4cyclictest997992-21unixbench_singl20:01:100
981582993023,4cyclictest1091175-21latency_hist23:10:020
981582993023,4cyclictest1017563-21latency_hist21:10:030
981584992922,3cyclictest0-21swapper/223:25:522
981584992922,3cyclictest0-21swapper/223:06:032
981584992922,3cyclictest0-21swapper/221:56:002
981584992921,5cyclictest992067-21cron19:45:002
981583992922,4cyclictest1073147-21ssh22:40:411
981583992922,4cyclictest1001-21mta-sts-daemon20:46:011
981583992922,4cyclictest0-21swapper/119:55:021
981583992921,6cyclictest986753-21latency19:25:511
981583992921,6cyclictest986753-21latency19:25:511
981583992912,12cyclictest3397920-21cups-browsed23:38:041
98158299293,12cyclictest1017567-21diskmemload22:47:560
981582992923,4cyclictest1039712-21aten_r2power_vo21:45:490
981582992922,4cyclictest1075779-21kworker/u8:15-xprtiod23:46:090
981584992820,5cyclictest1124088-21sshd00:03:192
981584992818,7cyclictest1125635-21latency00:05:552
98158499281,24cyclictest1092302-21ssh23:11:042
98158499281,23cyclictest3397917-21cupsd20:01:042
981583992822,3cyclictest0-21swapper/120:05:011
981583992820,5cyclictest999371-21timerwakeupswit20:06:111
981583992819,5cyclictest0-21swapper/100:22:271
981583992815,9cyclictest1030773-21/usr/sbin/munin21:30:581
981582992823,3cyclictest1002-21mta-sts-daemon19:11:010
981582992823,3cyclictest0-21swapper/023:51:000
981582992822,4cyclictest981581-21cyclictest20:31:110
981582992822,4cyclictest421-21dbus-daemon22:30:010
981582992820,6cyclictest989938-21ntp_kernel_pll_19:35:590
981582992820,6cyclictest989938-21ntp_kernel_pll_19:35:590
981582992820,5cyclictest1000-21mta-sts-daemon20:41:040
981582992820,5cyclictest1000-21mta-sts-daemon20:41:040
98158299281,22cyclictest1067773-21ntpq22:30:590
98158499274,13cyclictest428-21mta-sts-daemon19:21:012
981584992721,4cyclictest0-21swapper/220:30:012
98158399274,18cyclictest1070949-21ssh22:36:051
981583992722,4cyclictest981581-21cyclictest20:51:071
98158399272,19cyclictest265-21systemd-journal00:01:011
981583992720,3cyclictest0-21swapper/100:12:091
98158299272,19cyclictest12650irq/32-eth022:05:590
981582992721,4cyclictest1008487-21unixbench_singl20:36:080
981582992721,3cyclictest0-21swapper/023:30:580
981582992721,3cyclictest0-21swapper/000:00:560
981582992720,5cyclictest421-21dbus-daemon00:09:350
981582992720,4cyclictest1001085-21systemd-run20:15:010
981582992719,6cyclictest986924-21ntp_kernel_err19:25:550
981582992719,6cyclictest986924-21ntp_kernel_err19:25:550
981582992719,5cyclictest1011580-21true20:50:010
981582992712,11cyclictest0-21swapper/021:40:010
981584992620,3cyclictest0-21swapper/220:15:012
981584992619,4cyclictest983584-21fschecks_count19:15:532
981583992620,3cyclictest413603-21kworker/u8:5-xprtiod19:50:021
981583992619,3cyclictest0-21swapper/121:10:011
98158299267,14cyclictest665-21snmpd00:31:470
98158299265,5cyclictest1135001-21ssh00:21:000
981582992617,6cyclictest413603-21kworker/u8:5-xprtiod19:21:100
981582992613,9cyclictest12650irq/32-eth023:21:070
981584992519,3cyclictest995284-21kworker/u8:0-xprtiod20:20:012
981583992520,2cyclictest0-21swapper/120:15:011
981582992519,4cyclictest984441-21sed19:16:110
981582992517,6cyclictest0-21swapper/020:10:010
98158299251,11cyclictest991469-21ntpq19:40:590
981584992416,6cyclictest1012073-21fschecks_count20:50:532
981583992415,6cyclictest1-21systemd19:10:011
981583992414,8cyclictest985399-21needreboot19:20:551
981582992413,3cyclictest0-21swapper/019:45:480
981584992317,4cyclictest0-21swapper/220:45:012
981584992317,4cyclictest0-21swapper/220:45:012
981584992317,3cyclictest0-21swapper/220:45:512
981584992316,4cyclictest993452-21unixbench_multi19:46:102
98158499231,17cyclictest987133-21ps19:26:032
98158499231,17cyclictest987133-21ps19:26:032
981583992316,3cyclictest0-21swapper/120:43:051
981583992316,3cyclictest0-21swapper/120:43:051
981582992318,3cyclictest0-21swapper/020:00:010
981582992317,3cyclictest0-21swapper/020:25:020
981583992217,2cyclictest0-21swapper/120:30:011
981582992116,2cyclictest0-21swapper/019:10:010
98158299211,17cyclictest1004961-21ntpq20:25:580
98158599172,7cyclictest0-21swapper/319:36:023
98158599172,7cyclictest0-21swapper/319:36:023
981584991712,2cyclictest0-21swapper/219:10:022
98158599162,8cyclictest0-21swapper/323:11:003
98158599161,7cyclictest0-21swapper/323:06:073
98158599161,7cyclictest0-21swapper/319:51:023
98158599154,4cyclictest0-21swapper/319:31:043
98158599154,4cyclictest0-21swapper/319:31:043
98158599153,7cyclictest0-21swapper/321:35:523
98158599151,8cyclictest0-21swapper/322:50:583
98158599151,8cyclictest0-21swapper/321:51:023
98158599151,7cyclictest0-21swapper/322:40:583
98158599151,6cyclictest0-21swapper/321:01:013
98158599151,6cyclictest0-21swapper/320:01:013
98158599143,7cyclictest0-21swapper/322:46:023
98158599143,5cyclictest0-21swapper/320:11:023
98158599142,8cyclictest0-21swapper/322:55:573
98158599142,8cyclictest0-21swapper/300:00:193
98158599142,7cyclictest0-21swapper/323:41:013
98158599142,7cyclictest0-21swapper/322:21:003
98158599142,7cyclictest0-21swapper/321:15:593
98158599142,6cyclictest0-21swapper/320:06:023
98158599142,5cyclictest0-21swapper/319:20:573
98158599142,5cyclictest0-21swapper/319:15:593
98158599141,9cyclictest0-21swapper/322:16:053
98158599141,8cyclictest0-21swapper/300:36:033
98158599141,8cyclictest0-21swapper/300:36:033
98158599141,8cyclictest0-21swapper/300:11:113
98158599141,7cyclictest0-21swapper/322:01:013
98158599141,6cyclictest0-21swapper/320:46:013
98158599141,6cyclictest0-21swapper/320:16:003
98158599141,6cyclictest0-21swapper/319:56:013
98158599132,7cyclictest0-21swapper/323:15:563
98158599132,7cyclictest0-21swapper/322:10:563
98158599132,7cyclictest0-21swapper/322:10:563
98158599132,7cyclictest0-21swapper/322:06:013
98158599132,7cyclictest0-21swapper/321:40:473
98158599132,7cyclictest0-21swapper/321:10:493
98158599132,7cyclictest0-21swapper/321:10:493
98158599132,7cyclictest0-21swapper/300:20:593
98158599132,7cyclictest0-21swapper/300:15:483
98158599132,6cyclictest0-21swapper/322:35:583
98158599132,6cyclictest0-21swapper/322:25:493
98158599132,6cyclictest0-21swapper/300:05:533
98158599131,8cyclictest0-21swapper/321:48:193
98158599131,7cyclictest0-21swapper/323:35:503
98158599131,7cyclictest0-21swapper/323:31:013
98158599131,7cyclictest0-21swapper/322:30:573
98158599131,7cyclictest0-21swapper/321:26:003
98158599131,7cyclictest0-21swapper/321:21:053
98158599131,6cyclictest0-21swapper/323:55:493
98158599131,5cyclictest0-21swapper/320:20:583
98158599130,6cyclictest0-21swapper/323:45:483
98158599124,6cyclictest0-21swapper/323:50:533
98158599122,7cyclictest0-21swapper/300:30:563
98158599122,6cyclictest0-21swapper/321:55:553
98158599122,5cyclictest0-21swapper/321:05:583
98158599122,5cyclictest0-21swapper/319:11:013
98158599121,7cyclictest0-21swapper/321:30:573
98158599121,7cyclictest0-21swapper/300:25:543
98158599112,6cyclictest0-21swapper/323:25:483
98158599112,6cyclictest0-21swapper/320:30:593
98158599112,5cyclictest0-21swapper/319:46:053
98158599111,7cyclictest0-21swapper/323:20:513
98158599111,6cyclictest0-21swapper/323:00:233
98158599111,5cyclictest0-21swapper/320:56:003
98158599111,5cyclictest0-21swapper/320:25:573
98158599103,4cyclictest0-21swapper/319:45:013
98158599101,6cyclictest0-21swapper/320:40:523
98158599101,6cyclictest0-21swapper/320:40:523
98158599101,5cyclictest0-21swapper/320:50:533
98158599101,5cyclictest0-21swapper/319:25:493
98158599101,5cyclictest0-21swapper/319:25:493
9815859991,6cyclictest0-21swapper/320:35:563
9815859981,6cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional