You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 03:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Fri Sep 04, 2026 00:42:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1047636996049,6cyclictest0-21swapper/100:31:151
1047636996049,6cyclictest0-21swapper/100:31:151
1047635995742,13cyclictest1183338-21cron23:55:010
1047635995444,5cyclictest0-21swapper/023:56:080
1047636995029,6cyclictest171rcu_preempt20:36:091
1047636994839,5cyclictest0-21swapper/123:01:071
104763699483,5cyclictest171rcu_preempt21:21:201
1047635994736,7cyclictest0-21swapper/022:20:010
1047637994536,5cyclictest694-21cron00:00:012
1047636994536,7cyclictest1117021-21sh22:05:021
1047636994535,7cyclictest1101888-21munin-plugin-st21:40:011
1047636994522,7cyclictest171rcu_preempt20:51:041
104763599453,34cyclictest1157433-21ssh23:11:100
1047637994436,5cyclictest1114516-21aten_r2power_cu22:00:552
1047635994430,11cyclictest0-21swapper/000:20:010
1047635994429,12cyclictest1052248-21latency_hist19:25:020
1047637994333,7cyclictest3527540-21cups-browsed22:15:582
1047636994334,5cyclictest1053700-21latency_hist19:30:021
1047636994334,5cyclictest1053700-21latency_hist19:30:021
1047636994331,8cyclictest1169747-21mailstats23:31:201
1047635994335,4cyclictest1136845-21unixbench_multi22:36:190
1047635994322,18cyclictest1084970-21sh21:11:130
1047636994235,4cyclictest265-21systemd-journal00:40:001
1047635994220,16cyclictest421-21dbus-daemon22:11:120
1047636994133,5cyclictest1186607-21latency_hist00:00:031
104763799404,25cyclictest1112137-21sh21:56:062
1047637994034,3cyclictest0-21swapper/221:00:012
1047636994031,5cyclictest0-21swapper/121:31:111
1047636994027,9cyclictest1196433-21kernelversion00:16:041
1047635994032,3cyclictest0-21swapper/019:11:060
1047635994026,8cyclictest12750irq/33-eth023:26:150
1047637993934,2cyclictest0-21swapper/222:21:072
1047637993933,3cyclictest0-21swapper/221:10:012
1047637993933,3cyclictest0-21swapper/200:40:002
104763699391,32cyclictest1139415-21ssh22:41:121
1047635993930,4cyclictest0-21swapper/022:51:130
1047635993914,15cyclictest12650irq/32-eth023:31:100
1047637993834,2cyclictest0-21swapper/200:06:062
104763799383,24cyclictest1085023-21ssh21:11:142
1047635993824,9cyclictest1163444-21sh23:21:070
1047635993816,4cyclictest0-21swapper/022:01:110
1047637993729,5cyclictest1175110-21fschecks_count23:41:002
1047637993726,8cyclictest1169975-21timerwakeupswit23:31:232
1047637993726,8cyclictest1166251-21kernelversion23:26:062
1047636993729,5cyclictest1000-21mta-sts-daemon21:16:081
1047636993729,5cyclictest1000-21mta-sts-daemon21:16:081
1047635993729,5cyclictest421-21dbus-daemon00:35:010
1047635993729,5cyclictest421-21dbus-daemon00:35:010
1047635993722,12cyclictest1082273-21latency_hist21:05:030
1047635993720,2cyclictest171rcu_preempt19:41:060
1047635993715,18cyclictest1154385-21ssh23:06:040
1047635993714,15cyclictest1160565-21ssh23:16:140
1047637993629,3cyclictest0-21swapper/223:21:082
1047637993624,8cyclictest0-21swapper/221:26:082
1047636993629,4cyclictest1130675-21threads22:26:221
1047636993628,5cyclictest1144157-21ssh22:50:021
1047636993628,5cyclictest1071636-21systemd-run20:30:011
1047636993623,10cyclictest1203125-21timerandwakeup00:26:181
1047636993623,10cyclictest1203125-21timerandwakeup00:26:181
104763699362,29cyclictest1118210-21ssh22:06:081
104763699362,29cyclictest1118210-21ssh22:06:081
104763599364,24cyclictest420-21avahi-daemon20:46:110
1047635993629,4cyclictest1129065-21cron22:25:010
1047635993629,4cyclictest1074613-21munin-run20:40:010
1047635993628,5cyclictest1192944-21/usr/sbin/munin00:11:020
1047637993530,2cyclictest0-21swapper/222:40:012
1047637993528,4cyclictest1003-21mta-sts-daemon21:52:032
1047637993528,3cyclictest0-21swapper/221:25:012
1047637993527,4cyclictest0-21swapper/221:36:122
1047637993524,7cyclictest1138725-21aten_r2power_fr22:40:582
104763799352,24cyclictest665-21snmpd19:11:082
1047636993528,3cyclictest0-21swapper/122:00:011
1047635993530,3cyclictest1135117-21latency_hist22:35:020
1047635993528,4cyclictest1201554-21ssh00:25:020
1047635993519,10cyclictest0-21swapper/021:51:090
1047637993427,4cyclictest1110962-21kworker/u8:8-rpciod23:00:012
1047637993427,4cyclictest1110962-21kworker/u8:8-rpciod23:00:012
1047637993427,3cyclictest0-21swapper/223:16:092
1047637993426,5cyclictest1172109-21fschecks_time23:36:012
1047637993426,5cyclictest1089758-21ssh21:20:012
1047637993426,5cyclictest1089758-21ssh21:20:012
1047637993425,6cyclictest1059505-21sed19:46:182
104763699343,25cyclictest1172528-21ssh23:36:101
1047636993426,5cyclictest1082145-21systemd-run21:05:021
1047636993426,5cyclictest1050485-21tail19:16:181
1047636993425,7cyclictest694-21cron21:45:011
104763699342,26cyclictest1127311-21ssh22:21:091
104763699342,25cyclictest1178611-21ssh23:46:101
1047635993426,5cyclictest1080612-21awk21:00:010
1047635993424,4cyclictest1079098-21cron20:55:000
1047635993422,9cyclictest1178878-21ssh23:46:170
1047635993422,5cyclictest1091413-21ssh21:21:290
1047637993327,4cyclictest1047634-21cyclictest23:06:122
1047637993326,3cyclictest0-21swapper/219:41:102
1047637993325,5cyclictest439-21systemd-logind19:40:022
1047637993325,5cyclictest421-21dbus-daemon00:25:022
1047637993325,5cyclictest1150999-21sort23:01:002
1047637993324,6cyclictest485-21in:imuxsock00:30:022
1047637993324,6cyclictest485-21in:imuxsock00:30:022
1047637993324,6cyclictest1000-21mta-sts-daemon22:45:192
1047637993323,8cyclictest1103053-21needreboot21:41:072
104763799331,26cyclictest1121347-21sh22:11:142
1047636993327,3cyclictest0-21swapper/121:10:011
1047636993326,4cyclictest1158001-21unixbench_multi23:11:231
1047636993326,3cyclictest0-21swapper/123:26:131
1047636993326,3cyclictest0-21swapper/122:20:011
1047636993325,5cyclictest1056619-21grep19:40:011
1047636993324,6cyclictest0-21swapper/119:55:011
1047636993324,5cyclictest1182088-21unixbench-2d23:51:211
1047636993323,7cyclictest665-21snmpd00:00:591
104763599334,23cyclictest1113966-21munin-run22:00:010
1047635993327,3cyclictest1177417-21kworker/u8:11-xprtiod00:39:130
1047635993324,7cyclictest3527540-21cups-browsed20:26:000
1047635993324,7cyclictest1003-21mta-sts-daemon19:51:100
1047637993226,3cyclictest0-21swapper/222:09:162
1047637993226,3cyclictest0-21swapper/222:09:162
1047637993225,3cyclictest0-21swapper/223:11:102
1047636993225,3cyclictest0-21swapper/122:31:191
1047636993224,5cyclictest1174985-21aten_r2power_vo23:40:581
104763599323,23cyclictest1088037-21ssh21:16:120
104763599323,23cyclictest1088037-21ssh21:16:120
104763599322,25cyclictest1094041-21ssh21:26:110
1047635993220,9cyclictest1102494-21aten_r2power_en21:40:580
1047635993219,10cyclictest1174406-21latency_hist23:40:020
1047635993219,10cyclictest0-21swapper/022:41:200
1047637993125,3cyclictest0-21swapper/223:51:122
1047637993124,4cyclictest1197280-21unixbench_singl00:16:212
1047637993123,5cyclictest1186442-21cups-browsed00:00:082
1047636993124,3cyclictest0-21swapper/122:51:201
1047636993123,5cyclictest1062659-21latency_hist20:00:021
1047636993121,7cyclictest1108768-21sort21:51:021
1047636993120,7cyclictest1160391-21sh23:16:061
104763599313,6cyclictest171rcu_preempt19:16:080
1047635993126,3cyclictest1001-21mta-sts-daemon22:46:230
1047635993123,4cyclictest0-21swapper/000:05:020
1047635993120,7cyclictest0-21swapper/022:26:080
1047635993117,10cyclictest151ktimers/021:31:120
1047637993022,5cyclictest1132071-21idleruntime-cro22:30:012
1047637993022,5cyclictest1105997-21missed_timers21:46:022
1047637993022,5cyclictest1068630-21awk20:20:012
1047637993022,5cyclictest1065635-21true20:10:012
104763699303,21cyclictest1163541-21ssh23:21:111
1047636993024,3cyclictest0-21swapper/123:06:171
1047636993024,3cyclictest0-21swapper/123:00:021
1047636993024,3cyclictest0-21swapper/123:00:021
1047636993023,5cyclictest1047634-21cyclictest22:36:091
1047636993023,4cyclictest1083616-21diskmemload22:12:151
1047636993022,5cyclictest1186442-21cups-browsed00:11:121
1047636993018,7cyclictest0-21swapper/120:01:051
104763599303,9cyclictest428-21mta-sts-daemon22:06:050
104763599303,9cyclictest428-21mta-sts-daemon22:06:050
104763599302,8cyclictest1003-21mta-sts-daemon20:06:100
1047635993025,3cyclictest0-21swapper/023:01:200
1047635993020,7cyclictest1107936-21cut21:50:020
1047635993018,9cyclictest1059613-21cron19:50:010
1047635993015,13cyclictest1001-21mta-sts-daemon23:40:330
1047635993015,11cyclictest12650irq/32-eth021:36:050
1047637992923,3cyclictest0-21swapper/220:00:012
104763799292,24cyclictest1205772-21ssh00:31:112
104763799292,24cyclictest1205772-21ssh00:31:112
1047637992921,5cyclictest1145937-21sed22:51:232
1047637992921,5cyclictest1097116-21ntpq21:31:152
1047637992921,5cyclictest1074653-21systemd-run20:40:012
1047636992922,4cyclictest1108076-21ssh21:50:031
1047636992922,4cyclictest1055119-21latency_hist19:35:001
1047636992922,4cyclictest1003-21mta-sts-daemon00:08:561
1047635992922,4cyclictest1069168-21fschecks_time20:21:000
1047635992922,3cyclictest0-21swapper/000:06:030
1047635992921,5cyclictest420-21avahi-daemon20:16:160
1047635992918,8cyclictest1002-21mta-sts-daemon19:55:150
104763799282,21cyclictest665-21snmpd20:26:072
1047637992821,4cyclictest1061020-21unixbench_multi19:51:192
1047636992821,4cyclictest1094541-21unixbench-2d21:26:211
104763599288,6cyclictest1075442-21needreboot20:41:030
104763599288,6cyclictest1075442-21needreboot20:41:030
1047635992811,12cyclictest151ktimers/019:26:060
1047635992811,12cyclictest151ktimers/019:26:060
1047637992721,3cyclictest0-21swapper/200:11:062
1047637992718,6cyclictest1132485-21ssh22:30:392
1047636992722,3cyclictest0-21swapper/120:46:061
1047636992721,3cyclictest0-21swapper/120:56:061
1047636992719,5cyclictest1059246-21mailstats19:46:151
1047636992719,5cyclictest1053652-21kworker/u8:0+xprtiod20:15:011
104763599278,12cyclictest420-21avahi-daemon20:31:080
1047637992621,2cyclictest0-21swapper/223:50:012
1047637992619,4cyclictest1064120-21cron20:05:012
1047637992618,5cyclictest1050622-21munin-run19:20:012
1047637992617,7cyclictest1075089-21cpuspeed20:40:562
1047637992617,7cyclictest1075089-21cpuspeed20:40:562
104763699269,5cyclictest171rcu_preempt00:21:121
104763699262,17cyclictest1084930-21ssh21:11:111
1047636992620,3cyclictest0-21swapper/119:21:111
1047635992620,4cyclictest1065885-21aten_r2power_cu20:10:550
1047635992620,4cyclictest1000-21mta-sts-daemon19:10:010
1047635992619,5cyclictest539-21wpa_supplicant22:55:310
1047635992619,5cyclictest539-21wpa_supplicant22:55:310
104763599261,6cyclictest1063485-21ntpq20:01:050
1047635992614,3cyclictest171rcu_preempt00:26:280
1047635992614,3cyclictest171rcu_preempt00:26:280
1047635992611,11cyclictest0-21swapper/019:36:170
1047637992518,5cyclictest1077742-21latency_hist20:50:022
1047637992518,3cyclictest0-21swapper/220:15:012
1047637992517,5cyclictest1070152-21systemd-run20:25:012
1047637992511,2cyclictest171rcu_preempt19:26:182
1047637992511,2cyclictest171rcu_preempt19:26:182
1047636992518,4cyclictest1068620-21sendmail20:20:011
1047635992519,3cyclictest0-21swapper/021:06:060
1047637992418,3cyclictest594362-21kworker/u8:8-xprtiod19:10:022
1047637992418,3cyclictest0-21swapper/220:55:012
1047637992417,4cyclictest1052140-21munin-run19:25:012
1047636992418,3cyclictest0-21swapper/120:45:011
1047636992418,3cyclictest0-21swapper/120:45:011
104763599248,14cyclictest0-21swapper/019:30:570
104763799231,16cyclictest1081489-21ntpq21:01:072
104763699233,15cyclictest3527540-21cups-browsed20:31:081
1047636992318,2cyclictest0-21swapper/119:45:011
1047636992317,3cyclictest0-21swapper/119:15:011
104763799228,10cyclictest750-21ntpd19:31:062
1047637992215,4cyclictest1072131-21fschecks_count20:30:582
104763699222,16cyclictest1069246-21awk20:21:011
1047636992116,2cyclictest0-21swapper/119:10:011
1047636992112,6cyclictest1064491-21aten_r2power_po20:05:581
104763899182,7cyclictest0-21swapper/321:41:123
104763899167,5cyclictest0-21swapper/300:36:083
104763899161,8cyclictest0-21swapper/321:21:243
104763899157,5cyclictest0-21swapper/300:21:083
104763899157,4cyclictest0-21swapper/323:36:073
104763899157,4cyclictest0-21swapper/322:05:013
104763899154,6cyclictest0-21swapper/323:21:073
104763899153,8cyclictest0-21swapper/300:11:073
104763899152,7cyclictest0-21swapper/300:06:073
104763899151,9cyclictest0-21swapper/322:51:153
104763899151,9cyclictest0-21swapper/322:36:123
104763899151,8cyclictest0-21swapper/322:06:153
104763899151,8cyclictest0-21swapper/322:06:153
104763899151,8cyclictest0-21swapper/321:26:113
104763899148,4cyclictest0-21swapper/320:31:033
104763899147,5cyclictest0-21swapper/300:00:023
104763899147,4cyclictest0-21swapper/322:26:153
104763899146,5cyclictest0-21swapper/323:45:563
104763899146,4cyclictest0-21swapper/323:51:103
104763899146,4cyclictest0-21swapper/323:15:593
104763899146,4cyclictest0-21swapper/322:56:083
104763899146,4cyclictest0-21swapper/322:56:083
104763899143,8cyclictest0-21swapper/322:11:123
104763899142,8cyclictest0-21swapper/321:36:083
104763899142,6cyclictest0-21swapper/320:46:083
104763899141,8cyclictest0-21swapper/321:46:123
104763899141,8cyclictest0-21swapper/321:11:073
104763899141,6cyclictest0-21swapper/321:01:073
104763899141,6cyclictest0-21swapper/320:16:053
104763899137,4cyclictest0-21swapper/320:51:173
104763899137,4cyclictest0-21swapper/320:06:093
104763899137,4cyclictest0-21swapper/319:55:013
104763899137,3cyclictest0-21swapper/319:36:103
104763899136,4cyclictest0-21swapper/323:40:583
104763899136,4cyclictest0-21swapper/323:31:013
104763899136,4cyclictest0-21swapper/323:25:563
104763899136,4cyclictest0-21swapper/322:46:113
104763899136,4cyclictest0-21swapper/322:31:053
104763899136,4cyclictest0-21swapper/321:55:573
104763899136,4cyclictest0-21swapper/320:40:003
104763899136,4cyclictest0-21swapper/320:25:013
104763899136,4cyclictest0-21swapper/319:35:013
104763899136,4cyclictest0-21swapper/319:25:573
104763899136,4cyclictest0-21swapper/319:25:573
104763899136,4cyclictest0-21swapper/300:25:593
104763899136,4cyclictest0-21swapper/300:25:593
104763899136,4cyclictest0-21swapper/300:15:563
104763899136,4cyclictest0-21swapper/300:01:033
104763899132,7cyclictest0-21swapper/322:41:073
104763899132,7cyclictest0-21swapper/322:21:073
104763899132,7cyclictest0-21swapper/322:16:073
104763899131,7cyclictest0-21swapper/321:51:083
104763899131,7cyclictest0-21swapper/321:31:003
104763899131,7cyclictest0-21swapper/321:16:073
104763899131,7cyclictest0-21swapper/321:16:073
104763899131,7cyclictest0-21swapper/300:31:053
104763899131,7cyclictest0-21swapper/300:31:053
104763899131,6cyclictest0-21swapper/323:10:593
104763899131,6cyclictest0-21swapper/319:16:123
104763899128,2cyclictest0-21swapper/319:10:013
104763899127,3cyclictest0-21swapper/323:01:053
104763899127,3cyclictest0-21swapper/320:40:543
104763899127,3cyclictest0-21swapper/320:40:543
104763899127,3cyclictest0-21swapper/319:56:163
104763899126,3cyclictest0-21swapper/321:05:553
104763899126,3cyclictest0-21swapper/319:11:063
104763899121,7cyclictest0-21swapper/323:06:033
104763899116,3cyclictest0-21swapper/320:56:043
104763899116,3cyclictest0-21swapper/319:45:583
104763899116,3cyclictest0-21swapper/319:20:573
104763899115,4cyclictest0-21swapper/320:01:053
104763899115,3cyclictest0-21swapper/320:25:563
104763899115,3cyclictest0-21swapper/319:41:003
104763899106,3cyclictest0-21swapper/320:10:553
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional