You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 13:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Wed Dec 10, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1092340994921,23cyclictest0-21swapper/321:45:253
1092334994840,5cyclictest1120101-21unixbench_multi20:25:282
1092340994732,11cyclictest391ktimers/321:50:133
1092327994637,5cyclictest1118872-21cron20:25:010
1092327994634,8cyclictest1193094-21idleruntime-cro00:00:000
1092340994433,8cyclictest391ktimers/321:30:133
109234099438,6cyclictest1139539-21seq21:22:143
109234099438,6cyclictest1139539-21seq21:22:143
109234099431,9cyclictest1197175-21/usr/sbin/munin00:10:213
109234099431,10cyclictest1182992-21/usr/sbin/munin23:30:163
109234099431,10cyclictest1124573-21irqstats20:40:193
1092327994323,16cyclictest1156565-21grep22:10:250
109234099429,7cyclictest1153543-21seq22:04:003
1092340994212,26cyclictest1185588-21tail23:35:263
109234099421,11cyclictest1116138-21meminfo20:15:233
1092327994233,6cyclictest121ktimers/022:20:130
1092327994233,6cyclictest121ktimers/022:20:130
1092327994232,7cyclictest121ktimers/019:35:150
109234099415,4cyclictest1100663-21ntp_kernel_pll_19:30:203
1092340994114,24cyclictest1144491-21timerandwakeup21:35:273
109234099411,10cyclictest1181743-21/usr/sbin/munin23:25:233
1092334994131,7cyclictest1206953-21sendmail00:40:002
109234099401,9cyclictest1109556-21/usr/sbin/munin19:55:233
1092340994019,17cyclictest0-21swapper/322:55:193
109234099401,8cyclictest1094792-21/usr/sbin/munin19:15:273
109234099401,11cyclictest1103992-21meminfo19:40:193
109234099401,11cyclictest1103992-21meminfo19:40:183
109234099401,10cyclictest1198544-21diskstats00:15:163
1092334994033,5cyclictest1151750-21kworker/u8:2+events_unbound22:12:122
1092334994033,5cyclictest1130703-21kworker/u8:0+events_unbound21:02:012
1092331994030,6cyclictest0-21swapper/122:32:141
1092331994025,11cyclictest231ktimers/123:35:131
1092327994031,4cyclictest1131009-21sh21:00:000
1092327994028,7cyclictest1106294-21grep19:45:260
1092327994028,7cyclictest1106294-21grep19:45:260
109234099393,7cyclictest1180852-21taskset23:24:083
109234099392,9cyclictest1190017-21diskstats23:50:163
109234099392,9cyclictest1167273-21cron22:45:013
109234099391,9cyclictest1157371-21df22:15:143
109234099391,9cyclictest1153992-21/usr/sbin/munin22:05:183
109234099391,9cyclictest1150780-21irqstats21:55:193
109234099391,8cyclictest1186802-21/usr/sbin/munin23:40:183
1092340993916,20cyclictest0-21swapper/300:35:173
1092340993915,21cyclictest1119330-21fschecks_time20:25:203
1092340993913,23cyclictest0-21swapper/319:20:503
1092340993912,4cyclictest1094058-21munin-node19:15:023
109234099391,12cyclictest1131543-21/usr/sbin/munin21:00:183
109234099391,11cyclictest1191720-21diskstats23:55:183
109234099391,11cyclictest1163412-21grep22:30:273
109234099391,11cyclictest1122851-21irqstats20:35:173
109234099391,10cyclictest1174786-21runrttasks23:05:193
1092331993927,8cyclictest0-21swapper/121:30:251
109234099388,6cyclictest1188548-21cut23:45:183
109234099388,5cyclictest1136818-21/usr/sbin/munin21:15:213
109234099387,5cyclictest1135525-21ls21:10:263
109234099381,8cyclictest1162157-21cron22:30:003
109234099381,8cyclictest1120966-21fschecks_count20:30:153
1092340993812,4cyclictest1105248-21/usr/sbin/munin19:45:223
1092340993812,4cyclictest1105248-21/usr/sbin/munin19:45:223
1092340993812,22cyclictest1127605-21cron20:50:003
1092340993812,22cyclictest1127605-21cron20:50:003
109234099381,10cyclictest1132962-21/usr/sbin/munin21:05:273
109234099381,10cyclictest1107431-21/usr/sbin/munin19:50:173
1092334993828,7cyclictest1163856-21sh22:35:002
1092334993827,7cyclictest1158314-21grep22:15:252
1092331993826,8cyclictest1127195-21grep20:45:271
1092331993826,8cyclictest1127195-21grep20:45:271
1092327993831,4cyclictest1086836-21kworker/u8:1+events_unbound19:16:380
109234099377,5cyclictest1168094-21open_files22:45:223
109234099376,6cyclictest1195725-21awk00:05:273
109234099373,5cyclictest1156010-21meminfo22:10:193
109234099371,9cyclictest1128859-21tail20:50:293
109234099371,7cyclictest1193456-21fschecks_count00:00:163
109234099371,7cyclictest1129545-21/usr/sbin/munin20:55:233
109234099371,6cyclictest440-21cron22:25:003
109234099371,6cyclictest440-21cron22:25:003
109234099371,11cyclictest1102828-21tail19:35:263
109234099371,10cyclictest1170246-21unixbench_singl22:50:253
109234099370,10cyclictest1200322-21sed00:20:013
1092331993726,8cyclictest1199924-21sendmail00:20:001
1092331993726,6cyclictest0-21swapper/123:20:271
1092327993726,5cyclictest0-21swapper/000:20:260
109234099368,7cyclictest1178529-21cat23:15:253
109234099361,9cyclictest1140641-21/usr/sbin/munin21:25:263
109234099361,9cyclictest1118103-21grep20:20:243
109234099361,7cyclictest1173265-21proc_pri23:00:233
109234099361,7cyclictest1099890-21cron19:30:003
109234099361,10cyclictest1145822-21wc21:40:193
1092340993610,3cyclictest1113987-21/usr/sbin/munin20:10:283
1092327993630,4cyclictest1186019-21kworker/u8:0+events_unbound23:42:340
109234099351,9cyclictest1176646-21/usr/sbin/munin23:10:253
109234099351,9cyclictest1110719-21/usr/sbin/munin20:00:193
109234099351,11cyclictest1202593-21/usr/sbin/munin00:25:223
109234099350,8cyclictest1165594-21idleruntime-cro22:40:013
1092331993527,5cyclictest1179217-21munin-run23:20:011
1092331993524,7cyclictest0-21swapper/120:30:011
109232799359,4cyclictest11718332timerwakeupswit22:55:270
1092327993527,6cyclictest1130703-21kworker/u8:0+events_unbound21:57:090
1092327993525,5cyclictest0-21swapper/022:45:010
109234099347,4cyclictest1113351-21unixbench_singl20:05:273
1092340993411,3cyclictest0-21swapper/300:34:413
1092340993411,3cyclictest0-21swapper/300:34:413
1092334993428,4cyclictest1115223-21kworker/u8:1+events_unbound21:37:072
1092334993424,7cyclictest1185572-21unixbench_multi23:35:262
1092331993426,5cyclictest0-21swapper/120:35:011
1092331993426,4cyclictest0-21swapper/120:51:561
1092331993425,6cyclictest1194784-21sh00:05:001
1092331993424,6cyclictest0-21swapper/123:30:261
1092331993424,6cyclictest0-21swapper/122:50:251
1092327993425,5cyclictest1175808-21idleruntime-cro23:10:000
1092327993424,5cyclictest0-21swapper/021:20:010
1092334993325,4cyclictest0-21swapper/200:15:152
1092334993324,5cyclictest0-21swapper/221:20:162
1092334993324,5cyclictest0-21swapper/221:20:162
1092334993322,6cyclictest0-21swapper/222:35:282
1092331993324,5cyclictest0-21swapper/100:05:211
1092327993321,8cyclictest1143245-21apt-config21:35:000
1092334993225,5cyclictest311ktimers/223:45:122
1092334993224,5cyclictest1177107-21unixbench_singl23:10:282
1092334993224,5cyclictest0-21swapper/220:15:012
1092331993223,6cyclictest0-21swapper/123:40:181
1092331993223,4cyclictest0-21swapper/119:35:261
1092327993223,4cyclictest0-21swapper/022:05:260
1092334993124,3cyclictest0-21swapper/223:40:172
1092334993123,4cyclictest0-21swapper/222:00:262
1092334993123,4cyclictest0-21swapper/219:45:262
1092334993123,4cyclictest0-21swapper/219:45:262
1092334993121,7cyclictest1197736-21unixbench_multi00:10:262
1092331993123,5cyclictest0-21swapper/123:55:281
1092331993122,6cyclictest0-21swapper/120:20:011
1092331993122,6cyclictest0-21swapper/120:10:001
1092331993122,6cyclictest0-21swapper/119:50:021
1092331993122,6cyclictest0-21swapper/119:50:011
1092327993125,4cyclictest1095357-21kworker/u8:2+events_unbound20:11:480
1092327993124,4cyclictest121ktimers/019:20:120
1092327993123,5cyclictest1182485-21kworker/u8:3+events_unbound23:50:000
1092327993121,6cyclictest0-21swapper/000:00:160
1092327993120,8cyclictest0-21swapper/021:05:130
1092334993023,4cyclictest1110334-21latency_hist20:00:012
1092334993019,7cyclictest0-21swapper/221:05:262
1092331993020,6cyclictest0-21swapper/119:15:021
109232799302,4cyclictest131rcu_preempt20:50:150
1092327993022,4cyclictest0-21swapper/020:00:010
1092327993021,5cyclictest1158321-21grep22:15:250
1092327993021,5cyclictest0-21swapper/023:30:250
1092327993020,6cyclictest1120575-21sh20:30:010
1092334992920,4cyclictest0-21swapper/200:25:272
1092334992917,8cyclictest1098205-21basename19:25:012
1092331992922,3cyclictest0-21swapper/123:10:191
1092331992921,4cyclictest0-21swapper/100:35:011
1092331992921,4cyclictest0-21swapper/100:35:001
1092331992920,6cyclictest1200561-21fschecks_time00:20:181
1092331992919,6cyclictest0-21swapper/121:10:271
1092327992923,4cyclictest1110000-21kworker/u8:1+events_unbound20:06:480
1092327992921,4cyclictest0-21swapper/023:10:280
1092327992917,7cyclictest0-21swapper/022:25:270
1092334992820,5cyclictest1148518-21idleruntime-cro21:50:012
1092334992820,5cyclictest0-21swapper/223:15:262
1092334992820,4cyclictest11357132sleep221:10:272
1092334992819,5cyclictest0-21swapper/219:50:252
1092331992821,5cyclictest1115223-21kworker/u8:1+events_unbound21:07:031
1092331992821,4cyclictest0-21swapper/123:50:251
1092331992821,4cyclictest0-21swapper/122:25:271
1092331992821,4cyclictest0-21swapper/100:25:271
1092331992820,5cyclictest0-21swapper/123:45:241
1092331992820,4cyclictest0-21swapper/122:55:181
1092331992820,4cyclictest0-21swapper/119:41:421
1092331992820,4cyclictest0-21swapper/119:41:421
1092327992814,9cyclictest1123977-21cron20:40:010
109232799281,3cyclictest1148741-21apt-get21:50:130
109232799281,10cyclictest12041312latency00:30:180
109232799281,10cyclictest12041312latency00:30:180
1092334992719,4cyclictest0-21swapper/221:55:272
1092334992719,4cyclictest0-21swapper/221:35:002
1092334992718,4cyclictest0-21swapper/200:00:002
1092331992721,3cyclictest0-21swapper/121:50:251
1092331992720,4cyclictest1101118-21unixbench_multi19:30:251
1092331992720,3cyclictest0-21swapper/120:55:281
1092331992719,5cyclictest0-21swapper/123:30:001
1092331992717,6cyclictest0-21swapper/121:15:241
1092331992717,6cyclictest0-21swapper/100:40:001
109232799279,6cyclictest1115223-21kworker/u8:1+events_unbound21:20:030
109232799279,6cyclictest1115223-21kworker/u8:1+events_unbound21:20:030
109232799275,4cyclictest131rcu_preempt21:45:120
1092327992721,4cyclictest1116905-21cron20:17:010
1092327992720,4cyclictest1095357-21kworker/u8:2+events_unbound19:55:010
1092327992719,4cyclictest0-21swapper/019:10:250
1092327992716,8cyclictest1191501-21sed23:55:010
1092334992620,3cyclictest0-21swapper/220:45:002
1092334992620,3cyclictest0-21swapper/220:20:012
1092334992619,4cyclictest0-21swapper/222:50:002
1092334992618,5cyclictest1096259-21cron19:20:012
1092334992618,4cyclictest1094226-21latency_hist19:15:022
1092334992618,4cyclictest0-21swapper/221:42:062
1092334992615,6cyclictest0-21swapper/222:55:002
1092331992619,4cyclictest0-21swapper/119:20:011
109232799267,3cyclictest12022372cut00:25:180
1092327992619,4cyclictest1184302-21kworker/u8:1+events_unbound23:35:230
1092327992617,5cyclictest0-21swapper/022:35:190
1092327992616,6cyclictest1132329-21grep21:00:270
1092327992613,9cyclictest1198625-21fschecks_time00:15:150
109233499255,4cyclictest131rcu_preempt21:15:132
1092334992518,5cyclictest32-21ksoftirqd/220:20:132
1092334992517,5cyclictest0-21swapper/200:05:302
1092334992516,5cyclictest0-21swapper/222:40:252
1092334992515,6cyclictest0-21swapper/219:30:252
1092334992514,7cyclictest0-21swapper/223:30:272
1092334992514,7cyclictest0-21swapper/219:25:262
109233499251,13cyclictest0-21swapper/200:00:252
1092334992511,10cyclictest1-21systemd20:46:542
1092334992511,10cyclictest1-21systemd20:46:542
1092331992519,3cyclictest0-21swapper/120:40:261
1092331992517,5cyclictest0-21swapper/122:20:001
1092331992517,4cyclictest1153211-21grep22:00:261
109232799258,10cyclictest11-21ksoftirqd/023:25:230
109232799255,3cyclictest131rcu_preempt23:20:150
1092327992518,5cyclictest1095357-21kworker/u8:2+events_unbound19:30:250
1092327992515,6cyclictest1196037-21grep00:05:290
109232799251,21cyclictest1174283-21date23:05:000
1092327992511,7cyclictest11-21ksoftirqd/022:30:200
1092327992510,7cyclictest11-21ksoftirqd/020:30:230
1092334992417,3cyclictest0-21swapper/222:10:002
1092334992416,4cyclictest0-21swapper/221:50:252
109233199241,9cyclictest0-21swapper/119:25:121
1092331992418,3cyclictest0-21swapper/122:35:191
1092331992418,3cyclictest0-21swapper/122:05:261
1092331992417,3cyclictest0-21swapper/122:45:161
1092331992416,5cyclictest0-21swapper/121:45:001
1092331992416,5cyclictest0-21swapper/120:10:281
1092327992418,4cyclictest1172000-21kworker/u8:3+events_unbound23:15:160
1092327992418,4cyclictest0-21swapper/020:04:390
1092327992417,5cyclictest1168738-21kworker/u8:1+events_unbound22:53:390
1092327992417,5cyclictest1166954-21kworker/u8:0+events_unbound22:49:490
1092327992417,5cyclictest1130703-21kworker/u8:0+events_unbound21:42:080
1092327992416,4cyclictest0-21swapper/000:35:260
1092327992414,7cyclictest1125767-21sed20:45:010
109232799241,12cyclictest0-21swapper/021:39:420
109232799241,12cyclictest0-21swapper/021:25:220
1092334992317,3cyclictest0-21swapper/221:30:012
1092334992317,3cyclictest0-21swapper/219:35:232
1092334992316,4cyclictest1123986-21cron20:40:012
1092334992313,7cyclictest1122344-21wc20:35:012
1092334992313,6cyclictest1161724-21grep22:25:272
1092334992312,7cyclictest0-21swapper/220:00:282
1092331992316,3cyclictest0-21swapper/122:20:271
1092331992316,3cyclictest0-21swapper/122:20:261
1092331992315,5cyclictest0-21swapper/122:15:001
109232799238,6cyclictest11-21ksoftirqd/019:40:160
109232799238,6cyclictest11-21ksoftirqd/019:40:160
1092327992317,2cyclictest0-21swapper/020:45:150
1092327992317,2cyclictest0-21swapper/020:45:150
1092327992314,6cyclictest1153623-21cron22:05:010
1092334992216,4cyclictest1174288-21latency_hist23:05:002
1092334992216,3cyclictest0-21swapper/223:50:182
1092334992213,6cyclictest0-21swapper/200:30:162
1092334992213,6cyclictest0-21swapper/200:30:162
1092331992216,3cyclictest0-21swapper/123:00:171
1092331992216,3cyclictest0-21swapper/121:25:281
1092331992214,5cyclictest0-21swapper/120:35:151
1092331992212,7cyclictest1110348-21tr20:00:011
1092327992213,6cyclictest1135673-21grep21:10:270
1092334992115,3cyclictest0-21swapper/219:40:202
1092334992115,3cyclictest0-21swapper/219:40:202
1092334992114,4cyclictest311ktimers/220:55:282
1092334992111,6cyclictest0-21swapper/222:25:002
1092334992111,6cyclictest0-21swapper/222:25:002
109233199214,4cyclictest131rcu_preempt20:20:121
1092331992115,4cyclictest1112068-21idleruntime-cro20:05:011
1092331992115,3cyclictest1107370-21fschecks_time19:50:171
1092331992115,3cyclictest0-21swapper/121:00:261
1092331992114,5cyclictest0-21swapper/122:40:161
1092331992113,4cyclictest0-21swapper/121:57:081
1092331992111,7cyclictest0-21swapper/121:35:221
1092331992110,8cyclictest1148634-21sed21:50:011
1092334992010,7cyclictest1172461-21date23:00:012
109233499199,7cyclictest1175032-21wc23:05:242
1092334991913,3cyclictest0-21swapper/220:05:262
1092334991910,6cyclictest1182776-21wc23:30:012
1092331991912,5cyclictest231ktimers/121:20:021
1092331991912,5cyclictest231ktimers/121:20:021
1092331991910,6cyclictest1-21systemd19:21:381
1092334991812,4cyclictest311ktimers/223:20:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional