You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 15:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Tue Mar 10, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1166194995443,7cyclictest1212718-21grep09:20:252
1166194995243,6cyclictest1194383-21grep08:30:152
1166194994637,6cyclictest1202730-21awk08:55:002
1166190994521,20cyclictest0-21swapper/107:13:441
1166186994538,4cyclictest1211472-21munin-run09:20:010
1166194994435,4cyclictest0-21swapper/208:20:142
1166190994336,4cyclictest1257937-21sh11:35:001
1166197994234,5cyclictest1266451-21cron12:00:013
1166190994232,7cyclictest1218277-21cron09:40:001
1166190994230,8cyclictest231ktimers/111:20:141
116619099421,8cyclictest1248718-21/usr/sbin/munin11:05:241
1166197994130,8cyclictest391ktimers/311:10:113
1166194994133,6cyclictest311ktimers/212:00:112
1166194994130,7cyclictest1188450-21grep08:10:252
1166194994130,6cyclictest0-21swapper/212:25:252
1166194994129,8cyclictest1237254-21sh10:35:002
116619099411,7cyclictest1275558-21modprobe12:25:161
1166197994030,7cyclictest1271140-21grep12:10:253
1166194994029,7cyclictest1190171-21grep08:15:252
116619099408,29cyclictest0-21swapper/109:15:241
116619099401,7cyclictest1236915-21cron10:31:001
116619099401,6cyclictest1199061-21cron08:42:001
1166190994015,21cyclictest0-21swapper/108:10:221
1166197993929,6cyclictest1181608-21unixbench_multi07:50:243
1166194993932,3cyclictest0-21swapper/209:20:012
1166194993928,7cyclictest1214471-21grep09:25:272
1166194993928,6cyclictest1233384-21grep10:20:232
116619099397,29cyclictest1182543-21basename07:55:171
116619099393,4cyclictest1261709-21diskstats11:45:161
1166190993931,4cyclictest0-21swapper/109:05:151
116619099391,8cyclictest1247020-21tail11:00:251
116619099391,6cyclictest1222180-21/usr/sbin/munin09:50:161
116619099391,6cyclictest1173355-21cron07:28:001
116619099391,5cyclictest1243734-21cron10:51:001
116619099391,5cyclictest1179229-21sshd07:45:191
116619099391,5cyclictest1179229-21sshd07:45:191
1166186993929,6cyclictest1276258-21grep12:25:250
1166197993830,5cyclictest1190583-21munin-run08:20:013
1166197993829,6cyclictest1223823-21fschecks_time09:55:153
1166197993828,6cyclictest1182449-21fschecks_count07:55:163
1166197993828,5cyclictest0-21swapper/309:25:163
1166197993827,8cyclictest1216577-21cron09:35:003
1166197993825,10cyclictest391ktimers/307:30:133
1166194993832,3cyclictest1197615-21sendmail08:40:012
1166194993829,7cyclictest1211123-21kworker/u8:2+events_unbound09:45:102
1166194993828,6cyclictest0-21swapper/209:40:002
116619099383,6cyclictest1273649-21diskstats12:20:141
116619099382,4cyclictest1260735-21/usr/sbin/munin11:40:241
116619099381,9cyclictest1177182-21/usr/sbin/munin07:40:251
116619099381,9cyclictest1177182-21/usr/sbin/munin07:40:251
116619099381,8cyclictest1277985-21head12:30:251
116619099381,8cyclictest1195820-21wc08:35:011
116619099381,6cyclictest1244433-21/usr/sbin/munin10:55:161
116619099381,6cyclictest1227505-21meminfo10:05:191
116619099381,6cyclictest1168756-21/usr/sbin/munin07:15:171
116619099381,5cyclictest1170419-21/usr/sbin/munin07:20:131
1166190993815,20cyclictest1212285-21ntp_states09:20:211
116619099381,4cyclictest1213963-21/usr/sbin/munin09:25:221
116619099381,4cyclictest1196400-21/usr/sbin/munin08:35:181
116619099381,11cyclictest1263857-21ntp_states11:50:211
1166186993830,4cyclictest0-21swapper/008:20:010
1166186993830,4cyclictest0-21swapper/008:00:000
1166194993728,6cyclictest1231718-21unixbench_singl10:15:232
116619099376,27cyclictest0-21swapper/108:25:251
116619099373,3cyclictest1251949-21/usr/sbin/munin11:15:221
116619099371,9cyclictest1267332-21ps12:00:211
116619099371,9cyclictest1240996-21/usr/sbin/munin10:45:151
116619099371,9cyclictest1237594-21df10:35:131
116619099371,9cyclictest1203954-21grep08:55:261
116619099371,9cyclictest1201025-21apt08:50:001
116619099371,8cyclictest1270285-21grep12:10:151
116619099371,8cyclictest1184118-21/usr/sbin/munin08:00:141
116619099371,7cyclictest1189221-21/usr/sbin/munin08:15:151
1166190993717,16cyclictest438-21cron08:25:011
116619099371,6cyclictest1272073-21/usr/sbin/munin12:15:181
116619099371,6cyclictest1255297-21tr11:25:201
116619099371,5cyclictest1279091-21meminfo12:35:181
116619099371,5cyclictest1258618-21meminfo11:35:201
116619099371,5cyclictest1228522-21apt-get10:10:051
116619099371,5cyclictest1221364-21cron09:46:001
116619099371,5cyclictest1219264-21/usr/sbin/munin09:40:241
116619099371,4cyclictest1232383-21/usr/sbin/munin10:20:241
116619099371,4cyclictest1216324-21cron09:32:001
116619099371,4cyclictest1175740-21/usr/sbin/munin07:35:181
116619099371,4cyclictest1174971-21cron07:32:001
116619099371,11cyclictest1201946-21fgrep08:50:231
116619099371,10cyclictest1180921-21irqstats07:50:171
1166186993725,7cyclictest1229953-21grep10:10:260
1166186993725,7cyclictest1204026-21grep08:55:260
1166197993626,6cyclictest0-21swapper/307:45:003
1166197993626,6cyclictest0-21swapper/307:45:003
1166194993626,7cyclictest438-21cron11:10:012
1166194993625,6cyclictest0-21swapper/211:25:252
116619099363,6cyclictest1208399-21df09:10:131
116619099361,9cyclictest1234575-21wc10:25:201
116619099361,9cyclictest1223747-21df_inode09:55:131
116619099361,7cyclictest1186242-21ntp_kernel_pll_08:05:211
116619099361,6cyclictest1265934-21grep11:55:231
116619099361,6cyclictest1250636-21grep11:10:241
116619099361,4cyclictest1231744-21users10:15:251
1166190993613,20cyclictest1225353-21/usr/sbin/munin10:00:231
1166186993627,6cyclictest1212721-21unixbench_multi09:20:250
1166197993528,4cyclictest438-21cron11:30:003
1166197993528,3cyclictest0-21swapper/311:45:253
1166197993527,4cyclictest0-21swapper/312:20:153
1166197993526,6cyclictest1280108-21cron12:40:003
1166197993526,6cyclictest1241100-21fschecks_time10:45:183
1166197993525,6cyclictest0-21swapper/312:30:013
1166194993524,7cyclictest1182061-21awk07:55:012
116619099351,8cyclictest1240051-21/usr/sbin/munin10:40:241
116619099351,6cyclictest1268479-21cpuspeed12:05:141
116619099351,11cyclictest1205123-21memory09:00:181
1166197993427,4cyclictest1173544-21idleruntime-cro07:30:003
1166197993424,6cyclictest0-21swapper/311:05:153
1166197993421,8cyclictest0-21swapper/308:30:243
1166194993426,4cyclictest0-21swapper/211:40:012
1166194993423,6cyclictest0-21swapper/210:55:262
1166186993426,4cyclictest0-21swapper/012:15:250
1166186993424,7cyclictest1219580-21grep09:40:260
1166186993419,11cyclictest121ktimers/008:10:110
1166194993326,3cyclictest0-21swapper/210:00:262
1166194993324,5cyclictest0-21swapper/207:25:262
1166194993323,7cyclictest645-21runrttasks08:10:012
1166194993323,6cyclictest1264349-21grep11:50:252
1166194993323,6cyclictest0-21swapper/209:10:012
1166197993225,4cyclictest0-21swapper/310:00:263
1166197993222,6cyclictest0-21swapper/308:50:253
1166194993224,4cyclictest0-21swapper/211:20:172
1166194993223,5cyclictest1271094-21grep12:10:242
1166194993223,5cyclictest1219581-21unixbench_singl09:40:272
1166194993221,6cyclictest0-21swapper/207:45:262
1166194993221,6cyclictest0-21swapper/207:45:262
1166186993227,3cyclictest0-21swapper/009:35:130
1166186993224,4cyclictest0-21swapper/007:33:460
1166186993221,7cyclictest1271152-21grep12:10:250
1166186993221,7cyclictest1191878-21grep08:20:260
1166186993220,8cyclictest1209359-21grep09:10:240
1166186993218,10cyclictest121ktimers/011:15:100
116618699320,29cyclictest0-21swapper/008:00:120
1166197993125,4cyclictest1215497-21kworker/u8:3+events_unbound09:39:003
1166197993124,4cyclictest1207852-21munin-plugin-st09:10:023
1166197993121,6cyclictest1243621-21grep10:50:233
1166197993121,6cyclictest1221183-21cat09:45:233
1166197993121,6cyclictest0-21swapper/312:10:003
1166197993121,6cyclictest0-21swapper/308:45:273
1166197993121,6cyclictest0-21swapper/308:35:273
1166197993121,6cyclictest0-21swapper/307:45:263
1166197993121,6cyclictest0-21swapper/307:45:263
1166197993120,7cyclictest1205734-21grep09:00:243
1166197993120,6cyclictest0-21swapper/310:35:253
1166194993123,4cyclictest0-21swapper/210:10:262
1166194993120,7cyclictest0-21swapper/211:40:152
1166194993119,8cyclictest1174762-21grep07:30:262
1166186993123,4cyclictest0-21swapper/012:35:250
1166186993117,9cyclictest1240838-21runrttasks10:45:010
1166197993023,4cyclictest1211467-21kthreadd09:20:013
1166197993020,6cyclictest0-21swapper/310:45:003
1166197993020,6cyclictest0-21swapper/310:25:003
1166197993019,6cyclictest0-21swapper/311:00:263
1166197993019,6cyclictest0-21swapper/307:20:243
1166194993021,3cyclictest0-21swapper/211:55:142
1166194993020,6cyclictest0-21swapper/208:50:002
1166186993023,5cyclictest1188661-21kworker/u8:3+events_unbound08:33:500
1166186993023,4cyclictest0-21swapper/007:50:240
1166186993021,4cyclictest1245345-21grep10:55:260
1166186993018,8cyclictest13550irq/42-30be0000.ethernet12:05:120
1166197992921,5cyclictest1231709-21unixbench_singl10:15:233
1166197992921,4cyclictest0-21swapper/308:00:263
1166197992919,6cyclictest0-21swapper/309:15:013
1166194992922,5cyclictest1150079-21kworker/u8:0+events_unbound07:13:462
1166194992922,3cyclictest0-21swapper/212:40:012
1166194992921,3cyclictest0-21swapper/209:55:152
1166194992919,6cyclictest0-21swapper/209:00:012
1166194992918,6cyclictest0-21swapper/207:40:242
1166194992918,6cyclictest0-21swapper/207:40:242
1166186992921,5cyclictest1235249-21kworker/u8:0+events_unbound11:04:140
1166186992920,7cyclictest1227420-21sshd10:05:180
1166197992820,4cyclictest0-21swapper/311:50:253
1166197992820,4cyclictest0-21swapper/310:10:003
1166197992818,6cyclictest0-21swapper/311:35:263
1166197992818,6cyclictest0-21swapper/307:35:283
1166194992820,4cyclictest0-21swapper/210:50:002
1166194992817,7cyclictest1222935-21grep09:50:242
1166186992819,7cyclictest121ktimers/009:55:130
1166186992818,7cyclictest1259636-21sh11:40:000
1166186992818,7cyclictest1238127-21uname10:35:220
1166186992818,6cyclictest0-21swapper/010:15:230
1166194992720,3cyclictest0-21swapper/212:05:162
1166194992719,4cyclictest0-21swapper/211:30:252
1166194992719,4cyclictest0-21swapper/210:40:242
1166194992716,7cyclictest0-21swapper/207:20:242
1166186992719,4cyclictest1260026-21grep11:40:150
1166186992718,6cyclictest0-21swapper/011:55:120
1166186992718,6cyclictest0-21swapper/009:05:110
116618699271,6cyclictest1257040-21ntp_states11:30:210
1166186992716,7cyclictest1178198-21grep07:40:240
1166186992716,7cyclictest1178198-21grep07:40:240
1166186992713,7cyclictest1216170-21grep09:30:250
1166186992713,12cyclictest0-21swapper/010:45:200
116618699271,10cyclictest1267789-21who12:00:250
1166197992619,4cyclictest0-21swapper/307:20:003
1166197992618,5cyclictest0-21swapper/312:20:003
1166197992618,5cyclictest0-21swapper/311:15:243
1166197992616,6cyclictest0-21swapper/308:25:173
1166197992615,6cyclictest0-21swapper/308:05:263
1166194992619,5cyclictest1219646-21kworker/u8:1+events_unbound10:54:162
1166194992619,3cyclictest0-21swapper/209:15:012
1166194992618,4cyclictest1176933-21sh07:40:012
1166194992618,4cyclictest0-21swapper/211:45:252
1166194992618,4cyclictest0-21swapper/210:35:262
1166194992617,5cyclictest0-21swapper/210:25:252
1166194992616,6cyclictest0-21swapper/211:00:262
116618699262,4cyclictest1214914-21latency_hist09:30:010
1166186992619,5cyclictest1150079-21kworker/u8:0+events_unbound08:08:490
1166197992517,5cyclictest391ktimers/309:00:013
1166194992518,5cyclictest1178619-21kworker/u8:2+events_unbound07:58:472
1166194992516,7cyclictest1278086-21kworker/u8:2+events_unbound12:34:252
1166194992516,6cyclictest1184215-21fschecks_time08:00:162
1166194992515,6cyclictest0-21swapper/209:30:252
116618699252,8cyclictest11664522sh07:10:140
1166186992520,2cyclictest13550irq/42-30be0000.ethernet07:20:190
1166186992518,5cyclictest121ktimers/007:25:260
1166186992518,3cyclictest0-21swapper/009:45:230
116618699251,20cyclictest0-21swapper/007:35:390
116618699251,19cyclictest1194000-21munin-run08:30:010
1166186992510,12cyclictest645-21runrttasks07:19:580
1166197992418,3cyclictest0-21swapper/311:20:173
1166197992414,8cyclictest0-21swapper/311:30:243
1166194992417,4cyclictest0-21swapper/210:05:252
1166194992412,7cyclictest0-21swapper/211:15:242
116618699242,4cyclictest131rcu_preempt11:50:250
1166186992420,2cyclictest13550irq/42-30be0000.ethernet10:50:110
1166186992418,3cyclictest1256168-21sshd11:29:180
1166186992417,4cyclictest0-21swapper/010:35:000
1166186992416,5cyclictest0-21swapper/011:50:000
1166186992415,6cyclictest1196597-21cat08:35:200
1166186992415,5cyclictest121ktimers/011:10:010
116618699240,20cyclictest0-21swapper/008:54:240
1166197992315,4cyclictest0-21swapper/310:30:173
1166197992315,4cyclictest0-21swapper/307:10:253
1166197992313,7cyclictest1223406-21audit_send_reply09:55:003
1166197992311,8cyclictest0-21swapper/311:40:223
116619499231,16cyclictest1250709-21head11:10:252
116618699232,3cyclictest1273531-21apt-get12:20:110
1166186992317,3cyclictest0-21swapper/012:30:170
1166186992316,3cyclictest0-21swapper/010:29:360
116618699231,20cyclictest0-21swapper/011:24:440
116618699231,18cyclictest0-21swapper/010:23:380
116618699230,19cyclictest0-21swapper/011:14:030
1166197992216,3cyclictest0-21swapper/309:20:143
1166197992214,5cyclictest0-21swapper/310:15:003
1166194992212,6cyclictest1272797-21grep12:15:252
1166186992214,5cyclictest121ktimers/008:40:190
116618699221,19cyclictest0-21swapper/010:01:450
116618699220,18cyclictest0-21swapper/007:46:090
116618699220,18cyclictest0-21swapper/007:46:090
1166197992115,3cyclictest0-21swapper/308:25:013
1166197992115,3cyclictest0-21swapper/308:10:173
1166197992113,6cyclictest391ktimers/312:00:143
1166194992113,5cyclictest1193224-21/usr/sbin/munin08:25:242
1166197992014,3cyclictest0-21swapper/308:40:213
1166194992014,4cyclictest1197962-21df08:40:132
116618699201,11cyclictest645-21runrttasks08:47:410
1166197991912,5cyclictest0-21swapper/312:30:173
1166197991910,6cyclictest1219057-21nfs4_client09:40:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional