You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 07:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Tue Jun 16, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14015999719,13cyclictest0-21swapper/123:33:261
1401599963,23cyclictest10222-21latency_hist20:58:011
14015999534,13cyclictest0-21swapper/122:32:041
1401599934,39cyclictest0-21swapper/122:48:151
14015999330,12cyclictest8251-21unixbench-2d00:03:261
1401599924,10cyclictest1561-21munin-node23:08:251
14015999237,14cyclictest0-21swapper/122:23:091
14015999228,15cyclictest0-21swapper/122:38:161
219499910,9rtkit-daemon0-21swapper/322:48:203
1401599914,39cyclictest0-21swapper/123:13:191
14015999129,13cyclictest0-21swapper/123:38:221
14015999128,11cyclictest3804-21timerandwakeup21:33:321
14015999128,11cyclictest3804-21timerandwakeup21:33:321
1401599904,28cyclictest0-21swapper/122:58:151
14015999030,14cyclictest0-21swapper/118:53:361
1401599894,27cyclictest0-21swapper/120:53:011
1401599885,26cyclictest0-21swapper/122:43:261
1401599884,42cyclictest0-21swapper/121:48:231
14015998831,15cyclictest0-21swapper/121:13:241
1401599874,38cyclictest0-21swapper/123:04:441
1401599873,37cyclictest0-21swapper/123:22:551
14015998714,10cyclictest30038-21gltestperf22:13:171
14015998714,10cyclictest30038-21gltestperf22:13:171
1401599863,38cyclictest26196-21gltestperf23:43:151
1401599854,27cyclictest0-21swapper/123:48:241
219499830,12rtkit-daemon2193-21rtkit-daemon21:18:542
14015998319,12cyclictest0-21swapper/120:34:521
1401599824,27cyclictest0-21swapper/122:54:411
1401599824,27cyclictest0-21swapper/122:54:411
14015998235,10cyclictest0-21swapper/121:06:411
1401599814,9cyclictest18135-21gltestperf21:08:191
1401599814,27cyclictest0-21swapper/100:13:501
14015998135,11cyclictest0-21swapper/121:46:041
14015998135,10cyclictest0-21swapper/123:57:471
14015998129,13cyclictest0-21swapper/121:57:351
1401599794,28cyclictest0-21swapper/120:38:251
14015997836,11cyclictest0-21swapper/122:01:381
14015997836,10cyclictest0-21swapper/123:32:341
14015997836,10cyclictest0-21swapper/123:32:341
14015997735,10cyclictest0-21swapper/121:28:131
1401599763,31cyclictest0-21swapper/122:34:201
14017997124,40cyclictest11245-21hwlatdetect20:58:223
14017997121,43cyclictest13444-21crond22:37:563
14017996921,29cyclictest1057-21processes23:53:233
14017996917,22cyclictest18082-21idleruntime22:43:183
219499680,6rtkit-daemon1227-21runrttasks23:24:563
237042675,54sleep20-21swapper/221:16:512
219499670,9rtkit-daemon0-21swapper/320:53:402
14017996720,27cyclictest14399-21runrttasks21:49:183
14017996719,30cyclictest6760-21turbostat.cron20:53:003
75862660,5sleep015-21rcuc/019:43:370
14017996618,41cyclictest31462-21ssh22:15:043
14017996618,41cyclictest31462-21ssh22:15:043
14017996615,31cyclictest0-21swapper/323:48:093
14017996613,33cyclictest0-21swapper/322:18:193
14017996612,34cyclictest0-21swapper/321:43:253
219499650,6rtkit-daemon15164-21munin-node23:28:263
219499650,6rtkit-daemon15164-21munin-node23:28:263
14017996413,41cyclictest0-21swapper/300:18:443
14017996412,42cyclictest7581-21df_inode20:53:163
14017996412,33cyclictest0-21swapper/321:28:243
14017996410,32cyclictest0-21swapper/322:10:453
1401699643,12cyclictest0-21swapper/222:03:152
14017996319,29cyclictest1206-21runrttasks23:07:403
14017996318,29cyclictest25286-21hwlatdetect21:18:213
14017996313,43cyclictest0-21swapper/323:43:063
14017996312,33cyclictest0-21swapper/321:03:153
1401499634,51cyclictest0-21swapper/023:33:260
14017996218,25cyclictest15198-21ssh22:38:273
14017996212,31cyclictest0-21swapper/322:30:283
14017996211,44cyclictest0-21swapper/300:08:083
14017996211,44cyclictest0-21swapper/300:08:083
14017996210,33cyclictest0-21swapper/322:58:213
1401699625,12cyclictest0-21swapper/222:18:162
324812616,48sleep20-21swapper/223:03:312
288622613,49sleep00-21swapper/023:48:070
219499610,6rtkit-daemon0-21swapper/218:53:073
1401799619,45cyclictest0-21swapper/321:55:243
14017996116,38cyclictest18542-21sh23:33:043
14017996114,39cyclictest15508-21ssh00:14:463
14017996114,25cyclictest22861-21awk23:38:143
14017996113,42cyclictest0-21swapper/322:01:053
14017996113,29cyclictest22706-21ssh22:03:113
14017996113,29cyclictest0-21swapper/319:24:363
14017996110,29cyclictest0-21swapper/321:13:073
219499600,5rtkit-daemon0-21swapper/200:01:473
156062603,9sleep21124-21snmpd23:28:102
156062603,9sleep21124-21snmpd23:28:102
1401799608,45cyclictest0-21swapper/323:14:353
1401799608,45cyclictest0-21swapper/321:13:003
14017996021,24cyclictest3940-21unixbench_multi21:33:333
14017996021,24cyclictest3940-21unixbench_multi21:33:333
14017996017,23cyclictest0-21swapper/321:42:083
14017996014,26cyclictest21188-21sshd20:13:253
14017996013,23cyclictest0-21swapper/323:08:253
1401699604,12cyclictest0-21swapper/200:09:062
1401699604,12cyclictest0-21swapper/200:09:062
219499590,4rtkit-daemon18763-21systemd-cgroups21:57:522
1401799598,41cyclictest4014-21cstates22:23:133
1401799596,45cyclictest0-21swapper/319:43:253
14017995919,32cyclictest25978-21latency_hist19:18:043
14017995917,24cyclictest10247-21ssh23:18:293
14017995912,40cyclictest18396-21taskset18:58:393
14017995911,29cyclictest0-21swapper/322:56:523
14017995911,29cyclictest0-21swapper/322:56:523
1401699594,12cyclictest0-21swapper/221:08:272
1401699593,10cyclictest22035-21fschecks_count19:08:232
14016995920,25cyclictest21942-21processes22:48:272
14015995925,28cyclictest3753-21timerandwakeup20:43:321
1401499597,13cyclictest0-21swapper/022:53:190
1401499597,13cyclictest0-21swapper/022:53:190
17562583,48sleep00-21swapper/023:54:120
1401799588,43cyclictest0-21swapper/320:28:173
14017995816,35cyclictest18791-21irqstats20:08:253
14017995816,35cyclictest18791-21irqstats20:08:253
14017995815,33cyclictest30076-21ls20:33:143
14017995814,29cyclictest8610-21ssh00:04:133
14017995814,26cyclictest27717-21munin-node21:23:333
1401699584,12cyclictest0-21swapper/223:13:252
1401699584,11cyclictest3861-21grep23:58:102
14016995811,28cyclictest0-21swapper/221:28:192
1401499584,32cyclictest0-21swapper/023:24:050
1401499583,34cyclictest3773-21ssh21:33:320
1401499583,34cyclictest3773-21ssh21:33:320
14017995715,35cyclictest10225-21runrttasks19:51:173
14017995714,36cyclictest27607-21python19:18:353
1401699574,9cyclictest7266-21ssh22:28:112
1401699574,40cyclictest0-21swapper/222:55:072
1401699574,40cyclictest0-21swapper/222:55:072
1401699574,36cyclictest0-21swapper/222:01:582
1401699574,12cyclictest0-21swapper/221:03:142
14015995721,28cyclictest11482-21timerandwakeup00:08:241
14015995721,28cyclictest11482-21timerandwakeup00:08:241
14014995720,21cyclictest0-21swapper/021:32:430
219499560,7rtkit-daemon0-21swapper/123:45:182
219499560,4rtkit-daemon2193-21rtkit-daemon21:38:001
1401799564,33cyclictest0-21swapper/319:53:353
14017995634,15cyclictest0-21swapper/319:31:443
14017995621,28cyclictest1726-21tail19:33:223
1401699564,8cyclictest30676-21ssh22:13:282
1401699564,8cyclictest30676-21ssh22:13:282
1401699564,44cyclictest10279-21munin-node20:58:152
1401699564,37cyclictest0-21swapper/222:08:172
1401699564,13cyclictest0-21swapper/200:13:272
1401699564,12cyclictest0-21swapper/223:48:132
1401699564,12cyclictest0-21swapper/223:39:072
1401699564,12cyclictest0-21swapper/222:43:312
1401699564,12cyclictest0-21swapper/222:33:102
1401699564,12cyclictest0-21swapper/221:46:452
1401699563,12cyclictest0-21swapper/221:23:172
1401699562,42cyclictest0-21swapper/223:36:022
1401499564,36cyclictest0-21swapper/000:18:120
1401499563,44cyclictest12748-21df_abs21:48:130
219499550,5rtkit-daemon2193-21rtkit-daemon20:27:111
219499550,5rtkit-daemon2193-21rtkit-daemon19:23:511
219499550,4rtkit-daemon1124-21snmpd20:48:320
14017995513,28cyclictest0-21swapper/320:43:183
1401699555,29cyclictest0-21swapper/218:58:262
1401699554,12cyclictest0-21swapper/223:23:082
1401699554,12cyclictest0-21swapper/223:10:152
1401699553,12cyclictest0-21swapper/200:18:082
14016995522,24cyclictest281ktimersoftd/222:58:142
1401599554,36cyclictest0-21swapper/122:05:391
14015995523,13cyclictest0-21swapper/120:08:021
14014995525,13cyclictest0-21swapper/022:38:270
53662543,44sleep00-21swapper/023:59:400
259462543,43sleep00-21swapper/020:23:240
236942543,45sleep00-21swapper/021:16:490
219499540,4rtkit-daemon2193-21rtkit-daemon20:09:261
219499540,4rtkit-daemon2193-21rtkit-daemon20:09:261
219499540,4rtkit-daemon2193-21rtkit-daemon19:34:131
219499540,4rtkit-daemon2193-21rtkit-daemon19:18:511
175112542,9sleep20-21swapper/220:07:512
1401699549,26cyclictest0-21swapper/223:18:182
1401499544,43cyclictest0-21swapper/022:36:210
121092543,9sleep00-21swapper/000:09:440
121092543,9sleep00-21swapper/000:09:440
219499530,5rtkit-daemon2193-21rtkit-daemon20:13:041
219499530,4rtkit-daemon2193-21rtkit-daemon20:30:331
219499530,4rtkit-daemon2193-21rtkit-daemon19:29:131
219499530,4rtkit-daemon2193-21rtkit-daemon19:15:581
1401799537,31cyclictest0-21swapper/319:08:173
14017995334,12cyclictest20758-21unixbench_singl19:03:383
14017995320,27cyclictest23910-21processes20:18:323
14017995310,35cyclictest0-21swapper/320:28:033
1401699534,13cyclictest0-21swapper/221:38:162
1401699534,12cyclictest0-21swapper/221:33:072
1401699534,12cyclictest0-21swapper/221:33:072
1401699533,12cyclictest0-21swapper/223:57:162
1401699533,10cyclictest12427-21tail21:48:112
14016995321,14cyclictest0-21swapper/219:43:242
14016995321,13cyclictest14603-21grep22:38:172
14015995338,11cyclictest0-21swapper/120:59:481
14015995330,18cyclictest0-21swapper/121:21:261
1401499535,42cyclictest15-21rcuc/021:43:180
1401499534,43cyclictest0-21swapper/023:08:130
1401499534,31cyclictest0-21swapper/019:23:340
1401499534,11cyclictest0-21swapper/020:13:120
1401499533,11cyclictest0-21swapper/023:38:120
39702522,7sleep14070-21hddtemp_smartct23:58:121
219499520,4rtkit-daemon2193-21rtkit-daemon21:27:531
176532523,9sleep00-21swapper/021:53:500
1401699524,30cyclictest0-21swapper/219:13:312
1401699524,29cyclictest0-21swapper/220:13:262
1401699524,13cyclictest0-21swapper/222:26:572
1401699524,12cyclictest0-21swapper/219:38:322
14016995221,13cyclictest0-21swapper/220:43:192
14015995236,11cyclictest0-21swapper/122:18:001
1401499524,42cyclictest0-21swapper/022:31:250
14014995233,13cyclictest0-21swapper/021:03:180
14014995218,26cyclictest0-21swapper/022:03:140
122342520,6sleep01401499cyclictest20:58:460
97862513,41sleep00-21swapper/020:57:180
60172513,9sleep00-21swapper/022:25:270
288792514,39sleep00-21swapper/022:12:570
237652513,9sleep00-21swapper/019:13:070
229762513,9sleep00-21swapper/022:50:430
212232513,41sleep00-21swapper/021:59:350
209422513,9sleep00-21swapper/019:05:210
152532513,11sleep00-21swapper/000:13:520
1401799519,33cyclictest4444-21iostat_ios19:38:263
14017995134,11cyclictest14200-21needreboot19:58:273
14017995121,23cyclictest17094-21unixbench_multi20:03:363
1401699515,27cyclictest0-21swapper/220:38:122
1401699514,29cyclictest0-21swapper/220:33:242
1401699514,29cyclictest0-21swapper/219:53:262
1401699514,28cyclictest0-21swapper/219:48:262
1401699514,28cyclictest0-21swapper/200:03:182
1401699514,26cyclictest0-21swapper/220:18:142
14016995120,13cyclictest0-21swapper/220:28:172
1401499518,38cyclictest0-21swapper/021:24:260
1401499515,28cyclictest0-21swapper/020:33:160
1401499514,41cyclictest0-21swapper/000:05:210
1401499514,29cyclictest0-21swapper/021:18:280
14014995135,10cyclictest11039-21df19:53:190
14014995117,22cyclictest0-21swapper/023:04:370
79062503,40sleep00-21swapper/023:17:030
219499500,4rtkit-daemon2193-21rtkit-daemon20:07:560
195842503,41sleep00-21swapper/020:08:450
195842503,41sleep00-21swapper/020:08:450
192892503,41sleep00-21swapper/022:44:340
1401699504,25cyclictest0-21swapper/220:08:142
1401699504,25cyclictest0-21swapper/220:08:142
14015995035,11cyclictest0-21swapper/100:18:511
14015995029,13cyclictest0-21swapper/122:08:131
1401499506,37cyclictest0-21swapper/023:28:130
1401499506,37cyclictest0-21swapper/023:28:130
1401499504,39cyclictest0-21swapper/022:18:320
1401499504,28cyclictest0-21swapper/019:28:330
1401499504,27cyclictest0-21swapper/023:00:530
1401499503,34cyclictest0-21swapper/021:42:110
14014995026,9cyclictest15-21rcuc/021:08:340
14014995020,12cyclictest0-21swapper/019:08:370
219499490,6rtkit-daemon2193-21rtkit-daemon19:46:271
14017994911,31cyclictest0-21swapper/320:38:273
1401699499,24cyclictest0-21swapper/219:34:262
1401699494,28cyclictest0-21swapper/219:28:282
1401699494,28cyclictest0-21swapper/219:18:202
1401699493,28cyclictest0-21swapper/220:23:232
1401599494,28cyclictest0-21swapper/119:38:181
1401599494,28cyclictest0-21swapper/119:08:161
1401599494,28cyclictest0-21swapper/119:03:281
1401499497,37cyclictest0-21swapper/023:43:130
1401499495,13cyclictest0-21swapper/022:13:080
1401499495,13cyclictest0-21swapper/022:13:080
1401499494,27cyclictest0-21swapper/019:33:290
1401499494,27cyclictest0-21swapper/018:53:230
129842493,39sleep00-21swapper/019:58:130
282662484,9sleep00-21swapper/019:22:340
235382482,41sleep123564-21iostat_ios20:18:261
17462482,9sleep00-21swapper/020:41:580
1401699484,28cyclictest0-21swapper/219:04:322
1401699484,28cyclictest0-21swapper/218:54:312
1401599484,27cyclictest0-21swapper/118:58:281
14015994833,11cyclictest0-21swapper/123:27:471
1401499484,27cyclictest0-21swapper/020:43:160
1401499484,27cyclictest0-21swapper/018:58:340
52642473,38sleep00-21swapper/019:39:030
1401699474,26cyclictest1227-21runrttasks19:23:142
1401699473,38cyclictest0-21swapper/220:48:182
1401599474,26cyclictest0-21swapper/118:53:061
14015994730,12cyclictest0-21swapper/119:48:221
1401499478,22cyclictest15-21rcuc/020:23:020
1401499475,35cyclictest9053-21fschecks_count23:18:130
1401499473,20cyclictest0-21swapper/020:28:130
101882473,38sleep00-21swapper/019:50:480
1401699464,27cyclictest0-21swapper/219:58:152
1401599464,23cyclictest0-21swapper/119:53:151
14015994632,10cyclictest0-21swapper/119:58:221
14017994310,27cyclictest0-21swapper/318:53:053
1401699434,32cyclictest0-21swapper/218:53:062
137932404,29sleep00-21swapper/018:50:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional