You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 18:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri Jun 05, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2083499994,25cyclictest8702-21timerandwakeup12:03:173
20834999820,10cyclictest6399-21ssh11:13:063
20834999723,51cyclictest0-21swapper/309:58:083
2083499964,24cyclictest0-21swapper/311:27:473
2083499954,68cyclictest12027-21latency_hist11:22:473
2083499954,23cyclictest0-21swapper/311:43:383
20834999429,50cyclictest22545-21aten2.4-expect11:37:583
20834999429,50cyclictest22545-21aten2.4-expect11:37:583
20834999419,13cyclictest0-21swapper/308:08:133
20834999416,12cyclictest29152-21netstat09:23:153
20834999413,10cyclictest107550irq/46-eth010:33:103
2083499938,62cyclictest0-21swapper/309:28:033
2083499934,24cyclictest0-21swapper/309:05:503
2083499933,26cyclictest0-21swapper/307:12:263
20834999320,13cyclictest0-21swapper/308:48:193
2083499925,22cyclictest6809-21munin-node09:38:103
2083499924,25cyclictest0-21swapper/312:28:183
2083499924,25cyclictest0-21swapper/310:04:003
2083499924,25cyclictest0-21swapper/309:54:013
2083499924,24cyclictest0-21swapper/309:52:423
2083499923,25cyclictest21918-21idleruntime10:48:093
2083499923,23cyclictest18509-21rm12:18:113
2083499923,21cyclictest3430-21smartctl09:33:103
2083499923,21cyclictest3430-21smartctl09:33:103
2083499914,24cyclictest0-21swapper/310:56:243
2083499914,23cyclictest0-21swapper/310:43:033
2083499914,23cyclictest0-21swapper/310:08:003
2083499914,22cyclictest0-21swapper/311:07:223
20834999116,12cyclictest0-21swapper/309:18:103
20834999115,13cyclictest0-21swapper/309:45:103
2083499905,21cyclictest21753-21hddtemp_smartct09:13:113
2083499904,27cyclictest0-21swapper/311:49:213
2083499904,23cyclictest0-21swapper/312:23:163
2083499904,23cyclictest0-21swapper/312:23:163
2083499904,23cyclictest0-21swapper/312:13:393
2083499903,24cyclictest19756-21sshd09:10:213
2083499903,23cyclictest15935-21unixbench_multi10:38:213
20834999018,13cyclictest0-21swapper/310:28:013
2083499898,21cyclictest0-21swapper/311:27:483
2083499895,22cyclictest31567-21chrt10:13:443
2083499895,22cyclictest1599-21iostat10:18:113
2083499894,63cyclictest0-21swapper/312:08:093
2083499894,63cyclictest0-21swapper/307:06:253
2083499894,23cyclictest0-21swapper/310:27:353
2083499894,22cyclictest0-21swapper/311:02:233
2083499894,21cyclictest0-21swapper/311:57:133
2083499884,64cyclictest0-21swapper/307:33:253
2083499884,22cyclictest0-21swapper/311:11:593
20834998824,58cyclictest23333-21missed_timers08:13:183
20834998824,58cyclictest23333-21missed_timers08:13:183
20834998819,12cyclictest0-21swapper/312:01:533
2083399873,66cyclictest0-21swapper/209:28:072
2083499864,26cyclictest0-21swapper/308:41:403
20834998626,51cyclictest18340-21hwlatdetect08:03:143
2083499859,68cyclictest0-21swapper/308:33:173
20834998518,11cyclictest11437-21needreboot07:48:193
2083499844,22cyclictest0-21swapper/311:33:243
20834998426,50cyclictest1200-21fschecks_count07:28:153
20834998422,55cyclictest16457-21sendmail_mailqu07:58:253
2083399843,73cyclictest0-21swapper/210:03:172
2083399843,42cyclictest0-21swapper/209:56:272
20834998324,52cyclictest31281-21fschecks_time07:23:133
20834998324,52cyclictest31281-21fschecks_time07:23:133
219499820,6rtkit-daemon2193-21rtkit-daemon11:37:140
2083499824,25cyclictest0-21swapper/307:15:253
2083399824,59cyclictest0-21swapper/209:18:082
20834998117,13cyclictest0-21swapper/307:18:213
2083499805,67cyclictest0-21swapper/308:18:263
2083499804,14cyclictest0-21swapper/307:43:083
20834998025,46cyclictest30287-21hwlatdetect08:28:153
2083399804,68cyclictest0-21swapper/211:10:462
2083399803,70cyclictest0-21swapper/211:12:492
2083399803,61cyclictest0-21swapper/211:43:182
2083399803,59cyclictest0-21swapper/210:58:082
2083399803,39cyclictest0-21swapper/209:46:292
2083499794,24cyclictest0-21swapper/307:53:063
2083499793,22cyclictest0-21swapper/308:23:133
2083399793,58cyclictest0-21swapper/211:52:572
2083399793,41cyclictest0-21swapper/210:27:192
20834997821,13cyclictest0-21swapper/308:43:163
2083499774,19cyclictest25577-21kworker/3:009:02:533
2083399773,66cyclictest26837-21fschecks_count10:08:062
2083399773,66cyclictest1124-21snmpd07:41:302
20834997620,11cyclictest9442-21df_abs08:53:053
2083399765,36cyclictest0-21swapper/212:23:542
2083399765,36cyclictest0-21swapper/212:23:542
2083399764,56cyclictest0-21swapper/209:07:522
2083399763,66cyclictest0-21swapper/210:48:112
2083399763,51cyclictest0-21swapper/211:48:062
2083399757,52cyclictest2137-21python10:18:192
2083399755,63cyclictest0-21swapper/211:23:172
2083399754,64cyclictest0-21swapper/210:33:062
2083399753,64cyclictest176841ssh11:28:482
2083399753,54cyclictest0-21swapper/211:58:012
2083399749,45cyclictest0-21swapper/209:09:592
2083399747,52cyclictest0-21swapper/209:49:542
2083399745,37cyclictest0-21swapper/211:38:472
2083399745,37cyclictest0-21swapper/211:38:472
2083399744,63cyclictest0-21swapper/210:44:522
2083399744,54cyclictest0-21swapper/210:15:372
2083399744,53cyclictest0-21swapper/209:23:212
2083399743,62cyclictest14838-21fschecks_count10:38:052
2083399743,41cyclictest0-21swapper/212:03:162
20834997311,13cyclictest0-21swapper/307:38:303
2083399736,58cyclictest0-21swapper/207:53:392
2083399735,62cyclictest0-21swapper/209:16:092
2083399733,63cyclictest0-21swapper/208:33:092
2083399733,62cyclictest1124-21snmpd07:26:282
2083399733,62cyclictest1124-21snmpd07:26:282
2083399733,54cyclictest0-21swapper/212:19:382
2083399733,54cyclictest0-21swapper/212:07:532
2083399733,54cyclictest0-21swapper/210:28:282
2083399733,41cyclictest0-21swapper/209:58:212
2083399732,64cyclictest0-21swapper/208:48:242
2083399726,50cyclictest0-21swapper/211:03:182
2083399724,61cyclictest0-21swapper/209:33:152
2083399724,61cyclictest0-21swapper/209:33:152
2083399724,61cyclictest0-21swapper/208:02:422
2083399723,62cyclictest0-21swapper/209:38:072
2083399723,61cyclictest14893-21latency12:13:072
2083399723,61cyclictest0-21swapper/212:27:552
2083399723,55cyclictest0-21swapper/211:33:082
2083399713,53cyclictest0-21swapper/210:56:382
2083399713,53cyclictest0-21swapper/208:53:072
2083399705,50cyclictest1227-21runrttasks08:14:232
2083399705,50cyclictest1227-21runrttasks08:14:232
2083399703,37cyclictest0-21swapper/211:18:032
2083399696,57cyclictest0-21swapper/209:02:532
2083399695,40cyclictest0-21swapper/208:18:232
20833996832,30cyclictest31508-21crond08:32:532
2083399683,58cyclictest1142-21diskstats07:28:152
20833996733,27cyclictest27975-21crond07:17:562
20833996718,33cyclictest3083-21munin-node07:33:082
2083399665,54cyclictest0-21swapper/208:07:542
2083399665,53cyclictest20734-21idleruntime08:08:142
2083399663,56cyclictest0-21swapper/207:43:322
2083399663,34cyclictest0-21swapper/208:43:092
2083099665,54cyclictest0-21swapper/010:12:490
2083399654,44cyclictest29127-21latency_hist08:27:552
2083399653,55cyclictest23761-21cpuspeed_turbos07:08:102
2083399653,54cyclictest0-21swapper/207:07:262
20833996527,32cyclictest1227-21runrttasks07:48:112
25672644,24sleep10-21swapper/110:18:271
2083399644,53cyclictest0-21swapper/208:38:122
2083399644,53cyclictest0-21swapper/207:18:162
2083099645,51cyclictest19390-21grep10:43:220
2083499635,14cyclictest0-21swapper/307:02:573
2083099634,52cyclictest0-21swapper/008:42:530
2083099625,49cyclictest0-21swapper/009:08:120
188212620,3sleep119020-21sed11:32:471
264492603,11sleep00-21swapper/009:19:090
2083099605,48cyclictest1227-21runrttasks09:31:430
2083099605,47cyclictest0-21swapper/010:18:180
20830996014,30cyclictest0-21swapper/012:08:280
219499590,4rtkit-daemon2193-21rtkit-daemon11:58:061
2083299594,47cyclictest0-21swapper/108:12:541
20832995935,9cyclictest31159-21aten_r1power_fr11:02:591
2083099595,47cyclictest0-21swapper/010:53:100
20832995835,8cyclictest8742-21ssh10:28:161
2083099587,44cyclictest17012-21awk09:07:520
2083099585,47cyclictest0-21swapper/012:03:090
2083099583,47cyclictest0-21swapper/011:52:550
132362583,9sleep00-21swapper/009:48:070
327422574,46sleep00-21swapper/007:27:540
327422574,46sleep00-21swapper/007:27:540
219499570,6rtkit-daemon2193-21rtkit-daemon10:41:311
20832995728,13cyclictest0-21swapper/111:48:141
2083099574,46cyclictest0-21swapper/009:39:410
219499560,6rtkit-daemon2193-21rtkit-daemon12:08:131
20832995632,8cyclictest9857-21ssh09:43:051
2083299563,47cyclictest0-21swapper/110:14:361
2083299563,45cyclictest0-21swapper/111:12:471
20832995617,12cyclictest0-21swapper/112:22:551
20832995617,12cyclictest0-21swapper/112:22:551
2083099565,44cyclictest0-21swapper/009:53:060
2083099564,26cyclictest0-21swapper/011:27:580
190782567,37sleep219223-21diskstats06:58:122
122432563,10sleep00-21swapper/007:50:590
2083299553,45cyclictest0-21swapper/111:41:301
2083299553,45cyclictest0-21swapper/111:41:301
2083099554,44cyclictest0-21swapper/012:28:020
20830995538,10cyclictest17748-21tr08:03:070
133982553,10sleep00-21swapper/010:35:590
251622543,43sleep00-21swapper/008:18:110
219499540,5rtkit-daemon2193-21rtkit-daemon12:13:351
219499540,5rtkit-daemon2193-21rtkit-daemon11:18:071
2083299544,41cyclictest0-21swapper/111:33:121
20832995432,8cyclictest26257-21kworker/1:010:58:231
20832995422,25cyclictest29630-21fgrep07:18:261
20832995420,28cyclictest18210-21cut10:43:061
2083099546,12cyclictest0-21swapper/011:03:010
2083099544,44cyclictest0-21swapper/012:17:550
2083099544,44cyclictest0-21swapper/011:02:280
2083099543,44cyclictest0-21swapper/010:28:170
20830995425,12cyclictest0-21swapper/008:57:520
19402542,10sleep10-21swapper/109:32:121
274642533,44sleep00-21swapper/011:43:180
2083299533,32cyclictest22548-21turbostat.cron10:02:491
20832995329,8cyclictest6304-21ssh11:13:051
2083099535,40cyclictest0-21swapper/007:53:150
2083099535,27cyclictest21977-21awk08:12:540
2083099534,43cyclictest0-21swapper/011:12:590
2083099534,42cyclictest0-21swapper/010:13:180
2083099533,44cyclictest0-21swapper/012:12:470
2083099533,44cyclictest0-21swapper/009:13:220
20830995319,27cyclictest19525-21tail09:58:020
132732533,10sleep00-21swapper/008:59:100
99962523,42sleep00-21swapper/007:47:450
51372523,9sleep00-21swapper/007:36:410
287902522,10sleep10-21swapper/108:23:361
228052523,43sleep00-21swapper/012:24:420
228052523,43sleep00-21swapper/012:24:420
20832995226,12cyclictest0-21swapper/112:18:571
20832995226,12cyclictest0-21swapper/109:37:281
20832995226,12cyclictest0-21swapper/109:37:281
20832995226,12cyclictest0-21swapper/109:23:091
20832995225,13cyclictest0-21swapper/109:39:041
2083099525,23cyclictest0-21swapper/011:08:070
2083099524,42cyclictest0-21swapper/010:38:210
20830995236,11cyclictest15338-21cpuspeed_turbos07:58:090
2083099523,14cyclictest0-21swapper/010:23:060
149632522,10sleep10-21swapper/111:26:101
325132512,10sleep10-21swapper/107:24:571
325132512,10sleep10-21swapper/107:24:571
219499510,5rtkit-daemon2193-21rtkit-daemon12:06:351
2083299514,39cyclictest0-21swapper/110:23:021
20832995130,8cyclictest30531-21cat08:28:191
2083299513,44cyclictest0-21swapper/112:30:431
20832995125,12cyclictest0-21swapper/109:48:091
20832995122,17cyclictest0-21swapper/111:44:571
20832995118,26cyclictest24593-21awk10:03:201
2083099515,40cyclictest0-21swapper/010:48:050
2083099515,27cyclictest0-21swapper/011:38:150
2083099515,27cyclictest0-21swapper/011:38:150
2083099515,27cyclictest0-21swapper/011:23:210
2083099514,12cyclictest0-21swapper/009:33:190
2083099514,12cyclictest0-21swapper/009:33:190
2083099514,11cyclictest23405-21munin-node10:03:040
20830995136,9cyclictest27310-21grep08:23:060
2083099513,43cyclictest0-21swapper/009:46:380
20830995118,27cyclictest29572-21cstates11:47:590
170472512,43sleep10-21swapper/108:01:121
13932513,40sleep00-21swapper/008:36:490
254702503,9sleep00-21swapper/007:11:300
241102502,41sleep10-21swapper/108:14:501
241102502,41sleep10-21swapper/108:14:501
229082503,12sleep10-21swapper/109:14:021
2083299504,40cyclictest0-21swapper/111:52:591
20832995034,10cyclictest8620-21cut07:43:151
20832995032,13cyclictest0-21swapper/110:48:031
2083299503,41cyclictest0-21swapper/110:11:021
2083299503,38cyclictest0-21swapper/109:53:011
2083099504,40cyclictest0-21swapper/011:17:580
20830995025,11cyclictest0-21swapper/011:58:370
20830995020,12cyclictest0-21swapper/009:23:220
145662502,42sleep10-21swapper/107:54:551
50272492,9sleep10-21swapper/107:35:171
301242493,40sleep00-21swapper/007:19:560
264432492,10sleep10-21swapper/108:19:091
210492493,39sleep00-21swapper/007:03:080
2083299493,40cyclictest0-21swapper/109:18:231
20832994915,21cyclictest0-21swapper/107:09:071
20830994935,9cyclictest30165-21grep08:28:140
20830994917,13cyclictest1124-21snmpd07:41:300
128802492,41sleep10-21swapper/110:34:071
242952483,10sleep00-21swapper/008:17:150
242952483,10sleep00-21swapper/008:17:150
2083299483,41cyclictest0-21swapper/109:07:101
20832994828,7cyclictest27086-21ssh10:56:341
196692484,37sleep00-21swapper/006:58:180
90062473,36sleep10-21swapper/108:52:581
25892473,10sleep00-21swapper/007:29:400
2083299474,27cyclictest0-21swapper/109:08:131
2083099475,26cyclictest0-21swapper/008:51:420
20832994620,12cyclictest0-21swapper/107:17:571
20830994628,11cyclictest0-21swapper/007:13:080
20830994620,21cyclictest0-21swapper/008:43:160
84932452,9sleep10-21swapper/108:49:151
20832994531,9cyclictest11717-21tr08:58:051
2083299453,35cyclictest6777-21sshd07:38:241
20832994521,10cyclictest0-21swapper/108:33:261
194862452,37sleep10-21swapper/108:06:521
2083299444,13cyclictest0-21swapper/107:32:561
2083299443,35cyclictest0-21swapper/107:07:571
2083299443,35cyclictest0-21swapper/107:02:581
2083299433,33cyclictest0-21swapper/107:48:131
20832994324,13cyclictest0-21swapper/108:43:211
2083299413,30cyclictest0-21swapper/108:42:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional