You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 03:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Aug 21, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991110,7rtkit-daemon0-21swapper/121:24:251
2194991090,7rtkit-daemon0-21swapper/120:56:261
2194991020,6rtkit-daemon23911-21latency21:31:171
2194991000,6rtkit-daemon10133-21munin-node20:21:201
2808999973,23cyclictest20835-21diskmemload21:16:130
2808999973,23cyclictest20835-21diskmemload21:16:130
219499970,10rtkit-daemon18-21rcuc/120:45:491
2808999963,24cyclictest15967-21grep22:56:260
219499960,5rtkit-daemon0-21swapper/120:46:111
219499950,5rtkit-daemon0-21swapper/120:16:201
219499950,5rtkit-daemon0-21swapper/118:46:311
28089999417,9cyclictest423-21ssh20:06:330
219499940,6rtkit-daemon0-21swapper/121:26:251
219499940,6rtkit-daemon0-21swapper/120:26:501
2809699935,82cyclictest28017-21ssh21:36:482
2809699933,83cyclictest0-21swapper/219:58:372
2809699933,82cyclictest0-21swapper/221:08:222
2808999934,25cyclictest0-21swapper/021:55:120
2808999924,27cyclictest0-21swapper/023:06:280
2808999924,27cyclictest0-21swapper/021:11:070
2808999924,25cyclictest0-21swapper/021:09:540
2808999924,22cyclictest2634-21munin-node19:56:270
28089999219,9cyclictest107550irq/46-eth022:16:170
28089999215,13cyclictest0-21swapper/021:56:160
28089999215,13cyclictest0-21swapper/021:56:160
2808999914,26cyclictest0-21swapper/021:41:100
2808999914,25cyclictest0-21swapper/022:48:080
2808999914,24cyclictest0-21swapper/022:45:410
2808999914,24cyclictest0-21swapper/022:45:410
2809699903,79cyclictest28018-21fschecks_time23:16:092
2808999905,24cyclictest0-21swapper/023:20:040
2808999904,27cyclictest0-21swapper/022:33:160
2808999904,25cyclictest0-21swapper/021:38:460
2808999904,25cyclictest0-21swapper/021:26:180
2808999904,25cyclictest0-21swapper/020:52:440
2808999904,24cyclictest0-21swapper/021:46:120
2808999903,26cyclictest0-21swapper/021:05:550
2808999903,25cyclictest25787-21grep23:11:250
2808999894,75cyclictest0-21swapper/020:30:270
2808999894,67cyclictest0-21swapper/020:16:110
2808999894,24cyclictest0-21swapper/022:23:120
28089998920,10cyclictest0-21swapper/022:36:130
2808999884,76cyclictest0-21swapper/022:15:430
2808999884,64cyclictest0-21swapper/020:46:190
2808999884,26cyclictest0-21swapper/022:01:160
2808999884,25cyclictest0-21swapper/019:53:370
2808999884,23cyclictest0-21swapper/020:32:240
2808999884,23cyclictest0-21swapper/020:32:240
2808999883,27cyclictest0-21swapper/022:52:380
2808999883,27cyclictest0-21swapper/020:41:070
2808999883,27cyclictest0-21swapper/020:38:210
2808999883,25cyclictest0-21swapper/021:31:140
2808999883,24cyclictest0-21swapper/023:05:420
28089998819,9cyclictest20835-21diskmemload20:11:290
2809699874,76cyclictest15014-21gltestperf22:56:112
2809699873,78cyclictest0-21swapper/221:48:542
2809699873,76cyclictest0-21swapper/222:38:562
28096998711,69cyclictest27010-21crond23:15:492
2808999874,76cyclictest0-21swapper/022:26:560
2808999874,66cyclictest0-21swapper/018:36:270
2808999874,26cyclictest0-21swapper/017:57:260
2808999873,75cyclictest15606-21unixbench_multi19:36:310
2808999873,26cyclictest0-21swapper/020:56:140
2808999873,25cyclictest0-21swapper/020:25:480
2809799864,76cyclictest0-21swapper/323:15:493
2809699864,75cyclictest0-21swapper/222:51:082
2809699863,77cyclictest0-21swapper/220:09:072
2809699863,75cyclictest5979-21grep22:41:242
2809699863,75cyclictest5979-21grep22:41:242
2809699863,42cyclictest0-21swapper/222:27:162
2809699862,48cyclictest0-21swapper/221:34:232
2808999864,29cyclictest0-21swapper/019:21:250
2808999864,27cyclictest0-21swapper/021:21:040
2808999864,23cyclictest0-21swapper/022:06:560
28089998631,47cyclictest22602-21tr18:46:150
2808999863,24cyclictest0-21swapper/020:01:240
2809699855,74cyclictest0-21swapper/222:11:042
2809699855,72cyclictest89501ssh20:21:012
2809699854,74cyclictest0-21swapper/221:27:522
2808999854,65cyclictest0-21swapper/018:41:110
2809799843,75cyclictest16057-21runrttasks22:09:013
2809799843,43cyclictest0-21swapper/322:31:253
2809699845,73cyclictest0-21swapper/220:14:022
2809699844,74cyclictest0-21swapper/222:46:232
2809699844,74cyclictest0-21swapper/221:56:272
2809699844,74cyclictest0-21swapper/221:56:272
2809699844,74cyclictest0-21swapper/220:46:142
2809699844,73cyclictest0-21swapper/221:04:332
2809699844,72cyclictest31273-21ntpq22:31:202
28096998414,63cyclictest0-21swapper/220:51:212
2808999844,72cyclictest0-21swapper/018:26:220
28089998421,8cyclictest1227-21runrttasks19:09:170
28089998421,8cyclictest1227-21runrttasks19:09:170
2809699834,74cyclictest0-21swapper/217:51:312
2809699834,73cyclictest0-21swapper/220:35:492
2809699834,73cyclictest0-21swapper/220:35:492
2809699834,72cyclictest1227-21runrttasks23:01:172
2809699834,40cyclictest13352-21munin-node20:26:192
2809699833,75cyclictest0-21swapper/220:43:022
2809699833,75cyclictest0-21swapper/218:41:002
2809699833,74cyclictest0-21swapper/219:51:272
2809699833,71cyclictest0-21swapper/221:21:372
2809699833,53cyclictest0-21swapper/220:17:582
2808999834,71cyclictest0-21swapper/018:21:250
2808999834,71cyclictest0-21swapper/018:21:250
2808999834,28cyclictest0-21swapper/019:11:210
2809699825,70cyclictest0-21swapper/218:01:122
2809699824,71cyclictest20138-21aten_r1power_en22:16:062
2809699824,45cyclictest1227-21runrttasks21:51:082
2809699823,72cyclictest25876-21chrt18:51:242
2809699823,71cyclictest0-21swapper/221:45:362
2809699815,69cyclictest0-21swapper/222:01:352
2809699815,68cyclictest0-21swapper/220:56:052
2809699814,71cyclictest0-21swapper/222:25:122
2809699814,69cyclictest20740-21munin-node23:06:022
2809699813,72cyclictest0-21swapper/220:04:222
2809699813,71cyclictest13169-21munin-node21:16:072
2809699813,71cyclictest13169-21munin-node21:16:072
2809699813,48cyclictest0-21swapper/218:11:122
2808999813,24cyclictest0-21swapper/018:51:100
28089998124,49cyclictest7960-21munin-node18:16:160
2809699805,68cyclictest0-21swapper/220:36:192
2809699804,43cyclictest12126-21runrttasks21:14:002
2808999804,67cyclictest0-21swapper/019:26:110
2808999804,26cyclictest0-21swapper/019:16:210
2809699793,47cyclictest0-21swapper/219:03:142
2808999794,22cyclictest0-21swapper/019:32:210
2808999794,14cyclictest0-21swapper/019:01:100
2808999793,27cyclictest0-21swapper/018:56:100
2809799786,66cyclictest0-21swapper/318:26:113
2809799784,68cyclictest0-21swapper/320:01:123
2809799783,67cyclictest14119-21missed_timers21:16:193
2809799783,67cyclictest14119-21missed_timers21:16:193
28097997818,53cyclictest32243-21cpuspeed20:56:073
28097997813,59cyclictest1227-21runrttasks21:56:193
28097997813,59cyclictest1227-21runrttasks21:56:193
2809699785,68cyclictest0-21swapper/218:21:132
2809699785,68cyclictest0-21swapper/218:21:132
2809699784,68cyclictest0-21swapper/222:06:592
2808999789,14cyclictest0-21swapper/018:06:220
2808999784,12cyclictest0-21swapper/018:31:260
28089997829,41cyclictest20383-21unixbench_multi19:46:310
28089997829,41cyclictest20383-21unixbench_multi19:46:310
2809799774,66cyclictest0-21swapper/322:42:043
2809799774,66cyclictest0-21swapper/322:42:043
2809799774,65cyclictest0-21swapper/321:49:013
2809699774,67cyclictest0-21swapper/218:11:022
2809699774,66cyclictest29239-21munin-run19:00:592
2809699774,66cyclictest12760-21tail18:26:112
2808999777,6cyclictest0-21swapper/017:51:130
2808999773,14cyclictest0-21swapper/018:01:130
28089997723,48cyclictest17030-21cut19:41:160
2809799766,63cyclictest0-21swapper/322:20:523
2809799763,66cyclictest8434-21gltestperf22:46:133
2809799763,66cyclictest1227-21runrttasks19:25:463
2809799763,47cyclictest0-21swapper/320:14:533
2809699764,65cyclictest0-21swapper/218:46:152
2809699763,67cyclictest0-21swapper/219:16:152
2809799753,66cyclictest0-21swapper/322:26:173
2809799753,65cyclictest22684-21cat21:30:553
2809799753,65cyclictest18731-21munin-node23:01:183
2809799752,66cyclictest249361rm21:32:343
28097997513,55cyclictest1553-21nscd22:40:513
28089997518,8cyclictest6393-21grep18:11:190
2809799744,63cyclictest7776-21munin-node21:06:253
2809799743,64cyclictest28198-21head23:16:103
2809799743,64cyclictest17981-21grep21:21:263
2809799743,44cyclictest0-21swapper/320:31:483
2809799743,44cyclictest0-21swapper/320:31:483
2809799742,44cyclictest24180-21runrttasks18:47:353
28096997430,36cyclictest20196-21grep18:41:142
2809699743,65cyclictest1227-21runrttasks19:11:172
2809799733,64cyclictest0-21swapper/321:36:063
2809799733,63cyclictest5865-21runrttasks21:05:163
2809799733,37cyclictest26482-21iostat20:46:193
28097997323,44cyclictest21601-21gltestperf23:06:103
28097997322,44cyclictest13891-21munin-node19:36:303
2809799732,65cyclictest0-21swapper/322:01:033
2809799732,64cyclictest18942-21rm22:12:293
2809699734,64cyclictest0-21swapper/219:45:572
28089997327,39cyclictest0-21swapper/017:51:030
2809799725,61cyclictest0-21swapper/318:41:163
2809799724,62cyclictest25095-21cut19:56:163
2809799724,62cyclictest0-21swapper/320:21:333
2809799724,61cyclictest31196-21rm20:53:493
2809799724,61cyclictest0-21swapper/320:08:553
2809799724,61cyclictest0-21swapper/318:36:023
2809799723,62cyclictest3989-21gltestperf18:06:213
2809799723,62cyclictest14578-21grep22:56:073
2809799723,62cyclictest12091-21rm21:13:523
2809799723,62cyclictest0-21swapper/319:01:123
2809799723,41cyclictest0-21swapper/320:27:513
28097997211,55cyclictest29383-21aten_r1power_en21:41:053
2809699724,60cyclictest13031-21threads19:31:292
2809699723,62cyclictest16042-21latency_hist19:40:592
2809799713,61cyclictest5606-21munin-node19:16:253
2809799713,61cyclictest4234-21diskstats21:51:093
2809699716,54cyclictest1227-21runrttasks19:25:552
2809699714,62cyclictest0-21swapper/219:08:542
2809699714,62cyclictest0-21swapper/219:08:542
2809699713,63cyclictest0-21swapper/217:56:182
219499710,8rtkit-daemon0-21swapper/022:26:151
219499710,6rtkit-daemon0-21swapper/119:19:451
2809799704,60cyclictest0-21swapper/319:26:133
2809799703,60cyclictest22124-21iostat_ios19:51:193
2809699704,59cyclictest15725-21fschecks_count18:31:182
2809699702,63cyclictest0-21swapper/218:16:322
2809799696,56cyclictest24140-21tune2fs22:21:103
28097996932,32cyclictest3886-21runrttasks19:13:133
2809799693,61cyclictest0-21swapper/318:01:333
2809799693,60cyclictest0-21swapper/322:54:143
2809799693,59cyclictest0-21swapper/319:47:583
2809799693,59cyclictest0-21swapper/319:47:583
2809799692,61cyclictest20185-21munin-node20:36:233
2809799684,58cyclictest0-21swapper/320:19:083
2809799683,58cyclictest1012-21munin-node19:06:303
2809799683,58cyclictest1012-21munin-node19:06:303
2809699686,53cyclictest1227-21runrttasks19:26:032
2809699684,55cyclictest1227-21runrttasks19:49:452
2809699684,55cyclictest1227-21runrttasks19:49:452
2809799673,57cyclictest7982-21cut18:16:103
2809799673,57cyclictest19517-21runrttasks18:39:133
2809799672,59cyclictest0-21swapper/320:43:263
2809699674,56cyclictest28095-21systemd-cgroups17:51:022
2809799665,54cyclictest0-21swapper/319:41:163
2809799664,56cyclictest0-21swapper/318:56:003
2809799663,56cyclictest28599-21cpuspeed_turbos17:51:153
2809799653,54cyclictest12532-21munin-node19:31:213
2809799653,32cyclictest5734-21aten_r1power_vo18:11:133
28093996512,25cyclictest0-21swapper/121:51:201
2809799642,55cyclictest10663-21cpuspeed_turbos18:21:133
2809799642,55cyclictest10663-21cpuspeed_turbos18:21:133
219499640,5rtkit-daemon14104-21ssh22:06:081
2809399625,32cyclictest0-21swapper/122:01:081
2809399624,42cyclictest0-21swapper/123:11:171
2809799613,49cyclictest29125-21runrttasks18:59:443
2809799603,50cyclictest31048-21cpuspeed_turbos17:56:173
2809399604,34cyclictest0-21swapper/120:06:481
2809399596,27cyclictest8621-21irqstats22:46:171
2809399595,33cyclictest0-21swapper/121:14:341
2809399594,34cyclictest0-21swapper/121:56:151
2809399594,34cyclictest0-21swapper/121:56:151
2809399584,31cyclictest0-21swapper/122:36:201
2693425710,38sleep30-21swapper/317:46:233
205752573,12sleep10-21swapper/119:47:451
205752573,12sleep10-21swapper/119:47:451
308012563,12sleep10-21swapper/120:52:181
2809399564,12cyclictest0-21swapper/120:37:341
28093995639,12cyclictest0-21swapper/120:15:151
299962553,11sleep10-21swapper/119:01:151
2809399544,29cyclictest0-21swapper/121:01:231
28093995436,11cyclictest32460-21unixbench_singl17:56:361
28093995413,21cyclictest11822-21cat22:51:111
2809399535,30cyclictest0-21swapper/119:15:591
2809399535,29cyclictest0-21swapper/118:11:011
28093995332,12cyclictest12387-21sed19:31:171
252912533,45sleep125378-21interrupts19:56:201
193792533,11sleep10-21swapper/123:01:471
167082533,9sleep116845-21unixbench_multi18:31:331
164062532,46sleep116408-21sh22:58:001
14542534,43sleep10-21swapper/119:09:211
14542534,43sleep10-21swapper/119:09:211
86662523,12sleep10-21swapper/119:23:151
74592523,11sleep10-21swapper/118:12:351
61412524,42sleep10-21swapper/122:41:321
61412524,42sleep10-21swapper/122:41:321
2809399525,15cyclictest0-21swapper/121:42:271
2809399524,33cyclictest0-21swapper/122:33:141
2809399524,32cyclictest0-21swapper/123:16:041
2809399524,15cyclictest0-21swapper/120:04:171
28093995223,13cyclictest0-21swapper/119:52:331
28093995222,11cyclictest0-21swapper/121:36:091
28093995221,14cyclictest0-21swapper/123:06:211
146452523,10sleep10-21swapper/118:27:591
91412513,11sleep10-21swapper/121:10:111
28093995133,10cyclictest21098-21needreboot18:41:251
260032513,11sleep10-21swapper/118:51:281
253062513,42sleep10-21swapper/122:21:411
230492513,11sleep10-21swapper/122:20:401
196002514,42sleep10-21swapper/118:40:201
109772513,12sleep10-21swapper/119:27:181
2809399505,28cyclictest0-21swapper/121:16:081
2809399505,28cyclictest0-21swapper/121:16:081
2809399504,28cyclictest0-21swapper/118:06:021
28093995032,11cyclictest531-21tr21:46:061
28093995023,8cyclictest16563-21if_eth020:31:181
28093995023,8cyclictest16563-21if_eth020:31:181
28093995021,12cyclictest0-21swapper/122:15:491
124562503,11sleep10-21swapper/118:25:331
124562503,11sleep10-21swapper/118:25:331
2809399495,26cyclictest0-21swapper/118:57:361
2809399494,28cyclictest0-21swapper/119:36:331
2809399494,28cyclictest0-21swapper/118:16:281
2809399494,27cyclictest0-21swapper/117:51:341
28093994921,12cyclictest0-21swapper/119:44:361
2809399384,15cyclictest0-21swapper/117:51:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional