You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 03:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sat Sep 05, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
497699925,79cyclictest0-21swapper/321:42:053
497699915,9cyclictest30000-21idleruntime-cro19:36:513
497599914,80cyclictest0-21swapper/220:06:512
14902910,3sleep1201ktimersoftd/119:42:051
497599904,78cyclictest0-21swapper/220:27:052
497599895,77cyclictest0-21swapper/222:43:352
4975998935,48cyclictest1136-21unixbench_singl21:17:192
497699885,33cyclictest19560-21timerandwakeup20:07:213
497699884,76cyclictest0-21swapper/323:00:083
497699883,78cyclictest29054-21taskset22:50:213
497599884,77cyclictest0-21swapper/222:36:592
497599884,77cyclictest0-21swapper/222:36:592
497599884,32cyclictest0-21swapper/219:42:232
4976998737,43cyclictest14095-21sed17:52:283
497699873,77cyclictest8794-21aten_r1power_en20:41:593
4976998726,54cyclictest19377-21cpu21:47:003
497599875,75cyclictest0-21swapper/220:16:092
497599874,76cyclictest0-21swapper/218:54:432
497599873,78cyclictest0-21swapper/223:01:382
497599873,76cyclictest0-21swapper/221:37:102
497699865,73cyclictest0-21swapper/320:16:513
497699865,30cyclictest0-21swapper/322:52:273
497699864,74cyclictest16803-21ssh20:52:193
497699864,11cyclictest1227-21runrttasks20:21:023
4976998626,53cyclictest0-21swapper/321:26:593
497599865,75cyclictest0-21swapper/220:34:562
497599864,74cyclictest9644-21munin-node20:42:072
497699854,74cyclictest0-21swapper/320:27:253
497599855,30cyclictest0-21swapper/222:27:382
497599854,30cyclictest0-21swapper/221:52:512
497599854,30cyclictest0-21swapper/219:39:542
497599853,76cyclictest0-21swapper/220:50:122
497599853,75cyclictest0-21swapper/222:07:052
4975998521,12cyclictest0-21swapper/220:51:502
4975998514,12cyclictest0-21swapper/220:08:242
497699845,9cyclictest23612-21unixbench-2d21:02:203
497699845,72cyclictest0-21swapper/320:57:113
497599844,31cyclictest0-21swapper/222:12:102
497599843,75cyclictest0-21swapper/219:57:482
257012840,4sleep015-21rcuc/021:56:470
497699833,73cyclictest0-21swapper/321:10:043
4976998326,9cyclictest26143-21crond22:46:443
497599835,71cyclictest0-21swapper/220:26:222
497599834,73cyclictest0-21swapper/221:12:162
497599834,73cyclictest0-21swapper/221:12:162
497599834,72cyclictest0-21swapper/220:37:192
497599834,29cyclictest1227-21runrttasks21:35:272
497599833,74cyclictest0-21swapper/222:47:132
497599833,74cyclictest0-21swapper/221:11:062
497599833,31cyclictest0-21swapper/221:27:022
497599833,11cyclictest0-21swapper/220:57:402
4975998323,53cyclictest0-21swapper/222:03:442
4975998323,10cyclictest6625-21munin-node22:17:072
497699825,30cyclictest0-21swapper/322:31:323
497699824,69cyclictest4746-21grep23:02:013
497699824,32cyclictest0-21swapper/320:22:133
497699824,31cyclictest0-21swapper/322:36:403
497699824,30cyclictest0-21swapper/318:17:053
497599825,70cyclictest0-21swapper/221:47:032
497599824,31cyclictest0-21swapper/222:36:372
497599824,31cyclictest0-21swapper/219:55:212
497599824,31cyclictest0-21swapper/219:32:342
4975998238,37cyclictest4320-21tr23:01:562
497599823,34cyclictest12296-21taskset22:24:132
497599823,23cyclictest0-21swapper/219:07:042
497599823,23cyclictest0-21swapper/219:07:042
4975998213,8cyclictest107550irq/46-eth022:51:562
497699816,68cyclictest0-21swapper/322:37:453
497699816,68cyclictest0-21swapper/322:37:453
497699815,30cyclictest0-21swapper/320:04:303
497699815,25cyclictest0-21swapper/317:42:123
497699814,71cyclictest0-21swapper/321:52:113
497699814,67cyclictest0-21swapper/319:42:033
4976998125,8cyclictest2608-21rm22:10:013
4976998123,9cyclictest15641-21crond21:41:463
497599814,29cyclictest0-21swapper/219:47:242
4975998122,10cyclictest15604-21grep17:57:132
497699806,31cyclictest12642-21ssh20:47:083
497699805,69cyclictest0-21swapper/321:32:033
497699805,26cyclictest0-21swapper/322:04:023
497699805,22cyclictest11644-21unixbench-2d17:47:293
497699804,9cyclictest2961-21gltestperf20:32:093
497699804,30cyclictest0-21swapper/322:16:513
497699804,30cyclictest0-21swapper/319:50:373
497699804,30cyclictest0-21swapper/319:12:133
497599804,33cyclictest0-21swapper/220:17:542
497599804,31cyclictest0-21swapper/218:42:072
497599804,30cyclictest0-21swapper/221:22:572
4975998022,13cyclictest0-21swapper/221:41:552
497699794,68cyclictest0-21swapper/321:59:373
497699794,68cyclictest0-21swapper/321:59:373
497699794,29cyclictest0-21swapper/320:00:263
497699793,28cyclictest0-21swapper/321:17:403
4976997922,10cyclictest4181-21gltestperf22:12:043
4976997911,9cyclictest107550irq/46-eth021:12:053
4976997911,9cyclictest107550irq/46-eth021:12:053
497599794,28cyclictest11110-21munin-node18:57:122
4975997934,39cyclictest5933-21grep17:37:132
4975997923,9cyclictest23793-21grep19:22:102
4975997923,8cyclictest1227-21runrttasks18:09:342
497699784,8cyclictest5522-21hostname20:37:003
497699784,26cyclictest10433-21df_abs22:22:003
497699783,31cyclictest0-21swapper/317:41:573
4976997825,9cyclictest2375-21gltestperf18:37:153
4976997821,13cyclictest0-21swapper/319:56:343
497599784,29cyclictest0-21swapper/219:17:102
497599784,26cyclictest0-21swapper/218:22:122
497599784,26cyclictest0-21swapper/218:22:122
497599783,29cyclictest22727-21gltestperf21:02:062
4975997822,8cyclictest1227-21runrttasks18:40:012
497699774,29cyclictest0-21swapper/319:38:583
497699774,28cyclictest0-21swapper/319:25:333
497699774,27cyclictest24053-21munin-run18:16:543
497699774,12cyclictest0-21swapper/321:22:193
497599774,28cyclictest22206-21cpuspeed_turbos18:12:082
4975997723,9cyclictest9333-21grep17:42:312
497699764,33cyclictest0-21swapper/319:17:173
497699764,11cyclictest0-21swapper/318:31:553
4976997621,12cyclictest0-21swapper/318:57:203
497599764,30cyclictest0-21swapper/218:31:552
497599764,13cyclictest0-21swapper/221:57:032
497599764,13cyclictest0-21swapper/221:57:032
497699754,24cyclictest0-21swapper/317:57:083
497599754,30cyclictest0-21swapper/218:18:272
4975997523,8cyclictest1227-21runrttasks18:50:532
497699744,27cyclictest3961-21aten_r1power_cu18:42:033
497699744,14cyclictest0-21swapper/319:02:063
497699743,34cyclictest0-21swapper/318:02:253
497699743,10cyclictest32476-21munin-node18:32:163
4976997422,10cyclictest15881-21munin-node19:07:043
4976997422,10cyclictest15881-21munin-node19:07:043
4976997420,11cyclictest26214-21fschecks_time19:27:093
497599745,27cyclictest1186-21latency_hist18:36:552
497699735,61cyclictest0-21swapper/318:47:263
497699733,28cyclictest0-21swapper/318:07:063
497699733,26cyclictest11041-21latency_hist18:56:543
497599733,63cyclictest0-21swapper/217:47:262
4975997322,10cyclictest0-21swapper/217:56:562
4975997321,9cyclictest1227-21runrttasks19:28:212
497699715,59cyclictest0-21swapper/318:26:543
497699715,59cyclictest0-21swapper/318:26:543
497599713,29cyclictest19271-21sadc18:06:552
219499710,4rtkit-daemon0-21swapper/023:01:140
4975996822,11cyclictest0-21swapper/219:12:202
497299655,39cyclictest0-21swapper/018:37:190
219499650,5rtkit-daemon0-21swapper/018:16:250
219499640,8rtkit-daemon0-21swapper/018:43:170
497599635,16cyclictest0-21swapper/217:36:562
219499630,9rtkit-daemon0-21swapper/017:54:180
219499630,3rtkit-daemon0-21swapper/019:15:150
85182623,51sleep00-21swapper/020:41:510
497599623,30cyclictest0-21swapper/219:06:052
219499620,9rtkit-daemon0-21swapper/020:56:560
219499620,8rtkit-daemon0-21swapper/022:28:380
219499620,8rtkit-daemon0-21swapper/020:35:050
219499620,6rtkit-daemon3-21ksoftirqd/018:48:460
219499620,4rtkit-daemon3-21ksoftirqd/020:03:430
219499620,4rtkit-daemon0-21swapper/022:32:530
219499620,4rtkit-daemon0-21swapper/020:27:350
219499620,3rtkit-daemon0-21swapper/020:38:120
219499610,9rtkit-daemon0-21swapper/018:21:470
219499610,8rtkit-daemon0-21swapper/022:48:290
219499610,8rtkit-daemon0-21swapper/021:34:020
219499610,8rtkit-daemon0-21swapper/020:48:040
219499610,7rtkit-daemon0-21swapper/019:10:150
219499610,7rtkit-daemon0-21swapper/019:10:150
219499610,6rtkit-daemon3-21ksoftirqd/018:08:480
219499610,6rtkit-daemon0-21swapper/022:08:530
219499610,4rtkit-daemon0-21swapper/021:16:110
219499610,4rtkit-daemon0-21swapper/021:16:110
219499610,4rtkit-daemon0-21swapper/019:49:440
219499610,4rtkit-daemon0-21swapper/019:27:520
219499610,3rtkit-daemon15-21rcuc/020:15:500
219499610,3rtkit-daemon0-21swapper/023:04:360
219499610,3rtkit-daemon0-21swapper/020:53:340
219499610,3rtkit-daemon0-21swapper/019:36:220
219499610,3rtkit-daemon0-21swapper/017:42:190
219499610,2rtkit-daemon0-21swapper/021:57:240
219499610,2rtkit-daemon0-21swapper/021:57:240
219499610,2rtkit-daemon0-21swapper/021:47:390
219499610,2rtkit-daemon0-21swapper/021:27:330
219499610,2rtkit-daemon0-21swapper/021:10:110
219499610,2rtkit-daemon0-21swapper/021:02:490
219499610,2rtkit-daemon0-21swapper/019:37:290
219499610,2rtkit-daemon0-21swapper/017:57:030
230942604,13sleep00-21swapper/022:41:510
219499600,9rtkit-daemon0-21swapper/018:27:400
219499600,8rtkit-daemon0-21swapper/022:02:460
219499600,8rtkit-daemon0-21swapper/021:20:250
219499600,8rtkit-daemon0-21swapper/019:42:290
219499600,8rtkit-daemon0-21swapper/019:19:450
219499600,7rtkit-daemon0-21swapper/022:36:520
219499600,7rtkit-daemon0-21swapper/022:36:520
219499600,7rtkit-daemon0-21swapper/022:18:160
219499600,7rtkit-daemon0-21swapper/020:09:510
219499600,7rtkit-daemon0-21swapper/018:33:170
219499600,4rtkit-daemon2193-21rtkit-daemon22:29:381
219499600,4rtkit-daemon0-21swapper/022:25:450
219499600,3rtkit-daemon0-21swapper/020:23:350
219499600,3rtkit-daemon0-21swapper/020:18:350
219499600,3rtkit-daemon0-21swapper/018:02:480
219499600,2rtkit-daemon0-21swapper/022:13:080
219499600,2rtkit-daemon0-21swapper/021:43:470
219499600,2rtkit-daemon0-21swapper/021:26:030
219499600,2rtkit-daemon0-21swapper/019:22:520
219499600,2rtkit-daemon0-21swapper/019:03:310
219499600,2rtkit-daemon0-21swapper/017:47:190
53982594,47sleep15480-21grep19:47:101
497499593,32cyclictest0-21swapper/119:12:081
307482593,49sleep130752-21ssh20:26:281
219499590,7rtkit-daemon0-21swapper/021:37:020
219499590,3rtkit-daemon0-21swapper/022:51:520
219499590,3rtkit-daemon0-21swapper/019:57:440
219499590,3rtkit-daemon0-21swapper/019:52:210
219499590,3rtkit-daemon0-21swapper/018:52:390
219499590,3rtkit-daemon0-21swapper/018:22:400
219499590,3rtkit-daemon0-21swapper/018:22:400
12592593,12sleep10-21swapper/120:29:591
218772562,47sleep10-21swapper/122:38:011
218772562,47sleep10-21swapper/122:38:011
4974995510,25cyclictest0-21swapper/118:17:071
243392552,47sleep10-21swapper/121:04:411
219499550,6rtkit-daemon0-21swapper/018:03:181
497499544,32cyclictest0-21swapper/119:07:111
497499544,32cyclictest0-21swapper/119:07:111
4974995419,16cyclictest0-21swapper/122:57:141
219499540,6rtkit-daemon0-21swapper/018:34:541
4974995336,11cyclictest13847-21cut19:02:061
264992533,43sleep126551-21processes21:07:151
219499530,6rtkit-daemon0-21swapper/017:53:481
137462532,9sleep10-21swapper/120:47:241
84432522,10sleep10-21swapper/121:29:241
61972523,42sleep10-21swapper/123:03:331
58892522,43sleep10-21swapper/118:44:101
497499524,26cyclictest0-21swapper/120:06:531
4974995236,10cyclictest23071-21sed20:12:221
309842522,43sleep10-21swapper/118:28:541
219499520,5rtkit-daemon2193-21rtkit-daemon21:59:091
219499520,5rtkit-daemon2193-21rtkit-daemon21:59:091
497499514,29cyclictest0-21swapper/121:52:091
4974995136,9cyclictest10844-21cut17:47:161
4974995136,10cyclictest3621-21gltestperf21:22:061
4974995135,10cyclictest20042-21gltestperf21:47:061
497499513,40cyclictest0-21swapper/118:47:351
497499513,23cyclictest0-21swapper/119:17:171
497299514,28cyclictest0-21swapper/017:41:570
325762513,42sleep10-21swapper/119:39:361
112802513,40sleep10-21swapper/120:45:021
70932502,10sleep10-21swapper/117:38:441
53172502,42sleep10-21swapper/122:12:461
497499504,30cyclictest0-21swapper/121:12:151
497499504,30cyclictest0-21swapper/121:12:151
497499504,29cyclictest0-21swapper/122:22:111
497499504,29cyclictest0-21swapper/119:22:191
497499504,28cyclictest0-21swapper/121:32:161
497499504,28cyclictest0-21swapper/120:52:151
4974995035,9cyclictest23595-21grep18:12:341
4974995031,13cyclictest0-21swapper/119:53:091
497499503,30cyclictest7212-21unixbench_multi20:37:221
497499503,29cyclictest0-21swapper/121:01:071
18092504,12sleep10-21swapper/121:19:451
131722502,9sleep10-21swapper/119:00:471
497499494,38cyclictest0-21swapper/117:58:271
4974994931,11cyclictest23118-21munin-node22:42:151
497499493,40cyclictest0-21swapper/120:34:441
497499493,40cyclictest0-21swapper/120:03:561
497499493,33cyclictest0-21swapper/122:36:191
497499493,25cyclictest0-21swapper/121:37:331
4974994920,12cyclictest0-21swapper/120:17:351
497299495,28cyclictest0-21swapper/018:57:140
46592494,39sleep00-21swapper/017:33:200
298682492,41sleep10-21swapper/119:35:291
497499485,24cyclictest0-21swapper/122:47:171
497499484,38cyclictest0-21swapper/122:51:571
497499484,27cyclictest0-21swapper/122:02:081
497499484,27cyclictest0-21swapper/118:37:191
497499484,25cyclictest0-21swapper/119:57:191
497499483,32cyclictest0-21swapper/122:17:041
4974994817,18cyclictest1809-21ssh22:07:231
272582482,10sleep10-21swapper/119:27:471
497499474,27cyclictest0-21swapper/121:45:081
497499474,26cyclictest0-21swapper/118:11:551
497499474,26cyclictest0-21swapper/117:45:281
4974994528,10cyclictest9555-21gltestperf18:52:131
285342442,36sleep10-21swapper/118:23:221
285342442,36sleep10-21swapper/118:23:221
48642414,30sleep10-21swapper/117:35:591
497699384,11cyclictest0-21swapper/317:36:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional