You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 02:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Mon May 04, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
184009910110,12cyclictest0-21swapper/019:12:150
248599990,6rtkit-daemon0-21swapper/119:47:131
85872960,3sleep20-21swapper/221:14:142
1840099944,68cyclictest0-21swapper/019:57:140
18400999218,50cyclictest0-21swapper/022:03:540
18400999119,54cyclictest0-21swapper/020:27:110
248599900,7rtkit-daemon0-21swapper/121:26:541
1840099907,66cyclictest0-21swapper/022:24:270
1840099904,23cyclictest0-21swapper/021:37:300
1840099903,80cyclictest1419-21runrttasks20:53:130
18400999014,8cyclictest4267-21kworker/0:021:56:590
1840099894,69cyclictest0-21swapper/020:09:580
1840099893,68cyclictest0-21swapper/019:52:180
1840099893,68cyclictest0-21swapper/019:52:180
18400998915,7cyclictest7479-21ssh21:12:050
1840099885,62cyclictest0-21swapper/019:17:260
1840099885,20cyclictest0-21swapper/021:20:540
1840099885,20cyclictest0-21swapper/021:20:540
1840099884,76cyclictest0-21swapper/018:42:020
1840099883,63cyclictest0-21swapper/019:26:500
1840099883,21cyclictest0-21swapper/021:36:230
1840099883,14cyclictest0-21swapper/020:57:520
1840099874,69cyclictest0-21swapper/020:23:590
1840099874,67cyclictest0-21swapper/022:08:360
1840099873,19cyclictest17097-21ssh19:03:310
18400998718,10cyclictest30857-21cpuspeed_turbos17:22:020
18400998716,8cyclictest2461-21ssh21:06:350
1840099863,76cyclictest0-21swapper/021:47:510
1840099863,76cyclictest0-21swapper/019:24:260
18400998616,7cyclictest121850irq/46-eth022:17:490
18400998613,10cyclictest10924-21grep19:42:020
1840099853,7cyclictest121850irq/46-eth020:16:000
1840099844,74cyclictest0-21swapper/021:10:500
1840099844,73cyclictest0-21swapper/021:26:500
1840099844,73cyclictest0-21swapper/019:06:530
1840099844,65cyclictest0-21swapper/020:44:120
1840099844,60cyclictest0-21swapper/020:33:030
1840099844,60cyclictest0-21swapper/020:33:030
1840099843,8cyclictest121850irq/46-eth021:46:310
1840099843,75cyclictest0-21swapper/020:03:180
1840099843,20cyclictest24592-21ssh20:51:110
1840099843,12cyclictest0-21swapper/022:11:460
1840099834,26cyclictest0-21swapper/021:22:360
1840099834,21cyclictest0-21swapper/019:35:150
1840099833,72cyclictest0-21swapper/019:47:110
1840099833,21cyclictest9776-21tune2fs18:52:050
18400998323,54cyclictest1419-21runrttasks17:13:050
18400998314,8cyclictest16120-21ssh20:37:040
18400998314,8cyclictest16120-21ssh20:37:040
18400998313,10cyclictest743-21telnet21:51:490
1840099814,70cyclictest0-21swapper/020:17:040
1840099814,70cyclictest0-21swapper/019:37:000
1840099814,70cyclictest0-21swapper/018:36:570
18400998121,6cyclictest21932-21awk18:11:450
1840099804,24cyclictest0-21swapper/018:58:150
18400998023,50cyclictest0-21swapper/018:02:090
1840099793,68cyclictest0-21swapper/017:32:030
1840099793,21cyclictest0-21swapper/018:33:160
18400997926,47cyclictest30199-21cut18:27:030
18400997926,47cyclictest30199-21cut18:27:030
18400997821,50cyclictest23612-21swap18:12:160
1840099773,67cyclictest0-21swapper/017:47:060
1840099773,67cyclictest0-21swapper/017:47:060
1840099773,66cyclictest0-21swapper/017:41:470
1840099773,25cyclictest0-21swapper/017:01:510
1840099773,25cyclictest0-21swapper/017:01:510
18400997728,43cyclictest8271-21grep18:47:160
248599760,9rtkit-daemon29777-21rm20:10:422
1840099764,65cyclictest0-21swapper/017:56:490
18400997620,8cyclictest1419-21runrttasks18:18:220
18400997519,8cyclictest1419-21runrttasks17:45:290
18400997517,51cyclictest0-21swapper/016:57:010
236622740,4chrt23661-21ssh22:24:591
1840099743,27cyclictest12597-21munin-node17:51:560
18400997417,9cyclictest1419-21runrttasks18:23:140
18400997322,44cyclictest0-21swapper/017:27:150
18400997319,8cyclictest29851-21unixbench_multi17:17:210
1840099723,62cyclictest0-21swapper/017:07:190
248599700,7rtkit-daemon0-21swapper/318:42:533
248599700,5rtkit-daemon0-21swapper/220:22:343
248599670,6rtkit-daemon0-21swapper/220:32:113
248599670,6rtkit-daemon0-21swapper/220:32:113
248599670,3rtkit-daemon37-21ksoftirqd/319:17:223
172622670,5sleep30-21swapper/320:39:033
172622670,5sleep30-21swapper/320:39:033
248599660,7rtkit-daemon0-21swapper/221:01:403
248599660,7rtkit-daemon0-21swapper/220:26:563
310102650,2sleep30-21swapper/321:00:043
248599650,5rtkit-daemon7310-21diskstats19:36:583
248599650,5rtkit-daemon29-21ksoftirqd/220:16:573
18404996524,33cyclictest1419-21runrttasks20:46:543
18404996519,24cyclictest2501-21metacity21:22:363
248599640,9rtkit-daemon31944-21timerandwakeup20:12:123
248599640,6rtkit-daemon0-21swapper/221:07:023
248599640,6rtkit-daemon0-21swapper/219:35:513
248599630,8rtkit-daemon0-21swapper/317:31:113
248599630,5rtkit-daemon0-21swapper/221:20:393
248599630,5rtkit-daemon0-21swapper/221:20:393
248599630,5rtkit-daemon0-21swapper/219:29:363
248599620,9rtkit-daemon0-21swapper/318:17:093
248599620,9rtkit-daemon0-21swapper/318:13:543
248599620,8rtkit-daemon0-21swapper/317:22:493
248599620,5rtkit-daemon37-21ksoftirqd/317:00:193
248599620,5rtkit-daemon0-21swapper/219:25:593
248599620,4rtkit-daemon37-21ksoftirqd/318:10:173
248599620,3rtkit-daemon0-21swapper/318:39:233
248599620,3rtkit-daemon0-21swapper/317:03:043
248599620,3rtkit-daemon0-21swapper/317:03:043
18402996220,23cyclictest25170-21cpu20:51:531
248599610,8rtkit-daemon0-21swapper/318:55:453
248599610,7rtkit-daemon0-21swapper/318:05:543
248599610,7rtkit-daemon0-21swapper/220:10:493
248599610,5rtkit-daemon37-21ksoftirqd/318:26:463
248599610,5rtkit-daemon37-21ksoftirqd/318:26:463
248599610,4rtkit-daemon37-21ksoftirqd/318:33:463
248599610,4rtkit-daemon37-21ksoftirqd/317:56:553
248599610,4rtkit-daemon37-21ksoftirqd/317:46:253
248599610,4rtkit-daemon37-21ksoftirqd/317:08:043
18403996129,26cyclictest13462-21head19:46:522
18402996124,14cyclictest0-21swapper/119:42:111
18400996117,6cyclictest18377-21latency_hist16:56:490
52032600,4sleep118-21rcuc/121:09:091
248599600,9rtkit-daemon0-21swapper/318:58:073
248599600,7rtkit-daemon0-21swapper/318:49:003
248599600,7rtkit-daemon0-21swapper/318:26:013
248599600,7rtkit-daemon0-21swapper/317:33:333
248599600,5rtkit-daemon37-21ksoftirqd/317:11:563
248599600,4rtkit-daemon37-21ksoftirqd/319:09:143
248599600,4rtkit-daemon37-21ksoftirqd/317:48:033
248599600,4rtkit-daemon37-21ksoftirqd/317:48:033
248599600,4rtkit-daemon34-21rcuc/317:52:173
184582604,12sleep30-21swapper/321:28:223
18402996028,24cyclictest1419-21runrttasks20:43:491
248599590,9rtkit-daemon0-21swapper/317:21:113
248599590,7rtkit-daemon0-21swapper/319:12:293
248599590,3rtkit-daemon0-21swapper/319:03:303
248599590,3rtkit-daemon0-21swapper/317:36:483
1840299596,29cyclictest0-21swapper/120:01:591
1840299594,37cyclictest30723-21unixbench_singl19:22:191
248599580,4rtkit-daemon2484-21rtkit-daemon21:26:391
1840299585,45cyclictest0-21swapper/117:36:461
1840299583,49cyclictest0-21swapper/120:57:041
27222574,46sleep10-21swapper/119:30:251
248599570,4rtkit-daemon2484-21rtkit-daemon20:48:411
18403995724,27cyclictest0-21swapper/221:22:012
1840299574,29cyclictest0-21swapper/121:56:521
1840299574,29cyclictest0-21swapper/119:12:061
1840299574,27cyclictest0-21swapper/119:11:441
1840299573,10cyclictest0-21swapper/120:11:441
18402995722,13cyclictest0-21swapper/118:32:201
18402995720,13cyclictest0-21swapper/121:17:491
18402995720,13cyclictest0-21swapper/121:17:491
18402995720,13cyclictest0-21swapper/120:22:201
18402995717,34cyclictest0-21swapper/122:16:561
136922573,47sleep10-21swapper/118:58:491
6332564,10sleep10-21swapper/121:51:471
1840399569,34cyclictest0-21swapper/221:17:412
1840399569,34cyclictest0-21swapper/221:17:412
1840399567,21cyclictest1602-21ssh20:16:552
1840399564,36cyclictest0-21swapper/221:37:052
18403995636,11cyclictest28126-21tail21:42:112
18403995619,20cyclictest0-21swapper/218:58:302
1840299566,27cyclictest0-21swapper/119:40:591
1840299565,29cyclictest0-21swapper/120:07:131
1840299565,28cyclictest0-21swapper/118:42:101
1840299564,29cyclictest0-21swapper/120:36:521
1840299564,29cyclictest0-21swapper/120:36:521
1840299564,28cyclictest0-21swapper/119:57:101
1840299564,27cyclictest0-21swapper/120:34:441
1840299564,27cyclictest0-21swapper/120:34:441
1840299564,27cyclictest0-21swapper/119:17:041
1840299563,29cyclictest0-21swapper/121:42:001
18402995620,13cyclictest0-21swapper/122:04:061
136142562,47sleep113621-21iostat_ios17:52:061
1840499554,45cyclictest0-21swapper/322:16:173
18404995525,12cyclictest0-21swapper/322:02:043
1840399554,37cyclictest0-21swapper/221:31:062
1840399554,20cyclictest0-21swapper/220:34:382
1840399554,20cyclictest0-21swapper/220:34:382
18403995534,14cyclictest0-21swapper/220:57:102
1840399553,45cyclictest0-21swapper/219:40:092
18403995511,25cyclictest0-21swapper/219:42:162
1840299555,27cyclictest0-21swapper/120:28:501
1840299554,28cyclictest0-21swapper/121:12:141
1840299554,28cyclictest0-21swapper/118:17:001
1840299554,28cyclictest0-21swapper/117:47:111
1840299554,28cyclictest0-21swapper/117:47:111
1840299554,27cyclictest0-21swapper/120:17:381
1840299554,27cyclictest0-21swapper/118:01:471
1840299554,26cyclictest0-21swapper/121:01:451
64832543,8sleep16565-21missed_timers17:37:111
1840499548,31cyclictest0-21swapper/321:49:123
1840399544,43cyclictest0-21swapper/220:42:102
1840399544,29cyclictest0-21swapper/220:37:272
1840399544,29cyclictest0-21swapper/220:37:272
1840399544,29cyclictest0-21swapper/219:07:152
18403995438,10cyclictest11812-21grep22:06:562
1840399543,45cyclictest0-21swapper/219:17:122
1840299545,28cyclictest0-21swapper/117:22:011
1840299545,26cyclictest0-21swapper/122:12:171
1840299544,30cyclictest0-21swapper/119:31:591
1840299544,27cyclictest0-21swapper/121:49:131
1840299544,27cyclictest0-21swapper/119:03:141
248599530,5rtkit-daemon2484-21rtkit-daemon17:42:102
1840499533,43cyclictest361ktimersoftd/321:51:523
18404995325,11cyclictest7398-21needreboot21:12:033
18404995322,24cyclictest10923-21gltestperf19:42:023
1840399539,25cyclictest0-21swapper/221:02:112
1840399533,34cyclictest8465-21ssh22:01:562
18403995311,26cyclictest0-21swapper/220:12:022
1840299536,28cyclictest0-21swapper/121:36:591
1840299535,27cyclictest0-21swapper/122:08:021
1840299535,26cyclictest0-21swapper/119:54:131
1840299535,26cyclictest0-21swapper/119:54:131
1840299534,28cyclictest0-21swapper/117:02:121
1840299534,28cyclictest0-21swapper/117:02:121
171832533,43sleep20-21swapper/222:15:542
1840399524,29cyclictest0-21swapper/219:57:062
1840399524,29cyclictest0-21swapper/217:12:052
1840399524,28cyclictest0-21swapper/220:02:152
1840399524,12cyclictest0-21swapper/221:53:422
216902513,11sleep10-21swapper/118:08:511
205932513,11sleep10-21swapper/116:59:341
1840499515,32cyclictest0-21swapper/322:22:263
1840499515,27cyclictest0-21swapper/322:16:393
1840499514,28cyclictest4203-21munin-node21:56:493
1840499514,28cyclictest19584-21yum-updatesd-he20:42:093
18404995120,13cyclictest0-21swapper/321:36:533
18404995120,13cyclictest0-21swapper/319:56:453
18404995120,12cyclictest20471-21gltestperf21:31:573
1840399515,28cyclictest0-21swapper/219:22:502
1840399514,41cyclictest0-21swapper/221:46:592
1840399514,29cyclictest0-21swapper/221:06:542
1840399514,27cyclictest0-21swapper/221:32:052
1840399514,27cyclictest0-21swapper/218:12:002
1840399514,13cyclictest0-21swapper/221:56:532
18403995132,13cyclictest0-21swapper/220:51:562
1840399513,31cyclictest0-21swapper/222:16:472
18403995122,13cyclictest0-21swapper/219:03:322
18403995120,13cyclictest0-21swapper/218:42:182
1840299515,37cyclictest0-21swapper/117:42:161
248599500,4rtkit-daemon2484-21rtkit-daemon19:16:292
1840499505,27cyclictest0-21swapper/320:02:463
1840499505,27cyclictest0-21swapper/319:53:433
1840499505,27cyclictest0-21swapper/319:53:433
1840499505,27cyclictest0-21swapper/319:47:173
1840499504,26cyclictest0-21swapper/321:43:583
1840399509,25cyclictest0-21swapper/218:51:592
1840399507,26cyclictest0-21swapper/220:27:172
1840399504,40cyclictest0-21swapper/218:07:132
1840399504,38cyclictest0-21swapper/218:38:022
1840399504,27cyclictest0-21swapper/217:57:222
1840399504,24cyclictest0-21swapper/219:36:362
1840399504,19cyclictest0-21swapper/218:32:552
18403995011,24cyclictest0-21swapper/220:51:292
1840499495,27cyclictest0-21swapper/320:52:033
1840499494,38cyclictest11517-21diskstats22:06:533
1840399494,27cyclictest0-21swapper/222:21:532
1840399494,27cyclictest0-21swapper/219:52:002
1840399494,27cyclictest0-21swapper/219:52:002
1840399494,27cyclictest0-21swapper/217:27:102
1840399494,27cyclictest0-21swapper/217:16:592
18403994936,8cyclictest32589-21ssh19:26:572
1840399493,27cyclictest0-21swapper/217:22:002
18402994929,11cyclictest1699-21sshd18:36:551
248599480,4rtkit-daemon2484-21rtkit-daemon17:37:112
229662482,9sleep20-21swapper/217:04:272
229662482,9sleep20-21swapper/217:04:272
1840399484,26cyclictest0-21swapper/216:56:582
1840399483,39cyclictest0-21swapper/220:22:032
1840399483,39cyclictest0-21swapper/217:32:042
1840399483,27cyclictest0-21swapper/218:17:022
1840299486,34cyclictest0-21swapper/118:31:461
1840299486,34cyclictest0-21swapper/118:31:461
1840299484,36cyclictest0-21swapper/118:12:041
18402994832,10cyclictest30314-21crond17:21:481
18402994830,12cyclictest18257-21gltestperf18:02:061
18402994820,12cyclictest0-21swapper/121:31:571
277062473,38sleep10-21swapper/117:13:571
254502474,11sleep10-21swapper/117:10:391
1840399473,27cyclictest0-21swapper/218:27:112
1840399473,27cyclictest0-21swapper/218:27:112
1840399473,26cyclictest0-21swapper/217:52:142
1840399472,33cyclictest0-21swapper/218:02:052
177832474,35sleep20-21swapper/216:52:152
1840399464,26cyclictest0-21swapper/218:47:042
1840399463,26cyclictest0-21swapper/217:07:182
1840299463,37cyclictest0-21swapper/118:22:071
18402994615,14cyclictest0-21swapper/117:27:111
1840299454,25cyclictest0-21swapper/118:53:201
18402994527,12cyclictest0-21swapper/118:51:431
181162454,6sleep10-21swapper/116:53:351
18403994431,8cyclictest27775-21gltestperf18:22:052
122492433,10sleep20-21swapper/217:50:182
122492433,10sleep20-21swapper/217:50:182
1840499394,15cyclictest0-21swapper/316:56:493
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional