You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-14 - 02:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri Aug 14, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
126132950,8sleep01112399cyclictest21:47:410
126132950,8sleep01112399cyclictest21:47:410
132432890,6sleep213248-21fschecks_time19:07:522
193362840,3sleep3361ktimersoftd/320:18:063
11127997641,12cyclictest0-21swapper/120:13:461
11123997528,8cyclictest448-21ssh20:38:530
11129997417,50cyclictest31955-21latency20:37:573
11127996822,27cyclictest5890-21unixbench_singl19:58:071
1112399683,58cyclictest0-21swapper/022:03:020
77882673,12sleep20-21swapper/223:17:462
11127996723,25cyclictest0-21swapper/120:09:061
40622660,6sleep21112899cyclictest22:22:502
1112999655,54cyclictest0-21swapper/322:20:223
1112999653,56cyclictest0-21swapper/321:38:533
1112999646,50cyclictest4693-21sort23:12:503
1112899644,52cyclictest0-21swapper/221:02:532
1112899644,51cyclictest0-21swapper/222:52:412
11127996440,8cyclictest19217-21cpuspeed_turbos21:57:411
11127996426,13cyclictest0-21swapper/122:41:351
1112399644,53cyclictest0-21swapper/023:02:320
1112399644,53cyclictest0-21swapper/023:02:320
1112899634,51cyclictest0-21swapper/223:02:452
1112899634,51cyclictest0-21swapper/223:02:452
1112899634,51cyclictest0-21swapper/221:49:092
1112899634,51cyclictest0-21swapper/221:49:092
1112899634,51cyclictest0-21swapper/221:32:482
1112899624,51cyclictest0-21swapper/223:00:022
1112899624,50cyclictest0-21swapper/223:13:002
1112899624,50cyclictest0-21swapper/221:52:502
1112899624,50cyclictest0-21swapper/219:57:332
1112899623,52cyclictest0-21swapper/220:22:492
1112899623,51cyclictest0-21swapper/222:42:462
1112899623,51cyclictest0-21swapper/222:38:002
1112899622,42cyclictest0-21swapper/220:21:102
11127996245,12cyclictest0-21swapper/118:02:491
11127996225,10cyclictest24278-21interrupts18:22:581
11127996225,10cyclictest24278-21interrupts18:22:581
269682613,51sleep10-21swapper/120:31:241
269682613,51sleep10-21swapper/120:31:241
219499610,5rtkit-daemon2193-21rtkit-daemon19:05:441
219499610,5rtkit-daemon2193-21rtkit-daemon19:05:441
219499610,4rtkit-daemon2193-21rtkit-daemon18:45:221
1112899614,50cyclictest0-21swapper/220:39:572
1112899614,49cyclictest0-21swapper/221:17:492
1112899614,48cyclictest0-21swapper/220:43:032
1112899613,50cyclictest0-21swapper/219:27:522
1112799619,28cyclictest12974-21fschecks_time21:47:451
1112799619,28cyclictest12974-21fschecks_time21:47:451
11127996145,11cyclictest0-21swapper/120:32:501
11127996132,13cyclictest0-21swapper/121:28:031
1112899603,8cyclictest26-21rcuc/222:07:482
1112899603,50cyclictest0-21swapper/218:42:352
1112899603,49cyclictest0-21swapper/222:02:462
1112899603,49cyclictest0-21swapper/221:07:432
1112899603,49cyclictest0-21swapper/221:07:432
1112899602,52cyclictest0-21swapper/220:15:102
11127996043,11cyclictest0-21swapper/121:33:031
11127996043,10cyclictest0-21swapper/120:37:551
11127996041,13cyclictest0-21swapper/118:32:471
215352592,51sleep30-21swapper/322:01:113
1112999595,22cyclictest0-21swapper/321:47:283
1112899594,49cyclictest0-21swapper/221:27:412
11128995934,8cyclictest24497-21ssh20:27:462
11128995934,8cyclictest24497-21ssh20:27:462
1112899593,49cyclictest0-21swapper/218:27:362
1112899593,49cyclictest0-21swapper/218:27:362
11127995945,8cyclictest3864-21diskmemload20:48:041
11127995936,9cyclictest0-21swapper/118:12:521
11127995933,10cyclictest31012-21unixbench-2d23:03:001
11127995933,10cyclictest31012-21unixbench-2d23:03:001
11127995925,13cyclictest0-21swapper/122:03:331
11127995925,11cyclictest0-21swapper/122:50:001
11129995823,23cyclictest0-21swapper/322:32:463
11128995834,8cyclictest19451-21ssh21:57:442
1112899583,48cyclictest0-21swapper/222:12:582
1112799585,12cyclictest18679-21irqstats20:17:561
11127995830,13cyclictest0-21swapper/121:17:451
11127995828,13cyclictest0-21swapper/121:06:261
11127995826,13cyclictest0-21swapper/122:09:551
11127995826,12cyclictest7525-21ssh22:27:531
11127995826,12cyclictest7525-21ssh22:27:531
11127995823,15cyclictest0-21swapper/121:10:591
11127995823,15cyclictest0-21swapper/121:10:591
1112399585,45cyclictest0-21swapper/022:54:440
90952573,48sleep00-21swapper/020:03:090
296232573,46sleep20-21swapper/221:23:012
219499570,4rtkit-daemon2193-21rtkit-daemon20:03:411
11129995722,18cyclictest24213-21ssh22:53:003
1112899574,46cyclictest0-21swapper/222:32:262
1112899574,46cyclictest0-21swapper/222:32:262
1112899573,48cyclictest0-21swapper/219:03:042
1112899573,48cyclictest0-21swapper/219:03:042
1112899573,11cyclictest0-21swapper/222:47:412
11127995740,12cyclictest0-21swapper/122:36:431
11127995731,12cyclictest0-21swapper/118:39:031
11127995730,12cyclictest0-21swapper/121:22:401
11127995728,12cyclictest0-21swapper/121:42:291
11127995726,15cyclictest0-21swapper/121:42:441
11127995723,14cyclictest0-21swapper/120:24:301
1112399579,30cyclictest0-21swapper/021:57:280
1112399574,24cyclictest0-21swapper/020:23:470
1112399573,48cyclictest0-21swapper/020:52:300
11123995712,26cyclictest0-21swapper/019:42:480
268792563,9sleep00-21swapper/020:31:020
268792563,9sleep00-21swapper/020:31:020
17452562,9sleep30-21swapper/321:31:283
11129995631,10cyclictest0-21swapper/321:35:453
11129995626,13cyclictest0-21swapper/320:53:063
11129995618,8cyclictest0-21swapper/318:38:033
11129995616,23cyclictest6552-21netstat18:52:573
1112899565,44cyclictest28527-21if_err_eth020:32:542
1112899564,47cyclictest0-21swapper/222:36:542
1112899564,46cyclictest26-21rcuc/220:09:522
1112899563,8cyclictest7770-21yum-updatesd-he21:38:552
1112899563,10cyclictest0-21swapper/221:13:152
1112799566,29cyclictest0-21swapper/120:57:501
11127995639,12cyclictest0-21swapper/121:52:451
11127995631,11cyclictest0-21swapper/122:57:411
11127995629,14cyclictest0-21swapper/122:15:111
11127995626,11cyclictest0-21swapper/121:14:521
11127995623,14cyclictest0-21swapper/123:07:441
11127995623,13cyclictest0-21swapper/122:54:591
1112399564,46cyclictest0-21swapper/021:02:590
95972553,46sleep10-21swapper/123:21:191
1112999556,15cyclictest0-21swapper/319:17:343
1112999554,30cyclictest0-21swapper/322:51:103
11129995521,27cyclictest6623-21kworker/3:023:22:373
1112999552,14cyclictest0-21swapper/320:42:393
11128995531,9cyclictest628-21ssh23:07:412
1112899553,44cyclictest0-21swapper/223:27:242
11128995528,10cyclictest0-21swapper/220:05:122
11128995523,13cyclictest0-21swapper/220:47:552
11127995530,10cyclictest9458-21iostat20:52:531
11127995527,13cyclictest0-21swapper/120:42:441
1112399553,39cyclictest0-21swapper/022:50:040
11123995518,20cyclictest13363-21latency_hist23:27:250
272542543,43sleep00-21swapper/018:28:090
219499540,6rtkit-daemon2193-21rtkit-daemon21:42:450
219499540,5rtkit-daemon2193-21rtkit-daemon19:39:051
11129995421,13cyclictest0-21swapper/321:02:243
11129995414,24cyclictest18546-21cut18:12:483
1112899544,10cyclictest0-21swapper/220:55:562
1112899543,45cyclictest12001-21idleruntime-cro21:47:282
1112799547,28cyclictest0-21swapper/118:27:591
1112799545,29cyclictest0-21swapper/123:25:351
11127995435,12cyclictest4641-21iostat_ios23:12:481
1112799543,10cyclictest0-21swapper/122:45:371
11127995427,14cyclictest0-21swapper/119:48:031
11127995427,14cyclictest0-21swapper/119:48:031
1112399543,44cyclictest0-21swapper/020:44:110
1112399543,43cyclictest0-21swapper/020:52:450
57802533,44sleep10-21swapper/122:26:411
43262533,7sleep24363-21sensors_temp18:48:062
40462533,42sleep10-21swapper/118:48:011
219499530,5rtkit-daemon2193-21rtkit-daemon22:07:440
219499530,5rtkit-daemon2193-21rtkit-daemon21:57:290
219499530,5rtkit-daemon2193-21rtkit-daemon21:22:460
1112999535,13cyclictest0-21swapper/321:13:183
1112999534,32cyclictest0-21swapper/323:03:583
1112999534,32cyclictest0-21swapper/323:03:583
1112999533,12cyclictest0-21swapper/321:47:423
1112999533,12cyclictest0-21swapper/321:47:423
1112999533,11cyclictest0-21swapper/322:12:553
11129995322,9cyclictest28131-21aten_r1power_cu21:22:403
1112999532,11cyclictest0-21swapper/320:23:263
11128995336,10cyclictest32426-21grep19:47:502
11128995336,10cyclictest32426-21grep19:47:502
11128995323,13cyclictest0-21swapper/222:18:002
1112899532,11cyclictest0-21swapper/220:57:462
1112799535,29cyclictest0-21swapper/119:29:201
1112799534,31cyclictest0-21swapper/118:52:531
1112799534,27cyclictest0-21swapper/117:57:381
11127995321,13cyclictest0-21swapper/119:13:051
1112399535,35cyclictest0-21swapper/022:33:320
1112399534,41cyclictest0-21swapper/020:17:500
81932522,10sleep00-21swapper/022:28:170
81932522,10sleep00-21swapper/022:28:170
219499520,5rtkit-daemon2193-21rtkit-daemon21:32:450
219499520,5rtkit-daemon2193-21rtkit-daemon21:27:460
219499520,5rtkit-daemon2193-21rtkit-daemon21:20:230
143292523,42sleep10-21swapper/119:08:321
1112999524,24cyclictest31347-21crond19:47:323
1112999524,13cyclictest0-21swapper/321:02:413
1112999524,12cyclictest0-21swapper/322:27:383
1112999524,12cyclictest0-21swapper/322:27:383
1112999523,9cyclictest13770-21sed22:37:463
11129995223,12cyclictest0-21swapper/321:17:593
11129995221,12cyclictest0-21swapper/319:12:343
11129995210,24cyclictest0-21swapper/322:59:103
1112899525,41cyclictest26-21rcuc/219:38:002
11128995223,13cyclictest0-21swapper/219:57:562
11128995223,13cyclictest0-21swapper/219:42:482
1112799525,28cyclictest0-21swapper/118:58:091
1112799525,27cyclictest0-21swapper/119:44:231
1112799525,27cyclictest0-21swapper/118:19:001
1112799524,29cyclictest0-21swapper/117:58:071
11127995220,14cyclictest0-21swapper/122:17:281
1112399523,43cyclictest0-21swapper/019:58:100
277212512,9sleep30-21swapper/318:31:303
250912512,9sleep30-21swapper/322:07:163
219499510,5rtkit-daemon2193-21rtkit-daemon21:40:000
219499510,5rtkit-daemon2193-21rtkit-daemon21:08:310
219499510,5rtkit-daemon2193-21rtkit-daemon21:08:310
184812512,9sleep30-21swapper/321:57:043
183292512,42sleep30-21swapper/322:44:213
182882513,10sleep30-21swapper/319:17:573
1112999515,27cyclictest0-21swapper/320:29:303
1112999515,27cyclictest0-21swapper/320:29:303
1112999514,28cyclictest0-21swapper/320:07:553
1112999514,28cyclictest0-21swapper/319:58:073
1112999514,26cyclictest15658-21ssh20:13:053
1112999514,23cyclictest28027-21ssh22:10:573
1112999514,11cyclictest0-21swapper/320:06:203
1112999513,12cyclictest0-21swapper/322:22:473
11129995121,13cyclictest0-21swapper/318:47:353
11129995118,14cyclictest0-21swapper/318:08:063
11128995123,12cyclictest0-21swapper/218:13:022
1112799515,28cyclictest0-21swapper/119:19:191
1112799515,28cyclictest0-21swapper/118:08:001
1112799513,28cyclictest0-21swapper/119:22:581
11127995124,11cyclictest1854-21cpuspeed_turbos19:52:481
1112399514,41cyclictest0-21swapper/020:08:120
11123995110,13cyclictest0-21swapper/023:07:500
262622502,42sleep00-21swapper/019:33:340
214542502,9sleep30-21swapper/319:23:093
203562502,10sleep30-21swapper/321:08:553
203562502,10sleep30-21swapper/321:08:553
1112999505,28cyclictest0-21swapper/319:27:573
1112999504,28cyclictest0-21swapper/323:17:403
1112999503,11cyclictest0-21swapper/323:11:553
11129995021,12cyclictest0-21swapper/320:48:053
1112899504,40cyclictest0-21swapper/218:52:542
1112899504,26cyclictest0-21swapper/218:03:022
1112899503,28cyclictest0-21swapper/218:57:542
11128995023,9cyclictest1124-21snmpd17:58:562
1112399504,42cyclictest0-21swapper/022:46:120
1112399504,40cyclictest0-21swapper/021:14:230
1112399504,11cyclictest0-21swapper/020:58:040
1112399503,41cyclictest4105-21ssh23:12:420
1112399503,40cyclictest0-21swapper/022:57:400
1112399503,12cyclictest0-21swapper/022:17:440
1112399502,14cyclictest0-21swapper/019:17:480
108212504,40sleep00-21swapper/017:54:080
96952492,41sleep00-21swapper/019:00:250
71702492,40sleep00-21swapper/023:17:390
219499490,4rtkit-daemon2193-21rtkit-daemon18:02:540
171102492,41sleep00-21swapper/020:16:510
130692493,39sleep00-21swapper/019:07:510
1112999495,27cyclictest0-21swapper/319:52:513
1112999495,26cyclictest0-21swapper/319:35:533
1112999495,25cyclictest0-21swapper/320:35:163
1112999495,25cyclictest0-21swapper/318:24:013
1112999495,25cyclictest0-21swapper/318:24:013
1112999494,28cyclictest0-21swapper/319:02:343
1112999494,27cyclictest0-21swapper/318:49:053
1112999494,27cyclictest0-21swapper/318:03:573
1112999494,26cyclictest0-21swapper/319:48:003
1112999494,26cyclictest0-21swapper/319:48:003
1112999494,26cyclictest0-21swapper/319:04:083
1112999494,26cyclictest0-21swapper/319:04:083
11129994918,13cyclictest0-21swapper/318:17:553
11128994926,9cyclictest14937-21telnet19:12:452
11128994923,11cyclictest19980-21cpuspeed_turbos19:22:482
53362483,38sleep00-21swapper/022:24:590
24432482,40sleep00-21swapper/018:44:330
134382482,40sleep00-21swapper/018:01:570
1112999484,27cyclictest0-21swapper/317:58:083
1112999484,26cyclictest0-21swapper/318:37:363
11129994815,14cyclictest0-21swapper/319:38:583
1112899483,39cyclictest0-21swapper/218:36:142
11128994817,11cyclictest0-21swapper/218:07:472
1112799484,26cyclictest0-21swapper/119:33:001
1112399485,38cyclictest0-21swapper/020:34:380
11123994821,12cyclictest0-21swapper/022:38:590
11123994821,12cyclictest0-21swapper/022:12:500
11123994821,12cyclictest0-21swapper/018:37:540
251132472,9sleep00-21swapper/018:23:370
251132472,9sleep00-21swapper/018:23:370
201722473,10sleep00-21swapper/019:22:500
182312472,39sleep00-21swapper/018:12:120
170182472,39sleep00-21swapper/019:17:300
1112399474,27cyclictest0-21swapper/019:52:500
89322464,6sleep20-21swapper/217:52:412
48982462,39sleep00-21swapper/018:50:050
287892462,38sleep00-21swapper/019:40:190
263562462,37sleep20-21swapper/219:34:492
24202462,9sleep20-21swapper/218:44:152
120082462,38sleep00-21swapper/019:04:240
120082462,38sleep00-21swapper/019:04:240
11128994632,8cyclictest17625-21cpuspeed_turbos19:17:482
11128994623,7cyclictest23039-21crond18:22:362
205482452,37sleep00-21swapper/018:16:200
1112399453,25cyclictest0-21swapper/018:17:510
11123994419,11cyclictest0-21swapper/019:47:530
11123994419,11cyclictest0-21swapper/019:47:530
1112399424,24cyclictest0-21swapper/018:36:140
1112399423,12cyclictest0-21swapper/018:52:520
1112899412,24cyclictest0-21swapper/218:27:562
11123994025,9cyclictest22911-21tail19:27:520
11129993619,11cyclictest361ktimersoftd/317:57:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional