You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 11:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Tue May 12, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
864921200,4sleep28650-21gzip20:49:372
2485991080,3rtkit-daemon0-21swapper/021:13:030
2958199973,77cyclictest0-21swapper/021:54:270
2958199953,25cyclictest0-21swapper/020:16:590
2958199945,26cyclictest0-21swapper/019:50:200
2958199944,25cyclictest0-21swapper/021:18:240
2958199943,32cyclictest0-21swapper/019:35:410
2958199937,18cyclictest121850irq/46-eth019:27:250
2958199934,24cyclictest0-21swapper/021:52:210
2958199934,13cyclictest0-21swapper/020:29:070
2958199933,23cyclictest5578-21ssh19:09:380
29581999318,12cyclictest0-21swapper/018:20:490
29581999317,11cyclictest0-21swapper/019:42:520
2958199924,69cyclictest0-21swapper/021:46:040
2958199924,28cyclictest0-21swapper/018:24:300
2958199924,27cyclictest0-21swapper/022:02:400
2958199924,27cyclictest0-21swapper/020:01:530
2958199924,27cyclictest0-21swapper/020:01:530
2958199924,26cyclictest0-21swapper/020:41:130
2958199924,25cyclictest0-21swapper/019:31:120
2958199924,24cyclictest0-21swapper/021:33:410
2958199923,26cyclictest0-21swapper/019:14:250
2958199923,22cyclictest1287-21snmpd20:24:040
29581999218,12cyclictest0-21swapper/018:44:440
2958199915,26cyclictest0-21swapper/022:04:410
2958199915,26cyclictest0-21swapper/022:04:410
2958199915,25cyclictest0-21swapper/020:29:310
2958199915,25cyclictest0-21swapper/018:58:590
2958199914,27cyclictest0-21swapper/017:49:370
2958199914,25cyclictest0-21swapper/021:08:530
2958199914,25cyclictest0-21swapper/020:52:070
2958199914,25cyclictest0-21swapper/020:08:480
2958199914,24cyclictest3815-21munin-node20:44:270
2958199914,24cyclictest3815-21munin-node20:44:270
2958199914,23cyclictest0-21swapper/021:24:280
2958199914,23cyclictest0-21swapper/021:24:280
29581999118,9cyclictest30875-21ssh18:59:400
2958199904,25cyclictest0-21swapper/020:55:110
2958199904,24cyclictest0-21swapper/022:13:350
29581999019,12cyclictest0-21swapper/019:54:320
29581999017,11cyclictest0-21swapper/019:48:370
2958199898,23cyclictest0-21swapper/019:04:440
2958199894,26cyclictest0-21swapper/018:35:520
2958199894,24cyclictest0-21swapper/020:35:290
2958199893,27cyclictest0-21swapper/018:49:280
2958199893,19cyclictest223311diskmemload19:19:190
2958199893,19cyclictest223311diskmemload19:19:190
2958199885,24cyclictest0-21swapper/021:00:110
2958199884,77cyclictest0-21swapper/020:09:340
2958199884,26cyclictest0-21swapper/017:14:160
2958199884,26cyclictest0-21swapper/017:14:160
2958199884,22cyclictest7200-21yum-updatesd-he21:35:090
2958199883,26cyclictest0-21swapper/022:14:290
2958199874,26cyclictest0-21swapper/017:59:280
2958199874,23cyclictest0-21swapper/017:48:510
29581998717,12cyclictest0-21swapper/021:21:280
2958199864,26cyclictest0-21swapper/021:39:240
2958199864,26cyclictest0-21swapper/018:09:250
2958199863,75cyclictest575-21sed16:54:360
2958199855,28cyclictest0-21swapper/018:04:280
2958199844,26cyclictest0-21swapper/018:34:140
2958199823,21cyclictest0-21swapper/017:35:420
29581998229,46cyclictest2652-21grep16:59:300
29581998221,8cyclictest1419-21runrttasks17:27:360
2958199814,29cyclictest0-21swapper/017:54:380
2958199814,29cyclictest0-21swapper/017:54:380
2958199813,7cyclictest11599-21sadc17:19:160
2958199804,26cyclictest0-21swapper/018:19:140
2958199803,25cyclictest31506-21grep16:49:500
2958199794,28cyclictest0-21swapper/017:29:330
29581997924,8cyclictest18452-21tune2fs18:39:310
29581997924,8cyclictest18452-21tune2fs18:39:310
2958199777,10cyclictest0-21swapper/017:04:280
2958199765,15cyclictest0-21swapper/017:19:530
29581997520,8cyclictest1419-21runrttasks17:42:540
151812750,5chrt15182-21if_err_eth017:24:372
29585996512,46cyclictest13488-21gzip21:44:363
29585996416,41cyclictest27023-21hwlatdetect18:54:343
29585996316,41cyclictest15715-21needreboot19:24:373
2958399634,42cyclictest0-21swapper/120:34:351
29585996211,44cyclictest0-21swapper/320:13:163
248599620,5rtkit-daemon29832-21users19:44:441
29585996114,40cyclictest17407-21fschecks_time17:29:353
29584996110,35cyclictest0-21swapper/221:37:542
248599610,6rtkit-daemon0-21swapper/020:16:281
2958599609,28cyclictest28446-21ssh21:19:293
29585996012,42cyclictest0-21swapper/320:34:163
29585996011,43cyclictest0-21swapper/319:49:223
2958499603,50cyclictest0-21swapper/220:35:022
195782603,11sleep20-21swapper/217:34:342
57802593,10sleep10-21swapper/120:45:021
57802593,10sleep10-21swapper/120:45:021
2958599598,45cyclictest0-21swapper/321:27:173
2958599598,45cyclictest0-21swapper/321:27:173
29585995915,37cyclictest8854-21turbostat20:04:103
29585995915,37cyclictest8854-21turbostat20:04:103
29585995910,42cyclictest28581-21munin-node19:44:273
2958599586,46cyclictest0-21swapper/321:10:333
2958599586,45cyclictest0-21swapper/318:49:563
2958599584,48cyclictest0-21swapper/322:00:093
29585995820,32cyclictest7690-21runrttasks19:14:143
29585995815,36cyclictest25096-21ssh21:14:283
29585995813,27cyclictest25454-21gltestperf19:39:323
29585995813,15cyclictest0-21swapper/319:06:143
29585995812,40cyclictest0-21swapper/320:32:463
29585995811,40cyclictest0-21swapper/322:17:533
29585995811,40cyclictest0-21swapper/321:04:393
29585995810,42cyclictest0-21swapper/320:18:283
29583995825,15cyclictest0-21swapper/119:59:371
29583995825,15cyclictest0-21swapper/119:59:371
275512583,9sleep127645-21cpuspeed21:19:201
14462583,11sleep10-21swapper/121:29:001
14462583,11sleep10-21swapper/121:29:001
92972574,43sleep20-21swapper/221:39:252
4002573,7sleep1540-21perl22:14:221
2958599579,31cyclictest0-21swapper/320:19:393
2958599572,21cyclictest0-21swapper/320:52:573
29585995717,33cyclictest4663-21grep20:44:273
29585995717,33cyclictest4663-21grep20:44:273
29585995710,41cyclictest0-21swapper/320:26:263
2958499573,47cyclictest0-21swapper/219:39:412
2958399578,37cyclictest0-21swapper/119:35:071
2958399574,36cyclictest0-21swapper/119:42:241
248599570,5rtkit-daemon18575-21strings21:04:341
248599570,4rtkit-daemon20481-21strings20:19:351
2958599565,45cyclictest0-21swapper/321:42:173
29585995617,12cyclictest14309-21tr20:59:203
29585995615,17cyclictest4653-21seq21:32:533
29585995614,23cyclictest121850irq/46-eth021:49:263
29585995610,39cyclictest0-21swapper/319:09:233
2958499564,45cyclictest0-21swapper/221:19:312
29584995619,30cyclictest25933-21cstates22:04:212
29584995619,30cyclictest25933-21cstates22:04:212
248599560,3rtkit-daemon22331-21diskmemload20:57:261
248599560,13rtkit-daemon2484-21rtkit-daemon18:29:471
227482563,12sleep10-21swapper/121:59:231
193222563,8sleep11287-21snmpd19:29:401
150572564,11sleep20-21swapper/219:24:292
41132553,12sleep10-21swapper/121:30:571
323662554,43sleep20-21swapper/217:59:452
2958599558,37cyclictest0-21swapper/318:34:343
2958599555,45cyclictest0-21swapper/319:34:433
29585995540,10cyclictest19674-21gltestperf21:54:253
29585995514,33cyclictest0-21swapper/321:35:003
29585995511,39cyclictest0-21swapper/319:20:113
29585995511,39cyclictest0-21swapper/319:20:113
29585995511,37cyclictest11832-21munin-node17:19:433
2958499553,44cyclictest8099-21cpuspeed_turbos19:14:262
2958499553,43cyclictest30673-21unixbench_multi22:09:402
259842553,46sleep126128-21df_inode22:04:231
259842553,46sleep126128-21df_inode22:04:231
248599550,4rtkit-daemon22331-21diskmemload19:21:381
248599550,4rtkit-daemon22331-21diskmemload19:21:381
202722554,13sleep20-21swapper/221:54:362
71652543,10sleep10-21swapper/119:13:151
2958599548,40cyclictest0-21swapper/320:54:243
2958599545,12cyclictest0-21swapper/319:58:533
29585995413,35cyclictest0-21swapper/319:02:503
29585995411,35cyclictest3368-21ssh20:43:303
2958399545,35cyclictest0-21swapper/121:11:461
2958399544,25cyclictest0-21swapper/117:14:281
248599540,4rtkit-daemon32179-21ssh19:02:011
248599540,4rtkit-daemon1985-21strings19:04:381
248599540,4rtkit-daemon16239-21ssh21:01:111
248599540,4rtkit-daemon1287-21snmpd17:35:421
248599540,3rtkit-daemon25170-21ssh18:52:091
179462543,10sleep10-21swapper/121:52:051
17082542,21sleep20-21swapper/219:53:032
313732533,43sleep10-21swapper/119:49:231
2958599537,41cyclictest0-21swapper/317:54:283
2958599537,41cyclictest0-21swapper/317:54:283
29585995316,32cyclictest31950-21runrttasks22:13:563
29585995315,16cyclictest9057-21grep18:19:333
29585995314,13cyclictest0-21swapper/319:31:483
29585995310,35cyclictest25488-21ssh22:04:073
29585995310,35cyclictest25488-21ssh22:04:073
2958499534,42cyclictest0-21swapper/219:34:222
29584995332,14cyclictest0-21swapper/220:39:372
2958399536,33cyclictest0-21swapper/119:59:031
2958399535,15cyclictest0-21swapper/120:49:451
2958399535,14cyclictest0-21swapper/120:40:401
2958399535,14cyclictest0-21swapper/118:54:561
2958399534,34cyclictest0-21swapper/119:24:351
120462532,10sleep20-21swapper/220:54:382
119952532,9sleep20-21swapper/221:44:122
2958599529,35cyclictest30953-21munin-node17:59:263
29585995210,35cyclictest0-21swapper/320:07:243
29584995237,9cyclictest281ktimersoftd/220:19:322
29584995237,9cyclictest1822-21aten_r1power_en21:29:182
2958499523,43cyclictest0-21swapper/220:13:102
2958499523,42cyclictest0-21swapper/220:16:142
2958499523,41cyclictest0-21swapper/220:04:422
2958399527,28cyclictest0-21swapper/121:44:061
2958399525,15cyclictest0-21swapper/121:15:151
2958399524,31cyclictest0-21swapper/120:04:461
2958399524,29cyclictest0-21swapper/121:44:181
2958399524,28cyclictest0-21swapper/120:34:091
294952524,42sleep00-21swapper/016:48:370
76702512,42sleep20-21swapper/218:15:172
308912512,10sleep20-21swapper/219:48:362
2958599517,36cyclictest11597-21sh17:19:163
29585995134,11cyclictest11479-21sed18:24:333
29585995113,31cyclictest0-21swapper/318:08:223
2958499518,37cyclictest281ktimersoftd/218:54:352
2958499518,36cyclictest6101-21grep19:09:452
2958499516,26cyclictest0-21swapper/220:29:412
2958499514,11cyclictest0-21swapper/219:04:272
29584995134,11cyclictest7808-21tune2fs17:09:342
29584995134,11cyclictest7808-21tune2fs17:09:342
29584995132,13cyclictest0-21swapper/219:29:232
2958399515,28cyclictest0-21swapper/121:54:381
2958399515,13cyclictest0-21swapper/119:17:501
2958399514,28cyclictest0-21swapper/120:24:261
29583995121,24cyclictest12844-21cut20:09:231
248599510,5rtkit-daemon2484-21rtkit-daemon22:14:232
248599510,5rtkit-daemon2484-21rtkit-daemon21:49:322
248599510,5rtkit-daemon2484-21rtkit-daemon21:26:102
248599510,5rtkit-daemon2484-21rtkit-daemon21:26:102
248599510,4rtkit-daemon2484-21rtkit-daemon18:35:021
184922513,41sleep10-21swapper/117:30:461
162472513,12sleep10-21swapper/117:27:401
308222502,10sleep20-21swapper/216:49:402
2958599509,34cyclictest20174-21munin-node18:44:403
2958599505,38cyclictest3166-21gltestperf16:59:363
29584995034,10cyclictest4151-21cpuspeed_turbos20:44:222
29584995034,10cyclictest4151-21cpuspeed_turbos20:44:222
29584995034,10cyclictest32537-21tr16:54:302
29584995029,8cyclictest8218-21munin-node18:19:402
2958399505,27cyclictest0-21swapper/118:24:381
2958399505,27cyclictest0-21swapper/116:59:421
2958399504,28cyclictest0-21swapper/122:09:391
2958399504,28cyclictest0-21swapper/117:04:341
2958399504,28cyclictest0-21swapper/116:54:471
2958399504,25cyclictest0-21swapper/121:35:411
256182503,11sleep10-21swapper/117:45:091
166822502,10sleep20-21swapper/221:02:492
137202503,10sleep10-21swapper/117:20:541
2958599494,26cyclictest0-21swapper/316:54:523
2958499499,34cyclictest0-21swapper/221:14:072
2958499494,27cyclictest0-21swapper/217:49:272
29584994930,13cyclictest0-21swapper/220:24:242
2958499493,40cyclictest0-21swapper/221:14:342
29584994928,8cyclictest24746-21ssh18:50:462
29584994921,12cyclictest0-21swapper/218:34:132
29584994921,12cyclictest0-21swapper/217:19:472
29584994918,12cyclictest0-21swapper/218:09:152
2958399494,27cyclictest0-21swapper/118:39:441
2958399494,27cyclictest0-21swapper/118:39:441
2958399494,27cyclictest0-21swapper/117:59:361
2958399494,26cyclictest0-21swapper/118:24:141
2958399493,39cyclictest0-21swapper/118:04:261
282292493,10sleep10-21swapper/117:53:031
248599490,5rtkit-daemon2484-21rtkit-daemon21:59:242
174162492,9sleep20-21swapper/218:37:452
111192490,6chrt0-21swapper/219:19:242
111192490,6chrt0-21swapper/219:19:242
29585994829,12cyclictest7548-21unixbench_multi18:14:483
29585994827,16cyclictest0-21swapper/317:45:413
29585994818,13cyclictest0-21swapper/317:27:113
2958499484,37cyclictest0-21swapper/219:59:442
2958499484,37cyclictest0-21swapper/219:59:442
29584994829,13cyclictest0-21swapper/219:01:362
29584994827,8cyclictest3444-21munin-node18:09:362
29584994826,8cyclictest19274-21ssh21:04:592
29584994821,12cyclictest0-21swapper/219:54:202
29584994816,26cyclictest10668-21aten_r1power_fr18:24:262
29583994818,13cyclictest0-21swapper/116:49:341
76942473,38sleep10-21swapper/118:15:361
53042473,11sleep10-21swapper/118:10:321
2958599479,31cyclictest6605-21sshd17:06:283
2958599479,24cyclictest0-21swapper/316:49:293
2958599476,33cyclictest7187-21telnet17:09:283
2958599476,33cyclictest7187-21telnet17:09:283
2958599476,25cyclictest20940-21sshd17:36:333
29585994727,13cyclictest22230-21gltestperf17:39:343
29584994730,9cyclictest22196-21grep17:39:342
2958399474,25cyclictest29351-21fschecks_time17:54:361
2958399474,25cyclictest29351-21fschecks_time17:54:361
235182473,11sleep10-21swapper/117:43:521
2958599465,26cyclictest0-21swapper/317:49:413
2958599464,25cyclictest0-21swapper/318:09:263
29585994630,10cyclictest14079-21cat18:29:383
29584994630,10cyclictest23911-21aten2.4-expect17:44:272
2958499463,39cyclictest0-21swapper/217:04:462
2958399464,26cyclictest0-21swapper/117:10:381
2958399464,26cyclictest0-21swapper/117:10:381
29585994521,15cyclictest19636-21runrttasks18:40:193
29585994521,15cyclictest19636-21runrttasks18:40:193
29584994529,10cyclictest10248-21grep17:14:362
2958399456,25cyclictest0-21swapper/118:45:541
29584994419,19cyclictest1419-21runrttasks17:32:172
306542432,35sleep20-21swapper/217:58:322
306542432,35sleep20-21swapper/217:58:322
2958499433,33cyclictest0-21swapper/218:44:332
248599420,4rtkit-daemon2484-21rtkit-daemon16:49:141
2958499413,32cyclictest0-21swapper/216:59:282
198382413,32sleep20-21swapper/218:42:572
198382413,32sleep20-21swapper/218:42:572
2958599368,22cyclictest0-21swapper/316:49:173
29584993321,7cyclictest29711-21latency_hist16:49:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional