You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 04:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sat Nov 22, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
219602970,4sleep3361ktimersoftd/320:49:463
3202699934,63cyclictest0-21swapper/219:44:382
3202699934,12cyclictest0-21swapper/220:19:462
3202699924,64cyclictest0-21swapper/219:41:352
3202699894,61cyclictest0-21swapper/223:59:282
3202699885,13cyclictest0-21swapper/222:54:082
3202699884,66cyclictest0-21swapper/220:54:332
3202699875,12cyclictest0-21swapper/219:36:042
3202699874,63cyclictest0-21swapper/222:04:222
3202699874,59cyclictest0-21swapper/222:09:272
3202699865,12cyclictest0-21swapper/222:56:392
3202699865,12cyclictest0-21swapper/222:56:392
3202699864,66cyclictest0-21swapper/221:14:352
3202699864,58cyclictest0-21swapper/200:24:322
32026998616,62cyclictest0-21swapper/222:19:092
32026998616,62cyclictest0-21swapper/222:19:092
18452860,3sleep041ktimersoftd/020:09:370
3202699854,57cyclictest0-21swapper/219:29:522
3202699854,13cyclictest0-21swapper/200:19:172
3202699848,9cyclictest7150irq/45-ahci20:34:372
3202699844,63cyclictest0-21swapper/220:24:352
3202699844,62cyclictest0-21swapper/220:29:232
3202699844,58cyclictest0-21swapper/222:29:222
3202699843,61cyclictest0-21swapper/219:26:472
3202699834,64cyclictest0-21swapper/221:33:352
3202699834,62cyclictest0-21swapper/223:24:212
3202699834,12cyclictest0-21swapper/219:19:402
3202699833,65cyclictest0-21swapper/223:21:442
3202699833,63cyclictest0-21swapper/220:14:252
3202699833,58cyclictest0-21swapper/223:39:162
3202699833,58cyclictest0-21swapper/223:39:162
3202699824,63cyclictest0-21swapper/221:09:312
3202699824,63cyclictest0-21swapper/219:59:272
3202699824,63cyclictest0-21swapper/219:59:272
3202699824,61cyclictest0-21swapper/219:14:482
3202699824,61cyclictest0-21swapper/219:14:482
3202699824,58cyclictest0-21swapper/221:49:112
3202699824,55cyclictest0-21swapper/221:04:362
3202699824,12cyclictest0-21swapper/221:24:452
3202699824,11cyclictest0-21swapper/221:54:102
32026998219,45cyclictest22295-21yum-updatesd-he20:53:372
32026998214,53cyclictest0-21swapper/222:24:402
3202699814,61cyclictest0-21swapper/221:40:392
3202699814,56cyclictest0-21swapper/220:41:162
3202699814,18cyclictest0-21swapper/223:29:292
3202699813,57cyclictest0-21swapper/223:49:412
3202699804,60cyclictest0-21swapper/219:49:302
3202699804,58cyclictest0-21swapper/219:54:272
3202699804,58cyclictest0-21swapper/219:54:272
3202699804,15cyclictest0-21swapper/222:36:362
3202699804,12cyclictest0-21swapper/219:04:172
3202699795,14cyclictest0-21swapper/220:09:512
3202699794,15cyclictest0-21swapper/223:54:262
3202699794,14cyclictest0-21swapper/200:09:172
3202699794,13cyclictest0-21swapper/222:44:252
32026997916,6cyclictest0-21swapper/221:59:382
3202699784,58cyclictest0-21swapper/223:44:172
3202699784,57cyclictest0-21swapper/221:34:212
3202699784,56cyclictest0-21swapper/223:35:182
3202699784,17cyclictest0-21swapper/220:48:582
3202699784,13cyclictest0-21swapper/219:04:472
3202699784,12cyclictest0-21swapper/223:14:082
32026997811,8cyclictest114550irq/46-eth019:09:302
3202699774,55cyclictest0-21swapper/223:04:082
3202699774,55cyclictest0-21swapper/221:54:242
3202699773,57cyclictest0-21swapper/222:19:222
3202699773,20cyclictest0-21swapper/200:14:162
32026997713,10cyclictest25682-21fschecks_count20:59:312
3202699763,12cyclictest17744-21head00:04:312
32026997515,43cyclictest0-21swapper/223:06:412
3202699734,12cyclictest0-21swapper/223:14:102
3202699734,12cyclictest0-21swapper/222:39:422
32026997321,45cyclictest31890-21sh20:04:342
32026997317,49cyclictest3103-21grep21:19:322
3202699724,13cyclictest0-21swapper/218:59:172
243799630,5rtkit-daemon2436-21rtkit-daemon22:57:540
243799630,5rtkit-daemon2436-21rtkit-daemon22:57:540
49792620,13sleep03202199cyclictest20:14:450
142662593,49sleep00-21swapper/021:44:260
32025995840,13cyclictest0-21swapper/123:54:391
32027995736,13cyclictest30246-21grep22:14:423
32027995736,13cyclictest30246-21grep22:14:423
32027995715,21cyclictest0-21swapper/322:29:223
32025995741,12cyclictest0-21swapper/119:04:471
32027995627,10cyclictest16631-21grep20:39:373
244302563,10sleep10-21swapper/120:55:011
243799560,6rtkit-daemon2436-21rtkit-daemon20:29:300
137482563,11sleep30-21swapper/321:41:263
3202799557,28cyclictest0-21swapper/321:14:253
32025995539,12cyclictest0-21swapper/119:44:451
3202199553,46cyclictest0-21swapper/020:19:190
243799550,6rtkit-daemon2436-21rtkit-daemon23:29:230
243799550,6rtkit-daemon2436-21rtkit-daemon22:29:330
243799550,6rtkit-daemon2436-21rtkit-daemon21:24:280
243799550,6rtkit-daemon2436-21rtkit-daemon21:14:430
243799550,5rtkit-daemon2436-21rtkit-daemon22:44:320
243799550,5rtkit-daemon2436-21rtkit-daemon21:54:340
98592543,10sleep00-21swapper/021:34:260
3202799544,26cyclictest0-21swapper/321:46:343
32027995439,9cyclictest16039-21sed19:29:543
3202599545,42cyclictest0-21swapper/121:19:261
32025995437,12cyclictest0-21swapper/122:41:321
32025995429,8cyclictest32065-21cat18:59:171
32021995427,12cyclictest0-21swapper/000:24:350
243799540,6rtkit-daemon2436-21rtkit-daemon22:09:260
243799540,6rtkit-daemon2436-21rtkit-daemon20:59:440
243799540,6rtkit-daemon2436-21rtkit-daemon20:39:440
243799540,5rtkit-daemon2436-21rtkit-daemon22:49:320
243799540,5rtkit-daemon2436-21rtkit-daemon22:24:400
180012544,12sleep00-21swapper/021:49:410
78822533,10sleep30-21swapper/322:38:133
3202799534,27cyclictest0-21swapper/323:41:403
3202799534,27cyclictest0-21swapper/323:41:403
32027995336,10cyclictest2621-21tr21:19:273
32027995321,13cyclictest0-21swapper/322:04:283
32027995321,13cyclictest0-21swapper/319:39:303
3202799532,45cyclictest0-21swapper/320:11:393
3202599535,41cyclictest0-21swapper/120:34:271
3202599534,26cyclictest0-21swapper/123:48:391
32025995336,12cyclictest0-21swapper/123:24:221
32025995333,14cyclictest0-21swapper/119:14:521
32025995333,14cyclictest0-21swapper/119:14:521
247912533,10sleep00-21swapper/022:04:330
243799530,5rtkit-daemon2436-21rtkit-daemon23:14:230
243799530,5rtkit-daemon2436-21rtkit-daemon23:09:240
243799530,5rtkit-daemon2436-21rtkit-daemon21:43:050
243799530,5rtkit-daemon2436-21rtkit-daemon20:54:440
209932532,10sleep00-21swapper/019:41:400
198572532,44sleep00-21swapper/023:03:290
178582532,7sleep017944-21processes00:04:350
3202799525,25cyclictest0-21swapper/319:59:253
3202799525,25cyclictest0-21swapper/319:59:253
3202799524,29cyclictest0-21swapper/323:29:243
3202799524,29cyclictest0-21swapper/323:09:353
3202799524,29cyclictest0-21swapper/321:49:433
3202799524,29cyclictest0-21swapper/319:14:323
3202799524,29cyclictest0-21swapper/319:14:323
3202799524,29cyclictest0-21swapper/319:04:343
3202799524,28cyclictest0-21swapper/323:54:073
3202799524,28cyclictest0-21swapper/322:49:393
3202799524,28cyclictest0-21swapper/320:19:433
3202799524,26cyclictest0-21swapper/300:00:233
3202799524,25cyclictest0-21swapper/320:14:253
32027995235,11cyclictest12075-21cut23:54:203
32027995234,10cyclictest30004-21cut23:24:213
32027995220,13cyclictest0-21swapper/322:19:263
32027995220,13cyclictest0-21swapper/319:44:363
32027995210,25cyclictest1618-21nscd23:49:063
32025995238,9cyclictest854-21latency18:59:391
3202599523,12cyclictest0-21swapper/123:19:361
32025995226,20cyclictest0-21swapper/120:46:171
32025995226,12cyclictest0-21swapper/120:52:411
32025995224,11cyclictest6940-21cat23:44:071
32025995222,9cyclictest14090-21cat19:29:171
250712523,43sleep125147-21processes22:04:381
243799520,5rtkit-daemon2436-21rtkit-daemon22:39:250
243799520,5rtkit-daemon2436-21rtkit-daemon21:09:430
243799520,5rtkit-daemon2436-21rtkit-daemon20:44:370
243799520,5rtkit-daemon2436-21rtkit-daemon20:34:450
224412522,9sleep122521-21missed_timers21:59:341
19432522,43sleep00-21swapper/019:03:390
114242522,43sleep00-21swapper/019:21:210
78352513,10sleep10-21swapper/122:37:351
3202799514,30cyclictest0-21swapper/320:59:143
3202799514,29cyclictest0-21swapper/320:29:413
3202799514,28cyclictest0-21swapper/323:14:303
3202799514,28cyclictest0-21swapper/322:24:373
3202799514,28cyclictest0-21swapper/321:59:433
3202799514,28cyclictest0-21swapper/320:24:433
3202799514,28cyclictest0-21swapper/319:54:403
3202799514,28cyclictest0-21swapper/319:54:403
3202799514,28cyclictest0-21swapper/300:19:413
3202799514,28cyclictest0-21swapper/300:04:293
3202799514,26cyclictest0-21swapper/321:29:233
3202799513,29cyclictest0-21swapper/300:09:313
32027995120,12cyclictest0-21swapper/321:04:313
3202599515,39cyclictest0-21swapper/123:49:231
3202599514,41cyclictest0-21swapper/121:04:111
32025995135,11cyclictest0-21swapper/121:34:341
32025995132,13cyclictest0-21swapper/119:09:301
32025995125,20cyclictest0-21swapper/120:40:201
32025995124,8cyclictest18857-21cat21:54:101
243799510,6rtkit-daemon2436-21rtkit-daemon23:09:090
243799510,5rtkit-daemon2436-21rtkit-daemon21:59:410
243799510,5rtkit-daemon2436-21rtkit-daemon20:24:300
233872512,42sleep00-21swapper/019:46:480
17122512,10sleep30-21swapper/319:00:443
138282512,43sleep00-21swapper/023:58:020
3202799504,28cyclictest0-21swapper/323:04:363
3202799504,28cyclictest0-21swapper/321:24:363
3202799504,26cyclictest0-21swapper/321:34:213
3202799504,26cyclictest0-21swapper/319:09:353
32027995034,10cyclictest17102-21tail22:54:403
32027995034,10cyclictest17102-21tail22:54:403
32027995019,13cyclictest0-21swapper/323:34:423
32027995017,12cyclictest0-21swapper/319:50:353
3202599505,39cyclictest0-21swapper/119:54:281
3202599505,39cyclictest0-21swapper/119:54:281
3202599504,40cyclictest0-21swapper/119:34:161
3202599504,39cyclictest0-21swapper/122:29:091
3202599504,39cyclictest0-21swapper/119:39:351
32025995033,12cyclictest0-21swapper/123:59:411
32025995033,12cyclictest0-21swapper/120:09:291
32025995032,12cyclictest29049-21munin-node21:04:471
3202599503,40cyclictest0-21swapper/120:04:341
32025995024,21cyclictest0-21swapper/100:11:541
32025995023,21cyclictest32091-21munin-node23:29:361
32021995032,11cyclictest0-21swapper/000:14:150
243799500,5rtkit-daemon2436-21rtkit-daemon22:23:550
3202799494,27cyclictest0-21swapper/322:49:083
3202799494,27cyclictest0-21swapper/321:12:353
3202799494,27cyclictest0-21swapper/300:14:273
3202799494,25cyclictest26669-21sed20:59:453
32027994931,11cyclictest19918-21hwlatdetect21:54:303
32027994923,8cyclictest28242-21munin-run00:29:043
32027994917,14cyclictest0-21swapper/320:44:343
32027994916,13cyclictest0-21swapper/319:34:443
3202599494,28cyclictest0-21swapper/123:04:341
32025994932,10cyclictest26084-21munin-node00:24:321
32025994925,19cyclictest0-21swapper/120:33:421
32021994916,29cyclictest0-21swapper/020:49:390
198672493,10sleep30-21swapper/323:03:363
89072483,10sleep00-21swapper/021:30:310
67162483,39sleep00-21swapper/019:12:100
54672483,10sleep10-21swapper/120:17:001
3202799484,26cyclictest0-21swapper/319:28:363
32027994817,13cyclictest0-21swapper/323:19:363
32025994831,13cyclictest0-21swapper/122:54:401
32025994831,13cyclictest0-21swapper/122:54:401
32025994830,13cyclictest0-21swapper/121:09:241
32025994830,12cyclictest0-21swapper/121:29:341
3202599483,40cyclictest0-21swapper/122:19:361
32025994829,13cyclictest0-21swapper/122:29:411
32021994828,9cyclictest0-21swapper/019:29:330
32021994825,11cyclictest0-21swapper/020:04:340
32021994825,11cyclictest0-21swapper/019:34:270
32021994823,20cyclictest0-21swapper/023:39:180
32021994823,20cyclictest0-21swapper/023:39:180
317002482,10sleep00-21swapper/023:27:190
208672482,40sleep00-21swapper/000:11:290
102732483,10sleep10-21swapper/120:27:281
43502472,39sleep00-21swapper/021:23:180
42762472,9sleep00-21swapper/019:06:300
3202799473,22cyclictest0-21swapper/320:04:253
3202599474,37cyclictest0-21swapper/123:14:081
3202599474,37cyclictest0-21swapper/100:04:361
32025994730,12cyclictest0-21swapper/120:19:361
32025994730,12cyclictest0-21swapper/119:59:451
32025994730,12cyclictest0-21swapper/119:59:451
32025994727,11cyclictest12322-21df_abs21:39:271
304832473,38sleep10-21swapper/122:16:311
304832473,38sleep10-21swapper/122:16:311
291452472,39sleep00-21swapper/023:20:060
262522473,36sleep10-21swapper/122:09:211
257352473,10sleep10-21swapper/119:51:001
255892474,37sleep10-21swapper/100:20:491
243799470,5rtkit-daemon2436-21rtkit-daemon22:18:560
243799470,5rtkit-daemon2436-21rtkit-daemon22:18:560
198852473,10sleep10-21swapper/123:03:511
141922472,10sleep30-21swapper/320:34:403
69392462,10sleep00-21swapper/023:44:080
63862463,10sleep10-21swapper/123:39:461
41842463,10sleep00-21swapper/023:37:110
3202799464,12cyclictest0-21swapper/319:19:473
3202599464,35cyclictest0-21swapper/100:14:141
32025994632,8cyclictest3393-21tail23:34:311
3202599463,37cyclictest0-21swapper/122:50:031
3202599463,36cyclictest0-21swapper/119:34:411
32025994629,12cyclictest0-21swapper/123:14:281
32025994627,14cyclictest0-21swapper/122:46:371
32021994626,14cyclictest0-21swapper/019:59:270
32021994626,14cyclictest0-21swapper/019:59:270
32021994623,12cyclictest0-21swapper/019:49:320
32021994623,12cyclictest0-21swapper/019:14:510
32021994623,12cyclictest0-21swapper/019:14:510
32021994621,13cyclictest0-21swapper/019:58:030
32021994621,13cyclictest0-21swapper/019:58:030
16072463,9sleep10-21swapper/121:15:251
114902462,39sleep00-21swapper/023:53:390
3202799454,21cyclictest0-21swapper/322:39:233
3202799454,13cyclictest0-21swapper/322:09:213
3202599454,25cyclictest0-21swapper/121:54:341
32021994531,9cyclictest12564-21tune2fs19:24:330
66912443,10sleep10-21swapper/121:27:421
3202599444,12cyclictest0-21swapper/121:44:441
32025994422,9cyclictest0-21swapper/119:19:341
3202199443,25cyclictest0-21swapper/018:59:180
32021994429,11cyclictest0-21swapper/021:04:250
32021994422,10cyclictest0-21swapper/000:20:230
3202199442,37cyclictest0-21swapper/023:59:350
3202199424,34cyclictest0-21swapper/022:34:230
3202799404,30cyclictest0-21swapper/318:59:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional