You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 21:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Thu Nov 27, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2437991020,6rtkit-daemon0-21swapper/312:22:031
1139699954,27cyclictest0-21swapper/012:13:550
1139699934,28cyclictest0-21swapper/008:44:250
1139699924,28cyclictest0-21swapper/011:24:200
1139699924,28cyclictest0-21swapper/011:24:200
1139699924,28cyclictest0-21swapper/010:14:130
243799910,4rtkit-daemon2436-21rtkit-daemon10:04:161
1139699914,27cyclictest0-21swapper/011:59:190
1139699905,13cyclictest0-21swapper/011:13:420
1139699904,27cyclictest0-21swapper/008:49:350
11396999017,26cyclictest0-21swapper/008:19:370
1139699894,27cyclictest0-21swapper/010:13:300
11396998931,10cyclictest10178-21kernelversion09:04:260
1139699884,27cyclictest0-21swapper/007:54:200
1139699864,28cyclictest0-21swapper/011:14:180
11396998621,13cyclictest0-21swapper/008:54:360
1139699854,28cyclictest0-21swapper/007:24:190
1139699844,28cyclictest0-21swapper/008:29:370
1139699844,28cyclictest0-21swapper/008:29:370
1139699814,27cyclictest0-21swapper/009:54:280
1139699814,27cyclictest0-21swapper/009:54:280
183962790,6sleep318393-21grep10:29:213
243799710,21rtkit-daemon12666-21kernelversion06:54:310
183572710,5sleep318358-21head08:14:233
243799690,7rtkit-daemon0-21swapper/312:20:262
243799670,4rtkit-daemon2436-21rtkit-daemon11:14:211
291462633,12sleep10-21swapper/108:37:561
243799610,4rtkit-daemon26955-21interrupts07:24:301
1139899604,36cyclictest0-21swapper/108:54:141
11400995923,10cyclictest1369-21runrttasks08:11:463
11400995814,10cyclictest1901-21Xorg10:24:133
152542574,45sleep30-21swapper/311:29:283
11398995738,12cyclictest19090-21cpuspeed_turbos07:09:191
307312563,8sleep130858-21cpuspeed_turbos12:04:081
307312563,8sleep130858-21cpuspeed_turbos12:04:081
243799560,6rtkit-daemon0-21swapper/010:45:521
243799560,5rtkit-daemon2436-21rtkit-daemon09:49:240
243799550,8rtkit-daemon0-21swapper/212:21:183
243799550,7rtkit-daemon2436-21rtkit-daemon07:42:360
243799550,6rtkit-daemon2436-21rtkit-daemon12:04:190
243799550,6rtkit-daemon2436-21rtkit-daemon12:04:190
243799550,6rtkit-daemon2436-21rtkit-daemon07:06:380
243799550,6rtkit-daemon2436-21rtkit-daemon07:06:380
243799550,5rtkit-daemon2436-21rtkit-daemon10:34:220
243799550,5rtkit-daemon2436-21rtkit-daemon09:19:180
243799550,5rtkit-daemon2436-21rtkit-daemon08:39:190
1140099554,43cyclictest2627-21sshd12:11:273
11400995516,23cyclictest0-21swapper/312:08:543
11400995516,23cyclictest0-21swapper/312:08:543
11398995523,13cyclictest0-21swapper/109:34:231
243799540,6rtkit-daemon2436-21rtkit-daemon12:14:560
243799540,6rtkit-daemon2436-21rtkit-daemon11:19:050
243799540,6rtkit-daemon2436-21rtkit-daemon09:43:240
243799540,6rtkit-daemon2436-21rtkit-daemon09:01:110
243799540,6rtkit-daemon2436-21rtkit-daemon08:26:350
243799540,6rtkit-daemon2436-21rtkit-daemon07:49:290
243799540,6rtkit-daemon2436-21rtkit-daemon07:38:370
243799540,5rtkit-daemon2436-21rtkit-daemon11:43:120
243799540,5rtkit-daemon2436-21rtkit-daemon11:04:130
243799540,5rtkit-daemon2436-21rtkit-daemon09:29:020
243799540,5rtkit-daemon2436-21rtkit-daemon08:06:350
243799540,5rtkit-daemon2436-21rtkit-daemon08:02:430
243799540,5rtkit-daemon2436-21rtkit-daemon07:45:360
243799540,5rtkit-daemon2436-21rtkit-daemon07:45:360
243799540,4rtkit-daemon2436-21rtkit-daemon08:35:340
1140099545,13cyclictest0-21swapper/306:56:063
1139999544,43cyclictest0-21swapper/208:19:252
1139899545,30cyclictest0-21swapper/108:44:031
1139899544,26cyclictest0-21swapper/111:49:061
11398995436,10cyclictest30022-21unixbench_multi07:29:381
243799530,6rtkit-daemon2436-21rtkit-daemon11:55:260
243799530,6rtkit-daemon2436-21rtkit-daemon11:46:040
243799530,6rtkit-daemon2436-21rtkit-daemon09:10:030
243799530,6rtkit-daemon2436-21rtkit-daemon09:10:030
243799530,5rtkit-daemon2436-21rtkit-daemon12:19:110
243799530,5rtkit-daemon2436-21rtkit-daemon11:34:120
243799530,5rtkit-daemon2436-21rtkit-daemon11:32:570
243799530,5rtkit-daemon2436-21rtkit-daemon11:01:590
243799530,5rtkit-daemon2436-21rtkit-daemon10:54:590
243799530,5rtkit-daemon2436-21rtkit-daemon10:52:510
243799530,5rtkit-daemon2436-21rtkit-daemon10:48:140
243799530,5rtkit-daemon2436-21rtkit-daemon10:39:140
243799530,5rtkit-daemon2436-21rtkit-daemon10:39:140
243799530,5rtkit-daemon2436-21rtkit-daemon10:29:450
243799530,5rtkit-daemon2436-21rtkit-daemon10:26:070
243799530,5rtkit-daemon2436-21rtkit-daemon10:22:000
243799530,5rtkit-daemon2436-21rtkit-daemon10:05:230
243799530,5rtkit-daemon2436-21rtkit-daemon09:59:310
243799530,5rtkit-daemon2436-21rtkit-daemon09:44:090
243799530,5rtkit-daemon2436-21rtkit-daemon09:34:320
243799530,5rtkit-daemon2436-21rtkit-daemon09:29:400
243799530,5rtkit-daemon2436-21rtkit-daemon08:15:500
243799530,5rtkit-daemon2436-21rtkit-daemon08:09:350
243799530,5rtkit-daemon2436-21rtkit-daemon07:29:440
243799530,5rtkit-daemon2436-21rtkit-daemon07:19:520
243799530,5rtkit-daemon2436-21rtkit-daemon07:10:000
243799530,5rtkit-daemon2436-21rtkit-daemon07:00:230
231532532,44sleep00-21swapper/007:17:050
139482533,7sleep313972-21sh10:19:273
1140099534,12cyclictest0-21swapper/309:49:013
11400995339,9cyclictest27957-21sed08:34:243
1140099533,25cyclictest0-21swapper/308:59:133
1139899534,12cyclictest0-21swapper/111:33:471
11398995333,12cyclictest26172-21tr11:54:101
11398995321,14cyclictest0-21swapper/108:44:231
302842522,44sleep20-21swapper/207:31:422
243799520,4rtkit-daemon2436-21rtkit-daemon11:49:490
243799520,4rtkit-daemon2436-21rtkit-daemon09:14:550
243799520,4rtkit-daemon20541-21taskset11:41:051
11400995224,10cyclictest29184-21idleruntime-cro10:53:583
11400995224,10cyclictest26986-21cat08:34:043
11400995224,10cyclictest26986-21cat08:34:043
1139899525,28cyclictest0-21swapper/111:24:301
1139899525,28cyclictest0-21swapper/111:24:301
1139899525,28cyclictest0-21swapper/108:14:221
1139899525,28cyclictest0-21swapper/107:19:281
1139899525,28cyclictest0-21swapper/107:14:331
1139899524,29cyclictest0-21swapper/110:14:191
1139899524,29cyclictest0-21swapper/108:59:211
1139899524,29cyclictest0-21swapper/107:59:281
1139899524,29cyclictest0-21swapper/106:59:401
1139899524,28cyclictest0-21swapper/110:29:201
1139899524,24cyclictest0-21swapper/109:24:131
11398995221,24cyclictest5087-21sshd12:17:261
98782513,41sleep10-21swapper/107:55:431
255322512,10sleep30-21swapper/307:21:563
241682512,9sleep30-21swapper/310:41:073
241682512,9sleep30-21swapper/310:41:073
210922513,8sleep321173-21aten2.4-expect09:29:133
155662513,41sleep215696-21unixbench_singl09:14:372
13942512,9sleep20-21swapper/208:46:192
1140099514,27cyclictest0-21swapper/308:49:043
11400995116,29cyclictest21217-21cut07:14:173
11399995135,10cyclictest13121-21grep08:04:162
1139899514,29cyclictest0-21swapper/111:44:181
1139899514,29cyclictest0-21swapper/111:09:201
1139899514,29cyclictest0-21swapper/110:49:091
1139899514,29cyclictest0-21swapper/110:09:211
1139899514,29cyclictest0-21swapper/108:19:211
1139899514,28cyclictest0-21swapper/110:24:101
1139899514,28cyclictest0-21swapper/108:49:201
1139899514,28cyclictest0-21swapper/108:29:351
1139899514,28cyclictest0-21swapper/108:29:351
11398995136,9cyclictest3560-21tr07:44:171
11398995136,9cyclictest3560-21tr07:44:171
11398995119,13cyclictest0-21swapper/107:49:151
51672503,9sleep20-21swapper/210:02:252
311002503,11sleep20-21swapper/207:34:242
29892502,41sleep30-21swapper/308:49:233
1140099505,28cyclictest0-21swapper/310:59:143
1140099505,27cyclictest0-21swapper/309:04:363
1140099505,27cyclictest0-21swapper/307:48:383
1140099505,27cyclictest0-21swapper/307:48:383
1140099504,32cyclictest0-21swapper/306:59:373
1139999504,40cyclictest0-21swapper/210:14:232
1139999503,23cyclictest0-21swapper/211:26:532
1139999503,23cyclictest0-21swapper/211:26:532
11399995022,20cyclictest1369-21runrttasks08:43:302
11399995010,34cyclictest0-21swapper/208:09:142
1139899505,26cyclictest0-21swapper/111:59:281
1139899505,11cyclictest0-21swapper/108:07:511
1139899504,28cyclictest0-21swapper/112:09:101
1139899504,28cyclictest0-21swapper/110:59:321
1139899504,28cyclictest0-21swapper/110:19:291
1139899504,28cyclictest0-21swapper/109:44:171
1139899504,28cyclictest0-21swapper/109:04:241
1139899504,28cyclictest0-21swapper/107:34:301
53192492,9sleep20-21swapper/207:48:312
53192492,9sleep20-21swapper/207:48:312
279042492,9sleep30-21swapper/309:42:393
185082492,9sleep30-21swapper/307:08:463
185082492,9sleep30-21swapper/307:08:463
169042492,9sleep20-21swapper/210:24:502
134632492,9sleep20-21swapper/206:55:142
1140099495,27cyclictest0-21swapper/311:58:523
1140099495,26cyclictest0-21swapper/312:14:253
1140099495,26cyclictest0-21swapper/307:54:233
1140099495,26cyclictest0-21swapper/307:27:073
1140099494,28cyclictest0-21swapper/311:14:283
11400994928,16cyclictest0-21swapper/310:44:113
11400994919,10cyclictest4065-21awk11:08:573
11399994933,9cyclictest3862-21tail12:14:142
1139899495,26cyclictest0-21swapper/110:43:371
1139899495,26cyclictest0-21swapper/110:43:371
1139899494,28cyclictest0-21swapper/107:39:341
1139899494,28cyclictest0-21swapper/107:04:231
1139899494,28cyclictest0-21swapper/107:04:231
1139899494,27cyclictest0-21swapper/109:19:341
1139899494,26cyclictest3975-21gltestperf09:59:211
1139899494,26cyclictest0-21swapper/109:29:041
11398994920,13cyclictest0-21swapper/109:14:341
11398994919,11cyclictest12375-21gltestperf09:09:211
11398994919,11cyclictest12375-21gltestperf09:09:211
62982482,40sleep20-21swapper/208:56:072
327582483,9sleep30-21swapper/307:37:523
243799480,5rtkit-daemon2436-21rtkit-daemon11:21:431
231072482,9sleep20-21swapper/209:32:262
219502482,39sleep20-21swapper/210:38:242
182052483,39sleep10-21swapper/111:36:431
1140099485,13cyclictest13496-21sshd09:11:343
1140099485,13cyclictest13496-21sshd09:11:343
1140099484,27cyclictest0-21swapper/310:18:593
11400994827,12cyclictest29896-21df_abs10:54:123
11400994821,11cyclictest0-21swapper/310:09:133
11400994820,11cyclictest0-21swapper/307:29:223
11399994830,13cyclictest0-21swapper/210:59:302
11399994830,12cyclictest8908-21wc07:54:242
11399994820,13cyclictest0-21swapper/208:19:052
11399994819,12cyclictest0-21swapper/208:29:222
11399994819,12cyclictest0-21swapper/208:29:222
1139899486,16cyclictest0-21swapper/109:39:121
1139899485,26cyclictest0-21swapper/110:38:341
1139899485,26cyclictest0-21swapper/108:12:521
1139899484,26cyclictest0-21swapper/108:27:541
230272473,9sleep20-21swapper/211:47:082
147412472,9sleep20-21swapper/210:22:442
1140099475,25cyclictest0-21swapper/311:49:213
11400994730,12cyclictest30324-21tail08:39:223
1140099473,38cyclictest0-21swapper/308:24:233
1140099473,26cyclictest0-21swapper/309:29:023
11400994727,11cyclictest31002-21cpuspeed_turbos09:49:163
11400994719,9cyclictest12538-21munin-plugin-st08:04:053
1139999473,26cyclictest0-21swapper/209:19:212
11399994713,14cyclictest0-21swapper/208:26:172
11398994731,10cyclictest13383-21grep06:54:411
11398994730,10cyclictest30296-21gltestperf10:54:161
1139699474,35cyclictest0-21swapper/006:54:080
63762462,9sleep30-21swapper/308:57:083
51732462,38sleep30-21swapper/310:02:303
289512463,9sleep20-21swapper/208:35:232
277982462,9sleep20-21swapper/211:57:002
240582462,9sleep20-21swapper/210:39:412
240582462,9sleep20-21swapper/210:39:412
219702462,9sleep30-21swapper/308:22:463
18312462,10sleep30-21swapper/309:54:283
18312462,10sleep30-21swapper/309:54:283
1140099464,36cyclictest23472-21munin-node09:34:233
1140099464,25cyclictest0-21swapper/311:24:083
1140099464,25cyclictest0-21swapper/311:24:083
1140099464,25cyclictest0-21swapper/309:14:323
1140099464,25cyclictest0-21swapper/307:52:443
11400994632,8cyclictest22688-21unixbench_multi11:44:273
11400994625,15cyclictest0-21swapper/309:19:233
1139999463,36cyclictest0-21swapper/209:14:012
1139999463,36cyclictest0-21swapper/209:14:012
1139999463,25cyclictest0-21swapper/207:59:362
11399994624,9cyclictest14123-21telnet06:59:192
1139999462,39cyclictest0-21swapper/210:29:182
11399994618,12cyclictest0-21swapper/211:34:122
11398994617,13cyclictest0-21swapper/109:58:271
11398994617,13cyclictest0-21swapper/109:58:271
111952462,9sleep20-21swapper/211:23:462
97532452,37sleep20-21swapper/210:09:582
84642452,9sleep20-21swapper/211:14:312
325462452,36sleep20-21swapper/209:50:402
3232453,36sleep10-21swapper/109:53:531
29442453,9sleep20-21swapper/207:43:592
28632453,9sleep30-21swapper/307:42:563
11400994531,9cyclictest20033-21fgrep11:39:263
11400994530,9cyclictest5557-21tail10:04:113
11400994528,11cyclictest2449-21metacity11:59:533
11400994527,11cyclictest20877-21kernelversion10:34:213
1139999455,35cyclictest0-21swapper/211:59:172
1139999453,38cyclictest0-21swapper/211:29:442
1139999453,38cyclictest0-21swapper/210:44:252
1139999453,36cyclictest1369-21runrttasks07:15:392
1139999453,25cyclictest0-21swapper/207:26:392
111892452,9sleep20-21swapper/209:07:392
111332453,6sleep10-21swapper/106:51:071
62592442,9sleep20-21swapper/211:11:372
253782442,9sleep20-21swapper/211:51:312
11400994427,11cyclictest5083-21fschecks_time11:09:193
11400994426,12cyclictest0-21swapper/311:38:573
11399994431,8cyclictest18969-21grep11:39:102
1139999443,36cyclictest0-21swapper/209:24:282
1139999443,35cyclictest0-21swapper/209:47:132
1139999442,38cyclictest0-21swapper/210:52:272
11399994419,8cyclictest29418-21munin-node10:54:082
11399994419,19cyclictest6328-21gltestperf10:04:192
1139899444,34cyclictest0-21swapper/111:04:281
278512432,9sleep20-21swapper/209:41:572
148472432,34sleep30-21swapper/308:08:153
1139999433,35cyclictest0-21swapper/209:34:342
1139999433,34cyclictest0-21swapper/209:54:332
1139999433,34cyclictest0-21swapper/209:54:332
1139999433,34cyclictest0-21swapper/208:59:202
1139999433,24cyclictest0-21swapper/207:19:182
111692433,9sleep30-21swapper/311:23:273
1140099422,23cyclictest0-21swapper/307:09:183
1139999423,32cyclictest0-21swapper/212:04:062
1139999423,32cyclictest0-21swapper/212:04:062
1139999423,32cyclictest0-21swapper/207:09:082
11399994215,22cyclictest1618-21nscd07:49:292
183632412,33sleep20-21swapper/207:06:512
1139999413,33cyclictest0-21swapper/212:09:222
1139999413,10cyclictest0-21swapper/211:04:332
11399994123,12cyclictest0-21swapper/207:12:442
11399994120,8cyclictest3722-21unixbench_singl08:49:332
111872414,30sleep30-21swapper/306:51:493
112732305,19sleep20-21swapper/206:52:572
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional