You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 18:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Apr 11, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2707599300,30cyclictest0-21swapper/312:07:253
2706599261,24cyclictest62550irq/127-eno109:26:570
2706599260,25cyclictest21601-21diskmemload10:05:080
2706599260,25cyclictest0-21swapper/012:15:450
27075992524,1cyclictest34-21ksoftirqd/310:22:213
2707099250,2cyclictest6316-21cron12:35:002
2707099250,24cyclictest21601-21diskmemload10:26:202
2707099250,24cyclictest0-21swapper/212:39:212
27067992525,0cyclictest0-21swapper/110:41:301
2706799250,24cyclictest0-21swapper/109:36:111
2706599250,24cyclictest28665-21cron10:20:010
2706599250,24cyclictest21601-21diskmemload10:24:280
2706599250,24cyclictest0-21swapper/012:11:290
2706599250,24cyclictest0-21swapper/011:37:330
2706599250,24cyclictest0-21swapper/011:03:410
27075992423,1cyclictest34-21ksoftirqd/311:03:593
27075992422,1cyclictest9816-21apt-get08:49:203
2707599240,23cyclictest34-21ksoftirqd/309:16:093
2707599240,23cyclictest0-21swapper/311:40:553
27070992423,1cyclictest5038-21diskmemload11:30:442
27070992423,1cyclictest21601-21diskmemload12:11:022
27070992422,1cyclictest5105-21ssh09:57:552
2707099240,23cyclictest21601-21diskmemload09:15:132
2707099240,23cyclictest15006-21sh10:07:172
2707099240,0cyclictest0-21swapper/209:25:052
27067992422,1cyclictest0-21swapper/110:18:421
2706799240,23cyclictest9028-21diskmemload12:06:301
2706799240,23cyclictest14517-21cron11:40:001
2706599240,24cyclictest0-21swapper/010:50:200
2706599240,23cyclictest21963-21sh09:42:490
2706599240,23cyclictest21601-21diskmemload10:40:340
2706599240,23cyclictest0-21swapper/009:37:160
2706599240,22cyclictest313-21systemd-journal09:00:010
2706599240,1cyclictest28711-21ssh12:25:020
2706599240,0cyclictest21601-21diskmemload11:54:460
27075992323,0cyclictest21601-21diskmemload11:07:553
27075992323,0cyclictest0-21swapper/310:56:383
27075992323,0cyclictest0-21swapper/310:18:513
27075992323,0cyclictest0-21swapper/310:07:413
27075992323,0cyclictest0-21swapper/309:42:123
27075992323,0cyclictest0-21swapper/309:27:513
27075992321,1cyclictest5727-21apt-get12:04:213
27075992321,1cyclictest0-21swapper/312:24:263
27075992321,1cyclictest0-21swapper/311:31:513
27075992321,1cyclictest0-21swapper/310:32:103
27075992320,2cyclictest1649-21cron08:05:013
2707599230,23cyclictest21601-21diskmemload12:32:443
2707599230,23cyclictest21601-21diskmemload10:35:033
2707599230,23cyclictest0-21swapper/311:21:283
2707599230,23cyclictest0-21swapper/310:25:203
2707599230,23cyclictest0-21swapper/309:56:173
2707599230,22cyclictest805-21sh09:21:433
2707599230,22cyclictest606-21dbus-daemon08:25:003
2707599230,22cyclictest22228-21rm11:48:393
2707599230,22cyclictest21601-21diskmemload12:36:303
2707599230,22cyclictest21601-21diskmemload11:15:363
2707599230,22cyclictest21601-21diskmemload09:47:173
2707599230,22cyclictest20136-21ssh10:12:193
2707599230,22cyclictest19194-21grep08:00:013
2707599230,22cyclictest11968-21ssh09:33:153
27070992323,0cyclictest21601-21diskmemload10:45:242
27070992323,0cyclictest21601-21diskmemload10:42:012
27070992323,0cyclictest0-21swapper/211:26:142
27070992323,0cyclictest0-21swapper/211:06:392
27070992323,0cyclictest0-21swapper/210:58:582
27070992321,1cyclictest0-21swapper/208:40:012
27070992320,2cyclictest30778-21ssh12:28:162
27070992320,2cyclictest26706-21apt09:15:002
27070992320,2cyclictest1900-21basename07:25:002
27070992318,4cyclictest0-21swapper/211:54:512
2707099230,2cyclictest25648-21ssh09:45:242
2707099230,23cyclictest0-21swapper/210:50:412
2707099230,22cyclictest606-21dbus-daemon10:40:002
2707099230,22cyclictest26218-21ssh12:24:192
2707099230,22cyclictest21601-21diskmemload09:42:502
2707099230,22cyclictest10189-21ssh09:30:202
2707099230,22cyclictest0-21swapper/211:40:502
2707099230,0cyclictest0-21swapper/212:07:412
2707099230,0cyclictest0-21swapper/211:45:462
27067992323,0cyclictest0-21swapper/112:25:081
27067992323,0cyclictest0-21swapper/111:42:361
27067992323,0cyclictest0-21swapper/111:03:521
27067992323,0cyclictest0-21swapper/110:28:461
27067992323,0cyclictest0-21swapper/110:14:431
27067992323,0cyclictest0-21swapper/109:45:071
27067992323,0cyclictest0-21swapper/109:34:401
27067992323,0cyclictest0-21swapper/109:13:251
27067992321,1cyclictest12576-21ssh11:07:041
27067992321,1cyclictest0-21swapper/112:30:341
27067992321,1cyclictest0-21swapper/111:34:531
2706799230,2cyclictest27229-21perf10:50:001
2706799230,23cyclictest0-21swapper/110:01:151
2706799230,23cyclictest0-21swapper/109:20:271
2706799230,22cyclictest29132-21tail11:54:271
2706799230,22cyclictest28027-21ssh09:16:471
2706799230,22cyclictest21878-21ssh11:15:371
2706799230,22cyclictest1969-21sh11:29:111
2706799230,22cyclictest18625-21ssh12:15:201
2706799230,22cyclictest16740-21sh11:10:341
2706799230,1cyclictest26262-21apt-get12:24:201
2706799230,0cyclictest0-21swapper/112:00:391
2706799230,0cyclictest0-21swapper/111:20:071
2706799230,0cyclictest0-21swapper/110:20:281
27065992323,0cyclictest21601-21diskmemload12:20:130
27065992323,0cyclictest0-21swapper/009:52:240
27065992322,1cyclictest62550irq/127-eno109:20:120
27065992322,0cyclictest21601-21diskmemload09:10:310
27065992321,1cyclictest21837-21ssh11:15:340
27065992321,1cyclictest0-21swapper/011:30:130
27065992321,1cyclictest0-21swapper/010:58:270
27065992321,1cyclictest0-21swapper/010:14:330
27065992320,2cyclictest391-21diskmemload11:26:350
2706599230,22cyclictest0-21swapper/011:44:120
2706599230,22cyclictest0-21swapper/010:49:120
2706599230,22cyclictest0-21swapper/010:30:260
2706599230,22cyclictest0-21swapper/009:55:300
2706599230,22cyclictest0-21swapper/009:30:440
2706599230,0cyclictest0-21swapper/012:00:200
2706599230,0cyclictest0-21swapper/011:11:150
27075992222,0cyclictest0-21swapper/310:46:273
27075992221,1cyclictest34-21ksoftirqd/308:55:013
27075992220,1cyclictest34-21ksoftirqd/307:40:003
27075992220,1cyclictest0-21swapper/311:35:373
27075992220,1cyclictest0-21swapper/311:25:383
27075992220,1cyclictest0-21swapper/309:50:213
2707599220,22cyclictest34-21ksoftirqd/311:58:083
2707599220,22cyclictest0-21swapper/312:10:463
2707599220,21cyclictest28568-21sh10:51:053
2707599220,21cyclictest21601-21diskmemload10:00:433
2707599220,21cyclictest0-21swapper/312:15:473
2707599220,21cyclictest0-21swapper/311:50:023
2707599220,21cyclictest0-21swapper/310:40:243
2707599220,21cyclictest0-21swapper/309:36:083
2707599220,1cyclictest0-21swapper/312:25:323
27070992222,0cyclictest21601-21diskmemload12:16:522
27070992222,0cyclictest21601-21diskmemload12:01:112
27070992222,0cyclictest21601-21diskmemload10:31:552
27070992222,0cyclictest0-21swapper/210:20:242
27070992222,0cyclictest0-21swapper/210:18:182
27070992222,0cyclictest0-21swapper/210:10:542
27070992221,1cyclictest9694-21sh11:35:072
27070992221,0cyclictest0-21swapper/208:10:042
27070992220,2cyclictest17473-21ssh09:38:542
27070992220,1cyclictest1110-21ssh09:22:172
27070992220,1cyclictest0-21swapper/208:50:012
27070992219,2cyclictest29567-21dump-pmu-power08:20:002
27070992219,2cyclictest14350-21cron07:50:002
27070992219,0cyclictest0-21swapper/211:03:012
27070992217,4cyclictest30376-21ssh11:55:212
2707099220,21cyclictest9525-21ssh10:01:462
2707099220,21cyclictest32045-21awk08:25:002
2707099220,21cyclictest22454-21ssh11:16:292
2707099220,21cyclictest0-21swapper/211:10:532
2707099220,21cyclictest0-21swapper/209:50:222
27067992222,0cyclictest0-21swapper/110:33:461
27067992222,0cyclictest0-21swapper/109:50:211
27067992222,0cyclictest0-21swapper/109:40:101
27067992220,1cyclictest4284-21idleruntime-cro07:30:001
27067992220,1cyclictest13248-21ssh12:10:331
27067992220,1cyclictest0-21swapper/107:59:211
2706799220,22cyclictest14797-21ssh10:39:211
2706799220,22cyclictest0-21swapper/110:52:081
2706799220,21cyclictest20251-21ssh11:45:341
2706799220,21cyclictest0-21swapper/110:57:481
2706799220,21cyclictest0-21swapper/109:55:571
2706799220,21cyclictest0-21swapper/109:25:011
2706799220,21cyclictest0-21swapper/108:19:191
2706799220,21cyclictest0-21swapper/107:39:201
2706799220,1cyclictest32490-21apt-get07:24:201
2706799220,1cyclictest23970-21turbostat08:10:011
27065992222,0cyclictest21601-21diskmemload10:35:180
27065992222,0cyclictest0-21swapper/011:55:180
27065992220,1cyclictest0-21swapper/011:08:570
27065992220,1cyclictest0-21swapper/008:34:210
2706599220,22cyclictest0-21swapper/011:20:020
2706599220,21cyclictest8981-21ssh10:00:490
2706599220,21cyclictest0-21swapper/012:05:280
2706599220,21cyclictest0-21swapper/009:48:110
2706599220,21cyclictest0-21swapper/007:35:020
2706599220,1cyclictest0-21swapper/012:31:350
2706599220,1cyclictest0-21swapper/011:47:500
2706599220,0cyclictest0-21swapper/012:36:430
27075992121,0cyclictest0-21swapper/311:10:023
27075992120,0cyclictest0-21swapper/308:34:213
27075992119,2cyclictest34-21ksoftirqd/307:19:213
2707599210,21cyclictest0-21swapper/308:09:213
2707599210,20cyclictest0-21swapper/309:10:373
2707599210,20cyclictest0-21swapper/308:29:223
2707599210,20cyclictest0-21swapper/307:14:203
2707599210,1cyclictest5008-21apt-get08:39:213
27070992120,1cyclictest19780-21apt-get08:04:212
27070992120,0cyclictest0-21swapper/208:44:212
27070992119,1cyclictest606-21dbus-daemon07:35:002
2707099210,20cyclictest2613-21apt-get08:34:202
2707099210,20cyclictest2471-21apt-get07:29:202
2707099210,1cyclictest26796-21sh11:20:102
2707099210,1cyclictest0-21swapper/207:39:212
27067992120,0cyclictest30073-21apt-get07:19:211
2706799210,21cyclictest0-21swapper/111:55:141
2706799210,20cyclictest4871-21apt-get07:34:201
2706799210,20cyclictest0-21swapper/108:49:201
2706799210,20cyclictest0-21swapper/108:24:211
2706799210,0cyclictest7425-21apt-get08:44:211
27065992121,0cyclictest0-21swapper/007:14:200
27065992120,0cyclictest0-21swapper/007:29:200
27065992119,1cyclictest0-21swapper/008:15:020
27065992118,2cyclictest31869-21cron07:20:010
2706599210,21cyclictest0-21swapper/009:15:530
2706599210,0cyclictest0-21swapper/010:26:400
27075992020,0cyclictest0-21swapper/309:09:213
2707599200,6cyclictest0-21swapper/307:25:053
27070992020,0cyclictest0-21swapper/209:04:202
27070992019,1cyclictest0-21swapper/207:44:222
27070992019,0cyclictest0-21swapper/208:29:222
2707099200,0cyclictest22174-21apt-get08:09:212
2707099200,0cyclictest17365-21apt-get07:59:212
27065992020,0cyclictest0-21swapper/009:00:020
27065992020,0cyclictest0-21swapper/008:44:210
27065992020,0cyclictest0-21swapper/008:39:200
27065992020,0cyclictest0-21swapper/008:14:220
2706599200,19cyclictest0-21swapper/008:29:220
2706599200,0cyclictest12213-21apt-get08:54:200
27075991919,0cyclictest0-21swapper/308:14:223
27075991919,0cyclictest0-21swapper/307:24:203
2707599190,0cyclictest0-21swapper/307:54:223
27067991919,0cyclictest0-21swapper/108:59:211
2706799190,0cyclictest0-21swapper/109:04:201
27065991919,0cyclictest0-21swapper/007:49:210
27065991919,0cyclictest0-21swapper/007:44:220
27075991817,1cyclictest34-21ksoftirqd/307:43:443
27075991816,2cyclictest0-21swapper/309:04:203
27067991818,0cyclictest0-21swapper/108:39:211
27067991817,1cyclictest10182-21apt-get07:44:221
2706599180,9cyclictest0-21swapper/007:59:210
2707599173,13cyclictest34-21ksoftirqd/308:44:213
27070991717,0cyclictest27621-21apt-get07:14:202
27070991717,0cyclictest0-21swapper/208:54:202
27067991717,0cyclictest24967-21apt-get08:14:221
27067991717,0cyclictest0-21swapper/108:54:201
27065991715,1cyclictest21605-21ssh09:10:000
27075991616,0cyclictest0-21swapper/308:59:213
27067991616,0cyclictest0-21swapper/107:14:201
27067991615,1cyclictest12573-21apt-get07:49:211
27065991616,0cyclictest0-21swapper/008:09:210
27075991515,0cyclictest26776-21apt-get08:15:023
27075991515,0cyclictest0-21swapper/307:34:203
27065991515,0cyclictest0-21swapper/007:34:200
27065991514,1cyclictest13-21ksoftirqd/007:54:570
2707599140,14cyclictest0-21swapper/307:47:153
2707099140,14cyclictest0-21swapper/209:05:062
2707099140,14cyclictest0-21swapper/208:55:472
2707099140,14cyclictest0-21swapper/207:50:122
27067991414,0cyclictest0-21swapper/108:30:021
27067991414,0cyclictest0-21swapper/107:51:281
2706799140,14cyclictest0-21swapper/108:00:481
27065991414,0cyclictest0-21swapper/008:45:420
27065991414,0cyclictest0-21swapper/008:00:530
2706599140,14cyclictest0-21swapper/007:20:590
2706599140,0cyclictest0-21swapper/008:20:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional