You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 13:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Mon May 11, 2026 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
283491960,86ptp4l0-21swapper/107:05:091
94080940,78rtkit-daemon0-21swapper/007:05:380
3003027153,9sleep40-21swapper/407:09:146
2995126958,9sleep70-21swapper/707:08:069
2992926856,10sleep110-21swapper/1107:07:453
2988226756,9sleep50-21swapper/507:07:037
2979326654,10sleep100-21swapper/1007:05:452
2984126554,9sleep60-21swapper/607:06:288
60072510,0sleep10-21swapper/107:15:231
234002490,0sleep60-21swapper/608:20:228
3044199239,13cyclictest0-21swapper/708:26:529
3042799202,13cyclictest0-21swapper/411:10:016
283491200,0ptp4l0-21swapper/111:30:231
92642190,0sleep10-21swapper/112:15:171
3044199173,9cyclictest0-21swapper/707:20:019
3044199172,11cyclictest14468-21kworker/u24:212:30:009
30432991715,1cyclictest0-21swapper/509:59:597
283491170,1ptp4l21-21ksoftirqd/111:15:151
137592170,1sleep10-21swapper/111:40:151
3044199161,12cyclictest25490-21kworker/u24:110:35:009
3040399163,8cyclictest0-21swapper/008:20:000
3040399162,8cyclictest0-21swapper/012:35:000
3040399162,8cyclictest0-21swapper/007:25:000
298852167,7sleep80-21swapper/807:07:0710
283491160,1ptp4l21-21ksoftirqd/108:45:171
283491160,1ptp4l21-21ksoftirqd/108:40:001
283491160,0ptp4l0-21swapper/111:50:141
3046099153,8cyclictest0-21swapper/1109:20:003
3046099152,9cyclictest0-21swapper/1111:10:253
3046099152,8cyclictest0-21swapper/1108:45:013
3044199153,7cyclictest0-21swapper/708:15:009
3044199152,8cyclictest0-21swapper/711:45:019
3044199152,7cyclictest0-21swapper/711:04:599
3040399153,7cyclictest0-21swapper/009:14:310
283491150,0ptp4l0-21swapper/110:20:001
283491150,0ptp4l0-21swapper/109:20:211
14242150,1sleep3321rcuc/310:40:235
3046099142,8cyclictest0-21swapper/1108:00:013
3046099141,8cyclictest0-21swapper/1110:20:003
3044199142,7cyclictest0-21swapper/709:10:259
3044199142,7cyclictest0-21swapper/707:40:019
30441991411,2cyclictest0-21swapper/712:00:179
3043699141,8cyclictest0-21swapper/611:00:018
3043299142,8cyclictest0-21swapper/507:15:007
3043299142,7cyclictest0-21swapper/507:20:017
3040399143,7cyclictest0-21swapper/008:10:010
3040399141,7cyclictest0-21swapper/009:20:010
283491140,1ptp4l21-21ksoftirqd/112:25:161
283491140,1ptp4l21-21ksoftirqd/111:55:181
283491140,0ptp4l0-21swapper/110:00:211
279902140,0sleep110-21swapper/1109:50:263
3044199132,7cyclictest5841-21kworker/u24:112:40:019
3044199132,7cyclictest0-21swapper/708:20:249
3044199132,6cyclictest0-21swapper/707:40:259
3044199132,6cyclictest0-21swapper/707:30:249
3043699134,6cyclictest0-21swapper/607:30:008
3043299132,8cyclictest0-21swapper/510:05:007
3040399132,7cyclictest0-21swapper/011:00:230
3040399132,6cyclictest0-21swapper/010:30:240
283491130,1ptp4l21-21ksoftirqd/112:32:571
283491130,1ptp4l21-21ksoftirqd/109:55:191
283491130,1ptp4l21-21ksoftirqd/109:45:151
283491130,1ptp4l21-21ksoftirqd/108:08:051
283491130,1ptp4l21-21ksoftirqd/107:57:171
283491130,1ptp4l11163-21aten2_r3power_c07:25:111
283491130,0ptp4l0-21swapper/111:20:231
283491130,0ptp4l0-21swapper/111:05:241
283491130,0ptp4l0-21swapper/110:10:201
283491130,0ptp4l0-21swapper/109:50:151
264691130,0getstats0-21swapper/212:15:114
3046099122,6cyclictest0-21swapper/1110:40:003
3045499122,6cyclictest0-21swapper/1010:20:242
3045499120,1cyclictest0-21swapper/1008:00:222
3045099122,6cyclictest0-21swapper/908:35:0011
3044199122,6cyclictest0-21swapper/710:50:259
3043699123,5cyclictest0-21swapper/611:50:018
3043299129,3cyclictest0-21swapper/510:25:197
3043299124,7cyclictest0-21swapper/512:36:067
3043299120,11cyclictest22460-21irqrtprio08:20:177
3042799122,7cyclictest0-21swapper/407:10:246
3042799122,6cyclictest0-21swapper/411:35:016
3042799121,6cyclictest0-21swapper/407:35:006
298182126,5sleep90-21swapper/907:06:0811
283491120,4ptp4l21-21ksoftirqd/108:30:131
283491120,3ptp4l31208-21sort07:50:141
283491120,1ptp4l21-21ksoftirqd/110:55:161
283491120,1ptp4l21-21ksoftirqd/109:26:011
283491120,1ptp4l21-21ksoftirqd/109:00:241
283491120,0ptp4l0-21swapper/110:37:091
283491120,0ptp4l0-21swapper/110:25:211
283491120,0ptp4l0-21swapper/109:30:191
283491120,0ptp4l0-21swapper/108:10:361
21792120,0sleep20-21swapper/209:20:014
3045099112,6cyclictest0-21swapper/912:20:0011
3045099112,6cyclictest0-21swapper/909:25:0011
3045099112,5cyclictest0-21swapper/908:10:0011
3045099110,10cyclictest8073-21cpuspeed08:45:1311
3044599118,2cyclictest0-21swapper/812:30:2710
3044199118,2cyclictest0-21swapper/708:50:129
3044199112,5cyclictest0-21swapper/712:05:009
3043699111,6cyclictest17292-21kworker/u24:109:10:008
3042799111,6cyclictest0-21swapper/411:20:006
3042199119,1cyclictest0-21swapper/307:15:005
30415991110,1cyclictest0-21swapper/212:09:274
3040799112,1cyclictest31813-21grep10:40:111
3040399113,2cyclictest6840-21cstates09:25:130
3040399113,2cyclictest12665-21if_err_enp1s012:20:170
3040399112,3cyclictest30180-21cut11:20:130
3040399110,7cyclictest0-21swapper/009:40:070
3040399110,1cyclictest0-21swapper/008:05:230
283491110,2ptp4l4885-21sed10:45:191
283491110,2ptp4l31308-21cpuspeed_turbos09:15:171
283491110,2ptp4l17132-21ls11:00:231
283491110,1ptp4l21-21ksoftirqd/111:25:181
283491110,1ptp4l0-21swapper/108:50:111
283491110,0ptp4l0-21swapper/112:05:251
283491110,0ptp4l0-21swapper/110:20:221
283491110,0ptp4l0-21swapper/109:35:141
283491110,0ptp4l0-21swapper/108:25:231
283491110,0ptp4l0-21swapper/108:20:141
283491110,0ptp4l0-21swapper/108:03:301
264691110,0getstats0-21swapper/210:00:104
221462110,0sleep100-21swapper/1009:45:112
3046099100,3cyclictest21827-21taskset07:36:243
3045099103,4cyclictest0-21swapper/912:00:0011
3045099100,6cyclictest0-21swapper/907:50:0011
3044599100,1cyclictest0-21swapper/811:15:2610
3043699102,6cyclictest0-21swapper/608:50:028
3043699102,5cyclictest0-21swapper/610:10:018
3043699102,5cyclictest0-21swapper/608:20:008
3043699100,9cyclictest31400-21cut09:55:218
3043699100,2cyclictest10643-21munin-run07:25:008
3043299100,9cyclictest10879-21latency_hist07:25:017
3042799107,2cyclictest9020-21turbostat08:05:006
3042799102,5cyclictest0-21swapper/408:15:016
3042199100,9cyclictest0-21swapper/311:20:245
3042199100,1cyclictest0-21swapper/310:55:135
3041599107,2cyclictest29971-21df09:55:134
3041599107,2cyclictest19129-21diskstats11:05:154
3040799101,6cyclictest0-21swapper/108:45:011
3040399104,2cyclictest24622-21cpuspeed_turbos11:55:120
3040399104,2cyclictest1009-21runrttasks07:38:130
3040399103,2cyclictest16664-21cstates10:20:140
3040399101,3cyclictest0-21swapper/011:25:160
3040399100,7cyclictest0-21swapper/012:25:120
3040399100,7cyclictest0-21swapper/010:27:250
3040399100,7cyclictest0-21swapper/010:11:280
3040399100,7cyclictest0-21swapper/009:35:260
3040399100,6cyclictest0-21swapper/010:42:360
3040399100,6cyclictest0-21swapper/010:02:520
3040399100,1cyclictest0-21swapper/011:30:150
3040399100,1cyclictest0-21swapper/008:51:070
3040399100,1cyclictest0-21swapper/008:21:460
283491100,2ptp4l8204-21fschecks_count07:20:151
283491100,2ptp4l4772-21/usr/sbin/munin10:05:121
283491100,1ptp4l31730-21cut12:05:001
283491100,1ptp4l24549-21df10:30:131
283491100,1ptp4l24023-21latency11:10:191
283491100,1ptp4l0-21swapper/111:35:141
283491100,1ptp4l0-21swapper/108:15:121
9408090,0rtkit-daemon0-21swapper/611:51:128
9408090,0rtkit-daemon0-21swapper/608:39:398
304609998,1cyclictest0-21swapper/1107:50:153
304609997,1cyclictest0-21swapper/1108:55:233
304609990,8cyclictest0-21swapper/1112:10:123
304609990,1cyclictest0-21swapper/1109:14:293
304609990,1cyclictest0-21swapper/1109:00:133
304609990,1cyclictest0-21swapper/1108:45:173
304549992,5cyclictest0-21swapper/1011:00:002
304549990,9cyclictest0-21swapper/1009:38:062
304509997,1cyclictest0-21swapper/909:30:1811
304509991,5cyclictest0-21swapper/911:09:5911
304509991,5cyclictest0-21swapper/909:15:0111
304459998,1cyclictest0-21swapper/812:35:1910
304459998,1cyclictest0-21swapper/810:40:1110
304459998,1cyclictest0-21swapper/808:00:2010
304459997,1cyclictest0-21swapper/807:15:0110
304459990,9cyclictest0-21swapper/808:40:1910
304459990,1cyclictest0-21swapper/811:00:1510
304419990,8cyclictest18931-21kernelversion08:15:169
304419990,3cyclictest24994-21/usr/sbin/munin11:10:249
304419990,3cyclictest10748-21taskset12:19:509
304369992,5cyclictest0-21swapper/610:15:008
304369992,4cyclictest0-21swapper/612:30:008
304369992,4cyclictest0-21swapper/612:25:248
304369992,4cyclictest0-21swapper/611:35:008
304369992,4cyclictest0-21swapper/609:40:018
304369991,5cyclictest0-21swapper/611:40:008
304369990,8cyclictest0-21swapper/611:15:208
304329998,1cyclictest0-21swapper/512:15:277
304329998,1cyclictest0-21swapper/511:00:187
304329998,1cyclictest0-21swapper/510:49:597
304329992,4cyclictest0-21swapper/507:45:017
304329990,9cyclictest0-21swapper/511:55:227
304279997,1cyclictest0-21swapper/409:40:186
304279990,8cyclictest0-21swapper/411:35:196
304279990,1cyclictest0-21swapper/411:55:256
304219998,1cyclictest0-21swapper/310:49:595
304219998,1cyclictest0-21swapper/309:15:275
304219998,1cyclictest0-21swapper/307:40:005
304219997,1cyclictest0-21swapper/311:35:265
304219997,1cyclictest0-21swapper/308:45:125
304219990,9cyclictest0-21swapper/310:10:195
304219990,9cyclictest0-21swapper/309:20:225
304219990,8cyclictest0-21swapper/311:40:175
304219990,1cyclictest0-21swapper/310:15:175
304219990,1cyclictest0-21swapper/309:50:265
304159990,6cyclictest0-21swapper/212:35:254
304039997,1cyclictest0-21swapper/008:55:230
304039993,2cyclictest19986-21latency_hist11:50:010
304039993,2cyclictest1009-21runrttasks08:31:140
304039992,2cyclictest0-21swapper/009:04:550
304039991,2cyclictest0-21swapper/010:05:040
304039990,8cyclictest2290-21/usr/sbin/munin09:20:240
304039990,6cyclictest0-21swapper/010:47:050
304039990,6cyclictest0-21swapper/010:15:500
304039990,6cyclictest0-21swapper/009:59:490
304039990,6cyclictest0-21swapper/008:00:370
30070292,5sleep30-21swapper/307:09:495
28349190,1ptp4l21-21ksoftirqd/109:40:111
28349190,1ptp4l21-21ksoftirqd/107:10:131
28349190,0ptp4l0-21swapper/112:35:141
28349190,0ptp4l0-21swapper/112:20:001
28349190,0ptp4l0-21swapper/112:10:131
28349190,0ptp4l0-21swapper/111:45:131
28349190,0ptp4l0-21swapper/110:50:141
28349190,0ptp4l0-21swapper/109:10:141
28349190,0ptp4l0-21swapper/109:05:021
28349190,0ptp4l0-21swapper/108:55:011
28349190,0ptp4l0-21swapper/107:45:011
28349190,0ptp4l0-21swapper/107:40:011
28349190,0ptp4l0-21swapper/107:35:111
28349190,0ptp4l0-21swapper/107:30:021
304609987,1cyclictest0-21swapper/1109:30:243
304609987,1cyclictest0-21swapper/1108:05:123
304609980,8cyclictest0-21swapper/1112:15:113
304609980,8cyclictest0-21swapper/1110:10:213
304609980,8cyclictest0-21swapper/1109:25:163
304549987,1cyclictest0-21swapper/1012:20:142
304549987,1cyclictest0-21swapper/1010:45:132
304549987,1cyclictest0-21swapper/1010:30:192
304549987,1cyclictest0-21swapper/1009:50:142
304549987,1cyclictest0-21swapper/1007:35:142
304549985,2cyclictest19990-21turbostat11:49:592
304549980,8cyclictest0-21swapper/1012:16:352
304549980,8cyclictest0-21swapper/1012:05:152
304549980,8cyclictest0-21swapper/1011:55:222
304549980,8cyclictest0-21swapper/1011:15:212
304549980,8cyclictest0-21swapper/1009:40:222
304549980,8cyclictest0-21swapper/1008:55:162
304549980,8cyclictest0-21swapper/1008:05:242
304549980,1cyclictest0-21swapper/1012:00:152
304549980,1cyclictest0-21swapper/1010:40:202
304549980,1cyclictest0-21swapper/1009:05:162
304509987,1cyclictest32545-21fw_forwarded_lo10:40:1411
304509987,1cyclictest0-21swapper/910:55:1311
304509984,3cyclictest32514-21sed11:20:2411
304509980,8cyclictest8376-21strings09:25:1911
304509980,8cyclictest0-21swapper/912:24:5911
304509980,8cyclictest0-21swapper/907:15:1911
304509980,5cyclictest0-21swapper/908:40:0011
304509980,4cyclictest0-21swapper/907:45:0011
304509980,4cyclictest0-21swapper/907:25:0011
304509980,1cyclictest0-21swapper/912:05:0011
304509980,1cyclictest0-21swapper/911:25:1711
304509980,1cyclictest0-21swapper/910:05:1411
304459987,1cyclictest0-21swapper/810:25:1910
304459987,1cyclictest0-21swapper/809:30:2010
304459987,1cyclictest0-21swapper/809:20:1410
304459987,1cyclictest0-21swapper/808:50:1910
304459986,1cyclictest0-21swapper/810:55:2110
304459980,8cyclictest0-21swapper/810:50:1810
304459980,8cyclictest0-21swapper/810:20:2110
304459980,8cyclictest0-21swapper/809:05:2310
304459980,8cyclictest0-21swapper/809:00:2110
304459980,8cyclictest0-21swapper/808:25:2510
304459980,8cyclictest0-21swapper/807:20:1710
304459980,1cyclictest0-21swapper/811:05:1710
304459980,1cyclictest0-21swapper/810:10:5510
304459980,1cyclictest0-21swapper/807:10:2610
304419987,1cyclictest0-21swapper/710:55:259
304419987,1cyclictest0-21swapper/709:57:319
304419982,5cyclictest115650irq/18-p34p112:21:069
304419982,5cyclictest115650irq/18-p34p111:37:449
304419982,5cyclictest115650irq/18-p34p110:46:209
304419982,5cyclictest115650irq/18-p34p110:31:129
304419982,5cyclictest115650irq/18-p34p109:40:139
304419982,5cyclictest115650irq/18-p34p109:20:269
304419980,8cyclictest0-21swapper/710:25:149
304419980,7cyclictest30854-21basename09:15:129
304419980,7cyclictest25093-21memory09:05:189
304419980,7cyclictest0-21swapper/711:50:139
304419980,7cyclictest0-21swapper/710:00:209
304419980,1cyclictest0-21swapper/710:05:179
304419980,1cyclictest0-21swapper/708:30:189
304419980,1cyclictest0-21swapper/707:55:159
304369987,1cyclictest0-21swapper/610:25:158
304369985,2cyclictest30276-21wget07:50:118
304369980,8cyclictest0-21swapper/607:55:198
304369980,4cyclictest0-21swapper/611:25:018
304329987,1cyclictest0-21swapper/512:05:117
304329987,1cyclictest0-21swapper/511:35:247
304329987,1cyclictest0-21swapper/510:55:167
304329987,1cyclictest0-21swapper/510:20:237
304329987,1cyclictest0-21swapper/509:20:247
304329987,1cyclictest0-21swapper/508:15:107
304329982,4cyclictest0-21swapper/510:50:537
304329981,5cyclictest0-21swapper/510:05:017
304329981,5cyclictest0-21swapper/508:55:017
304329981,5cyclictest0-21swapper/508:05:027
304329980,8cyclictest0-21swapper/511:25:167
304329980,8cyclictest0-21swapper/509:15:237
304329980,8cyclictest0-21swapper/508:55:257
304329980,8cyclictest0-21swapper/507:25:147
304329980,5cyclictest14516-21kworker/u24:007:35:007
304279986,1cyclictest0-21swapper/411:53:376
304279980,7cyclictest2337-21latency_hist10:44:596
304279980,7cyclictest0-21swapper/412:15:276
304279980,3cyclictest1147-21idleruntime-cro07:55:006
304279980,1cyclictest0-21swapper/410:10:156
304279980,1cyclictest0-21swapper/408:55:156
304219987,1cyclictest0-21swapper/311:45:195
304219984,3cyclictest15020-21latency_hist08:55:005
304219983,4cyclictest0-21swapper/312:05:015
304219982,4cyclictest0-21swapper/308:05:185
304219980,8cyclictest0-21swapper/311:05:255
304219980,1cyclictest0-21swapper/309:30:125
304219980,1cyclictest0-21swapper/307:55:145
304159987,1cyclictest0-21swapper/211:50:244
304159980,8cyclictest0-21swapper/208:25:144
304159980,8cyclictest0-21swapper/208:13:374
304159980,4cyclictest0-21swapper/207:30:014
304159980,1cyclictest26051-21/usr/sbin/munin11:15:134
304159980,1cyclictest0-21swapper/208:00:124
304039986,1cyclictest0-21swapper/007:45:230
304039985,2cyclictest19990-21turbostat11:54:540
304039985,2cyclictest0-21swapper/012:00:190
304039981,2cyclictest0-21swapper/010:59:490
28359180,2phc2sys24145-21grep10:30:124
304609976,1cyclictest0-21swapper/1112:26:183
304609976,1cyclictest0-21swapper/1112:20:003
304609976,1cyclictest0-21swapper/1112:05:263
304609976,1cyclictest0-21swapper/1111:56:473
304609976,1cyclictest0-21swapper/1111:50:583
304609976,1cyclictest0-21swapper/1111:05:233
304609976,1cyclictest0-21swapper/1109:20:253
304609976,1cyclictest0-21swapper/1108:50:113
304609976,1cyclictest0-21swapper/1108:37:473
304609976,1cyclictest0-21swapper/1108:33:353
304609976,1cyclictest0-21swapper/1108:25:233
304609976,1cyclictest0-21swapper/1108:20:213
304609976,1cyclictest0-21swapper/1107:45:013
304609976,1cyclictest0-21swapper/1107:10:373
304609970,7cyclictest0-21swapper/1112:31:063
304609970,7cyclictest0-21swapper/1111:46:103
304609970,7cyclictest0-21swapper/1111:43:353
304609970,7cyclictest0-21swapper/1111:30:153
304609970,7cyclictest0-21swapper/1111:20:003
304609970,7cyclictest0-21swapper/1111:15:033
304609970,7cyclictest0-21swapper/1110:57:373
304609970,7cyclictest0-21swapper/1110:50:193
304609970,7cyclictest0-21swapper/1110:45:503
304609970,7cyclictest0-21swapper/1110:40:333
304609970,7cyclictest0-21swapper/1110:01:393
304609970,7cyclictest0-21swapper/1109:05:283
304609970,7cyclictest0-21swapper/1107:40:263
304609970,7cyclictest0-21swapper/1107:25:243
304609970,7cyclictest0-21swapper/1107:20:263
304609970,1cyclictest0-21swapper/1112:04:113
304609970,1cyclictest0-21swapper/1111:37:183
304609970,1cyclictest0-21swapper/1111:27:393
304609970,1cyclictest0-21swapper/1111:02:363
304609970,1cyclictest0-21swapper/1110:33:233
304609970,1cyclictest0-21swapper/1110:27:423
304609970,1cyclictest0-21swapper/1110:20:103
304609970,1cyclictest0-21swapper/1110:07:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional