You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-15 - 15:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Mon Jun 15, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2834911000,90ptp4l0-21swapper/107:06:161
1287210088,10sleep100-21swapper/1007:06:142
94080800,75rtkit-daemon0-21swapper/507:06:017
3152627159,9sleep110-21swapper/1107:05:163
124026957,10sleep60-21swapper/607:05:348
140226655,9sleep00-21swapper/007:07:520
129726554,9sleep70-21swapper/707:06:239
125126453,9sleep40-21swapper/407:05:446
8952530,0sleep00-21swapper/012:25:240
92032490,0sleep121-21ksoftirqd/107:15:181
83352480,0sleep00-21swapper/008:40:140
194599253,18cyclictest0-21swapper/411:50:006
1958992310,7cyclictest18154-21taskset10:45:009
197399183,10cyclictest0-21swapper/910:25:2411
197399182,10cyclictest0-21swapper/907:10:0011
195899183,10cyclictest0-21swapper/707:40:009
193699183,10cyclictest0-21swapper/208:35:234
283491170,0ptp4l0-21swapper/110:20:261
197399172,13cyclictest0-21swapper/908:50:1611
195899170,10cyclictest0-21swapper/707:20:009
194099172,10cyclictest0-21swapper/308:40:005
283491160,0ptp4l0-21swapper/111:45:131
283491160,0ptp4l0-21swapper/111:30:181
283491160,0ptp4l0-21swapper/111:15:121
283491160,0ptp4l0-21swapper/107:45:021
197399163,8cyclictest0-21swapper/911:45:0111
197399163,8cyclictest0-21swapper/908:35:0011
195899163,9cyclictest0-21swapper/710:30:009
195899163,8cyclictest0-21swapper/708:30:009
194099163,7cyclictest0-21swapper/307:15:005
14102167,7sleep80-21swapper/807:08:0010
94080150,3rtkit-daemon0-21swapper/1111:18:363
197899154,7cyclictest0-21swapper/1009:15:002
197399153,7cyclictest0-21swapper/908:25:0011
196499150,10cyclictest0-21swapper/809:25:0010
195899154,7cyclictest0-21swapper/709:05:009
195899152,7cyclictest0-21swapper/711:30:019
194999152,8cyclictest0-21swapper/508:55:007
194099152,8cyclictest0-21swapper/310:45:015
194099152,8cyclictest0-21swapper/309:20:005
193099152,8cyclictest0-21swapper/109:05:001
193099152,8cyclictest0-21swapper/108:55:001
193099152,8cyclictest0-21swapper/108:00:001
283491140,0ptp4l0-21swapper/107:35:141
198299142,7cyclictest0-21swapper/1109:45:003
198299142,6cyclictest0-21swapper/1111:05:003
197399142,7cyclictest0-21swapper/912:20:0011
197399142,7cyclictest0-21swapper/908:50:0011
197399142,7cyclictest0-21swapper/907:50:0111
197399141,12cyclictest1015-21kworker/u24:007:30:0011
196499142,7cyclictest0-21swapper/812:00:2510
195899142,7cyclictest0-21swapper/708:40:259
195899140,2cyclictest0-21swapper/707:40:159
194999141,9cyclictest1015-21kworker/u24:008:05:007
193699142,9cyclictest0-21swapper/209:45:004
193099143,7cyclictest0-21swapper/111:40:241
193099142,8cyclictest0-21swapper/111:00:001
193099141,8cyclictest0-21swapper/107:40:001
192499140,1cyclictest0-21swapper/007:40:150
133672140,0sleep110-21swapper/1110:35:233
283491130,0ptp4l0-21swapper/112:10:221
283491130,0ptp4l0-21swapper/112:05:151
283491130,0ptp4l0-21swapper/111:20:551
283491130,0ptp4l0-21swapper/111:00:151
283491130,0ptp4l0-21swapper/109:56:351
283491130,0ptp4l0-21swapper/109:56:351
283491130,0ptp4l0-21swapper/109:54:481
283491130,0ptp4l0-21swapper/109:54:471
283491130,0ptp4l0-21swapper/109:38:451
283491130,0ptp4l0-21swapper/109:15:131
198299132,6cyclictest0-21swapper/1112:20:133
197399132,6cyclictest0-21swapper/912:10:2211
197399132,6cyclictest0-21swapper/907:10:2311
1973991310,2cyclictest5225-21turbostat07:55:0011
196499132,7cyclictest0-21swapper/810:45:0010
196499131,7cyclictest0-21swapper/810:15:1910
194999132,7cyclictest0-21swapper/511:35:017
194999132,7cyclictest0-21swapper/511:15:007
194999132,7cyclictest0-21swapper/507:25:277
193099133,6cyclictest0-21swapper/107:55:001
167662130,0sleep50-21swapper/511:25:117
283491120,3ptp4l23516-21ls12:15:121
283491120,3ptp4l21327-21tr08:15:121
283491120,3ptp4l1686-21irqrtprio08:30:191
283491120,2ptp4l6554-21hddtemp_smartct11:10:141
283491120,2ptp4l28698-21perl10:15:101
283491120,1ptp4l21-21ksoftirqd/111:58:331
283491120,0ptp4l0-21swapper/112:20:011
283491120,0ptp4l0-21swapper/112:00:241
283491120,0ptp4l0-21swapper/111:25:131
283491120,0ptp4l0-21swapper/111:09:181
283491120,0ptp4l0-21swapper/110:30:291
283491120,0ptp4l0-21swapper/109:48:341
283491120,0ptp4l0-21swapper/108:40:251
283491120,0ptp4l0-21swapper/107:55:161
198299122,6cyclictest0-21swapper/1112:30:023
198299121,7cyclictest0-21swapper/1110:50:003
198299121,7cyclictest0-21swapper/1108:30:263
198299121,6cyclictest0-21swapper/1109:35:003
1982991210,1cyclictest0-21swapper/1110:25:013
197399122,6cyclictest0-21swapper/910:45:0111
196499122,6cyclictest0-21swapper/810:45:2410
196499121,7cyclictest12940-21kworker/u24:011:25:0110
196499121,7cyclictest0-21swapper/810:55:2410
196499120,7cyclictest0-21swapper/812:15:2310
1945991210,2cyclictest0-21swapper/411:40:166
194099122,7cyclictest0-21swapper/310:25:015
193699122,6cyclictest0-21swapper/209:10:004
193099122,6cyclictest0-21swapper/108:05:241
28502110,0sleep70-21swapper/707:50:169
283491110,3ptp4l29251-21cstates08:25:131
283491110,1ptp4l15243-21expr10:40:131
283491110,1ptp4l0-21swapper/109:25:001
283491110,1ptp4l0-21swapper/108:15:011
283491110,0ptp4l0-21swapper/108:38:161
283491110,0ptp4l0-21swapper/107:25:161
198299118,2cyclictest2260-21cut12:30:123
196499112,5cyclictest0-21swapper/811:10:0010
196499112,5cyclictest0-21swapper/810:10:0110
196499112,5cyclictest0-21swapper/810:10:0010
195899110,10cyclictest10781-21tail08:00:169
195499119,1cyclictest0-21swapper/611:25:008
195499110,10cyclictest29888-21awk12:25:008
194999111,6cyclictest1015-21kworker/u24:008:55:007
194599115,3cyclictest0-21swapper/410:05:016
194599115,3cyclictest0-21swapper/410:05:006
194099118,2cyclictest31487-21cut11:45:005
194099117,3cyclictest21837-21awk12:10:235
193699112,6cyclictest0-21swapper/211:00:004
193699112,6cyclictest0-21swapper/210:10:004
193699112,6cyclictest0-21swapper/210:10:004
193699112,5cyclictest0-21swapper/211:10:234
193099110,1cyclictest0-21swapper/108:45:221
192842110,0sleep10-21swapper/110:45:141
283491100,2ptp4l32745-21memory09:10:171
283491100,1ptp4l8635-21expr09:30:081
283491100,1ptp4l4622-21grep11:50:131
283491100,1ptp4l25527-21fw_forwarded_lo11:35:161
283491100,1ptp4l23735-21diskstats10:05:141
283491100,1ptp4l23735-21diskstats10:05:131
283491100,1ptp4l23320-21fw_forwarded_lo10:50:141
283491100,1ptp4l2269-21grep12:30:131
283491100,1ptp4l12772-21sed07:20:161
283491100,0ptp4l0-21swapper/112:25:241
283491100,0ptp4l0-21swapper/109:27:311
283491100,0ptp4l0-21swapper/108:20:131
283491100,0ptp4l0-21swapper/107:30:121
198299102,5cyclictest0-21swapper/1111:30:223
198299102,5cyclictest0-21swapper/1108:30:003
197899102,6cyclictest0-21swapper/1009:25:002
197399100,9cyclictest0-21swapper/909:00:2011
195899107,2cyclictest0-21swapper/708:05:149
195499100,9cyclictest20092-21latency_hist11:30:018
195499100,9cyclictest0-21swapper/609:25:008
195499100,2cyclictest0-21swapper/608:50:148
195499100,10cyclictest0-21swapper/607:10:128
194999107,2cyclictest0-21swapper/511:40:157
194999101,7cyclictest2105-21kworker/u24:110:35:007
194999100,9cyclictest31825-21fschecks_time09:10:137
194599104,3cyclictest0-21swapper/412:35:016
194599100,9cyclictest0-21swapper/412:25:136
193699100,9cyclictest9025-21taskset12:37:364
193699100,1cyclictest0-21swapper/212:35:014
193099102,4cyclictest0-21swapper/110:15:001
193099100,5cyclictest0-21swapper/107:10:001
28349190,0ptp4l0-21swapper/112:35:111
28349190,0ptp4l0-21swapper/110:35:011
28349190,0ptp4l0-21swapper/110:25:021
28349190,0ptp4l0-21swapper/110:00:011
28349190,0ptp4l0-21swapper/110:00:011
28349190,0ptp4l0-21swapper/109:40:011
28349190,0ptp4l0-21swapper/109:00:141
28349190,0ptp4l0-21swapper/108:55:111
19829998,1cyclictest0-21swapper/1110:08:543
19829998,1cyclictest0-21swapper/1110:08:543
19829998,1cyclictest0-21swapper/1109:00:143
19829990,9cyclictest0-21swapper/1111:50:143
19789990,9cyclictest0-21swapper/1007:45:242
19739990,9cyclictest0-21swapper/911:15:1611
19739990,8cyclictest0-21swapper/911:30:1111
19589997,1cyclictest0-21swapper/707:15:009
19549998,1cyclictest0-21swapper/610:30:008
19549990,9cyclictest0-21swapper/610:20:258
19549990,8cyclictest357-21fschecks_count11:45:128
19549990,8cyclictest20555-21mailstats09:55:218
19549990,8cyclictest20555-21mailstats09:55:208
19549990,8cyclictest0-21swapper/612:10:118
19549990,8cyclictest0-21swapper/609:30:098
19459998,1cyclictest0-21swapper/407:25:226
19459990,9cyclictest0-21swapper/412:10:126
19459990,9cyclictest0-21swapper/412:00:116
19459990,9cyclictest0-21swapper/410:45:136
19459990,9cyclictest0-21swapper/408:25:176
19459990,1cyclictest0-21swapper/408:40:126
19409997,1cyclictest0-21swapper/309:00:195
19409992,5cyclictest0-21swapper/311:25:005
19409992,4cyclictest0-21swapper/312:25:025
19409991,5cyclictest0-21swapper/307:25:005
19409990,2cyclictest13480-21sed10:35:245
19369992,5cyclictest0-21swapper/211:00:014
19369990,9cyclictest0-21swapper/209:15:134
19369990,1cyclictest0-21swapper/209:00:144
19249996,2cyclictest8903-21latency_hist11:15:000
30625282,5sleep30-21swapper/307:05:075
19829987,1cyclictest0-21swapper/1111:05:123
19829987,1cyclictest0-21swapper/1109:15:003
19829987,1cyclictest0-21swapper/1107:25:223
19829985,2cyclictest9032-21turbostat08:00:003
19829985,2cyclictest8316-21/usr/sbin/munin11:55:133
19829980,8cyclictest0-21swapper/1108:20:193
19829980,8cyclictest0-21swapper/1107:15:123
19829980,1cyclictest0-21swapper/1112:10:123
19829980,1cyclictest0-21swapper/1108:40:143
19789987,1cyclictest0-21swapper/1010:25:122
19789987,1cyclictest0-21swapper/1009:15:152
19789980,8cyclictest0-21swapper/1012:25:172
19789980,8cyclictest0-21swapper/1011:25:182
19789980,8cyclictest0-21swapper/1008:50:112
19789980,7cyclictest0-21swapper/1010:18:322
19789980,1cyclictest0-21swapper/1012:15:142
19789980,1cyclictest0-21swapper/1011:50:122
19789980,1cyclictest0-21swapper/1011:01:062
19789980,1cyclictest0-21swapper/1009:05:222
19789980,1cyclictest0-21swapper/1008:55:172
19789980,1cyclictest0-21swapper/1007:30:152
19739987,1cyclictest0-21swapper/912:20:2111
19739980,5cyclictest0-21swapper/911:50:1311
19649981,6cyclictest0-21swapper/807:40:2210
19649980,7cyclictest0-21swapper/809:05:1610
19649980,3cyclictest0-21swapper/808:10:0010
19649980,1cyclictest0-21swapper/811:47:3110
19589987,1cyclictest0-21swapper/712:35:259
19589981,4cyclictest0-21swapper/712:20:009
19589980,1cyclictest0-21swapper/712:05:199
19549987,1cyclictest51-21ksoftirqd/607:29:328
19549987,1cyclictest0-21swapper/610:40:218
19549987,1cyclictest0-21swapper/609:10:148
19549987,1cyclictest0-21swapper/608:25:178
19549987,1cyclictest0-21swapper/607:15:238
19549982,5cyclictest115650irq/18-p34p112:35:268
19549982,5cyclictest115650irq/18-p34p111:37:558
19549982,5cyclictest115650irq/18-p34p111:06:408
19549982,5cyclictest115650irq/18-p34p110:00:518
19549982,5cyclictest115650irq/18-p34p110:00:518
19549982,5cyclictest115650irq/18-p34p109:29:228
19549982,5cyclictest115650irq/18-p34p109:18:448
19549980,8cyclictest51-21ksoftirqd/608:40:338
19549980,8cyclictest0-21swapper/611:10:138
19549980,8cyclictest0-21swapper/611:00:168
19549980,8cyclictest0-21swapper/610:30:158
19549980,8cyclictest0-21swapper/607:50:158
19549980,7cyclictest24146-21irqrtprio07:35:208
19549980,7cyclictest0-21swapper/612:30:148
19549980,7cyclictest0-21swapper/612:25:158
19549980,7cyclictest0-21swapper/612:20:018
19549980,7cyclictest0-21swapper/611:50:128
19549980,7cyclictest0-21swapper/610:55:238
19549980,7cyclictest0-21swapper/610:50:038
19549980,7cyclictest0-21swapper/610:45:148
19549980,7cyclictest0-21swapper/610:35:038
19549980,7cyclictest0-21swapper/609:51:518
19549980,7cyclictest0-21swapper/609:51:518
19549980,7cyclictest0-21swapper/609:45:098
19549980,7cyclictest0-21swapper/609:06:078
19549980,7cyclictest0-21swapper/608:55:578
19549980,3cyclictest8495-21fschecks_time11:55:138
19549980,3cyclictest21812-21smartctl11:30:148
19549980,2cyclictest0-21swapper/612:00:128
19549980,1cyclictest23227-21cpuspeed_turbos10:05:128
19549980,1cyclictest23227-21cpuspeed_turbos10:05:128
19549980,1cyclictest0-21swapper/611:40:138
19549980,1cyclictest0-21swapper/611:15:208
19549980,1cyclictest0-21swapper/610:15:138
19549980,1cyclictest0-21swapper/608:35:238
19549980,1cyclictest0-21swapper/608:00:158
19549980,1cyclictest0-21swapper/607:45:248
19549980,1cyclictest0-21swapper/607:30:168
19549980,1cyclictest0-21swapper/607:25:008
19499987,1cyclictest0-21swapper/509:19:317
19499987,1cyclictest0-21swapper/507:20:227
19499980,1cyclictest0-21swapper/509:55:217
19499980,1cyclictest0-21swapper/509:55:207
19499980,1cyclictest0-21swapper/507:15:127
19459987,1cyclictest0-21swapper/408:20:186
19459987,1cyclictest0-21swapper/408:15:116
19459985,2cyclictest1576-21turbostat07:14:556
19459981,5cyclictest0-21swapper/410:00:006
19459981,5cyclictest0-21swapper/410:00:006
19459980,8cyclictest0-21swapper/411:00:206
19459980,8cyclictest0-21swapper/407:50:176
19459980,7cyclictest30310-21diskmemload10:36:446
19459980,2cyclictest11349-21munin-run09:35:006
19459980,1cyclictest0-21swapper/411:15:156
19459980,1cyclictest0-21swapper/410:25:166
19409987,1cyclictest0-21swapper/308:55:245
19409987,1cyclictest0-21swapper/307:15:175
19409981,5cyclictest0-21swapper/307:30:225
19409981,4cyclictest0-21swapper/311:25:015
19409980,8cyclictest0-21swapper/307:45:245
19409980,7cyclictest30310-21diskmemload12:35:295
19409980,1cyclictest0-21swapper/310:45:165
19369985,2cyclictest19098-21memory08:10:164
19369980,8cyclictest0-21swapper/212:10:164
19369980,8cyclictest0-21swapper/210:35:124
19369980,1cyclictest0-21swapper/212:00:164
19369980,1cyclictest0-21swapper/208:30:224
19369980,1cyclictest0-21swapper/208:20:264
19249982,3cyclictest0-21swapper/012:32:070
19249981,4cyclictest0-21swapper/010:30:310
19249980,1cyclictest0-21swapper/010:40:010
19249980,1cyclictest0-21swapper/008:00:160
9408070,0rtkit-daemon0-21swapper/507:30:077
28359170,5phc2sys32028-21if_err_enp1s0.107:05:174
19829976,1cyclictest0-21swapper/1112:16:243
19829976,1cyclictest0-21swapper/1111:21:383
19829976,1cyclictest0-21swapper/1110:40:333
19829976,1cyclictest0-21swapper/1110:25:393
19829976,1cyclictest0-21swapper/1110:00:393
19829976,1cyclictest0-21swapper/1110:00:383
19829976,1cyclictest0-21swapper/1109:50:453
19829976,1cyclictest0-21swapper/1109:50:443
19829976,1cyclictest0-21swapper/1109:20:273
19829976,1cyclictest0-21swapper/1109:10:533
19829976,1cyclictest0-21swapper/1109:07:453
19829976,1cyclictest0-21swapper/1108:47:513
19829976,1cyclictest0-21swapper/1108:35:063
19829976,1cyclictest0-21swapper/1107:50:183
19829976,1cyclictest0-21swapper/1107:49:213
19829974,2cyclictest29649-21irqrtprio11:40:163
19829973,3cyclictest23288-21fschecks_time10:50:153
19829970,7cyclictest0-21swapper/1111:45:033
19829970,7cyclictest0-21swapper/1111:35:463
19829970,7cyclictest0-21swapper/1111:25:203
19829970,7cyclictest0-21swapper/1108:55:213
19829970,1cyclictest0-21swapper/1112:09:023
19829970,1cyclictest0-21swapper/1112:01:413
19829970,1cyclictest0-21swapper/1111:10:293
19829970,1cyclictest0-21swapper/1110:56:093
19829970,1cyclictest0-21swapper/1110:31:173
19829970,1cyclictest0-21swapper/1110:15:273
19829970,1cyclictest0-21swapper/1110:11:583
19829970,1cyclictest0-21swapper/1109:55:253
19829970,1cyclictest0-21swapper/1109:55:253
19829970,1cyclictest0-21swapper/1109:45:023
19829970,1cyclictest0-21swapper/1109:36:113
19829970,1cyclictest0-21swapper/1109:29:553
19829970,1cyclictest0-21swapper/1108:51:353
19829970,1cyclictest0-21swapper/1108:15:333
19829970,1cyclictest0-21swapper/1108:10:493
19829970,1cyclictest0-21swapper/1108:07:313
19829970,1cyclictest0-21swapper/1108:04:283
19829970,1cyclictest0-21swapper/1107:40:303
19829970,1cyclictest0-21swapper/1107:39:233
19829970,1cyclictest0-21swapper/1107:30:083
19829970,1cyclictest0-21swapper/1107:21:053
19829970,1cyclictest0-21swapper/1107:10:593
19789976,1cyclictest0-21swapper/1012:35:482
19789976,1cyclictest0-21swapper/1011:45:212
19789976,1cyclictest0-21swapper/1011:41:072
19789976,1cyclictest0-21swapper/1011:15:222
19789976,1cyclictest0-21swapper/1011:10:492
19789976,1cyclictest0-21swapper/1010:56:442
19789976,1cyclictest0-21swapper/1010:34:022
19789976,1cyclictest0-21swapper/1010:20:162
19789976,1cyclictest0-21swapper/1010:11:312
19789976,1cyclictest0-21swapper/1010:01:092
19789976,1cyclictest0-21swapper/1010:01:092
19789976,1cyclictest0-21swapper/1008:45:052
19789976,1cyclictest0-21swapper/1008:27:542
19789976,1cyclictest0-21swapper/1008:05:122
19789976,1cyclictest0-21swapper/1007:50:152
19789976,1cyclictest0-21swapper/1007:40:142
19789976,1cyclictest0-21swapper/1007:35:202
19789976,1cyclictest0-21swapper/1007:22:382
19789974,2cyclictest26294-21irqrtprio08:20:172
19789974,2cyclictest22254-21munin-run12:15:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional