You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 07:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Tue Aug 18, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
940801160,111rtkit-daemon0-21swapper/1019:07:582
2834911120,46ptp4l0-21swapper/119:08:241
3081327563,10sleep110-21swapper/1119:05:533
3089427059,9sleep70-21swapper/719:07:029
3101326856,10sleep50-21swapper/519:08:487
3093426755,10sleep60-21swapper/619:07:378
3093226756,9sleep40-21swapper/419:07:356
3090026554,9sleep00-21swapper/019:07:060
211492620,0sleep10-21swapper/120:15:261
120752600,0sleep50-21swapper/519:25:007
313272590,0sleep6501rcuc/623:20:148
48062550,0sleep20-21swapper/222:00:254
264622550,0sleep10-21swapper/120:25:141
91512520,0sleep40-21swapper/423:30:256
3148199273,16cyclictest0-21swapper/600:00:018
3146199202,11cyclictest0-21swapper/220:30:014
3148699191,3cyclictest0-21swapper/700:00:159
31495991810,2cyclictest18108-21ls00:25:2111
3146199183,9cyclictest0-21swapper/223:00:004
3146199183,10cyclictest0-21swapper/221:30:014
3146199183,10cyclictest0-21swapper/220:45:004
3146199182,10cyclictest0-21swapper/200:15:224
283491180,1ptp4l21-21ksoftirqd/100:35:141
3149599172,9cyclictest0-21swapper/923:25:0111
3149099173,8cyclictest0-21swapper/800:20:0110
3146199173,9cyclictest0-21swapper/222:30:014
3146199173,9cyclictest0-21swapper/221:10:014
3146199173,8cyclictest0-21swapper/200:40:014
31461991714,2cyclictest0-21swapper/219:45:004
3149599160,7cyclictest0-21swapper/922:44:5511
3148699163,8cyclictest0-21swapper/719:50:019
3148699162,8cyclictest0-21swapper/723:00:019
3147799163,8cyclictest0-21swapper/519:55:017
3146199163,8cyclictest0-21swapper/222:35:004
3146199162,9cyclictest0-21swapper/222:35:014
3146199162,9cyclictest0-21swapper/220:00:254
3145799162,8cyclictest0-21swapper/121:40:011
308102167,7sleep80-21swapper/819:05:4910
283491160,1ptp4l21-21ksoftirqd/119:55:141
3150499151,8cyclictest0-21swapper/1119:20:013
3149599153,7cyclictest0-21swapper/920:50:0111
3149599152,7cyclictest0-21swapper/920:15:2511
3148699153,7cyclictest0-21swapper/721:20:019
3148699152,8cyclictest0-21swapper/723:35:019
3148199152,8cyclictest0-21swapper/623:05:018
31481991513,1cyclictest0-21swapper/600:05:008
3147799153,7cyclictest0-21swapper/519:45:017
3147799151,2cyclictest0-21swapper/521:40:177
3146899153,8cyclictest0-21swapper/319:15:015
3146199153,8cyclictest0-21swapper/223:10:254
3146199152,8cyclictest0-21swapper/200:30:014
31461991513,1cyclictest31326-21turbostat21:14:594
3146199151,13cyclictest0-21swapper/223:40:164
3145799154,7cyclictest0-21swapper/122:55:011
3145799152,8cyclictest0-21swapper/119:25:001
3145299152,8cyclictest0-21swapper/019:30:010
3145299152,7cyclictest0-21swapper/019:35:000
3145299151,8cyclictest0-21swapper/021:25:000
283491150,1ptp4l21-21ksoftirqd/121:21:231
283491150,1ptp4l21-21ksoftirqd/121:05:131
283491150,0ptp4l0-21swapper/121:10:101
283491150,0ptp4l0-21swapper/120:00:181
283491150,0ptp4l0-21swapper/119:45:241
3150499143,7cyclictest0-21swapper/1123:50:013
3149599142,7cyclictest0-21swapper/922:10:2311
3149599142,7cyclictest0-21swapper/922:10:2311
3148699142,7cyclictest0-21swapper/722:20:259
3148699142,7cyclictest0-21swapper/722:20:259
3148199143,6cyclictest0-21swapper/621:55:278
3147799143,7cyclictest0-21swapper/522:25:017
3147799143,7cyclictest0-21swapper/522:25:007
3146899140,14cyclictest0-21swapper/323:52:275
3146199143,8cyclictest0-21swapper/200:25:014
3145799142,7cyclictest0-21swapper/121:05:011
3145299143,7cyclictest0-21swapper/023:15:000
3145299142,7cyclictest0-21swapper/000:20:010
283491140,1ptp4l21-21ksoftirqd/122:15:121
283491140,1ptp4l21-21ksoftirqd/122:15:111
283491140,0ptp4l0-21swapper/123:35:261
283491140,0ptp4l0-21swapper/119:15:021
283491140,0ptp4l0-21swapper/119:10:221
3150499132,7cyclictest0-21swapper/1123:45:013
3149599132,7cyclictest0-21swapper/923:00:2411
3148199130,8cyclictest0-21swapper/621:00:158
3146899132,6cyclictest0-21swapper/300:15:005
3146199131,8cyclictest0-21swapper/223:35:014
3145799134,8cyclictest0-21swapper/120:36:241
291702130,0sleep100-21swapper/1022:35:122
283491130,1ptp4l21-21ksoftirqd/119:40:151
283491130,0ptp4l0-21swapper/122:35:181
283491130,0ptp4l0-21swapper/122:21:281
283491130,0ptp4l0-21swapper/122:21:281
222492130,1sleep3321rcuc/319:35:245
3150499122,6cyclictest0-21swapper/1122:25:253
3149599122,6cyclictest0-21swapper/923:45:0111
3149599122,6cyclictest0-21swapper/919:55:2511
3149099129,2cyclictest11369-21latency_hist22:55:0110
3148199122,6cyclictest0-21swapper/623:00:018
3148199122,6cyclictest0-21swapper/621:10:018
3147799122,6cyclictest0-21swapper/523:37:037
3147799122,6cyclictest0-21swapper/500:40:007
3146899122,7cyclictest0-21swapper/322:25:015
3146899122,7cyclictest0-21swapper/322:25:015
3146899122,6cyclictest0-21swapper/322:30:005
3146899122,6cyclictest0-21swapper/300:20:015
3146199123,7cyclictest0-21swapper/221:55:014
3145799121,3cyclictest0-21swapper/100:00:161
3145299121,6cyclictest0-21swapper/021:30:010
283491120,4ptp4l21-21ksoftirqd/119:50:011
283491120,0ptp4l0-21swapper/123:48:371
283491120,0ptp4l0-21swapper/122:40:191
283491120,0ptp4l0-21swapper/120:44:301
3150499112,6cyclictest0-21swapper/1121:35:013
3150499111,7cyclictest18258-21kworker/u24:120:55:003
3150499111,6cyclictest0-21swapper/1100:25:273
3150499110,2cyclictest31848-21grep20:30:223
3149999110,10cyclictest16250-21cpuspeed_turbos19:30:112
3149999110,10cyclictest11086-21grep20:05:122
3149599110,4cyclictest0-21swapper/923:10:0011
3149599110,1cyclictest0-21swapper/923:25:2111
3149099112,5cyclictest0-21swapper/819:50:0010
3148699110,6cyclictest0-21swapper/720:00:009
3148699110,1cyclictest0-21swapper/722:00:019
3148199110,7cyclictest0-21swapper/622:05:198
3148199110,7cyclictest0-21swapper/622:05:198
3148199110,2cyclictest21835-21/usr/sbin/munin23:50:138
3146899112,6cyclictest0-21swapper/320:55:265
3146899111,6cyclictest0-21swapper/319:40:245
3146899110,1cyclictest8269-21missed_timers23:30:195
3146899110,1cyclictest0-21swapper/323:18:255
3146899110,1cyclictest0-21swapper/323:10:205
3146899110,11cyclictest0-21swapper/300:35:135
308822115,5sleep90-21swapper/919:06:5111
283491110,2ptp4l9432-21netstat21:25:221
283491110,2ptp4l26545-21fw_conntrack23:55:151
283491110,2ptp4l15246-21grep00:20:261
283491110,1ptp4l21-21ksoftirqd/120:58:421
283491110,1ptp4l0-21swapper/121:50:131
283491110,1ptp4l0-21swapper/100:30:151
283491110,0ptp4l0-21swapper/121:45:251
283491110,0ptp4l0-21swapper/120:05:121
283491110,0ptp4l0-21swapper/100:17:521
3150499109,1cyclictest0-21swapper/1122:55:163
3150499100,9cyclictest23930-21swap23:50:233
3149999109,1cyclictest0-21swapper/1020:30:162
3149999100,9cyclictest26200-21taskset23:10:532
3149599109,1cyclictest0-21swapper/923:50:2511
3149599109,1cyclictest0-21swapper/923:37:0611
3149599109,1cyclictest0-21swapper/923:15:1111
3149599109,1cyclictest0-21swapper/923:11:2011
3149599109,1cyclictest0-21swapper/900:38:1911
3149599109,1cyclictest0-21swapper/900:15:1911
3149599109,1cyclictest0-21swapper/900:13:2411
3149599100,1cyclictest0-21swapper/923:55:3211
3149599100,1cyclictest0-21swapper/923:46:4711
3149599100,1cyclictest0-21swapper/923:30:3311
3149599100,1cyclictest0-21swapper/900:33:1111
3149599100,1cyclictest0-21swapper/900:21:2311
3149599100,1cyclictest0-21swapper/900:00:1611
3149599100,10cyclictest0-21swapper/922:57:0311
3149599100,10cyclictest0-21swapper/922:53:3311
3149099109,1cyclictest0-21swapper/821:40:1510
3149099102,5cyclictest0-21swapper/823:35:2310
3149099100,9cyclictest17669-21open_files23:00:2010
3148699106,3cyclictest13028-21cat22:15:019
3148699106,3cyclictest13028-21cat22:15:009
3148199100,9cyclictest21038-21hddtemp_smartct19:35:158
3148199100,3cyclictest16690-21sed23:40:228
3147799101,5cyclictest0-21swapper/522:45:017
3146899109,1cyclictest0-21swapper/323:46:245
3146899109,1cyclictest0-21swapper/323:25:445
3146899109,1cyclictest0-21swapper/323:20:195
3146899109,1cyclictest0-21swapper/323:00:535
3146899109,1cyclictest0-21swapper/322:53:085
3146899109,1cyclictest0-21swapper/300:27:265
3146899109,1cyclictest0-21swapper/300:22:425
3146899102,5cyclictest0-21swapper/322:00:005
3146899101,6cyclictest0-21swapper/300:30:265
3146899100,1cyclictest0-21swapper/323:55:295
3146899100,10cyclictest0-21swapper/323:42:255
3146899100,10cyclictest0-21swapper/323:07:055
3146899100,10cyclictest0-21swapper/322:56:385
3146899100,10cyclictest0-21swapper/300:02:435
3146199107,2cyclictest0-21swapper/223:55:224
3146199100,9cyclictest0-21swapper/220:50:194
3146199100,9cyclictest0-21swapper/219:30:114
3145799100,1cyclictest0-21swapper/123:15:471
283591100,2phc2sys0-21swapper/219:08:184
283491100,1ptp4l6628-21timerandwakeup22:45:251
283491100,1ptp4l3239-21/usr/sbin/munin00:05:271
283491100,1ptp4l30056-21expr20:30:141
283491100,1ptp4l21-21ksoftirqd/121:40:131
283491100,1ptp4l18226-21ps19:30:201
283491100,1ptp4l16095-21cstates23:00:131
283491100,1ptp4l15057-21idleruntime-cro23:00:011
283491100,0ptp4l0-21swapper/123:05:121
283491100,0ptp4l0-21swapper/121:55:221
283491100,0ptp4l0-21swapper/120:45:201
283491100,0ptp4l0-21swapper/120:25:011
283491100,0ptp4l0-21swapper/119:36:171
283491100,0ptp4l0-21swapper/119:25:171
315049998,1cyclictest0-21swapper/1100:10:133
315049990,8cyclictest4242-40dnf20:36:243
315049990,8cyclictest0-21swapper/1120:40:133
315049990,1cyclictest0-21swapper/1120:25:133
315049990,1cyclictest0-21swapper/1119:30:173
314999998,1cyclictest0-21swapper/1000:25:222
314999990,9cyclictest0-21swapper/1023:20:202
314999990,1cyclictest741rcuc/1021:50:202
314959998,1cyclictest0-21swapper/900:06:5711
314959990,8cyclictest0-21swapper/920:40:1411
314959990,2cyclictest0-21swapper/921:30:0111
314909998,1cyclictest0-21swapper/823:25:1910
314909990,9cyclictest0-21swapper/822:30:1310
314909990,1cyclictest0-21swapper/821:40:0110
314869990,9cyclictest16451-21strings20:10:219
314869990,9cyclictest0-21swapper/722:05:019
314869990,4cyclictest0-21swapper/722:34:569
314869990,1cyclictest0-21swapper/720:05:229
314819991,5cyclictest0-21swapper/619:15:008
314819990,8cyclictest6373-21unixbench-2d21:20:258
314819990,8cyclictest0-21swapper/621:15:168
314819990,8cyclictest0-21swapper/600:10:188
314819990,3cyclictest11313-21/usr/sbin/munin00:15:248
314819990,1cyclictest115650irq/18-p34p121:25:258
314819990,1cyclictest0-21swapper/621:34:308
314819990,1cyclictest0-21swapper/619:10:168
314819990,1cyclictest0-21swapper/600:35:228
314779997,1cyclictest3380-21ls00:05:267
314779990,8cyclictest0-21swapper/519:55:157
314719998,1cyclictest0-21swapper/419:45:006
314719998,1cyclictest0-21swapper/400:10:186
314719991,7cyclictest0-21swapper/420:08:326
314719990,8cyclictest5644-21fschecks_time19:15:156
314719990,1cyclictest0-21swapper/400:00:256
314689998,1cyclictest321rcuc/320:25:005
314689998,1cyclictest0-21swapper/323:35:075
314689998,1cyclictest0-21swapper/300:06:325
314689991,5cyclictest30188-21kworker/u24:321:40:005
314689991,5cyclictest0-21swapper/321:00:265
314689991,5cyclictest0-21swapper/320:35:015
314619998,1cyclictest0-21swapper/222:05:244
314619998,1cyclictest0-21swapper/222:05:244
314619998,1cyclictest0-21swapper/220:20:004
314619997,1cyclictest0-21swapper/219:25:014
314619996,2cyclictest0-21swapper/219:15:164
314619992,6cyclictest0-21swapper/222:15:014
314619992,6cyclictest0-21swapper/222:15:014
314619990,9cyclictest0-21swapper/223:20:124
314619990,9cyclictest0-21swapper/220:45:244
314619990,9cyclictest0-21swapper/219:25:134
314619990,1cyclictest0-21swapper/223:50:124
314619990,1cyclictest0-21swapper/223:25:124
314529998,1cyclictest0-21swapper/023:37:010
314529992,6cyclictest0-21swapper/023:30:000
314529992,6cyclictest0-21swapper/020:05:000
314529990,8cyclictest0-21swapper/020:25:230
314529990,8cyclictest0-21swapper/019:45:140
30831293,5sleep30-21swapper/319:06:095
28349190,1ptp4l21-21ksoftirqd/123:50:141
28349190,1ptp4l21-21ksoftirqd/123:40:111
28349190,1ptp4l21-21ksoftirqd/123:10:011
28349190,1ptp4l21-21ksoftirqd/122:30:011
28349190,1ptp4l21-21ksoftirqd/122:25:011
28349190,1ptp4l21-21ksoftirqd/122:10:121
28349190,1ptp4l21-21ksoftirqd/122:10:121
28349190,1ptp4l21-21ksoftirqd/122:00:011
28349190,1ptp4l21-21ksoftirqd/121:15:001
28349190,1ptp4l21-21ksoftirqd/120:50:001
28349190,1ptp4l21-21ksoftirqd/100:25:011
28349190,1ptp4l21-21ksoftirqd/100:10:131
28349190,0ptp4l0-21swapper/123:30:121
28349190,0ptp4l0-21swapper/123:25:151
28349190,0ptp4l0-21swapper/123:20:141
28349190,0ptp4l0-21swapper/122:05:121
28349190,0ptp4l0-21swapper/122:05:121
28349190,0ptp4l0-21swapper/121:30:121
28349190,0ptp4l0-21swapper/120:10:151
315049987,1cyclictest0-21swapper/1119:20:123
315049987,1cyclictest0-21swapper/1100:15:203
315049986,1cyclictest0-21swapper/1123:15:113
315049980,8cyclictest0-21swapper/1122:50:133
315049980,1cyclictest0-21swapper/1121:55:193
315049980,1cyclictest0-21swapper/1121:05:243
314999987,1cyclictest0-21swapper/1023:47:292
314999987,1cyclictest0-21swapper/1023:05:202
314999987,1cyclictest0-21swapper/1022:50:262
314999987,1cyclictest0-21swapper/1022:26:552
314999987,1cyclictest0-21swapper/1021:07:222
314999987,1cyclictest0-21swapper/1020:55:192
314999987,1cyclictest0-21swapper/1020:10:212
314999987,1cyclictest0-21swapper/1020:00:252
314999987,1cyclictest0-21swapper/1000:04:012
314999980,8cyclictest0-21swapper/1022:30:252
314999980,8cyclictest0-21swapper/1021:25:192
314999980,8cyclictest0-21swapper/1020:21:222
314999980,1cyclictest0-21swapper/1022:15:192
314999980,1cyclictest0-21swapper/1022:15:192
314999980,1cyclictest0-21swapper/1021:35:222
314999980,1cyclictest0-21swapper/1000:10:182
314999980,1cyclictest0-21swapper/1000:05:242
314959980,7cyclictest0-21swapper/921:19:2811
314959980,1cyclictest0-21swapper/919:20:1611
314909987,1cyclictest0-21swapper/823:45:2310
314909987,1cyclictest0-21swapper/822:35:1810
314909987,1cyclictest0-21swapper/819:20:0110
314909987,1cyclictest0-21swapper/800:10:1510
314909987,1cyclictest0-21swapper/800:05:1610
314909985,2cyclictest6162-21fschecks_time20:40:1510
314909981,4cyclictest0-21swapper/823:35:0010
314909980,8cyclictest0-21swapper/822:15:1410
314909980,8cyclictest0-21swapper/822:15:1310
314909980,8cyclictest0-21swapper/820:55:1810
314909980,8cyclictest0-21swapper/820:45:1310
314909980,8cyclictest0-21swapper/820:35:1310
314909980,5cyclictest0-21swapper/819:30:0110
314909980,1cyclictest0-21swapper/821:10:0010
314869987,1cyclictest0-21swapper/723:35:169
314869987,1cyclictest0-21swapper/721:00:259
314869987,1cyclictest0-21swapper/720:15:199
314869987,1cyclictest0-21swapper/700:25:169
314869980,8cyclictest0-21swapper/722:15:129
314869980,8cyclictest0-21swapper/722:15:129
314869980,8cyclictest0-21swapper/721:40:169
314869980,8cyclictest0-21swapper/721:05:249
314869980,8cyclictest0-21swapper/720:00:149
314869980,3cyclictest0-21swapper/720:50:009
314819987,1cyclictest0-21swapper/623:10:128
314819987,1cyclictest0-21swapper/622:10:148
314819987,1cyclictest0-21swapper/622:10:138
314819987,1cyclictest0-21swapper/620:50:178
314819987,1cyclictest0-21swapper/620:20:148
314819987,1cyclictest0-21swapper/619:50:138
314819983,5cyclictest0-21swapper/620:29:558
314819982,5cyclictest115650irq/18-p34p123:30:148
314819982,5cyclictest115650irq/18-p34p123:15:418
314819982,5cyclictest115650irq/18-p34p122:45:038
314819982,5cyclictest115650irq/18-p34p122:29:408
314819982,5cyclictest115650irq/18-p34p122:21:218
314819982,5cyclictest115650irq/18-p34p122:21:218
314819982,5cyclictest115650irq/18-p34p122:15:278
314819982,5cyclictest115650irq/18-p34p122:15:278
314819982,5cyclictest115650irq/18-p34p122:04:358
314819982,5cyclictest115650irq/18-p34p121:35:148
314819982,5cyclictest115650irq/18-p34p121:10:318
314819982,5cyclictest115650irq/18-p34p100:31:528
314819982,5cyclictest115650irq/18-p34p100:21:238
314819980,8cyclictest0-21swapper/623:30:018
314819980,8cyclictest0-21swapper/623:05:128
314819980,8cyclictest0-21swapper/600:25:158
314819980,7cyclictest28232-21diskstats19:45:128
314819980,7cyclictest0-21swapper/622:35:188
314819980,3cyclictest24958-21/usr/sbin/munin22:30:138
314819980,3cyclictest16655-21wget20:55:148
314819980,2cyclictest17457-21ps19:30:188
314819980,1cyclictest0-21swapper/623:45:148
314819980,1cyclictest0-21swapper/621:40:158
314819980,1cyclictest0-21swapper/620:15:168
314819980,1cyclictest0-21swapper/619:40:148
314779987,1cyclictest0-21swapper/500:10:247
314779985,2cyclictest7478-21irqstats22:05:187
314779985,2cyclictest7478-21irqstats22:05:187
314779980,1cyclictest0-21swapper/522:00:217
314719987,1cyclictest0-21swapper/423:10:346
314719987,1cyclictest0-21swapper/422:45:146
314719987,1cyclictest0-21swapper/422:15:246
314719987,1cyclictest0-21swapper/422:15:246
314719987,1cyclictest0-21swapper/422:00:186
314719980,8cyclictest0-21swapper/421:30:166
314719980,8cyclictest0-21swapper/400:35:186
314719980,8cyclictest0-21swapper/400:30:266
314719980,1cyclictest0-21swapper/423:50:206
314719980,1cyclictest0-21swapper/423:45:126
314719980,1cyclictest0-21swapper/423:19:236
314719980,1cyclictest0-21swapper/423:00:246
314719980,1cyclictest0-21swapper/421:09:066
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional