You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 10:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Sat Nov 22, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
275991880,78ptp4l0-21swapper/119:07:591
2136027158,10sleep50-21swapper/519:05:137
2356526755,9sleep100-21swapper/1019:05:532
2360226453,9sleep110-21swapper/1119:06:183
2355926352,9sleep60-21swapper/619:05:508
2279926251,8sleep00-21swapper/019:05:200
2358526151,8sleep70-21swapper/719:06:039
2079826153,5sleep40-21swapper/419:05:126
178732600,0sleep00-21swapper/020:20:280
87752560,0sleep40-21swapper/422:15:216
2425299274,18cyclictest0-21swapper/420:15:016
205542240,0sleep30-21swapper/321:09:595
2425299232,16cyclictest0-21swapper/422:35:016
95022200,0sleep60-21swapper/600:25:008
2427999190,1cyclictest0-21swapper/1023:25:262
2426199193,9cyclictest0-21swapper/621:05:238
2424799193,10cyclictest0-21swapper/321:40:235
2424799192,12cyclictest19804-21kworker/u24:100:00:015
2423699191,13cyclictest19804-21kworker/u24:100:05:001
2427499183,9cyclictest0-21swapper/920:30:0111
2426199180,17cyclictest0-21swapper/620:44:548
2424799180,17cyclictest0-21swapper/322:45:195
2428399173,8cyclictest0-21swapper/1100:05:013
2427499173,8cyclictest0-21swapper/920:14:5911
2426599173,8cyclictest0-21swapper/719:45:009
2424799172,9cyclictest0-21swapper/319:50:005
2424299174,8cyclictest0-21swapper/219:45:004
2424299172,3cyclictest0-21swapper/222:20:164
2423699172,9cyclictest0-21swapper/120:15:001
2423699171,15cyclictest0-21swapper/122:10:161
2423199173,9cyclictest0-21swapper/022:40:000
2423199173,8cyclictest0-21swapper/021:50:010
275991160,2ptp4l3168-21irqrtprio20:45:191
275991160,1ptp4l21-21ksoftirqd/122:30:221
275991160,1ptp4l21-21ksoftirqd/120:55:201
275991160,0ptp4l0-21swapper/123:10:211
275991160,0ptp4l0-21swapper/123:10:211
275991160,0ptp4l0-21swapper/122:50:011
2427499163,8cyclictest0-21swapper/920:55:2311
2427099162,9cyclictest0-21swapper/822:20:0010
2426199162,9cyclictest0-21swapper/623:20:018
2426199162,8cyclictest0-21swapper/623:05:018
2426199162,8cyclictest0-21swapper/623:05:008
2426199160,15cyclictest0-21swapper/600:35:188
2425699163,8cyclictest0-21swapper/519:30:007
2424799163,8cyclictest0-21swapper/323:35:005
2424799163,8cyclictest0-21swapper/321:25:015
2424799163,8cyclictest0-21swapper/300:40:005
2424799162,8cyclictest0-21swapper/322:55:005
2424299163,8cyclictest0-21swapper/200:10:014
2424299163,7cyclictest0-21swapper/222:30:014
2423199162,8cyclictest0-21swapper/000:25:230
237532168,6sleep80-21swapper/819:08:2910
275991150,1ptp4l21-21ksoftirqd/120:35:141
275991150,0ptp4l0-21swapper/123:25:281
275991150,0ptp4l0-21swapper/122:25:151
2428399152,7cyclictest0-21swapper/1123:25:013
2427499153,7cyclictest0-21swapper/923:25:0011
2427499153,7cyclictest0-21swapper/922:40:0011
2427499152,8cyclictest0-21swapper/919:25:0011
2427099152,8cyclictest0-21swapper/821:00:0010
2426599153,8cyclictest0-21swapper/700:25:009
2426599153,7cyclictest0-21swapper/700:30:009
2426599152,9cyclictest0-21swapper/723:00:019
2426599152,9cyclictest0-21swapper/723:00:009
2426199153,7cyclictest0-21swapper/600:15:268
2425699153,7cyclictest0-21swapper/523:00:017
2425699153,7cyclictest0-21swapper/523:00:007
2425699153,7cyclictest0-21swapper/521:30:257
2424299152,8cyclictest0-21swapper/221:55:264
2423199153,7cyclictest0-21swapper/022:50:270
2423199153,7cyclictest0-21swapper/000:00:000
141272150,1sleep6501rcuc/600:30:148
275991140,1ptp4l21-21ksoftirqd/120:15:131
2428399140,12cyclictest0-21swapper/1121:35:193
2427999140,9cyclictest0-21swapper/1022:45:272
2427499143,7cyclictest0-21swapper/922:51:2511
2427499142,7cyclictest0-21swapper/923:45:0011
2427499142,7cyclictest0-21swapper/922:35:0111
2427499142,7cyclictest0-21swapper/920:00:0011
2427099142,7cyclictest0-21swapper/821:15:0110
2426599143,7cyclictest0-21swapper/720:40:009
2426599143,6cyclictest0-21swapper/721:40:009
2426599142,7cyclictest0-21swapper/719:59:599
2426199140,8cyclictest0-21swapper/622:00:018
2425699143,6cyclictest0-21swapper/522:15:017
2424299142,8cyclictest0-21swapper/220:20:014
2423699142,8cyclictest19804-21kworker/u24:100:05:011
2423699141,9cyclictest21-21ksoftirqd/120:05:011
2423699140,8cyclictest0-21swapper/122:55:001
2423699140,8cyclictest0-21swapper/122:55:001
2423199143,7cyclictest0-21swapper/023:15:240
2423199143,6cyclictest0-21swapper/020:55:010
275991130,5ptp4l21-21ksoftirqd/121:50:261
275991130,1ptp4l21-21ksoftirqd/122:36:211
275991130,1ptp4l21-21ksoftirqd/121:35:011
275991130,1ptp4l21-21ksoftirqd/120:30:071
275991130,1ptp4l21-21ksoftirqd/100:37:591
275991130,1ptp4l21-21ksoftirqd/100:34:571
275991130,0ptp4l0-21swapper/123:55:131
2428399132,7cyclictest0-21swapper/1121:20:253
2428399132,6cyclictest0-21swapper/1121:25:263
2428399132,6cyclictest0-21swapper/1100:15:003
2427499133,6cyclictest0-21swapper/900:15:0011
2427499132,7cyclictest0-21swapper/922:00:0011
2427099132,7cyclictest0-21swapper/822:10:0110
2427099132,6cyclictest0-21swapper/822:30:0110
2426599132,7cyclictest0-21swapper/723:35:249
2426599132,6cyclictest0-21swapper/723:15:019
2426599132,6cyclictest0-21swapper/723:15:019
2426599130,12cyclictest0-21swapper/720:10:009
2426199132,7cyclictest0-21swapper/619:20:018
2425699131,8cyclictest0-21swapper/523:40:017
2425299133,6cyclictest0-21swapper/421:55:006
2424799132,7cyclictest0-21swapper/322:00:015
2424299131,8cyclictest12125-21kworker/u24:021:35:004
24242991310,2cyclictest15912-21turbostat19:40:004
2423699132,6cyclictest0-21swapper/121:15:011
2423699130,7cyclictest0-21swapper/119:15:011
2423199132,7cyclictest0-21swapper/022:00:240
2423199132,6cyclictest0-21swapper/022:25:000
2423199131,7cyclictest0-21swapper/020:00:000
316642120,0sleep00-21swapper/023:30:010
275991120,1ptp4l21-21ksoftirqd/123:20:151
275991120,1ptp4l21-21ksoftirqd/121:25:201
275991120,1ptp4l21-21ksoftirqd/119:10:181
275991120,1ptp4l21-21ksoftirqd/100:27:341
275991120,0ptp4l0-21swapper/123:50:141
275991120,0ptp4l0-21swapper/123:45:191
275991120,0ptp4l0-21swapper/122:20:131
275991120,0ptp4l0-21swapper/122:15:201
275991120,0ptp4l0-21swapper/121:15:181
275991120,0ptp4l0-21swapper/120:26:191
275991120,0ptp4l0-21swapper/119:33:481
2428399123,5cyclictest0-21swapper/1120:05:003
2428399121,7cyclictest0-21swapper/1123:40:273
2428399120,11cyclictest0-21swapper/1123:49:563
2426599120,11cyclictest0-21swapper/720:35:009
2426199120,1cyclictest0-21swapper/619:15:008
2425699123,5cyclictest0-21swapper/520:45:007
2425699122,6cyclictest0-21swapper/521:05:007
2425699121,6cyclictest12125-21kworker/u24:021:30:007
2425299121,7cyclictest0-21swapper/422:20:236
2425299121,7cyclictest0-21swapper/400:40:016
2424799129,2cyclictest0-21swapper/321:50:195
2424299129,2cyclictest32740-21turbostat22:50:014
2424299123,8cyclictest0-21swapper/221:10:014
2424299120,11cyclictest0-21swapper/221:20:174
2423699122,6cyclictest0-21swapper/122:51:251
2423199123,8cyclictest0-21swapper/000:20:010
2423199122,7cyclictest0-21swapper/022:15:220
2423199122,6cyclictest0-21swapper/023:35:010
2423199122,6cyclictest0-21swapper/020:40:000
2423199120,11cyclictest6389-21processes21:30:220
275991110,2ptp4l12433-21sed23:05:011
275991110,2ptp4l12433-21sed23:05:011
275991110,1ptp4l21-21ksoftirqd/119:25:251
275991110,1ptp4l0-21swapper/121:05:151
275991110,1ptp4l0-21swapper/119:50:161
275991110,0ptp4l0-21swapper/119:20:231
275991110,0ptp4l0-21swapper/100:10:181
2428399118,2cyclictest15912-21turbostat19:40:003
2428399112,6cyclictest0-21swapper/1123:55:213
2428399110,10cyclictest0-21swapper/1119:34:543
2427999118,2cyclictest23552-21turbostat19:50:002
2427999112,5cyclictest0-21swapper/1019:51:032
2427999110,5cyclictest10534-21munin-run23:45:012
2427499111,8cyclictest19804-21kworker/u24:100:30:0111
2427499110,10cyclictest7620-21fw_conntrack22:15:1411
2427099113,5cyclictest0-21swapper/823:50:0110
2427099112,6cyclictest0-21swapper/820:50:0010
2427099110,10cyclictest0-21swapper/823:40:0010
2426599112,5cyclictest0-21swapper/720:50:019
2426599110,10cyclictest0-21swapper/720:59:599
2426199112,7cyclictest0-21swapper/619:35:018
2424799112,5cyclictest0-21swapper/321:00:015
2424799111,6cyclictest0-21swapper/322:00:015
2424799111,5cyclictest0-21swapper/321:35:005
2424299111,3cyclictest0-21swapper/220:00:194
2423199112,6cyclictest0-21swapper/022:00:000
191591110,0getstats0-21swapper/223:09:494
191591110,0getstats0-21swapper/223:09:494
275991100,2ptp4l8117-21switchtime20:50:221
275991100,2ptp4l21-21ksoftirqd/119:40:201
275991100,1ptp4l536-21hddtemp_smartct23:30:161
275991100,1ptp4l29277-21cat22:45:001
275991100,1ptp4l23021-21timerwakeupswit23:15:231
275991100,1ptp4l21-21ksoftirqd/120:00:211
275991100,1ptp4l10070-21strings21:35:211
275991100,1ptp4l0-21swapper/123:35:181
275991100,1ptp4l0-21swapper/119:45:231
275991100,0ptp4l0-21swapper/121:55:151
275991100,0ptp4l0-21swapper/121:24:241
2428399100,5cyclictest0-21swapper/1119:20:003
2427999100,9cyclictest15836-21irqrtprio22:25:182
2427499102,6cyclictest0-21swapper/919:25:2611
2426599102,6cyclictest0-21swapper/722:25:249
2426599100,9cyclictest0-21swapper/721:30:009
2426599100,9cyclictest0-21swapper/700:05:009
2425699100,9cyclictest29657-21timerandwakeup22:00:247
2424799102,7cyclictest0-21swapper/322:15:005
2424799101,5cyclictest0-21swapper/323:50:005
2424799100,9cyclictest0-21swapper/320:45:135
2424299100,9cyclictest4746-21wc22:55:004
2424299100,9cyclictest0-21swapper/200:15:134
2423199100,9cyclictest0-21swapper/021:25:230
9498090,0rtkit-daemon0-21swapper/223:58:384
27609190,3phc2sys0-21swapper/219:08:244
27599190,1ptp4l21-21ksoftirqd/123:40:171
27599190,1ptp4l21-21ksoftirqd/122:00:131
27599190,1ptp4l21-21ksoftirqd/100:15:131
27599190,1ptp4l16191-21cstates21:45:121
27599190,1ptp4l11823-21aten2_r3power_c21:40:101
27599190,0ptp4l0-21swapper/123:05:001
27599190,0ptp4l0-21swapper/123:05:001
27599190,0ptp4l0-21swapper/122:05:121
27599190,0ptp4l0-21swapper/121:00:011
27599190,0ptp4l0-21swapper/120:40:111
27599190,0ptp4l0-21swapper/120:20:011
27599190,0ptp4l0-21swapper/119:55:121
27599190,0ptp4l0-21swapper/119:35:111
27599190,0ptp4l0-21swapper/100:20:121
242839998,1cyclictest0-21swapper/1119:40:213
242839996,2cyclictest13611-21turbostat22:25:013
242799990,8cyclictest18764-21diskstats22:30:132
242799990,1cyclictest0-21swapper/1023:55:122
242749998,1cyclictest0-21swapper/920:30:1811
242749998,1cyclictest0-21swapper/900:10:2211
242749990,9cyclictest0-21swapper/923:45:2011
242749990,9cyclictest0-21swapper/923:30:2511
242749990,9cyclictest0-21swapper/922:20:1211
242749990,8cyclictest0-21swapper/922:04:5511
242749990,1cyclictest0-21swapper/922:25:2511
242749990,1cyclictest0-21swapper/900:05:1511
242709996,2cyclictest30593-21fw_forwarded_lo22:45:1810
242709990,1cyclictest0-21swapper/800:25:0010
242659990,4cyclictest0-21swapper/700:19:569
242659990,3cyclictest0-21swapper/721:49:559
242659990,2cyclictest22457-21pool21:50:299
242619996,2cyclictest5339-21/usr/sbin/munin20:05:198
242619992,6cyclictest0-21swapper/621:15:018
242619990,8cyclictest0-21swapper/619:45:128
242619990,1cyclictest0-21swapper/622:55:018
242569998,1cyclictest0-21swapper/521:35:177
242569990,9cyclictest0-21swapper/521:15:177
242569990,4cyclictest0-21swapper/523:30:007
242569990,1cyclictest0-21swapper/519:50:137
242529997,1cyclictest0-21swapper/400:30:156
242429990,8cyclictest112750irq/18-p34p119:22:194
242429990,8cyclictest1009-21snmpd21:50:134
242429990,8cyclictest0-21swapper/219:55:164
242319998,1cyclictest0-21swapper/021:40:170
242319997,1cyclictest0-21swapper/022:40:170
242319997,1cyclictest0-21swapper/019:25:170
242319990,9cyclictest0-21swapper/020:55:200
22012291,5sleep90-21swapper/919:05:1611
242839987,1cyclictest0-21swapper/1120:45:203
242839986,1cyclictest0-21swapper/1122:56:443
242839986,1cyclictest0-21swapper/1122:56:433
242839980,8cyclictest0-21swapper/1120:20:283
242839980,1cyclictest0-21swapper/1120:40:163
242799981,5cyclictest0-21swapper/1021:50:252
242799980,8cyclictest0-21swapper/1022:15:242
242799980,1cyclictest0-21swapper/1023:45:172
242799980,1cyclictest0-21swapper/1021:45:132
242799980,1cyclictest0-21swapper/1020:35:202
242799980,1cyclictest0-21swapper/1019:35:232
242799980,1cyclictest0-21swapper/1000:15:132
242749987,1cyclictest0-21swapper/922:45:1711
242749987,1cyclictest0-21swapper/921:14:2511
242749987,1cyclictest0-21swapper/919:30:1511
242749980,8cyclictest0-21swapper/923:10:2811
242749980,8cyclictest0-21swapper/923:10:2811
242749980,8cyclictest0-21swapper/921:30:1911
242749980,8cyclictest0-21swapper/919:45:1911
242749980,8cyclictest0-21swapper/900:35:2511
242749980,1cyclictest0-21swapper/920:50:2011
242709987,1cyclictest0-21swapper/823:40:2210
242709987,1cyclictest0-21swapper/822:50:2810
242709980,8cyclictest0-21swapper/823:50:1110
242709980,8cyclictest0-21swapper/820:50:1410
242709980,1cyclictest0-21swapper/819:40:2710
242709980,1cyclictest0-21swapper/800:05:1410
242659987,1cyclictest0-21swapper/722:45:229
242659987,1cyclictest0-21swapper/721:20:189
242659987,1cyclictest0-21swapper/721:16:159
242659987,1cyclictest0-21swapper/720:15:189
242659987,1cyclictest0-21swapper/719:30:009
242659980,8cyclictest0-21swapper/723:40:199
242659980,1cyclictest0-21swapper/722:00:129
242659980,1cyclictest0-21swapper/721:10:209
242619987,1cyclictest0-21swapper/622:10:138
242619987,1cyclictest0-21swapper/620:20:178
242619987,1cyclictest0-21swapper/619:40:188
242619980,8cyclictest14673-21strings19:35:178
242619980,8cyclictest0-21swapper/621:15:158
242619980,1cyclictest0-21swapper/623:40:268
242619980,1cyclictest0-21swapper/623:05:198
242619980,1cyclictest0-21swapper/623:05:188
242619980,1cyclictest0-21swapper/621:40:128
242619980,1cyclictest0-21swapper/621:30:158
242569987,1cyclictest0-21swapper/523:20:237
242569987,1cyclictest0-21swapper/523:15:147
242569987,1cyclictest0-21swapper/520:30:207
242569987,1cyclictest0-21swapper/500:35:167
242569982,3cyclictest0-21swapper/500:20:017
242569980,8cyclictest0-21swapper/522:30:217
242569980,7cyclictest0-21swapper/500:06:537
242569980,4cyclictest0-21swapper/500:25:017
242569980,1cyclictest0-21swapper/523:05:207
242569980,1cyclictest0-21swapper/523:05:197
242529980,8cyclictest0-21swapper/421:55:276
242529980,7cyclictest30452-21latency_hist22:05:016
242529980,3cyclictest4920-21cat22:55:006
242529980,3cyclictest32753-21crond19:20:006
242529980,1cyclictest0-21swapper/422:25:236
242529980,1cyclictest0-21swapper/421:15:566
242479987,1cyclictest0-21swapper/319:35:165
242479987,1cyclictest0-21swapper/319:25:205
242479985,2cyclictest16684-21munin-run00:35:005
242479980,1cyclictest0-21swapper/321:15:175
242479980,1cyclictest0-21swapper/320:25:165
242429987,1cyclictest0-21swapper/223:20:014
242429987,1cyclictest0-21swapper/221:00:224
242429987,1cyclictest0-21swapper/220:30:124
242429980,8cyclictest0-21swapper/220:25:134
242429980,8cyclictest0-21swapper/219:50:134
242429980,8cyclictest0-21swapper/200:20:124
242429980,7cyclictest25296-21entropy19:10:124
242429980,7cyclictest0-21swapper/223:15:144
242429980,7cyclictest0-21swapper/222:40:144
242429980,2cyclictest9569-21/usr/sbin/munin23:00:164
242429980,2cyclictest9569-21/usr/sbin/munin23:00:154
242429980,2cyclictest0-21swapper/223:40:274
242429980,1cyclictest0-21swapper/220:45:194
242319987,1cyclictest0-21swapper/021:00:240
242319987,1cyclictest0-21swapper/020:35:160
242319987,1cyclictest0-21swapper/020:00:160
242319980,8cyclictest0-21swapper/019:30:250
242319980,1cyclictest0-21swapper/021:16:140
242319980,1cyclictest0-21swapper/019:20:220
242319980,1cyclictest0-21swapper/000:34:450
23053281,5sleep30-21swapper/319:05:235
2623270,1sleep80-21swapper/822:10:1310
242839976,1cyclictest0-21swapper/1123:50:153
242839976,1cyclictest0-21swapper/1123:27:473
242839976,1cyclictest0-21swapper/1123:15:343
242839976,1cyclictest0-21swapper/1123:10:193
242839976,1cyclictest0-21swapper/1123:10:183
242839976,1cyclictest0-21swapper/1122:15:153
242839976,1cyclictest0-21swapper/1122:00:233
242839976,1cyclictest0-21swapper/1121:57:033
242839976,1cyclictest0-21swapper/1121:31:123
242839976,1cyclictest0-21swapper/1121:15:003
242839976,1cyclictest0-21swapper/1121:05:253
242839976,1cyclictest0-21swapper/1120:38:053
242839976,1cyclictest0-21swapper/1120:25:223
242839976,1cyclictest0-21swapper/1119:56:443
242839976,1cyclictest0-21swapper/1100:06:303
242839974,2cyclictest5034-21aten2_r3power_v19:25:133
242839974,2cyclictest11090-21aten2_r3power_e20:15:113
242839974,2cyclictest1020-21runrttasks19:11:593
242839970,7cyclictest0-21swapper/1123:05:033
242839970,7cyclictest0-21swapper/1123:05:023
242839970,7cyclictest0-21swapper/1123:00:543
242839970,7cyclictest0-21swapper/1123:00:533
242839970,7cyclictest0-21swapper/1122:53:543
242839970,7cyclictest0-21swapper/1122:40:173
242839970,7cyclictest0-21swapper/1122:35:143
242839970,7cyclictest0-21swapper/1122:30:113
242839970,7cyclictest0-21swapper/1121:45:213
242839970,7cyclictest0-21swapper/1121:10:053
242839970,7cyclictest0-21swapper/1120:30:113
242839970,7cyclictest0-21swapper/1120:07:033
242839970,7cyclictest0-21swapper/1100:35:133
242839970,7cyclictest0-21swapper/1100:30:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional