You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 18:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Wed Dec 10, 2025 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
94980880,83rtkit-daemon0-21swapper/1007:09:502
275991830,65ptp4l0-21swapper/107:09:521
104862710,0sleep80-21swapper/809:35:1910
2513126957,10sleep70-21swapper/707:09:529
2427726859,6sleep50-21swapper/507:05:257
2496326655,9sleep00-21swapper/007:07:310
60192650,0sleep60-21swapper/608:05:208
2483526554,9sleep60-21swapper/607:05:388
2183826352,9sleep110-21swapper/1107:05:063
25892610,0sleep80-21swapper/807:20:1710
290092600,0sleep00-21swapper/007:55:000
2486126049,9sleep40-21swapper/407:06:006
164622580,0sleep100-21swapper/1008:20:132
58032550,0sleep40-21swapper/410:10:206
58032550,0sleep40-21swapper/410:10:206
212092550,0sleep10-21swapper/107:45:011
199462550,0sleep100-21swapper/1009:05:182
172072550,0sleep10-21swapper/109:45:141
67752210,0sleep60-21swapper/608:50:018
268092200,0sleep90-21swapper/909:55:2211
2547199186,8cyclictest12899-21kworker/u24:207:25:008
2547199184,9cyclictest12899-21kworker/u24:207:30:018
2545299184,9cyclictest0-21swapper/207:10:014
2544299183,9cyclictest0-21swapper/008:35:000
317302170,0sleep80-21swapper/809:20:1710
275991170,0ptp4l0-21swapper/108:05:271
2548999172,9cyclictest0-21swapper/907:30:2611
2548099172,9cyclictest0-21swapper/707:35:009
2545899172,9cyclictest0-21swapper/311:50:255
2545299173,9cyclictest0-21swapper/211:45:014
95832160,0sleep50-21swapper/509:35:177
275991160,0ptp4l0-21swapper/111:40:191
275991160,0ptp4l0-21swapper/111:35:111
2548999163,7cyclictest0-21swapper/909:20:0011
2548599163,7cyclictest0-21swapper/812:24:1610
2547199163,8cyclictest0-21swapper/611:35:018
2545899163,8cyclictest0-21swapper/308:30:245
2544799162,8cyclictest0-21swapper/112:25:001
2544299163,8cyclictest0-21swapper/009:24:100
2544299163,7cyclictest0-21swapper/007:14:590
251322167,7sleep80-21swapper/807:09:5310
147582160,0sleep110-21swapper/1111:45:253
275991150,0ptp4l0-21swapper/111:20:161
275991150,0ptp4l0-21swapper/108:00:221
2548999152,7cyclictest0-21swapper/911:35:0111
2548099152,7cyclictest0-21swapper/708:20:009
2548099152,7cyclictest0-21swapper/708:10:019
2547199152,7cyclictest0-21swapper/608:10:268
2545299158,6cyclictest16319-21switchtime07:35:264
2545299154,7cyclictest29886-21kworker/u24:112:35:004
2545299153,8cyclictest0-21swapper/207:50:014
2544799152,8cyclictest0-21swapper/108:25:241
2544299152,8cyclictest0-21swapper/011:55:010
2544299152,8cyclictest0-21swapper/010:15:010
2544299152,8cyclictest0-21swapper/010:15:010
2544299151,9cyclictest0-21swapper/012:05:000
24582150,0sleep1075-21ksoftirqd/1010:05:372
24582150,0sleep1075-21ksoftirqd/1010:05:372
36642140,0sleep00-21swapper/011:30:240
275991140,1ptp4l26790-21unixbench_singl08:30:241
275991140,1ptp4l21-21ksoftirqd/111:55:161
275991140,0ptp4l0-21swapper/111:45:271
275991140,0ptp4l0-21swapper/111:10:141
275991140,0ptp4l0-21swapper/110:25:161
275991140,0ptp4l0-21swapper/110:25:151
275991140,0ptp4l0-21swapper/110:15:291
275991140,0ptp4l0-21swapper/110:15:291
275991140,0ptp4l0-21swapper/109:37:121
2548999142,7cyclictest0-21swapper/908:50:0111
2548999141,8cyclictest0-21swapper/910:15:0011
2548999141,8cyclictest0-21swapper/910:15:0011
2548099143,7cyclictest0-21swapper/708:50:019
2548099143,6cyclictest0-21swapper/709:00:009
2548099142,8cyclictest0-21swapper/709:20:009
2548099142,6cyclictest0-21swapper/712:30:019
2547199142,8cyclictest0-21swapper/607:39:598
2547199142,7cyclictest0-21swapper/611:10:238
2547199142,7cyclictest0-21swapper/610:50:008
2547199142,7cyclictest0-21swapper/609:25:008
2547199142,7cyclictest0-21swapper/609:00:018
2547199142,7cyclictest0-21swapper/608:05:008
2545899142,7cyclictest0-21swapper/312:30:015
2545299145,5cyclictest29886-21kworker/u24:110:55:004
2545299143,9cyclictest0-21swapper/210:00:014
2545299140,13cyclictest0-21swapper/210:20:144
2545299140,13cyclictest0-21swapper/210:20:134
2545299140,13cyclictest0-21swapper/207:30:174
2544799142,8cyclictest0-21swapper/109:05:011
2544799142,8cyclictest0-21swapper/108:50:011
2544799142,7cyclictest0-21swapper/110:45:001
2544299143,6cyclictest0-21swapper/007:35:000
2544299142,8cyclictest0-21swapper/008:35:000
2544299142,7cyclictest0-21swapper/011:15:010
2544299141,7cyclictest0-21swapper/010:00:010
294422130,0sleep20-21swapper/208:35:194
275991130,0ptp4l0-21swapper/112:00:211
275991130,0ptp4l0-21swapper/110:20:181
275991130,0ptp4l0-21swapper/110:20:171
275991130,0ptp4l0-21swapper/109:15:221
275991130,0ptp4l0-21swapper/108:40:221
275991130,0ptp4l0-21swapper/107:35:001
2548999133,6cyclictest0-21swapper/909:40:0011
2548999131,7cyclictest12899-21kworker/u24:208:30:0111
2548999131,7cyclictest0-21swapper/911:10:0111
2548999130,8cyclictest0-21swapper/911:55:2411
2548999130,12cyclictest0-21swapper/908:44:5511
2548599133,6cyclictest0-21swapper/809:50:0110
2548099133,6cyclictest0-21swapper/707:20:009
2548099132,6cyclictest0-21swapper/709:45:009
2548099132,6cyclictest0-21swapper/707:14:599
2548099130,8cyclictest0-21swapper/708:25:019
2547199133,6cyclictest0-21swapper/612:15:018
2547199132,7cyclictest0-21swapper/611:00:018
2547199132,7cyclictest0-21swapper/610:40:018
2547199132,7cyclictest0-21swapper/610:35:018
2547199132,7cyclictest0-21swapper/609:10:248
2547199132,6cyclictest0-21swapper/612:20:008
2547199132,6cyclictest0-21swapper/609:45:008
2547199132,6cyclictest0-21swapper/608:20:248
2547199132,6cyclictest0-21swapper/607:45:278
2545899132,7cyclictest0-21swapper/309:25:225
2545299132,3cyclictest21837-21idleruntime-cro09:10:004
2545299130,3cyclictest20056-21chrt09:47:274
2545299130,2cyclictest0-21swapper/212:30:154
2545299130,2cyclictest0-21swapper/210:55:194
2545299130,2cyclictest0-21swapper/207:45:154
2545299130,2cyclictest0-21swapper/207:25:194
2545299130,13cyclictest0-21swapper/207:40:144
2545299130,12cyclictest0-21swapper/211:56:124
2545299130,12cyclictest0-21swapper/210:26:344
2545299130,12cyclictest0-21swapper/210:26:344
2544799132,7cyclictest0-21swapper/112:05:251
2544799132,7cyclictest0-21swapper/111:30:011
2544799132,7cyclictest0-21swapper/110:00:001
2544799131,7cyclictest0-21swapper/112:30:011
2544299132,7cyclictest0-21swapper/008:05:270
2544299132,6cyclictest0-21swapper/008:45:010
275991120,3ptp4l31024-21cat08:40:001
275991120,3ptp4l29895-21irqrtprio10:00:171
275991120,1ptp4l21-21ksoftirqd/112:35:181
275991120,0ptp4l0-21swapper/112:10:561
275991120,0ptp4l0-21swapper/111:50:241
275991120,0ptp4l0-21swapper/111:28:021
275991120,0ptp4l0-21swapper/109:30:241
275991120,0ptp4l0-21swapper/108:15:221
275991120,0ptp4l0-21swapper/107:45:501
2548999120,7cyclictest0-21swapper/909:10:0111
2548599121,7cyclictest0-21swapper/809:10:0110
2547199122,6cyclictest0-21swapper/612:00:258
2547199120,1cyclictest0-21swapper/607:55:008
2545899122,6cyclictest0-21swapper/310:15:285
2545899122,6cyclictest0-21swapper/310:15:275
2545899122,6cyclictest0-21swapper/308:40:015
2545899122,6cyclictest0-21swapper/308:05:005
2545299122,4cyclictest3866-21cstates12:15:134
2545299120,1cyclictest0-21swapper/209:21:064
2545299120,12cyclictest0-21swapper/212:00:164
2545299120,12cyclictest0-21swapper/209:25:194
2545299120,11cyclictest0-21swapper/210:43:064
2545299120,11cyclictest0-21swapper/210:35:174
2545299120,11cyclictest0-21swapper/210:30:184
2545299120,11cyclictest0-21swapper/208:21:004
250072121,5sleep30-21swapper/307:08:115
275991110,5ptp4l0-21swapper/110:05:291
275991110,5ptp4l0-21swapper/110:05:291
275991110,3ptp4l23282-21cat10:35:131
275991110,1ptp4l0-21swapper/111:05:181
275991110,1ptp4l0-21swapper/108:50:131
275991110,0ptp4l0-21swapper/111:04:231
275991110,0ptp4l0-21swapper/110:50:181
275991110,0ptp4l0-21swapper/109:10:141
275991110,0ptp4l0-21swapper/107:20:011
2549499118,3cyclictest26424-21perl11:20:162
2548999112,6cyclictest0-21swapper/911:20:0011
2548999111,7cyclictest0-21swapper/912:40:0011
2548999110,6cyclictest0-21swapper/911:30:0111
2548599113,5cyclictest0-21swapper/810:40:0010
2547199110,1cyclictest0-21swapper/609:20:008
2545299113,7cyclictest6472-21latency_hist08:50:004
2545299112,4cyclictest5865-21missed_timers10:10:204
2545299112,4cyclictest5865-21missed_timers10:10:194
2545299111,3cyclictest24233-21missed_timers09:10:184
2545299110,3cyclictest6694-21gltestperf09:30:154
2545299110,3cyclictest10455-21grep11:00:124
2545299110,2cyclictest31908-21runrttasks07:15:174
2545299110,2cyclictest0-21swapper/212:25:154
2545299110,2cyclictest0-21swapper/212:07:254
2545299110,2cyclictest0-21swapper/211:35:144
2545299110,2cyclictest0-21swapper/211:30:144
2545299110,2cyclictest0-21swapper/211:25:144
2545299110,2cyclictest0-21swapper/211:15:184
2545299110,2cyclictest0-21swapper/211:05:164
2545299110,2cyclictest0-21swapper/210:45:274
2545299110,2cyclictest0-21swapper/210:15:184
2545299110,2cyclictest0-21swapper/210:15:174
2545299110,2cyclictest0-21swapper/210:05:384
2545299110,2cyclictest0-21swapper/210:05:374
2545299110,2cyclictest0-21swapper/209:55:214
2545299110,2cyclictest0-21swapper/209:50:164
2545299110,2cyclictest0-21swapper/209:40:144
2545299110,2cyclictest0-21swapper/209:35:174
2545299110,2cyclictest0-21swapper/209:15:154
2545299110,2cyclictest0-21swapper/209:02:524
2545299110,2cyclictest0-21swapper/208:50:154
2545299110,2cyclictest0-21swapper/208:40:164
2545299110,2cyclictest0-21swapper/208:25:244
2545299110,2cyclictest0-21swapper/208:15:174
2545299110,2cyclictest0-21swapper/208:10:214
2545299110,2cyclictest0-21swapper/208:05:154
2545299110,2cyclictest0-21swapper/208:00:244
2545299110,2cyclictest0-21swapper/207:55:174
2545299110,2cyclictest0-21swapper/207:20:274
2545299110,11cyclictest0-21swapper/211:20:194
2545299110,10cyclictest0-21swapper/211:50:134
2545299110,10cyclictest0-21swapper/208:59:044
275991100,2ptp4l10826-21/usr/sbin/munin12:25:121
275991100,1ptp4l5965-21timerwakeupswit12:15:251
275991100,1ptp4l3211-21fschecks_time07:20:191
275991100,1ptp4l31987-21hddtemp_smartct10:45:191
275991100,1ptp4l30351-21fw_conntrack07:55:161
275991100,1ptp4l26531-21fw_conntrack07:50:151
275991100,1ptp4l26287-21cut07:10:141
275991100,1ptp4l24276-21sed11:15:251
275991100,1ptp4l22691-21sed10:35:011
275991100,1ptp4l17200-21latency_hist07:40:011
275991100,1ptp4l0-21swapper/108:20:141
275991100,0ptp4l0-21swapper/109:50:151
275991100,0ptp4l0-21swapper/108:11:511
2549499100,2cyclictest27983-21fschecks_time10:40:182
2548999108,1cyclictest0-21swapper/908:31:0211
2548999100,5cyclictest0-21swapper/910:05:0011
2548599102,5cyclictest0-21swapper/811:50:0110
2548599101,6cyclictest0-21swapper/810:40:0010
2548599101,5cyclictest0-21swapper/811:40:0010
2548599100,2cyclictest0-21swapper/812:10:1910
2548099100,9cyclictest21784-21diskmemload12:20:179
2548099100,5cyclictest0-21swapper/707:54:599
2548099100,1cyclictest0-21swapper/709:10:009
2546799100,9cyclictest13880-21taskset08:56:397
2546399107,2cyclictest24806-21grep09:10:236
2546399100,9cyclictest16187-21/usr/sbin/munin11:50:266
2546399100,9cyclictest0-21swapper/412:20:236
2546399100,9cyclictest0-21swapper/407:25:236
2545299100,2cyclictest7336-21cpuspeed_turbos12:20:124
2545299100,2cyclictest0-21swapper/212:10:104
2545299100,2cyclictest0-21swapper/211:45:144
2545299100,2cyclictest0-21swapper/211:10:114
2545299100,2cyclictest0-21swapper/208:30:124
2544299107,2cyclictest31904-21fw_conntrack07:15:160
2544299103,4cyclictest0-21swapper/009:45:000
27609190,1phc2sys0-21swapper/207:05:164
27599190,1ptp4l30215-21cpuspeed_turbos09:20:121
27599190,0ptp4l0-21swapper/110:55:141
27599190,0ptp4l0-21swapper/110:10:131
27599190,0ptp4l0-21swapper/110:10:131
27599190,0ptp4l0-21swapper/109:40:131
27599190,0ptp4l0-21swapper/109:25:121
27599190,0ptp4l0-21swapper/109:05:141
27599190,0ptp4l0-21swapper/108:55:371
27599190,0ptp4l0-21swapper/107:25:151
254899998,1cyclictest0-21swapper/912:00:1311
254899990,8cyclictest69-21ksoftirqd/909:20:2311
254899990,8cyclictest2449-21timerandwakeup10:05:3711
254899990,8cyclictest2449-21timerandwakeup10:05:3711
254899990,8cyclictest23110-21df_inode09:10:1211
254859997,1cyclictest0-21swapper/811:40:1210
254859993,3cyclictest0-21swapper/809:15:0010
254859991,6cyclictest0-21swapper/810:50:2610
254859991,5cyclictest0-21swapper/808:45:0110
254859990,8cyclictest0-21swapper/807:55:1310
254809997,1cyclictest0-21swapper/711:49:559
254719998,1cyclictest0-21swapper/611:30:008
254719998,1cyclictest0-21swapper/610:54:238
254679990,8cyclictest0-21swapper/509:10:157
254639998,1cyclictest0-21swapper/407:15:176
254639997,1cyclictest0-21swapper/411:35:006
254639990,9cyclictest0-21swapper/412:10:006
254589990,9cyclictest0-21swapper/308:23:565
254589990,8cyclictest31758-21munin-run10:05:015
254429990,9cyclictest0-21swapper/010:05:260
254429990,9cyclictest0-21swapper/010:05:260
254429990,1cyclictest0-21swapper/009:10:130
254429990,1cyclictest0-21swapper/007:28:460
24825291,6sleep90-21swapper/907:05:2811
254989987,1cyclictest0-21swapper/1111:50:143
254989987,1cyclictest0-21swapper/1109:50:183
254989987,1cyclictest0-21swapper/1108:50:143
254989987,1cyclictest0-21swapper/1108:30:003
254989986,2cyclictest18594-21egrep12:35:133
254989986,1cyclictest0-21swapper/1109:05:163
254989980,8cyclictest0-21swapper/1110:40:163
254989980,8cyclictest0-21swapper/1110:25:243
254989980,8cyclictest0-21swapper/1110:25:243
254989980,8cyclictest0-21swapper/1109:20:243
254989980,8cyclictest0-21swapper/1107:40:153
254989980,1cyclictest0-21swapper/1109:56:123
254989980,1cyclictest0-21swapper/1109:35:003
254989980,1cyclictest0-21swapper/1107:50:243
254949987,1cyclictest0-21swapper/1011:01:132
254949987,1cyclictest0-21swapper/1010:50:152
254949987,1cyclictest0-21swapper/1009:55:222
254949987,1cyclictest0-21swapper/1009:25:102
254949980,8cyclictest0-21swapper/1009:40:252
254949980,8cyclictest0-21swapper/1007:10:232
254949980,1cyclictest0-21swapper/1011:55:022
254949980,1cyclictest0-21swapper/1011:35:192
254949980,1cyclictest0-21swapper/1010:30:132
254949980,1cyclictest0-21swapper/1009:35:162
254899987,1cyclictest0-21swapper/908:55:4511
254899987,1cyclictest0-21swapper/908:38:4111
254899987,1cyclictest0-21swapper/907:25:1511
254899986,1cyclictest4425-21hddtemp_smartct12:15:1611
254899985,2cyclictest11833-21idleruntime-cro08:14:5911
254899984,3cyclictest16799-21/usr/sbin/munin10:25:1711
254899984,3cyclictest16799-21/usr/sbin/munin10:25:1611
254899980,8cyclictest0-21swapper/911:50:1811
254899980,8cyclictest0-21swapper/910:56:1111
254899980,8cyclictest0-21swapper/909:30:1711
254899980,8cyclictest0-21swapper/908:15:2511
254899980,1cyclictest0-21swapper/912:20:1811
254899980,1cyclictest0-21swapper/912:10:1711
254899980,1cyclictest0-21swapper/909:40:1811
254859987,1cyclictest0-21swapper/810:55:2010
254859987,1cyclictest0-21swapper/807:10:1710
254859980,8cyclictest0-21swapper/811:05:1510
254859980,8cyclictest0-21swapper/808:55:0110
254859980,7cyclictest11068-21awk10:20:0110
254859980,7cyclictest11068-21awk10:20:0110
254859980,1cyclictest22206-21users10:30:2610
254859980,1cyclictest0-21swapper/807:15:2110
254809987,1cyclictest0-21swapper/711:25:189
254809987,1cyclictest0-21swapper/709:20:239
254809980,8cyclictest0-21swapper/710:15:019
254809980,8cyclictest0-21swapper/710:15:009
254809980,8cyclictest0-21swapper/709:55:139
254809980,8cyclictest0-21swapper/708:00:329
254809980,1cyclictest0-21swapper/708:40:219
254719987,1cyclictest0-21swapper/611:35:198
254719987,1cyclictest0-21swapper/609:30:118
254719987,1cyclictest0-21swapper/609:25:178
254719987,1cyclictest0-21swapper/608:45:008
254719985,2cyclictest0-21swapper/607:30:188
254719980,8cyclictest0-21swapper/611:40:208
254719980,8cyclictest0-21swapper/610:00:178
254719980,8cyclictest0-21swapper/607:40:148
254719980,1cyclictest0-21swapper/607:55:248
254679980,8cyclictest0-21swapper/509:20:137
254679980,7cyclictest0-21swapper/510:41:117
254679980,5cyclictest0-21swapper/507:35:257
254679980,1cyclictest0-21swapper/512:10:187
254639987,1cyclictest0-21swapper/411:35:256
254639987,1cyclictest0-21swapper/409:30:006
254639985,2cyclictest28945-21cpuspeed_turbos10:00:136
254639980,8cyclictest0-21swapper/412:15:166
254639980,8cyclictest0-21swapper/410:20:176
254639980,8cyclictest0-21swapper/410:20:176
254639980,8cyclictest0-21swapper/409:00:176
254639980,8cyclictest0-21swapper/408:55:396
254639980,8cyclictest0-21swapper/408:40:166
254639980,8cyclictest0-21swapper/407:10:226
254639980,3cyclictest11834-21latency_hist08:15:016
254639980,1cyclictest0-21swapper/411:00:216
254639980,1cyclictest0-21swapper/410:45:356
254639980,1cyclictest0-21swapper/410:15:156
254639980,1cyclictest0-21swapper/410:15:156
254639980,1cyclictest0-21swapper/409:40:226
254639980,1cyclictest0-21swapper/409:20:166
254639980,1cyclictest0-21swapper/409:15:236
254639980,1cyclictest0-21swapper/409:05:156
254589987,1cyclictest0-21swapper/308:40:215
254589985,2cyclictest5385-21expr11:35:135
254589980,8cyclictest0-21swapper/309:40:185
254589980,1cyclictest0-21swapper/312:15:235
254589980,1cyclictest0-21swapper/307:10:195
254429987,1cyclictest0-21swapper/010:35:140
254429980,8cyclictest0-21swapper/010:56:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional