You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 07:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Tue Sep 01, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
94080820,76rtkit-daemon0-21swapper/419:05:136
283491810,60ptp4l0-21swapper/119:06:561
1029826856,10sleep110-21swapper/1119:08:573
707926755,10sleep100-21swapper/1019:05:092
1004526755,9sleep50-21swapper/519:05:277
1036826655,9sleep00-21swapper/019:09:590
1008826654,10sleep70-21swapper/719:05:539
1026726554,9sleep60-21swapper/619:08:288
292702490,0sleep80-21swapper/800:30:1410
1077799250,1cyclictest741rcuc/1023:45:152
1076399181,3cyclictest0-21swapper/719:40:189
1075099183,14cyclictest0-21swapper/419:15:006
1074099182,11cyclictest0-21swapper/223:40:014
1073499183,9cyclictest0-21swapper/100:30:001
1077299174,8cyclictest0-21swapper/919:20:0011
1077299173,8cyclictest0-21swapper/921:15:0011
1076899173,9cyclictest0-21swapper/823:25:0110
1075099172,14cyclictest0-21swapper/422:00:006
1075099172,14cyclictest0-21swapper/420:10:006
1074599172,9cyclictest0-21swapper/323:25:235
1074099173,8cyclictest0-21swapper/219:15:244
1074099172,10cyclictest0-21swapper/223:05:024
1073499171,12cyclictest14099-21kworker/u24:020:10:001
1072999170,17cyclictest0-21swapper/020:50:170
1072999170,17cyclictest0-21swapper/020:50:160
283491160,1ptp4l21-21ksoftirqd/122:25:161
283491160,1ptp4l21-21ksoftirqd/100:35:131
283491160,0ptp4l0-21swapper/123:40:181
168732160,0sleep70-21swapper/721:20:189
1077299162,9cyclictest0-21swapper/919:30:0011
1076899163,8cyclictest0-21swapper/821:47:0610
1076899162,8cyclictest0-21swapper/800:00:0010
1076899162,10cyclictest14099-21kworker/u24:020:35:0110
1076899162,10cyclictest14099-21kworker/u24:020:35:0110
1076399162,9cyclictest0-21swapper/720:45:019
1076399162,9cyclictest0-21swapper/720:45:019
1075999162,8cyclictest0-21swapper/623:05:018
1075099162,13cyclictest0-21swapper/420:50:016
1075099162,13cyclictest0-21swapper/420:50:016
1074599163,8cyclictest0-21swapper/321:00:255
1074099163,9cyclictest0-21swapper/223:40:014
1074099163,9cyclictest0-21swapper/220:30:004
1074099163,8cyclictest0-21swapper/200:10:004
1073499164,7cyclictest0-21swapper/121:05:001
1072999163,7cyclictest0-21swapper/019:25:000
101742167,7sleep80-21swapper/819:07:0610
283491150,1ptp4l21-21ksoftirqd/121:05:201
1077299152,8cyclictest0-21swapper/900:10:0011
1076899153,7cyclictest0-21swapper/821:20:2310
1076899151,7cyclictest0-21swapper/823:20:0110
1076399153,8cyclictest0-21swapper/723:00:239
1076399152,7cyclictest0-21swapper/721:45:009
1076399152,7cyclictest0-21swapper/719:15:009
1076399150,3cyclictest0-21swapper/700:10:139
1075999154,6cyclictest0-21swapper/621:20:018
1075999153,7cyclictest0-21swapper/620:25:248
1075999151,2cyclictest0-21swapper/623:10:168
1074599153,7cyclictest0-21swapper/322:50:015
1074099153,8cyclictest0-21swapper/200:35:004
1074099153,8cyclictest0-21swapper/200:20:004
1073499153,7cyclictest0-21swapper/122:40:231
1073499152,8cyclictest0-21swapper/121:45:011
1073499152,8cyclictest0-21swapper/120:15:001
1073499152,8cyclictest0-21swapper/119:25:251
10729991513,1cyclictest18839-21turbostat22:50:010
283491140,1ptp4l21-21ksoftirqd/123:22:021
283491140,1ptp4l21-21ksoftirqd/123:10:281
283491140,0ptp4l0-21swapper/122:30:011
283491140,0ptp4l0-21swapper/122:05:191
250852140,0sleep90-21swapper/922:55:1811
1078199142,7cyclictest0-21swapper/1119:55:003
1077299143,7cyclictest0-21swapper/900:35:0011
1077299142,7cyclictest0-21swapper/921:05:0011
1077299141,8cyclictest0-21swapper/923:40:0111
1076899143,7cyclictest0-21swapper/819:55:0010
1076899142,8cyclictest0-21swapper/821:40:0110
1076899142,7cyclictest0-21swapper/821:15:0010
1076899142,7cyclictest0-21swapper/819:25:0010
1076399142,8cyclictest0-21swapper/721:35:009
1076399142,7cyclictest0-21swapper/722:05:019
1074599142,7cyclictest0-21swapper/322:00:015
1074599142,7cyclictest0-21swapper/300:00:005
1074099142,8cyclictest0-21swapper/221:35:014
1074099142,8cyclictest0-21swapper/200:15:004
1073499142,8cyclictest0-21swapper/120:25:011
101182146,6sleep90-21swapper/919:06:1911
283491130,2ptp4l14540-21latency20:35:191
283491130,2ptp4l14540-21latency20:35:181
283491130,1ptp4l21-21ksoftirqd/123:50:191
283491130,1ptp4l21-21ksoftirqd/122:53:591
283491130,1ptp4l21-21ksoftirqd/121:50:021
283491130,1ptp4l21-21ksoftirqd/120:52:241
283491130,1ptp4l21-21ksoftirqd/120:52:231
283491130,1ptp4l21-21ksoftirqd/120:46:101
283491130,1ptp4l21-21ksoftirqd/120:46:101
283491130,1ptp4l21-21ksoftirqd/120:03:061
283491130,1ptp4l21-21ksoftirqd/119:40:181
283491130,1ptp4l21-21ksoftirqd/119:11:491
283491130,1ptp4l21-21ksoftirqd/100:03:541
140952130,0sleep30-21swapper/321:15:255
1078199133,5cyclictest0-21swapper/1121:30:013
1078199132,7cyclictest0-21swapper/1123:50:003
10777991312,1cyclictest75-21ksoftirqd/1022:15:242
1077799130,1cyclictest0-21swapper/1023:30:172
1077299130,6cyclictest0-21swapper/922:10:0011
1076899132,7cyclictest0-21swapper/822:40:0110
1076899130,12cyclictest0-21swapper/800:19:5910
1076399132,7cyclictest0-21swapper/722:10:259
1076399130,8cyclictest0-21swapper/720:05:019
1075999132,6cyclictest0-21swapper/620:55:028
1075999132,6cyclictest0-21swapper/620:55:018
1075999130,8cyclictest0-21swapper/623:10:018
1075499133,6cyclictest0-21swapper/520:50:017
1075499133,6cyclictest0-21swapper/520:50:017
1075499132,8cyclictest0-21swapper/520:00:007
1074599132,7cyclictest0-21swapper/322:35:025
1074599132,7cyclictest0-21swapper/321:55:015
1074599132,7cyclictest0-21swapper/320:35:015
1074599132,7cyclictest0-21swapper/320:35:015
1073499133,5cyclictest0-21swapper/100:25:011
1072999132,6cyclictest0-21swapper/023:35:010
1072999131,8cyclictest0-21swapper/022:40:010
283491120,6ptp4l21-21ksoftirqd/121:36:151
283491120,6ptp4l0-21swapper/119:54:061
283491120,4ptp4l21-21ksoftirqd/121:30:211
283491120,4ptp4l21-21ksoftirqd/120:15:171
283491120,4ptp4l21-21ksoftirqd/119:55:141
283491120,1ptp4l21-21ksoftirqd/123:30:211
283491120,1ptp4l21-21ksoftirqd/123:08:011
283491120,1ptp4l21-21ksoftirqd/123:00:181
283491120,1ptp4l21-21ksoftirqd/122:15:261
283491120,1ptp4l21-21ksoftirqd/121:59:061
283491120,1ptp4l21-21ksoftirqd/120:25:241
283491120,1ptp4l21-21ksoftirqd/100:10:131
283491120,0ptp4l0-21swapper/122:55:121
283491120,0ptp4l0-21swapper/122:35:151
1076899120,11cyclictest14415-21cpuspeed_turbos23:25:1210
1075999121,7cyclictest0-21swapper/619:30:238
1075999120,1cyclictest0-21swapper/623:59:598
1075499124,5cyclictest0-21swapper/520:20:017
1075499122,6cyclictest0-21swapper/523:15:017
1075499121,7cyclictest0-21swapper/500:00:007
1075499120,7cyclictest0-21swapper/519:45:007
1075099129,2cyclictest0-21swapper/420:00:136
1074599122,6cyclictest0-21swapper/323:10:235
1072999120,7cyclictest0-21swapper/021:15:000
283491110,1ptp4l21-21ksoftirqd/122:10:181
1077299112,5cyclictest0-21swapper/920:15:0011
1077299110,6cyclictest0-21swapper/920:05:0011
1076399112,5cyclictest0-21swapper/723:55:009
1075999110,1cyclictest0-21swapper/619:43:168
1075499112,6cyclictest0-21swapper/523:45:027
1075099118,2cyclictest31594-21switchtime23:45:236
1075099111,6cyclictest0-21swapper/400:10:196
1074099110,10cyclictest0-21swapper/222:05:154
283491100,5ptp4l21-21ksoftirqd/122:45:481
283491100,1ptp4l21-21ksoftirqd/123:55:281
283491100,1ptp4l21-21ksoftirqd/123:19:161
283491100,1ptp4l21-21ksoftirqd/120:55:191
283491100,1ptp4l21-21ksoftirqd/120:55:191
283491100,1ptp4l21-21ksoftirqd/119:45:141
283491100,1ptp4l201rcuc/119:20:151
283491100,0ptp4l0-21swapper/122:20:151
283491100,0ptp4l0-21swapper/119:31:151
258182100,0sleep20-21swapper/222:55:234
1078199107,2cyclictest3594-21memory21:45:193
1078199102,5cyclictest0-21swapper/1123:30:243
1078199102,5cyclictest0-21swapper/1122:40:023
1077799109,1cyclictest741rcuc/1000:00:162
1077799109,1cyclictest0-21swapper/1023:00:222
1077799101,5cyclictest0-21swapper/1020:25:002
1077299102,5cyclictest0-21swapper/919:40:0011
1077299100,9cyclictest23075-21munin-run19:25:0011
1077299100,9cyclictest0-21swapper/900:00:2311
1076899100,9cyclictest1507-21needreboot21:00:2010
1076899100,5cyclictest0-21swapper/821:19:5510
1076399101,6cyclictest0-21swapper/722:10:009
1075499108,1cyclictest0-21swapper/519:35:257
1075499100,9cyclictest0-21swapper/522:15:147
1072999100,9cyclictest26551-21memory00:25:190
28359190,2phc2sys0-21swapper/219:07:074
28349190,1ptp4l21-21ksoftirqd/123:35:131
28349190,1ptp4l21-21ksoftirqd/123:25:121
28349190,1ptp4l21-21ksoftirqd/122:00:011
28349190,1ptp4l21-21ksoftirqd/121:40:121
28349190,1ptp4l21-21ksoftirqd/121:25:131
28349190,1ptp4l21-21ksoftirqd/121:20:011
28349190,1ptp4l21-21ksoftirqd/121:15:141
28349190,1ptp4l21-21ksoftirqd/120:40:141
28349190,1ptp4l21-21ksoftirqd/120:40:141
28349190,1ptp4l21-21ksoftirqd/120:30:011
28349190,1ptp4l21-21ksoftirqd/120:30:011
28349190,1ptp4l21-21ksoftirqd/119:35:141
28349190,1ptp4l21-21ksoftirqd/119:15:011
28349190,1ptp4l21-21ksoftirqd/100:30:131
28349190,1ptp4l21-21ksoftirqd/100:15:111
28349190,0ptp4l0-21swapper/123:45:121
28349190,0ptp4l0-21swapper/121:10:111
28349190,0ptp4l0-21swapper/100:05:001
107819991,5cyclictest0-21swapper/1120:45:003
107819991,5cyclictest0-21swapper/1120:45:003
107819991,5cyclictest0-21swapper/1100:05:003
107779999,0cyclictest0-21swapper/1023:15:132
107779997,1cyclictest10513-21perl21:55:152
107779992,4cyclictest0-21swapper/1022:20:242
107779990,8cyclictest29092-21awk20:15:002
107779990,8cyclictest25844-21irqrtprio20:50:172
107779990,8cyclictest25844-21irqrtprio20:50:172
107729991,6cyclictest0-21swapper/923:10:0111
107729990,8cyclictest14097-21chrt19:12:0711
107729990,8cyclictest0-21swapper/920:20:0011
107689996,2cyclictest19913-21fw_forwarded_lo21:25:1510
107689990,1cyclictest0-21swapper/822:50:2410
107639997,1cyclictest0-21swapper/700:25:189
107639992,5cyclictest0-21swapper/723:15:019
107639990,9cyclictest0-21swapper/723:40:239
107599998,1cyclictest0-21swapper/600:20:168
107599996,2cyclictest0-21swapper/623:25:138
107599990,8cyclictest21609-21hddtemp_smartct20:45:168
107599990,8cyclictest21609-21hddtemp_smartct20:45:168
107599990,8cyclictest0-21swapper/623:45:138
107599990,8cyclictest0-21swapper/622:05:258
107599990,8cyclictest0-21swapper/620:10:158
107549992,4cyclictest0-21swapper/521:35:127
107549991,6cyclictest7941-21kworker/u24:200:20:007
107549990,9cyclictest0-21swapper/521:00:157
107549990,1cyclictest0-21swapper/520:45:257
107549990,1cyclictest0-21swapper/520:45:257
107509998,1cyclictest0-21swapper/423:35:186
107509998,1cyclictest0-21swapper/422:10:256
107509998,1cyclictest0-21swapper/421:47:066
107509996,2cyclictest2161-21turbostat19:40:006
107459992,6cyclictest0-21swapper/319:20:005
107459991,4cyclictest0-21swapper/323:50:235
107409990,9cyclictest0-21swapper/222:15:244
107299992,4cyclictest0-21swapper/021:35:010
107299991,7cyclictest3009-21swap23:50:220
107299990,9cyclictest0-21swapper/023:15:230
107299990,8cyclictest25760-21chrt21:33:370
10290293,5sleep30-21swapper/319:08:495
9017280,0sleep80-21swapper/800:00:1210
107819987,1cyclictest0-21swapper/1122:10:143
107819987,1cyclictest0-21swapper/1119:20:233
107819981,5cyclictest0-21swapper/1121:20:003
107819980,4cyclictest0-21swapper/1100:20:013
107819980,1cyclictest28891-21memory23:00:183
107819980,1cyclictest0-21swapper/1123:05:243
107819980,1cyclictest0-21swapper/1100:35:153
107779987,1cyclictest741rcuc/1000:25:222
107779987,1cyclictest0-21swapper/1023:58:312
107779987,1cyclictest0-21swapper/1022:40:302
107779987,1cyclictest0-21swapper/1022:04:032
107779982,3cyclictest741rcuc/1019:40:002
107779981,4cyclictest0-21swapper/1000:10:002
107779981,1cyclictest741rcuc/1000:30:382
107779981,1cyclictest0-21swapper/1023:43:242
107779980,8cyclictest0-21swapper/1021:45:172
107779980,8cyclictest0-21swapper/1020:45:162
107779980,8cyclictest0-21swapper/1020:45:152
107779980,1cyclictest0-21swapper/1019:40:232
107729987,1cyclictest0-21swapper/922:45:1811
107729987,1cyclictest0-21swapper/921:20:1611
107729986,1cyclictest16201-21sed20:40:0011
107729986,1cyclictest16201-21sed20:40:0011
107729981,4cyclictest0-21swapper/922:00:2111
107729980,8cyclictest0-21swapper/919:45:1811
107729980,1cyclictest0-21swapper/921:25:2211
107689984,3cyclictest27127-21latency_hist19:30:0010
107689980,1cyclictest0-21swapper/819:35:1410
107639987,1cyclictest0-21swapper/721:55:269
107639980,1cyclictest0-21swapper/722:40:019
107639980,1cyclictest0-21swapper/722:25:129
107639980,1cyclictest0-21swapper/720:46:579
107639980,1cyclictest0-21swapper/720:46:579
107599987,1cyclictest0-21swapper/600:30:138
107599982,5cyclictest115650irq/18-p34p123:50:538
107599982,5cyclictest115650irq/18-p34p122:10:028
107599982,5cyclictest115650irq/18-p34p121:45:468
107599982,5cyclictest115650irq/18-p34p121:40:028
107599982,5cyclictest115650irq/18-p34p121:10:048
107599982,5cyclictest115650irq/18-p34p100:39:048
107599982,5cyclictest115650irq/18-p34p100:10:108
107599981,6cyclictest51-21ksoftirqd/621:58:258
107599980,8cyclictest0-21swapper/622:20:158
107599980,8cyclictest0-21swapper/620:15:158
107599980,8cyclictest0-21swapper/619:20:198
107599980,8cyclictest0-21swapper/600:15:138
107599980,7cyclictest22068-21sed22:50:248
107599980,7cyclictest0-21swapper/623:20:168
107599980,7cyclictest0-21swapper/621:25:138
107599980,7cyclictest0-21swapper/620:30:138
107599980,7cyclictest0-21swapper/620:30:138
107599980,7cyclictest0-21swapper/620:00:158
107599980,7cyclictest0-21swapper/600:00:138
107599980,2cyclictest1979-21grep20:20:158
107599980,1cyclictest15971-21/usr/sbin/munin19:15:248
107599980,1cyclictest0-21swapper/622:40:138
107599980,1cyclictest0-21swapper/622:30:188
107599980,1cyclictest0-21swapper/622:15:188
107599980,1cyclictest0-21swapper/621:20:178
107599980,1cyclictest0-21swapper/620:05:238
107549987,1cyclictest0-21swapper/521:25:007
107549987,1cyclictest0-21swapper/520:25:137
107549987,1cyclictest0-21swapper/500:25:197
107549985,2cyclictest22118-21fw_forwarded_lo22:10:167
107549981,6cyclictest0-21swapper/521:10:007
107549980,8cyclictest0-21swapper/523:35:117
107549980,8cyclictest0-21swapper/522:50:217
107549980,8cyclictest0-21swapper/521:30:017
107549980,8cyclictest0-21swapper/520:40:147
107549980,8cyclictest0-21swapper/520:40:147
107549980,7cyclictest0-21swapper/521:46:097
107549980,1cyclictest0-21swapper/520:55:197
107549980,1cyclictest0-21swapper/520:55:187
107509987,1cyclictest0-21swapper/419:45:256
107509987,1cyclictest0-21swapper/419:15:016
107509986,1cyclictest0-21swapper/421:40:136
107509982,5cyclictest6903-21cat21:10:006
107509980,8cyclictest0-21swapper/420:50:116
107509980,8cyclictest0-21swapper/420:50:116
107509980,7cyclictest0-21swapper/400:35:006
107509980,1cyclictest0-21swapper/423:55:246
107509980,1cyclictest0-21swapper/422:25:206
107509980,1cyclictest0-21swapper/400:05:006
107459987,1cyclictest0-21swapper/320:30:015
107459987,1cyclictest0-21swapper/319:25:205
107459980,8cyclictest0-21swapper/319:50:165
107459980,7cyclictest6777-21diskmemload00:05:045
107459980,1cyclictest0-21swapper/322:55:145
107459980,1cyclictest0-21swapper/321:10:185
107409987,1cyclictest0-21swapper/222:50:244
107409987,1cyclictest0-21swapper/220:30:014
107409987,1cyclictest0-21swapper/220:30:014
107409981,3cyclictest0-21swapper/223:45:234
107409980,8cyclictest0-21swapper/219:30:174
107409980,8cyclictest0-21swapper/219:10:264
107409980,1cyclictest0-21swapper/223:10:184
107409980,1cyclictest0-21swapper/223:05:194
107409980,1cyclictest0-21swapper/221:05:194
107409980,1cyclictest0-21swapper/219:50:154
107299987,1cyclictest0-21swapper/023:45:130
107299987,1cyclictest0-21swapper/022:30:010
107299987,1cyclictest0-21swapper/021:00:150
107299987,1cyclictest0-21swapper/000:15:230
107299983,3cyclictest0-21swapper/021:50:000
107299982,4cyclictest0-21swapper/022:10:010
107299981,6cyclictest12608-21ps21:15:180
107299981,6cyclictest0-21swapper/022:55:090
107299980,8cyclictest0-21swapper/021:25:180
107299980,5cyclictest0-21swapper/023:44:270
107299980,4cyclictest0-21swapper/000:12:290
107299980,2cyclictest28932-21expr22:20:140
107299980,1cyclictest0-21swapper/019:35:220
107299980,1cyclictest0-21swapper/000:35:250
736270,0sleep90-21swapper/923:50:1111
107819976,1cyclictest0-21swapper/1123:55:243
107819976,1cyclictest0-21swapper/1123:41:453
107819976,1cyclictest0-21swapper/1122:30:303
107819976,1cyclictest0-21swapper/1122:26:533
107819976,1cyclictest0-21swapper/1121:55:153
107819976,1cyclictest0-21swapper/1121:43:003
107819976,1cyclictest0-21swapper/1120:57:033
107819976,1cyclictest0-21swapper/1120:57:033
107819976,1cyclictest0-21swapper/1120:20:123
107819976,1cyclictest0-21swapper/1120:10:183
107819976,1cyclictest0-21swapper/1119:55:073
107819976,1cyclictest0-21swapper/1119:39:253
107819976,1cyclictest0-21swapper/1119:16:283
107819976,1cyclictest0-21swapper/1100:30:253
107819976,1cyclictest0-21swapper/1100:20:223
107819976,1cyclictest0-21swapper/1100:06:403
107819974,2cyclictest16240-21unixbench_singl22:00:223
107819973,3cyclictest24705-21sed22:55:173
107819970,7cyclictest0-21swapper/1123:35:153
107819970,7cyclictest0-21swapper/1123:29:003
107819970,7cyclictest0-21swapper/1123:21:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional