You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 12:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Tue May 19, 2026 00:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
283491940,84ptp4l0-21swapper/119:08:561
2778827766,9sleep00-21swapper/019:05:040
3094326856,10sleep110-21swapper/1119:08:043
3081526856,10sleep70-21swapper/719:06:119
3012426855,10sleep50-21swapper/519:05:217
3105826647,9sleep60-21swapper/619:09:478
3107226453,9sleep40-21swapper/419:09:576
3091426453,9sleep100-21swapper/1019:07:382
3148299224,11cyclictest0-21swapper/922:25:0011
3144599192,10cyclictest0-21swapper/119:15:001
3144599182,7cyclictest0-21swapper/123:35:001
3147299173,8cyclictest0-21swapper/700:35:029
3146899173,9cyclictest0-21swapper/622:20:008
3145099173,9cyclictest0-21swapper/200:25:014
3145099173,8cyclictest0-21swapper/200:10:004
3144599173,8cyclictest0-21swapper/122:20:001
3144599173,8cyclictest0-21swapper/121:25:001
3144599172,8cyclictest0-21swapper/119:25:001
3144599172,8cyclictest0-21swapper/100:15:001
3144599172,7cyclictest0-21swapper/121:05:001
3147799164,7cyclictest0-21swapper/821:50:0010
3147799163,8cyclictest0-21swapper/819:25:0010
3147799163,7cyclictest0-21swapper/821:00:0010
3147299163,8cyclictest0-21swapper/720:00:009
3147299162,8cyclictest0-21swapper/723:55:009
3146399162,9cyclictest0-21swapper/523:30:017
3144199163,8cyclictest0-21swapper/021:20:000
3144199162,7cyclictest0-21swapper/021:15:000
283491160,0ptp4l0-21swapper/123:45:231
283491160,0ptp4l0-21swapper/121:15:171
283491160,0ptp4l0-21swapper/120:30:121
283491160,0ptp4l0-21swapper/120:05:211
3148299152,8cyclictest0-21swapper/921:05:0011
3148299152,8cyclictest0-21swapper/900:40:0011
3147799152,8cyclictest0-21swapper/822:35:0110
3147799152,8cyclictest0-21swapper/821:10:0010
3147799152,8cyclictest0-21swapper/800:25:0010
3147799152,7cyclictest0-21swapper/822:20:2310
3147799151,8cyclictest0-21swapper/823:00:0110
3147299153,8cyclictest0-21swapper/723:20:009
3147299153,8cyclictest0-21swapper/723:15:009
3147299153,7cyclictest0-21swapper/723:50:019
3147299153,7cyclictest0-21swapper/700:05:009
3147299152,8cyclictest0-21swapper/721:15:009
3144199152,8cyclictest0-21swapper/021:05:000
3144199151,9cyclictest0-21swapper/000:00:250
283491150,1ptp4l21-21ksoftirqd/122:10:221
283491150,1ptp4l21-21ksoftirqd/122:10:221
283491150,1ptp4l16502-21cstates19:30:131
283491150,0ptp4l0-21swapper/121:30:171
283491150,0ptp4l0-21swapper/121:00:151
283491150,0ptp4l0-21swapper/120:45:181
283491150,0ptp4l0-21swapper/100:35:241
12072150,2sleep333-21ksoftirqd/319:50:245
115692150,2sleep863-21ksoftirqd/822:10:1910
115692150,2sleep863-21ksoftirqd/822:10:1810
3148299142,7cyclictest0-21swapper/923:20:2511
3148299142,7cyclictest0-21swapper/923:10:0011
3147299143,7cyclictest0-21swapper/720:35:259
3147299142,8cyclictest5623-21kworker/u24:000:25:009
3146899143,7cyclictest0-21swapper/623:50:248
3146899142,8cyclictest13229-21kworker/u24:220:45:008
3146899142,8cyclictest0-21swapper/622:00:018
3146899142,8cyclictest0-21swapper/622:00:008
3146899142,7cyclictest0-21swapper/622:55:268
3146399142,7cyclictest0-21swapper/520:40:237
3145099142,7cyclictest0-21swapper/223:45:004
3145099142,7cyclictest0-21swapper/220:35:004
3144599143,8cyclictest0-21swapper/119:55:001
3144599142,7cyclictest0-21swapper/123:10:001
31445991410,3cyclictest22954-21cat22:25:191
3144199142,7cyclictest0-21swapper/022:40:000
3144199142,7cyclictest0-21swapper/022:10:240
3144199142,7cyclictest0-21swapper/022:10:230
283491140,1ptp4l21-21ksoftirqd/120:55:251
283491140,0ptp4l0-21swapper/121:35:161
283491140,0ptp4l0-21swapper/121:35:151
283491140,0ptp4l0-21swapper/120:40:181
283491140,0ptp4l0-21swapper/119:15:191
3149299132,7cyclictest0-21swapper/1100:15:003
3149299131,7cyclictest0-21swapper/1120:45:243
3148299132,7cyclictest0-21swapper/922:15:0011
3148299132,7cyclictest0-21swapper/922:15:0011
3148299131,7cyclictest0-21swapper/920:25:0011
3147799133,6cyclictest0-21swapper/821:51:2610
3147799132,7cyclictest0-21swapper/822:40:2110
3147799131,7cyclictest0-21swapper/823:10:2410
3146899133,7cyclictest5623-21kworker/u24:023:55:018
3146399132,7cyclictest0-21swapper/522:15:017
3146399132,7cyclictest0-21swapper/522:15:007
3145499132,6cyclictest0-21swapper/323:05:005
3145499132,6cyclictest0-21swapper/322:15:005
3145499132,6cyclictest0-21swapper/322:15:005
3144599132,7cyclictest0-21swapper/121:50:001
283491130,4ptp4l0-21swapper/120:00:201
283491130,1ptp4l21-21ksoftirqd/122:46:281
283491130,0ptp4l31447-21smartctl21:55:161
283491130,0ptp4l31447-21smartctl21:55:151
283491130,0ptp4l0-21swapper/123:50:151
283491130,0ptp4l0-21swapper/100:15:201
187492130,0sleep10-21swapper/120:15:111
3149299122,6cyclictest0-21swapper/1123:15:013
3148299122,6cyclictest0-21swapper/923:55:0011
3148299122,6cyclictest0-21swapper/922:20:0011
3147299123,8cyclictest0-21swapper/722:15:019
3147299123,8cyclictest0-21swapper/722:15:009
3147299121,7cyclictest0-21swapper/721:45:279
3146399122,6cyclictest0-21swapper/522:25:007
3144199123,5cyclictest0-21swapper/020:50:010
3144199120,11cyclictest24195-21fschecks_time23:10:140
310212126,5sleep90-21swapper/919:09:1311
284682122,7sleep80-21swapper/819:05:1210
283491120,0ptp4l0-21swapper/122:00:151
283491120,0ptp4l0-21swapper/122:00:151
283491120,0ptp4l0-21swapper/121:50:111
283491120,0ptp4l0-21swapper/121:10:131
283491120,0ptp4l0-21swapper/120:51:171
283491120,0ptp4l0-21swapper/119:25:241
283491120,0ptp4l0-21swapper/100:00:241
3149299112,6cyclictest0-21swapper/1121:55:013
3149299111,6cyclictest13229-21kworker/u24:219:45:003
3149299110,11cyclictest0-21swapper/1122:09:563
3149299110,11cyclictest0-21swapper/1122:09:553
3148699110,10cyclictest10202-21wget23:35:112
3147299110,10cyclictest4006-21latency_hist00:10:019
3146899118,2cyclictest4705-21cat20:40:008
3146399112,5cyclictest0-21swapper/521:30:007
3146399111,6cyclictest0-21swapper/520:15:017
3145499111,6cyclictest0-21swapper/319:20:005
3145099111,7cyclictest0-21swapper/220:55:004
3145099110,10cyclictest16733-21cpuspeed20:55:124
3144599110,2cyclictest11400-21basename23:35:151
283491110,4ptp4l21-21ksoftirqd/120:10:121
283491110,2ptp4l8825-21irqrtprio21:25:161
283491110,2ptp4l31188-21latency_hist19:50:001
283491110,2ptp4l2810-21/usr/sbin/munin23:25:121
283491110,2ptp4l26091-21cpuspeed_turbos20:25:121
283491110,2ptp4l23672-21irqrtprio20:20:151
283491110,1ptp4l0-21swapper/122:50:141
283491110,1ptp4l0-21swapper/122:30:181
283491110,1ptp4l0-21swapper/119:35:191
283491110,0ptp4l0-21swapper/123:55:141
283491110,0ptp4l0-21swapper/121:40:011
234222110,0sleep100-21swapper/1023:50:182
3149299102,5cyclictest0-21swapper/1119:40:013
3149299100,1cyclictest0-21swapper/1123:50:003
3148699100,1cyclictest0-21swapper/1019:15:262
3148299106,3cyclictest30724-21cstates21:55:1311
3148299106,3cyclictest30724-21cstates21:55:1211
3148299103,6cyclictest0-21swapper/921:20:0011
3148299102,6cyclictest0-21swapper/919:30:0011
3147799100,9cyclictest0-21swapper/800:00:1610
3147299107,2cyclictest0-21swapper/700:25:159
3147299103,6cyclictest0-21swapper/722:35:019
3146899102,7cyclictest0-21swapper/622:25:008
3146899100,2cyclictest7311-21/usr/sbin/munin21:25:228
3146399100,3cyclictest17373-21sort20:55:157
3145999100,9cyclictest1009-21runrttasks23:55:216
3145499107,2cyclictest28506-21perl19:45:155
3145499102,5cyclictest0-21swapper/300:20:015
3145499101,5cyclictest0-21swapper/322:25:235
3145099102,5cyclictest0-21swapper/223:15:254
3145099102,5cyclictest0-21swapper/220:15:014
3145099100,9cyclictest7641-21tune2fs20:00:134
3144599100,9cyclictest32227-21if_err_p34p123:20:181
3144199107,2cyclictest16153-21ps23:40:200
3144199102,5cyclictest0-21swapper/020:30:010
3144199102,4cyclictest0-21swapper/022:05:000
3144199102,4cyclictest0-21swapper/022:05:000
3144199101,6cyclictest0-21swapper/023:30:000
3144199101,6cyclictest0-21swapper/022:45:230
3144199100,5cyclictest0-21swapper/019:10:220
3144199100,1cyclictest0-21swapper/022:55:010
283491100,2ptp4l27477-21diskmemload22:20:191
283491100,2ptp4l21-21ksoftirqd/123:15:201
283491100,2ptp4l0-21swapper/100:30:191
283491100,1ptp4l6497-21df22:05:141
283491100,1ptp4l6497-21df22:05:131
283491100,1ptp4l375-21cpuspeed_turbos22:40:111
283491100,1ptp4l21-21ksoftirqd/100:25:151
283491100,0ptp4l0-21swapper/123:00:141
283491100,0ptp4l0-21swapper/120:35:201
283491100,0ptp4l0-21swapper/119:55:141
283491100,0ptp4l0-21swapper/100:05:161
314929996,2cyclictest393-21fw_forwarded_lo19:10:153
314929991,5cyclictest0-21swapper/1121:45:003
314929990,9cyclictest0-21swapper/1123:00:203
314929990,1cyclictest0-21swapper/1120:40:233
314869998,1cyclictest0-21swapper/1019:10:152
314869990,1cyclictest17011-21timerandwakeup120:10:242
314869990,1cyclictest0-21swapper/1021:35:232
314869990,1cyclictest0-21swapper/1021:35:222
314869990,1cyclictest0-21swapper/1020:25:142
314829996,2cyclictest6792-21turbostat21:25:0011
314829990,4cyclictest0-21swapper/921:50:0011
314779990,8cyclictest29278-21basename21:10:1510
314779990,8cyclictest14714-21/usr/sbin/munin23:40:1310
314779990,8cyclictest0-21swapper/823:45:2710
314779990,8cyclictest0-21swapper/823:05:1610
314729997,1cyclictest0-21swapper/719:45:209
314729991,7cyclictest24715-21kworker/u24:200:20:009
314689998,1cyclictest0-21swapper/620:10:198
314639991,4cyclictest0-21swapper/500:10:257
314639990,9cyclictest0-21swapper/521:55:237
314639990,9cyclictest0-21swapper/521:55:237
314599998,1cyclictest0-21swapper/421:20:226
314599990,9cyclictest0-21swapper/421:40:146
314599990,9cyclictest0-21swapper/400:35:196
314599990,1cyclictest0-21swapper/420:45:176
314599990,1cyclictest0-21swapper/420:00:226
314549998,1cyclictest0-21swapper/320:40:175
314549996,2cyclictest18226-21turbostat21:44:555
314549991,5cyclictest0-21swapper/323:55:005
314549991,5cyclictest0-21swapper/321:35:005
314549991,5cyclictest0-21swapper/321:35:005
314509998,1cyclictest0-21swapper/223:50:194
314509998,1cyclictest0-21swapper/220:25:124
314509992,6cyclictest0-21swapper/222:51:344
314509991,6cyclictest0-21swapper/222:30:194
314509991,5cyclictest0-21swapper/221:25:004
314459998,1cyclictest0-21swapper/122:55:131
314419996,2cyclictest28066-21munin-run22:35:010
314419991,6cyclictest0-21swapper/020:10:010
314419991,6cyclictest0-21swapper/000:35:010
314419991,5cyclictest0-21swapper/019:45:010
314419990,8cyclictest0-21swapper/019:20:110
314419990,1cyclictest0-21swapper/023:45:160
30948293,5sleep30-21swapper/319:08:085
28349190,0ptp4l0-21swapper/123:40:131
28349190,0ptp4l0-21swapper/123:05:011
28349190,0ptp4l0-21swapper/122:35:131
28349190,0ptp4l0-21swapper/119:40:011
28349190,0ptp4l0-21swapper/100:20:011
314929987,1cyclictest0-21swapper/1119:51:063
314929985,2cyclictest809-21cpuspeed00:05:133
314929981,5cyclictest0-21swapper/1123:35:003
314929981,4cyclictest0-21swapper/1121:40:003
314929981,4cyclictest0-21swapper/1121:40:003
314929980,8cyclictest0-21swapper/1123:07:403
314929980,1cyclictest0-21swapper/1121:05:183
314929980,1cyclictest0-21swapper/1120:55:203
314929980,1cyclictest0-21swapper/1120:20:133
314929980,1cyclictest0-21swapper/1119:25:123
314869987,1cyclictest0-21swapper/1023:25:212
314869987,1cyclictest0-21swapper/1022:25:212
314869987,1cyclictest0-21swapper/1021:10:132
314869987,1cyclictest0-21swapper/1021:00:252
314869987,1cyclictest0-21swapper/1020:50:122
314869980,8cyclictest0-21swapper/1022:51:302
314869980,8cyclictest0-21swapper/1000:25:172
314869980,1cyclictest0-21swapper/1023:40:142
314869980,1cyclictest0-21swapper/1021:50:162
314869980,1cyclictest0-21swapper/1021:40:412
314869980,1cyclictest0-21swapper/1021:20:152
314869980,1cyclictest0-21swapper/1020:20:112
314829987,1cyclictest0-21swapper/922:45:2011
314829987,1cyclictest0-21swapper/920:05:2011
314829980,8cyclictest0-21swapper/921:35:1511
314829980,8cyclictest0-21swapper/921:35:1411
314829980,8cyclictest0-21swapper/920:00:2111
314829980,8cyclictest0-21swapper/919:10:1811
314779982,5cyclictest115650irq/18-p34p123:55:2810
314779982,5cyclictest115650irq/18-p34p123:15:5710
314779982,5cyclictest115650irq/18-p34p122:16:0310
314779982,5cyclictest115650irq/18-p34p122:05:2110
314779982,5cyclictest115650irq/18-p34p122:05:2010
314779982,5cyclictest115650irq/18-p34p121:56:1710
314779982,5cyclictest115650irq/18-p34p121:56:1710
314779982,5cyclictest115650irq/18-p34p121:35:2510
314779982,5cyclictest115650irq/18-p34p121:35:2510
314779982,5cyclictest115650irq/18-p34p100:17:3210
314779982,5cyclictest115650irq/18-p34p100:10:4210
314779980,8cyclictest0-21swapper/823:30:1410
314779980,8cyclictest0-21swapper/822:35:1410
314779980,8cyclictest0-21swapper/820:05:1310
314779980,7cyclictest0-21swapper/821:25:1310
314779980,7cyclictest0-21swapper/821:15:1810
314779980,7cyclictest0-21swapper/820:10:1810
314779980,7cyclictest0-21swapper/819:45:2210
314779980,7cyclictest0-21swapper/819:20:1710
314779980,3cyclictest1009-21runrttasks00:35:1510
314779980,2cyclictest0-21swapper/822:50:0010
314779980,2cyclictest0-21swapper/819:30:1810
314779980,1cyclictest0-21swapper/823:20:1910
314779980,1cyclictest0-21swapper/822:50:1810
314779980,1cyclictest0-21swapper/821:20:2310
314779980,1cyclictest0-21swapper/820:30:1910
314779980,1cyclictest0-21swapper/800:30:1510
314729980,7cyclictest0-21swapper/722:06:339
314729980,7cyclictest0-21swapper/722:06:339
314729980,1cyclictest0-21swapper/720:45:129
314729980,1cyclictest0-21swapper/720:10:189
314689987,1cyclictest0-21swapper/623:20:228
314689980,8cyclictest0-21swapper/600:10:258
314689980,1cyclictest0-21swapper/623:05:128
314689980,1cyclictest0-21swapper/621:40:018
314689980,1cyclictest0-21swapper/621:40:008
314689980,1cyclictest0-21swapper/621:20:248
314639987,1cyclictest0-21swapper/519:35:317
314639987,1cyclictest0-21swapper/519:15:267
314639986,1cyclictest187602sleep523:04:107
314639986,1cyclictest0-21swapper/521:10:167
314639980,8cyclictest0-21swapper/520:45:137
314639980,8cyclictest0-21swapper/519:55:167
314639980,8cyclictest0-21swapper/519:20:157
314639980,7cyclictest0-21swapper/522:29:267
314639980,1cyclictest0-21swapper/520:00:187
314599987,1cyclictest0-21swapper/423:45:216
314599987,1cyclictest0-21swapper/420:35:156
314599987,1cyclictest0-21swapper/400:10:196
314599986,2cyclictest1612-21sed19:50:246
314599980,8cyclictest0-21swapper/423:20:246
314599980,8cyclictest0-21swapper/422:12:456
314599980,8cyclictest0-21swapper/422:12:446
314599980,8cyclictest0-21swapper/421:15:216
314599980,8cyclictest0-21swapper/419:35:216
314599980,8cyclictest0-21swapper/419:20:146
314599980,1cyclictest0-21swapper/421:00:266
314599980,1cyclictest0-21swapper/400:20:176
314599980,1cyclictest0-21swapper/400:00:216
314549985,2cyclictest4951-21cpuspeed_turbos00:10:135
314549982,3cyclictest0-21swapper/320:20:015
314549981,4cyclictest0-21swapper/322:05:015
314549981,4cyclictest0-21swapper/322:05:005
314549980,8cyclictest0-21swapper/323:20:175
314549980,8cyclictest0-21swapper/321:45:485
314549980,8cyclictest0-21swapper/320:30:115
314509987,1cyclictest0-21swapper/221:50:174
314509987,1cyclictest0-21swapper/219:55:144
314509985,2cyclictest21188-21hddtemp_smartct00:30:144
314509983,4cyclictest0-21swapper/222:13:564
314509983,4cyclictest0-21swapper/222:13:564
314509983,2cyclictest0-21swapper/221:14:364
314509982,5cyclictest0-21swapper/200:10:204
314509981,6cyclictest0-21swapper/200:27:564
314509981,5cyclictest0-21swapper/221:40:004
314509981,5cyclictest0-21swapper/221:40:004
314509981,4cyclictest0-21swapper/223:12:544
314509980,8cyclictest0-21swapper/221:30:144
314509980,7cyclictest0-21swapper/221:56:014
314509980,7cyclictest0-21swapper/221:56:014
314419987,1cyclictest0-21swapper/022:20:170
314419984,3cyclictest23016-21tune2fs20:20:110
314419981,4cyclictest0-21swapper/000:15:010
314419980,8cyclictest0-21swapper/023:30:110
314419980,8cyclictest0-21swapper/021:35:180
314419980,8cyclictest0-21swapper/021:35:170
314419980,8cyclictest0-21swapper/021:05:220
314419980,1cyclictest27800-21fschecks_count23:15:160
314419980,1cyclictest0-21swapper/023:50:160
314419980,1cyclictest0-21swapper/023:35:150
314419980,1cyclictest0-21swapper/022:40:150
314419980,1cyclictest0-21swapper/021:45:160
4615270,1sleep90-21swapper/919:15:1511
314929976,1cyclictest0-21swapper/1123:50:333
314929976,1cyclictest0-21swapper/1123:20:443
314929976,1cyclictest0-21swapper/1122:16:073
314929976,1cyclictest0-21swapper/1121:12:293
314929976,1cyclictest0-21swapper/1120:05:083
314929976,1cyclictest0-21swapper/1120:00:213
314929976,1cyclictest0-21swapper/1119:30:153
314929976,1cyclictest0-21swapper/1119:15:143
314929976,1cyclictest0-21swapper/1100:35:073
314929976,1cyclictest0-21swapper/1100:00:253
314929975,1cyclictest0-21swapper/1121:25:123
314929970,7cyclictest0-21swapper/1123:40:123
314929970,7cyclictest0-21swapper/1122:35:223
314929970,7cyclictest0-21swapper/1122:30:183
314929970,7cyclictest0-21swapper/1122:24:563
314929970,7cyclictest0-21swapper/1121:30:083
314929970,7cyclictest0-21swapper/1120:30:423
314929970,7cyclictest0-21swapper/1120:25:113
314929970,7cyclictest0-21swapper/1120:15:153
314929970,7cyclictest0-21swapper/1119:45:013
314929970,7cyclictest0-21swapper/1100:26:153
314929970,7cyclictest0-21swapper/1100:22:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional