You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 13:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Mon May 25, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
283491840,64ptp4l0-21swapper/107:06:151
364526956,10sleep110-21swapper/1107:05:133
669626857,9sleep50-21swapper/507:05:547
689926655,9sleep60-21swapper/607:08:558
687126655,9sleep40-21swapper/407:08:306
680726654,10sleep70-21swapper/707:07:329
671726554,9sleep00-21swapper/007:06:130
602826553,9sleep100-21swapper/1007:05:232
236952600,0sleep00-21swapper/011:00:120
254862580,0sleep70-21swapper/709:35:229
155162540,0sleep30-21swapper/312:10:235
45462490,0sleep60-21swapper/612:00:008
60552480,0sleep70-21swapper/709:55:019
60552480,0sleep70-21swapper/709:55:009
731299202,14cyclictest0-21swapper/409:55:016
731299202,14cyclictest0-21swapper/409:55:006
729899193,11cyclictest0-21swapper/211:30:004
729899193,10cyclictest0-21swapper/211:05:004
729899183,10cyclictest0-21swapper/210:05:004
729899183,10cyclictest0-21swapper/210:05:004
733299175,8cyclictest30571-21kworker/u24:111:20:0010
729899173,8cyclictest0-21swapper/208:10:014
728999173,9cyclictest0-21swapper/007:15:010
728999173,8cyclictest0-21swapper/007:50:010
283491170,0ptp4l0-21swapper/111:20:151
7341991615,1cyclictest0-21swapper/1008:10:222
733699163,8cyclictest0-21swapper/908:15:0111
733699161,9cyclictest0-21swapper/909:25:0011
733299163,7cyclictest0-21swapper/809:30:0110
730699162,8cyclictest0-21swapper/309:35:005
730699162,8cyclictest0-21swapper/308:50:265
7306991612,3cyclictest0-21swapper/311:30:155
730699161,10cyclictest0-21swapper/312:30:005
729899163,9cyclictest0-21swapper/208:25:004
729899163,8cyclictest0-21swapper/209:15:014
729899162,8cyclictest0-21swapper/211:40:234
729899162,10cyclictest0-21swapper/212:40:014
67672167,7sleep80-21swapper/807:06:5710
733699153,7cyclictest0-21swapper/911:10:2311
733699153,7cyclictest0-21swapper/910:55:0011
733699152,8cyclictest0-21swapper/911:45:0011
733699152,7cyclictest0-21swapper/909:40:0011
733699152,6cyclictest0-21swapper/907:30:0011
733299153,8cyclictest0-21swapper/811:10:0110
733299153,7cyclictest0-21swapper/808:20:0110
733299152,7cyclictest0-21swapper/811:25:0010
732799152,7cyclictest0-21swapper/712:40:009
732799152,7cyclictest0-21swapper/707:50:019
730699155,6cyclictest0-21swapper/310:15:225
730699154,6cyclictest0-21swapper/311:00:015
730699152,8cyclictest0-21swapper/312:05:235
730699152,8cyclictest0-21swapper/310:30:015
729899152,9cyclictest0-21swapper/208:40:004
729499152,8cyclictest0-21swapper/110:20:011
728999153,8cyclictest0-21swapper/011:45:210
728999153,8cyclictest0-21swapper/008:10:000
728999153,7cyclictest0-21swapper/010:45:010
283491150,1ptp4l21-21ksoftirqd/107:30:201
283491150,0ptp4l0-21swapper/111:30:181
283491150,0ptp4l0-21swapper/109:15:231
200732150,1sleep111009-21runrttasks10:55:113
133482150,2sleep333-21ksoftirqd/307:55:205
734599140,13cyclictest31696-21awk09:05:003
733699142,7cyclictest0-21swapper/912:05:0011
7336991411,2cyclictest0-21swapper/910:20:2211
733699140,13cyclictest0-21swapper/907:24:5611
733299142,8cyclictest0-21swapper/807:45:0010
733299142,7cyclictest0-21swapper/810:10:0110
733299142,7cyclictest0-21swapper/810:10:0010
733299140,1cyclictest0-21swapper/810:30:0010
732799143,7cyclictest0-21swapper/711:50:009
730699143,6cyclictest0-21swapper/309:50:005
730699142,7cyclictest0-21swapper/309:45:015
283491140,0ptp4l0-21swapper/109:50:201
283491140,0ptp4l0-21swapper/109:50:191
283491140,0ptp4l0-21swapper/108:55:121
283491140,0ptp4l0-21swapper/107:25:251
733699132,6cyclictest0-21swapper/910:10:2311
733699132,6cyclictest0-21swapper/910:10:2311
733299132,7cyclictest0-21swapper/807:35:2310
733299131,8cyclictest0-21swapper/811:35:0110
732799133,6cyclictest0-21swapper/710:25:019
732799132,8cyclictest0-21swapper/707:35:009
732799132,7cyclictest0-21swapper/709:40:239
732799130,8cyclictest0-21swapper/711:20:009
732799130,8cyclictest0-21swapper/709:05:249
730699132,7cyclictest0-21swapper/311:20:255
729899132,9cyclictest0-21swapper/209:45:014
729499132,7cyclictest0-21swapper/111:25:011
729499131,8cyclictest0-21swapper/110:30:241
728999133,6cyclictest0-21swapper/012:15:000
728999132,7cyclictest0-21swapper/012:20:000
283491130,1ptp4l21-21ksoftirqd/111:59:331
283491130,1ptp4l21-21ksoftirqd/110:09:331
283491130,1ptp4l21-21ksoftirqd/110:09:331
734199120,1cyclictest0-21swapper/1011:15:142
734199120,11cyclictest0-21swapper/1011:29:562
734199120,11cyclictest0-21swapper/1010:49:552
733299120,7cyclictest0-21swapper/810:04:5610
733299120,7cyclictest0-21swapper/810:04:5510
732799121,7cyclictest24273-21kworker/u24:008:50:019
732399123,6cyclictest0-21swapper/608:40:228
732399122,6cyclictest0-21swapper/612:25:008
732399122,6cyclictest0-21swapper/611:45:008
732399122,6cyclictest0-21swapper/609:30:008
731699121,4cyclictest131rcu_preempt08:35:007
729499122,6cyclictest0-21swapper/112:15:241
728999129,2cyclictest22447-21turbostat09:35:010
728999122,6cyclictest0-21swapper/010:25:010
68632126,5sleep90-21swapper/907:08:2211
283491120,1ptp4l21-21ksoftirqd/108:20:091
283491120,0ptp4l0-21swapper/112:13:101
283491120,0ptp4l0-21swapper/111:52:321
283491120,0ptp4l0-21swapper/111:13:521
283491120,0ptp4l0-21swapper/111:05:281
164472120,0sleep10-21swapper/110:50:121
734599118,2cyclictest20255-21perl09:30:133
734599112,5cyclictest0-21swapper/1107:15:233
733699112,5cyclictest0-21swapper/908:00:0011
733699110,2cyclictest4693-21df_inode09:10:1311
733699110,10cyclictest0-21swapper/907:35:0011
732399118,2cyclictest17853-21fschecks_count08:45:148
731699110,10cyclictest26556-21latency_hist09:40:017
731299112,5cyclictest0-21swapper/408:45:006
728999110,10cyclictest14270-21perl08:40:140
299622110,0sleep40-21swapper/407:35:196
283491110,2ptp4l29175-21df09:00:141
283491110,2ptp4l28481-21cut12:30:111
283491110,2ptp4l21329-21latency_hist10:15:001
283491110,2ptp4l21147-21diskstats12:20:151
283491110,2ptp4l19615-21perl08:05:141
283491110,1ptp4l21-21ksoftirqd/108:45:211
283491110,1ptp4l0-21swapper/112:10:001
283491110,1ptp4l0-21swapper/109:05:141
283491110,1ptp4l0-21swapper/108:30:171
283491110,1ptp4l0-21swapper/107:45:201
283491110,0ptp4l0-21swapper/112:35:171
283491110,0ptp4l0-21swapper/109:20:161
283491110,0ptp4l0-21swapper/107:50:171
734599109,1cyclictest0-21swapper/1110:33:523
734599102,5cyclictest0-21swapper/1110:05:013
734599102,5cyclictest0-21swapper/1110:05:003
734599101,6cyclictest0-21swapper/1107:45:233
734599100,10cyclictest0-21swapper/1108:59:563
734199107,2cyclictest0-21swapper/1009:10:132
734199100,9cyclictest26543-21df11:45:112
734199100,9cyclictest0-21swapper/1011:09:552
734199100,10cyclictest0-21swapper/1009:29:562
733699108,1cyclictest0-21swapper/911:35:0111
733699108,1cyclictest0-21swapper/908:35:0011
733699101,6cyclictest0-21swapper/907:40:0011
733699100,9cyclictest16492-21fw_conntrack09:25:1511
733699100,9cyclictest0-21swapper/912:10:0011
733299107,2cyclictest20876-21perl10:55:1310
732399107,2cyclictest9996-21perl12:05:138
732399100,9cyclictest29607-21ls09:40:238
731699108,1cyclictest0-21swapper/507:15:127
731699103,6cyclictest0-21swapper/510:35:237
731699101,5cyclictest4098-21kworker/u24:012:00:007
731299102,5cyclictest0-21swapper/410:15:016
731299102,5cyclictest0-21swapper/410:15:006
731299101,6cyclictest0-21swapper/410:55:016
730699100,9cyclictest0-21swapper/309:20:145
729499108,1cyclictest10423-21turbostat07:59:551
729499101,5cyclictest0-21swapper/109:45:001
728999109,1cyclictest0-21swapper/010:30:120
728999101,6cyclictest0-21swapper/010:00:000
728999101,6cyclictest0-21swapper/010:00:000
283491100,2ptp4l5812-21memory09:10:181
283491100,2ptp4l28609-21df_inode07:35:121
283491100,2ptp4l26997-21df_inode08:15:141
283491100,2ptp4l18341-21df_inode10:10:121
283491100,1ptp4l16946-21irqrtprio09:25:181
283491100,1ptp4l0-21swapper/110:35:121
283491100,0ptp4l0-21swapper/112:25:171
283491100,0ptp4l0-21swapper/111:00:141
283491100,0ptp4l0-21swapper/109:57:201
283491100,0ptp4l0-21swapper/109:57:201
283491100,0ptp4l0-21swapper/108:25:151
283491100,0ptp4l0-21swapper/107:20:131
9408090,0rtkit-daemon0-21swapper/912:18:2011
73459998,1cyclictest0-21swapper/1111:15:013
73459998,1cyclictest0-21swapper/1109:55:153
73459998,1cyclictest0-21swapper/1109:55:143
73459992,5cyclictest0-21swapper/1110:15:013
73459992,5cyclictest0-21swapper/1110:15:003
73459992,4cyclictest0-21swapper/1107:25:003
73459991,5cyclictest0-21swapper/1111:45:003
73459991,5cyclictest0-21swapper/1111:25:013
73459991,5cyclictest0-21swapper/1108:55:003
73419993,5cyclictest0-21swapper/1008:30:002
73419990,8cyclictest0-21swapper/1011:55:202
73419990,4cyclictest0-21swapper/1009:09:552
73419990,2cyclictest24362-21cat12:25:122
73369998,1cyclictest0-21swapper/912:30:1111
73369998,1cyclictest0-21swapper/909:20:0011
73369997,1cyclictest0-21swapper/908:20:0011
73369990,1cyclictest0-21swapper/911:40:0011
73329990,1cyclictest0-21swapper/809:45:1710
73279990,8cyclictest0-21swapper/708:35:219
73279990,8cyclictest0-21swapper/707:19:559
73279990,2cyclictest6385-21ls09:10:239
73239991,5cyclictest0-21swapper/610:50:018
73239990,9cyclictest0-21swapper/609:00:188
73239990,8cyclictest15952-21irqrtprio11:30:168
73239990,2cyclictest7686-21cat09:15:018
73169996,2cyclictest30664-21turbostat11:10:007
73169993,5cyclictest0-21swapper/509:00:237
73169992,6cyclictest0-21swapper/510:30:017
73169992,6cyclictest0-21swapper/507:25:017
73129992,5cyclictest0-21swapper/411:00:006
73129992,4cyclictest0-21swapper/412:30:006
73129991,5cyclictest0-21swapper/410:00:236
73129991,5cyclictest0-21swapper/410:00:236
73129990,1cyclictest0-21swapper/407:40:116
73069998,1cyclictest0-21swapper/309:15:265
73069990,9cyclictest0-21swapper/308:15:005
73069990,1cyclictest0-21swapper/310:40:175
72989998,1cyclictest0-21swapper/208:15:134
72989996,2cyclictest26260-21turbostat09:40:004
72989996,2cyclictest15382-21sed07:15:234
72989996,2cyclictest0-21swapper/209:45:254
72989995,3cyclictest30353-21sshd11:05:354
72989990,9cyclictest0-21swapper/210:30:134
72989990,1cyclictest0-21swapper/210:25:124
72989990,1cyclictest0-21swapper/207:24:184
72899998,1cyclictest0-21swapper/008:35:250
72899998,1cyclictest0-21swapper/007:15:000
72899993,5cyclictest0-21swapper/011:45:000
72899992,6cyclictest0-21swapper/008:35:000
72899992,6cyclictest0-21swapper/007:40:000
72899990,9cyclictest0-21swapper/012:00:130
72899990,9cyclictest0-21swapper/008:45:120
72899990,1cyclictest0-21swapper/010:10:230
72899990,1cyclictest0-21swapper/010:10:230
6707293,5sleep30-21swapper/307:06:055
28349190,1ptp4l21-21ksoftirqd/111:40:121
28349190,1ptp4l21-21ksoftirqd/111:35:111
28349190,1ptp4l21-21ksoftirqd/110:40:181
28349190,1ptp4l21-21ksoftirqd/110:25:231
28349190,1ptp4l21-21ksoftirqd/110:00:131
28349190,1ptp4l21-21ksoftirqd/110:00:131
28349190,1ptp4l21-21ksoftirqd/109:40:151
28349190,1ptp4l21-21ksoftirqd/109:35:111
28349190,1ptp4l21-21ksoftirqd/108:50:131
28349190,1ptp4l21-21ksoftirqd/108:35:131
28349190,1ptp4l21-21ksoftirqd/108:00:131
28349190,1ptp4l21-21ksoftirqd/107:15:011
28349190,1ptp4l12745-21cstates10:45:121
28349190,0ptp4l0-21swapper/112:00:131
28349190,0ptp4l0-21swapper/111:45:011
28349190,0ptp4l0-21swapper/111:15:111
28349190,0ptp4l0-21swapper/110:55:111
28349190,0ptp4l0-21swapper/110:20:131
28349190,0ptp4l0-21swapper/109:30:121
28349190,0ptp4l0-21swapper/108:40:131
28349190,0ptp4l0-21swapper/108:10:131
28349190,0ptp4l0-21swapper/107:40:131
28349190,0ptp4l0-21swapper/107:10:111
73459987,1cyclictest0-21swapper/1112:10:243
73459987,1cyclictest0-21swapper/1110:25:183
73459987,1cyclictest0-21swapper/1109:40:183
73459987,1cyclictest0-21swapper/1109:15:203
73459981,5cyclictest0-21swapper/1107:30:233
73459981,4cyclictest0-21swapper/1112:00:003
73459981,4cyclictest0-21swapper/1111:35:223
73459980,8cyclictest0-21swapper/1110:40:123
73459980,8cyclictest0-21swapper/1110:15:163
73459980,8cyclictest0-21swapper/1109:20:193
73459980,8cyclictest0-21swapper/1108:10:203
73459980,1cyclictest0-21swapper/1111:45:173
73459980,1cyclictest0-21swapper/1111:25:163
73459980,1cyclictest0-21swapper/1110:50:133
73459980,1cyclictest0-21swapper/1109:05:203
73419980,8cyclictest0-21swapper/1012:35:232
73419980,8cyclictest0-21swapper/1010:10:212
73419980,8cyclictest0-21swapper/1010:10:202
73419980,7cyclictest3183-21diskmemload09:43:472
73369987,1cyclictest0-21swapper/909:50:1711
73369987,1cyclictest0-21swapper/909:50:1611
73369987,1cyclictest0-21swapper/908:40:2311
73369987,1cyclictest0-21swapper/908:35:2011
73369986,1cyclictest0-21swapper/912:29:5511
73369980,8cyclictest0-21swapper/911:21:3511
73369980,8cyclictest0-21swapper/910:35:2011
73369980,8cyclictest0-21swapper/907:10:1711
73329987,1cyclictest0-21swapper/811:25:1410
73329987,1cyclictest0-21swapper/807:35:0010
73329980,1cyclictest0-21swapper/810:25:0110
73329980,1cyclictest0-21swapper/808:20:2010
73279987,1cyclictest0-21swapper/709:15:219
73279980,1cyclictest0-21swapper/712:10:199
73279980,1cyclictest0-21swapper/707:25:149
73239987,1cyclictest0-21swapper/611:10:188
73239987,1cyclictest0-21swapper/607:45:208
73239982,5cyclictest115650irq/18-p34p111:50:038
73239982,5cyclictest115650irq/18-p34p111:25:128
73239982,5cyclictest115650irq/18-p34p110:43:138
73239982,5cyclictest115650irq/18-p34p110:05:348
73239982,5cyclictest115650irq/18-p34p110:05:348
73239982,5cyclictest115650irq/18-p34p109:52:378
73239982,5cyclictest115650irq/18-p34p109:52:368
73239982,5cyclictest115650irq/18-p34p109:45:108
73239982,5cyclictest115650irq/18-p34p109:35:268
73239982,4cyclictest0-21swapper/607:15:008
73239981,4cyclictest0-21swapper/608:55:008
73239980,8cyclictest0-21swapper/610:50:198
73239980,8cyclictest0-21swapper/610:35:128
73239980,7cyclictest3244-21/usr/sbin/munin08:25:198
73239980,7cyclictest24372-21fschecks_count11:00:148
73239980,7cyclictest22502-21fw_conntrack10:15:138
73239980,7cyclictest1-21systemd11:08:168
73239980,7cyclictest11659-21kernelversion10:00:178
73239980,7cyclictest11659-21kernelversion10:00:178
73239980,7cyclictest10188-21latency_hist11:25:008
73239980,3cyclictest8704-21cat09:55:248
73239980,3cyclictest8704-21cat09:55:238
73239980,2cyclictest21788-21/usr/sbin/munin10:55:178
73239980,1cyclictest115650irq/18-p34p108:50:128
73239980,1cyclictest0-21swapper/607:30:158
73169987,1cyclictest0-21swapper/511:00:147
73169987,1cyclictest0-21swapper/507:35:127
73169987,1cyclictest0-21swapper/507:20:187
73169981,5cyclictest0-21swapper/508:55:017
73169980,8cyclictest0-21swapper/510:50:207
73169980,1cyclictest0-21swapper/512:30:157
73169980,1cyclictest0-21swapper/512:20:147
73169980,0cyclictest0-21swapper/510:40:177
73129987,1cyclictest0-21swapper/411:50:176
73129987,1cyclictest0-21swapper/408:55:196
73129982,5cyclictest0-21swapper/408:15:006
73129981,5cyclictest14750irq/20-ata_piix07:30:016
73129981,5cyclictest0-21swapper/409:35:246
73129981,4cyclictest14750irq/20-ata_piix09:20:016
73129981,4cyclictest0-21swapper/408:00:246
73129980,8cyclictest0-21swapper/410:30:226
73129980,8cyclictest0-21swapper/409:40:186
73129980,8cyclictest0-21swapper/409:30:116
73129980,8cyclictest0-21swapper/409:10:226
73129980,8cyclictest0-21swapper/407:10:196
73129980,7cyclictest25677-21latency_hist08:15:006
73129980,1cyclictest0-21swapper/410:40:186
73129980,1cyclictest0-21swapper/408:30:166
73069985,2cyclictest31183-21ps10:25:205
73069980,1cyclictest0-21swapper/312:35:145
73069980,1cyclictest0-21swapper/311:10:205
73069980,1cyclictest0-21swapper/309:35:175
73069980,1cyclictest0-21swapper/307:10:145
72989981,6cyclictest0-21swapper/211:49:304
72989980,8cyclictest0-21swapper/208:30:204
72989980,8cyclictest0-21swapper/208:00:134
72989980,1cyclictest0-21swapper/211:10:144
72989980,1cyclictest0-21swapper/208:40:014
72899987,1cyclictest0-21swapper/009:40:180
72899987,1cyclictest0-21swapper/009:35:170
72899987,1cyclictest0-21swapper/009:10:160
72899987,1cyclictest0-21swapper/009:00:150
72899985,2cyclictest6230-21date11:20:000
72899982,4cyclictest0-21swapper/010:35:040
72899981,4cyclictest0-21swapper/011:09:010
72899980,8cyclictest0-21swapper/011:25:180
72899980,8cyclictest0-21swapper/011:10:170
72899980,8cyclictest0-21swapper/009:25:150
72899980,8cyclictest0-21swapper/008:50:220
73459976,1cyclictest0-21swapper/1112:37:413
73459976,1cyclictest0-21swapper/1112:30:203
73459976,1cyclictest0-21swapper/1111:50:213
73459976,1cyclictest0-21swapper/1111:31:083
73459976,1cyclictest0-21swapper/1110:36:563
73459976,1cyclictest0-21swapper/1108:25:483
73459970,7cyclictest0-21swapper/1112:15:203
73459970,7cyclictest0-21swapper/1111:10:203
73459970,7cyclictest0-21swapper/1110:24:553
73459970,7cyclictest0-21swapper/1109:50:083
73459970,7cyclictest0-21swapper/1109:50:083
73459970,7cyclictest0-21swapper/1109:35:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional