You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 21:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Thu Dec 11, 2025 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
147232950,0sleep100-21swapper/1011:10:182
275991890,79ptp4l0-21swapper/107:08:461
2068226758,7sleep110-21swapper/1107:08:543
2066326755,10sleep50-21swapper/507:08:357
212132660,0sleep30-21swapper/308:30:185
2057326554,9sleep100-21swapper/1007:07:172
2061026452,10sleep60-21swapper/607:07:488
2059126453,9sleep00-21swapper/007:07:310
2056726453,9sleep40-21swapper/407:07:106
2046426351,10sleep70-21swapper/707:05:389
34772600,0sleep90-21swapper/912:20:1411
10632590,0sleep90-21swapper/908:45:2511
94980530,48rtkit-daemon0-21swapper/807:06:5210
21153992820,8cyclictest0-21swapper/1007:20:272
2115399260,1cyclictest0-21swapper/1008:40:242
2112599211,16cyclictest0-21swapper/409:45:006
2115999180,4cyclictest0-21swapper/1111:30:173
2113499184,9cyclictest0-21swapper/608:50:018
2113499180,4cyclictest0-21swapper/609:50:178
2115999173,9cyclictest0-21swapper/1108:45:003
2113999170,3cyclictest0-21swapper/709:50:169
2113499173,9cyclictest0-21swapper/612:15:018
2113499172,8cyclictest0-21swapper/609:40:008
2113499170,3cyclictest0-21swapper/611:30:188
2112599172,12cyclictest0-21swapper/410:35:016
2112099172,9cyclictest0-21swapper/310:15:005
2112099171,9cyclictest0-21swapper/311:35:015
2111199173,8cyclictest0-21swapper/110:30:001
275991160,0ptp4l0-21swapper/112:20:151
275991160,0ptp4l0-21swapper/108:15:151
2114899164,7cyclictest0-21swapper/912:39:5911
2114399163,11cyclictest0-21swapper/808:25:0010
2113499162,9cyclictest0-21swapper/611:44:598
2112099163,8cyclictest0-21swapper/309:55:005
2112099163,7cyclictest0-21swapper/310:40:005
2111699163,7cyclictest0-21swapper/212:20:234
2760911512,1phc2sys0-21swapper/207:07:404
275991150,1ptp4l21-21ksoftirqd/108:40:161
275991150,0ptp4l0-21swapper/112:15:181
275991150,0ptp4l0-21swapper/110:15:161
2114899152,8cyclictest0-21swapper/911:45:0011
2114399154,7cyclictest0-21swapper/807:15:0110
2114399153,8cyclictest0-21swapper/810:50:0010
2114399153,7cyclictest0-21swapper/809:40:0110
2114399153,7cyclictest0-21swapper/809:10:0010
2114399152,7cyclictest0-21swapper/807:25:0010
2113999152,8cyclictest0-21swapper/709:45:009
2113499152,7cyclictest0-21swapper/611:10:018
21125991512,2cyclictest24311-21turbostat07:55:006
2112099154,6cyclictest0-21swapper/308:00:005
2111699153,8cyclictest0-21swapper/211:35:014
2111699152,10cyclictest0-21swapper/210:00:004
2111199153,8cyclictest0-21swapper/107:25:011
2110799153,7cyclictest0-21swapper/010:25:010
275991140,1ptp4l21-21ksoftirqd/110:40:171
275991140,1ptp4l21-21ksoftirqd/110:10:161
275991140,1ptp4l21-21ksoftirqd/109:35:381
275991140,1ptp4l21-21ksoftirqd/107:30:131
275991140,0ptp4l0-21swapper/109:04:291
275991140,0ptp4l0-21swapper/108:55:171
2115999142,7cyclictest0-21swapper/1110:15:003
2114899142,8cyclictest0-21swapper/911:39:5911
2114899142,8cyclictest0-21swapper/911:25:0111
2114899142,7cyclictest0-21swapper/911:15:2711
2114899142,7cyclictest0-21swapper/909:25:0111
2114399142,7cyclictest0-21swapper/811:20:2410
2114399142,7cyclictest0-21swapper/810:40:0010
2114399141,9cyclictest5978-21kworker/u24:112:05:0110
2113999142,7cyclictest0-21swapper/709:20:019
2113499143,7cyclictest0-21swapper/612:30:318
2113499143,7cyclictest0-21swapper/608:45:018
2113499140,9cyclictest0-21swapper/609:35:008
2112099143,6cyclictest0-21swapper/312:35:015
2112099142,6cyclictest0-21swapper/309:15:015
2111199142,7cyclictest0-21swapper/111:25:001
2110799142,7cyclictest0-21swapper/011:20:010
195562140,0sleep30-21swapper/307:05:205
275991130,6ptp4l21-21ksoftirqd/107:45:001
275991130,5ptp4l21-21ksoftirqd/112:10:241
275991130,2ptp4l17055-21/usr/sbin/munin10:30:201
275991130,1ptp4l21-21ksoftirqd/109:40:381
275991130,1ptp4l21-21ksoftirqd/107:59:561
275991130,0ptp4l0-21swapper/112:30:011
275991130,0ptp4l0-21swapper/110:50:121
2115999132,7cyclictest0-21swapper/1109:25:003
2115999132,7cyclictest0-21swapper/1107:50:243
2115999130,2cyclictest19698-21munin-run09:55:003
2114899132,7cyclictest0-21swapper/912:00:0011
2114899132,7cyclictest0-21swapper/910:05:2411
2114399131,7cyclictest0-21swapper/809:54:5910
21143991311,2cyclictest0-21swapper/811:15:1910
2114399130,7cyclictest7456-21awk08:15:0110
2113999133,6cyclictest0-21swapper/710:45:259
2113999132,7cyclictest0-21swapper/711:55:009
2113499133,6cyclictest0-21swapper/609:10:018
2113499132,7cyclictest0-21swapper/607:55:018
2113499132,7cyclictest0-21swapper/607:25:248
2113499131,10cyclictest5978-21kworker/u24:110:05:008
2113499130,12cyclictest0-21swapper/607:50:008
2112999132,7cyclictest0-21swapper/509:00:017
2112099132,6cyclictest0-21swapper/309:20:235
2111699133,6cyclictest0-21swapper/211:00:004
2111199132,7cyclictest0-21swapper/108:35:261
2111199132,6cyclictest0-21swapper/109:35:001
2111199131,7cyclictest0-21swapper/112:10:001
2111199131,10cyclictest5978-21kworker/u24:109:05:001
2110799132,7cyclictest0-21swapper/009:45:000
2110799130,8cyclictest0-21swapper/011:30:000
275991120,1ptp4l21-21ksoftirqd/112:00:131
275991120,1ptp4l21-21ksoftirqd/109:50:111
275991120,0ptp4l0-21swapper/111:25:011
275991120,0ptp4l0-21swapper/110:56:581
275991120,0ptp4l0-21swapper/109:55:151
275991120,0ptp4l0-21swapper/108:25:141
2115999122,7cyclictest0-21swapper/1112:05:273
2115999122,7cyclictest0-21swapper/1107:25:013
2115999122,6cyclictest0-21swapper/1107:50:013
2115999120,11cyclictest0-21swapper/1108:20:003
2115399122,6cyclictest0-21swapper/1012:40:012
2114899122,7cyclictest0-21swapper/911:00:0111
2114899122,6cyclictest0-21swapper/910:25:0011
2113499122,6cyclictest0-21swapper/610:15:248
2112999122,6cyclictest0-21swapper/509:15:007
2112999122,6cyclictest0-21swapper/507:25:017
2112999121,7cyclictest0-21swapper/508:50:237
2112099122,6cyclictest0-21swapper/310:35:005
2112099121,6cyclictest0-21swapper/310:50:015
21120991210,1cyclictest0-21swapper/307:20:015
2111699122,7cyclictest0-21swapper/211:45:014
2111699122,7cyclictest0-21swapper/209:05:004
2110799123,5cyclictest0-21swapper/010:50:000
2110799122,6cyclictest0-21swapper/009:50:000
2110799121,6cyclictest0-21swapper/012:25:010
2110799120,11cyclictest31490-21cpuspeed_turbos12:15:120
275991110,3ptp4l3626-21fw_conntrack08:50:161
275991110,2ptp4l9106-21perl11:45:171
275991110,2ptp4l8453-21hddtemp_smartct10:20:171
275991110,2ptp4l7927-21sed11:45:011
275991110,2ptp4l4704-21ls08:10:171
275991110,2ptp4l25787-21if_enp1s0.107:15:021
275991110,2ptp4l21299-21cpuspeed_turbos07:50:131
275991110,2ptp4l19885-21tail10:35:171
275991110,2ptp4l15288-21fw_conntrack12:35:171
275991110,2ptp4l13819-21hddtemp_smartct09:45:171
275991110,1ptp4l21-21ksoftirqd/111:15:271
275991110,1ptp4l0-21swapper/112:30:121
275991110,0ptp4l0-21swapper/109:25:121
275991110,0ptp4l0-21swapper/108:30:131
275991110,0ptp4l0-21swapper/107:10:451
2115999117,3cyclictest6491-21aten2_r3power_e08:55:163
2115999112,6cyclictest0-21swapper/1109:30:013
2115999111,6cyclictest0-21swapper/1107:35:013
2115399112,5cyclictest0-21swapper/1010:45:002
2115399110,10cyclictest0-21swapper/1008:00:012
2114899118,2cyclictest14491-21perl07:40:1411
2112999110,7cyclictest5978-21kworker/u24:107:30:007
2112599111,7cyclictest14850irq/20-ata_piix10:55:006
2112099110,3cyclictest17373-21irqstats08:25:205
2112099110,10cyclictest29751-21perl08:00:155
2111699114,5cyclictest0-21swapper/209:35:014
2111699112,6cyclictest0-21swapper/208:15:014
2111699111,7cyclictest0-21swapper/212:30:004
2111699110,11cyclictest0-21swapper/210:50:204
2111699110,10cyclictest13784-21cpuspeed_turbos11:10:154
2111199112,6cyclictest0-21swapper/111:14:591
2110799110,2cyclictest1350-21cpuspeed_turbos09:30:130
275991100,2ptp4l32600-21aten2_r3power_v11:35:161
275991100,1ptp4l9628-21/usr/sbin/munin07:35:131
275991100,1ptp4l31146-21switchtime08:00:231
275991100,1ptp4l25907-21tr09:20:131
275991100,1ptp4l21-21ksoftirqd/111:02:301
275991100,1ptp4l0-21swapper/111:30:151
275991100,0ptp4l0-21swapper/111:55:181
275991100,0ptp4l0-21swapper/109:15:151
275991100,0ptp4l0-21swapper/108:45:151
275991100,0ptp4l0-21swapper/108:22:481
275991100,0ptp4l0-21swapper/108:08:511
2115399103,4cyclictest0-21swapper/1011:50:012
2114399100,9cyclictest28269-21fw_conntrack08:40:1710
2113999107,2cyclictest0-21swapper/708:50:219
2113499107,2cyclictest2912-21hddtemp_smartct10:55:148
2113499106,3cyclictest29115-21expr08:00:138
2113499100,1cyclictest0-21swapper/610:45:148
2113499100,1cyclictest0-21swapper/609:55:238
2112999100,9cyclictest0-21swapper/512:20:187
2112099108,1cyclictest0-21swapper/312:25:165
2112099103,6cyclictest0-21swapper/310:10:005
2112099100,9cyclictest0-21swapper/309:00:195
2112099100,1cyclictest0-21swapper/310:25:265
2111699101,6cyclictest0-21swapper/210:20:004
2110799107,2cyclictest28979-21cut10:05:160
2110799102,5cyclictest0-21swapper/007:45:000
2110799100,2cyclictest12607-21df_inode08:20:130
27599190,1ptp4l28127-21awk10:05:141
27599190,1ptp4l27594-21hddtemp_smartct10:45:171
27599190,1ptp4l18712-21cstates09:10:141
27599190,0ptp4l0-21swapper/111:50:151
27599190,0ptp4l0-21swapper/110:00:131
27599190,0ptp4l0-21swapper/107:45:131
27599190,0ptp4l0-21swapper/107:20:001
211599996,2cyclictest8213-21turbostat09:40:013
211599991,5cyclictest0-21swapper/1112:34:593
211599990,8cyclictest11573-21needreboot07:35:193
211599990,1cyclictest0-21swapper/1112:00:153
211599990,1cyclictest0-21swapper/1111:10:213
211599990,1cyclictest0-21swapper/1110:35:143
211539992,4cyclictest0-21swapper/1008:20:012
211489990,8cyclictest15435-21awk09:05:1611
211489990,1cyclictest0-21swapper/912:25:1611
211439990,9cyclictest0-21swapper/807:50:1510
211439990,1cyclictest0-21swapper/809:20:2510
211399992,4cyclictest0-21swapper/707:45:149
211399990,8cyclictest0-21swapper/711:45:209
211399990,8cyclictest0-21swapper/709:25:149
211349990,9cyclictest0-21swapper/609:00:178
211299998,1cyclictest0-21swapper/508:45:017
211299992,6cyclictest0-21swapper/509:30:257
211299992,4cyclictest0-21swapper/511:15:007
211299991,4cyclictest0-21swapper/510:10:007
211299990,8cyclictest0-21swapper/512:10:017
211299990,5cyclictest0-21swapper/508:20:247
211299990,1cyclictest0-21swapper/511:30:147
211299990,1cyclictest0-21swapper/510:50:207
211299990,1cyclictest0-21swapper/510:45:147
211259990,9cyclictest0-21swapper/411:50:276
211259990,9cyclictest0-21swapper/411:15:186
211259990,8cyclictest0-21swapper/412:24:596
211259990,2cyclictest22277-21hddtemp_smartct11:20:146
211209998,1cyclictest0-21swapper/309:05:155
211209998,1cyclictest0-21swapper/307:45:015
211209997,2cyclictest5342-21timerwakeupswit12:20:235
211209990,1cyclictest0-21swapper/308:45:215
211169992,5cyclictest0-21swapper/209:15:014
211169992,5cyclictest0-21swapper/207:45:014
211169990,8cyclictest492-21sed07:20:244
211119991,5cyclictest0-21swapper/111:05:011
211079998,1cyclictest0-21swapper/011:05:190
211079996,2cyclictest0-21swapper/010:55:140
20389291,6sleep90-21swapper/907:05:2711
211599987,1cyclictest0-21swapper/1109:45:193
211599982,5cyclictest0-21swapper/1109:00:233
211599980,8cyclictest0-21swapper/1111:35:213
211599980,8cyclictest0-21swapper/1110:55:193
211599980,1cyclictest0-21swapper/1108:35:153
211539982,4cyclictest0-21swapper/1009:40:162
211539980,1cyclictest6532-21switchtime11:40:242
211539980,1cyclictest0-21swapper/1009:30:162
211539980,1cyclictest0-21swapper/1008:35:012
211489987,1cyclictest0-21swapper/909:40:2511
211489987,1cyclictest0-21swapper/909:10:1411
211489987,1cyclictest0-21swapper/908:55:2311
211489987,1cyclictest0-21swapper/908:05:1411
211489987,1cyclictest0-21swapper/907:30:1311
211489987,1cyclictest0-21swapper/907:10:2311
211489980,8cyclictest0-21swapper/911:25:1911
211489980,1cyclictest0-21swapper/912:18:2911
211489980,1cyclictest0-21swapper/909:35:2111
211489980,1cyclictest0-21swapper/909:25:2811
211489980,1cyclictest0-21swapper/907:25:1311
211439980,8cyclictest0-21swapper/812:15:4810
211439980,8cyclictest0-21swapper/810:15:2010
211439980,8cyclictest0-21swapper/808:15:1510
211439980,1cyclictest0-21swapper/812:35:2210
211439980,1cyclictest0-21swapper/811:30:2410
211439980,1cyclictest0-21swapper/810:25:1710
211439980,1cyclictest0-21swapper/810:10:2710
211439980,1cyclictest0-21swapper/809:27:2710
211439980,1cyclictest0-21swapper/807:25:2010
211399987,1cyclictest0-21swapper/707:40:099
211399987,1cyclictest0-21swapper/707:25:179
211399983,5cyclictest0-21swapper/709:20:019
211399983,4cyclictest0-21swapper/711:30:009
211399980,8cyclictest0-21swapper/710:05:189
211399980,8cyclictest0-21swapper/708:45:219
211399980,8cyclictest0-21swapper/707:50:189
211399980,3cyclictest0-21swapper/708:10:009
211349987,1cyclictest0-21swapper/608:30:228
211349986,1cyclictest0-21swapper/607:40:128
211349980,8cyclictest0-21swapper/609:45:218
211349980,4cyclictest0-21swapper/611:24:548
211299987,1cyclictest0-21swapper/512:10:167
211299987,1cyclictest0-21swapper/508:10:187
211299986,1cyclictest11273-21turbostat08:20:017
211299980,8cyclictest0-21swapper/512:35:267
211299980,8cyclictest0-21swapper/509:25:207
211299980,8cyclictest0-21swapper/508:05:127
211299980,8cyclictest0-21swapper/507:35:207
211299980,7cyclictest17410-21diskmemload09:44:347
211299980,1cyclictest0-21swapper/509:45:277
211299980,1cyclictest0-21swapper/509:00:297
211299980,1cyclictest0-21swapper/507:40:247
211259987,1cyclictest0-21swapper/410:25:236
211259985,2cyclictest12820-21turbostat07:44:566
211259981,4cyclictest0-21swapper/411:00:246
211259980,2cyclictest8011-21irqrtprio08:55:216
211259980,1cyclictest0-21swapper/410:15:206
211259980,1cyclictest0-21swapper/410:05:176
211259980,1cyclictest0-21swapper/408:50:156
211209987,1cyclictest0-21swapper/309:15:245
211209987,1cyclictest0-21swapper/308:50:135
211209980,8cyclictest0-21swapper/311:47:475
211209980,8cyclictest0-21swapper/307:10:245
211209980,1cyclictest0-21swapper/308:40:225
211169987,1cyclictest0-21swapper/211:00:244
211169987,1cyclictest0-21swapper/208:05:184
211169980,8cyclictest0-21swapper/210:05:134
211169980,8cyclictest0-21swapper/209:45:324
211169980,8cyclictest0-21swapper/209:20:144
211169980,8cyclictest0-21swapper/208:30:234
211169980,8cyclictest0-21swapper/208:15:154
211169980,7cyclictest17410-21diskmemload09:41:284
211169980,7cyclictest13856-21missed_timers08:20:194
211169980,7cyclictest0-21swapper/211:20:184
211169980,2cyclictest11087-21df12:30:134
211169980,1cyclictest0-21swapper/212:15:244
211169980,1cyclictest0-21swapper/210:40:184
211169980,1cyclictest0-21swapper/210:25:134
211169980,1cyclictest0-21swapper/209:50:164
211169980,1cyclictest0-21swapper/209:15:144
211169980,1cyclictest0-21swapper/208:50:244
211169980,1cyclictest0-21swapper/207:50:124
211169980,1cyclictest0-21swapper/207:40:004
211079987,1cyclictest0-21swapper/011:40:150
211079987,1cyclictest0-21swapper/011:35:250
211079986,1cyclictest0-21swapper/010:33:100
211079980,8cyclictest0-21swapper/012:10:200
211079980,7cyclictest0-21swapper/009:55:040
211079980,1cyclictest0-21swapper/009:05:240
11099280,0chrt0-21swapper/1010:25:132
211599976,1cyclictest0-21swapper/1112:24:483
211599976,1cyclictest0-21swapper/1112:15:073
211599976,1cyclictest0-21swapper/1112:10:353
211599976,1cyclictest0-21swapper/1111:26:113
211599976,1cyclictest0-21swapper/1111:05:373
211599976,1cyclictest0-21swapper/1111:00:173
211599976,1cyclictest0-21swapper/1110:21:213
211599976,1cyclictest0-21swapper/1109:55:173
211599976,1cyclictest0-21swapper/1109:18:073
211599976,1cyclictest0-21swapper/1109:06:163
211599976,1cyclictest0-21swapper/1108:30:463
211599976,1cyclictest0-21swapper/1108:25:523
211599976,1cyclictest0-21swapper/1107:42:113
211599976,1cyclictest0-21swapper/1107:25:193
211599974,2cyclictest852-21aten2_r3power_e09:30:133
211599974,2cyclictest1020-21runrttasks09:42:453
211599973,3cyclictest31360-21cut08:45:153
211599972,4cyclictest0-21swapper/1107:15:243
211599970,7cyclictest0-21swapper/1111:55:573
211599970,7cyclictest0-21swapper/1111:46:343
211599970,7cyclictest0-21swapper/1111:40:253
211599970,7cyclictest0-21swapper/1111:20:083
211599970,7cyclictest0-21swapper/1111:15:193
211599970,7cyclictest0-21swapper/1110:45:233
211599970,7cyclictest0-21swapper/1110:18:153
211599970,7cyclictest0-21swapper/1110:05:053
211599970,7cyclictest0-21swapper/1110:00:453
211599970,7cyclictest0-21swapper/1108:21:123
211599970,7cyclictest0-21swapper/1108:12:273
211599970,7cyclictest0-21swapper/1108:00:183
211599970,7cyclictest0-21swapper/1107:55:233
211599970,7cyclictest0-21swapper/1107:10:483
211599970,1cyclictest0-21swapper/1112:35:583
211599970,1cyclictest0-21swapper/1112:26:453
211599970,1cyclictest0-21swapper/1110:50:053
211599970,1cyclictest0-21swapper/1110:43:253
211599970,1cyclictest0-21swapper/1110:32:383
211599970,1cyclictest0-21swapper/1110:26:033
211599970,1cyclictest0-21swapper/1109:10:273
211599970,1cyclictest0-21swapper/1108:52:343
211599970,1cyclictest0-21swapper/1108:05:023
211539976,1cyclictest0-21swapper/1012:25:162
211539976,1cyclictest0-21swapper/1012:20:072
211539976,1cyclictest0-21swapper/1012:15:202
211539976,1cyclictest0-21swapper/1012:06:012
211539976,1cyclictest0-21swapper/1011:57:462
211539976,1cyclictest0-21swapper/1011:35:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional