You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 10:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Fri Dec 12, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2759911050,94ptp4l0-21swapper/119:08:401
187721040,0sleep10-21swapper/121:00:201
1109328271,9sleep40-21swapper/419:06:476
1131626855,11sleep50-21swapper/519:10:007
802526554,8sleep70-21swapper/719:05:139
1107026552,10sleep110-21swapper/1119:06:293
10682650,0sleep90-21swapper/922:25:0011
1110226351,10sleep00-21swapper/019:06:540
1128926251,9sleep60-21swapper/619:09:368
1128025948,9sleep100-21swapper/1019:09:282
127612570,0sleep100-21swapper/1023:20:192
215312560,0sleep110-21swapper/1122:50:173
1171399213,14cyclictest0-21swapper/420:50:006
1172299202,11cyclictest0-21swapper/620:30:018
1174399193,10cyclictest0-21swapper/1021:00:282
1170399194,9cyclictest0-21swapper/219:15:014
1170999184,8cyclictest0-21swapper/323:05:005
1169999183,9cyclictest0-21swapper/119:25:011
1169999182,10cyclictest0-21swapper/122:50:011
106232180,0sleep10-21swapper/100:00:161
106232180,0sleep10-21swapper/100:00:151
275991170,1ptp4l0-21swapper/123:20:141
1170399174,8cyclictest0-21swapper/220:40:014
1170399173,9cyclictest0-21swapper/219:25:014
1170399173,9cyclictest0-21swapper/200:35:004
1170399171,2cyclictest0-21swapper/222:00:184
1169999172,14cyclictest0-21swapper/121:25:231
1169499172,9cyclictest0-21swapper/023:35:010
1174799161,8cyclictest0-21swapper/1123:35:003
1173499163,8cyclictest0-21swapper/822:55:0010
1172799163,9cyclictest0-21swapper/720:05:019
1172299162,9cyclictest0-21swapper/621:20:008
1172299162,9cyclictest0-21swapper/600:40:018
1170999163,8cyclictest0-21swapper/320:00:015
1169499163,8cyclictest0-21swapper/000:32:200
1169499163,7cyclictest0-21swapper/023:15:000
11694991612,2cyclictest0-21swapper/023:35:170
275991150,0ptp4l0-21swapper/123:30:131
240282150,0sleep40-21swapper/421:30:146
1174799153,7cyclictest0-21swapper/1123:05:013
1174799150,14cyclictest0-21swapper/1121:50:213
1173899152,8cyclictest0-21swapper/923:05:2611
1172799153,7cyclictest0-21swapper/700:15:279
1172299152,7cyclictest0-21swapper/600:15:008
1171399152,12cyclictest0-21swapper/423:45:006
1170999153,8cyclictest0-21swapper/300:10:015
1170999153,8cyclictest0-21swapper/300:10:005
1170999153,7cyclictest0-21swapper/321:45:275
1170999152,7cyclictest0-21swapper/322:35:005
1170999152,7cyclictest0-21swapper/321:55:005
1170399153,8cyclictest0-21swapper/219:15:244
1169999154,8cyclictest3166-21kworker/u24:021:40:001
1169999153,6cyclictest0-21swapper/122:35:001
1169999152,8cyclictest0-21swapper/119:25:011
1169999150,2cyclictest0-21swapper/121:30:171
1169499152,8cyclictest0-21swapper/020:30:240
275991140,0ptp4l0-21swapper/122:42:071
275991140,0ptp4l0-21swapper/121:42:011
275991140,0ptp4l0-21swapper/100:35:171
1174799143,6cyclictest0-21swapper/1121:25:003
1174799143,6cyclictest0-21swapper/1120:10:003
1174799142,7cyclictest0-21swapper/1121:05:303
1174799141,8cyclictest0-21swapper/1119:15:013
1173899143,7cyclictest0-21swapper/921:10:0011
1173899142,8cyclictest0-21swapper/922:05:2911
1173499143,7cyclictest0-21swapper/822:40:0010
1173499142,7cyclictest0-21swapper/823:30:0010
1173499142,7cyclictest0-21swapper/821:05:0010
1173499142,7cyclictest0-21swapper/819:45:0210
1172799143,6cyclictest0-21swapper/720:55:249
1172299141,8cyclictest0-21swapper/623:20:008
1171399140,3cyclictest0-21swapper/420:55:176
1170999143,7cyclictest0-21swapper/321:31:585
1170999142,8cyclictest0-21swapper/322:20:015
1170999142,8cyclictest0-21swapper/320:00:235
1170999142,7cyclictest0-21swapper/323:25:005
1170999142,7cyclictest0-21swapper/322:00:265
1170999142,7cyclictest0-21swapper/321:10:255
1170399142,6cyclictest0-21swapper/221:00:014
1169999143,7cyclictest0-21swapper/123:50:011
1169999143,7cyclictest0-21swapper/123:50:001
1169999142,8cyclictest0-21swapper/122:25:001
1169999142,8cyclictest0-21swapper/100:20:261
1169999142,7cyclictest0-21swapper/120:50:001
1169999140,8cyclictest0-21swapper/120:40:001
1169499143,7cyclictest0-21swapper/021:20:280
93012130,0sleep50-21swapper/521:50:297
1174399132,7cyclictest0-21swapper/1023:30:242
1174399132,7cyclictest0-21swapper/1019:45:232
1174399130,12cyclictest0-21swapper/1021:49:552
1173899132,7cyclictest0-21swapper/919:50:0111
1173499132,6cyclictest0-21swapper/820:55:0010
1173499131,8cyclictest3166-21kworker/u24:021:55:0010
1172799132,6cyclictest0-21swapper/700:10:009
1172799132,6cyclictest0-21swapper/700:10:009
1172299132,6cyclictest0-21swapper/620:55:008
1171899133,7cyclictest0-21swapper/523:55:017
1171899133,7cyclictest0-21swapper/523:55:007
1170999132,6cyclictest0-21swapper/320:25:005
1170999131,7cyclictest0-21swapper/323:40:005
1169999137,2cyclictest0-21swapper/123:55:171
1169999132,7cyclictest0-21swapper/122:20:001
1169999132,7cyclictest0-21swapper/120:10:001
1169999130,8cyclictest0-21swapper/122:10:011
1169499132,6cyclictest0-21swapper/022:30:000
275991120,3ptp4l0-21swapper/123:15:131
275991120,1ptp4l21-21ksoftirqd/100:19:281
275991120,0ptp4l0-21swapper/122:57:521
275991120,0ptp4l0-21swapper/122:39:191
275991120,0ptp4l0-21swapper/122:26:061
275991120,0ptp4l0-21swapper/122:03:511
275991120,0ptp4l0-21swapper/121:15:181
275991120,0ptp4l0-21swapper/119:45:111
275991120,0ptp4l0-21swapper/100:10:261
1174799122,6cyclictest0-21swapper/1123:00:003
1174799120,3cyclictest27879-21munin-run19:30:013
1173899122,6cyclictest0-21swapper/923:20:0011
1173499122,7cyclictest3166-21kworker/u24:000:30:0010
1172799122,9cyclictest9181-21expr21:10:139
1171899122,6cyclictest0-21swapper/500:40:007
1171899121,7cyclictest0-21swapper/522:00:007
1171399120,11cyclictest8853-21fschecks_time23:15:166
1170999121,6cyclictest0-21swapper/319:30:025
1169999122,6cyclictest0-21swapper/121:50:291
1169999121,7cyclictest0-21swapper/119:35:011
1169499120,8cyclictest3166-21kworker/u24:020:05:010
75222111,8sleep80-21swapper/819:05:0110
275991110,0ptp4l0-21swapper/123:05:061
275991110,0ptp4l0-21swapper/122:11:521
275991110,0ptp4l0-21swapper/120:57:071
275991110,0ptp4l0-21swapper/120:25:521
275991110,0ptp4l0-21swapper/120:23:171
275991110,0ptp4l0-21swapper/119:53:481
275991110,0ptp4l0-21swapper/119:44:481
124532110,0sleep70-21swapper/721:15:149
1174799111,6cyclictest0-21swapper/1119:25:013
1172799111,7cyclictest0-21swapper/723:10:009
1172799110,10cyclictest8682-21cat20:25:269
1171899112,5cyclictest0-21swapper/519:15:017
1171899111,5cyclictest0-21swapper/523:10:007
1170999110,6cyclictest0-21swapper/320:25:275
1169499112,7cyclictest0-21swapper/022:25:000
1169499112,6cyclictest0-21swapper/022:45:000
1169499110,10cyclictest14941-21fschecks_time20:35:180
112992111,4sleep30-21swapper/319:09:455
84202101,6sleep90-21swapper/919:05:1511
275991100,2ptp4l6496-21latency21:05:231
275991100,2ptp4l26312-21fschecks_time20:50:161
275991100,1ptp4l0-21swapper/123:00:271
275991100,1ptp4l0-21swapper/119:15:161
275991100,0ptp4l0-21swapper/123:40:181
275991100,0ptp4l0-21swapper/122:50:181
275991100,0ptp4l0-21swapper/121:12:101
1174799100,5cyclictest0-21swapper/1120:34:553
1173899106,3cyclictest2165-21runrttasks23:50:1011
1173899106,3cyclictest2165-21runrttasks23:50:1011
1173899102,4cyclictest0-21swapper/922:40:0011
1173899100,9cyclictest0-21swapper/920:30:2011
1172799107,2cyclictest20294-21perl23:30:169
1172799107,2cyclictest1279-21/usr/sbin/munin21:40:239
1172799102,5cyclictest0-21swapper/722:35:259
1172799102,5cyclictest0-21swapper/700:10:289
1172799100,1cyclictest0-21swapper/723:35:189
1172299108,1cyclictest0-21swapper/620:20:008
1171399104,5cyclictest14850irq/20-ata_piix19:45:016
1170999108,1cyclictest0-21swapper/320:05:155
1170999100,9cyclictest28877-21hddtemp_smartct21:35:155
1170999100,3cyclictest7139-21chrt19:44:125
1170399107,2cyclictest26136-21sshd22:15:144
1170399101,6cyclictest0-21swapper/222:40:004
1170399100,9cyclictest0-21swapper/222:20:144
1170399100,9cyclictest0-21swapper/200:15:164
1170399100,2cyclictest20366-21perl23:30:154
1170399100,2cyclictest13770-21cat22:40:144
1169499102,4cyclictest0-21swapper/019:55:240
27599190,4ptp4l21-21ksoftirqd/100:05:101
27599190,4ptp4l21-21ksoftirqd/100:05:101
27599190,1ptp4l21-21ksoftirqd/123:50:001
27599190,1ptp4l21-21ksoftirqd/123:50:001
27599190,1ptp4l21-21ksoftirqd/100:30:231
27599190,1ptp4l21-21ksoftirqd/100:25:151
27599190,0ptp4l0-21swapper/123:35:121
27599190,0ptp4l0-21swapper/123:25:011
27599190,0ptp4l0-21swapper/123:10:001
27599190,0ptp4l0-21swapper/121:55:001
27599190,0ptp4l0-21swapper/121:45:151
27599190,0ptp4l0-21swapper/121:20:001
27599190,0ptp4l0-21swapper/120:40:121
27599190,0ptp4l0-21swapper/120:30:141
27599190,0ptp4l0-21swapper/120:15:001
27599190,0ptp4l0-21swapper/120:05:011
27599190,0ptp4l0-21swapper/120:00:121
27599190,0ptp4l0-21swapper/119:55:121
27599190,0ptp4l0-21swapper/119:30:141
27599190,0ptp4l0-21swapper/119:10:011
117479991,5cyclictest0-21swapper/1100:35:293
117479990,8cyclictest0-21swapper/1120:55:183
117439990,9cyclictest0-21swapper/1022:45:182
117439990,8cyclictest0-21swapper/1023:00:222
117439990,1cyclictest0-21swapper/1019:50:142
117389990,8cyclictest0-21swapper/923:00:2811
117349998,1cyclictest0-21swapper/820:10:1410
117349996,2cyclictest23435-21fw_forwarded_lo22:10:1510
117349990,9cyclictest0-21swapper/821:45:1710
117279998,1cyclictest0-21swapper/723:55:009
117279998,1cyclictest0-21swapper/723:55:009
117279998,1cyclictest0-21swapper/721:05:009
117279992,5cyclictest0-21swapper/722:10:009
117279990,9cyclictest0-21swapper/723:15:259
117279990,9cyclictest0-21swapper/722:40:139
117279990,9cyclictest0-21swapper/722:15:009
117279990,9cyclictest0-21swapper/700:00:269
117279990,9cyclictest0-21swapper/700:00:269
117229996,2cyclictest5175-21/usr/sbin/munin19:40:178
117189992,4cyclictest0-21swapper/500:10:007
117189992,4cyclictest0-21swapper/500:10:007
117139997,1cyclictest24158-21perl20:05:166
117139990,9cyclictest0-21swapper/420:20:206
117139990,1cyclictest0-21swapper/423:10:276
117099990,9cyclictest0-21swapper/323:40:245
117099990,9cyclictest0-21swapper/322:45:155
117099990,9cyclictest0-21swapper/300:25:165
117099990,1cyclictest0-21swapper/322:40:175
117099990,1cyclictest0-21swapper/320:45:175
117039998,1cyclictest0-21swapper/219:45:214
117039998,1cyclictest0-21swapper/219:10:014
117039992,4cyclictest0-21swapper/222:10:004
117039990,9cyclictest0-21swapper/221:25:284
117039990,8cyclictest0-21swapper/221:55:224
117039990,8cyclictest0-21swapper/221:00:274
117039990,8cyclictest0-21swapper/219:50:154
117039990,8cyclictest0-21swapper/200:10:214
117039990,3cyclictest31937-21/usr/sbin/munin00:25:284
117039990,3cyclictest27914-21/usr/sbin/munin00:20:264
117039990,3cyclictest11178-21gltestperf00:00:184
117039990,3cyclictest11178-21gltestperf00:00:184
117039990,2cyclictest24681-21sed22:10:244
116949998,1cyclictest0-21swapper/019:20:180
116949992,6cyclictest0-21swapper/020:20:000
116949992,4cyclictest0-21swapper/023:25:160
116949991,7cyclictest3166-21kworker/u24:019:20:010
116949990,8cyclictest0-21swapper/023:05:230
116949990,8cyclictest0-21swapper/020:15:000
117479985,2cyclictest14877-21awk19:55:013
117479980,1cyclictest7964-21diskmemload00:30:233
117439987,1cyclictest0-21swapper/1023:35:222
117439987,1cyclictest0-21swapper/1023:25:182
117439987,1cyclictest0-21swapper/1022:10:002
117439987,1cyclictest0-21swapper/1021:10:222
117439986,1cyclictest0-21swapper/1021:15:272
117439980,8cyclictest0-21swapper/1023:05:272
117439980,8cyclictest0-21swapper/1021:20:182
117439980,8cyclictest0-21swapper/1020:50:262
117389987,1cyclictest0-21swapper/920:10:1411
117389987,1cyclictest0-21swapper/900:10:2911
117389981,5cyclictest9806-21cut20:30:0011
117389980,1cyclictest0-21swapper/923:35:1711
117389980,1cyclictest0-21swapper/923:20:2911
117389980,1cyclictest0-21swapper/921:25:3311
117389980,1cyclictest0-21swapper/920:45:1711
117389980,1cyclictest0-21swapper/920:05:1711
117389980,1cyclictest0-21swapper/919:16:1511
117349987,1cyclictest0-21swapper/823:30:1510
117349987,1cyclictest0-21swapper/823:20:2910
117349980,1cyclictest0-21swapper/822:35:1410
117349980,1cyclictest0-21swapper/821:35:2210
117279987,1cyclictest0-21swapper/722:50:189
117279987,1cyclictest0-21swapper/719:15:209
117279980,8cyclictest0-21swapper/721:50:189
117279980,8cyclictest0-21swapper/721:45:289
117279980,8cyclictest0-21swapper/720:30:149
117279980,1cyclictest10836-21sshd19:47:249
117229987,1cyclictest0-21swapper/623:45:008
117229987,1cyclictest0-21swapper/623:30:138
117229987,1cyclictest0-21swapper/623:10:228
117229987,1cyclictest0-21swapper/619:30:178
117229986,1cyclictest0-21swapper/622:35:018
117229986,1cyclictest0-21swapper/620:10:018
117229982,4cyclictest0-21swapper/600:02:458
117229982,4cyclictest0-21swapper/600:02:448
117229980,1cyclictest0-21swapper/622:45:208
117229980,1cyclictest0-21swapper/621:10:268
117229980,1cyclictest0-21swapper/620:45:198
117189987,1cyclictest0-21swapper/522:20:257
117189986,1cyclictest12666-21expr20:30:247
117189980,8cyclictest0-21swapper/520:25:007
117139987,1cyclictest0-21swapper/419:30:186
117139982,4cyclictest0-21swapper/420:00:016
117139980,8cyclictest0-21swapper/423:05:236
117139980,8cyclictest0-21swapper/422:05:196
117139980,1cyclictest0-21swapper/423:55:236
117139980,1cyclictest0-21swapper/423:20:186
117139980,1cyclictest0-21swapper/422:20:256
117139980,1cyclictest0-21swapper/419:10:186
117099986,1cyclictest0-21swapper/321:25:195
117099980,8cyclictest0-21swapper/321:55:205
117099980,8cyclictest0-21swapper/320:50:335
117099980,1cyclictest0-21swapper/321:15:255
117039982,5cyclictest0-21swapper/223:35:244
117039981,2cyclictest0-21swapper/223:25:194
117039980,8cyclictest0-21swapper/222:55:174
117039980,8cyclictest0-21swapper/222:25:154
117039980,8cyclictest0-21swapper/220:05:154
117039980,8cyclictest0-21swapper/219:55:154
117039980,8cyclictest0-21swapper/200:05:194
117039980,8cyclictest0-21swapper/200:05:194
117039980,7cyclictest1935-21/usr/sbin/munin21:40:274
117039980,7cyclictest0-21swapper/223:05:164
117039980,7cyclictest0-21swapper/221:45:214
117039980,7cyclictest0-21swapper/221:30:184
117039980,7cyclictest0-21swapper/220:40:104
117039980,7cyclictest0-21swapper/219:30:184
117039980,3cyclictest1524-21taskset23:48:384
117039980,3cyclictest1524-21taskset23:48:384
117039980,2cyclictest0-21swapper/222:50:184
117039980,2cyclictest0-21swapper/222:45:184
117039980,1cyclictest0-21swapper/223:55:194
117039980,1cyclictest0-21swapper/219:25:124
117039980,1cyclictest0-21swapper/200:35:184
116949987,1cyclictest0-21swapper/022:45:230
116949987,1cyclictest0-21swapper/022:05:240
116949987,1cyclictest0-21swapper/021:40:160
116949986,1cyclictest0-21swapper/021:30:140
116949982,5cyclictest0-21swapper/022:40:000
116949980,8cyclictest0-21swapper/021:55:200
116949980,1cyclictest0-21swapper/021:25:250
116949980,1cyclictest0-21swapper/000:05:140
116949980,1cyclictest0-21swapper/000:05:140
559270,0sleep100-21swapper/1021:40:212
117479976,1cyclictest0-21swapper/1123:55:483
117479976,1cyclictest0-21swapper/1123:40:023
117479976,1cyclictest0-21swapper/1123:26:573
117479976,1cyclictest0-21swapper/1123:16:033
117479976,1cyclictest0-21swapper/1123:10:023
117479976,1cyclictest0-21swapper/1123:06:363
117479976,1cyclictest0-21swapper/1122:35:013
117479976,1cyclictest0-21swapper/1122:22:053
117479976,1cyclictest0-21swapper/1122:17:023
117479976,1cyclictest0-21swapper/1122:06:423
117479976,1cyclictest0-21swapper/1122:00:193
117479976,1cyclictest0-21swapper/1121:39:223
117479976,1cyclictest0-21swapper/1120:20:133
117479976,1cyclictest0-21swapper/1120:02:533
117479976,1cyclictest0-21swapper/1119:55:213
117479976,1cyclictest0-21swapper/1119:30:253
117479976,1cyclictest0-21swapper/1100:26:523
117479970,7cyclictest0-21swapper/1122:45:213
117479970,7cyclictest0-21swapper/1121:00:153
117479970,7cyclictest0-21swapper/1120:37:333
117479970,7cyclictest0-21swapper/1119:46:053
117479970,7cyclictest0-21swapper/1100:20:243
117479970,7cyclictest0-21swapper/1100:01:323
117479970,7cyclictest0-21swapper/1100:01:323
117479970,1cyclictest0-21swapper/1123:50:023
117479970,1cyclictest0-21swapper/1123:50:023
117479970,1cyclictest0-21swapper/1123:47:373
117479970,1cyclictest0-21swapper/1123:47:363
117479970,1cyclictest0-21swapper/1123:37:193
117479970,1cyclictest0-21swapper/1122:41:193
117479970,1cyclictest0-21swapper/1122:30:503
117479970,1cyclictest0-21swapper/1122:25:093
117479970,1cyclictest0-21swapper/1122:11:373
117479970,1cyclictest0-21swapper/1121:55:593
117479970,1cyclictest0-21swapper/1121:45:083
117479970,1cyclictest0-21swapper/1121:40:063
117479970,1cyclictest0-21swapper/1121:30:403
117479970,1cyclictest0-21swapper/1121:25:303
117479970,1cyclictest0-21swapper/1121:18:223
117479970,1cyclictest0-21swapper/1121:14:033
117479970,1cyclictest0-21swapper/1120:48:583
117479970,1cyclictest0-21swapper/1120:42:023
117479970,1cyclictest0-21swapper/1120:25:293
117479970,1cyclictest0-21swapper/1119:41:033
117479970,1cyclictest0-21swapper/1119:35:203
117479970,1cyclictest0-21swapper/1100:16:093
117479970,1cyclictest0-21swapper/1100:10:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional