You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 15:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Mon Dec 08, 2025 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
94980880,83rtkit-daemon0-21swapper/407:07:366
275991860,59ptp4l0-21swapper/107:09:431
571727059,9sleep110-21swapper/1107:07:333
572926858,8sleep100-21swapper/1007:07:442
572426855,10sleep50-21swapper/507:07:407
574126755,10sleep70-21swapper/707:07:549
572526553,10sleep60-21swapper/607:07:418
281072650,0sleep80-21swapper/811:45:2510
281072650,0sleep80-21swapper/811:45:2510
302362630,0sleep00-21swapper/008:20:170
558526252,8sleep00-21swapper/007:05:350
186872610,0sleep00-21swapper/008:05:160
316472600,0sleep20-21swapper/209:05:134
309842590,0sleep80-21swapper/810:25:2710
127542560,0sleep70-21swapper/710:05:009
190792530,0sleep30-21swapper/311:35:185
190792530,0sleep30-21swapper/311:35:185
130452520,0sleep110-21swapper/1110:45:213
623399191,17cyclictest0-21swapper/210:20:174
623399191,12cyclictest27-21ksoftirqd/207:10:004
622899193,10cyclictest0-21swapper/108:35:001
622499181,16cyclictest0-21swapper/011:55:200
622499181,16cyclictest0-21swapper/011:55:190
626499172,9cyclictest0-21swapper/912:10:0111
626099173,9cyclictest0-21swapper/809:55:0110
626099173,8cyclictest0-21swapper/808:19:5910
626099172,10cyclictest3141-21kworker/u24:309:04:5910
625599171,15cyclictest0-21swapper/707:20:169
625199173,9cyclictest0-21swapper/607:15:018
625199173,8cyclictest0-21swapper/607:30:018
623799171,11cyclictest28086-21kworker/u24:011:30:015
622899173,8cyclictest0-21swapper/107:30:011
622499175,8cyclictest0-21swapper/008:40:000
622499173,8cyclictest0-21swapper/008:50:010
622499171,9cyclictest0-21swapper/008:25:010
275991170,1ptp4l21-21ksoftirqd/107:15:011
626099163,8cyclictest0-21swapper/812:15:1210
623399162,9cyclictest0-21swapper/208:35:004
622899163,9cyclictest0-21swapper/109:15:011
622899163,7cyclictest0-21swapper/107:40:011
622499163,9cyclictest0-21swapper/012:30:000
275991160,0ptp4l0-21swapper/112:15:151
275991160,0ptp4l0-21swapper/112:05:181
275991160,0ptp4l0-21swapper/110:55:161
275991160,0ptp4l0-21swapper/107:55:251
626499153,7cyclictest0-21swapper/909:15:0411
626499152,8cyclictest0-21swapper/910:15:2811
626099153,8cyclictest0-21swapper/809:40:0010
626099153,7cyclictest0-21swapper/810:55:0110
625599153,8cyclictest0-21swapper/709:30:009
625599153,7cyclictest0-21swapper/710:20:269
625599153,7cyclictest0-21swapper/708:55:019
625599152,8cyclictest0-21swapper/708:30:009
6255991511,3cyclictest0-21swapper/710:55:189
625199154,6cyclictest0-21swapper/612:40:018
625199152,8cyclictest0-21swapper/612:25:008
623799152,9cyclictest0-21swapper/308:00:025
623799152,8cyclictest0-21swapper/307:25:015
623399153,8cyclictest0-21swapper/210:40:004
622499153,8cyclictest0-21swapper/011:50:250
622499153,8cyclictest0-21swapper/011:50:240
622499153,7cyclictest0-21swapper/009:00:000
622499152,8cyclictest0-21swapper/011:40:010
622499152,8cyclictest0-21swapper/011:40:010
622499152,8cyclictest0-21swapper/011:25:010
622499151,8cyclictest0-21swapper/011:00:010
58222157,6sleep80-21swapper/807:09:0710
275991150,0ptp4l0-21swapper/112:35:171
275991150,0ptp4l0-21swapper/111:45:181
275991150,0ptp4l0-21swapper/111:45:181
275991150,0ptp4l0-21swapper/110:15:201
275991150,0ptp4l0-21swapper/109:25:221
626499146,4cyclictest0-21swapper/908:30:2611
626499143,7cyclictest0-21swapper/908:20:2611
626499142,8cyclictest0-21swapper/911:40:2511
626499142,8cyclictest0-21swapper/911:40:2511
626499142,7cyclictest0-21swapper/909:10:0011
626099143,7cyclictest0-21swapper/812:30:0010
626099143,7cyclictest0-21swapper/809:25:0010
626099142,7cyclictest0-21swapper/811:55:0010
626099142,7cyclictest0-21swapper/811:55:0010
626099141,8cyclictest0-21swapper/811:30:0010
625599142,6cyclictest0-21swapper/708:00:229
625199142,7cyclictest0-21swapper/607:50:018
625199141,8cyclictest0-21swapper/611:15:008
625199140,9cyclictest0-21swapper/611:10:008
624699142,7cyclictest0-21swapper/509:50:247
624699142,7cyclictest0-21swapper/509:00:017
623399140,9cyclictest0-21swapper/208:20:004
622899142,7cyclictest0-21swapper/108:35:001
622499143,7cyclictest0-21swapper/010:05:000
622499142,7cyclictest0-21swapper/010:50:290
58692140,1sleep11801rcuc/1112:00:173
58692140,1sleep11801rcuc/1112:00:163
275991140,0ptp4l0-21swapper/107:50:221
232312140,0sleep20-21swapper/209:35:154
627399132,7cyclictest0-21swapper/1111:20:013
626499132,7cyclictest0-21swapper/911:25:0011
626499132,6cyclictest0-21swapper/909:40:0011
626099130,2cyclictest0-21swapper/811:00:2110
625599133,6cyclictest0-21swapper/712:05:269
625599132,6cyclictest0-21swapper/711:05:009
625599131,8cyclictest0-21swapper/708:40:239
625199133,7cyclictest28086-21kworker/u24:010:45:018
625199133,6cyclictest0-21swapper/608:35:008
623799132,7cyclictest0-21swapper/312:05:015
623799132,7cyclictest0-21swapper/312:05:005
623799132,7cyclictest0-21swapper/311:35:015
623799132,7cyclictest0-21swapper/309:45:015
623799132,7cyclictest0-21swapper/307:35:015
623799132,7cyclictest0-21swapper/307:25:245
623799132,6cyclictest0-21swapper/309:30:005
623799131,7cyclictest0-21swapper/312:05:005
623399132,7cyclictest0-21swapper/212:35:004
622499132,7cyclictest0-21swapper/008:50:010
622499132,7cyclictest0-21swapper/007:20:000
622499132,6cyclictest0-21swapper/010:20:000
275991130,1ptp4l21-21ksoftirqd/111:30:201
275991130,1ptp4l21-21ksoftirqd/110:40:161
275991130,0ptp4l0-21swapper/112:11:001
275991130,0ptp4l0-21swapper/109:50:131
275991130,0ptp4l0-21swapper/107:40:231
166062130,0sleep100-21swapper/1011:30:252
626099122,7cyclictest0-21swapper/812:15:0110
626099122,6cyclictest0-21swapper/809:55:2410
626099122,6cyclictest0-21swapper/808:05:0210
625599122,6cyclictest0-21swapper/709:50:009
624699122,6cyclictest0-21swapper/511:35:017
624699122,6cyclictest0-21swapper/511:35:007
624699122,6cyclictest0-21swapper/509:35:007
623799121,7cyclictest0-21swapper/309:05:015
623799121,6cyclictest28086-21kworker/u24:010:10:015
622499122,6cyclictest0-21swapper/011:15:250
622499121,8cyclictest3141-21kworker/u24:308:00:000
56482121,5sleep90-21swapper/907:06:3211
275991120,0ptp4l0-21swapper/111:55:001
275991120,0ptp4l0-21swapper/111:55:001
275991120,0ptp4l0-21swapper/111:26:141
275991120,0ptp4l0-21swapper/110:25:251
275991120,0ptp4l0-21swapper/110:20:171
275991120,0ptp4l0-21swapper/110:00:221
275991120,0ptp4l0-21swapper/109:37:161
275991120,0ptp4l0-21swapper/108:50:221
275991120,0ptp4l0-21swapper/108:25:131
275991120,0ptp4l0-21swapper/108:12:551
275991120,0ptp4l0-21swapper/108:07:191
626999118,3cyclictest27306-21sed08:15:182
626499119,1cyclictest0-21swapper/908:19:5411
626499113,7cyclictest0-21swapper/910:50:0011
626499112,7cyclictest0-21swapper/910:40:0111
626499110,6cyclictest0-21swapper/909:30:0111
626099111,6cyclictest3141-21kworker/u24:307:25:0110
625599112,8cyclictest0-21swapper/711:00:309
625599110,10cyclictest5812-21expr09:55:139
625599110,10cyclictest28342-21df_inode12:30:149
625599110,10cyclictest15805-21cut12:15:019
624699112,5cyclictest0-21swapper/511:05:017
624699112,5cyclictest0-21swapper/508:05:267
624699110,6cyclictest0-21swapper/509:10:247
623399113,5cyclictest0-21swapper/207:45:014
623399110,2cyclictest7694-21df09:15:154
622499119,1cyclictest0-21swapper/010:25:260
622499110,6cyclictest0-21swapper/010:20:010
275991110,6ptp4l21-21ksoftirqd/112:30:181
275991110,1ptp4l0-21swapper/111:20:131
275991110,0ptp4l0-21swapper/111:55:191
275991110,0ptp4l0-21swapper/111:55:191
275991110,0ptp4l0-21swapper/111:35:221
275991110,0ptp4l0-21swapper/111:35:221
275991110,0ptp4l0-21swapper/111:00:161
275991110,0ptp4l0-21swapper/109:30:011
275991110,0ptp4l0-21swapper/109:05:201
275991110,0ptp4l0-21swapper/108:40:121
275991110,0ptp4l0-21swapper/108:22:201
217862110,0sleep90-21swapper/908:10:1311
627399101,6cyclictest0-21swapper/1108:39:593
626499108,1cyclictest0-21swapper/907:15:0211
626499102,7cyclictest0-21swapper/907:35:2611
626499102,5cyclictest0-21swapper/911:45:2411
626499102,5cyclictest0-21swapper/911:45:2411
626499100,9cyclictest6525-21/usr/sbin/munin07:10:1511
625599100,9cyclictest0-21swapper/709:50:249
625199103,5cyclictest0-21swapper/608:45:008
624699108,1cyclictest0-21swapper/510:25:187
624699100,9cyclictest22074-21/usr/sbin/munin10:15:217
623799108,1cyclictest0-21swapper/308:55:255
623799100,9cyclictest5567-21kernelversion10:35:195
623799100,9cyclictest0-21swapper/308:40:245
623399107,2cyclictest0-21swapper/210:40:124
623399102,5cyclictest0-21swapper/207:30:014
623399101,6cyclictest0-21swapper/212:10:014
623399100,9cyclictest3215-21cut09:10:124
623399100,9cyclictest20658-40dnf10:15:054
623399100,9cyclictest16308-21cat11:30:254
623399100,2cyclictest0-21swapper/209:30:194
622499108,1cyclictest0-21swapper/012:20:010
275991100,3ptp4l29837-21/usr/sbin/munin09:45:141
275991100,2ptp4l6785-21if_err_p34p109:55:171
275991100,1ptp4l734-21perl10:30:161
275991100,1ptp4l27576-21df11:05:131
275991100,1ptp4l26822-21diskstats09:40:151
275991100,1ptp4l21-21ksoftirqd/112:00:181
275991100,1ptp4l21-21ksoftirqd/112:00:181
275991100,1ptp4l17371-21grep10:10:151
275991100,1ptp4l17136-21fschecks_time08:45:171
275991100,1ptp4l0-21swapper/112:20:211
275991100,1ptp4l0-21swapper/110:05:151
275991100,1ptp4l0-21swapper/108:15:231
275991100,1ptp4l0-21swapper/107:45:221
275991100,0ptp4l0-21swapper/111:40:191
275991100,0ptp4l0-21swapper/111:40:191
275991100,0ptp4l0-21swapper/110:50:181
275991100,0ptp4l0-21swapper/108:00:341
9498090,0rtkit-daemon0-21swapper/807:45:2110
62739998,1cyclictest0-21swapper/1111:45:243
62739998,1cyclictest0-21swapper/1111:45:233
62739990,9cyclictest0-21swapper/1111:50:143
62739990,9cyclictest0-21swapper/1111:50:133
62739990,1cyclictest0-21swapper/1111:40:173
62739990,1cyclictest0-21swapper/1111:40:163
62699990,1cyclictest0-21swapper/1009:10:182
62699990,1cyclictest0-21swapper/1008:00:172
62649996,2cyclictest0-21swapper/909:39:5911
62609997,1cyclictest0-21swapper/811:55:2210
62609997,1cyclictest0-21swapper/811:55:2210
62609990,8cyclictest0-21swapper/810:05:1410
62609990,8cyclictest0-21swapper/808:30:2710
62609990,8cyclictest0-21swapper/807:40:2010
62519996,2cyclictest7900-21turbostat12:05:018
62519996,2cyclictest7900-21turbostat12:05:008
62519990,9cyclictest0-21swapper/609:45:248
62519990,9cyclictest0-21swapper/607:15:178
62519990,1cyclictest0-21swapper/612:15:228
62519990,1cyclictest0-21swapper/609:30:008
62469992,4cyclictest0-21swapper/510:45:017
62469991,6cyclictest0-21swapper/508:45:007
62469990,9cyclictest0-21swapper/511:20:247
62469990,1cyclictest0-21swapper/511:10:157
62429990,1cyclictest0-21swapper/407:10:196
62379990,2cyclictest2333-21diskmemload12:10:275
62339996,2cyclictest0-21swapper/210:27:044
62339990,8cyclictest470-21smart_sda11:10:224
62339990,8cyclictest20385-21/usr/sbin/munin10:55:174
62339990,3cyclictest24722-21fschecks_time08:55:164
62339990,1cyclictest0-21swapper/211:20:144
62249992,6cyclictest0-21swapper/009:30:010
62249990,1cyclictest0-21swapper/012:10:140
27599190,0ptp4l0-21swapper/112:25:121
27599190,0ptp4l0-21swapper/111:15:101
27599190,0ptp4l0-21swapper/111:10:141
27599190,0ptp4l0-21swapper/110:45:151
27599190,0ptp4l0-21swapper/110:35:011
27599190,0ptp4l0-21swapper/109:20:151
27599190,0ptp4l0-21swapper/109:15:031
27599190,0ptp4l0-21swapper/109:00:171
27599190,0ptp4l0-21swapper/108:55:131
27599190,0ptp4l0-21swapper/107:30:131
27599190,0ptp4l0-21swapper/107:20:021
27599190,0ptp4l0-21swapper/107:10:151
62739987,1cyclictest0-21swapper/1112:10:163
62739987,1cyclictest0-21swapper/1108:20:013
62739987,1cyclictest0-21swapper/1108:10:153
62739980,1cyclictest0-21swapper/1112:35:133
62739980,1cyclictest0-21swapper/1112:30:263
62739980,1cyclictest0-21swapper/1109:00:283
62739980,1cyclictest0-21swapper/1107:15:163
62699987,1cyclictest0-21swapper/1009:05:142
62699987,1cyclictest0-21swapper/1008:55:202
62699987,1cyclictest0-21swapper/1008:05:242
62699987,1cyclictest0-21swapper/1007:55:002
62699980,8cyclictest0-21swapper/1009:25:412
62699980,1cyclictest0-21swapper/1012:00:482
62699980,1cyclictest0-21swapper/1012:00:482
62699980,1cyclictest0-21swapper/1011:50:162
62699980,1cyclictest0-21swapper/1011:50:162
62699980,1cyclictest0-21swapper/1011:20:222
62699980,1cyclictest0-21swapper/1011:15:222
62699980,1cyclictest0-21swapper/1010:40:142
62699980,1cyclictest0-21swapper/1010:20:132
62699980,1cyclictest0-21swapper/1007:30:022
62699980,1cyclictest0-21swapper/1007:15:152
62649981,3cyclictest0-21swapper/910:00:1811
62649980,1cyclictest0-21swapper/912:00:5811
62649980,1cyclictest0-21swapper/912:00:5811
62649980,1cyclictest0-21swapper/911:35:1311
62649980,1cyclictest0-21swapper/911:35:1311
62649980,1cyclictest0-21swapper/911:05:1811
62649980,1cyclictest0-21swapper/910:40:2011
62649980,1cyclictest0-21swapper/910:25:2011
62609984,3cyclictest25566-21cut10:20:1510
62609983,4cyclictest7594-21ps07:50:1910
62609980,8cyclictest0-21swapper/811:35:1710
62609980,8cyclictest0-21swapper/811:35:1710
62609980,1cyclictest0-21swapper/807:10:2210
62559987,1cyclictest0-21swapper/711:40:199
62559987,1cyclictest0-21swapper/711:40:199
62559987,1cyclictest0-21swapper/708:45:149
62559985,2cyclictest0-21swapper/707:10:169
62559980,1cyclictest0-21swapper/709:30:259
62559980,1cyclictest0-21swapper/709:05:259
62559980,1cyclictest0-21swapper/707:40:139
62519987,1cyclictest0-21swapper/611:20:018
62519987,1cyclictest0-21swapper/610:05:188
62519980,8cyclictest0-21swapper/612:30:138
62519980,8cyclictest0-21swapper/610:45:238
62519980,8cyclictest0-21swapper/610:35:218
62519980,1cyclictest0-21swapper/609:00:178
62469987,1cyclictest0-21swapper/510:10:207
62469981,6cyclictest3141-21kworker/u24:308:55:017
62469981,4cyclictest0-21swapper/512:15:257
62469980,8cyclictest0-21swapper/511:30:237
62469980,8cyclictest0-21swapper/510:50:127
62469980,8cyclictest0-21swapper/510:45:187
62469980,8cyclictest0-21swapper/509:25:147
62469980,8cyclictest0-21swapper/509:05:387
62469980,8cyclictest0-21swapper/508:00:147
62469980,5cyclictest0-21swapper/507:50:027
62469980,1cyclictest0-21swapper/510:00:197
62429987,1cyclictest0-21swapper/411:50:146
62429987,1cyclictest0-21swapper/411:50:146
62429987,1cyclictest0-21swapper/409:35:146
62429987,1cyclictest0-21swapper/408:35:206
62429985,2cyclictest7896-21turbostat08:35:006
62429980,8cyclictest0-21swapper/412:15:126
62429980,8cyclictest0-21swapper/410:40:196
62429980,7cyclictest0-21swapper/411:55:276
62429980,7cyclictest0-21swapper/411:55:276
62429980,7cyclictest0-21swapper/409:02:256
62429980,1cyclictest0-21swapper/411:26:356
62429980,1cyclictest0-21swapper/411:20:216
62429980,1cyclictest0-21swapper/410:50:196
62429980,1cyclictest0-21swapper/410:46:206
62429980,1cyclictest0-21swapper/407:46:056
62379987,1cyclictest0-21swapper/311:20:175
62379987,1cyclictest0-21swapper/308:15:125
62379987,1cyclictest0-21swapper/308:00:115
62379987,1cyclictest0-21swapper/307:40:155
62379985,2cyclictest11664-21cpuspeed07:15:125
62379980,8cyclictest0-21swapper/311:10:015
62379980,8cyclictest0-21swapper/308:45:165
62379980,8cyclictest0-21swapper/308:35:165
62379980,1cyclictest0-21swapper/309:15:175
62379980,1cyclictest0-21swapper/309:10:175
62339980,8cyclictest0-21swapper/211:40:184
62339980,8cyclictest0-21swapper/211:40:184
62339980,8cyclictest0-21swapper/207:40:164
62339980,7cyclictest24372-21sshd11:00:214
62339980,1cyclictest0-21swapper/211:20:004
62339980,1cyclictest0-21swapper/209:40:174
62339980,1cyclictest0-21swapper/208:10:184
62339980,1cyclictest0-21swapper/207:50:124
62249987,1cyclictest0-21swapper/012:05:000
62249980,8cyclictest0-21swapper/011:00:210
62249980,7cyclictest0-21swapper/012:40:010
62249980,1cyclictest0-21swapper/010:40:180
62249980,1cyclictest0-21swapper/009:35:200
62249980,1cyclictest0-21swapper/008:00:150
62249980,1cyclictest0-21swapper/007:35:260
5696281,5sleep30-21swapper/307:07:135
27609180,1phc2sys0-21swapper/211:05:144
62739976,1cyclictest0-21swapper/1112:25:153
62739976,1cyclictest0-21swapper/1112:21:043
62739976,1cyclictest0-21swapper/1112:05:503
62739976,1cyclictest0-21swapper/1111:10:193
62739976,1cyclictest0-21swapper/1111:00:103
62739976,1cyclictest0-21swapper/1110:51:473
62739976,1cyclictest0-21swapper/1110:40:233
62739976,1cyclictest0-21swapper/1110:35:063
62739976,1cyclictest0-21swapper/1110:25:553
62739976,1cyclictest0-21swapper/1110:20:093
62739976,1cyclictest0-21swapper/1110:05:193
62739976,1cyclictest0-21swapper/1109:57:323
62739976,1cyclictest0-21swapper/1109:50:023
62739976,1cyclictest0-21swapper/1109:45:063
62739976,1cyclictest0-21swapper/1109:41:163
62739976,1cyclictest0-21swapper/1109:22:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional