You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 23:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot3s.osadl.org (updated Wed May 20, 2026 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591680,51ptp4l0-21swapper/007:06:100
2298826055,3sleep10-21swapper/107:09:361
2291725147,2sleep20-21swapper/207:08:402
2296025046,2sleep30-21swapper/307:09:143
308322470,0sleep20-21swapper/208:20:222
178522440,0sleep10-21swapper/112:00:161
200552420,0sleep30-21swapper/308:00:213
119591190,0ptp4l0-21swapper/110:30:141
119591190,0ptp4l0-21swapper/008:35:200
119591180,0ptp4l0-21swapper/211:30:192
119591180,0ptp4l0-21swapper/108:30:191
119591180,0ptp4l0-21swapper/108:05:181
119591180,0ptp4l0-21swapper/009:10:180
119591170,0ptp4l0-21swapper/112:10:171
119591170,0ptp4l0-21swapper/111:30:131
119591170,0ptp4l0-21swapper/011:00:140
119591170,0ptp4l0-21swapper/009:40:140
119591160,1ptp4l4974-21snmp_o5powerctl12:35:221
119591160,1ptp4l3076-21snmp_o5powerctl10:30:210
119591160,1ptp4l26861-21ntp_states11:15:191
119591160,1ptp4l25151-21ls07:10:241
119591160,1ptp4l24879-21snmp_o5powerctl10:10:220
119591160,0ptp4l0-21swapper/107:25:181
119591160,0ptp4l0-21swapper/107:20:191
119591160,0ptp4l0-21swapper/011:40:150
119591160,0ptp4l0-21swapper/010:45:460
119591160,0ptp4l0-21swapper/010:40:180
119591150,1ptp4l8444-21ls11:40:231
119591150,1ptp4l6587-21snmp_o5powerctl07:35:201
119591150,1ptp4l6069-21users10:35:231
119591150,1ptp4l32145-21cpuspeed_turbos08:25:150
119591150,1ptp4l32131-21aten2.4-expect07:25:130
119591150,1ptp4l30040-21ls11:20:240
119591150,1ptp4l25032-21apt-get11:15:020
119591150,1ptp4l24537-21ls09:10:161
119591150,1ptp4l21478-21snmp_o5powerctl12:05:220
119591150,1ptp4l20558-21diskstats10:05:131
119591150,1ptp4l19084-21hddtemp_smartct08:00:141
119591150,1ptp4l17030-21snmp_o5powerctl08:55:230
119591150,1ptp4l14659-21apt-get10:55:120
119591150,1ptp4l1394-21if_enp0s31f612:30:151
119591150,1ptp4l11150-21snmp_o5powerctl09:45:220
119591150,1ptp4l10981-21/usr/sbin/munin07:45:161
119591150,1ptp4l10660-21perl08:45:140
119591150,0ptp4l0-21swapper/208:15:482
119591150,0ptp4l0-21swapper/112:15:231
119591150,0ptp4l0-21swapper/111:55:231
119591150,0ptp4l0-21swapper/111:45:211
119591150,0ptp4l0-21swapper/111:25:131
119591150,0ptp4l0-21swapper/111:20:131
119591150,0ptp4l0-21swapper/111:13:441
119591150,0ptp4l0-21swapper/111:05:241
119591150,0ptp4l0-21swapper/109:40:231
119591150,0ptp4l0-21swapper/109:30:201
119591150,0ptp4l0-21swapper/108:20:121
119591150,0ptp4l0-21swapper/107:50:331
119591150,0ptp4l0-21swapper/107:30:121
119591150,0ptp4l0-21swapper/012:25:130
119591150,0ptp4l0-21swapper/011:55:130
119591150,0ptp4l0-21swapper/011:35:130
119591140,1ptp4l8007-21expr07:40:131
119591140,1ptp4l6037-21kernelversion07:35:160
119591140,1ptp4l4839-21date07:35:010
119591140,1ptp4l3780-21snmp_o5powerctl08:30:220
119591140,1ptp4l32474-21snmp_o5powerctl11:25:230
119591140,1ptp4l31828-21expr10:25:150
119591140,1ptp4l29219-21smartctl10:20:160
119591140,1ptp4l27658-21cat10:15:231
119591140,1ptp4l27412-21/usr/sbin/munin09:15:181
119591140,1ptp4l27254-21grep07:15:151
119591140,1ptp4l26777-21snmp_o5powerctl12:15:210
119591140,1ptp4l25159-21/usr/sbin/munin08:10:221
119591140,1ptp4l20768-21hddtemp_smartct10:05:140
119591140,1ptp4l20319-21grep12:05:151
119591140,1ptp4l18084-21aten2.4-expect09:00:150
119591140,1ptp4l14389-21snmp_o5powerctl08:50:231
119591140,1ptp4l13303-21/usr/sbin/munin11:50:190
119591140,1ptp4l13064-21/usr/sbin/munin07:50:190
119591140,1ptp4l10539-21df_inode08:45:141
119591140,0ptp4l5451-21ls09:35:180
119591140,0ptp4l27940-21memory07:15:180
119591140,0ptp4l22732-21cstates12:10:140
119591140,0ptp4l0-21swapper/212:30:212
119591140,0ptp4l0-21swapper/112:25:231
119591140,0ptp4l0-21swapper/112:20:131
119591140,0ptp4l0-21swapper/111:50:181
119591140,0ptp4l0-21swapper/111:35:191
119591140,0ptp4l0-21swapper/111:00:171
119591140,0ptp4l0-21swapper/110:55:141
119591140,0ptp4l0-21swapper/110:50:181
119591140,0ptp4l0-21swapper/110:48:201
119591140,0ptp4l0-21swapper/110:40:261
119591140,0ptp4l0-21swapper/110:25:141
119591140,0ptp4l0-21swapper/110:20:191
119591140,0ptp4l0-21swapper/110:10:021
119591140,0ptp4l0-21swapper/110:00:211
119591140,0ptp4l0-21swapper/109:55:191
119591140,0ptp4l0-21swapper/109:27:061
119591140,0ptp4l0-21swapper/109:20:161
119591140,0ptp4l0-21swapper/109:00:201
119591140,0ptp4l0-21swapper/108:55:141
119591140,0ptp4l0-21swapper/108:35:181
119591140,0ptp4l0-21swapper/107:55:221
119591140,0ptp4l0-21swapper/012:00:130
119591140,0ptp4l0-21swapper/011:45:110
119591140,0ptp4l0-21swapper/011:30:020
119591140,0ptp4l0-21swapper/011:05:140
119591140,0ptp4l0-21swapper/010:50:170
119591140,0ptp4l0-21swapper/010:35:120
119591140,0ptp4l0-21swapper/010:15:220
119591140,0ptp4l0-21swapper/010:00:220
119591140,0ptp4l0-21swapper/009:55:220
119591140,0ptp4l0-21swapper/009:05:220
119591140,0ptp4l0-21swapper/008:50:140
119591140,0ptp4l0-21swapper/008:40:180
119591140,0ptp4l0-21swapper/008:10:200
119591140,0ptp4l0-21swapper/007:45:220
119591140,0ptp4l0-21swapper/007:40:220
119591140,0ptp4l0-21swapper/007:20:220
119591130,0ptp4l33-21ksoftirqd/209:50:142
119591130,0ptp4l0-21swapper/310:50:143
119591130,0ptp4l0-21swapper/212:20:192
119591130,0ptp4l0-21swapper/210:45:162
119591130,0ptp4l0-21swapper/210:05:192
119591130,0ptp4l0-21swapper/209:35:162
119591130,0ptp4l0-21swapper/208:40:152
119591130,0ptp4l0-21swapper/207:30:172
119591130,0ptp4l0-21swapper/109:50:121
119591130,0ptp4l0-21swapper/109:45:131
119591130,0ptp4l0-21swapper/109:35:021
119591130,0ptp4l0-21swapper/109:05:141
119591130,0ptp4l0-21swapper/108:40:161
119591130,0ptp4l0-21swapper/108:25:141
119591130,0ptp4l0-21swapper/108:15:141
119591130,0ptp4l0-21swapper/012:35:130
119591130,0ptp4l0-21swapper/012:30:120
119591130,0ptp4l0-21swapper/012:20:150
119591130,0ptp4l0-21swapper/011:10:150
119591130,0ptp4l0-21swapper/009:50:130
119591130,0ptp4l0-21swapper/009:30:120
119591130,0ptp4l0-21swapper/009:25:140
119591130,0ptp4l0-21swapper/009:20:130
119591130,0ptp4l0-21swapper/009:15:120
119591130,0ptp4l0-21swapper/008:20:120
119591130,0ptp4l0-21swapper/008:15:130
119591130,0ptp4l0-21swapper/008:05:180
119591130,0ptp4l0-21swapper/008:00:110
119591130,0ptp4l0-21swapper/007:55:140
119591130,0ptp4l0-21swapper/007:10:010
2328099120,7cyclictest0-21swapper/207:20:122
119591120,1ptp4l28583-21cut10:20:142
119591120,0ptp4l0-21swapper/209:20:162
119591120,0ptp4l0-21swapper/209:15:192
119591120,0ptp4l0-21swapper/208:11:402
119591110,0ptp4l0-21swapper/207:25:252
119591100,0ptp4l0-21swapper/212:15:202
119591100,0ptp4l0-21swapper/211:37:552
119591100,0ptp4l0-21swapper/210:35:192
119591100,0ptp4l0-21swapper/209:03:122
232819997,1cyclictest6179-21chrt10:36:393
232819997,1cyclictest5582-21phc2sys09:35:203
232819997,1cyclictest5015-21tr08:35:113
232819997,1cyclictest3713-21expr12:35:143
232819997,1cyclictest32437-21cat10:25:173
232819997,1cyclictest30909-21cat12:25:153
232819997,1cyclictest28103-21chrt09:16:403
232819997,1cyclictest27853-21taskset11:19:443
232819997,1cyclictest26022-21sed12:15:163
232819997,1cyclictest25088-21cat10:10:233
232819997,1cyclictest22538-21tr08:05:203
232819997,1cyclictest22001-21chrt12:07:303
232819997,1cyclictest18635-21cut11:00:203
232819997,1cyclictest16783-21taskset11:58:423
232819997,1cyclictest16336-21cut08:55:173
232819997,1cyclictest14695-21basename10:55:133
232809997,1cyclictest3296-21ls10:30:222
232809997,1cyclictest28237-21chrt10:19:522
232809997,1cyclictest19697-21seq10:03:212
232809990,8cyclictest22797-21expr12:10:142
11959190,0ptp4l0-21swapper/212:35:552
11959190,0ptp4l0-21swapper/212:26:282
11959190,0ptp4l0-21swapper/212:06:212
11959190,0ptp4l0-21swapper/212:01:582
11959190,0ptp4l0-21swapper/211:51:342
11959190,0ptp4l0-21swapper/211:42:572
11959190,0ptp4l0-21swapper/211:27:212
11959190,0ptp4l0-21swapper/211:21:482
11959190,0ptp4l0-21swapper/211:15:162
11959190,0ptp4l0-21swapper/211:11:302
11959190,0ptp4l0-21swapper/211:07:122
11959190,0ptp4l0-21swapper/211:03:102
11959190,0ptp4l0-21swapper/210:51:542
11959190,0ptp4l0-21swapper/210:43:222
11959190,0ptp4l0-21swapper/210:25:562
11959190,0ptp4l0-21swapper/210:10:512
11959190,0ptp4l0-21swapper/209:57:422
11959190,0ptp4l0-21swapper/209:45:282
11959190,0ptp4l0-21swapper/209:41:582
11959190,0ptp4l0-21swapper/209:30:302
11959190,0ptp4l0-21swapper/209:26:552
11959190,0ptp4l0-21swapper/209:11:172
11959190,0ptp4l0-21swapper/209:05:122
11959190,0ptp4l0-21swapper/208:58:102
11959190,0ptp4l0-21swapper/208:50:122
11959190,0ptp4l0-21swapper/208:46:042
11959190,0ptp4l0-21swapper/208:35:042
11959190,0ptp4l0-21swapper/208:30:082
11959190,0ptp4l0-21swapper/208:29:482
11959190,0ptp4l0-21swapper/208:00:262
11959190,0ptp4l0-21swapper/207:55:012
11959190,0ptp4l0-21swapper/207:51:122
11959190,0ptp4l0-21swapper/207:46:512
11959190,0ptp4l0-21swapper/207:41:002
11959190,0ptp4l0-21swapper/207:36:352
11959190,0ptp4l0-21swapper/207:18:562
11959190,0ptp4l0-21swapper/207:13:212
232819986,1cyclictest9725-21tr09:45:133
232819986,1cyclictest8317-21tr08:40:173
232819986,1cyclictest8078-21ntpq10:40:193
232819986,1cyclictest7665-21aten_r9power_po07:40:133
232819986,1cyclictest7501-21cut11:40:173
232819986,1cyclictest67982sleep309:40:103
232819986,1cyclictest5020-21tr11:35:183
232819986,1cyclictest4934-21aten_r9power_cu07:35:123
232819986,1cyclictest4464-21taskset08:34:343
232819986,1cyclictest32359-21expr07:25:143
232819986,1cyclictest32272-21cat08:25:153
232819986,1cyclictest31413-21tail09:25:133
232819986,1cyclictest31008-21tr11:25:143
232819986,1cyclictest30189-21python10:20:223
232819986,1cyclictest30110-21cut09:20:183
232819986,1cyclictest29409-21basename07:20:123
232819986,1cyclictest28389-21taskset08:15:343
232819986,1cyclictest28156-21aten_r9power_cu11:20:133
232819986,1cyclictest28014-21cut12:20:123
232819986,1cyclictest28003-21cat07:15:193
232819986,1cyclictest26046-21grep10:15:133
232819986,1cyclictest25974-21taskset08:13:293
232819986,1cyclictest23892-21grep07:10:163
232819986,1cyclictest2374-21aten_r9power_vo07:30:133
232819986,1cyclictest23641-21expr09:10:123
232819986,1cyclictest22662-21tr12:10:143
232819986,1cyclictest21082-21cat09:05:143
232819986,1cyclictest20865-21cat10:05:143
232819986,1cyclictest20238-21tr11:05:133
232819986,1cyclictest19837-21latency_hist10:05:013
232819986,1cyclictest19506-21cut09:00:223
232819986,1cyclictest1860-21expr10:30:133
232819986,1cyclictest17938-21taskset07:57:383
232819986,1cyclictest17836-21expr12:00:153
232819986,1cyclictest1532-21basename09:30:123
232819986,1cyclictest15245-21diskstats09:55:143
232819986,1cyclictest13345-21tr07:50:143
232819986,1cyclictest13011-21cat11:50:163
232819986,1cyclictest1286-21aten_r9power_en11:30:123
232819986,1cyclictest12760-21expr09:50:153
232819986,1cyclictest12724-21cut08:50:133
232819986,1cyclictest123052sleep307:45:563
232819986,1cyclictest11839-21sed10:50:023
232819986,1cyclictest11514-21chrt11:49:013
232819986,1cyclictest11276-21ls08:45:173
232819986,1cyclictest1068-21expr12:30:133
232819985,2cyclictest29219-21tr08:20:133
232809986,1cyclictest9506-21expr11:45:122
232809986,1cyclictest21042-21basename08:05:122
232809986,1cyclictest15500-21cut11:55:172
232809980,7cyclictest14696-21cut10:55:132
232819975,1cyclictest24893-21taskset11:13:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional