You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 18:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot3s.osadl.org (updated Thu May 07, 2026 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591710,50ptp4l0-21swapper/007:09:100
119591600,43ptp4l0-21swapper/107:06:581
119591520,30ptp4l0-21swapper/207:05:172
527724944,2sleep30-21swapper/307:05:153
48932430,0sleep20-21swapper/211:05:122
119591220,0ptp4l0-21swapper/007:20:230
119591190,0ptp4l0-21swapper/012:25:240
119591190,0ptp4l0-21swapper/011:20:230
119591190,0ptp4l0-21swapper/009:10:160
119591180,1ptp4l24249-21/usr/sbin/munin11:40:160
119591180,0ptp4l0-21swapper/010:15:190
119591180,0ptp4l0-21swapper/010:03:200
119591170,0ptp4l0-21swapper/109:30:131
119591170,0ptp4l0-21swapper/010:35:210
119591170,0ptp4l0-21swapper/008:20:170
792699169,6cyclictest0-21swapper/209:25:232
119591160,2ptp4l9643-21snmp_o5powerctl07:10:221
119591160,2ptp4l29520-21/usr/sbin/munin08:50:220
119591160,1ptp4l5696-21apt-get08:05:140
119591160,1ptp4l4629-21apt-get12:05:130
119591160,1ptp4l26902-21apt-get08:45:110
119591160,1ptp4l2571-21apt-get08:00:021
119591160,1ptp4l22889-21snmp_o5powerctl09:35:221
119591160,0ptp4l0-21swapper/112:30:131
119591160,0ptp4l0-21swapper/108:14:011
119591160,0ptp4l0-21swapper/009:35:150
119591160,0ptp4l0-21swapper/008:35:180
119591160,0ptp4l0-21swapper/007:26:340
119591150,3ptp4l0-21swapper/012:02:150
119591150,2ptp4l0-21swapper/208:20:182
119591150,1ptp4l792499cyclictest08:00:210
119591150,1ptp4l6987-21snmp_o5powerctl09:05:240
119591150,1ptp4l3348-21ls11:00:171
119591150,1ptp4l28254-21snmp_o5powerctl10:45:190
119591150,1ptp4l2506-21cut10:00:010
119591150,1ptp4l22944-21snmp_o5powerctl10:35:211
119591150,1ptp4l20695-21apt-get11:35:141
119591150,1ptp4l20450-21ls10:30:231
119591150,1ptp4l17600-21snmp_o5powerctl09:25:201
119591150,1ptp4l1611-21ls08:55:241
119591150,1ptp4l14667-21ntp_states09:20:180
119591150,1ptp4l13078-21diskstats12:20:130
119591150,1ptp4l13037-21snmp_o5powerctl07:15:211
119591150,1ptp4l12376-21ntp_states08:15:181
119591150,1ptp4l101ktimersoftd/008:55:130
119591150,0ptp4l0-21swapper/209:55:172
119591150,0ptp4l0-21swapper/111:45:021
119591150,0ptp4l0-21swapper/110:52:061
119591150,0ptp4l0-21swapper/110:20:121
119591150,0ptp4l0-21swapper/110:10:111
119591150,0ptp4l0-21swapper/107:48:331
119591150,0ptp4l0-21swapper/011:32:370
119591150,0ptp4l0-21swapper/011:11:060
119591140,1ptp4l9723-21date12:15:010
119591140,1ptp4l7196-21perf11:10:010
119591140,1ptp4l6596-21unixbench_singl12:05:241
119591140,1ptp4l6052-21hddtemp_smartct10:05:161
119591140,1ptp4l30532-21snmp_o5powerctl11:50:210
119591140,1ptp4l29723-21grep08:50:131
119591140,1ptp4l28667-21ntp_states07:45:180
119591140,1ptp4l27500-21ls11:45:160
119591140,1ptp4l27039-21latency_hist07:45:011
119591140,1ptp4l25213-21cut08:40:170
119591140,1ptp4l22627-21timerwakeupswit12:35:240
119591140,1ptp4l22627-21timerwakeupswit12:35:240
119591140,1ptp4l17686-21ntp_states08:25:181
119591140,1ptp4l17419-21users11:25:231
119591140,1ptp4l16924-21grep08:25:150
119591140,1ptp4l16459-21diskstats10:25:131
119591140,1ptp4l11831-21memory09:15:160
119591140,0ptp4l1875-21apt-config12:00:011
119591140,0ptp4l0-21swapper/112:25:041
119591140,0ptp4l0-21swapper/111:55:221
119591140,0ptp4l0-21swapper/111:40:201
119591140,0ptp4l0-21swapper/110:57:051
119591140,0ptp4l0-21swapper/110:48:021
119591140,0ptp4l0-21swapper/110:40:151
119591140,0ptp4l0-21swapper/110:16:111
119591140,0ptp4l0-21swapper/109:42:361
119591140,0ptp4l0-21swapper/109:20:111
119591140,0ptp4l0-21swapper/109:10:201
119591140,0ptp4l0-21swapper/108:35:141
119591140,0ptp4l0-21swapper/108:30:121
119591140,0ptp4l0-21swapper/108:20:191
119591140,0ptp4l0-21swapper/107:30:211
119591140,0ptp4l0-21swapper/107:20:191
119591140,0ptp4l0-21swapper/011:25:060
119591140,0ptp4l0-21swapper/011:00:200
119591140,0ptp4l0-21swapper/010:57:180
119591140,0ptp4l0-21swapper/010:30:110
119591140,0ptp4l0-21swapper/010:24:440
119591140,0ptp4l0-21swapper/009:53:330
119591140,0ptp4l0-21swapper/009:47:250
119591140,0ptp4l0-21swapper/009:43:430
119591140,0ptp4l0-21swapper/009:00:210
119591140,0ptp4l0-21swapper/008:10:220
119591140,0ptp4l0-21swapper/007:40:130
792699136,5cyclictest0-21swapper/212:10:222
119591130,0ptp4l31246-21netstat07:50:171
119591130,0ptp4l0-21swapper/212:35:162
119591130,0ptp4l0-21swapper/212:35:152
119591130,0ptp4l0-21swapper/212:05:142
119591130,0ptp4l0-21swapper/211:40:182
119591130,0ptp4l0-21swapper/210:25:182
119591130,0ptp4l0-21swapper/210:20:212
119591130,0ptp4l0-21swapper/210:15:172
119591130,0ptp4l0-21swapper/209:45:122
119591130,0ptp4l0-21swapper/209:30:212
119591130,0ptp4l0-21swapper/209:04:352
119591130,0ptp4l0-21swapper/207:45:012
119591130,0ptp4l0-21swapper/207:30:122
119591130,0ptp4l0-21swapper/112:35:181
119591130,0ptp4l0-21swapper/112:35:171
119591130,0ptp4l0-21swapper/112:20:121
119591130,0ptp4l0-21swapper/112:15:111
119591130,0ptp4l0-21swapper/112:10:171
119591130,0ptp4l0-21swapper/111:50:221
119591130,0ptp4l0-21swapper/111:30:121
119591130,0ptp4l0-21swapper/111:20:131
119591130,0ptp4l0-21swapper/111:15:131
119591130,0ptp4l0-21swapper/111:10:011
119591130,0ptp4l0-21swapper/111:05:011
119591130,0ptp4l0-21swapper/110:00:131
119591130,0ptp4l0-21swapper/109:55:201
119591130,0ptp4l0-21swapper/109:50:011
119591130,0ptp4l0-21swapper/109:45:151
119591130,0ptp4l0-21swapper/109:15:121
119591130,0ptp4l0-21swapper/109:05:181
119591130,0ptp4l0-21swapper/109:00:231
119591130,0ptp4l0-21swapper/108:45:121
119591130,0ptp4l0-21swapper/108:40:151
119591130,0ptp4l0-21swapper/108:05:151
119591130,0ptp4l0-21swapper/107:55:191
119591130,0ptp4l0-21swapper/107:35:191
119591130,0ptp4l0-21swapper/107:25:141
119591130,0ptp4l0-21swapper/012:30:120
119591130,0ptp4l0-21swapper/012:16:080
119591130,0ptp4l0-21swapper/011:55:220
119591130,0ptp4l0-21swapper/011:35:170
119591130,0ptp4l0-21swapper/011:15:120
119591130,0ptp4l0-21swapper/010:50:140
119591130,0ptp4l0-21swapper/010:40:150
119591130,0ptp4l0-21swapper/010:25:170
119591130,0ptp4l0-21swapper/010:10:130
119591130,0ptp4l0-21swapper/010:05:130
119591130,0ptp4l0-21swapper/009:25:220
119591130,0ptp4l0-21swapper/008:30:160
119591130,0ptp4l0-21swapper/008:15:130
119591130,0ptp4l0-21swapper/007:55:190
119591130,0ptp4l0-21swapper/007:50:160
119591130,0ptp4l0-21swapper/007:35:140
119591130,0ptp4l0-21swapper/007:30:130
119591130,0ptp4l0-21swapper/007:15:020
119591130,0ptp4l0-21swapper/007:10:180
119591120,0ptp4l0-21swapper/212:25:152
119591120,0ptp4l0-21swapper/209:50:202
119591120,0ptp4l0-21swapper/207:40:192
119591120,0ptp4l0-21swapper/009:30:110
792699119,1cyclictest32332-21ls07:55:012
119591110,0ptp4l41-21ksoftirqd/310:34:053
119591110,0ptp4l0-21swapper/211:35:252
119591110,0ptp4l0-21swapper/209:15:132
119591110,0ptp4l0-21swapper/208:05:132
119591100,0ptp4l0-21swapper/211:45:482
119591100,0ptp4l0-21swapper/210:07:532
119591100,0ptp4l0-21swapper/208:17:012
119591100,0ptp4l0-21swapper/207:59:272
119591100,0ptp4l0-21swapper/207:12:222
79279997,1cyclictest430-21sed10:55:183
79279997,1cyclictest30187-21grep08:50:153
79279997,1cyclictest25050-21cat11:40:223
79279997,1cyclictest21716-21taskset07:35:003
79279997,1cyclictest21082-21seq08:31:413
79279997,1cyclictest15969-21chrt08:24:013
79279997,1cyclictest128422sleep310:17:093
79269997,1cyclictest9374-21cut08:10:172
79269997,1cyclictest9246-21cat09:10:172
79269997,1cyclictest20904-21tail08:30:232
79269997,1cyclictest20222-21fgrep10:30:212
79269997,1cyclictest184192sleep208:26:282
79269997,1cyclictest10380-21chrt10:14:372
79269996,2cyclictest24511-21cut10:40:152
79269992,1cyclictest33-21ksoftirqd/212:15:162
79269992,1cyclictest33-21ksoftirqd/212:00:202
79269990,8cyclictest30722-21ls10:50:192
79269990,8cyclictest2926-21tr10:00:112
79269990,8cyclictest22591-21grep09:35:182
79269990,3cyclictest29960-21cstates08:50:132
79269990,3cyclictest21667-21cstates10:35:122
11959190,1ptp4l7721-21diskmemload11:20:402
11959190,0ptp4l0-21swapper/212:20:012
11959190,0ptp4l0-21swapper/211:55:272
11959190,0ptp4l0-21swapper/211:53:252
11959190,0ptp4l0-21swapper/211:31:542
11959190,0ptp4l0-21swapper/211:29:232
11959190,0ptp4l0-21swapper/211:15:052
11959190,0ptp4l0-21swapper/211:13:552
11959190,0ptp4l0-21swapper/210:46:152
11959190,0ptp4l0-21swapper/209:42:532
11959190,0ptp4l0-21swapper/209:20:442
11959190,0ptp4l0-21swapper/209:05:482
11959190,0ptp4l0-21swapper/208:56:262
11959190,0ptp4l0-21swapper/208:42:122
11959190,0ptp4l0-21swapper/208:36:122
11959190,0ptp4l0-21swapper/208:00:282
11959190,0ptp4l0-21swapper/207:39:332
11959190,0ptp4l0-21swapper/207:22:262
11959190,0ptp4l0-21swapper/207:16:512
79279986,1cyclictest9469-21cut08:10:173
79279986,1cyclictest8934-21cut10:10:173
79279986,1cyclictest8849-21interrupts09:10:163
79279986,1cyclictest8463-21chrt07:10:143
79279986,1cyclictest8340-21cut12:10:183
79279986,1cyclictest7673-21tr11:10:123
79279986,1cyclictest6833-21taskset11:05:353
79279986,1cyclictest6410-21basename08:05:173
79279986,1cyclictest6389-21wc12:05:243
79279986,1cyclictest5977-21grep10:05:163
79279986,1cyclictest5281-21chrt09:05:083
79279986,1cyclictest4243-21cat08:00:173
79279986,1cyclictest4066-21ntp_kernel_err10:00:163
79279986,1cyclictest332-21tr07:55:153
79279986,1cyclictest32234-21basename09:55:123
79279986,1cyclictest31848-21expr11:55:143
79279986,1cyclictest30490-21cut07:50:143
79279986,1cyclictest30395-21cat10:50:173
79279986,1cyclictest29916-21expr09:50:153
79279986,1cyclictest2961-21cat09:00:123
79279986,1cyclictest29124-21expr11:50:133
79279986,1cyclictest28695-21tail09:45:213
79279986,1cyclictest28679-21chrt10:46:083
79279986,1cyclictest28336-21cut08:45:193
79279986,1cyclictest27820-21which11:45:203
79279986,1cyclictest27329-21aten_r9power_en07:45:113
79279986,1cyclictest2677-21chrt12:00:153
79279986,1cyclictest26192sleep311:00:133
79279986,1cyclictest24775-21egrep07:40:143
79279986,1cyclictest24546-21seq08:40:143
79279986,1cyclictest24459-21grep10:40:153
79279986,1cyclictest23583-21cat07:35:223
79279986,1cyclictest22435-21load09:35:183
79279986,1cyclictest22402-21grep12:35:223
79279986,1cyclictest22402-21grep12:35:223
79279986,1cyclictest21829-21tr08:35:143
79279986,1cyclictest21490-21tr10:35:133
79279986,1cyclictest21102-21expr11:35:163
79279986,1cyclictest18933-21expr09:30:123
79279986,1cyclictest18562-21grep11:30:143
79279986,1cyclictest18451-21expr12:30:133
79279986,1cyclictest17586-21cut09:25:203
79279986,1cyclictest17398-21basename07:25:143
79279986,1cyclictest16966-21head08:25:153
79279986,1cyclictest16528-21sed11:25:163
79279986,1cyclictest16378-21cat10:25:133
79279986,1cyclictest16295-21cat12:25:173
79279986,1cyclictest15992-21tail07:20:243
79279986,1cyclictest1443-21cut08:55:233
79279986,1cyclictest13888-21head09:20:143
79279986,1cyclictest13503-21taskset07:16:463
79279986,1cyclictest13452-21cut10:20:133
79279986,1cyclictest13247-21taskset08:18:133
79279986,1cyclictest13157-21cat11:20:143
79279986,1cyclictest12885-21expr12:20:133
79279986,1cyclictest120562sleep312:16:353
79279986,1cyclictest11467-21cat09:15:153
79279986,1cyclictest11083-21tr11:15:173
79269986,1cyclictest32506-21tail10:55:162
79269986,1cyclictest27229-21expr08:45:122
79269986,1cyclictest2547-21expr11:00:132
79269981,1cyclictest130091phc2sys12:30:202
79269980,5cyclictest0-21swapper/207:25:122
79279975,1cyclictest24286-21expr09:40:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional