You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 14:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot3s.osadl.org (updated Fri May 22, 2026 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591650,44ptp4l0-21swapper/019:07:080
119591620,33ptp4l0-21swapper/119:09:481
119591530,36ptp4l0-21swapper/219:09:182
1608525046,2sleep30-21swapper/319:06:353
258782440,0sleep30-21swapper/323:30:023
119591210,0ptp4l0-21swapper/022:50:180
119591190,0ptp4l0-21swapper/120:10:211
119591190,0ptp4l0-21swapper/119:25:231
119591180,0ptp4l0-21swapper/123:25:181
119591180,0ptp4l0-21swapper/123:05:151
119591180,0ptp4l0-21swapper/122:20:141
119591180,0ptp4l0-21swapper/120:55:201
119591180,0ptp4l0-21swapper/100:00:231
119591170,0ptp4l0-21swapper/122:25:161
119591170,0ptp4l0-21swapper/021:45:110
119591160,1ptp4l6203-21apt-get19:50:101
119591160,1ptp4l5612-21apt-get20:50:120
119591160,1ptp4l31613-21apt-get23:40:120
119591160,1ptp4l28344-21snmp_o5powerctl22:30:230
119591160,1ptp4l15429-21apt-get00:10:132
119591160,0ptp4l0-21swapper/122:10:121
119591160,0ptp4l0-21swapper/120:05:121
119591160,0ptp4l0-21swapper/119:35:071
119591160,0ptp4l0-21swapper/019:25:150
119591150,1ptp4l9768-21snmp_o5powerctl21:55:241
119591150,1ptp4l7204-21ls21:50:231
119591150,1ptp4l3519-21snmp_o5powerctl23:45:220
119591150,1ptp4l31741-21snmp_o5powerctl20:35:200
119591150,1ptp4l28803-21ntp_states20:30:181
119591150,1ptp4l28803-21ntp_states20:30:181
119591150,1ptp4l28055-21ntp_states22:30:201
119591150,1ptp4l27760-21snmp_o5powerctl23:30:220
119591150,1ptp4l23152-21apt-get00:25:011
119591150,1ptp4l21757-21apt-get21:20:121
119591150,1ptp4l21123-21python20:15:211
119591150,1ptp4l1989-21snmp_o5powerctl20:40:201
119591150,1ptp4l1832-21snmp_o5powerctl21:40:211
119591150,1ptp4l17456-21users00:10:240
119591150,1ptp4l17327-21ls00:10:231
119591150,1ptp4l15698-21expr23:10:130
119591150,1ptp4l12893-21ntp_states20:00:181
119591150,0ptp4l28903-21apt-get00:35:130
119591150,0ptp4l2218-21apt-get22:45:110
119591150,0ptp4l18709-21apt-get22:15:131
119591150,0ptp4l0-21swapper/123:30:121
119591150,0ptp4l0-21swapper/120:35:171
119591150,0ptp4l0-21swapper/023:00:120
119591150,0ptp4l0-21swapper/022:00:110
119591150,0ptp4l0-21swapper/021:35:030
119591150,0ptp4l0-21swapper/020:15:080
119591150,0ptp4l0-21swapper/019:45:170
119591150,0ptp4l0-21swapper/019:30:130
119591150,0ptp4l0-21swapper/000:25:230
119591150,0ptp4l0-21swapper/000:00:120
119591140,1ptp4l9577-21irqstats20:55:160
119591140,1ptp4l6175-21/usr/sbin/munin19:50:160
119591140,1ptp4l513-21grep20:40:130
119591140,1ptp4l31871-21latency_hist22:40:010
119591140,1ptp4l31871-21latency_hist22:40:010
119591140,1ptp4l30989-21snmp_o5powerctl22:35:231
119591140,1ptp4l30989-21snmp_o5powerctl22:35:221
119591140,1ptp4l3094-21cpu20:45:120
119591140,1ptp4l28229-21unixbench_singl00:30:250
119591140,1ptp4l28013-21grep00:30:242
119591140,1ptp4l27788-21if_enp0s31f621:30:150
119591140,1ptp4l25274-21fschecks_count20:25:142
119591140,1ptp4l23733-21cstates23:25:150
119591140,1ptp4l21985-21unixbench_multi19:15:230
119591140,1ptp4l20492-21/usr/sbin/munin21:15:221
119591140,1ptp4l18587-21df23:15:131
119591140,1ptp4l16984-21cpu20:10:120
119591140,1ptp4l16687-21telnet19:10:141
119591140,1ptp4l15456-21snmp_o5powerctl21:05:221
119591140,1ptp4l14580-21if_enp4s021:05:170
119591140,0ptp4l8198-21hddtemp_smartct22:55:161
119591140,0ptp4l16527-21aten2.4-expect21:10:131
119591140,0ptp4l0-21swapper/223:40:182
119591140,0ptp4l0-21swapper/123:50:181
119591140,0ptp4l0-21swapper/123:40:021
119591140,0ptp4l0-21swapper/123:35:221
119591140,0ptp4l0-21swapper/123:20:241
119591140,0ptp4l0-21swapper/123:00:541
119591140,0ptp4l0-21swapper/122:50:221
119591140,0ptp4l0-21swapper/122:45:181
119591140,0ptp4l0-21swapper/122:40:151
119591140,0ptp4l0-21swapper/122:05:211
119591140,0ptp4l0-21swapper/122:00:231
119591140,0ptp4l0-21swapper/121:25:151
119591140,0ptp4l0-21swapper/120:50:211
119591140,0ptp4l0-21swapper/120:20:161
119591140,0ptp4l0-21swapper/119:45:121
119591140,0ptp4l0-21swapper/119:40:171
119591140,0ptp4l0-21swapper/119:33:031
119591140,0ptp4l0-21swapper/119:20:131
119591140,0ptp4l0-21swapper/119:15:231
119591140,0ptp4l0-21swapper/100:34:071
119591140,0ptp4l0-21swapper/100:20:221
119591140,0ptp4l0-21swapper/100:18:091
119591140,0ptp4l0-21swapper/100:05:191
119591140,0ptp4l0-21swapper/023:05:160
119591140,0ptp4l0-21swapper/022:10:150
119591140,0ptp4l0-21swapper/021:40:140
119591140,0ptp4l0-21swapper/021:15:250
119591140,0ptp4l0-21swapper/021:10:240
119591140,0ptp4l0-21swapper/021:00:230
119591140,0ptp4l0-21swapper/020:25:170
119591140,0ptp4l0-21swapper/020:00:220
119591140,0ptp4l0-21swapper/019:55:230
119591140,0ptp4l0-21swapper/019:40:210
119591140,0ptp4l0-21swapper/019:25:020
119591140,0ptp4l0-21swapper/000:20:190
119591130,0ptp4l0-21swapper/222:55:162
119591130,0ptp4l0-21swapper/222:45:152
119591130,0ptp4l0-21swapper/222:25:242
119591130,0ptp4l0-21swapper/222:05:182
119591130,0ptp4l0-21swapper/221:45:212
119591130,0ptp4l0-21swapper/220:40:142
119591130,0ptp4l0-21swapper/220:30:172
119591130,0ptp4l0-21swapper/220:30:162
119591130,0ptp4l0-21swapper/220:20:192
119591130,0ptp4l0-21swapper/219:45:142
119591130,0ptp4l0-21swapper/219:25:242
119591130,0ptp4l0-21swapper/200:00:282
119591130,0ptp4l0-21swapper/123:55:141
119591130,0ptp4l0-21swapper/123:45:131
119591130,0ptp4l0-21swapper/123:10:111
119591130,0ptp4l0-21swapper/121:45:171
119591130,0ptp4l0-21swapper/121:35:021
119591130,0ptp4l0-21swapper/121:30:021
119591130,0ptp4l0-21swapper/121:00:171
119591130,0ptp4l0-21swapper/120:45:131
119591130,0ptp4l0-21swapper/120:25:131
119591130,0ptp4l0-21swapper/119:55:161
119591130,0ptp4l0-21swapper/100:35:141
119591130,0ptp4l0-21swapper/023:55:150
119591130,0ptp4l0-21swapper/023:50:170
119591130,0ptp4l0-21swapper/023:35:130
119591130,0ptp4l0-21swapper/023:20:140
119591130,0ptp4l0-21swapper/023:15:120
119591130,0ptp4l0-21swapper/022:55:150
119591130,0ptp4l0-21swapper/022:40:130
119591130,0ptp4l0-21swapper/022:25:140
119591130,0ptp4l0-21swapper/022:20:120
119591130,0ptp4l0-21swapper/022:15:130
119591130,0ptp4l0-21swapper/022:05:170
119591130,0ptp4l0-21swapper/021:55:160
119591130,0ptp4l0-21swapper/021:50:150
119591130,0ptp4l0-21swapper/021:25:110
119591130,0ptp4l0-21swapper/021:20:140
119591130,0ptp4l0-21swapper/020:30:130
119591130,0ptp4l0-21swapper/020:30:120
119591130,0ptp4l0-21swapper/020:20:110
119591130,0ptp4l0-21swapper/020:05:110
119591130,0ptp4l0-21swapper/019:35:140
119591130,0ptp4l0-21swapper/019:10:150
119591130,0ptp4l0-21swapper/000:15:130
119591130,0ptp4l0-21swapper/000:05:130
119591120,0ptp4l0-21swapper/222:50:162
119591120,0ptp4l0-21swapper/221:25:152
119591120,0ptp4l0-21swapper/220:15:132
119591120,0ptp4l0-21swapper/219:40:172
119591110,0ptp4l0-21swapper/219:30:022
119591100,1ptp4l41-21ksoftirqd/321:57:313
119591100,0ptp4l0-21swapper/221:34:552
119591100,0ptp4l0-21swapper/219:17:022
119591100,0ptp4l0-21swapper/200:37:482
166129997,1cyclictest3660-21sed23:45:233
166129997,1cyclictest32713-21basename20:40:113
166129997,1cyclictest31497-21gzip21:35:243
166129997,1cyclictest30981-21expr19:35:123
166129997,1cyclictest29996-21cut22:35:153
166129997,1cyclictest29996-21cut22:35:153
166129997,1cyclictest27963-21date19:30:013
166129997,1cyclictest26459-21cat23:30:133
166129997,1cyclictest22236-21cut00:20:213
166129997,1cyclictest21788-21expr22:20:143
166129997,1cyclictest19362-21cut21:15:153
166129997,1cyclictest1868-21tr19:40:153
166129997,1cyclictest17154-21tr22:10:173
166129997,1cyclictest13678-21cat23:05:173
166129997,1cyclictest11463-21sensors00:00:223
166129996,2cyclictest22097-21tail23:20:183
166129990,8cyclictest6443-21cut19:50:113
166119997,1cyclictest8723-21gzip23:55:222
166119997,1cyclictest8104-21grep19:50:222
166119997,1cyclictest5173-21head23:50:162
166119997,1cyclictest22975-21cut19:20:132
166119997,1cyclictest22642-21cat22:20:172
166119997,1cyclictest190552sleep221:15:082
166119997,1cyclictest18643-21tune2fs00:15:142
166119997,1cyclictest160872sleep221:08:522
166119990,8cyclictest17302-21cut19:10:162
11959190,0ptp4l33-21ksoftirqd/220:00:572
11959190,0ptp4l0-21swapper/223:36:542
11959190,0ptp4l0-21swapper/223:25:032
11959190,0ptp4l0-21swapper/223:23:282
11959190,0ptp4l0-21swapper/223:16:552
11959190,0ptp4l0-21swapper/223:11:102
11959190,0ptp4l0-21swapper/223:00:092
11959190,0ptp4l0-21swapper/222:40:042
11959190,0ptp4l0-21swapper/222:36:552
11959190,0ptp4l0-21swapper/222:36:542
11959190,0ptp4l0-21swapper/222:30:022
11959190,0ptp4l0-21swapper/222:12:192
11959190,0ptp4l0-21swapper/222:02:192
11959190,0ptp4l0-21swapper/221:55:512
11959190,0ptp4l0-21swapper/221:40:482
11959190,0ptp4l0-21swapper/221:37:122
11959190,0ptp4l0-21swapper/221:22:032
11959190,0ptp4l0-21swapper/221:10:392
11959190,0ptp4l0-21swapper/221:00:072
11959190,0ptp4l0-21swapper/220:52:242
11959190,0ptp4l0-21swapper/220:35:072
11959190,0ptp4l0-21swapper/220:05:032
11959190,0ptp4l0-21swapper/219:57:082
11959190,0ptp4l0-21swapper/219:37:092
11959190,0ptp4l0-21swapper/200:26:232
11959190,0ptp4l0-21swapper/200:21:282
11959190,0ptp4l0-21swapper/200:06:212
166129986,1cyclictest9032-21sed23:55:243
166129986,1cyclictest8801-21tail22:55:203
166129986,1cyclictest8683-21tr20:55:123
166129986,1cyclictest6069-21cat20:50:143
166129986,1cyclictest5805-21cat21:50:153
166129986,1cyclictest5039-21grep22:50:133
166129986,1cyclictest435-21cut22:40:173
166129986,1cyclictest4088-21cut19:45:153
166129986,1cyclictest3817-21wc22:45:203
166129986,1cyclictest30253-21cat20:35:123
166129986,1cyclictest30153-21chrt19:31:503
166129986,1cyclictest29619-21tr23:35:183
166129986,1cyclictest2924-21taskset20:45:013
166129986,1cyclictest29174-21expr00:35:143
166129986,1cyclictest289562sleep322:33:413
166129986,1cyclictest28476-21cut20:30:173
166129986,1cyclictest28476-21cut20:30:163
166129986,1cyclictest27728-21expr21:30:143
166129986,1cyclictest27652sleep321:45:043
166129986,1cyclictest26755-21grep00:30:153
166129986,1cyclictest25669-21cat21:25:173
166129986,1cyclictest25521-21sed00:25:243
166129986,1cyclictest24909-21grep20:25:133
166129986,1cyclictest24340-21cat22:25:143
166129986,1cyclictest23647-21tr19:20:303
166129986,1cyclictest22726-21grep20:20:133
166129986,1cyclictest2267-21taskset21:41:233
166129986,1cyclictest21722-21sshd21:20:083
166129986,1cyclictest21204-21wc19:15:173
166129986,1cyclictest20071-21ntp_kernel_pll_22:15:183
166129986,1cyclictest19878-21expr20:15:143
166129986,1cyclictest18414-21expr00:15:133
166129986,1cyclictest18329-21sort23:15:133
166129986,1cyclictest17267-21tail19:10:153
166129986,1cyclictest17199-21expr20:10:123
166129986,1cyclictest16549-21basename21:10:133
166129986,1cyclictest16102-21tail23:10:143
166129986,1cyclictest15777-21grep21:05:253
166129986,1cyclictest14779-21grep22:05:183
166129986,1cyclictest14152-21bc20:05:103
166129986,1cyclictest13663-21taskset20:01:553
166129986,1cyclictest12531-21basename00:05:133
166129986,1cyclictest11465-21expr21:00:143
166129986,1cyclictest10999-21grep22:00:123
166129986,1cyclictest10212-21ntp_kernel_pll_19:55:203
166129981,3cyclictest0-21swapper/323:40:123
166119986,1cyclictest8721-21cut20:55:132
166119986,1cyclictest5758-21expr21:50:142
166119986,1cyclictest39352sleep223:46:092
166119986,1cyclictest3480-21tune2fs20:45:142
166119986,1cyclictest27541-21chrt23:30:212
166119986,1cyclictest18741-21aten2.4-expect22:15:122
166119986,1cyclictest13078-21tr23:05:142
11959180,0ptp4l0-21swapper/220:14:292
166129975,1cyclictest4688-21cat23:50:153
166129975,1cyclictest16440-21cut00:10:173
166129975,1cyclictest10204-21aten2.4-expect23:00:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional