You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 14:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Sun May 10, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591670,44ptp4l0-21swapper/019:08:470
119591600,38ptp4l0-21swapper/119:06:031
119591550,38ptp4l0-21swapper/219:09:332
1518525144,5sleep30-21swapper/319:08:253
211032410,0sleep20-21swapper/221:20:142
119591320,0ptp4l0-21swapper/100:20:131
119591290,0ptp4l0-21swapper/019:40:190
119591200,0ptp4l0-21swapper/022:10:240
119591180,0ptp4l0-21swapper/119:55:151
119591180,0ptp4l0-21swapper/119:35:151
119591180,0ptp4l0-21swapper/119:20:171
119591180,0ptp4l0-21swapper/021:35:220
119591170,0ptp4l0-21swapper/123:46:251
119591170,0ptp4l0-21swapper/123:10:151
119591170,0ptp4l0-21swapper/119:15:171
119591170,0ptp4l0-21swapper/022:05:000
119591160,1ptp4l32159-21apt-get20:40:131
119591160,1ptp4l31617-21expr22:40:130
119591160,1ptp4l226-21systemd-journal23:10:010
119591160,1ptp4l13000-21apt-get21:05:120
119591160,1ptp4l10349-21apt-get21:00:130
119591160,0ptp4l0-21swapper/123:40:111
119591160,0ptp4l0-21swapper/123:00:151
119591160,0ptp4l0-21swapper/121:15:181
119591160,0ptp4l0-21swapper/021:15:210
119591150,2ptp4l26362-21awk19:25:231
119591150,2ptp4l13970-21cat20:05:120
119591150,1ptp4l7312-21apt-get21:55:121
119591150,1ptp4l5184-21apt-get19:50:010
119591150,1ptp4l4717-21sed22:50:120
119591150,1ptp4l4444-21snmp_o5powerctl19:45:220
119591150,1ptp4l3101-21snmp_o5powerctl22:45:230
119591150,1ptp4l30195-21snmp_o5powerctl22:35:200
119591150,1ptp4l29965-21diskstats20:35:130
119591150,1ptp4l29591-21snmp_o5powerctl00:35:220
119591150,1ptp4l25-21ksoftirqd/123:15:211
119591150,1ptp4l21723-21apt-get19:20:120
119591150,1ptp4l17628-21ntp_states20:10:190
119591150,0ptp4l0-21swapper/122:10:131
119591150,0ptp4l0-21swapper/100:29:561
119591150,0ptp4l0-21swapper/021:27:070
119591150,0ptp4l0-21swapper/000:00:130
119591140,1ptp4l9352-21snmp_o5powerctl20:55:231
119591140,1ptp4l8396-21snmp_o5powerctl22:55:240
119591140,1ptp4l6707-21snmp_o5powerctl20:50:210
119591140,1ptp4l4048-21missed_timers19:45:171
119591140,1ptp4l402-21python22:40:201
119591140,1ptp4l32051-21df_inode21:40:161
119591140,1ptp4l31168-21/usr/sbin/munin22:40:152
119591140,1ptp4l30598-21irqstats20:35:171
119591140,1ptp4l30186-21ls21:35:171
119591140,1ptp4l29024-21irqstats00:35:171
119591140,1ptp4l28901-21ls19:30:231
119591140,1ptp4l28499-21/usr/sbin/munin22:35:192
119591140,1ptp4l28129-21ls20:30:181
119591140,1ptp4l28126-21/usr/sbin/munin23:35:130
119591140,1ptp4l27930-21snmp_o5powerctl21:30:230
119591140,1ptp4l27636-21ls22:30:230
119591140,1ptp4l24913-21snmp_o5powerctl22:25:221
119591140,1ptp4l24403-21cpuspeed_turbos20:25:141
119591140,1ptp4l24206-21/usr/sbin/munin20:25:130
119591140,1ptp4l24083-21/usr/sbin/munin21:25:121
119591140,1ptp4l22643-21snmp_o5powerctl21:20:220
119591140,1ptp4l21447-21diskstats21:20:151
119591140,1ptp4l21074-21diskstats22:20:151
119591140,1ptp4l19843-21latency_hist00:20:010
119591140,1ptp4l17686-21users19:10:341
119591140,1ptp4l17397-21aten_r9power_po00:15:121
119591140,1ptp4l17340-21snmp_o5powerctl19:10:330
119591140,1ptp4l1656-21ps19:40:201
119591140,1ptp4l16464-21timerandwakeup00:10:220
119591140,1ptp4l15416-21munin-run21:10:011
119591140,1ptp4l12611-21snmp_o5powerctl20:00:201
119591140,0ptp4l9355-21snmp_o5powerctl20:55:230
119591140,0ptp4l21874-21ls00:20:240
119591140,0ptp4l0-21swapper/223:25:222
119591140,0ptp4l0-21swapper/220:45:522
119591140,0ptp4l0-21swapper/123:55:021
119591140,0ptp4l0-21swapper/123:55:021
119591140,0ptp4l0-21swapper/123:50:101
119591140,0ptp4l0-21swapper/123:35:111
119591140,0ptp4l0-21swapper/123:30:131
119591140,0ptp4l0-21swapper/123:25:181
119591140,0ptp4l0-21swapper/123:20:231
119591140,0ptp4l0-21swapper/123:05:191
119591140,0ptp4l0-21swapper/122:30:211
119591140,0ptp4l0-21swapper/122:05:301
119591140,0ptp4l0-21swapper/122:02:501
119591140,0ptp4l0-21swapper/121:50:201
119591140,0ptp4l0-21swapper/121:45:011
119591140,0ptp4l0-21swapper/121:12:581
119591140,0ptp4l0-21swapper/121:00:141
119591140,0ptp4l0-21swapper/120:20:211
119591140,0ptp4l0-21swapper/120:15:121
119591140,0ptp4l0-21swapper/120:10:211
119591140,0ptp4l0-21swapper/100:30:091
119591140,0ptp4l0-21swapper/100:13:211
119591140,0ptp4l0-21swapper/100:01:591
119591140,0ptp4l0-21swapper/023:45:210
119591140,0ptp4l0-21swapper/023:35:010
119591140,0ptp4l0-21swapper/023:20:140
119591140,0ptp4l0-21swapper/023:18:390
119591140,0ptp4l0-21swapper/023:00:020
119591140,0ptp4l0-21swapper/021:55:220
119591140,0ptp4l0-21swapper/019:30:210
119591140,0ptp4l0-21swapper/019:25:130
119591140,0ptp4l0-21swapper/019:15:220
119591130,0ptp4l22244-21smartctl20:20:140
119591130,0ptp4l0-21swapper/223:20:192
119591130,0ptp4l0-21swapper/223:05:152
119591130,0ptp4l0-21swapper/221:50:122
119591130,0ptp4l0-21swapper/220:50:172
119591130,0ptp4l0-21swapper/220:25:222
119591130,0ptp4l0-21swapper/220:15:232
119591130,0ptp4l0-21swapper/220:10:222
119591130,0ptp4l0-21swapper/219:45:152
119591130,0ptp4l0-21swapper/219:30:192
119591130,0ptp4l0-21swapper/200:20:192
119591130,0ptp4l0-21swapper/200:15:212
119591130,0ptp4l0-21swapper/200:10:132
119591130,0ptp4l0-21swapper/200:05:222
119591130,0ptp4l0-21swapper/122:55:191
119591130,0ptp4l0-21swapper/122:50:111
119591130,0ptp4l0-21swapper/122:45:151
119591130,0ptp4l0-21swapper/122:35:131
119591130,0ptp4l0-21swapper/122:15:161
119591130,0ptp4l0-21swapper/121:30:141
119591130,0ptp4l0-21swapper/120:50:191
119591130,0ptp4l0-21swapper/120:45:141
119591130,0ptp4l0-21swapper/120:05:141
119591130,0ptp4l0-21swapper/119:50:131
119591130,0ptp4l0-21swapper/100:05:141
119591130,0ptp4l0-21swapper/023:55:120
119591130,0ptp4l0-21swapper/023:55:110
119591130,0ptp4l0-21swapper/023:50:210
119591130,0ptp4l0-21swapper/023:40:120
119591130,0ptp4l0-21swapper/023:25:130
119591130,0ptp4l0-21swapper/023:05:170
119591130,0ptp4l0-21swapper/022:25:120
119591130,0ptp4l0-21swapper/022:20:120
119591130,0ptp4l0-21swapper/022:15:140
119591130,0ptp4l0-21swapper/022:00:130
119591130,0ptp4l0-21swapper/021:50:160
119591130,0ptp4l0-21swapper/021:45:150
119591130,0ptp4l0-21swapper/021:40:170
119591130,0ptp4l0-21swapper/021:10:130
119591130,0ptp4l0-21swapper/020:45:180
119591130,0ptp4l0-21swapper/020:40:150
119591130,0ptp4l0-21swapper/020:30:130
119591130,0ptp4l0-21swapper/020:15:150
119591130,0ptp4l0-21swapper/020:00:190
119591130,0ptp4l0-21swapper/019:55:140
119591130,0ptp4l0-21swapper/019:35:140
119591130,0ptp4l0-21swapper/000:30:130
119591130,0ptp4l0-21swapper/000:25:160
119591130,0ptp4l0-21swapper/000:05:160
119591120,0ptp4l0-21swapper/223:30:202
119591120,0ptp4l0-21swapper/222:10:202
119591120,0ptp4l0-21swapper/221:55:142
119591120,0ptp4l0-21swapper/221:00:192
1561499112,4cyclictest0-21swapper/300:25:143
119591110,0ptp4l0-21swapper/220:40:192
119591110,0ptp4l0-21swapper/220:35:252
119591110,0ptp4l0-21swapper/200:32:442
119591100,0ptp4l0-21swapper/222:54:572
119591100,0ptp4l0-21swapper/220:02:252
119591100,0ptp4l0-21swapper/219:58:252
156149997,1cyclictest9887-21cat23:00:133
156149997,1cyclictest8323-21expr22:55:233
156149997,1cyclictest63132sleep322:53:033
156149997,1cyclictest5169-21cut21:50:123
156149997,1cyclictest3086-21cut22:45:223
156149997,1cyclictest30297-21seq23:36:523
156149997,1cyclictest25518-21grep21:25:223
156149997,1cyclictest19752-21hwlatdetect19:15:163
156149997,1cyclictest15510-21date21:10:003
156149997,1cyclictest15040-21wc22:10:003
156149997,1cyclictest132382sleep320:03:453
156149997,1cyclictest11966-21tr21:00:213
156149997,1cyclictest1003-21cut19:40:173
156139997,1cyclictest8399-21basename20:55:162
156139997,1cyclictest6258-21wc23:55:022
156139997,1cyclictest28959-21mii-tool23:35:162
156139997,1cyclictest23538-21head20:20:232
156139997,1cyclictest22709-21sed19:20:162
156139997,1cyclictest12730-21basename22:05:142
11959190,0ptp4l0-21swapper/223:55:252
11959190,0ptp4l0-21swapper/223:55:242
11959190,0ptp4l0-21swapper/223:49:302
11959190,0ptp4l0-21swapper/223:16:512
11959190,0ptp4l0-21swapper/223:10:322
11959190,0ptp4l0-21swapper/223:00:052
11959190,0ptp4l0-21swapper/222:55:262
11959190,0ptp4l0-21swapper/222:48:342
11959190,0ptp4l0-21swapper/222:26:132
11959190,0ptp4l0-21swapper/222:22:102
11959190,0ptp4l0-21swapper/222:17:092
11959190,0ptp4l0-21swapper/221:46:312
11959190,0ptp4l0-21swapper/221:35:262
11959190,0ptp4l0-21swapper/221:32:202
11959190,0ptp4l0-21swapper/221:26:222
11959190,0ptp4l0-21swapper/221:17:022
11959190,0ptp4l0-21swapper/221:07:572
11959190,0ptp4l0-21swapper/220:33:152
11959190,0ptp4l0-21swapper/219:50:112
11959190,0ptp4l0-21swapper/219:41:182
11959190,0ptp4l0-21swapper/219:35:072
11959190,0ptp4l0-21swapper/219:26:132
11959190,0ptp4l0-21swapper/219:18:292
11959190,0ptp4l0-21swapper/200:36:132
11959190,0ptp4l0-21swapper/200:29:462
11959190,0ptp4l0-21swapper/200:04:292
156149986,1cyclictest9373-21wc20:55:243
156149986,1cyclictest9304-21aten_r9power_po00:00:143
156149986,1cyclictest8843-21cut19:55:163
156149986,1cyclictest7826-21cut21:55:153
156149986,1cyclictest7660-21cut23:55:163
156149986,1cyclictest7660-21cut23:55:153
156149986,1cyclictest5706-21tail20:50:153
156149986,1cyclictest5679-21basename19:50:123
156149986,1cyclictest46382sleep320:48:083
156149986,1cyclictest3745-21sed19:45:173
156149986,1cyclictest3741-21cut23:50:123
156149986,1cyclictest32645-21cat20:40:153
156149986,1cyclictest32317-21kernelversion22:40:173
156149986,1cyclictest31809-21tr21:40:163
156149986,1cyclictest31074-21cut23:40:113
156149986,1cyclictest30944-21apt22:40:003
156149986,1cyclictest30598-21if_enp0s31f619:35:163
156149986,1cyclictest29682-21cat20:35:123
156149986,1cyclictest29365-21expr21:35:123
156149986,1cyclictest292482sleep319:33:013
156149986,1cyclictest28626-21ls00:35:153
156149986,1cyclictest28064-21missed_timers20:30:193
156149986,1cyclictest276562sleep323:31:543
156149986,1cyclictest26520-21gltestperf22:30:163
156149986,1cyclictest26221-21chrt21:30:043
156149986,1cyclictest25403-21egrep00:30:143
156149986,1cyclictest24828-21grep20:25:163
156149986,1cyclictest24680-21expr19:25:143
156149986,1cyclictest24077-21cat22:25:163
156149986,1cyclictest2400-21expr21:45:153
156149986,1cyclictest23782-21chrt19:20:453
156149986,1cyclictest23295-21expr23:25:133
156149986,1cyclictest22568-21find21:20:213
156149986,1cyclictest22340-21if_enp3s020:20:153
156149986,1cyclictest21926-21tail00:20:243
156149986,1cyclictest20986-21expr22:20:133
156149986,1cyclictest20783-21tune2fs23:20:173
156149986,1cyclictest19401-21cut22:15:213
156149986,1cyclictest19264-21tr21:15:183
156149986,1cyclictest18910-21basename20:15:133
156149986,1cyclictest18184-21tail23:15:163
156149986,1cyclictest18114-21ethtool00:15:173
156149986,1cyclictest173462sleep322:10:513
156149986,1cyclictest17325-21tr20:10:173
156149986,1cyclictest16326-21expr19:10:273
156149986,1cyclictest159122sleep320:09:003
156149986,1cyclictest15770-21cut21:10:143
156149986,1cyclictest15322-21expr23:10:143
156149986,1cyclictest15175-21cut00:10:143
156149986,1cyclictest12267-21basename23:05:123
156149986,1cyclictest11843-21taskset00:05:103
156149986,1cyclictest1043-21seq23:45:123
156139986,1cyclictest32205-21head21:40:162
156139986,1cyclictest25930-21aten_r9power_en22:30:132
156139986,1cyclictest14707-21uname20:05:172
156139986,1cyclictest10883-21cut22:00:182
11959180,0ptp4l0-21swapper/223:41:002
11959180,0ptp4l0-21swapper/221:10:062
11959180,0ptp4l0-21swapper/219:10:212
156149964,1cyclictest12053-21taskset22:00:583
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional