You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 05:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Fri Jul 17, 2026 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35572800,1sleep02953399cyclictest22:20:220
2925026959,8sleep20-21swapper/219:09:412
119591640,31ptp4l0-21swapper/019:05:380
119591620,43ptp4l0-21swapper/119:08:591
2900125549,4sleep30-21swapper/319:06:293
319572470,0sleep30-21swapper/323:15:173
246282410,0sleep1241ktimersoftd/100:00:241
119591330,0ptp4l0-21swapper/123:15:271
119591310,0ptp4l0-21swapper/121:15:211
119591280,0ptp4l0-21swapper/019:29:130
29533992321,1cyclictest9-21ksoftirqd/019:15:010
29535992119,1cyclictest33-21ksoftirqd/200:35:132
119591190,0ptp4l0-21swapper/023:35:230
119591190,0ptp4l0-21swapper/022:30:130
119591180,0ptp4l0-21swapper/123:40:241
119591180,0ptp4l0-21swapper/123:25:011
119591180,0ptp4l0-21swapper/022:15:270
119591180,0ptp4l0-21swapper/020:35:260
119591180,0ptp4l0-21swapper/019:55:150
119591170,0ptp4l101ktimersoftd/022:53:040
119591170,0ptp4l0-21swapper/121:20:161
119591170,0ptp4l0-21swapper/021:45:250
119591170,0ptp4l0-21swapper/021:35:200
119591160,1ptp4l32391-21apt-get20:15:140
119591160,1ptp4l31042-21snmp_o5powerctl21:10:210
119591160,1ptp4l29580-21apt-get19:10:121
119591160,1ptp4l25787-21apt-get23:05:131
119591160,1ptp4l25787-21apt-get23:05:121
119591160,1ptp4l21020-21apt-get21:55:131
119591160,0ptp4l0-21swapper/121:45:161
119591160,0ptp4l0-21swapper/120:15:161
119591160,0ptp4l0-21swapper/100:14:591
119591160,0ptp4l0-21swapper/100:14:581
119591160,0ptp4l0-21swapper/022:00:020
119591150,1ptp4l8853-21snmp_o5powerctl22:30:221
119591150,1ptp4l8695-21snmp_o5powerctl00:30:221
119591150,1ptp4l7027-21latency_hist22:30:011
119591150,1ptp4l5455-21/usr/sbin/munin21:25:151
119591150,1ptp4l4314-21snmp_o5powerctl20:20:231
119591150,1ptp4l4244-21/usr/sbin/munin20:20:210
119591150,1ptp4l3230-21snmp_o5powerctl23:20:201
119591150,1ptp4l3194-21snmp_o5powerctl00:20:230
119591150,1ptp4l25730-21snmp_o5powerctl21:00:220
119591150,1ptp4l25730-21snmp_o5powerctl21:00:210
119591150,1ptp4l22967-21sed19:55:161
119591150,1ptp4l2179-21grep23:20:140
119591150,1ptp4l20951-21diskstats22:55:140
119591150,1ptp4l18149-21diskstats23:50:141
119591150,1ptp4l14689-21ls21:40:220
119591150,1ptp4l14527-21/usr/sbin/munin19:40:151
119591150,1ptp4l14051-21snmp_o5powerctl23:40:220
119591150,1ptp4l13609-21expr20:40:131
119591150,1ptp4l11879-21ls19:35:140
119591150,1ptp4l11340-21snmp_o5powerctl00:35:231
119591150,0ptp4l0-21swapper/123:55:121
119591150,0ptp4l0-21swapper/123:45:131
119591150,0ptp4l0-21swapper/123:00:131
119591150,0ptp4l0-21swapper/122:55:121
119591150,0ptp4l0-21swapper/122:22:301
119591150,0ptp4l0-21swapper/121:35:121
119591150,0ptp4l0-21swapper/120:25:191
119591150,0ptp4l0-21swapper/119:25:111
119591150,0ptp4l0-21swapper/100:15:131
119591150,0ptp4l0-21swapper/023:50:130
119591150,0ptp4l0-21swapper/023:30:120
119591150,0ptp4l0-21swapper/023:15:120
119591150,0ptp4l0-21swapper/021:20:120
119591150,0ptp4l0-21swapper/020:00:120
119591150,0ptp4l0-21swapper/000:10:130
119591150,0ptp4l0-21swapper/000:10:130
119591150,0ptp4l0-21swapper/000:05:200
119591140,1ptp4l8735-21snmp_o5powerctl23:30:231
119591140,1ptp4l841-21cat19:15:141
119591140,1ptp4l6681-21open_files20:25:210
119591140,1ptp4l4671-21cat00:25:130
119591140,1ptp4l27704-21ntp_offset22:05:200
119591140,1ptp4l26746-21aten_r9power_en21:05:130
119591140,1ptp4l24623-21fschecks_time21:00:151
119591140,1ptp4l24623-21fschecks_time21:00:141
119591140,1ptp4l24163-21diskstats22:00:141
119591140,1ptp4l20562-21apt-get21:55:010
119591140,1ptp4l19016-21chrt21:50:161
119591140,1ptp4l18664-21apt-key20:50:020
119591140,1ptp4l17023-21fschecks_time19:45:161
119591140,1ptp4l16806-21timerandwakeup23:45:240
119591140,1ptp4l16438-21needreboot22:45:210
119591140,1ptp4l11338-21snmp_o5powerctl00:35:220
119591140,0ptp4l0-21swapper/220:25:152
119591140,0ptp4l0-21swapper/200:05:232
119591140,0ptp4l0-21swapper/123:35:121
119591140,0ptp4l0-21swapper/123:14:081
119591140,0ptp4l0-21swapper/122:47:101
119591140,0ptp4l0-21swapper/122:40:191
119591140,0ptp4l0-21swapper/122:35:241
119591140,0ptp4l0-21swapper/122:18:401
119591140,0ptp4l0-21swapper/122:10:171
119591140,0ptp4l0-21swapper/122:06:121
119591140,0ptp4l0-21swapper/121:40:181
119591140,0ptp4l0-21swapper/121:30:171
119591140,0ptp4l0-21swapper/121:10:171
119591140,0ptp4l0-21swapper/120:50:181
119591140,0ptp4l0-21swapper/120:46:291
119591140,0ptp4l0-21swapper/120:30:161
119591140,0ptp4l0-21swapper/120:05:191
119591140,0ptp4l0-21swapper/120:02:581
119591140,0ptp4l0-21swapper/119:35:121
119591140,0ptp4l0-21swapper/119:21:201
119591140,0ptp4l0-21swapper/100:23:461
119591140,0ptp4l0-21swapper/023:55:220
119591140,0ptp4l0-21swapper/022:40:230
119591140,0ptp4l0-21swapper/022:35:220
119591140,0ptp4l0-21swapper/022:10:220
119591140,0ptp4l0-21swapper/021:25:220
119591140,0ptp4l0-21swapper/020:10:200
119591140,0ptp4l0-21swapper/019:45:240
119591140,0ptp4l0-21swapper/019:20:120
119591140,0ptp4l0-21swapper/000:32:510
119591140,0ptp4l0-21swapper/000:00:130
119591130,3ptp4l41-21ksoftirqd/322:43:543
119591130,1ptp4l11799-21memory20:35:182
119591130,0ptp4l0-21swapper/223:15:222
119591130,0ptp4l0-21swapper/222:45:192
119591130,0ptp4l0-21swapper/222:35:222
119591130,0ptp4l0-21swapper/222:30:122
119591130,0ptp4l0-21swapper/222:25:242
119591130,0ptp4l0-21swapper/222:10:122
119591130,0ptp4l0-21swapper/221:40:142
119591130,0ptp4l0-21swapper/221:30:322
119591130,0ptp4l0-21swapper/221:05:132
119591130,0ptp4l0-21swapper/220:40:162
119591130,0ptp4l0-21swapper/220:30:182
119591130,0ptp4l0-21swapper/220:10:122
119591130,0ptp4l0-21swapper/219:30:172
119591130,0ptp4l0-21swapper/219:10:142
119591130,0ptp4l0-21swapper/200:25:162
119591130,0ptp4l0-21swapper/200:20:252
119591130,0ptp4l0-21swapper/200:10:262
119591130,0ptp4l0-21swapper/200:10:252
119591130,0ptp4l0-21swapper/122:50:141
119591130,0ptp4l0-21swapper/121:05:201
119591130,0ptp4l0-21swapper/120:55:141
119591130,0ptp4l0-21swapper/120:35:131
119591130,0ptp4l0-21swapper/120:10:131
119591130,0ptp4l0-21swapper/119:50:151
119591130,0ptp4l0-21swapper/119:30:131
119591130,0ptp4l0-21swapper/100:25:191
119591130,0ptp4l0-21swapper/100:05:171
119591130,0ptp4l0-21swapper/023:25:160
119591130,0ptp4l0-21swapper/023:10:140
119591130,0ptp4l0-21swapper/023:05:150
119591130,0ptp4l0-21swapper/023:05:140
119591130,0ptp4l0-21swapper/023:00:170
119591130,0ptp4l0-21swapper/022:25:000
119591130,0ptp4l0-21swapper/021:50:130
119591130,0ptp4l0-21swapper/021:30:330
119591130,0ptp4l0-21swapper/021:15:140
119591130,0ptp4l0-21swapper/020:55:010
119591130,0ptp4l0-21swapper/020:45:120
119591130,0ptp4l0-21swapper/020:40:120
119591130,0ptp4l0-21swapper/020:30:130
119591130,0ptp4l0-21swapper/020:05:130
119591130,0ptp4l0-21swapper/019:50:020
119591130,0ptp4l0-21swapper/019:40:130
119591130,0ptp4l0-21swapper/019:30:140
119591130,0ptp4l0-21swapper/019:10:210
119591130,0ptp4l0-21swapper/000:15:160
2953599116,2cyclictest6667-21grep21:25:222
119591110,2ptp4l0-21swapper/219:23:302
119591110,0ptp4l0-21swapper/200:15:212
29535991010,0cyclictest33-21ksoftirqd/223:05:012
119591100,1ptp4l0-21swapper/221:45:362
119591100,0ptp4l0-21swapper/223:40:022
119591100,0ptp4l0-21swapper/223:10:162
119591100,0ptp4l0-21swapper/222:00:272
119591100,0ptp4l0-21swapper/200:35:002
295369997,1cyclictest9239-21taskset22:30:443
295369997,1cyclictest7966-21cut23:30:173
295369997,1cyclictest6840-21grep21:25:233
295369997,1cyclictest6504-21chrt23:26:063
295369997,1cyclictest4123-21taskset22:22:583
295369997,1cyclictest308712sleep300:13:143
295369997,1cyclictest308712sleep300:13:143
295369997,1cyclictest26044-21tr23:05:133
295369997,1cyclictest26044-21tr23:05:133
295369997,1cyclictest23284-21seq00:00:153
295369997,1cyclictest21128-21head19:50:233
295369997,1cyclictest210282sleep320:53:343
295369997,1cyclictest19988-21taskset22:52:043
295369997,1cyclictest19323-21sed21:50:173
295369997,1cyclictest17213-21taskset22:45:573
295369997,1cyclictest14362-21uname20:40:173
295369997,1cyclictest14165-21grub-editenv21:40:173
295369996,2cyclictest11340-21cut23:35:223
295369990,8cyclictest7868-21expr21:30:153
295369990,8cyclictest2493-21tr21:20:143
295359997,1cyclictest5133-21basename23:25:182
295359997,1cyclictest32110-21sh22:15:142
295359997,1cyclictest24104-21cut00:00:192
295359997,1cyclictest24021-21seq21:00:032
295359997,1cyclictest24021-21seq21:00:032
295359997,1cyclictest19017-21ntpq23:50:192
295359997,1cyclictest1397-21rm23:20:012
295359997,1cyclictest12688-21cat21:40:022
295359997,1cyclictest1108-21cut19:15:162
11959190,0ptp4l0-21swapper/223:56:492
11959190,0ptp4l0-21swapper/223:45:162
11959190,0ptp4l0-21swapper/223:35:342
11959190,0ptp4l0-21swapper/223:31:302
11959190,0ptp4l0-21swapper/223:08:022
11959190,0ptp4l0-21swapper/223:08:022
11959190,0ptp4l0-21swapper/222:55:482
11959190,0ptp4l0-21swapper/222:40:102
11959190,0ptp4l0-21swapper/222:23:292
11959190,0ptp4l0-21swapper/221:55:582
11959190,0ptp4l0-21swapper/221:50:452
11959190,0ptp4l0-21swapper/221:22:242
11959190,0ptp4l0-21swapper/221:18:082
11959190,0ptp4l0-21swapper/221:10:282
11959190,0ptp4l0-21swapper/220:56:372
11959190,0ptp4l0-21swapper/220:45:472
11959190,0ptp4l0-21swapper/220:22:462
11959190,0ptp4l0-21swapper/220:16:562
11959190,0ptp4l0-21swapper/220:07:072
11959190,0ptp4l0-21swapper/220:02:552
11959190,0ptp4l0-21swapper/219:56:562
11959190,0ptp4l0-21swapper/219:50:562
11959190,0ptp4l0-21swapper/219:46:592
11959190,0ptp4l0-21swapper/219:41:542
11959190,0ptp4l0-21swapper/219:39:142
11959190,0ptp4l0-21swapper/219:26:062
295369986,1cyclictest9431-21tr19:30:163
295369986,1cyclictest9055-21cut20:30:183
295369986,1cyclictest836-21cut22:15:233
295369986,1cyclictest7112-21tail00:30:133
295369986,1cyclictest6509-21missed_timers20:25:203
295369986,1cyclictest6505-21tail19:25:153
295369986,1cyclictest571-21tr21:15:193
295369986,1cyclictest5613-21taskset19:24:533
295369986,1cyclictest5089-21basename00:25:153
295369986,1cyclictest4745-21sort22:25:143
295369986,1cyclictest3612-21cut20:20:173
295369986,1cyclictest31539-21tr00:15:153
295369986,1cyclictest31047-21tail20:10:193
295369986,1cyclictest30519-21sed19:10:183
295369986,1cyclictest3030-21grep00:20:203
295369986,1cyclictest29669-21expr21:10:113
295369986,1cyclictest29211-21tr22:10:133
295369986,1cyclictest29070-21head20:05:243
295369986,1cyclictest28421-21cat23:10:133
295369986,1cyclictest28363-21cut21:05:223
295369986,1cyclictest281972sleep300:08:033
295369986,1cyclictest26574-21tr22:05:143
295369986,1cyclictest25757-21netstat20:00:193
295369986,1cyclictest25559-21tr21:00:213
295369986,1cyclictest25559-21tr21:00:203
295369986,1cyclictest252022sleep323:00:493
295369986,1cyclictest23952-21expr22:00:143
295369986,1cyclictest22524-21grep21:55:203
295369986,1cyclictest21998-21grep19:55:133
295369986,1cyclictest21596-21wc20:55:133
295369986,1cyclictest20996-21expr23:55:153
295369986,1cyclictest20764-21cat22:55:153
295369986,1cyclictest2073-21tune2fs23:20:143
295369986,1cyclictest19879-21chrt23:52:413
295369986,1cyclictest18286-21cron20:50:013
295369986,1cyclictest17104-21gzip21:45:243
295369986,1cyclictest17026-21grep23:45:253
295369986,1cyclictest1662-21taskset20:15:253
295369986,1cyclictest16492-21basename19:45:143
295369986,1cyclictest14345-21cut19:40:153
295369986,1cyclictest12413-21expr20:35:253
295369986,1cyclictest123382sleep323:40:033
295369986,1cyclictest12136-21cut19:35:163
295369986,1cyclictest11315-21grep22:35:203
295369986,1cyclictest10504-21cat00:35:173
295369986,1cyclictest10176-21taskset21:35:123
295359986,1cyclictest19137-21cat20:50:142
295359986,1cyclictest18488-21expr22:50:172
11959180,0ptp4l0-21swapper/222:06:562
295369975,1cyclictest1254-21hostname19:15:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional