You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 01:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Tue Jul 28, 2026 12:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591630,32ptp4l0-21swapper/007:08:440
119591590,40ptp4l0-21swapper/107:07:241
964325045,2sleep30-21swapper/307:05:243
243462490,0sleep00-21swapper/010:35:140
1014224945,2sleep20-21swapper/207:05:582
27682480,0sleep30-21swapper/308:55:133
247232460,0sleep10-21swapper/110:35:151
142252450,0sleep00-21swapper/007:15:120
119591220,0ptp4l0-21swapper/012:15:160
119591190,0ptp4l0-21swapper/112:00:221
119591190,0ptp4l0-21swapper/109:00:251
119591180,0ptp4l0-21swapper/109:40:131
119591180,0ptp4l0-21swapper/008:55:160
119591170,2ptp4l0-21swapper/011:10:190
119591170,0ptp4l0-21swapper/107:30:141
119591170,0ptp4l0-21swapper/012:00:170
119591160,1ptp4l29912-21apt-get08:45:131
119591160,1ptp4l16826-21apt-get07:20:121
119591160,0ptp4l0-21swapper/010:40:170
119591150,2ptp4l8680-21seq10:05:161
119591150,2ptp4l31930-21users08:45:240
119591150,1ptp4l6832-21snmp_o5powerctl11:00:230
119591150,1ptp4l4830-21snmp_o5powerctl07:55:210
119591150,1ptp4l31152-21snmp_o5powerctl11:45:221
119591150,1ptp4l29391-21ls07:40:221
119591150,1ptp4l25272-21snmp_o5powerctl12:35:240
119591150,1ptp4l24002-21snmp_o5powerctl07:30:220
119591150,1ptp4l2353-21apt-get11:55:130
119591150,1ptp4l23179-21ntp_states09:30:191
119591150,1ptp4l22623-21snmp_o5powerctl12:30:231
119591150,1ptp4l21785-21diskstats11:30:141
119591150,1ptp4l18030-21snmp_o5powerctl10:20:221
119591150,1ptp4l13017-21snmp_o5powerctl08:10:221
119591150,1ptp4l12719-21snmp_o5powerctl10:10:230
119591150,0ptp4l0-21swapper/111:50:131
119591150,0ptp4l0-21swapper/109:25:141
119591150,0ptp4l0-21swapper/011:45:130
119591150,0ptp4l0-21swapper/009:10:120
119591150,0ptp4l0-21swapper/008:15:010
119591140,1ptp4l570-21df08:50:140
119591140,1ptp4l30419-21/usr/sbin/munin10:45:160
119591140,1ptp4l30419-21/usr/sbin/munin10:45:160
119591140,1ptp4l28537-21memory09:40:170
119591140,1ptp4l2831-21diskstats11:55:151
119591140,1ptp4l26637-21python07:35:211
119591140,1ptp4l2595-21apt-get09:55:030
119591140,1ptp4l25421-21timerandwakeup12:35:251
119591140,1ptp4l25372-21irqrtprio09:35:200
119591140,1ptp4l24428-21aten2.4-expect10:35:152
119591140,1ptp4l22095-21perf07:30:010
119591140,1ptp4l21251-21cstates12:30:140
119591140,1ptp4l20976-21smartctl08:25:210
119591140,1ptp4l19978-21snmp_o5powerctl12:25:230
119591140,1ptp4l19399-21aten_r9power_po08:25:131
119591140,1ptp4l1937-21cat09:50:240
119591140,1ptp4l19027-21ls12:25:161
119591140,1ptp4l18141-21sed09:20:240
119591140,1ptp4l1725-21ls07:50:171
119591140,1ptp4l15826-21snmp_o5powerctl07:15:221
119591140,1ptp4l15670-21snmp_o5powerctl08:15:231
119591140,1ptp4l14868-21missed_timers09:15:180
119591140,1ptp4l14357-21ntpq12:15:201
119591140,1ptp4l1115-21irqrtprio08:50:171
119591140,1ptp4l10897-21apt-get08:10:010
119591140,1ptp4l0-21swapper/010:30:530
119591140,0ptp4l31350-21ntp_states09:45:201
119591140,0ptp4l0-21swapper/211:25:232
119591140,0ptp4l0-21swapper/112:10:231
119591140,0ptp4l0-21swapper/111:25:021
119591140,0ptp4l0-21swapper/111:10:241
119591140,0ptp4l0-21swapper/111:07:111
119591140,0ptp4l0-21swapper/111:00:131
119591140,0ptp4l0-21swapper/110:58:091
119591140,0ptp4l0-21swapper/110:47:541
119591140,0ptp4l0-21swapper/110:47:541
119591140,0ptp4l0-21swapper/110:43:471
119591140,0ptp4l0-21swapper/110:25:191
119591140,0ptp4l0-21swapper/109:55:031
119591140,0ptp4l0-21swapper/109:54:461
119591140,0ptp4l0-21swapper/109:05:201
119591140,0ptp4l0-21swapper/108:59:331
119591140,0ptp4l0-21swapper/108:40:241
119591140,0ptp4l0-21swapper/108:40:231
119591140,0ptp4l0-21swapper/108:30:161
119591140,0ptp4l0-21swapper/108:20:211
119591140,0ptp4l0-21swapper/107:55:131
119591140,0ptp4l0-21swapper/107:45:211
119591140,0ptp4l0-21swapper/107:25:221
119591140,0ptp4l0-21swapper/012:10:140
119591140,0ptp4l0-21swapper/011:35:240
119591140,0ptp4l0-21swapper/011:30:130
119591140,0ptp4l0-21swapper/011:25:210
119591140,0ptp4l0-21swapper/010:50:230
119591140,0ptp4l0-21swapper/010:00:260
119591140,0ptp4l0-21swapper/008:05:440
119591140,0ptp4l0-21swapper/007:50:180
119591140,0ptp4l0-21swapper/007:49:460
119591140,0ptp4l0-21swapper/007:35:240
119591140,0ptp4l0-21swapper/007:10:280
119591130,1ptp4l22121-21df10:30:151
119591130,0ptp4l9112-21strings11:05:200
119591130,0ptp4l22429-21df_inode08:30:140
119591130,0ptp4l0-21swapper/308:50:133
119591130,0ptp4l0-21swapper/212:30:242
119591130,0ptp4l0-21swapper/210:30:172
119591130,0ptp4l0-21swapper/208:35:012
119591130,0ptp4l0-21swapper/207:30:222
119591130,0ptp4l0-21swapper/207:10:142
119591130,0ptp4l0-21swapper/112:20:131
119591130,0ptp4l0-21swapper/112:05:161
119591130,0ptp4l0-21swapper/111:40:021
119591130,0ptp4l0-21swapper/111:35:161
119591130,0ptp4l0-21swapper/111:20:131
119591130,0ptp4l0-21swapper/111:15:141
119591130,0ptp4l0-21swapper/110:50:141
119591130,0ptp4l0-21swapper/110:15:151
119591130,0ptp4l0-21swapper/110:10:171
119591130,0ptp4l0-21swapper/110:00:141
119591130,0ptp4l0-21swapper/109:20:151
119591130,0ptp4l0-21swapper/109:15:131
119591130,0ptp4l0-21swapper/109:10:181
119591130,0ptp4l0-21swapper/108:35:191
119591130,0ptp4l0-21swapper/108:05:121
119591130,0ptp4l0-21swapper/108:00:131
119591130,0ptp4l0-21swapper/107:10:151
119591130,0ptp4l0-21swapper/012:20:140
119591130,0ptp4l0-21swapper/012:05:150
119591130,0ptp4l0-21swapper/011:50:150
119591130,0ptp4l0-21swapper/011:40:210
119591130,0ptp4l0-21swapper/011:20:150
119591130,0ptp4l0-21swapper/011:15:150
119591130,0ptp4l0-21swapper/010:55:190
119591130,0ptp4l0-21swapper/010:25:180
119591130,0ptp4l0-21swapper/010:20:140
119591130,0ptp4l0-21swapper/010:15:190
119591130,0ptp4l0-21swapper/010:05:220
119591130,0ptp4l0-21swapper/009:45:250
119591130,0ptp4l0-21swapper/009:30:170
119591130,0ptp4l0-21swapper/009:25:010
119591130,0ptp4l0-21swapper/009:05:170
119591130,0ptp4l0-21swapper/009:00:150
119591130,0ptp4l0-21swapper/008:40:230
119591130,0ptp4l0-21swapper/008:40:230
119591130,0ptp4l0-21swapper/008:35:110
119591130,0ptp4l0-21swapper/008:20:120
119591130,0ptp4l0-21swapper/008:00:220
119591130,0ptp4l0-21swapper/007:40:140
119591130,0ptp4l0-21swapper/007:20:150
10717991312,0cyclictest41-21ksoftirqd/308:15:153
10717991311,1cyclictest41-21ksoftirqd/308:35:133
10717991310,2cyclictest41-21ksoftirqd/309:30:153
119591120,0ptp4l0-21swapper/209:20:212
119591120,0ptp4l0-21swapper/208:25:192
119591120,0ptp4l0-21swapper/207:20:172
119591120,0ptp4l0-21swapper/109:35:161
10717991211,0cyclictest41-21ksoftirqd/312:35:223
119591110,0ptp4l33-21ksoftirqd/209:00:312
119591110,0ptp4l0-21swapper/312:12:123
119591110,0ptp4l0-21swapper/207:26:472
10717991110,1cyclictest41-21ksoftirqd/310:35:143
119591100,1ptp4l0-21swapper/308:46:563
119591100,0ptp4l0-21swapper/307:56:293
119591100,0ptp4l0-21swapper/212:09:012
119591100,0ptp4l0-21swapper/210:20:522
10717991010,0cyclictest41-21ksoftirqd/311:50:213
10717991010,0cyclictest41-21ksoftirqd/311:25:183
11959190,0ptp4l41-21ksoftirqd/311:56:433
11959190,0ptp4l0-21swapper/311:30:313
11959190,0ptp4l0-21swapper/311:18:013
11959190,0ptp4l0-21swapper/311:11:013
11959190,0ptp4l0-21swapper/311:02:013
11959190,0ptp4l0-21swapper/308:41:403
11959190,0ptp4l0-21swapper/308:41:403
11959190,0ptp4l0-21swapper/308:05:323
11959190,0ptp4l0-21swapper/212:18:432
11959190,0ptp4l0-21swapper/212:11:312
11959190,0ptp4l0-21swapper/211:56:402
11959190,0ptp4l0-21swapper/210:58:112
11959190,0ptp4l0-21swapper/210:46:512
11959190,0ptp4l0-21swapper/210:46:502
11959190,0ptp4l0-21swapper/210:44:432
11959190,0ptp4l0-21swapper/210:17:392
11959190,0ptp4l0-21swapper/210:14:512
11959190,0ptp4l0-21swapper/209:46:452
11959190,0ptp4l0-21swapper/209:40:432
11959190,0ptp4l0-21swapper/209:25:262
11959190,0ptp4l0-21swapper/208:37:462
11959190,0ptp4l0-21swapper/208:10:032
11959190,0ptp4l0-21swapper/208:03:362
11959190,0ptp4l0-21swapper/207:47:392
107179998,1cyclictest41-21ksoftirqd/307:25:163
107179997,2cyclictest607-21irqbalance07:47:513
107179997,1cyclictest7930-21chrt08:01:203
107179997,1cyclictest3937-21sed09:55:153
107179997,1cyclictest31853-21taskset10:48:043
107179997,1cyclictest31853-21taskset10:48:033
107179997,1cyclictest29969-21basename09:45:133
107179997,1cyclictest260912sleep311:36:493
107179997,1cyclictest18965-21grep12:25:163
107179997,1cyclictest17666-21taskset07:20:173
107179997,1cyclictest16356-21chrt07:17:313
107179997,1cyclictest105742sleep310:07:183
107179997,1cyclictest103762sleep309:05:463
107169997,1cyclictest4367-21date07:55:192
107169997,1cyclictest32354-21cut08:50:022
107169997,1cyclictest27277-21chrt07:38:532
107169997,1cyclictest17068-21tail11:20:172
107169997,1cyclictest16360-21basename12:20:152
107169997,1cyclictest100472sleep211:08:072
11959180,0ptp4l0-21swapper/309:03:493
11959180,0ptp4l0-21swapper/211:48:062
11959180,0ptp4l0-21swapper/211:40:482
11959180,0ptp4l0-21swapper/210:05:582
107179987,1cyclictest41-21ksoftirqd/312:30:223
107179987,1cyclictest11496-21grep09:10:153
107179986,1cyclictest8357-21chrt12:05:173
107179986,1cyclictest8093-21seq11:05:153
107179986,1cyclictest5685-21taskset10:00:073
107179986,1cyclictest5268-21cut12:00:143
107179986,1cyclictest3995-21head10:55:193
107179986,1cyclictest32575-21taskset09:50:053
107179986,1cyclictest32290-21tail10:50:143
107179986,1cyclictest28577-21cat09:40:173
107179986,1cyclictest27215-21cut10:40:153
107179986,1cyclictest26956-21sh11:40:143
107179986,1cyclictest26767-21grep07:35:243
107179986,1cyclictest24714-21tr09:35:163
107179986,1cyclictest23208-21grep08:30:183
107179986,1cyclictest22698-21expr07:30:143
107179986,1cyclictest216182sleep310:30:053
107179986,1cyclictest17609-21tr08:20:153
107179986,1cyclictest17363-21cut09:20:173
107179986,1cyclictest17307-21snmp_o5powerctl12:20:213
107179986,1cyclictest15796-21basename11:20:123
107179986,1cyclictest14270-21grep10:15:163
107179986,1cyclictest14007-21expr09:15:133
107179986,1cyclictest13494-21grep12:15:143
107179986,1cyclictest11961-21expr08:10:163
107179986,1cyclictest11104-21cut10:10:143
107179986,1cyclictest10720-21chrt07:10:043
107169986,1cyclictest919-21cat07:50:152
107169986,1cyclictest8987-21cut08:05:152
107169986,1cyclictest8506-21sort09:05:162
107169986,1cyclictest7058-21grep11:00:232
107169986,1cyclictest658-21taskset09:50:152
107169986,1cyclictest5768-21basename10:00:142
107169986,1cyclictest5541-21sort12:00:152
107169986,1cyclictest425-21tail10:50:162
107169986,1cyclictest3170-21cut09:55:112
107169986,1cyclictest3067-21cut08:55:142
107169986,1cyclictest28535-21grep07:40:172
107169986,1cyclictest24909-21sh09:35:162
107169986,1cyclictest23998-21cut11:35:152
107169986,1cyclictest23654-21hostname12:35:132
107169986,1cyclictest2269-21seq08:51:372
107169986,1cyclictest21960-21tail11:30:152
107169986,1cyclictest19598-21grep10:25:152
107169986,1cyclictest18272-21seq12:25:072
107169986,1cyclictest1808-21taskset11:51:182
107169986,1cyclictest16941-21expr08:20:122
107169986,1cyclictest16260-21taskset08:18:242
107169986,1cyclictest158022sleep209:17:162
107169986,1cyclictest15061-21tail11:15:232
107169986,1cyclictest14027-21ntp_states07:15:022
107169986,1cyclictest11722-21cat09:10:172
107169986,1cyclictest10643-21cat11:10:152
107179976,1cyclictest19493-21cat09:25:143
107179975,1cyclictest29573-21aten_r9power_vo11:45:133
107179975,1cyclictest29052sleep307:55:003
107179975,1cyclictest27749-21aten_r9power_vo07:40:123
107179975,1cyclictest19567-21tr08:25:143
107179975,1cyclictest19396-21expr10:25:133
107179975,1cyclictest16598-21tr10:20:133
107169975,1cyclictest27527-21cut08:40:152
107169975,1cyclictest27527-21cut08:40:142
107169975,1cyclictest23447-21cut09:30:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional