You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 22:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Sat May 09, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591680,51ptp4l0-21swapper/007:06:340
119591630,31ptp4l0-21swapper/107:08:551
1300915449,2phc2sys0-21swapper/207:05:132
211522510,0sleep30-21swapper/309:25:163
1163325042,2sleep30-21swapper/307:05:253
119591230,0ptp4l0-21swapper/111:50:141
119591180,0ptp4l0-21swapper/108:20:211
119591180,0ptp4l0-21swapper/107:55:201
119591170,0ptp4l0-21swapper/107:20:231
119591170,0ptp4l0-21swapper/011:30:190
119591160,1ptp4l8789-21apt-get11:05:121
119591160,1ptp4l2166-21apt-get07:50:131
119591160,0ptp4l0-21swapper/111:29:211
119591160,0ptp4l0-21swapper/107:15:161
119591160,0ptp4l0-21swapper/012:05:210
119591160,0ptp4l0-21swapper/011:15:020
119591150,1ptp4l9534-21apt-get09:05:140
119591150,1ptp4l9300-21ls08:00:231
119591150,1ptp4l8157-21users11:00:231
119591150,1ptp4l4013-21sed07:50:240
119591150,1ptp4l31893-21snmp_o5powerctl11:45:221
119591150,1ptp4l2875-21snmp_o5powerctl09:50:221
119591150,1ptp4l2500-21snmp_o5powerctl10:50:210
119591150,1ptp4l23719-21snmp_o5powerctl11:30:221
119591150,1ptp4l20150-21apt-get09:25:131
119591150,1ptp4l17473-21snmp_o5powerctl07:15:220
119591150,0ptp4l0-21swapper/111:40:121
119591150,0ptp4l0-21swapper/111:15:131
119591150,0ptp4l0-21swapper/110:55:121
119591150,0ptp4l0-21swapper/110:49:371
119591150,0ptp4l0-21swapper/110:40:021
119591150,0ptp4l0-21swapper/110:15:261
119591150,0ptp4l0-21swapper/109:36:501
119591150,0ptp4l0-21swapper/109:12:091
119591150,0ptp4l0-21swapper/108:50:191
119591150,0ptp4l0-21swapper/107:45:021
119591150,0ptp4l0-21swapper/011:50:150
119591150,0ptp4l0-21swapper/011:45:120
119591150,0ptp4l0-21swapper/009:14:000
119591150,0ptp4l0-21swapper/008:45:120
119591150,0ptp4l0-21swapper/008:00:020
119591150,0ptp4l0-21swapper/007:10:130
119591140,1ptp4l4513-21cstates08:55:131
119591140,1ptp4l32633-21smartctl09:45:210
119591140,1ptp4l2995-21timerandwakeup09:50:230
119591140,1ptp4l28713-21expr09:40:151
119591140,1ptp4l26629-21snmp_o5powerctl12:35:220
119591140,1ptp4l26326-21mailstats11:35:200
119591140,1ptp4l25829-21interrupts12:35:171
119591140,1ptp4l24168-21taskset09:30:190
119591140,1ptp4l22216-21apt-config12:30:010
119591140,1ptp4l21219-21phc2sys-jitter10:25:221
119591140,1ptp4l2048-21diskstats08:50:140
119591140,1ptp4l20109-21users08:20:240
119591140,1ptp4l19915-21perf09:25:010
119591140,1ptp4l17249-21latency_hist09:20:010
119591140,1ptp4l13841-21users10:10:260
119591140,1ptp4l12673-21cut08:10:011
119591140,1ptp4l12349-21grep10:10:171
119591140,1ptp4l11464-21telnet11:10:110
119591140,1ptp4l10648-21users12:05:251
119591140,1ptp4l10083-21irqrtprio10:05:161
119591140,0ptp4l4780-21strings10:55:180
119591140,0ptp4l22423-21apt-get10:30:121
119591140,0ptp4l0-21swapper/212:15:212
119591140,0ptp4l0-21swapper/112:27:201
119591140,0ptp4l0-21swapper/112:24:081
119591140,0ptp4l0-21swapper/112:15:231
119591140,0ptp4l0-21swapper/112:01:181
119591140,0ptp4l0-21swapper/111:55:221
119591140,0ptp4l0-21swapper/110:36:561
119591140,0ptp4l0-21swapper/110:00:161
119591140,0ptp4l0-21swapper/109:59:401
119591140,0ptp4l0-21swapper/109:23:081
119591140,0ptp4l0-21swapper/109:19:051
119591140,0ptp4l0-21swapper/108:40:121
119591140,0ptp4l0-21swapper/108:18:201
119591140,0ptp4l0-21swapper/108:10:161
119591140,0ptp4l0-21swapper/107:40:231
119591140,0ptp4l0-21swapper/107:13:471
119591140,0ptp4l0-21swapper/012:20:190
119591140,0ptp4l0-21swapper/011:40:190
119591140,0ptp4l0-21swapper/011:00:120
119591140,0ptp4l0-21swapper/009:40:090
119591140,0ptp4l0-21swapper/009:38:370
119591140,0ptp4l0-21swapper/009:00:240
119591140,0ptp4l0-21swapper/008:15:190
119591140,0ptp4l0-21swapper/007:55:230
119591140,0ptp4l0-21swapper/007:25:130
119591130,1ptp4l23413-21kworker/u8:008:30:130
119591130,0ptp4l26498-21df_inode08:35:160
119591130,0ptp4l0-21swapper/312:10:193
119591130,0ptp4l0-21swapper/212:20:102
119591130,0ptp4l0-21swapper/212:10:232
119591130,0ptp4l0-21swapper/212:00:192
119591130,0ptp4l0-21swapper/211:25:202
119591130,0ptp4l0-21swapper/211:00:142
119591130,0ptp4l0-21swapper/210:55:132
119591130,0ptp4l0-21swapper/210:35:172
119591130,0ptp4l0-21swapper/209:50:242
119591130,0ptp4l0-21swapper/209:45:162
119591130,0ptp4l0-21swapper/209:40:212
119591130,0ptp4l0-21swapper/209:25:232
119591130,0ptp4l0-21swapper/208:10:182
119591130,0ptp4l0-21swapper/208:00:192
119591130,0ptp4l0-21swapper/207:45:162
119591130,0ptp4l0-21swapper/207:35:172
119591130,0ptp4l0-21swapper/207:30:152
119591130,0ptp4l0-21swapper/207:20:132
119591130,0ptp4l0-21swapper/112:30:171
119591130,0ptp4l0-21swapper/112:10:121
119591130,0ptp4l0-21swapper/111:35:131
119591130,0ptp4l0-21swapper/111:20:151
119591130,0ptp4l0-21swapper/111:10:141
119591130,0ptp4l0-21swapper/110:50:181
119591130,0ptp4l0-21swapper/110:20:131
119591130,0ptp4l0-21swapper/109:45:181
119591130,0ptp4l0-21swapper/109:30:131
119591130,0ptp4l0-21swapper/109:05:171
119591130,0ptp4l0-21swapper/109:00:131
119591130,0ptp4l0-21swapper/108:45:131
119591130,0ptp4l0-21swapper/108:35:151
119591130,0ptp4l0-21swapper/108:30:131
119591130,0ptp4l0-21swapper/108:25:151
119591130,0ptp4l0-21swapper/107:35:131
119591130,0ptp4l0-21swapper/107:30:161
119591130,0ptp4l0-21swapper/107:25:171
119591130,0ptp4l0-21swapper/012:25:130
119591130,0ptp4l0-21swapper/012:15:170
119591130,0ptp4l0-21swapper/012:10:150
119591130,0ptp4l0-21swapper/012:00:160
119591130,0ptp4l0-21swapper/011:55:130
119591130,0ptp4l0-21swapper/011:25:020
119591130,0ptp4l0-21swapper/011:20:160
119591130,0ptp4l0-21swapper/011:05:220
119591130,0ptp4l0-21swapper/010:45:130
119591130,0ptp4l0-21swapper/010:40:120
119591130,0ptp4l0-21swapper/010:35:150
119591130,0ptp4l0-21swapper/010:30:150
119591130,0ptp4l0-21swapper/010:25:230
119591130,0ptp4l0-21swapper/010:20:160
119591130,0ptp4l0-21swapper/010:15:170
119591130,0ptp4l0-21swapper/010:05:160
119591130,0ptp4l0-21swapper/010:00:120
119591130,0ptp4l0-21swapper/009:55:140
119591130,0ptp4l0-21swapper/009:25:150
119591130,0ptp4l0-21swapper/008:55:220
119591130,0ptp4l0-21swapper/008:40:170
119591130,0ptp4l0-21swapper/008:25:160
119591130,0ptp4l0-21swapper/008:10:130
119591130,0ptp4l0-21swapper/008:05:130
119591130,0ptp4l0-21swapper/007:45:140
119591130,0ptp4l0-21swapper/007:40:160
119591130,0ptp4l0-21swapper/007:35:130
119591130,0ptp4l0-21swapper/007:30:160
119591130,0ptp4l0-21swapper/007:20:130
119591120,0ptp4l0-21swapper/309:05:193
119591120,0ptp4l0-21swapper/210:20:012
119591120,0ptp4l0-21swapper/208:55:132
119591120,0ptp4l0-21swapper/208:30:192
119591120,0ptp4l0-21swapper/207:50:232
119591120,0ptp4l0-21swapper/207:10:202
1236299114,3cyclictest33-21ksoftirqd/210:50:122
1236299114,2cyclictest33-21ksoftirqd/211:30:152
1236299110,1cyclictest33-21ksoftirqd/207:25:162
1236299110,1cyclictest0-21swapper/209:10:192
119591110,0ptp4l0-21swapper/309:32:243
119591110,0ptp4l0-21swapper/307:50:173
119591110,0ptp4l0-21swapper/208:50:132
119591110,0ptp4l0-21swapper/208:45:232
119591110,0ptp4l0-21swapper/207:41:302
1236299106,2cyclictest33-21ksoftirqd/211:50:132
1236299104,3cyclictest33-21ksoftirqd/212:25:182
1236299104,3cyclictest33-21ksoftirqd/210:30:122
1236299104,2cyclictest33-21ksoftirqd/209:15:142
1236299103,2cyclictest33-21ksoftirqd/210:10:182
1236299103,2cyclictest33-21ksoftirqd/208:35:212
1236299103,1cyclictest33-21ksoftirqd/211:45:012
1236299103,1cyclictest33-21ksoftirqd/211:35:132
1236299103,1cyclictest33-21ksoftirqd/211:05:172
1236299102,2cyclictest33-21ksoftirqd/208:15:252
119591100,0ptp4l0-21swapper/212:38:252
119591100,0ptp4l0-21swapper/210:06:252
119591100,0ptp4l0-21swapper/210:02:242
119591100,0ptp4l0-21swapper/208:43:312
119591100,0ptp4l0-21swapper/208:05:152
123639997,1cyclictest8712-21chrt10:02:293
123639997,1cyclictest802-21chrt09:48:273
123639997,1cyclictest58082sleep310:59:173
123639997,1cyclictest31535-21apt-key07:45:013
123639997,1cyclictest28490-21cut10:40:143
123639997,1cyclictest26436-21expr08:35:153
123639997,1cyclictest23027-21basename12:30:163
123639997,1cyclictest22729-21head08:25:253
123639997,1cyclictest22274-21cat07:25:183
123639997,1cyclictest18109-21cut10:20:173
123639997,1cyclictest14153-21chrt10:14:183
123639997,1cyclictest12468-21tr09:10:133
123639996,2cyclictest29942-21cat08:40:183
123629998,0cyclictest33-21ksoftirqd/211:40:232
123629997,1cyclictest24094-21cut09:30:172
123629995,2cyclictest33-21ksoftirqd/211:55:132
123629993,2cyclictest33-21ksoftirqd/212:05:152
123629993,2cyclictest33-21ksoftirqd/210:45:132
123629993,1cyclictest33-21ksoftirqd/210:40:162
123629993,1cyclictest33-21ksoftirqd/209:35:162
123629992,2cyclictest33-21ksoftirqd/211:18:482
123629992,2cyclictest33-21ksoftirqd/209:55:232
123629990,3cyclictest33-21ksoftirqd/209:20:202
123629990,3cyclictest0-21swapper/208:25:142
123629990,2cyclictest33-21ksoftirqd/210:25:242
11959190,1ptp4l3929-21taskset08:54:353
11959190,1ptp4l1236299cyclictest11:21:162
11959190,0ptp4l41-21ksoftirqd/308:55:263
11959190,0ptp4l0-21swapper/310:34:273
11959190,0ptp4l0-21swapper/310:26:313
11959190,0ptp4l0-21swapper/308:14:053
11959190,0ptp4l0-21swapper/307:22:093
11959190,0ptp4l0-21swapper/212:30:492
11959190,0ptp4l0-21swapper/211:11:312
123639986,1cyclictest7446-21taskset08:00:103
123639986,1cyclictest7112-21tr09:00:143
123639986,1cyclictest6737-21gltestperf11:00:153
123639986,1cyclictest5473-21cut09:55:213
123639986,1cyclictest4795-21basename07:55:133
123639986,1cyclictest468-21gunzip08:45:203
123639986,1cyclictest3984-21grep11:55:153
123639986,1cyclictest32033-21cut07:45:133
123639986,1cyclictest30653-21cat11:45:133
123639986,1cyclictest30614-21cut10:45:113
123639986,1cyclictest28556-21cut09:40:143
123639986,1cyclictest2766-21taskset11:54:003
123639986,1cyclictest27607-21expr11:40:133
123639986,1cyclictest27412-21timerandwakeup09:35:243
123639986,1cyclictest25408-21expr10:35:143
123639986,1cyclictest25151-21grep12:35:143
123639986,1cyclictest25066-21expr11:35:133
123639986,1cyclictest24876-21uname07:30:183
123639986,1cyclictest23749-21expr08:30:143
123639986,1cyclictest22266-21tr11:30:143
123639986,1cyclictest20710-21grep12:25:183
123639986,1cyclictest180562sleep308:20:083
123639986,1cyclictest17509-21taskset09:20:133
123639986,1cyclictest17366-21grep08:15:243
123639986,1cyclictest16876-21cat12:20:113
123639986,1cyclictest16519-21seq10:15:393
123639986,1cyclictest15759-21tr09:15:183
123639986,1cyclictest14444-21grep12:15:143
123639986,1cyclictest1153-21cat10:50:133
123639986,1cyclictest11464-21telnet11:10:113
123639986,1cyclictest11215-21chrt10:05:373
123639986,1cyclictest10960-21chrt12:09:153
123639986,1cyclictest108412sleep311:05:383
123639986,1cyclictest10594-21sh08:05:163
123639980,2cyclictest0-21swapper/307:10:133
123629986,1cyclictest8727-21cat09:00:242
123629986,1cyclictest15268-21basename07:15:012
123629982,3cyclictest33-21ksoftirqd/207:55:172
123629980,3cyclictest33-21ksoftirqd/208:20:132
11959180,0ptp4l0-21swapper/312:03:123
11959180,0ptp4l0-21swapper/311:25:083
11959180,0ptp4l0-21swapper/311:16:443
11959180,0ptp4l0-21swapper/307:38:463
11959180,0ptp4l0-21swapper/210:15:072
11959180,0ptp4l0-21swapper/209:05:112
123639976,1cyclictest16255-21expr07:15:143
123639975,1cyclictest19060-21taskset11:23:503
123639975,1cyclictest1588-21cat09:50:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional