You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 02:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot3s.osadl.org (updated Thu Sep 17, 2026 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591610,39ptp4l0-21swapper/007:08:110
119591580,40ptp4l0-21swapper/107:05:311
335625147,2sleep20-21swapper/207:07:542
196425045,2sleep30-21swapper/307:05:183
159052420,0sleep00-21swapper/009:30:190
119591260,0ptp4l0-21swapper/107:35:211
3782992319,1cyclictest33-21ksoftirqd/209:31:272
119591210,0ptp4l0-21swapper/112:05:131
119591190,0ptp4l0-21swapper/111:45:141
119591190,0ptp4l0-21swapper/111:00:211
119591180,0ptp4l0-21swapper/011:35:170
119591170,1ptp4l23218-21aten_r9power_po07:45:130
119591170,0ptp4l0-21swapper/112:20:021
119591170,0ptp4l0-21swapper/010:35:260
3782991616,0cyclictest33-21ksoftirqd/208:35:132
3780991615,0cyclictest9-21ksoftirqd/007:10:140
119591160,2ptp4l9129-21snmp_o5powerctl11:15:221
119591160,2ptp4l30548-21ntp_states10:55:181
119591160,2ptp4l0-21swapper/108:20:171
119591160,1ptp4l6848-21apt-get08:15:131
119591160,1ptp4l29168-21apt-get10:55:120
119591160,1ptp4l18398-21apt-get09:32:331
119591160,1ptp4l1781-21apt-get12:05:130
119591160,0ptp4l0-21swapper/110:46:341
119591160,0ptp4l0-21swapper/110:40:251
119591160,0ptp4l0-21swapper/110:05:131
119591160,0ptp4l0-21swapper/012:35:130
3780991515,0cyclictest9-21ksoftirqd/011:15:160
3780991510,2cyclictest9-21ksoftirqd/008:45:190
119591150,1ptp4l7908-21hddtemp_smartct07:15:151
119591150,1ptp4l7539-21smartctl08:15:160
119591150,1ptp4l4055-21ls11:05:250
119591150,1ptp4l31875-21ls09:00:170
119591150,1ptp4l26068-21smartctl09:45:220
119591150,1ptp4l19342-21ls08:35:250
119591150,1ptp4l17826-21perf11:35:010
119591150,1ptp4l14062-21python12:25:221
119591150,1ptp4l10833-21grep10:20:131
119591150,1ptp4l10594-21smartctl09:20:211
119591150,0ptp4l0-21swapper/212:25:152
119591150,0ptp4l0-21swapper/112:35:131
119591150,0ptp4l0-21swapper/111:50:231
119591150,0ptp4l0-21swapper/111:40:121
119591150,0ptp4l0-21swapper/110:15:131
119591150,0ptp4l0-21swapper/109:40:131
119591150,0ptp4l0-21swapper/109:00:121
119591150,0ptp4l0-21swapper/012:25:130
119591150,0ptp4l0-21swapper/010:15:130
119591150,0ptp4l0-21swapper/010:05:130
119591150,0ptp4l0-21swapper/009:05:160
119591150,0ptp4l0-21swapper/008:40:140
119591150,0ptp4l0-21swapper/007:20:130
119591150,0ptp4l0-21swapper/007:15:120
3782991413,0cyclictest33-21ksoftirqd/208:45:192
119591140,1ptp4l9256-21expr09:20:130
119591140,1ptp4l7935-21diskstats11:15:143
119591140,1ptp4l7929-21snmp_o5powerctl09:15:220
119591140,1ptp4l4951-21/usr/sbin/munin09:10:190
119591140,1ptp4l29843-21sed11:55:151
119591140,1ptp4l28948-21unixbench-2d09:50:241
119591140,1ptp4l28192-21snmp_o5powerctl10:50:231
119591140,1ptp4l26525-21if_enp0s31f607:50:141
119591140,1ptp4l23242-21diskstats08:45:141
119591140,1ptp4l20979-21ls09:35:230
119591140,1ptp4l17191-21/usr/sbin/munin07:30:241
119591140,1ptp4l16717-21snmp_o5powerctl12:30:221
119591140,1ptp4l15989-21fschecks_time11:30:151
119591140,1ptp4l12819-21missed_timers09:25:171
119591140,1ptp4l11429-21snmp_o5powerctl12:20:220
119591140,0ptp4l32360-21apt-get10:00:121
119591140,0ptp4l14886-21snmp_o5powerctl10:25:220
119591140,0ptp4l0-21swapper/307:45:223
119591140,0ptp4l0-21swapper/209:25:212
119591140,0ptp4l0-21swapper/112:10:151
119591140,0ptp4l0-21swapper/111:10:231
119591140,0ptp4l0-21swapper/110:30:011
119591140,0ptp4l0-21swapper/109:19:571
119591140,0ptp4l0-21swapper/109:11:241
119591140,0ptp4l0-21swapper/109:08:081
119591140,0ptp4l0-21swapper/108:56:531
119591140,0ptp4l0-21swapper/108:40:251
119591140,0ptp4l0-21swapper/108:10:251
119591140,0ptp4l0-21swapper/107:55:221
119591140,0ptp4l0-21swapper/107:45:261
119591140,0ptp4l0-21swapper/107:20:131
119591140,0ptp4l0-21swapper/107:10:141
119591140,0ptp4l0-21swapper/012:30:240
119591140,0ptp4l0-21swapper/012:15:190
119591140,0ptp4l0-21swapper/012:10:120
119591140,0ptp4l0-21swapper/010:47:280
119591140,0ptp4l0-21swapper/010:35:010
119591140,0ptp4l0-21swapper/010:00:140
119591140,0ptp4l0-21swapper/009:40:150
119591140,0ptp4l0-21swapper/008:34:320
119591140,0ptp4l0-21swapper/008:20:240
119591140,0ptp4l0-21swapper/008:10:230
119591140,0ptp4l0-21swapper/008:01:550
119591140,0ptp4l0-21swapper/007:30:140
246992130,1sleep224701-21kernelversion11:45:152
119591130,0ptp4l0-21swapper/309:25:013
119591130,0ptp4l0-21swapper/307:50:173
119591130,0ptp4l0-21swapper/211:25:192
119591130,0ptp4l0-21swapper/209:55:242
119591130,0ptp4l0-21swapper/209:35:212
119591130,0ptp4l0-21swapper/112:15:141
119591130,0ptp4l0-21swapper/112:00:131
119591130,0ptp4l0-21swapper/111:35:131
119591130,0ptp4l0-21swapper/111:25:121
119591130,0ptp4l0-21swapper/111:20:081
119591130,0ptp4l0-21swapper/111:05:151
119591130,0ptp4l0-21swapper/110:35:191
119591130,0ptp4l0-21swapper/110:30:131
119591130,0ptp4l0-21swapper/110:10:141
119591130,0ptp4l0-21swapper/109:55:141
119591130,0ptp4l0-21swapper/109:45:171
119591130,0ptp4l0-21swapper/109:35:121
119591130,0ptp4l0-21swapper/108:52:361
119591130,0ptp4l0-21swapper/108:35:151
119591130,0ptp4l0-21swapper/108:30:151
119591130,0ptp4l0-21swapper/108:25:121
119591130,0ptp4l0-21swapper/108:05:171
119591130,0ptp4l0-21swapper/108:00:121
119591130,0ptp4l0-21swapper/107:40:131
119591130,0ptp4l0-21swapper/107:25:131
119591130,0ptp4l0-21swapper/012:00:120
119591130,0ptp4l0-21swapper/011:55:160
119591130,0ptp4l0-21swapper/011:50:210
119591130,0ptp4l0-21swapper/011:45:130
119591130,0ptp4l0-21swapper/011:40:150
119591130,0ptp4l0-21swapper/011:25:130
119591130,0ptp4l0-21swapper/011:20:150
119591130,0ptp4l0-21swapper/011:10:130
119591130,0ptp4l0-21swapper/011:00:140
119591130,0ptp4l0-21swapper/010:50:160
119591130,0ptp4l0-21swapper/010:40:140
119591130,0ptp4l0-21swapper/010:20:140
119591130,0ptp4l0-21swapper/010:10:150
119591130,0ptp4l0-21swapper/009:55:210
119591130,0ptp4l0-21swapper/009:50:140
119591130,0ptp4l0-21swapper/009:25:150
119591130,0ptp4l0-21swapper/008:55:120
119591130,0ptp4l0-21swapper/008:50:160
119591130,0ptp4l0-21swapper/008:25:130
119591130,0ptp4l0-21swapper/008:05:120
119591130,0ptp4l0-21swapper/007:55:170
119591130,0ptp4l0-21swapper/007:50:110
119591130,0ptp4l0-21swapper/007:40:120
119591130,0ptp4l0-21swapper/007:35:150
119591130,0ptp4l0-21swapper/007:25:220
119591120,1ptp4l28406-21/usr/sbin/munin07:55:182
119591120,0ptp4l0-21swapper/309:00:153
119591120,0ptp4l0-21swapper/308:10:143
119591120,0ptp4l0-21swapper/212:10:262
119591120,0ptp4l0-21swapper/208:34:032
3782991111,0cyclictest33-21ksoftirqd/210:05:142
378299111,0cyclictest121rcu_preempt11:03:162
119591110,2ptp4l41-21ksoftirqd/307:57:223
3782991010,0cyclictest33-21ksoftirqd/207:40:012
119591100,1ptp4l0-21swapper/212:39:352
119591100,1ptp4l0-21swapper/210:03:352
119591100,1ptp4l0-21swapper/209:14:332
119591100,0ptp4l0-21swapper/308:05:073
119591100,0ptp4l0-21swapper/210:48:052
119591100,0ptp4l0-21swapper/209:40:262
119591100,0ptp4l0-21swapper/209:15:132
119591100,0ptp4l0-21swapper/209:05:152
37839997,1cyclictest6196-21timerandwakeup12:10:233
37839997,1cyclictest3972-21expr09:10:143
37839997,1cyclictest29188-21taskset09:51:463
37839997,1cyclictest22371-21sed10:40:163
37839997,1cyclictest22327-21wc07:40:213
37839997,1cyclictest18750-21tr07:35:163
37839997,1cyclictest17721-21stty12:35:133
37839997,1cyclictest13423-21cut07:25:163
37839990,8cyclictest31073-21ntp_states09:55:193
37839990,8cyclictest29436-21ntpq08:55:193
37839990,8cyclictest16625-21rt-features12:30:203
37829997,1cyclictest6903-21cut10:10:222
37829997,1cyclictest29116-21expr11:55:112
37829997,1cyclictest13813-21cut08:25:212
37829997,1cyclictest12495-21chrt07:25:022
37829990,8cyclictest9394-21sh09:20:132
37829990,0cyclictest121rcu_preempt09:45:232
11959190,0ptp4l0-21swapper/312:16:173
11959190,0ptp4l0-21swapper/311:59:473
11959190,0ptp4l0-21swapper/311:42:583
11959190,0ptp4l0-21swapper/310:35:333
11959190,0ptp4l0-21swapper/308:29:213
11959190,0ptp4l0-21swapper/212:32:572
11959190,0ptp4l0-21swapper/212:20:552
11959190,0ptp4l0-21swapper/212:15:352
11959190,0ptp4l0-21swapper/212:05:542
11959190,0ptp4l0-21swapper/212:00:052
11959190,0ptp4l0-21swapper/211:50:572
11959190,0ptp4l0-21swapper/211:41:252
11959190,0ptp4l0-21swapper/211:38:402
11959190,0ptp4l0-21swapper/211:20:582
11959190,0ptp4l0-21swapper/211:16:312
11959190,0ptp4l0-21swapper/211:10:082
11959190,0ptp4l0-21swapper/211:09:402
11959190,0ptp4l0-21swapper/210:55:392
11959190,0ptp4l0-21swapper/210:54:442
11959190,0ptp4l0-21swapper/210:41:302
11959190,0ptp4l0-21swapper/210:32:052
11959190,0ptp4l0-21swapper/210:28:502
11959190,0ptp4l0-21swapper/210:24:232
11959190,0ptp4l0-21swapper/210:19:152
11959190,0ptp4l0-21swapper/209:50:572
11959190,0ptp4l0-21swapper/209:04:592
11959190,0ptp4l0-21swapper/208:55:292
11959190,0ptp4l0-21swapper/208:52:402
11959190,0ptp4l0-21swapper/208:40:512
11959190,0ptp4l0-21swapper/208:20:032
11959190,0ptp4l0-21swapper/208:16:182
11959190,0ptp4l0-21swapper/208:05:092
11959190,0ptp4l0-21swapper/208:00:272
11959190,0ptp4l0-21swapper/207:47:372
11959190,0ptp4l0-21swapper/207:38:332
11959190,0ptp4l0-21swapper/207:32:312
11959190,0ptp4l0-21swapper/207:21:482
11959190,0ptp4l0-21swapper/207:12:292
37839986,1cyclictest9725-21tr08:20:153
37839986,1cyclictest9554-21chrt10:15:223
37839986,1cyclictest904-21chrt09:05:083
37839986,1cyclictest8219-21ntpq08:15:193
37839986,1cyclictest6922-21proc_pri07:15:023
37839986,1cyclictest6892-21tr10:10:223
37839986,1cyclictest6222-21taskset09:15:083
37839986,1cyclictest5499-21snmp_o5powerctl07:10:223
37839986,1cyclictest52902sleep311:10:143
37839986,1cyclictest464-21ntpq12:00:193
37839986,1cyclictest3531-21ntpq11:05:213
37839986,1cyclictest31958-21basename11:00:123
37839986,1cyclictest31196-21aten_r9power_vo08:00:113
37839986,1cyclictest309-21expr10:00:133
37839986,1cyclictest29224-21cut10:55:123
37839986,1cyclictest28671-21chrt10:51:533
37839986,1cyclictest26654-21expr11:50:153
37839986,1cyclictest2632-21cut10:05:133
37839986,1cyclictest26105-21hwlatdetect08:50:163
37839986,1cyclictest24828-21sed11:45:173
37839986,1cyclictest24417-21basename09:45:133
37839986,1cyclictest24057-21tr10:45:143
37839986,1cyclictest22758-21cat08:45:123
37839986,1cyclictest22259-21grep09:40:153
37839986,1cyclictest22176-21taskset08:40:433
37839986,1cyclictest2186-21cat12:05:143
37839986,1cyclictest206402sleep311:39:413
37839986,1cyclictest20045-21ls08:40:013
37839986,1cyclictest19098-21basename09:35:123
37839986,1cyclictest173062sleep307:31:363
37839986,1cyclictest15946-21cut10:30:143
37839986,1cyclictest15926-21cut08:30:163
37839986,1cyclictest15519-21basename11:30:133
37839986,1cyclictest14624-21cat09:30:123
37839986,1cyclictest13855-21cut10:25:143
37839986,1cyclictest13492-21basename11:25:153
37839986,1cyclictest12948-21grep12:25:153
37839986,1cyclictest12187-21head09:25:143
37839986,1cyclictest12187-21cat12:25:023
37839986,1cyclictest11559-21cut11:20:203
37839986,1cyclictest11135-21sed07:20:183
37839986,1cyclictest10649-21hostname10:20:123
37829986,1cyclictest6459-21head07:15:022
37829986,1cyclictest33-21ksoftirqd/208:10:132
37829986,1cyclictest26035-21expr07:50:112
37829986,1cyclictest15614-21cat11:30:132
11959180,0ptp4l0-21swapper/210:36:402
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional