You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 02:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot3s.osadl.org (updated Sat Mar 21, 2026 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2517526156,3sleep30-21swapper/307:08:563
119591610,31ptp4l0-21swapper/107:06:551
119591590,41ptp4l0-21swapper/007:08:260
2509525442,2sleep20-21swapper/207:07:552
79262450,0sleep20-21swapper/207:35:132
119591310,0ptp4l0-21swapper/009:45:230
119591290,0ptp4l0-21swapper/009:10:240
25521992521,2cyclictest25-21ksoftirqd/109:55:011
25522992114,2cyclictest33-21ksoftirqd/208:15:122
25521992018,1cyclictest25-21ksoftirqd/107:25:201
2552199200,1cyclictest121rcu_preempt10:15:231
119591200,1ptp4l0-21swapper/010:55:150
119591190,1ptp4l21675-21grep11:00:221
119591190,0ptp4l0-21swapper/109:40:121
119591190,0ptp4l0-21swapper/108:55:201
25522991818,0cyclictest33-21ksoftirqd/210:35:122
2552199180,0cyclictest121rcu_preempt08:35:191
119591180,0ptp4l0-21swapper/008:25:250
119591170,0ptp4l0-21swapper/111:55:231
119591170,0ptp4l0-21swapper/110:25:161
119591170,0ptp4l0-21swapper/108:31:541
119591170,0ptp4l0-21swapper/012:35:120
119591160,2ptp4l21766-21snmp_o5powerctl10:00:220
119591160,1ptp4l822-21apt-get11:25:120
119591160,1ptp4l6620-21apt-get09:35:120
119591160,1ptp4l6131-21apt-get11:35:121
119591160,1ptp4l25566-21apt-get07:10:130
119591160,1ptp4l25352-21apt-get09:10:111
119591160,1ptp4l1925-21snmp_o5powerctl12:25:230
119591160,1ptp4l14575-21apt-get09:50:111
119591160,1ptp4l1330-21apt-get09:25:140
119591160,1ptp4l13216-21ls09:45:191
119591160,0ptp4l0-21swapper/011:45:170
119591160,0ptp4l0-21swapper/007:55:020
119591150,1ptp4l9772-21grep10:40:140
119591150,1ptp4l8174-21snmp_o5powerctl10:35:201
119591150,1ptp4l5798-21ls09:30:230
119591150,1ptp4l4725-21apt-get07:30:140
119591150,1ptp4l381-21ls07:20:171
119591150,1ptp4l3164-21snmp_o5powerctl08:25:221
119591150,1ptp4l30243-21ls07:15:190
119591150,1ptp4l29217-21memory09:15:160
119591150,1ptp4l29016-21snmp_o5powerctl12:15:200
119591150,1ptp4l28565-21memory12:15:161
119591150,1ptp4l28310-21apt-get10:15:130
119591150,1ptp4l15429-21smartctl08:50:150
119591150,1ptp4l14459-21apt-get10:50:130
119591150,0ptp4l0-21swapper/112:00:111
119591150,0ptp4l0-21swapper/110:10:551
119591150,0ptp4l0-21swapper/109:35:131
119591150,0ptp4l0-21swapper/109:20:171
119591150,0ptp4l0-21swapper/107:30:231
119591150,0ptp4l0-21swapper/012:10:130
119591150,0ptp4l0-21swapper/008:31:550
119591150,0ptp4l0-21swapper/007:25:130
25522991413,0cyclictest33-21ksoftirqd/209:55:022
119591140,1ptp4l9919-21/usr/sbin/munin08:40:150
119591140,1ptp4l7955-21grep07:35:131
119591140,1ptp4l7837-21df_inode07:35:110
119591140,1ptp4l30978-21users07:15:241
119591140,1ptp4l30602-21users08:15:230
119591140,1ptp4l30575-21/usr/sbin/munin11:20:230
119591140,1ptp4l29992-21/usr/sbin/munin12:20:220
119591140,1ptp4l28929-21tr09:15:151
119591140,1ptp4l28827-21irqrtprio11:15:161
119591140,1ptp4l25026-21switchtime08:05:220
119591140,1ptp4l23594-21grep09:05:171
119591140,1ptp4l23150-21cstates10:05:131
119591140,1ptp4l19572-21cpu12:00:130
119591140,1ptp4l19227-21cat07:55:191
119591140,1ptp4l18743-21systemctl10:55:231
119591140,1ptp4l17353-21/usr/sbin/munin08:55:190
119591140,1ptp4l1440-21/usr/sbin/munin09:25:141
119591140,1ptp4l13173-21/usr/sbin/munin07:45:150
119591140,1ptp4l13150-21memory09:45:182
119591140,1ptp4l10766-21/usr/sbin/munin09:40:190
119591140,1ptp4l10285-21irqrtprio09:40:162
119591140,0ptp4l4767-21ls11:30:161
119591140,0ptp4l22630-21apt-get11:05:110
119591140,0ptp4l17148-21ls07:50:251
119591140,0ptp4l0-21swapper/211:30:192
119591140,0ptp4l0-21swapper/112:35:211
119591140,0ptp4l0-21swapper/112:20:171
119591140,0ptp4l0-21swapper/112:10:161
119591140,0ptp4l0-21swapper/111:50:131
119591140,0ptp4l0-21swapper/111:45:201
119591140,0ptp4l0-21swapper/111:41:421
119591140,0ptp4l0-21swapper/110:50:221
119591140,0ptp4l0-21swapper/110:45:151
119591140,0ptp4l0-21swapper/110:40:121
119591140,0ptp4l0-21swapper/109:00:161
119591140,0ptp4l0-21swapper/108:40:241
119591140,0ptp4l0-21swapper/108:05:221
119591140,0ptp4l0-21swapper/108:00:221
119591140,0ptp4l0-21swapper/107:13:021
119591140,0ptp4l0-21swapper/012:05:200
119591140,0ptp4l0-21swapper/011:40:200
119591140,0ptp4l0-21swapper/011:35:220
119591140,0ptp4l0-21swapper/011:15:180
119591140,0ptp4l0-21swapper/010:10:200
119591140,0ptp4l0-21swapper/010:05:230
119591140,0ptp4l0-21swapper/009:55:010
119591140,0ptp4l0-21swapper/009:50:190
119591140,0ptp4l0-21swapper/009:00:160
119591140,0ptp4l0-21swapper/008:35:220
119591140,0ptp4l0-21swapper/008:20:220
119591140,0ptp4l0-21swapper/007:40:230
25522991312,0cyclictest33-21ksoftirqd/212:20:202
119591130,0ptp4l0-21swapper/212:30:172
119591130,0ptp4l0-21swapper/212:05:232
119591130,0ptp4l0-21swapper/212:00:202
119591130,0ptp4l0-21swapper/211:45:142
119591130,0ptp4l0-21swapper/210:40:152
119591130,0ptp4l0-21swapper/210:35:002
119591130,0ptp4l0-21swapper/210:10:152
119591130,0ptp4l0-21swapper/209:10:192
119591130,0ptp4l0-21swapper/208:55:142
119591130,0ptp4l0-21swapper/207:55:142
119591130,0ptp4l0-21swapper/207:15:152
119591130,0ptp4l0-21swapper/112:30:141
119591130,0ptp4l0-21swapper/112:25:131
119591130,0ptp4l0-21swapper/112:05:141
119591130,0ptp4l0-21swapper/111:25:131
119591130,0ptp4l0-21swapper/111:20:121
119591130,0ptp4l0-21swapper/111:10:131
119591130,0ptp4l0-21swapper/111:05:121
119591130,0ptp4l0-21swapper/110:30:131
119591130,0ptp4l0-21swapper/110:20:151
119591130,0ptp4l0-21swapper/110:00:151
119591130,0ptp4l0-21swapper/109:30:151
119591130,0ptp4l0-21swapper/108:50:131
119591130,0ptp4l0-21swapper/108:45:161
119591130,0ptp4l0-21swapper/108:20:131
119591130,0ptp4l0-21swapper/108:15:121
119591130,0ptp4l0-21swapper/108:10:141
119591130,0ptp4l0-21swapper/107:45:121
119591130,0ptp4l0-21swapper/107:40:131
119591130,0ptp4l0-21swapper/012:30:130
119591130,0ptp4l0-21swapper/011:55:150
119591130,0ptp4l0-21swapper/011:50:120
119591130,0ptp4l0-21swapper/011:30:160
119591130,0ptp4l0-21swapper/011:10:120
119591130,0ptp4l0-21swapper/011:00:120
119591130,0ptp4l0-21swapper/010:45:130
119591130,0ptp4l0-21swapper/010:35:210
119591130,0ptp4l0-21swapper/010:30:140
119591130,0ptp4l0-21swapper/010:25:130
119591130,0ptp4l0-21swapper/010:20:140
119591130,0ptp4l0-21swapper/009:20:120
119591130,0ptp4l0-21swapper/009:05:120
119591130,0ptp4l0-21swapper/008:45:180
119591130,0ptp4l0-21swapper/008:10:150
119591130,0ptp4l0-21swapper/008:00:180
119591130,0ptp4l0-21swapper/007:50:130
119591130,0ptp4l0-21swapper/007:20:110
25522991210,1cyclictest33-21ksoftirqd/207:25:192
119591120,0ptp4l0-21swapper/208:00:212
2552299113,1cyclictest33-21ksoftirqd/210:50:132
2552299100,0cyclictest130091phc2sys11:55:122
119591100,2ptp4l0-21swapper/209:38:102
119591100,0ptp4l0-21swapper/208:13:552
255239997,1cyclictest6734-21sed08:35:003
255239997,1cyclictest25356-21seq08:05:523
255239997,1cyclictest24107-21cut11:05:193
255239997,1cyclictest170672sleep310:55:063
255239992,2cyclictest0-21swapper/308:00:133
255239990,8cyclictest29528-21tr08:15:153
255239990,8cyclictest20024-21cut11:00:133
255239990,8cyclictest18366-21tr08:55:173
255229997,1cyclictest9060-21cut11:40:122
255229997,1cyclictest6900-21ntpq12:35:182
255229997,1cyclictest4139-21basename08:30:122
255229997,1cyclictest30228-21chrt09:17:532
255229997,1cyclictest25174-21cat11:10:022
255229997,1cyclictest21793-21cat10:00:232
255229997,1cyclictest16814-21sed07:50:222
255229990,8cyclictest28190-21expr11:15:132
255229990,3cyclictest30606-21runrttasks11:20:132
11959190,1ptp4l41-21ksoftirqd/310:13:263
11959190,0ptp4l41-21ksoftirqd/312:31:243
11959190,0ptp4l0-21swapper/212:29:162
11959190,0ptp4l0-21swapper/212:15:052
11959190,0ptp4l0-21swapper/212:13:512
11959190,0ptp4l0-21swapper/211:26:382
11959190,0ptp4l0-21swapper/211:00:342
11959190,0ptp4l0-21swapper/210:49:102
11959190,0ptp4l0-21swapper/210:19:322
11959190,0ptp4l0-21swapper/210:05:592
11959190,0ptp4l0-21swapper/209:51:032
11959190,0ptp4l0-21swapper/209:31:412
11959190,0ptp4l0-21swapper/209:27:192
11959190,0ptp4l0-21swapper/209:24:502
11959190,0ptp4l0-21swapper/209:10:002
11959190,0ptp4l0-21swapper/208:50:252
11959190,0ptp4l0-21swapper/208:45:072
11959190,0ptp4l0-21swapper/208:38:582
11959190,0ptp4l0-21swapper/207:46:552
11959190,0ptp4l0-21swapper/207:33:572
11959190,0ptp4l0-21swapper/207:21:272
255239986,1cyclictest9997-21seq07:40:073
255239986,1cyclictest9890-21basename10:40:153
255239986,1cyclictest9257-21acpi09:40:113
255239986,1cyclictest9139-21expr11:40:143
255239986,1cyclictest8855-21head07:35:173
255239986,1cyclictest8375-21cat10:35:223
255239986,1cyclictest8238-21pluginstate08:35:203
255239986,1cyclictest7043-21cat09:35:143
255239986,1cyclictest5919-21expr12:35:123
255239986,1cyclictest5671-21cat10:30:223
255239986,1cyclictest531-21cat12:25:143
255239986,1cyclictest5187-21load09:30:183
255239986,1cyclictest4988-21grep07:30:153
255239986,1cyclictest3726-21cut11:30:133
255239986,1cyclictest3261-21ls08:25:243
255239986,1cyclictest32489-21head10:20:213
255239986,1cyclictest32021-21cut09:20:173
255239986,1cyclictest31934-21grep08:20:153
255239986,1cyclictest31751-21head07:20:123
255239986,1cyclictest30991-21expr11:20:133
255239986,1cyclictest30562-21fschecks_time12:20:163
255239986,1cyclictest30044-21chrt11:16:253
255239986,1cyclictest28444-21expr09:15:123
255239986,1cyclictest28376-21aten_r9power_po10:15:143
255239986,1cyclictest28301-21uname07:15:023
255239986,1cyclictest27894-21grep12:15:143
255239986,1cyclictest27527-21taskset11:13:023
255239986,1cyclictest27425-21wc07:10:243
255239986,1cyclictest26735-21ntp_states09:10:203
255239986,1cyclictest25904-21chrt08:10:093
255239986,1cyclictest25368-21expr12:10:163
255239986,1cyclictest24324-21chrt12:08:323
255239986,1cyclictest23088-21expr10:05:143
255239986,1cyclictest22948-21grep09:05:133
255239986,1cyclictest2258-21tr10:25:183
255239986,1cyclictest20072-21acpi10:00:133
255239986,1cyclictest19816-21expr12:00:143
255239986,1cyclictest19635-21snmp_o5powerctl07:55:223
255239986,1cyclictest1961-21cut11:25:173
255239986,1cyclictest19516-21taskset09:56:043
255239986,1cyclictest1940-21cat07:25:013
255239986,1cyclictest17090-21expr11:55:143
255239986,1cyclictest17019-21cat07:50:243
255239986,1cyclictest15172-21cat08:50:143
255239986,1cyclictest1517-21grep09:25:153
255239986,1cyclictest15063-21tail10:50:163
255239986,1cyclictest14700-21stty09:50:133
255239986,1cyclictest14308-21tr11:50:133
255239986,1cyclictest14007-21chrt10:47:303
255239986,1cyclictest13577-21tr09:45:213
255239986,1cyclictest13366-21hddtemp_smartct07:45:163
255239986,1cyclictest12775-21head08:45:163
255239986,1cyclictest11772-21chrt08:44:123
255239986,1cyclictest11548-21taskset11:45:133
255229986,1cyclictest6312-21wc11:35:142
255229986,1cyclictest31339-21cut08:20:122
255229986,1cyclictest2840-21cut10:25:232
255229986,1cyclictest2794-21tail08:25:192
255229986,1cyclictest27275-21head11:10:232
255229986,1cyclictest27240-21chrt07:10:222
255229986,1cyclictest23409-21stty08:05:142
255229986,1cyclictest20009-21chrt09:00:042
255229986,1cyclictest18747-21tr10:55:232
255229986,1cyclictest14313-21tr11:50:142
255229986,1cyclictest115902sleep208:41:492
255229986,1cyclictest10392-21cat07:40:132
11959180,0ptp4l0-21swapper/210:20:042
255239975,1cyclictest8110-21grep11:35:243
255239975,1cyclictest20342-21cstates09:00:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional