You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 15:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot3s.osadl.org (updated Mon Mar 23, 2026 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591650,44ptp4l0-21swapper/007:08:450
119591570,40ptp4l0-21swapper/107:08:471
3066325144,2sleep20-21swapper/207:09:552
3038725042,6sleep30-21swapper/307:06:233
119591480,35ptp4l0-21swapper/007:10:020
279792460,0sleep10-21swapper/111:05:121
171892450,0sleep317155-21perf10:45:013
30935992120,0cyclictest33-21ksoftirqd/210:30:122
119591210,1ptp4l18475-21basename09:45:160
119591210,0ptp4l0-21swapper/012:35:160
110292190,0sleep20-21swapper/209:30:172
119591180,0ptp4l0-21swapper/007:45:220
119591170,4ptp4l22244-21cat11:55:021
119591170,0ptp4l0-21swapper/111:45:161
119591170,0ptp4l0-21swapper/109:40:221
119591170,0ptp4l0-21swapper/007:15:240
30935991616,0cyclictest33-21ksoftirqd/210:55:242
119591160,1ptp4l30647-21apt-get11:10:121
119591160,1ptp4l27028-21snmp_o5powerctl11:00:210
119591160,0ptp4l0-21swapper/112:30:011
119591160,0ptp4l0-21swapper/107:35:181
30934991515,0cyclictest25-21ksoftirqd/108:50:181
119591150,2ptp4l2182-21snmp_o5powerctl12:15:230
119591150,2ptp4l0-21swapper/007:52:030
119591150,1ptp4l972-21snmpd08:52:380
119591150,1ptp4l7110-21ls12:25:181
119591150,1ptp4l5799-21ls09:20:180
119591150,1ptp4l5475-21sed11:20:240
119591150,1ptp4l494-21ntp_states08:10:180
119591150,1ptp4l32609-21ls09:10:171
119591150,1ptp4l32330-21snmp_o5powerctl11:10:210
119591150,1ptp4l27769-21snmp_o5powerctl09:00:220
119591150,1ptp4l20946-21tune2fs09:50:140
119591150,1ptp4l18597-21ls10:45:161
119591150,1ptp4l16787-21snmp_o5powerctl09:40:200
119591150,1ptp4l16422-21snmp_o5powerctl10:40:222
119591150,1ptp4l15832-21snmp_o5powerctl11:40:220
119591150,1ptp4l14812-21apt-get08:40:011
119591150,1ptp4l11480-21snmp_o5powerctl09:30:211
119591150,1ptp4l11475-21snmp_o5powerctl09:30:210
119591150,1ptp4l10144-21snmp_o5powerctl12:30:220
119591150,0ptp4l9757-21apt-get08:30:110
119591150,0ptp4l0-21swapper/112:35:131
119591150,0ptp4l0-21swapper/111:00:121
119591150,0ptp4l0-21swapper/110:40:031
119591150,0ptp4l0-21swapper/109:55:121
119591150,0ptp4l0-21swapper/109:20:111
119591150,0ptp4l0-21swapper/108:55:121
119591150,0ptp4l0-21swapper/012:25:230
119591150,0ptp4l0-21swapper/010:30:110
119591150,0ptp4l0-21swapper/010:20:130
119591150,0ptp4l0-21swapper/009:39:450
119591150,0ptp4l0-21swapper/009:15:140
119591150,0ptp4l0-21swapper/009:05:130
119591140,1ptp4l7749-21df_inode07:25:151
119591140,1ptp4l7709-21grep11:25:211
119591140,1ptp4l4252-21smartctl11:20:151
119591140,1ptp4l4076-21ps12:20:160
119591140,1ptp4l30272-21aten_r9power_cu12:10:121
119591140,1ptp4l29338-21netstat11:05:200
119591140,1ptp4l28345-21/usr/sbin/munin10:05:190
119591140,1ptp4l28312-21smartctl12:05:140
119591140,1ptp4l27577-21cat12:05:020
119591140,1ptp4l2605-21/usr/sbin/munin08:15:150
119591140,1ptp4l23778-21cpuspeed_turbos07:55:140
119591140,1ptp4l23469-21if_enp3s010:55:161
119591140,1ptp4l20368-21expr10:50:140
119591140,1ptp4l19063-21snmp_o5powerctl10:45:200
119591140,1ptp4l15751-21df_inode08:40:130
119591140,1ptp4l14282-21aten2.4-expect11:40:141
119591140,1ptp4l12055-21/usr/sbin/munin10:35:270
119591140,1ptp4l11468-21/usr/sbin/munin11:35:140
119591140,0ptp4l30041-21snmp_o5powerctl10:05:251
119591140,0ptp4l28905-21ls12:05:161
119591140,0ptp4l24215-21ps10:55:220
119591140,0ptp4l22021-21ls07:50:181
119591140,0ptp4l19652-21ls09:45:221
119591140,0ptp4l0-21swapper/209:35:222
119591140,0ptp4l0-21swapper/208:35:232
119591140,0ptp4l0-21swapper/207:35:142
119591140,0ptp4l0-21swapper/112:20:161
119591140,0ptp4l0-21swapper/111:50:251
119591140,0ptp4l0-21swapper/111:35:151
119591140,0ptp4l0-21swapper/111:30:261
119591140,0ptp4l0-21swapper/111:15:181
119591140,0ptp4l0-21swapper/110:50:221
119591140,0ptp4l0-21swapper/110:35:241
119591140,0ptp4l0-21swapper/110:20:171
119591140,0ptp4l0-21swapper/110:10:031
119591140,0ptp4l0-21swapper/110:10:021
119591140,0ptp4l0-21swapper/109:25:191
119591140,0ptp4l0-21swapper/109:15:021
119591140,0ptp4l0-21swapper/109:00:021
119591140,0ptp4l0-21swapper/108:45:161
119591140,0ptp4l0-21swapper/108:20:261
119591140,0ptp4l0-21swapper/108:15:221
119591140,0ptp4l0-21swapper/108:10:101
119591140,0ptp4l0-21swapper/107:45:221
119591140,0ptp4l0-21swapper/107:30:221
119591140,0ptp4l0-21swapper/011:50:200
119591140,0ptp4l0-21swapper/010:12:160
119591140,0ptp4l0-21swapper/010:12:160
119591140,0ptp4l0-21swapper/009:55:200
119591140,0ptp4l0-21swapper/009:25:130
119591140,0ptp4l0-21swapper/009:10:110
3093599130,12cyclictest18497-21kworker/2:012:10:262
119591130,0ptp4l13048-21diskstats07:35:150
119591130,0ptp4l0-21swapper/212:20:202
119591130,0ptp4l0-21swapper/211:50:222
119591130,0ptp4l0-21swapper/211:45:202
119591130,0ptp4l0-21swapper/211:35:162
119591130,0ptp4l0-21swapper/211:30:172
119591130,0ptp4l0-21swapper/211:00:222
119591130,0ptp4l0-21swapper/209:55:152
119591130,0ptp4l0-21swapper/209:45:162
119591130,0ptp4l0-21swapper/209:10:182
119591130,0ptp4l0-21swapper/208:20:192
119591130,0ptp4l0-21swapper/208:10:132
119591130,0ptp4l0-21swapper/208:00:142
119591130,0ptp4l0-21swapper/207:50:162
119591130,0ptp4l0-21swapper/207:45:132
119591130,0ptp4l0-21swapper/207:40:212
119591130,0ptp4l0-21swapper/207:30:242
119591130,0ptp4l0-21swapper/207:15:182
119591130,0ptp4l0-21swapper/207:10:192
119591130,0ptp4l0-21swapper/112:15:141
119591130,0ptp4l0-21swapper/112:00:151
119591130,0ptp4l0-21swapper/110:30:131
119591130,0ptp4l0-21swapper/110:25:151
119591130,0ptp4l0-21swapper/110:15:131
119591130,0ptp4l0-21swapper/110:00:151
119591130,0ptp4l0-21swapper/109:50:161
119591130,0ptp4l0-21swapper/109:35:131
119591130,0ptp4l0-21swapper/109:05:131
119591130,0ptp4l0-21swapper/108:35:161
119591130,0ptp4l0-21swapper/108:30:131
119591130,0ptp4l0-21swapper/108:25:111
119591130,0ptp4l0-21swapper/108:05:151
119591130,0ptp4l0-21swapper/108:00:161
119591130,0ptp4l0-21swapper/107:55:011
119591130,0ptp4l0-21swapper/107:40:131
119591130,0ptp4l0-21swapper/107:20:121
119591130,0ptp4l0-21swapper/107:15:131
119591130,0ptp4l0-21swapper/107:10:131
119591130,0ptp4l0-21swapper/012:10:170
119591130,0ptp4l0-21swapper/011:55:010
119591130,0ptp4l0-21swapper/011:45:170
119591130,0ptp4l0-21swapper/011:30:140
119591130,0ptp4l0-21swapper/011:25:130
119591130,0ptp4l0-21swapper/011:15:110
119591130,0ptp4l0-21swapper/010:40:150
119591130,0ptp4l0-21swapper/010:25:160
119591130,0ptp4l0-21swapper/010:15:140
119591130,0ptp4l0-21swapper/010:00:150
119591130,0ptp4l0-21swapper/008:55:160
119591130,0ptp4l0-21swapper/008:45:130
119591130,0ptp4l0-21swapper/008:35:130
119591130,0ptp4l0-21swapper/008:25:130
119591130,0ptp4l0-21swapper/008:20:180
119591130,0ptp4l0-21swapper/008:05:150
119591130,0ptp4l0-21swapper/008:00:120
119591130,0ptp4l0-21swapper/007:40:140
119591130,0ptp4l0-21swapper/007:30:140
119591130,0ptp4l0-21swapper/007:25:140
119591130,0ptp4l0-21swapper/007:20:120
30936991211,1cyclictest41-21ksoftirqd/310:55:243
3093699120,4cyclictest0-21swapper/309:20:123
119591120,0ptp4l0-21swapper/212:05:112
119591120,0ptp4l0-21swapper/210:00:172
119591120,0ptp4l0-21swapper/207:25:002
3093599110,4cyclictest0-21swapper/209:40:112
119591110,0ptp4l0-21swapper/212:30:142
3093699108,1cyclictest14810-21grep08:40:013
3093599106,2cyclictest33-21ksoftirqd/210:50:172
119591100,0ptp4l0-21swapper/211:55:262
119591100,0ptp4l0-21swapper/207:21:282
309369997,1cyclictest9085-21taskset10:28:473
309369997,1cyclictest5150-21cut10:20:173
309369997,1cyclictest304982sleep310:06:373
309369997,1cyclictest29391-21head09:05:163
309369997,1cyclictest25415-21taskset09:59:343
309369997,1cyclictest14496-21chrt09:35:303
309369997,1cyclictest14012-21ls11:40:013
309369997,1cyclictest11967-21chrt09:32:033
309359999,0cyclictest33-21ksoftirqd/209:15:022
309359997,1cyclictest6256-21hostname11:25:132
309359997,1cyclictest5993-21cat10:20:232
309359997,1cyclictest3963-21seq08:17:062
309359997,1cyclictest33-21ksoftirqd/212:35:142
309359997,1cyclictest13202-21uname10:35:192
309359994,2cyclictest33-21ksoftirqd/209:00:012
309359990,8cyclictest9297-21seq09:26:432
11959190,1ptp4l33-21ksoftirqd/211:19:192
11959190,1ptp4l0-21swapper/212:01:532
11959190,0ptp4l0-21swapper/212:27:032
11959190,0ptp4l0-21swapper/212:15:262
11959190,0ptp4l0-21swapper/211:40:282
11959190,0ptp4l0-21swapper/211:21:372
11959190,0ptp4l0-21swapper/211:11:542
11959190,0ptp4l0-21swapper/211:06:532
11959190,0ptp4l0-21swapper/210:16:162
11959190,0ptp4l0-21swapper/210:10:092
11959190,0ptp4l0-21swapper/210:10:082
11959190,0ptp4l0-21swapper/210:05:392
11959190,0ptp4l0-21swapper/209:08:032
11959190,0ptp4l0-21swapper/208:58:262
11959190,0ptp4l0-21swapper/208:54:452
11959190,0ptp4l0-21swapper/208:30:272
11959190,0ptp4l0-21swapper/208:26:182
11959190,0ptp4l0-21swapper/207:56:182
309369987,1cyclictest20911-21grep09:50:143
309369986,1cyclictest9786-21telnet08:30:113
309369986,1cyclictest92812sleep309:26:303
309369986,1cyclictest9159-21sed07:25:253
309369986,1cyclictest794-21expr12:15:153
309369986,1cyclictest7902-21expr11:25:223
309369986,1cyclictest7855-21cat08:25:163
309369986,1cyclictest6637-21if_err_enp0s31f12:25:153
309369986,1cyclictest5242-21expr07:20:133
309369986,1cyclictest5066-21grep08:20:153
309369986,1cyclictest3941-21cat10:20:013
309369986,1cyclictest3649-21aten2.4-expect11:20:133
309369986,1cyclictest3522-21snmp_o5powerctl09:15:243
309369986,1cyclictest3420-21tr12:20:113
309369986,1cyclictest32331-21tr09:10:163
309369986,1cyclictest32048-21mii-tool10:10:173
309369986,1cyclictest32048-21mii-tool10:10:173
309369986,1cyclictest31164-21sort07:10:133
309369986,1cyclictest30833-21grep12:10:133
309369986,1cyclictest30784-21wc11:10:143
309369986,1cyclictest29236-21expr08:05:153
309369986,1cyclictest28252-21tr11:05:153
309369986,1cyclictest28231-21tail08:00:263
309369986,1cyclictest27869-21tr12:05:123
309369986,1cyclictest27442-21chrt11:01:063
309369986,1cyclictest27163-21phc2sys-jitter10:00:213
309369986,1cyclictest27100-21seq12:01:333
309369986,1cyclictest26800-21sed09:00:163
309369986,1cyclictest2650-21cat08:15:153
309369986,1cyclictest23424-21tr08:55:143
309369986,1cyclictest22329-21cut11:55:113
309369986,1cyclictest21174-21tail08:50:163
309369986,1cyclictest20951-21tr07:50:133
309369986,1cyclictest20875-21cat10:50:163
309369986,1cyclictest20605-21wc11:50:203
309369986,1cyclictest18665-21uniq07:45:163
309369986,1cyclictest17988-21stty08:45:123
309369986,1cyclictest17867-21basename09:45:143
309369986,1cyclictest17504-21hostname10:45:113
309369986,1cyclictest17464-21sed11:45:163
309369986,1cyclictest16118-21cat08:40:163
309369986,1cyclictest16063-21tail07:40:153
309369986,1cyclictest15490-21expr09:40:143
309369986,1cyclictest1526-21cat07:15:023
309369986,1cyclictest15115-21tr11:40:173
309369986,1cyclictest1503-21expr11:15:143
309369986,1cyclictest14556-21head07:35:253
309369986,1cyclictest12737-21grep12:35:213
309369986,1cyclictest1233-21chrt08:11:043
309369986,1cyclictest12151-21basename10:35:163
309369986,1cyclictest11091-21cut10:30:193
309369986,1cyclictest10541-21tail07:30:163
309369985,2cyclictest25274-21snmp_o5powerctl07:55:233
309359987,0cyclictest33-21ksoftirqd/208:45:212
309359986,1cyclictest6879-21cut10:25:142
309359986,1cyclictest4711-21grep09:20:142
309359986,1cyclictest29675-21cat08:05:172
309359986,1cyclictest20494-21cut09:50:142
309359986,1cyclictest17355-21taskset10:45:062
309359986,1cyclictest15301-21basename08:40:132
309369976,0cyclictest9552-21sed11:30:153
309369975,1cyclictest8597-21telnet12:30:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional