You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 00:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot3s.osadl.org (updated Mon Sep 14, 2026 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
255512990,2sleep341-21ksoftirqd/307:05:133
119591670,46ptp4l0-21swapper/107:09:131
119591660,32ptp4l0-21swapper/007:07:520
119591620,31ptp4l0-21swapper/207:05:122
38482420,1sleep23852-21phc2sys11:25:192
266662420,0sleep20-21swapper/208:05:182
223902420,0sleep20-21swapper/211:00:172
27900992726,1cyclictest33-21ksoftirqd/208:55:012
119591170,2ptp4l21155-21snmp_o5powerctl09:55:221
119591170,1ptp4l19637-21apt-get08:55:100
119591170,0ptp4l0-21swapper/012:00:150
190942160,0sleep30-21swapper/310:55:143
119591160,2ptp4l13970-21snmp_o5powerctl07:40:220
119591160,2ptp4l0-21swapper/207:50:212
119591160,1ptp4l6023-21apt-get09:30:130
119591160,1ptp4l5047-21snmp_o5powerctl09:25:210
119591160,1ptp4l29516-21apt-get11:15:140
119591160,1ptp4l29166-21apt-get12:15:020
119591160,1ptp4l21567-21apt-get11:00:131
119591160,0ptp4l0-21swapper/009:53:380
119591160,0ptp4l0-21swapper/008:50:150
27900991515,0cyclictest33-21ksoftirqd/212:05:212
119591150,1ptp4l5867-21awk12:30:140
119591150,1ptp4l4287-21ls10:25:181
119591150,1ptp4l31234-21/usr/sbin/munin11:15:241
119591150,1ptp4l31155-21ntp_states07:15:010
119591150,1ptp4l2932-21latency_hist10:25:011
119591150,1ptp4l29283-21snmp_o5powerctl09:10:210
119591150,1ptp4l28425-21snmp_o5powerctl12:10:200
119591150,1ptp4l23825-21snmp_o5powerctl10:00:200
119591150,1ptp4l15622-21/usr/sbin/munin10:45:231
119591150,1ptp4l14903-21snmp_o5powerctl11:45:211
119591150,1ptp4l14886-21fschecks_count08:45:130
119591150,1ptp4l13363-21sed07:40:171
119591150,1ptp4l13079-21ntp_states08:40:171
119591150,1ptp4l12930-21ntp_states09:40:180
119591150,0ptp4l0-21swapper/112:25:141
119591150,0ptp4l0-21swapper/112:15:131
119591150,0ptp4l0-21swapper/110:50:121
119591150,0ptp4l0-21swapper/110:33:371
119591150,0ptp4l0-21swapper/109:29:331
119591150,0ptp4l0-21swapper/109:15:161
119591150,0ptp4l0-21swapper/108:25:121
119591150,0ptp4l0-21swapper/107:55:121
119591150,0ptp4l0-21swapper/011:00:130
119591150,0ptp4l0-21swapper/010:50:110
119591150,0ptp4l0-21swapper/010:35:150
119591150,0ptp4l0-21swapper/010:30:170
119591150,0ptp4l0-21swapper/009:45:110
119591150,0ptp4l0-21swapper/009:20:190
119591150,0ptp4l0-21swapper/007:55:120
27900991413,0cyclictest33-21ksoftirqd/207:20:012
119591140,1ptp4l8350-21tr07:30:171
119591140,1ptp4l426-21latency_hist09:20:000
119591140,1ptp4l32721-21ls07:15:181
119591140,1ptp4l30483-21latency_hist07:15:001
119591140,1ptp4l30157-21aten2.4-expect10:15:120
119591140,1ptp4l29869-21/usr/sbin/munin08:10:211
119591140,1ptp4l28393-21sed10:10:151
119591140,1ptp4l28335-21cstates07:10:130
119591140,1ptp4l2686-21appstreamcli12:25:020
119591140,1ptp4l26024-21missed_timers10:05:181
119591140,1ptp4l26024-21missed_timers10:05:181
119591140,1ptp4l23982-21snmp_o5powerctl09:00:221
119591140,1ptp4l21672-21diskstats12:00:141
119591140,1ptp4l2009-21sed08:20:170
119591140,1ptp4l20008-21irqstats10:55:180
119591140,1ptp4l19856-21cstates09:55:150
119591140,1ptp4l1949-21tr07:20:130
119591140,1ptp4l19370-21df_inode10:55:141
119591140,1ptp4l18822-21cstates11:55:141
119591140,1ptp4l18053-21memory09:50:161
119591140,1ptp4l16048-21irqstats07:45:160
119591140,1ptp4l12698-21sed10:40:221
119591140,1ptp4l10482-21aten_r9power_vo11:40:150
119591140,0ptp4l0-21swapper/111:35:201
119591140,0ptp4l0-21swapper/111:32:091
119591140,0ptp4l0-21swapper/111:25:171
119591140,0ptp4l0-21swapper/111:20:241
119591140,0ptp4l0-21swapper/109:40:011
119591140,0ptp4l0-21swapper/109:35:221
119591140,0ptp4l0-21swapper/109:30:141
119591140,0ptp4l0-21swapper/109:20:151
119591140,0ptp4l0-21swapper/109:14:361
119591140,0ptp4l0-21swapper/109:05:221
119591140,0ptp4l0-21swapper/108:55:121
119591140,0ptp4l0-21swapper/108:35:151
119591140,0ptp4l0-21swapper/108:30:221
119591140,0ptp4l0-21swapper/108:00:181
119591140,0ptp4l0-21swapper/107:35:241
119591140,0ptp4l0-21swapper/107:21:581
119591140,0ptp4l0-21swapper/012:24:270
119591140,0ptp4l0-21swapper/011:10:220
119591140,0ptp4l0-21swapper/010:25:230
119591140,0ptp4l0-21swapper/010:10:170
119591140,0ptp4l0-21swapper/009:35:140
119591140,0ptp4l0-21swapper/008:35:230
119591140,0ptp4l0-21swapper/008:30:220
119591140,0ptp4l0-21swapper/008:25:150
119591140,0ptp4l0-21swapper/008:10:160
119591140,0ptp4l0-21swapper/007:30:200
27900991311,0cyclictest33-21ksoftirqd/211:15:232
119591130,0ptp4l0-21swapper/212:15:142
119591130,0ptp4l0-21swapper/211:40:162
119591130,0ptp4l0-21swapper/211:20:212
119591130,0ptp4l0-21swapper/210:40:142
119591130,0ptp4l0-21swapper/210:25:162
119591130,0ptp4l0-21swapper/209:50:142
119591130,0ptp4l0-21swapper/209:25:162
119591130,0ptp4l0-21swapper/209:00:152
119591130,0ptp4l0-21swapper/208:55:212
119591130,0ptp4l0-21swapper/208:45:142
119591130,0ptp4l0-21swapper/208:40:142
119591130,0ptp4l0-21swapper/208:20:202
119591130,0ptp4l0-21swapper/208:15:222
119591130,0ptp4l0-21swapper/207:55:212
119591130,0ptp4l0-21swapper/207:46:102
119591130,0ptp4l0-21swapper/207:40:142
119591130,0ptp4l0-21swapper/207:35:212
119591130,0ptp4l0-21swapper/207:25:182
119591130,0ptp4l0-21swapper/112:35:131
119591130,0ptp4l0-21swapper/112:30:011
119591130,0ptp4l0-21swapper/112:20:151
119591130,0ptp4l0-21swapper/112:10:211
119591130,0ptp4l0-21swapper/112:05:151
119591130,0ptp4l0-21swapper/111:50:131
119591130,0ptp4l0-21swapper/111:40:131
119591130,0ptp4l0-21swapper/111:10:141
119591130,0ptp4l0-21swapper/111:05:141
119591130,0ptp4l0-21swapper/110:35:181
119591130,0ptp4l0-21swapper/110:15:131
119591130,0ptp4l0-21swapper/110:00:151
119591130,0ptp4l0-21swapper/109:45:161
119591130,0ptp4l0-21swapper/108:50:121
119591130,0ptp4l0-21swapper/108:45:131
119591130,0ptp4l0-21swapper/108:20:131
119591130,0ptp4l0-21swapper/108:15:141
119591130,0ptp4l0-21swapper/108:05:011
119591130,0ptp4l0-21swapper/107:50:191
119591130,0ptp4l0-21swapper/107:45:141
119591130,0ptp4l0-21swapper/107:25:141
119591130,0ptp4l0-21swapper/012:35:140
119591130,0ptp4l0-21swapper/011:55:150
119591130,0ptp4l0-21swapper/011:50:120
119591130,0ptp4l0-21swapper/011:45:020
119591130,0ptp4l0-21swapper/011:35:220
119591130,0ptp4l0-21swapper/011:30:130
119591130,0ptp4l0-21swapper/011:25:030
119591130,0ptp4l0-21swapper/011:20:140
119591130,0ptp4l0-21swapper/011:05:120
119591130,0ptp4l0-21swapper/010:45:120
119591130,0ptp4l0-21swapper/010:40:120
119591130,0ptp4l0-21swapper/010:20:120
119591130,0ptp4l0-21swapper/010:05:170
119591130,0ptp4l0-21swapper/010:05:170
119591130,0ptp4l0-21swapper/009:05:140
119591130,0ptp4l0-21swapper/009:00:130
119591130,0ptp4l0-21swapper/008:40:110
119591130,0ptp4l0-21swapper/008:15:140
119591130,0ptp4l0-21swapper/008:05:150
119591130,0ptp4l0-21swapper/008:00:120
119591130,0ptp4l0-21swapper/007:50:150
119591130,0ptp4l0-21swapper/007:35:150
119591130,0ptp4l0-21swapper/007:25:150
27900991212,0cyclictest33-21ksoftirqd/210:30:192
2790099121,0cyclictest121rcu_preempt10:00:212
119591120,2ptp4l41-21ksoftirqd/309:15:453
119591120,1ptp4l41-21ksoftirqd/310:53:373
119591120,0ptp4l0-21swapper/212:30:192
119591120,0ptp4l0-21swapper/209:40:172
119591120,0ptp4l0-21swapper/208:10:242
119591120,0ptp4l0-21swapper/012:05:120
119591110,0ptp4l0-21swapper/207:22:172
119591100,0ptp4l0-21swapper/210:15:152
119591100,0ptp4l0-21swapper/207:34:382
279159997,1cyclictest76142sleep312:33:053
279159997,1cyclictest5738-21taskset09:29:403
279159997,1cyclictest4359-21ntpq10:25:183
279159997,1cyclictest29759-21grep11:15:153
279159997,1cyclictest21800-21taskset09:59:033
279159997,1cyclictest21242sleep312:23:163
279159997,1cyclictest206562sleep311:56:383
279159997,1cyclictest19050-21chrt08:50:433
279159997,1cyclictest189262sleep309:51:083
279159997,1cyclictest13454-21cut11:45:123
279159997,1cyclictest107972sleep309:36:383
279159997,1cyclictest1038-21cat11:20:183
279159990,8cyclictest31608-21head12:15:243
279009997,1cyclictest8669-21dpkg09:35:132
279009997,1cyclictest19574-21head10:55:152
279009991,3cyclictest0-21swapper/210:45:122
279009990,8cyclictest14295-21cut11:45:172
11959190,0ptp4l41-21ksoftirqd/308:09:543
11959190,0ptp4l0-21swapper/308:42:303
11959190,0ptp4l0-21swapper/212:35:032
11959190,0ptp4l0-21swapper/212:27:452
11959190,0ptp4l0-21swapper/212:20:512
11959190,0ptp4l0-21swapper/212:11:052
11959190,0ptp4l0-21swapper/212:02:242
11959190,0ptp4l0-21swapper/211:58:062
11959190,0ptp4l0-21swapper/211:53:172
11959190,0ptp4l0-21swapper/211:37:052
11959190,0ptp4l0-21swapper/211:30:282
11959190,0ptp4l0-21swapper/211:10:492
11959190,0ptp4l0-21swapper/211:05:392
11959190,0ptp4l0-21swapper/210:50:312
11959190,0ptp4l0-21swapper/210:35:432
11959190,0ptp4l0-21swapper/210:20:052
11959190,0ptp4l0-21swapper/210:11:192
11959190,0ptp4l0-21swapper/210:07:132
11959190,0ptp4l0-21swapper/210:07:132
11959190,0ptp4l0-21swapper/209:46:312
11959190,0ptp4l0-21swapper/209:30:042
11959190,0ptp4l0-21swapper/209:21:592
11959190,0ptp4l0-21swapper/209:15:092
11959190,0ptp4l0-21swapper/209:10:112
11959190,0ptp4l0-21swapper/209:09:412
11959190,0ptp4l0-21swapper/208:35:062
11959190,0ptp4l0-21swapper/208:30:432
11959190,0ptp4l0-21swapper/208:26:572
11959190,0ptp4l0-21swapper/208:03:262
11959190,0ptp4l0-21swapper/207:12:022
279159986,1cyclictest9656-21ntpq10:35:213
279159986,1cyclictest9001-21taskset08:35:073
279159986,1cyclictest8298-21cut12:35:133
279159986,1cyclictest7684-21hostname07:30:143
279159986,1cyclictest7336-21cut09:30:183
279159986,1cyclictest715-21cut09:20:133
279159986,1cyclictest6521-21grep08:30:133
279159986,1cyclictest5886-21taskset08:26:473
279159986,1cyclictest56522sleep310:30:113
279159986,1cyclictest5390-21expr11:30:133
279159986,1cyclictest4303-21chrt07:25:073
279159986,1cyclictest31213-21expr08:15:153
279159986,1cyclictest3048-21tail11:25:153
279159986,1cyclictest30383-21expr10:15:123
279159986,1cyclictest297442sleep309:11:403
279159986,1cyclictest29683-21cut08:10:203
279159986,1cyclictest290022sleep311:11:433
279159986,1cyclictest2875-21cat07:20:173
279159986,1cyclictest28632-21fw_packets07:10:143
279159986,1cyclictest28112-21cut10:10:143
279159986,1cyclictest26708-21taskset12:10:043
279159986,1cyclictest2654-21cat12:25:023
279159986,1cyclictest25128-21expr10:05:143
279159986,1cyclictest25128-21expr10:05:143
279159986,1cyclictest25120-21cat12:05:173
279159986,1cyclictest25089-21chrt08:02:263
279159986,1cyclictest24980-21hostname09:05:133
279159986,1cyclictest24195-21acpi11:05:113
279159986,1cyclictest23606-21seq11:00:303
279159986,1cyclictest22640-21cat09:00:143
279159986,1cyclictest22465-21cat10:00:123
279159986,1cyclictest21318-21telnet12:00:133
279159986,1cyclictest19640-21aten_r9power_cu08:55:113
279159986,1cyclictest1845-21sed10:20:193
279159986,1cyclictest18009-21cat07:50:153
279159986,1cyclictest179952sleep311:51:303
279159986,1cyclictest162992sleep309:46:233
279159986,1cyclictest15278-21expr07:45:133
279159986,1cyclictest14918-21sort08:45:143
279159986,1cyclictest14224-21sed07:40:243
279159986,1cyclictest13806-21cat10:45:123
279159986,1cyclictest13588-21taskset09:40:323
279159986,1cyclictest124212sleep311:40:373
279159986,1cyclictest11052sleep307:16:113
279159986,1cyclictest10636-21tr07:35:183
279159986,1cyclictest10562sleep308:20:093
279159986,1cyclictest100582sleep311:39:333
279009986,1cyclictest20205-21basename09:55:162
10978286,1sleep311174-21cut10:40:133
279159964,1cyclictest20310-21aten_r9power_po07:55:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional