You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 00:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot3s.osadl.org (updated Fri Jun 19, 2026 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591650,38ptp4l0-21swapper/207:09:282
119591590,31ptp4l0-21swapper/007:05:120
119591580,41ptp4l0-21swapper/107:06:501
1009825043,2sleep30-21swapper/307:06:533
73432460,1sleep37347-21unixbench_singl09:00:263
153692430,0sleep30-21swapper/310:20:013
119591190,6ptp4l9098-21sed11:05:212
119591190,0ptp4l0-21swapper/112:30:211
119591180,0ptp4l0-21swapper/111:30:121
119591180,0ptp4l0-21swapper/107:50:231
119591180,0ptp4l0-21swapper/007:20:180
119591170,2ptp4l21805-21snmp_o5powerctl12:30:200
119591170,2ptp4l0-21swapper/010:15:190
119591170,1ptp4l15968-21apt-get09:20:131
119591170,0ptp4l0-21swapper/208:55:122
119591170,0ptp4l0-21swapper/112:00:231
119591170,0ptp4l0-21swapper/010:20:150
119591170,0ptp4l0-21swapper/007:25:140
119591160,1ptp4l9886-21ls09:05:251
119591160,1ptp4l9523-21apt-get12:10:121
119591160,1ptp4l7247-21apt-get11:05:110
119591160,1ptp4l30881-21snmp_o5powerctl09:45:220
119591160,1ptp4l27867-21snmp_o5powerctl10:40:220
119591160,1ptp4l27203-21ntp_states11:40:181
119591160,1ptp4l1565-21apt-get11:55:120
119591160,1ptp4l11204-21snmp_o5powerctl12:10:210
119591160,0ptp4l0-21swapper/110:15:121
119591160,0ptp4l0-21swapper/109:40:171
119591160,0ptp4l0-21swapper/108:50:101
119591150,2ptp4l0-21swapper/107:55:151
119591150,1ptp4l8902-21ls10:05:171
119591150,1ptp4l7955-21users08:00:251
119591150,1ptp4l7153-21memory08:00:170
119591150,1ptp4l5348-21apt-get09:00:140
119591150,1ptp4l5072-21df_inode11:00:130
119591150,1ptp4l31609-21memory07:45:191
119591150,1ptp4l31467-21cp10:50:012
119591150,1ptp4l30507-21snmp_o5powerctl10:45:200
119591150,1ptp4l3023-21/usr/sbin/munin11:55:201
119591150,1ptp4l29895-21hddtemp_smartct09:45:151
119591150,1ptp4l29061-21perl11:45:141
119591150,1ptp4l26950-21latency_hist08:40:011
119591150,1ptp4l24911-21ntp_states10:35:181
119591150,1ptp4l24627-21munin-run07:35:010
119591150,1ptp4l23471-21hddtemp_smartct12:35:160
119591150,1ptp4l21235-21snmp_o5powerctl07:25:191
119591150,1ptp4l1701-21perf10:55:011
119591150,1ptp4l15261-21memory07:15:171
119591150,1ptp4l14851-21apt-get12:20:121
119591150,1ptp4l12590-21expr12:15:140
119591150,1ptp4l11949-21snmp_o5powerctl10:10:221
119591150,0ptp4l0-21swapper/111:25:161
119591150,0ptp4l0-21swapper/111:20:121
119591150,0ptp4l0-21swapper/110:55:121
119591150,0ptp4l0-21swapper/110:30:221
119591150,0ptp4l0-21swapper/109:30:121
119591150,0ptp4l0-21swapper/109:00:141
119591150,0ptp4l0-21swapper/108:40:131
119591150,0ptp4l0-21swapper/108:25:121
119591150,0ptp4l0-21swapper/108:18:381
119591150,0ptp4l0-21swapper/107:40:511
119591150,0ptp4l0-21swapper/012:20:120
119591150,0ptp4l0-21swapper/011:35:110
119591150,0ptp4l0-21swapper/011:20:120
119591150,0ptp4l0-21swapper/011:10:220
119591150,0ptp4l0-21swapper/009:30:120
119591150,0ptp4l0-21swapper/008:25:120
119591140,1ptp4l32379-21sed11:50:180
119591140,1ptp4l31614-21apt-get09:50:020
119591140,1ptp4l29368-21cut11:45:160
119591140,1ptp4l26084-21memory07:35:201
119591140,1ptp4l22095-21cpuspeed_turbos08:30:170
119591140,1ptp4l18370-21mailstats07:20:222
119591140,1ptp4l15399-21ntpq07:15:190
119591140,1ptp4l11267-21aten2.4-expect08:10:131
119591140,0ptp4l9-21ksoftirqd/008:55:230
119591140,0ptp4l1934-21apt-get10:55:120
119591140,0ptp4l0-21swapper/212:05:192
119591140,0ptp4l0-21swapper/210:25:222
119591140,0ptp4l0-21swapper/208:50:162
119591140,0ptp4l0-21swapper/208:25:212
119591140,0ptp4l0-21swapper/208:20:142
119591140,0ptp4l0-21swapper/207:40:232
119591140,0ptp4l0-21swapper/112:35:211
119591140,0ptp4l0-21swapper/112:27:231
119591140,0ptp4l0-21swapper/112:18:441
119591140,0ptp4l0-21swapper/112:05:251
119591140,0ptp4l0-21swapper/111:50:211
119591140,0ptp4l0-21swapper/111:10:181
119591140,0ptp4l0-21swapper/111:05:141
119591140,0ptp4l0-21swapper/111:00:201
119591140,0ptp4l0-21swapper/110:45:141
119591140,0ptp4l0-21swapper/110:40:121
119591140,0ptp4l0-21swapper/110:20:241
119591140,0ptp4l0-21swapper/109:55:201
119591140,0ptp4l0-21swapper/109:35:111
119591140,0ptp4l0-21swapper/109:25:131
119591140,0ptp4l0-21swapper/109:15:181
119591140,0ptp4l0-21swapper/109:10:131
119591140,0ptp4l0-21swapper/108:55:121
119591140,0ptp4l0-21swapper/108:45:151
119591140,0ptp4l0-21swapper/108:30:161
119591140,0ptp4l0-21swapper/108:20:181
119591140,0ptp4l0-21swapper/108:05:161
119591140,0ptp4l0-21swapper/107:30:131
119591140,0ptp4l0-21swapper/107:10:151
119591140,0ptp4l0-21swapper/012:25:120
119591140,0ptp4l0-21swapper/012:00:220
119591140,0ptp4l0-21swapper/011:30:220
119591140,0ptp4l0-21swapper/011:25:110
119591140,0ptp4l0-21swapper/011:15:180
119591140,0ptp4l0-21swapper/010:50:140
119591140,0ptp4l0-21swapper/010:35:110
119591140,0ptp4l0-21swapper/010:30:150
119591140,0ptp4l0-21swapper/010:25:140
119591140,0ptp4l0-21swapper/010:10:140
119591140,0ptp4l0-21swapper/010:05:190
119591140,0ptp4l0-21swapper/010:00:150
119591140,0ptp4l0-21swapper/010:00:150
119591140,0ptp4l0-21swapper/009:55:220
119591140,0ptp4l0-21swapper/009:40:140
119591140,0ptp4l0-21swapper/009:35:140
119591140,0ptp4l0-21swapper/009:25:140
119591140,0ptp4l0-21swapper/009:15:190
119591140,0ptp4l0-21swapper/008:40:150
119591140,0ptp4l0-21swapper/008:35:240
119591140,0ptp4l0-21swapper/008:20:150
119591140,0ptp4l0-21swapper/008:10:220
119591140,0ptp4l0-21swapper/008:05:140
119591140,0ptp4l0-21swapper/007:50:220
119591140,0ptp4l0-21swapper/007:46:330
119591140,0ptp4l0-21swapper/007:40:120
10602991412,1cyclictest33-21ksoftirqd/209:00:142
119591130,0ptp4l0-21swapper/211:30:222
119591130,0ptp4l0-21swapper/211:15:162
119591130,0ptp4l0-21swapper/210:40:212
119591130,0ptp4l0-21swapper/209:46:282
119591130,0ptp4l0-21swapper/209:18:582
119591130,0ptp4l0-21swapper/209:05:162
119591130,0ptp4l0-21swapper/208:41:082
119591130,0ptp4l0-21swapper/208:17:302
119591130,0ptp4l0-21swapper/208:01:302
119591130,0ptp4l0-21swapper/207:10:202
119591130,0ptp4l0-21swapper/111:35:121
119591130,0ptp4l0-21swapper/111:15:141
119591130,0ptp4l0-21swapper/110:25:011
119591130,0ptp4l0-21swapper/110:00:141
119591130,0ptp4l0-21swapper/110:00:141
119591130,0ptp4l0-21swapper/109:50:141
119591130,0ptp4l0-21swapper/107:20:141
119591130,0ptp4l0-21swapper/012:05:150
119591130,0ptp4l0-21swapper/011:40:110
119591130,0ptp4l0-21swapper/009:20:200
119591130,0ptp4l0-21swapper/009:10:160
119591130,0ptp4l0-21swapper/009:05:150
119591130,0ptp4l0-21swapper/008:50:150
119591130,0ptp4l0-21swapper/008:45:120
119591130,0ptp4l0-21swapper/008:15:130
119591130,0ptp4l0-21swapper/007:55:140
119591130,0ptp4l0-21swapper/007:35:140
119591130,0ptp4l0-21swapper/007:10:140
119591120,1ptp4l0-21swapper/210:20:022
119591120,0ptp4l0-21swapper/212:25:142
119591120,0ptp4l0-21swapper/212:15:442
119591120,0ptp4l0-21swapper/212:11:492
119591120,0ptp4l0-21swapper/210:50:212
119591110,0ptp4l0-21swapper/212:34:332
119591110,0ptp4l0-21swapper/211:39:212
119591110,0ptp4l0-21swapper/211:28:332
119591110,0ptp4l0-21swapper/208:45:332
119591110,0ptp4l0-21swapper/207:36:332
119591100,1ptp4l0-21swapper/210:37:132
119591100,1ptp4l0-21swapper/210:33:502
119591100,0ptp4l0-21swapper/209:32:322
119591100,0ptp4l0-21swapper/208:30:082
119591100,0ptp4l0-21swapper/207:16:382
1060299108,1cyclictest5437-21cat11:00:162
11959190,1ptp4l0-21swapper/211:20:102
11959190,1ptp4l0-21swapper/211:13:362
11959190,0ptp4l0-21swapper/212:36:122
11959190,0ptp4l0-21swapper/212:01:402
11959190,0ptp4l0-21swapper/211:55:572
11959190,0ptp4l0-21swapper/211:50:512
11959190,0ptp4l0-21swapper/210:56:432
11959190,0ptp4l0-21swapper/210:15:542
11959190,0ptp4l0-21swapper/210:11:092
11959190,0ptp4l0-21swapper/210:06:162
11959190,0ptp4l0-21swapper/210:02:572
11959190,0ptp4l0-21swapper/210:02:572
11959190,0ptp4l0-21swapper/209:50:522
11959190,0ptp4l0-21swapper/209:26:202
11959190,0ptp4l0-21swapper/209:21:072
11959190,0ptp4l0-21swapper/209:13:492
11959190,0ptp4l0-21swapper/208:37:092
11959190,0ptp4l0-21swapper/208:10:562
11959190,0ptp4l0-21swapper/208:07:102
11959190,0ptp4l0-21swapper/207:51:042
11959190,0ptp4l0-21swapper/207:45:062
11959190,0ptp4l0-21swapper/207:30:502
106039997,1cyclictest80052sleep308:00:533
106039997,1cyclictest26848-21taskset08:39:373
106039997,1cyclictest25662-21taskset10:36:423
106039997,1cyclictest23758-21cut07:30:213
106039997,1cyclictest2082-21cut11:55:153
106039997,1cyclictest20562-21cut11:30:123
106039997,1cyclictest1211-21wc11:55:013
106039997,1cyclictest10293-21taskset09:08:493
106039990,8cyclictest20624-21uptime09:25:233
106029999,0cyclictest33-21ksoftirqd/207:25:182
106029997,1cyclictest3403-21egrep07:55:132
106029997,1cyclictest29966-21tr11:45:202
106029997,1cyclictest27282-21basename09:40:162
106029997,1cyclictest257952sleep211:40:102
106029997,1cyclictest25158-21sort09:35:172
106029990,8cyclictest2537-21expr09:55:132
11959180,0ptp4l0-21swapper/212:20:462
106039986,1cyclictest909-21sed08:50:173
106039986,1cyclictest8631-21ntp_states11:05:183
106039986,1cyclictest7821-21sed12:05:193
106039986,1cyclictest7674-21cut10:05:123
106039986,1cyclictest63752sleep312:01:493
106039986,1cyclictest5329-21expr10:00:143
106039986,1cyclictest5329-21expr10:00:143
106039986,1cyclictest5233-21grep11:00:143
106039986,1cyclictest4897-21grep07:55:213
106039986,1cyclictest4449-21ls08:55:223
106039986,1cyclictest4208-21grep09:55:233
106039986,1cyclictest32648-21uniq09:50:153
106039986,1cyclictest31163-21ntpq08:45:193
106039986,1cyclictest30482-21stty07:45:143
106039986,1cyclictest29791-21cut09:45:153
106039986,1cyclictest297842sleep307:43:193
106039986,1cyclictest29537-21sed10:45:143
106039986,1cyclictest29232-21cat11:45:153
106039986,1cyclictest27451-21cut11:40:203
106039986,1cyclictest27432-21tr08:40:143
106039986,1cyclictest26836-21grep10:40:153
106039986,1cyclictest26546-21cat09:40:123
106039986,1cyclictest25106-21expr07:35:153
106039986,1cyclictest24266-21cat09:35:133
106039986,1cyclictest23455-21seq09:32:343
106039986,1cyclictest2329-21cat07:50:233
106039986,1cyclictest23270-21cut11:35:123
106039986,1cyclictest23208-21expr12:35:153
106039986,1cyclictest23131-21taskset10:33:113
106039986,1cyclictest2246-21expr10:55:143
106039986,1cyclictest22121-21expr08:30:173
106039986,1cyclictest204472sleep310:27:413
106039986,1cyclictest20417-21taskset12:30:133
106039986,1cyclictest20094-21sed08:25:173
106039986,1cyclictest198132sleep312:29:083
106039986,1cyclictest19545-21basename07:25:093
106039986,1cyclictest18825-21tr11:25:163
106039986,1cyclictest17923-21awk08:20:203
106039986,1cyclictest17915-21taskset10:24:083
106039986,1cyclictest16813-21cut07:20:123
106039986,1cyclictest16217-21chrt08:19:133
106039986,1cyclictest16165-21chrt07:16:333
106039986,1cyclictest1572-21taskset10:53:383
106039986,1cyclictest15178-21chrt11:20:023
106039986,1cyclictest14916-21aten_r9power_po12:20:133
106039986,1cyclictest13648-21expr09:15:153
106039986,1cyclictest12680-21grep11:15:143
106039986,1cyclictest12641-21expr12:15:143
106039986,1cyclictest12402-21chrt10:11:363
106039986,1cyclictest11824-21cut08:10:153
106039986,1cyclictest11554-21tr07:10:183
106039986,1cyclictest10690-21cut09:10:133
106039986,1cyclictest10318-21expr11:10:133
106039986,1cyclictest10275-21switchtime08:05:233
106039986,1cyclictest10153-21head12:10:153
106039975,1cyclictest15945-21cat09:20:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional