You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 00:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot3s.osadl.org (updated Wed May 13, 2026 12:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591630,58ptp4l0-21swapper/107:06:441
119591630,58ptp4l0-21swapper/107:06:441
119591620,31ptp4l0-21swapper/007:06:420
119591620,31ptp4l0-21swapper/007:06:420
1458325144,5sleep20-21swapper/207:06:122
1458325144,5sleep20-21swapper/207:06:122
1300915147,2phc2sys0-21swapper/307:07:173
1300915147,2phc2sys0-21swapper/307:07:173
119591210,0ptp4l0-21swapper/010:20:210
119591200,0ptp4l0-21swapper/109:55:201
119591190,2ptp4l0-21swapper/112:30:131
119591190,0ptp4l0-21swapper/210:20:122
119591180,5ptp4l22671-21cat08:20:231
119591170,0ptp4l0-21swapper/109:45:161
119591170,0ptp4l0-21swapper/108:45:141
119591170,0ptp4l0-21swapper/108:10:151
119591170,0ptp4l0-21swapper/108:10:141
119591170,0ptp4l0-21swapper/008:35:110
119591170,0ptp4l0-21swapper/007:15:190
119591160,1ptp4l4354-21apt-get08:50:130
119591160,1ptp4l3751-21snmp_o5powerctl07:45:191
119591160,1ptp4l3391-21apt-get10:50:111
119591160,1ptp4l22658-21diskstats11:25:140
119591160,1ptp4l15559-21apt-get08:10:120
119591160,1ptp4l15559-21apt-get08:10:120
119591160,1ptp4l1185-21ls07:40:220
119591160,0ptp4l0-21swapper/111:25:211
119591160,0ptp4l0-21swapper/012:15:210
119591160,0ptp4l0-21swapper/012:10:210
119591150,2ptp4l0-21swapper/009:24:560
119591150,1ptp4l937-21ls08:40:240
119591150,1ptp4l8665-21snmp_o5powerctl08:55:211
119591150,1ptp4l5465-21irqstats08:50:181
119591150,1ptp4l3698-21df_inode11:50:131
119591150,1ptp4l29644-21ls09:35:181
119591150,1ptp4l23608-21df09:25:120
119591150,1ptp4l20848-21/usr/sbin/munin08:20:160
119591150,1ptp4l20545-21ntp_states12:20:190
119591150,1ptp4l1987-21/usr/sbin/munin11:45:191
119591150,1ptp4l18628-21ntp_states10:15:190
119591150,1ptp4l18321-21snmp_o5powerctl11:15:210
119591150,1ptp4l17873-21ntp_states12:15:181
119591150,1ptp4l15522-21snmp_o5powerctl12:10:231
119591150,1ptp4l14725-21diskmemload12:00:140
119591150,1ptp4l14350-21expr11:10:161
119591150,1ptp4l12341-21grep12:05:171
119591150,1ptp4l11933-21snmp_o5powerctl08:00:220
119591150,0ptp4l6626-21apt-get09:55:130
119591150,0ptp4l0-21swapper/112:01:311
119591150,0ptp4l0-21swapper/111:43:571
119591150,0ptp4l0-21swapper/111:35:131
119591150,0ptp4l0-21swapper/110:55:121
119591150,0ptp4l0-21swapper/110:45:131
119591150,0ptp4l0-21swapper/109:50:231
119591150,0ptp4l0-21swapper/108:15:211
119591150,0ptp4l0-21swapper/011:55:250
119591150,0ptp4l0-21swapper/009:13:320
119591150,0ptp4l0-21swapper/009:05:140
1514199145,4cyclictest11596-21taskset10:03:502
119591140,1ptp4l3889-21gltestperf11:50:140
119591140,1ptp4l3163-21cat10:50:010
119591140,1ptp4l31147-21aten_r9power_en09:40:131
119591140,1ptp4l30477-21snmp_o5powerctl08:35:191
119591140,1ptp4l29522-21snmp_o5powerctl10:35:211
119591140,1ptp4l28781-21cut11:35:190
119591140,1ptp4l28513-21phc2sys12:35:190
119591140,1ptp4l27820-21/usr/sbin/munin10:35:130
119591140,1ptp4l27759-21memory07:30:181
119591140,1ptp4l26085-21latency_hist08:30:011
119591140,1ptp4l2577-21sed09:45:180
119591140,1ptp4l25376-21fschecks_time11:30:151
119591140,1ptp4l24736-21memory08:25:170
119591140,1ptp4l23750-21sed07:25:001
119591140,1ptp4l22217-21cstates12:25:130
119591140,1ptp4l21899-21sed10:20:231
119591140,1ptp4l20026-21apt-get09:20:021
119591140,1ptp4l19252-21head12:20:131
119591140,1ptp4l15562-21perl09:10:151
119591140,1ptp4l14841-21grep10:10:132
119591140,1ptp4l12594-21gltestperf10:05:151
119591140,1ptp4l11488-21ls09:00:240
119591140,1ptp4l10730-21df08:00:141
119591140,0ptp4l3461-21ls08:45:240
119591140,0ptp4l0-21swapper/211:35:232
119591140,0ptp4l0-21swapper/211:25:222
119591140,0ptp4l0-21swapper/210:27:572
119591140,0ptp4l0-21swapper/207:55:212
119591140,0ptp4l0-21swapper/112:35:141
119591140,0ptp4l0-21swapper/111:20:021
119591140,0ptp4l0-21swapper/111:20:021
119591140,0ptp4l0-21swapper/111:00:221
119591140,0ptp4l0-21swapper/110:40:131
119591140,0ptp4l0-21swapper/110:25:161
119591140,0ptp4l0-21swapper/110:15:181
119591140,0ptp4l0-21swapper/110:10:151
119591140,0ptp4l0-21swapper/109:25:211
119591140,0ptp4l0-21swapper/109:15:221
119591140,0ptp4l0-21swapper/109:05:191
119591140,0ptp4l0-21swapper/109:00:201
119591140,0ptp4l0-21swapper/108:40:241
119591140,0ptp4l0-21swapper/108:32:291
119591140,0ptp4l0-21swapper/107:55:181
119591140,0ptp4l0-21swapper/107:50:011
119591140,0ptp4l0-21swapper/107:35:181
119591140,0ptp4l0-21swapper/107:25:221
119591140,0ptp4l0-21swapper/107:15:241
119591140,0ptp4l0-21swapper/012:05:220
119591140,0ptp4l0-21swapper/011:45:170
119591140,0ptp4l0-21swapper/011:40:170
119591140,0ptp4l0-21swapper/011:30:230
119591140,0ptp4l0-21swapper/011:20:200
119591140,0ptp4l0-21swapper/011:20:200
119591140,0ptp4l0-21swapper/011:05:120
119591140,0ptp4l0-21swapper/010:55:210
119591140,0ptp4l0-21swapper/010:50:200
119591140,0ptp4l0-21swapper/010:30:180
119591140,0ptp4l0-21swapper/010:25:210
119591140,0ptp4l0-21swapper/010:05:220
119591140,0ptp4l0-21swapper/010:00:030
119591140,0ptp4l0-21swapper/009:50:220
119591140,0ptp4l0-21swapper/008:30:180
119591140,0ptp4l0-21swapper/008:15:230
119591140,0ptp4l0-21swapper/007:45:160
119591140,0ptp4l0-21swapper/007:25:230
119591140,0ptp4l0-21swapper/007:10:230
119591130,0ptp4l0-21swapper/212:30:162
119591130,0ptp4l0-21swapper/212:15:212
119591130,0ptp4l0-21swapper/211:30:202
119591130,0ptp4l0-21swapper/210:30:152
119591130,0ptp4l0-21swapper/209:50:132
119591130,0ptp4l0-21swapper/208:10:232
119591130,0ptp4l0-21swapper/208:10:222
119591130,0ptp4l0-21swapper/112:25:151
119591130,0ptp4l0-21swapper/111:55:171
119591130,0ptp4l0-21swapper/111:15:131
119591130,0ptp4l0-21swapper/111:05:131
119591130,0ptp4l0-21swapper/110:30:171
119591130,0ptp4l0-21swapper/110:00:151
119591130,0ptp4l0-21swapper/109:30:121
119591130,0ptp4l0-21swapper/108:05:121
119591130,0ptp4l0-21swapper/107:40:201
119591130,0ptp4l0-21swapper/107:10:181
119591130,0ptp4l0-21swapper/012:30:130
119591130,0ptp4l0-21swapper/011:10:150
119591130,0ptp4l0-21swapper/011:00:130
119591130,0ptp4l0-21swapper/010:40:130
119591130,0ptp4l0-21swapper/010:10:140
119591130,0ptp4l0-21swapper/009:40:140
119591130,0ptp4l0-21swapper/009:35:150
119591130,0ptp4l0-21swapper/009:30:140
119591130,0ptp4l0-21swapper/009:15:150
119591130,0ptp4l0-21swapper/008:55:130
119591130,0ptp4l0-21swapper/008:05:120
119591130,0ptp4l0-21swapper/007:55:120
119591130,0ptp4l0-21swapper/007:50:130
119591130,0ptp4l0-21swapper/007:35:130
119591130,0ptp4l0-21swapper/007:30:140
119591130,0ptp4l0-21swapper/007:20:170
1514199126,5cyclictest31817-21grep10:40:172
1514199126,5cyclictest1163-21tune2fs11:45:142
1514199125,6cyclictest29076-21ls10:35:162
1514199125,4cyclictest1822-21taskset07:44:542
1514199125,4cyclictest1261-21chrt08:42:362
1514199124,5cyclictest3487-21chrt09:46:572
1514199124,5cyclictest20702-21taskset07:16:352
119591120,0ptp4l0-21swapper/212:00:212
1514199116,4cyclictest2598-21cut08:45:162
1514199115,5cyclictest5202-21grep07:50:142
1514199115,5cyclictest19429-21wc08:15:182
1514199114,6cyclictest29512-21sleep12:40:002
1514199114,6cyclictest12574-21ntpq12:05:182
1514199110,1cyclictest226-21systemd-journal11:54:562
119591110,0ptp4l0-21swapper/211:58:452
119591110,0ptp4l0-21swapper/211:23:452
119591110,0ptp4l0-21swapper/211:23:452
1514199105,4cyclictest308902sleep208:36:002
1514199105,4cyclictest30494-21expr11:40:132
1514199105,4cyclictest29738-21tail09:35:192
1514199105,4cyclictest21121-21tr08:20:152
119591100,1ptp4l33-21ksoftirqd/210:48:112
119591100,0ptp4l0-21swapper/210:16:022
151429997,1cyclictest5552-21taskset10:52:033
151429997,1cyclictest5510-21seq11:53:393
151429997,1cyclictest2769-21hddtemp_smartct07:45:143
151429997,1cyclictest27233-21sleep11:35:003
151429997,1cyclictest27185-21head10:30:243
151429997,1cyclictest214192sleep311:21:143
151429997,1cyclictest214192sleep311:21:143
151429997,1cyclictest16861-21grep11:15:133
151429997,1cyclictest15165-21taskset08:08:163
151429997,1cyclictest14966-21dpkg09:10:123
151429997,1cyclictest14598-21if_enp2s012:10:163
151429997,1cyclictest14046-21taskset10:06:183
151429996,2cyclictest22306-21cut07:20:183
151429991,4cyclictest0-21swapper/309:25:113
151429990,8cyclictest10740-21taskset12:02:313
151419997,1cyclictest8681-21cat11:00:122
151419997,1cyclictest3596-21tr10:50:122
151419997,1cyclictest23535-21sshd07:23:442
151419994,4cyclictest6211-21grep10:55:132
151419994,4cyclictest14148-21expr12:10:142
151419993,1cyclictest16874-21tr11:15:132
151419991,1cyclictest0-21swapper/209:02:442
11959190,0ptp4l0-21swapper/212:26:082
11959190,0ptp4l0-21swapper/212:20:562
11959190,0ptp4l0-21swapper/211:12:512
11959190,0ptp4l0-21swapper/211:05:402
11959190,0ptp4l0-21swapper/210:06:552
11959190,0ptp4l0-21swapper/209:56:152
11959190,0ptp4l0-21swapper/209:40:112
11959190,0ptp4l0-21swapper/209:34:402
11959190,0ptp4l0-21swapper/209:25:322
11959190,0ptp4l0-21swapper/209:23:342
11959190,0ptp4l0-21swapper/209:15:472
11959190,0ptp4l0-21swapper/209:10:422
11959190,0ptp4l0-21swapper/209:09:182
11959190,0ptp4l0-21swapper/208:56:112
11959190,0ptp4l0-21swapper/208:50:372
11959190,0ptp4l0-21swapper/208:30:322
11959190,0ptp4l0-21swapper/208:28:582
11959190,0ptp4l0-21swapper/208:07:162
11959190,0ptp4l0-21swapper/208:04:462
11959190,0ptp4l0-21swapper/207:35:122
11959190,0ptp4l0-21swapper/207:30:402
11959190,0ptp4l0-21swapper/207:11:452
151429987,1cyclictest13001-21smartctl09:05:123
151429986,1cyclictest9252-21uniq11:00:153
151429986,1cyclictest899-21taskset09:42:563
151429986,1cyclictest860-21cpu10:45:143
151429986,1cyclictest8581-21tr07:55:163
151429986,1cyclictest7951-21cut08:55:163
151429986,1cyclictest6585-21chrt09:55:033
151429986,1cyclictest6130-21sh10:55:123
151429986,1cyclictest5900-21head11:55:123
151429986,1cyclictest5133-21cat07:50:153
151429986,1cyclictest4023-21aten_r9power_en09:50:113
151429986,1cyclictest325002sleep311:44:403
151429986,1cyclictest31695-21cut08:40:143
151429986,1cyclictest30479-21chrt10:40:073
151429986,1cyclictest28828-21basename08:35:103
151429986,1cyclictest28699-21tr09:35:153
151429986,1cyclictest28687-21if_err_enp3s010:35:153
151429986,1cyclictest286802sleep307:31:473
151429986,1cyclictest27199-21cut12:35:123
151429986,1cyclictest27102-21cut09:30:183
151429986,1cyclictest26529-21expr08:30:143
151429986,1cyclictest26285-21sort12:30:223
151429986,1cyclictest24090-21sort08:25:153
151429986,1cyclictest23949-21cut07:25:133
151429986,1cyclictest23041-21cat10:25:133
151429986,1cyclictest22789-21tr12:25:163
151429986,1cyclictest22399-21expr11:25:133
151429986,1cyclictest21929-21cut08:20:173
151429986,1cyclictest20406-21find09:20:013
151429986,1cyclictest19891-21basename10:20:113
151429986,1cyclictest19844-21cat07:15:183
151429986,1cyclictest19657-21seq09:15:333
151429986,1cyclictest19604-21seq10:19:383
151429986,1cyclictest19141-21cut08:15:183
151429986,1cyclictest19124-21taskset12:20:053
151429986,1cyclictest1821-21taskset07:44:533
151429986,1cyclictest1750-21hostname08:45:133
151429986,1cyclictest17400-21cat08:10:233
151429986,1cyclictest17400-21cat08:10:233
151429986,1cyclictest16619-21cpu12:15:123
151429986,1cyclictest15801-21cat10:10:173
151429986,1cyclictest1544-21tr09:45:133
151429986,1cyclictest14213-21tr11:10:163
151429986,1cyclictest1211-21grep11:45:153
151429986,1cyclictest12073-21idleruntime11:05:153
151429986,1cyclictest11682-21chrt12:05:143
151429986,1cyclictest10674-21expr08:00:143
151429986,1cyclictest10369-21cat09:00:163
151429986,1cyclictest10100-21if_enp4s010:00:163
151419986,1cyclictest3586-21tr07:45:182
151419986,1cyclictest23928-21aten_r9power_en07:25:132
151429976,1cyclictest29318-21sed11:35:243
151429975,1cyclictest5118-21cat08:50:163
151429975,1cyclictest29595-21expr07:35:143
151429975,1cyclictest15392-21tr07:10:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional