You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 10:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Wed Jun 24, 2026 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591590,41ptp4l0-21swapper/019:05:270
119591580,36ptp4l0-21swapper/119:05:171
1980425344,7sleep30-21swapper/319:07:063
1969325244,2sleep20-21swapper/219:05:422
119591310,0ptp4l0-21swapper/121:20:151
119591240,0ptp4l0-21swapper/100:09:571
119591230,0ptp4l0-21swapper/120:50:361
119591220,0ptp4l0-21swapper/022:55:170
119591210,0ptp4l0-21swapper/122:45:191
119591190,0ptp4l0-21swapper/119:45:151
119591190,0ptp4l0-21swapper/119:30:121
119591180,0ptp4l0-21swapper/020:30:250
119591180,0ptp4l0-21swapper/000:15:190
119591170,0ptp4l0-21swapper/122:50:221
119591170,0ptp4l0-21swapper/100:35:131
119591160,1ptp4l8786-21apt-get22:50:140
119591160,1ptp4l3093-21/usr/sbin/munin23:40:161
119591160,1ptp4l25309-21apt-get22:20:130
119591160,0ptp4l0-21swapper/000:05:180
119591150,1ptp4l7445-21apt-get19:45:120
119591150,1ptp4l6620-21diskstats22:45:140
119591150,1ptp4l31643-21snmp_o5powerctl00:30:230
119591150,1ptp4l30080-21sed19:25:171
119591150,1ptp4l29630-21snmp_o5powerctl22:25:260
119591150,1ptp4l29254-21snmp_o5powerctl23:25:230
119591150,1ptp4l29243-21python23:25:231
119591150,1ptp4l27608-21ls19:20:171
119591150,1ptp4l27532-21snmp_o5powerctl21:20:240
119591150,1ptp4l26360-21snmp_o5powerctl00:20:241
119591150,1ptp4l24645-21snmp_o5powerctl21:15:241
119591150,1ptp4l23226-21snmp_o5powerctl19:15:020
119591150,1ptp4l22013-21apt-get00:15:121
119591150,1ptp4l21514-21ls23:10:251
119591150,1ptp4l1563-21irqstats23:35:161
119591150,1ptp4l15622-21snmp_o5powerctl00:00:240
119591150,1ptp4l15406-21apt-get20:00:130
119591150,1ptp4l14414-21df_inode00:00:151
119591150,1ptp4l14038-21snmp_o5powerctl20:55:240
119591150,0ptp4l0-21swapper/122:20:141
119591150,0ptp4l0-21swapper/121:45:131
119591150,0ptp4l0-21swapper/120:10:131
119591150,0ptp4l0-21swapper/100:10:111
119591150,0ptp4l0-21swapper/023:15:120
119591150,0ptp4l0-21swapper/021:53:440
119591150,0ptp4l0-21swapper/021:25:160
119591150,0ptp4l0-21swapper/020:20:150
119591140,1ptp4l7536-21df20:45:151
119591140,1ptp4l4798-21snmp_o5powerctl23:40:220
119591140,1ptp4l4732-21/usr/sbin/munin21:40:161
119591140,1ptp4l2914-21ps21:35:240
119591140,1ptp4l22004-21snmp_o5powerctl21:10:251
119591140,1ptp4l20733-21irqstats23:10:190
119591140,1ptp4l19398-21wc21:05:240
119591140,1ptp4l1894-21/usr/sbin/munin19:35:170
119591140,1ptp4l16579-21date23:05:010
119591140,1ptp4l16366-21snmp_o5powerctl22:00:221
119591140,1ptp4l14562-21ls19:55:221
119591140,1ptp4l1404-21latency00:35:180
119591140,1ptp4l12047-21aten2.4-expect21:55:170
119591140,1ptp4l10285-21sshd23:50:222
119591140,0ptp4l6176-21ls20:40:230
119591140,0ptp4l18884-21ls21:05:181
119591140,0ptp4l1758-21apt-get20:35:131
119591140,0ptp4l0-21swapper/222:00:182
119591140,0ptp4l0-21swapper/123:47:121
119591140,0ptp4l0-21swapper/123:05:231
119591140,0ptp4l0-21swapper/122:41:551
119591140,0ptp4l0-21swapper/122:35:151
119591140,0ptp4l0-21swapper/122:30:021
119591140,0ptp4l0-21swapper/122:25:151
119591140,0ptp4l0-21swapper/122:05:181
119591140,0ptp4l0-21swapper/121:55:271
119591140,0ptp4l0-21swapper/121:35:231
119591140,0ptp4l0-21swapper/121:30:151
119591140,0ptp4l0-21swapper/121:00:131
119591140,0ptp4l0-21swapper/120:40:221
119591140,0ptp4l0-21swapper/120:20:281
119591140,0ptp4l0-21swapper/120:15:031
119591140,0ptp4l0-21swapper/120:00:331
119591140,0ptp4l0-21swapper/119:40:151
119591140,0ptp4l0-21swapper/119:10:211
119591140,0ptp4l0-21swapper/023:45:020
119591140,0ptp4l0-21swapper/023:05:200
119591140,0ptp4l0-21swapper/022:10:120
119591140,0ptp4l0-21swapper/021:30:130
119591140,0ptp4l0-21swapper/020:35:140
119591140,0ptp4l0-21swapper/019:50:220
119591140,0ptp4l0-21swapper/019:41:530
119591140,0ptp4l0-21swapper/019:30:210
119591140,0ptp4l0-21swapper/019:10:120
2029099131,3cyclictest0-21swapper/300:35:133
2028899131,3cyclictest0-21swapper/119:35:141
119591130,0ptp4l30251-21aten2.4-expect23:30:120
119591130,0ptp4l19356-21apt-get00:10:120
119591130,0ptp4l14547-21cstates23:00:141
119591130,0ptp4l0-21swapper/223:15:192
119591130,0ptp4l0-21swapper/222:30:252
119591130,0ptp4l0-21swapper/222:05:192
119591130,0ptp4l0-21swapper/221:45:242
119591130,0ptp4l0-21swapper/221:35:162
119591130,0ptp4l0-21swapper/221:30:212
119591130,0ptp4l0-21swapper/221:10:162
119591130,0ptp4l0-21swapper/220:46:272
119591130,0ptp4l0-21swapper/220:35:152
119591130,0ptp4l0-21swapper/220:00:322
119591130,0ptp4l0-21swapper/219:40:182
119591130,0ptp4l0-21swapper/219:20:182
119591130,0ptp4l0-21swapper/200:20:142
119591130,0ptp4l0-21swapper/200:00:262
119591130,0ptp4l0-21swapper/123:55:161
119591130,0ptp4l0-21swapper/123:50:141
119591130,0ptp4l0-21swapper/123:30:131
119591130,0ptp4l0-21swapper/123:20:131
119591130,0ptp4l0-21swapper/123:20:131
119591130,0ptp4l0-21swapper/123:15:161
119591130,0ptp4l0-21swapper/122:55:151
119591130,0ptp4l0-21swapper/122:15:141
119591130,0ptp4l0-21swapper/122:10:201
119591130,0ptp4l0-21swapper/121:50:131
119591130,0ptp4l0-21swapper/121:25:201
119591130,0ptp4l0-21swapper/120:55:181
119591130,0ptp4l0-21swapper/120:30:161
119591130,0ptp4l0-21swapper/120:25:211
119591130,0ptp4l0-21swapper/119:50:141
119591130,0ptp4l0-21swapper/119:15:151
119591130,0ptp4l0-21swapper/100:30:141
119591130,0ptp4l0-21swapper/100:25:141
119591130,0ptp4l0-21swapper/023:55:170
119591130,0ptp4l0-21swapper/023:50:140
119591130,0ptp4l0-21swapper/023:35:130
119591130,0ptp4l0-21swapper/023:20:160
119591130,0ptp4l0-21swapper/023:20:150
119591130,0ptp4l0-21swapper/022:40:150
119591130,0ptp4l0-21swapper/022:35:130
119591130,0ptp4l0-21swapper/022:30:210
119591130,0ptp4l0-21swapper/022:15:170
119591130,0ptp4l0-21swapper/022:05:130
119591130,0ptp4l0-21swapper/022:00:150
119591130,0ptp4l0-21swapper/021:45:160
119591130,0ptp4l0-21swapper/021:40:120
119591130,0ptp4l0-21swapper/021:15:150
119591130,0ptp4l0-21swapper/021:10:160
119591130,0ptp4l0-21swapper/021:00:170
119591130,0ptp4l0-21swapper/020:50:200
119591130,0ptp4l0-21swapper/020:45:200
119591130,0ptp4l0-21swapper/020:25:150
119591130,0ptp4l0-21swapper/020:15:130
119591130,0ptp4l0-21swapper/020:10:150
119591130,0ptp4l0-21swapper/020:05:140
119591130,0ptp4l0-21swapper/019:55:140
119591130,0ptp4l0-21swapper/019:25:140
119591130,0ptp4l0-21swapper/019:20:110
119591130,0ptp4l0-21swapper/000:25:160
119591130,0ptp4l0-21swapper/000:20:180
2029099120,5cyclictest0-21swapper/320:20:153
119591120,0ptp4l0-21swapper/221:05:032
119591120,0ptp4l0-21swapper/220:55:212
119591120,0ptp4l0-21swapper/220:50:012
119591120,0ptp4l0-21swapper/120:05:161
2029099111,5cyclictest0-21swapper/321:00:133
119591110,2ptp4l0-21swapper/223:12:382
119591110,0ptp4l0-21swapper/223:39:222
119591110,0ptp4l0-21swapper/222:25:522
119591110,0ptp4l0-21swapper/221:44:562
119591110,0ptp4l0-21swapper/220:26:442
119591110,0ptp4l0-21swapper/219:15:242
119591110,0ptp4l0-21swapper/200:34:022
139542100,0sleep30-21swapper/320:55:233
119591100,2ptp4l0-21swapper/223:07:372
119591100,1ptp4l33-21ksoftirqd/220:13:542
119591100,1ptp4l2028999cyclictest00:08:212
119591100,1ptp4l0-21swapper/222:38:112
119591100,1ptp4l0-21swapper/221:28:552
119591100,1ptp4l0-21swapper/219:51:552
119591100,0ptp4l0-21swapper/223:40:352
119591100,0ptp4l0-21swapper/221:15:052
119591100,0ptp4l0-21swapper/221:00:432
119591100,0ptp4l0-21swapper/220:18:402
119591100,0ptp4l0-21swapper/219:55:132
119591100,0ptp4l0-21swapper/219:49:442
202909997,1cyclictest3346-21grep21:35:273
202909997,1cyclictest30724-21telnet22:30:153
202909997,1cyclictest284712sleep319:20:543
202909997,1cyclictest2730-21taskset23:38:293
202909997,1cyclictest26694-21ntp_states22:20:193
202909997,1cyclictest25791-21chrt19:15:473
202909997,1cyclictest22621-21chrt19:13:433
202909997,1cyclictest22553-21taskset21:12:513
202909997,1cyclictest22197-21chrt22:12:383
202909997,1cyclictest176652sleep320:03:183
202909997,1cyclictest16220-21chrt23:01:293
202909997,1cyclictest1263-21grep19:30:223
202909997,1cyclictest118432sleep320:51:393
202909991,5cyclictest0-21swapper/323:50:123
202909990,8cyclictest4035-21taskset19:36:273
202909990,8cyclictest26764-21cut21:20:173
202909990,8cyclictest21834-21sed20:10:183
11959190,0ptp4l0-21swapper/223:46:012
11959190,0ptp4l0-21swapper/223:34:572
11959190,0ptp4l0-21swapper/223:26:552
11959190,0ptp4l0-21swapper/223:20:302
11959190,0ptp4l0-21swapper/223:20:292
11959190,0ptp4l0-21swapper/223:00:082
11959190,0ptp4l0-21swapper/222:55:562
11959190,0ptp4l0-21swapper/222:53:192
11959190,0ptp4l0-21swapper/222:45:122
11959190,0ptp4l0-21swapper/222:42:192
11959190,0ptp4l0-21swapper/222:21:152
11959190,0ptp4l0-21swapper/222:15:032
11959190,0ptp4l0-21swapper/222:12:172
11959190,0ptp4l0-21swapper/221:56:152
11959190,0ptp4l0-21swapper/221:50:582
11959190,0ptp4l0-21swapper/221:20:382
11959190,0ptp4l0-21swapper/220:42:142
11959190,0ptp4l0-21swapper/220:30:152
11959190,0ptp4l0-21swapper/220:20:552
11959190,0ptp4l0-21swapper/219:33:342
11959190,0ptp4l0-21swapper/219:28:012
11959190,0ptp4l0-21swapper/219:10:082
11959190,0ptp4l0-21swapper/200:35:432
11959190,0ptp4l0-21swapper/200:25:362
11959190,0ptp4l0-21swapper/200:11:302
202909986,1cyclictest9298-21chrt21:50:033
202909986,1cyclictest8870-21cut22:50:143
202909986,1cyclictest7564-21cut19:45:123
202909986,1cyclictest7230-21grep21:45:163
202909986,1cyclictest7207-21tr22:45:163
202909986,1cyclictest7106-21basename20:45:123
202909986,1cyclictest7089-21taskset23:45:193
202909986,1cyclictest5161-21chrt23:40:293
202909986,1cyclictest5146-21cut21:40:173
202909986,1cyclictest5127-21grep19:40:153
202909986,1cyclictest43822sleep320:40:013
202909986,1cyclictest3882-21expr22:40:143
202909986,1cyclictest32698-21sed20:30:183
202909986,1cyclictest32362-21chrt23:31:443
202909986,1cyclictest31396-21expr21:30:153
202909986,1cyclictest31194-21taskset19:26:543
202909986,1cyclictest29933-21seq00:30:053
202909986,1cyclictest2991-21cat20:35:203
202909986,1cyclictest29762-21ls21:25:183
202909986,1cyclictest28609-21ls00:25:193
202909986,1cyclictest28364-21if_enp4s023:25:163
202909986,1cyclictest28319-21cat22:25:173
202909986,1cyclictest25851-21sed00:20:183
202909986,1cyclictest25623-21sh23:20:163
202909986,1cyclictest25623-21sh23:20:153
202909986,1cyclictest23814-21cut20:15:103
202909986,1cyclictest23180-21wc21:15:163
202909986,1cyclictest22886-21expr22:15:153
202909986,1cyclictest21990-21cat00:15:123
202909986,1cyclictest20664-21tr23:10:183
202909986,1cyclictest20138-21taskset20:06:023
202909986,1cyclictest20028-21sed00:10:153
202909986,1cyclictest18641-21seq00:05:393
202909986,1cyclictest17650-21taskset21:05:133
202909986,1cyclictest17341-21dpkg22:05:113
202909986,1cyclictest16790-21dpkg23:05:023
202909986,1cyclictest15327-21sh00:00:203
202909986,1cyclictest15118-21expr22:00:143
202909986,1cyclictest1504-21tail22:35:143
202909986,1cyclictest13199-21load21:55:223
202909986,1cyclictest13177-21cat19:55:133
202909986,1cyclictest12049-21tail22:55:163
202909986,1cyclictest11666-21expr23:55:163
202909986,1cyclictest10381-21cat19:50:133
202899986,1cyclictest22063-21cut00:15:132
202899986,1cyclictest1954-21sh19:35:132
202899986,1cyclictest13018-21cat23:55:232
11959180,0ptp4l0-21swapper/220:07:262
202909975,1cyclictest29507-21expr20:25:143
202909975,1cyclictest24554-21taskset23:18:393
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional