You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-23 - 16:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot3s.osadl.org (updated Sat May 23, 2026 12:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591650,31ptp4l0-21swapper/007:05:510
119591610,40ptp4l0-21swapper/107:09:111
1218625349,2sleep30-21swapper/307:05:423
1221025046,2sleep20-21swapper/207:06:012
13612430,0sleep10-21swapper/110:50:141
12781992524,0cyclictest33-21ksoftirqd/212:25:122
119591230,0ptp4l0-21swapper/112:10:181
119591200,0ptp4l0-21swapper/111:45:221
12781991918,1cyclictest33-21ksoftirqd/212:20:012
232302170,0sleep223233-21aten_r9power_cu09:30:112
119591170,0ptp4l0-21swapper/111:03:111
119591170,0ptp4l0-21swapper/010:10:010
119591170,0ptp4l0-21swapper/008:30:180
12779991611,4cyclictest0-21swapper/011:05:130
119591160,1ptp4l31464-21ls07:40:240
119591160,1ptp4l3140-21ls10:50:240
119591160,1ptp4l28370-21apt-get10:40:120
119591160,1ptp4l25867-21apt-get09:35:140
119591160,1ptp4l2331-21snmp_o5powerctl11:50:221
119591160,1ptp4l17517-21snmp_o5powerctl08:15:211
119591160,1ptp4l11631-21snmp_o5powerctl09:05:211
119591160,0ptp4l0-21swapper/109:50:141
119591160,0ptp4l0-21swapper/108:55:181
119591160,0ptp4l0-21swapper/108:04:091
119591160,0ptp4l0-21swapper/011:30:120
1277999158,7cyclictest0-21swapper/012:20:020
1277999158,5cyclictest0-21swapper/011:10:130
119591150,1ptp4l8980-21snmp_o5powerctl09:00:221
119591150,1ptp4l8819-21snmp_o5powerctl10:00:230
119591150,1ptp4l735-21open_files08:45:201
119591150,1ptp4l6907-21snmp_o5powerctl07:55:231
119591150,1ptp4l585-21users10:45:260
119591150,1ptp4l5124-21diskstats08:55:150
119591150,1ptp4l30507-21ntp_states08:40:191
119591150,1ptp4l27378-21snmp_o5powerctl10:35:240
119591150,1ptp4l26626-21snmp_o5powerctl12:35:221
119591150,1ptp4l24878-21cat12:35:011
119591150,1ptp4l24170-21irqstats10:30:181
119591150,1ptp4l24138-21snmp_o5powerctl11:30:221
119591150,1ptp4l20144-21diskstats12:25:141
119591150,1ptp4l19440-21snmp_o5powerctl10:20:241
119591150,1ptp4l19371-21diskstats07:20:161
119591150,1ptp4l18401-21memory11:20:181
119591150,1ptp4l17522-21snmp_o5powerctl08:15:220
119591150,1ptp4l1615-21snmp_o5powerctl07:45:230
119591150,1ptp4l1615-21snmp_o5powerctl07:45:220
119591150,1ptp4l14510-21snmp_o5powerctl07:10:271
119591150,1ptp4l14260-21aten2.4-expect12:15:140
119591150,1ptp4l14214-21ntp_states07:10:250
119591150,1ptp4l1380-21apt-get09:50:010
119591150,1ptp4l11966-21awk08:05:200
119591150,1ptp4l11463-21python10:05:221
119591150,0ptp4l0-21swapper/112:20:011
119591150,0ptp4l0-21swapper/111:42:271
119591150,0ptp4l0-21swapper/111:25:231
119591150,0ptp4l0-21swapper/110:45:241
119591150,0ptp4l0-21swapper/110:35:261
119591150,0ptp4l0-21swapper/110:25:241
119591150,0ptp4l0-21swapper/110:03:501
119591150,0ptp4l0-21swapper/109:40:021
119591150,0ptp4l0-21swapper/108:05:141
119591150,0ptp4l0-21swapper/107:54:551
119591150,0ptp4l0-21swapper/107:40:131
119591150,0ptp4l0-21swapper/107:35:021
119591150,0ptp4l0-21swapper/011:35:130
119591150,0ptp4l0-21swapper/009:30:120
119591150,0ptp4l0-21swapper/009:20:130
119591150,0ptp4l0-21swapper/007:25:080
12779991414,0cyclictest0-21swapper/011:48:250
12779991412,1cyclictest0-21swapper/012:10:100
119591140,1ptp4l7929-21grep09:00:150
119591140,1ptp4l6338-21irqrtprio07:55:180
119591140,1ptp4l3659-21mailstats08:50:210
119591140,1ptp4l3659-21mailstats08:50:210
119591140,1ptp4l30037-21snmp_o5powerctl10:40:221
119591140,1ptp4l26904-21cstates08:35:161
119591140,1ptp4l26045-21sort07:30:220
119591140,1ptp4l23391-21/usr/sbin/munin09:30:131
119591140,1ptp4l20833-21cut11:25:180
119591140,1ptp4l19821-21grep08:20:171
119591140,0ptp4l27664-21ls08:35:200
119591140,0ptp4l25854-21snmp_o5powerctl07:30:221
119591140,0ptp4l15320-21aten2.4-expect09:15:131
119591140,0ptp4l0-21swapper/209:05:212
119591140,0ptp4l0-21swapper/112:05:131
119591140,0ptp4l0-21swapper/111:55:011
119591140,0ptp4l0-21swapper/111:35:151
119591140,0ptp4l0-21swapper/111:17:561
119591140,0ptp4l0-21swapper/111:10:381
119591140,0ptp4l0-21swapper/111:05:141
119591140,0ptp4l0-21swapper/110:55:231
119591140,0ptp4l0-21swapper/110:10:241
119591140,0ptp4l0-21swapper/109:55:201
119591140,0ptp4l0-21swapper/109:45:211
119591140,0ptp4l0-21swapper/109:35:161
119591140,0ptp4l0-21swapper/109:20:171
119591140,0ptp4l0-21swapper/109:10:161
119591140,0ptp4l0-21swapper/108:50:221
119591140,0ptp4l0-21swapper/108:50:211
119591140,0ptp4l0-21swapper/108:30:151
119591140,0ptp4l0-21swapper/107:45:241
119591140,0ptp4l0-21swapper/107:45:241
119591140,0ptp4l0-21swapper/107:25:221
119591140,0ptp4l0-21swapper/107:15:021
119591140,0ptp4l0-21swapper/012:35:140
119591140,0ptp4l0-21swapper/012:05:230
119591140,0ptp4l0-21swapper/012:00:220
119591140,0ptp4l0-21swapper/012:00:210
119591140,0ptp4l0-21swapper/011:40:220
119591140,0ptp4l0-21swapper/011:20:220
119591140,0ptp4l0-21swapper/011:15:210
119591140,0ptp4l0-21swapper/010:55:240
119591140,0ptp4l0-21swapper/010:15:030
119591140,0ptp4l0-21swapper/009:40:230
119591140,0ptp4l0-21swapper/009:15:180
119591140,0ptp4l0-21swapper/008:25:190
119591140,0ptp4l0-21swapper/008:10:260
119591140,0ptp4l0-21swapper/007:50:140
119591140,0ptp4l0-21swapper/007:35:360
119591140,0ptp4l0-21swapper/007:15:210
1278199139,2cyclictest33-21ksoftirqd/211:15:232
1278199136,1cyclictest33-21ksoftirqd/208:50:122
1278199136,1cyclictest33-21ksoftirqd/208:50:112
119591130,0ptp4l0-21swapper/212:30:182
119591130,0ptp4l0-21swapper/212:15:172
119591130,0ptp4l0-21swapper/211:55:202
119591130,0ptp4l0-21swapper/210:30:242
119591130,0ptp4l0-21swapper/210:15:242
119591130,0ptp4l0-21swapper/210:00:142
119591130,0ptp4l0-21swapper/208:10:152
119591130,0ptp4l0-21swapper/207:40:162
119591130,0ptp4l0-21swapper/112:15:141
119591130,0ptp4l0-21swapper/112:00:131
119591130,0ptp4l0-21swapper/112:00:131
119591130,0ptp4l0-21swapper/110:15:151
119591130,0ptp4l0-21swapper/109:25:141
119591130,0ptp4l0-21swapper/108:25:141
119591130,0ptp4l0-21swapper/108:10:181
119591130,0ptp4l0-21swapper/012:30:160
119591130,0ptp4l0-21swapper/012:25:130
119591130,0ptp4l0-21swapper/011:55:020
119591130,0ptp4l0-21swapper/011:50:130
119591130,0ptp4l0-21swapper/011:00:140
119591130,0ptp4l0-21swapper/010:30:020
119591130,0ptp4l0-21swapper/010:25:140
119591130,0ptp4l0-21swapper/010:20:150
119591130,0ptp4l0-21swapper/010:05:140
119591130,0ptp4l0-21swapper/009:55:140
119591130,0ptp4l0-21swapper/009:45:150
119591130,0ptp4l0-21swapper/009:25:130
119591130,0ptp4l0-21swapper/009:10:130
119591130,0ptp4l0-21swapper/009:05:140
119591130,0ptp4l0-21swapper/008:45:120
119591130,0ptp4l0-21swapper/008:40:150
119591130,0ptp4l0-21swapper/008:20:110
119591130,0ptp4l0-21swapper/008:00:010
119591130,0ptp4l0-21swapper/007:20:140
246322120,0sleep30-21swapper/310:30:233
1278199125,3cyclictest33-21ksoftirqd/211:45:122
1278199125,1cyclictest33-21ksoftirqd/208:15:132
1278199122,2cyclictest33-21ksoftirqd/211:00:212
119591120,0ptp4l0-21swapper/209:10:182
119591120,0ptp4l0-21swapper/208:25:142
1278199117,4cyclictest0-21swapper/212:10:112
1278199114,3cyclictest33-21ksoftirqd/210:05:132
1278199114,2cyclictest33-21ksoftirqd/210:45:192
1278199114,1cyclictest33-21ksoftirqd/208:45:222
1278199113,2cyclictest33-21ksoftirqd/209:40:132
1278199113,1cyclictest33-21ksoftirqd/208:20:132
12781991111,0cyclictest33-21ksoftirqd/207:15:152
12781991110,0cyclictest33-21ksoftirqd/209:25:142
119591110,0ptp4l0-21swapper/209:57:072
119591110,0ptp4l0-21swapper/207:32:082
1278199108,0cyclictest33-21ksoftirqd/207:10:272
1278199104,1cyclictest33-21ksoftirqd/209:00:112
1278199103,3cyclictest33-21ksoftirqd/207:50:252
1278199103,2cyclictest33-21ksoftirqd/209:35:182
1278199103,2cyclictest33-21ksoftirqd/208:35:242
1278199103,1cyclictest33-21ksoftirqd/208:30:222
1278199102,2cyclictest33-21ksoftirqd/211:20:132
1278199100,1cyclictest33-21ksoftirqd/207:25:142
119591100,0ptp4l0-21swapper/212:01:082
119591100,0ptp4l0-21swapper/212:01:072
119591100,0ptp4l0-21swapper/211:52:072
119591100,0ptp4l0-21swapper/209:20:022
119591100,0ptp4l0-21swapper/208:02:162
127829997,1cyclictest6427-21tr12:00:143
127829997,1cyclictest6427-21tr12:00:133
127829997,1cyclictest30591-21interrupts07:40:183
127829997,1cyclictest27129-21cut07:35:283
127829997,1cyclictest24139-21snmp_o5powerctl11:30:213
127829997,1cyclictest22737-21uname08:25:213
127829997,1cyclictest16289-21chrt12:16:553
127829997,1cyclictest15209-21aten_r9power_vo10:15:153
127829997,1cyclictest13537-21cut09:10:173
127829997,1cyclictest12393-21cut11:10:153
127829997,1cyclictest12124-21sed12:10:123
127829997,1cyclictest10649-21smartctl09:05:153
127829991,4cyclictest12447-21apt-get10:10:133
127829990,8cyclictest29364-21tr10:40:173
127829990,8cyclictest22016-21chrt12:29:323
127819997,1cyclictest9534-21cat11:05:142
127819997,1cyclictest26433-21cut12:35:202
127819997,1cyclictest20635-21tr10:25:142
127819995,2cyclictest33-21ksoftirqd/211:25:132
127819994,1cyclictest33-21ksoftirqd/211:10:382
127819993,3cyclictest33-21ksoftirqd/207:35:292
127819993,1cyclictest33-21ksoftirqd/210:20:152
127819993,1cyclictest33-21ksoftirqd/209:50:222
127819993,1cyclictest33-21ksoftirqd/209:15:172
127819993,1cyclictest33-21ksoftirqd/208:55:142
127819993,1cyclictest33-21ksoftirqd/207:20:232
127819992,2cyclictest33-21ksoftirqd/210:55:232
127819992,1cyclictest33-21ksoftirqd/210:40:172
127819991,2cyclictest33-21ksoftirqd/212:05:142
127819991,2cyclictest33-21ksoftirqd/211:40:152
127819991,2cyclictest33-21ksoftirqd/209:45:212
11959190,0ptp4l0-21swapper/211:39:072
11959190,0ptp4l0-21swapper/211:31:042
11959190,0ptp4l0-21swapper/210:50:492
11959190,0ptp4l0-21swapper/210:38:162
11959190,0ptp4l0-21swapper/210:10:292
11959190,0ptp4l0-21swapper/208:40:122
11959190,0ptp4l0-21swapper/208:07:072
11959190,0ptp4l0-21swapper/207:56:112
11959190,0ptp4l0-21swapper/207:49:052
11959190,0ptp4l0-21swapper/207:49:052
127829987,1cyclictest29414-21awk11:40:213
127829987,1cyclictest21660-21sed10:25:193
127829986,1cyclictest9831-21tr12:05:173
127829986,1cyclictest8072-21tr11:00:203
127829986,1cyclictest7806-21expr10:00:173
127829986,1cyclictest7590-21chrt07:59:383
127829986,1cyclictest6132-21chrt10:58:053
127829986,1cyclictest5327-21cat11:55:243
127829986,1cyclictest5073-21ls08:55:143
127829986,1cyclictest47962sleep307:52:403
127829986,1cyclictest4453-21taskset09:55:093
127829986,1cyclictest41702sleep309:54:143
127829986,1cyclictest32551-21cat07:45:143
127829986,1cyclictest32551-21cat07:45:143
127829986,1cyclictest32355-21grep08:45:143
127829986,1cyclictest31842-21cat09:45:143
127829986,1cyclictest309832sleep310:45:083
127829986,1cyclictest3093-21cut08:50:173
127829986,1cyclictest3093-21cut08:50:173
127829986,1cyclictest29429-21head09:40:153
127829986,1cyclictest29150-21sh08:40:133
127829986,1cyclictest27908-21taskset10:37:353
127829986,1cyclictest26870-21cat08:35:163
127829986,1cyclictest26538-21head09:35:173
127829986,1cyclictest26405-21needreboot11:35:193
127829986,1cyclictest26295-21netstat12:35:173
127829986,1cyclictest25578-21chrt09:34:383
127829986,1cyclictest24568-21cat08:30:153
127829986,1cyclictest24154-21chrt07:30:103
127829986,1cyclictest22712-21expr12:30:143
127829986,1cyclictest20902-21cat09:25:143
127829986,1cyclictest20704-21cat07:20:243
127829986,1cyclictest20664-21cat11:25:173
127829986,1cyclictest19272-21tr10:20:213
127829986,1cyclictest18739-21grep08:20:123
127829986,1cyclictest1873-21head10:50:163
127829986,1cyclictest18197-21cut09:20:143
127829986,1cyclictest17889-21grep11:20:163
127829986,1cyclictest17361-21head08:15:203
127829986,1cyclictest17153-21grep09:15:243
127829986,1cyclictest17015-21bc12:20:133
127829986,1cyclictest16192-21chrt07:15:093
127829986,1cyclictest15007-21grep11:15:143
127829986,1cyclictest13008-21egrep07:10:193
127829986,1cyclictest11882-21chrt10:06:033
127829986,1cyclictest1118-21seq11:50:143
127829986,1cyclictest10875-21python11:05:223
127829986,1cyclictest10860-21cat08:05:143
127829986,1cyclictest10157-21chrt08:03:183
127829976,1cyclictest8281-21sed09:00:173
127829975,1cyclictest30644-21cut11:45:133
127829975,1cyclictest22402-21if_err_enp4s007:25:183
127829975,1cyclictest13439-21cut08:10:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional