You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 03:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Mon May 18, 2026 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591750,48ptp4l0-21swapper/119:05:211
119591620,31ptp4l0-21swapper/019:06:050
1300915748,4phc2sys0-21swapper/219:06:402
728625248,2sleep30-21swapper/319:08:363
78772450,0sleep30-21swapper/320:10:123
131242420,0sleep10-21swapper/123:20:181
119591320,0ptp4l0-21swapper/100:00:231
7657992624,1cyclictest33-21ksoftirqd/223:45:142
119591190,5ptp4l18836-21snmp_o5powerctl00:30:231
119591180,0ptp4l0-21swapper/121:55:191
119591180,0ptp4l0-21swapper/121:50:251
119591180,0ptp4l0-21swapper/121:35:171
119591180,0ptp4l0-21swapper/119:50:201
119591180,0ptp4l0-21swapper/019:30:210
119591170,0ptp4l0-21swapper/122:30:241
119591170,0ptp4l0-21swapper/122:15:161
119591170,0ptp4l0-21swapper/019:10:210
7656991615,0cyclictest25-21ksoftirqd/120:25:141
119591160,1ptp4l31928-21apt-get20:55:111
119591160,1ptp4l23995-21apt-get20:40:132
119591160,1ptp4l21329-21apt-get20:35:131
119591160,1ptp4l15704-21apt-get21:25:121
119591160,0ptp4l0-21swapper/120:20:011
119591160,0ptp4l0-21swapper/022:15:020
119591160,0ptp4l0-21swapper/021:15:170
119591160,0ptp4l0-21swapper/020:50:130
119591150,1ptp4l7663-21irqstats00:10:170
119591150,1ptp4l7624-21perf20:10:020
119591150,1ptp4l6783-21apt-get23:10:140
119591150,1ptp4l6783-21apt-get23:10:130
119591150,1ptp4l5510-21ls00:05:230
119591150,1ptp4l3731-21/usr/sbin/munin00:05:151
119591150,1ptp4l31336-21snmp_o5powerctl19:50:230
119591150,1ptp4l28212-21apt-get23:50:131
119591150,1ptp4l27240-21snmp_o5powerctl23:45:240
119591150,1ptp4l23982-21hddtemp_smartct22:40:160
119591150,1ptp4l22638-21users22:35:211
119591150,1ptp4l21090-21ls00:35:181
119591150,1ptp4l16533-21users00:25:231
119591150,1ptp4l15786-21users19:20:250
119591150,1ptp4l13091-21missed_timers00:20:180
119591150,1ptp4l12577-21df23:20:160
119591150,0ptp4l0-21swapper/123:55:111
119591150,0ptp4l0-21swapper/123:13:491
119591150,0ptp4l0-21swapper/123:13:491
119591150,0ptp4l0-21swapper/122:50:181
119591150,0ptp4l0-21swapper/122:05:211
119591150,0ptp4l0-21swapper/121:20:141
119591150,0ptp4l0-21swapper/120:10:121
119591150,0ptp4l0-21swapper/100:24:251
119591150,0ptp4l0-21swapper/100:10:131
119591150,0ptp4l0-21swapper/022:55:580
119591150,0ptp4l0-21swapper/022:46:490
119591150,0ptp4l0-21swapper/022:37:420
119591150,0ptp4l0-21swapper/021:50:130
119591150,0ptp4l0-21swapper/020:00:230
305952140,0sleep00-21swapper/023:54:560
119591140,1ptp4l9915-21diskstats23:15:161
119591140,1ptp4l9171-21/usr/sbin/munin00:15:160
119591140,1ptp4l7456-21/usr/sbin/munin21:10:250
119591140,1ptp4l5804-21snmp_o5powerctl23:05:241
119591140,1ptp4l3691-21cat22:00:241
119591140,1ptp4l32329-21aten_r9power_cu19:55:131
119591140,1ptp4l31181-21expr23:55:130
119591140,1ptp4l26779-21df_inode21:45:151
119591140,1ptp4l2661-21diskstats21:00:151
119591140,1ptp4l2632-21latency23:00:190
119591140,1ptp4l25108-21latency_hist23:45:011
119591140,1ptp4l24472-21diskstats20:40:151
119591140,1ptp4l22667-21snmp_o5powerctl21:35:230
119591140,1ptp4l20140-21aten_r9power_vo23:35:131
119591140,1ptp4l20067-21ntp_states20:30:201
119591140,1ptp4l17849-21smartctl00:30:170
119591140,1ptp4l17373-21snmp_o5powerctl21:25:210
119591140,1ptp4l14579-21timerandwakeup21:20:250
119591140,1ptp4l13161-21/usr/sbin/munin22:20:151
119591140,1ptp4l1309-21cpuspeed_turbos00:00:142
119591140,1ptp4l11102-21apt-get19:15:141
119591140,1ptp4l10970-21expr20:15:151
119591140,0ptp4l28313-21snmp_o5powerctl20:45:230
119591140,0ptp4l24968-21snmp_o5powerctl22:40:231
119591140,0ptp4l16188-21snmp_o5powerctl00:25:210
119591140,0ptp4l0-21swapper/123:45:191
119591140,0ptp4l0-21swapper/123:00:241
119591140,0ptp4l0-21swapper/122:55:141
119591140,0ptp4l0-21swapper/122:47:011
119591140,0ptp4l0-21swapper/122:25:211
119591140,0ptp4l0-21swapper/122:10:231
119591140,0ptp4l0-21swapper/121:42:461
119591140,0ptp4l0-21swapper/121:30:181
119591140,0ptp4l0-21swapper/121:15:141
119591140,0ptp4l0-21swapper/121:10:231
119591140,0ptp4l0-21swapper/120:50:231
119591140,0ptp4l0-21swapper/120:05:221
119591140,0ptp4l0-21swapper/120:00:181
119591140,0ptp4l0-21swapper/119:45:231
119591140,0ptp4l0-21swapper/119:30:221
119591140,0ptp4l0-21swapper/119:24:001
119591140,0ptp4l0-21swapper/119:10:211
119591140,0ptp4l0-21swapper/023:32:080
119591140,0ptp4l0-21swapper/022:51:240
119591140,0ptp4l0-21swapper/022:30:150
119591140,0ptp4l0-21swapper/022:25:230
119591140,0ptp4l0-21swapper/022:20:330
119591140,0ptp4l0-21swapper/022:10:090
119591140,0ptp4l0-21swapper/022:05:020
119591140,0ptp4l0-21swapper/022:00:230
119591140,0ptp4l0-21swapper/021:05:140
119591140,0ptp4l0-21swapper/021:01:150
119591140,0ptp4l0-21swapper/020:55:220
119591140,0ptp4l0-21swapper/020:40:230
119591140,0ptp4l0-21swapper/019:55:180
119591140,0ptp4l0-21swapper/019:28:400
119591140,0ptp4l0-21swapper/019:15:010
119591140,0ptp4l0-21swapper/000:35:230
119591140,0ptp4l0-21swapper/000:00:250
119591130,0ptp4l0-21swapper/223:20:212
119591130,0ptp4l0-21swapper/223:00:222
119591130,0ptp4l0-21swapper/222:40:132
119591130,0ptp4l0-21swapper/221:40:212
119591130,0ptp4l0-21swapper/221:05:172
119591130,0ptp4l0-21swapper/220:50:152
119591130,0ptp4l0-21swapper/220:25:012
119591130,0ptp4l0-21swapper/219:25:132
119591130,0ptp4l0-21swapper/200:30:262
119591130,0ptp4l0-21swapper/200:20:192
119591130,0ptp4l0-21swapper/200:10:232
119591130,0ptp4l0-21swapper/123:30:141
119591130,0ptp4l0-21swapper/123:25:151
119591130,0ptp4l0-21swapper/121:05:181
119591130,0ptp4l0-21swapper/120:45:131
119591130,0ptp4l0-21swapper/119:40:151
119591130,0ptp4l0-21swapper/119:35:131
119591130,0ptp4l0-21swapper/119:25:141
119591130,0ptp4l0-21swapper/100:15:151
119591130,0ptp4l0-21swapper/023:40:150
119591130,0ptp4l0-21swapper/023:35:020
119591130,0ptp4l0-21swapper/023:25:140
119591130,0ptp4l0-21swapper/023:15:130
119591130,0ptp4l0-21swapper/023:05:130
119591130,0ptp4l0-21swapper/021:55:140
119591130,0ptp4l0-21swapper/021:45:140
119591130,0ptp4l0-21swapper/021:40:130
119591130,0ptp4l0-21swapper/021:30:190
119591130,0ptp4l0-21swapper/020:35:200
119591130,0ptp4l0-21swapper/020:30:150
119591130,0ptp4l0-21swapper/020:25:130
119591130,0ptp4l0-21swapper/020:20:160
119591130,0ptp4l0-21swapper/020:15:130
119591130,0ptp4l0-21swapper/020:10:130
119591130,0ptp4l0-21swapper/019:45:160
119591130,0ptp4l0-21swapper/019:40:010
119591130,0ptp4l0-21swapper/019:35:150
119591120,0ptp4l0-21swapper/220:45:182
119591120,0ptp4l0-21swapper/220:15:192
765799112,3cyclictest0-21swapper/223:15:132
765799111,6cyclictest0-21swapper/221:30:122
765799110,5cyclictest0-21swapper/200:25:122
765799110,3cyclictest30337-21ntpq21:50:202
765799110,1cyclictest0-21swapper/222:05:122
119591110,0ptp4l0-21swapper/223:08:552
119591110,0ptp4l0-21swapper/222:29:542
119591110,0ptp4l0-21swapper/221:00:172
765799103,5cyclictest22234-21tr00:40:012
119591100,0ptp4l0-21swapper/200:06:172
76589997,1cyclictest6869-21sensors_temp20:05:233
76589997,1cyclictest6256-21taskset23:06:343
76589997,1cyclictest28974-21cat22:50:133
76589997,1cyclictest26682-21chrt19:44:023
76589997,1cyclictest23988-21hostname22:40:163
76589997,1cyclictest1878-21expr23:00:153
76589997,1cyclictest18336-21cut23:30:173
76589997,1cyclictest17470-21grep20:25:203
76589997,1cyclictest15127-21taskset21:23:353
76589997,1cyclictest12340-21taskset22:19:043
76589997,1cyclictest10847-21tr00:15:223
76589990,8cyclictest28197-21chrt22:48:173
76579997,1cyclictest8880-21wc19:10:172
76579997,1cyclictest32085-21cat22:55:162
76579997,1cyclictest14968-21tr23:25:152
76579997,1cyclictest11213-21cut19:15:162
76579994,3cyclictest0-21swapper/220:55:132
76579993,3cyclictest33-21ksoftirqd/220:25:132
76579990,3cyclictest8322-21ps23:10:222
76579990,3cyclictest8322-21ps23:10:212
76579990,1cyclictest33-21ksoftirqd/220:35:242
76579990,1cyclictest0-21swapper/221:55:142
11959190,0ptp4l0-21swapper/320:24:273
11959190,0ptp4l0-21swapper/223:56:152
11959190,0ptp4l0-21swapper/223:50:522
11959190,0ptp4l0-21swapper/223:42:372
11959190,0ptp4l0-21swapper/223:35:072
11959190,0ptp4l0-21swapper/223:33:292
11959190,0ptp4l0-21swapper/222:51:252
11959190,0ptp4l0-21swapper/222:46:372
11959190,0ptp4l0-21swapper/222:37:112
11959190,0ptp4l0-21swapper/222:30:302
11959190,0ptp4l0-21swapper/222:10:492
11959190,0ptp4l0-21swapper/222:04:232
11959190,0ptp4l0-21swapper/221:47:022
11959190,0ptp4l0-21swapper/221:36:552
11959190,0ptp4l0-21swapper/221:25:052
11959190,0ptp4l0-21swapper/221:20:192
11959190,0ptp4l0-21swapper/221:17:192
11959190,0ptp4l0-21swapper/221:10:322
11959190,0ptp4l0-21swapper/220:30:352
11959190,0ptp4l0-21swapper/220:10:032
11959190,0ptp4l0-21swapper/220:05:472
11959190,0ptp4l0-21swapper/220:04:282
11959190,0ptp4l0-21swapper/219:56:452
11959190,0ptp4l0-21swapper/219:48:222
11959190,0ptp4l0-21swapper/219:43:412
11959190,0ptp4l0-21swapper/219:37:302
11959190,0ptp4l0-21swapper/219:31:352
11959190,0ptp4l0-21swapper/219:21:232
11959190,0ptp4l0-21swapper/200:19:052
76589987,1cyclictest2273-21aten2.4-expect21:00:133
76589986,1cyclictest9573-21cat19:10:233
76589986,1cyclictest8543-21latency22:10:183
76589986,1cyclictest7682-21cat21:10:143
76589986,1cyclictest7502-21basename23:10:183
76589986,1cyclictest7502-21basename23:10:173
76589986,1cyclictest6923-21cat00:10:143
76589986,1cyclictest6216-21ntp_states21:05:203
76589986,1cyclictest5978-21cat22:05:183
76589986,1cyclictest46492sleep320:01:073
76589986,1cyclictest447-21cut20:55:163
76589986,1cyclictest32499-21cat19:55:133
76589986,1cyclictest32138-21tr22:55:173
76589986,1cyclictest31637-21basename21:55:133
76589986,1cyclictest31181-21taskset21:52:543
76589986,1cyclictest30953-21aten2.4-expect23:55:123
76589986,1cyclictest30655-21tr19:50:183
76589986,1cyclictest28644-21cut19:45:223
76589986,1cyclictest28434-21tr23:50:153
76589986,1cyclictest278842sleep323:49:063
76589986,1cyclictest2722-21cat22:00:173
76589986,1cyclictest26939-21grep21:45:173
76589986,1cyclictest26822-21tr20:45:143
76589986,1cyclictest26113-21taskset20:41:323
76589986,1cyclictest24112-21expr21:40:133
76589986,1cyclictest23512-21taskset23:40:163
76589986,1cyclictest22689-21ntp_kernel_pll_20:35:203
76589986,1cyclictest216632sleep319:35:053
76589986,1cyclictest21477-21snmp_o5powerctl00:35:213
76589986,1cyclictest21201-21tr21:35:153
76589986,1cyclictest20744-21telnet22:35:113
76589986,1cyclictest20004-21taskset23:35:053
76589986,1cyclictest19922-21cat19:30:163
76589986,1cyclictest19395-21phc2sys22:30:213
76589986,1cyclictest18964-21cat20:30:143
76589986,1cyclictest18551-21chrt19:26:483
76589986,1cyclictest1737-21expr00:00:153
76589986,1cyclictest17145-21acpi00:30:143
76589986,1cyclictest16792-21chrt23:25:323
76589986,1cyclictest15971-21taskset19:22:383
76589986,1cyclictest15855-21sort22:25:153
76589986,1cyclictest14205-21chrt23:21:173
76589986,1cyclictest12980-21chrt00:20:173
76589986,1cyclictest12675-21processes19:15:233
76589986,1cyclictest11297-21if_enp4s020:15:173
76589986,1cyclictest10754-21grep23:15:193
76589986,1cyclictest10647-21cut21:15:203
76589981,2cyclictest0-21swapper/322:20:133
76589980,4cyclictest0-21swapper/321:25:113
76579986,1cyclictest31362-21cat19:50:232
76579986,1cyclictest13802-21chrt22:20:182
76579986,1cyclictest10149-21egrep22:15:152
11959180,0ptp4l0-21swapper/321:32:213
11959180,0ptp4l0-21swapper/320:51:353
11959180,0ptp4l0-21swapper/300:28:213
76589975,1cyclictest3880-21aten2.4-expect00:05:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional