You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-06 - 11:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot3s.osadl.org (updated Sat Jun 06, 2026 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591700,49ptp4l0-21swapper/019:08:060
119591570,40ptp4l0-21swapper/119:08:551
1169925248,2sleep20-21swapper/219:09:172
1142325147,2sleep30-21swapper/319:05:403
291982450,0sleep10-21swapper/123:40:221
119591320,2ptp4l8276-21/usr/sbin/munin21:00:190
119591300,0ptp4l0-21swapper/020:07:270
119591260,0ptp4l0-21swapper/000:36:300
119591220,0ptp4l0-21swapper/023:50:140
119591200,1ptp4l19073-21kernelversion20:20:171
119591190,0ptp4l0-21swapper/120:15:211
119591190,0ptp4l0-21swapper/020:25:130
119591180,0ptp4l0-21swapper/221:45:242
119591180,0ptp4l0-21swapper/122:35:151
119591180,0ptp4l0-21swapper/122:15:211
119591180,0ptp4l0-21swapper/120:40:211
119591170,2ptp4l21194-21snmp_o5powerctl23:25:220
119591170,1ptp4l0-21swapper/019:10:010
119591170,0ptp4l0-21swapper/120:05:191
119591170,0ptp4l0-21swapper/020:45:150
1201799160,14cyclictest0-21swapper/120:45:131
119591160,1ptp4l7347-21apt-get20:00:140
119591160,1ptp4l672-21apt-get22:50:120
119591160,1ptp4l27819-21apt-get22:40:130
119591160,1ptp4l14329-21apt-get22:15:120
119591160,0ptp4l0-21swapper/123:15:211
119591160,0ptp4l0-21swapper/122:00:161
119591160,0ptp4l0-21swapper/122:00:161
119591160,0ptp4l0-21swapper/121:25:141
119591150,1ptp4l7881-21python23:00:200
119591150,1ptp4l7328-21irqstats23:00:151
119591150,1ptp4l5755-21snmp_o5powerctl20:55:231
119591150,1ptp4l4090-21/usr/sbin/munin20:55:130
119591150,1ptp4l32141-21snmp_o5powerctl22:45:230
119591150,1ptp4l25779-21df_inode21:35:120
119591150,1ptp4l2526-21snmp_o5powerctl21:50:210
119591150,1ptp4l24525-21users22:30:250
119591150,1ptp4l22450-21snmp_o5powerctl19:25:221
119591150,1ptp4l20910-21ntpq23:25:191
119591150,1ptp4l15290-21perl21:15:141
119591150,1ptp4l14026-21ntp_states20:10:200
119591150,1ptp4l11804-21diskmemload23:10:121
119591150,1ptp4l10538-21snmp_o5powerctl23:05:200
119591150,0ptp4l0-21swapper/123:35:111
119591150,0ptp4l0-21swapper/122:10:111
119591150,0ptp4l0-21swapper/121:45:131
119591150,0ptp4l0-21swapper/121:30:281
119591150,0ptp4l0-21swapper/022:35:120
119591150,0ptp4l0-21swapper/021:48:120
119591150,0ptp4l0-21swapper/000:10:120
119591140,2ptp4l0-21swapper/119:15:181
119591140,1ptp4l564-21cut19:45:201
119591140,1ptp4l4674-21snmp_o5powerctl23:55:221
119591140,1ptp4l4632-21mailstats23:55:210
119591140,1ptp4l28346-21/usr/sbin/munin23:40:160
119591140,1ptp4l2820-21ntp_states20:50:180
119591140,1ptp4l26254-21unixbench-2d00:35:221
119591140,1ptp4l26157-21/usr/sbin/munin21:35:151
119591140,1ptp4l24102-21df_inode19:30:140
119591140,1ptp4l23724-21sh19:30:131
119591140,1ptp4l2359-21tune2fs19:50:140
119591140,1ptp4l22101-21cstates00:30:131
119591140,1ptp4l22062-21/usr/sbin/munin20:25:201
119591140,1ptp4l20900-21ps21:25:160
119591140,1ptp4l19308-21ntp_kernel_err20:20:180
119591140,1ptp4l14626-21which19:15:001
119591140,1ptp4l13889-21sort21:10:230
119591140,1ptp4l13238-21latency21:10:181
119591140,1ptp4l10075-21grep21:05:151
119591140,0ptp4l0-21swapper/200:10:202
119591140,0ptp4l0-21swapper/123:50:181
119591140,0ptp4l0-21swapper/123:45:131
119591140,0ptp4l0-21swapper/123:30:141
119591140,0ptp4l0-21swapper/123:20:141
119591140,0ptp4l0-21swapper/123:05:271
119591140,0ptp4l0-21swapper/122:55:131
119591140,0ptp4l0-21swapper/122:30:141
119591140,0ptp4l0-21swapper/122:25:011
119591140,0ptp4l0-21swapper/122:20:151
119591140,0ptp4l0-21swapper/122:05:161
119591140,0ptp4l0-21swapper/121:50:141
119591140,0ptp4l0-21swapper/121:41:271
119591140,0ptp4l0-21swapper/120:50:201
119591140,0ptp4l0-21swapper/120:30:211
119591140,0ptp4l0-21swapper/100:25:201
119591140,0ptp4l0-21swapper/100:10:191
119591140,0ptp4l0-21swapper/023:35:210
119591140,0ptp4l0-21swapper/022:56:590
119591140,0ptp4l0-21swapper/022:10:150
119591140,0ptp4l0-21swapper/021:20:220
119591140,0ptp4l0-21swapper/021:15:130
119591140,0ptp4l0-21swapper/020:35:120
119591140,0ptp4l0-21swapper/019:40:110
119591140,0ptp4l0-21swapper/019:20:140
119591140,0ptp4l0-21swapper/000:05:210
12018991313,0cyclictest0-21swapper/223:16:392
119591130,0ptp4l9058-21gltestperf00:05:151
119591130,0ptp4l0-21swapper/223:20:182
119591130,0ptp4l0-21swapper/223:05:192
119591130,0ptp4l0-21swapper/222:10:192
119591130,0ptp4l0-21swapper/221:25:232
119591130,0ptp4l0-21swapper/220:45:182
119591130,0ptp4l0-21swapper/220:20:132
119591130,0ptp4l0-21swapper/220:10:132
119591130,0ptp4l0-21swapper/220:05:252
119591130,0ptp4l0-21swapper/200:00:212
119591130,0ptp4l0-21swapper/122:50:131
119591130,0ptp4l0-21swapper/122:45:131
119591130,0ptp4l0-21swapper/122:40:171
119591130,0ptp4l0-21swapper/121:55:131
119591130,0ptp4l0-21swapper/121:20:141
119591130,0ptp4l0-21swapper/121:00:121
119591130,0ptp4l0-21swapper/120:35:151
119591130,0ptp4l0-21swapper/120:10:171
119591130,0ptp4l0-21swapper/120:00:161
119591130,0ptp4l0-21swapper/119:55:141
119591130,0ptp4l0-21swapper/119:50:131
119591130,0ptp4l0-21swapper/119:40:161
119591130,0ptp4l0-21swapper/119:35:131
119591130,0ptp4l0-21swapper/119:20:131
119591130,0ptp4l0-21swapper/100:20:121
119591130,0ptp4l0-21swapper/100:15:131
119591130,0ptp4l0-21swapper/100:00:121
119591130,0ptp4l0-21swapper/023:45:150
119591130,0ptp4l0-21swapper/023:30:150
119591130,0ptp4l0-21swapper/023:20:160
119591130,0ptp4l0-21swapper/023:15:150
119591130,0ptp4l0-21swapper/023:10:130
119591130,0ptp4l0-21swapper/022:25:010
119591130,0ptp4l0-21swapper/022:20:120
119591130,0ptp4l0-21swapper/022:05:140
119591130,0ptp4l0-21swapper/022:00:150
119591130,0ptp4l0-21swapper/022:00:140
119591130,0ptp4l0-21swapper/021:55:130
119591130,0ptp4l0-21swapper/021:40:120
119591130,0ptp4l0-21swapper/021:30:130
119591130,0ptp4l0-21swapper/021:05:140
119591130,0ptp4l0-21swapper/020:40:130
119591130,0ptp4l0-21swapper/020:30:130
119591130,0ptp4l0-21swapper/020:15:130
119591130,0ptp4l0-21swapper/019:55:130
119591130,0ptp4l0-21swapper/019:45:150
119591130,0ptp4l0-21swapper/019:35:120
119591130,0ptp4l0-21swapper/019:25:140
119591130,0ptp4l0-21swapper/019:15:130
119591130,0ptp4l0-21swapper/000:30:130
119591130,0ptp4l0-21swapper/000:25:130
119591130,0ptp4l0-21swapper/000:20:130
119591130,0ptp4l0-21swapper/000:15:130
119591130,0ptp4l0-21swapper/000:00:140
211902120,0sleep20-21swapper/223:25:202
119591120,0ptp4l0-21swapper/223:30:012
119591120,0ptp4l0-21swapper/221:20:012
119591120,0ptp4l0-21swapper/220:15:172
119591120,0ptp4l0-21swapper/219:35:152
119591120,0ptp4l0-21swapper/219:15:212
119591110,0ptp4l0-21swapper/223:56:222
119591110,0ptp4l0-21swapper/220:00:232
119591100,1ptp4l0-21swapper/221:42:422
119591100,0ptp4l0-21swapper/222:16:292
119591100,0ptp4l0-21swapper/220:58:292
119591100,0ptp4l0-21swapper/219:59:562
120199997,1cyclictest4998-21cut20:55:173
120199997,1cyclictest30406-21cat21:45:013
120199997,1cyclictest2501-21taskset23:51:453
120199997,1cyclictest24982-21cat20:30:223
120199997,1cyclictest19380-21head21:20:253
120199997,1cyclictest14745-21expr22:15:143
120199997,1cyclictest12232-21grep00:10:163
120199997,1cyclictest10510-21kernelversion21:05:163
120199996,2cyclictest25307-21snmp_o5powerctl19:30:223
120199996,2cyclictest230952sleep319:29:103
120199990,8cyclictest4212-21chrt19:55:003
120199990,8cyclictest18504-21head22:20:203
120199990,0cyclictest0-21swapper/300:30:133
120189997,1cyclictest93612sleep221:05:052
120189997,1cyclictest29646-21taskset23:42:042
120189997,1cyclictest24801-21chrt21:31:432
120189997,1cyclictest24664-21expr00:35:142
120189997,1cyclictest23887-21grep19:30:142
120189997,1cyclictest23602-21cat20:30:132
120189997,1cyclictest2052-21expr19:50:142
120189997,1cyclictest18469-21expr19:20:132
120189991,4cyclictest0-21swapper/223:00:172
11959190,0ptp4l0-21swapper/223:51:392
11959190,0ptp4l0-21swapper/223:48:332
11959190,0ptp4l0-21swapper/223:13:482
11959190,0ptp4l0-21swapper/222:56:062
11959190,0ptp4l0-21swapper/222:50:572
11959190,0ptp4l0-21swapper/222:46:492
11959190,0ptp4l0-21swapper/222:40:352
11959190,0ptp4l0-21swapper/222:38:022
11959190,0ptp4l0-21swapper/222:30:282
11959190,0ptp4l0-21swapper/222:05:122
11959190,0ptp4l0-21swapper/221:56:162
11959190,0ptp4l0-21swapper/221:54:042
11959190,0ptp4l0-21swapper/221:15:062
11959190,0ptp4l0-21swapper/221:13:552
11959190,0ptp4l0-21swapper/220:40:012
11959190,0ptp4l0-21swapper/220:36:282
11959190,0ptp4l0-21swapper/220:26:112
11959190,0ptp4l0-21swapper/219:26:092
11959190,0ptp4l0-21swapper/219:10:592
11959190,0ptp4l0-21swapper/200:30:322
11959190,0ptp4l0-21swapper/200:17:152
120199986,1cyclictest9826-21ntp_states00:05:183
120199986,1cyclictest974-21egrep21:50:133
120199986,1cyclictest9022-21snmp_o5powerctl20:00:233
120199986,1cyclictest7099-21awk23:00:163
120199986,1cyclictest6816-21aten_r9power_po21:00:123
120199986,1cyclictest6442-21tail22:00:133
120199986,1cyclictest6442-21tail22:00:123
120199986,1cyclictest5714-21cut00:00:123
120199986,1cyclictest567-21cat20:45:223
120199986,1cyclictest5255-21grep19:55:153
120199986,1cyclictest4840-21netstat21:55:173
120199986,1cyclictest4627-21basename23:55:213
120199986,1cyclictest3781-21grep22:55:143
120199986,1cyclictest32556-21taskset22:46:093
120199986,1cyclictest32085-21fschecks_count19:45:153
120199986,1cyclictest31176-21grep21:45:163
120199986,1cyclictest30673-21sort23:45:153
120199986,1cyclictest29994-21grep20:40:203
120199986,1cyclictest28012-21cat22:40:143
120199986,1cyclictest27487-21basename23:40:123
120199986,1cyclictest273792sleep321:35:523
120199986,1cyclictest27191-21chrt22:35:293
120199986,1cyclictest26851-21sed20:35:173
120199986,1cyclictest26549-21expr19:35:123
120199986,1cyclictest25273-21expr23:35:123
120199986,1cyclictest24699-21sshd22:32:293
120199986,1cyclictest24574-21tr00:35:133
120199986,1cyclictest23820-21cat21:30:183
120199986,1cyclictest22278-21aten_r9power_vo23:30:143
120199986,1cyclictest22130-21chrt22:28:303
120199986,1cyclictest21722-21taskset23:27:323
120199986,1cyclictest21170-21sort21:25:173
120199986,1cyclictest20641-21basename20:25:123
120199986,1cyclictest20097-21taskset20:21:433
120199986,1cyclictest20070-21cut00:25:173
120199986,1cyclictest18700-21sort19:20:143
120199986,1cyclictest18632-21taskset00:22:413
120199986,1cyclictest17349-21sh23:20:153
120199986,1cyclictest16440-21cut19:15:173
120199986,1cyclictest1516-21if_err_enp0s31f22:50:163
120199986,1cyclictest14905-21tr21:15:143
120199986,1cyclictest14414-21tr23:15:143
120199986,1cyclictest1440-21taskset20:50:113
120199986,1cyclictest14368-21grep00:15:163
120199986,1cyclictest14106-21chrt19:10:333
120199986,1cyclictest13719-21taskset22:10:273
120199986,1cyclictest12862-21grub-editenv23:10:173
120199986,1cyclictest12835-21cat20:10:143
120199986,1cyclictest12443-21expr21:10:143
120199986,1cyclictest10853-21chrt22:05:233
120199986,1cyclictest10366-21expr20:05:143
120199980,7cyclictest29316-21ls19:40:123
120199980,7cyclictest15830-21cut20:15:153
120189986,1cyclictest84882sleep200:05:132
120189986,1cyclictest7636-21wc22:00:182
120189986,1cyclictest7636-21wc22:00:172
120189986,1cyclictest6813-21stty21:00:122
120189986,1cyclictest31550-21chrt19:45:032
120189986,1cyclictest289122sleep219:40:092
120189986,1cyclictest25752-21expr21:35:132
120189986,1cyclictest25653-21cat23:35:152
120189986,1cyclictest20270-21expr22:25:132
120189986,1cyclictest19331-21grep00:25:132
120189986,1cyclictest18540-21chrt00:21:302
120189986,1cyclictest17535-21tune2fs22:20:142
11959180,0ptp4l0-21swapper/220:50:312
120199964,1cyclictest10082-21load23:05:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional