You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 03:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Fri Aug 28, 2026 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591700,42ptp4l0-21swapper/019:05:490
119591610,39ptp4l0-21swapper/119:05:501
2196525447,5sleep30-21swapper/319:08:383
2206125245,2sleep20-21swapper/219:09:542
141612470,1sleep114164-21missed_timers23:55:191
29592400,0sleep00-21swapper/019:30:270
119591300,0ptp4l0-21swapper/021:50:240
119591270,0ptp4l0-21swapper/100:04:331
22331992119,1cyclictest25-21ksoftirqd/121:45:001
119591190,6ptp4l29947-21awk19:20:191
22331991818,0cyclictest25-21ksoftirqd/122:25:161
119591180,0ptp4l0-21swapper/123:30:191
119591180,0ptp4l0-21swapper/119:30:311
119591180,0ptp4l0-21swapper/019:50:150
119591170,0ptp4l0-21swapper/122:20:251
119591170,0ptp4l0-21swapper/119:10:181
119591160,4ptp4l27749-21grep19:15:231
119591160,2ptp4l24148-21run-parts20:10:200
119591160,2ptp4l21406-21/usr/sbin/munin23:10:131
119591160,1ptp4l8688-21apt-get20:45:130
119591160,1ptp4l8076-21apt-get21:45:010
119591160,1ptp4l32025-21apt-get00:30:110
119591160,1ptp4l2400-21snmp_o5powerctl20:30:221
119591160,1ptp4l22378-21apt-get19:10:120
119591160,1ptp4l10486-21ls19:45:171
119591160,1ptp4l0-21swapper/020:55:160
119591160,0ptp4l0-21swapper/123:40:321
119591160,0ptp4l0-21swapper/122:30:131
119591160,0ptp4l0-21swapper/019:25:120
119591150,2ptp4l6988-21grep22:40:210
119591150,1ptp4l8457-21df_inode22:45:151
119591150,1ptp4l3926-21snmp_o5powerctl00:35:231
119591150,1ptp4l30874-21snmp_o5powerctl23:25:211
119591150,1ptp4l29498-21aten2.4-expect00:25:130
119591150,1ptp4l26046-21apt-get00:20:020
119591150,1ptp4l25275-21ntp_states23:15:200
119591150,1ptp4l23459-21snmp_o5powerctl22:10:211
119591150,1ptp4l226-21systemd-journal22:00:150
119591150,1ptp4l20802-21snmp_o5powerctl22:05:231
119591150,1ptp4l2029-21snmp_o5powerctl21:30:221
119591150,1ptp4l18977-21cat20:00:231
119591150,1ptp4l17240-21apt-get20:00:120
119591150,1ptp4l17239-21snmp_o5powerctl00:00:230
119591150,1ptp4l14949-21snmp_o5powerctl22:55:241
119591150,1ptp4l12542-21ls20:50:171
119591150,1ptp4l12394-21df_inode19:50:141
119591150,1ptp4l12302-21snmp_o5powerctl22:50:220
119591150,1ptp4l0-21swapper/221:51:272
119591150,0ptp4l19888-21apt-get20:05:121
119591150,0ptp4l0-21swapper/123:05:131
119591150,0ptp4l0-21swapper/120:15:221
119591150,0ptp4l0-21swapper/023:25:110
119591150,0ptp4l0-21swapper/022:55:120
119591150,0ptp4l0-21swapper/022:17:410
119591150,0ptp4l0-21swapper/021:55:020
119591150,0ptp4l0-21swapper/020:35:140
119591150,0ptp4l0-21swapper/020:22:470
119591150,0ptp4l0-21swapper/019:35:120
22331991413,0cyclictest25-21ksoftirqd/122:00:141
119591140,1ptp4l7702-21sensors_temp20:40:211
119591140,1ptp4l7339-21snmp_o5powerctl21:40:230
119591140,1ptp4l31806-21strings20:25:170
119591140,1ptp4l26480-21snmp_o5powerctl21:15:231
119591140,1ptp4l2439-21switchtime20:30:220
119591140,1ptp4l24107-21df_inode00:15:130
119591140,1ptp4l20695-21/usr/sbin/munin20:05:160
119591140,1ptp4l19900-21awk00:05:231
119591140,1ptp4l18558-21cstates00:05:130
119591140,1ptp4l17545-21hddtemp_smartct21:00:151
119591140,1ptp4l12547-21ntp_offset21:50:191
119591140,0ptp4l3969-21ls23:35:230
119591140,0ptp4l12445-21irqstats20:50:160
119591140,0ptp4l10442-21ls20:45:231
119591140,0ptp4l0-21swapper/223:35:222
119591140,0ptp4l0-21swapper/223:20:172
119591140,0ptp4l0-21swapper/221:55:202
119591140,0ptp4l0-21swapper/200:20:232
119591140,0ptp4l0-21swapper/123:50:161
119591140,0ptp4l0-21swapper/123:35:221
119591140,0ptp4l0-21swapper/123:20:221
119591140,0ptp4l0-21swapper/123:15:151
119591140,0ptp4l0-21swapper/123:00:231
119591140,0ptp4l0-21swapper/122:36:091
119591140,0ptp4l0-21swapper/121:55:211
119591140,0ptp4l0-21swapper/121:10:181
119591140,0ptp4l0-21swapper/120:55:151
119591140,0ptp4l0-21swapper/120:35:231
119591140,0ptp4l0-21swapper/120:25:161
119591140,0ptp4l0-21swapper/120:20:151
119591140,0ptp4l0-21swapper/120:10:231
119591140,0ptp4l0-21swapper/119:55:141
119591140,0ptp4l0-21swapper/119:25:131
119591140,0ptp4l0-21swapper/100:30:221
119591140,0ptp4l0-21swapper/100:25:131
119591140,0ptp4l0-21swapper/100:20:131
119591140,0ptp4l0-21swapper/100:10:161
119591140,0ptp4l0-21swapper/023:30:220
119591140,0ptp4l0-21swapper/023:20:210
119591140,0ptp4l0-21swapper/023:10:180
119591140,0ptp4l0-21swapper/022:25:270
119591140,0ptp4l0-21swapper/021:35:150
119591140,0ptp4l0-21swapper/021:10:170
119591140,0ptp4l0-21swapper/021:05:230
119591140,0ptp4l0-21swapper/021:00:220
119591140,0ptp4l0-21swapper/020:15:370
119591140,0ptp4l0-21swapper/019:55:180
119591140,0ptp4l0-21swapper/019:20:130
119591140,0ptp4l0-21swapper/019:15:220
119591130,1ptp4l4091-21kworker/u8:219:35:141
119591130,0ptp4l2748-21awk00:35:150
119591130,0ptp4l0-21swapper/223:55:232
119591130,0ptp4l0-21swapper/223:50:012
119591130,0ptp4l0-21swapper/223:45:212
119591130,0ptp4l0-21swapper/222:00:252
119591130,0ptp4l0-21swapper/221:30:212
119591130,0ptp4l0-21swapper/221:15:232
119591130,0ptp4l0-21swapper/220:55:192
119591130,0ptp4l0-21swapper/220:40:182
119591130,0ptp4l0-21swapper/220:10:212
119591130,0ptp4l0-21swapper/220:05:252
119591130,0ptp4l0-21swapper/220:00:212
119591130,0ptp4l0-21swapper/219:55:212
119591130,0ptp4l0-21swapper/219:40:202
119591130,0ptp4l0-21swapper/219:25:222
119591130,0ptp4l0-21swapper/123:45:131
119591130,0ptp4l0-21swapper/122:50:131
119591130,0ptp4l0-21swapper/122:40:131
119591130,0ptp4l0-21swapper/122:15:161
119591130,0ptp4l0-21swapper/121:45:021
119591130,0ptp4l0-21swapper/121:35:161
119591130,0ptp4l0-21swapper/121:25:151
119591130,0ptp4l0-21swapper/121:25:151
119591130,0ptp4l0-21swapper/121:20:141
119591130,0ptp4l0-21swapper/121:05:151
119591130,0ptp4l0-21swapper/119:40:151
119591130,0ptp4l0-21swapper/100:15:131
119591130,0ptp4l0-21swapper/023:55:170
119591130,0ptp4l0-21swapper/023:50:140
119591130,0ptp4l0-21swapper/023:45:150
119591130,0ptp4l0-21swapper/023:40:120
119591130,0ptp4l0-21swapper/023:05:140
119591130,0ptp4l0-21swapper/023:00:130
119591130,0ptp4l0-21swapper/022:45:140
119591130,0ptp4l0-21swapper/022:35:140
119591130,0ptp4l0-21swapper/022:30:150
119591130,0ptp4l0-21swapper/022:20:160
119591130,0ptp4l0-21swapper/022:10:130
119591130,0ptp4l0-21swapper/022:05:160
119591130,0ptp4l0-21swapper/021:30:130
119591130,0ptp4l0-21swapper/021:25:130
119591130,0ptp4l0-21swapper/021:25:130
119591130,0ptp4l0-21swapper/021:20:170
119591130,0ptp4l0-21swapper/021:15:160
119591130,0ptp4l0-21swapper/020:40:130
119591130,0ptp4l0-21swapper/019:45:150
119591130,0ptp4l0-21swapper/019:40:140
119591130,0ptp4l0-21swapper/000:10:130
202922120,0sleep30-21swapper/322:05:213
119591120,0ptp4l0-21swapper/222:50:262
119591120,0ptp4l0-21swapper/200:35:242
119591110,0ptp4l0-21swapper/221:45:532
119591110,0ptp4l0-21swapper/221:20:202
119591110,0ptp4l0-21swapper/200:05:112
119591100,0ptp4l0-21swapper/221:04:012
223339997,1cyclictest30203-21expr22:25:173
223339997,1cyclictest27553-21hostname21:20:143
223339997,1cyclictest2481-21expr23:35:143
223339997,1cyclictest24116-21grep21:10:233
223339997,1cyclictest24057-21taskset22:13:273
223339997,1cyclictest1960-21mailstats21:30:213
223339997,1cyclictest1682-21cut20:30:173
223339997,1cyclictest16052-21cut19:55:203
223339997,1cyclictest14565-21cat21:55:163
223329997,1cyclictest78412sleep221:42:142
223329997,1cyclictest6836-21grep22:40:202
223329997,1cyclictest5093-21uname19:35:182
223329997,1cyclictest32300-21grep00:30:132
223329997,1cyclictest31393-21cat22:25:252
223329997,1cyclictest26111-21snmp_o5powerctl22:15:222
223329997,1cyclictest24088-21cat23:15:152
223329997,1cyclictest20734-21wc22:05:232
223329990,8cyclictest2648-21basename22:35:152
11959190,0ptp4l0-21swapper/323:26:173
11959190,0ptp4l0-21swapper/223:40:252
11959190,0ptp4l0-21swapper/223:30:072
11959190,0ptp4l0-21swapper/223:27:222
11959190,0ptp4l0-21swapper/223:10:582
11959190,0ptp4l0-21swapper/223:08:142
11959190,0ptp4l0-21swapper/223:01:412
11959190,0ptp4l0-21swapper/222:56:092
11959190,0ptp4l0-21swapper/222:31:092
11959190,0ptp4l0-21swapper/222:24:532
11959190,0ptp4l0-21swapper/221:38:312
11959190,0ptp4l0-21swapper/221:25:312
11959190,0ptp4l0-21swapper/221:25:312
11959190,0ptp4l0-21swapper/221:10:062
11959190,0ptp4l0-21swapper/221:07:302
11959190,0ptp4l0-21swapper/220:45:112
11959190,0ptp4l0-21swapper/220:39:352
11959190,0ptp4l0-21swapper/220:31:132
11959190,0ptp4l0-21swapper/220:29:582
11959190,0ptp4l0-21swapper/220:23:322
11959190,0ptp4l0-21swapper/220:17:482
11959190,0ptp4l0-21swapper/219:30:242
11959190,0ptp4l0-21swapper/219:20:082
11959190,0ptp4l0-21swapper/219:19:032
11959190,0ptp4l0-21swapper/219:13:532
11959190,0ptp4l0-21swapper/200:27:242
11959190,0ptp4l0-21swapper/200:15:022
11959190,0ptp4l0-21swapper/200:00:462
223339986,1cyclictest9652-21chrt22:45:243
223339986,1cyclictest9500-21expr19:45:133
223339986,1cyclictest9248-21sort21:45:173
223339986,1cyclictest788-21chrt19:26:473
223339986,1cyclictest7658-21grep23:45:133
223339986,1cyclictest6847-21chrt23:41:173
223339986,1cyclictest6845-21cat21:40:173
223339986,1cyclictest6516-21sh20:40:143
223339986,1cyclictest61172sleep319:36:553
223339986,1cyclictest586-21cat23:30:183
223339986,1cyclictest5441-21hostname22:40:133
223339986,1cyclictest4010-21netstat22:35:203
223339986,1cyclictest3581-21tr20:35:153
223339986,1cyclictest30556-21head20:25:123
223339986,1cyclictest3028-21tail21:35:143
223339986,1cyclictest29327-21echo00:25:013
223339986,1cyclictest29059-21grep19:20:143
223339986,1cyclictest28965-21uname20:20:183
223339986,1cyclictest27341-21cut22:20:153
223339986,1cyclictest2720-21df00:35:153
223339986,1cyclictest26678-21aten2.4-expect23:20:133
223339986,1cyclictest26107-21taskset23:17:463
223339986,1cyclictest25932-21tr22:15:203
223339986,1cyclictest25787-21cut21:15:203
223339986,1cyclictest25442-21grep20:15:133
223339986,1cyclictest25375-21basename19:15:023
223339986,1cyclictest25144-21tr00:15:203
223339986,1cyclictest24053-21snmp_o5powerctl19:10:223
223339986,1cyclictest23378-21cat20:10:163
223339986,1cyclictest23198-21sed23:10:233
223339986,1cyclictest21508-21head21:05:253
223339986,1cyclictest21404-21tr20:05:243
223339986,1cyclictest20718-21chrt23:06:413
223339986,1cyclictest18849-21head00:05:153
223339986,1cyclictest18141-21cut22:00:213
223339986,1cyclictest17431-21cat20:00:133
223339986,1cyclictest16958-21basename21:00:133
223339986,1cyclictest16526-21grep23:00:153
223339986,1cyclictest15890-21ls00:00:143
223339986,1cyclictest14419-21tr20:55:133
223339986,1cyclictest14395-21cut22:55:173
223339986,1cyclictest13445-21grep23:55:173
223339986,1cyclictest12732sleep319:30:023
223339986,1cyclictest12261-21cut21:50:183
223339986,1cyclictest1180-21chrt00:30:203
223339986,1cyclictest1179-21cat22:30:183
223339986,1cyclictest11734-21tr22:50:173
223339986,1cyclictest10093-21readlink23:50:013
223339980,7cyclictest286042sleep300:21:083
223329986,1cyclictest9909-21grep19:45:152
223329986,1cyclictest21922-21tr00:10:172
223329986,1cyclictest12289-21sed20:50:162
11959180,0ptp4l0-21swapper/222:45:562
11959180,0ptp4l0-21swapper/222:10:102
11959180,0ptp4l0-21swapper/219:50:032
223339975,1cyclictest6950-21cat19:40:153
223339975,1cyclictest30159-21basename21:25:123
223339975,1cyclictest30159-21basename21:25:123
223339975,1cyclictest21655-21sed00:10:153
223339975,1cyclictest12552-21head19:50:143
223339975,1cyclictest11668-21cat20:50:133
223339964,1cyclictest10092-21open_files20:45:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional