You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 12:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot3s.osadl.org (updated Tue Apr 07, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591630,32ptp4l0-21swapper/019:05:110
119591630,31ptp4l0-21swapper/119:09:311
805825854,2sleep30-21swapper/319:08:593
119591570,39ptp4l0-21swapper/219:08:112
46752480,0sleep10-21swapper/121:00:181
242802470,0sleep10-21swapper/120:35:191
8497992524,1cyclictest9-21ksoftirqd/000:40:010
119591250,0ptp4l0-21swapper/021:55:140
119591180,0ptp4l0-21swapper/121:25:161
119591170,0ptp4l0-21swapper/122:05:181
119591160,1ptp4l8747-21apt-get22:10:132
119591160,1ptp4l8153-21apt-get23:10:122
119591160,1ptp4l32432-21ls21:50:221
119591160,1ptp4l24662-21apt-get22:40:110
119591160,1ptp4l16711-21apt-get22:25:120
119591160,1ptp4l14812-21apt-get20:20:131
119591160,1ptp4l13061-21snmp_o5powerctl22:15:201
119591160,0ptp4l0-21swapper/121:35:101
119591160,0ptp4l0-21swapper/120:25:231
119591160,0ptp4l0-21swapper/022:20:200
119591160,0ptp4l0-21swapper/000:15:220
119591150,1ptp4l9543-21ntp_states23:10:181
119591150,1ptp4l8306-21snmp_o5powerctl20:05:221
119591150,1ptp4l5972-21df23:05:141
119591150,1ptp4l4499-21users00:00:241
119591150,1ptp4l3510-21sed23:00:151
119591150,1ptp4l30797-21memory23:50:170
119591150,1ptp4l26933-21apt-get23:45:120
119591150,1ptp4l23204-21ls22:35:171
119591150,1ptp4l226-21systemd-journal21:05:010
119591150,1ptp4l20963-21tr21:30:161
119591150,1ptp4l20350-21cat00:30:220
119591150,1ptp4l18534-21apt-get23:30:021
119591150,1ptp4l17542-21snmp_o5powerctl00:25:211
119591150,1ptp4l15635-21munin-run00:25:011
119591150,1ptp4l15616-21wc21:20:191
119591150,1ptp4l15551-21irqstats21:20:190
119591150,1ptp4l15291-21timerandwakeup23:20:220
119591150,1ptp4l13436-21snmp_o5powerctl21:15:220
119591150,1ptp4l11024-21df_inode00:15:141
119591150,1ptp4l10792-21snmp_o5powerctl21:10:211
119591150,1ptp4l10792-21snmp_o5powerctl21:10:211
119591150,0ptp4l0-21swapper/219:55:112
119591150,0ptp4l0-21swapper/122:40:161
119591150,0ptp4l0-21swapper/121:40:231
119591150,0ptp4l0-21swapper/119:20:121
119591150,0ptp4l0-21swapper/119:10:111
119591150,0ptp4l0-21swapper/023:25:230
119591150,0ptp4l0-21swapper/021:30:250
119591150,0ptp4l0-21swapper/020:40:110
119591150,0ptp4l0-21swapper/020:25:110
119591150,0ptp4l0-21swapper/019:30:120
119591150,0ptp4l0-21swapper/019:20:250
8497991412,0cyclictest9-21ksoftirqd/023:30:150
119591140,1ptp4l6571-21diskstats22:05:150
119591140,1ptp4l6078-21grep23:05:150
119591140,1ptp4l4101-21aten_r9power_vo20:00:131
119591140,1ptp4l4087-21sed22:00:150
119591140,1ptp4l3566-21latency_hist21:00:010
119591140,1ptp4l31064-21/usr/sbin/munin23:50:201
119591140,1ptp4l24293-21dpkg23:40:121
119591140,1ptp4l21019-21cat00:35:021
119591140,1ptp4l1912-21gltestperf19:55:140
119591140,1ptp4l14587-21irqstats23:20:161
119591140,1ptp4l11163-21ls23:15:140
119591140,0ptp4l8873-21diskmemload21:45:160
119591140,0ptp4l10565-21ls20:10:170
119591140,0ptp4l0-21swapper/221:45:192
119591140,0ptp4l0-21swapper/220:20:022
119591140,0ptp4l0-21swapper/200:07:412
119591140,0ptp4l0-21swapper/200:00:222
119591140,0ptp4l0-21swapper/123:55:121
119591140,0ptp4l0-21swapper/123:45:131
119591140,0ptp4l0-21swapper/122:55:171
119591140,0ptp4l0-21swapper/122:50:161
119591140,0ptp4l0-21swapper/122:45:181
119591140,0ptp4l0-21swapper/122:30:151
119591140,0ptp4l0-21swapper/122:25:211
119591140,0ptp4l0-21swapper/122:10:151
119591140,0ptp4l0-21swapper/121:55:231
119591140,0ptp4l0-21swapper/121:15:161
119591140,0ptp4l0-21swapper/121:05:171
119591140,0ptp4l0-21swapper/120:55:131
119591140,0ptp4l0-21swapper/120:45:131
119591140,0ptp4l0-21swapper/120:40:011
119591140,0ptp4l0-21swapper/120:30:141
119591140,0ptp4l0-21swapper/120:15:231
119591140,0ptp4l0-21swapper/120:10:211
119591140,0ptp4l0-21swapper/119:55:131
119591140,0ptp4l0-21swapper/119:50:011
119591140,0ptp4l0-21swapper/119:45:211
119591140,0ptp4l0-21swapper/119:40:181
119591140,0ptp4l0-21swapper/119:30:221
119591140,0ptp4l0-21swapper/119:25:181
119591140,0ptp4l0-21swapper/119:15:021
119591140,0ptp4l0-21swapper/100:05:141
119591140,0ptp4l0-21swapper/023:55:220
119591140,0ptp4l0-21swapper/023:12:200
119591140,0ptp4l0-21swapper/023:00:230
119591140,0ptp4l0-21swapper/022:52:120
119591140,0ptp4l0-21swapper/022:45:010
119591140,0ptp4l0-21swapper/022:35:150
119591140,0ptp4l0-21swapper/022:30:140
119591140,0ptp4l0-21swapper/021:50:220
119591140,0ptp4l0-21swapper/021:35:090
119591140,0ptp4l0-21swapper/021:25:150
119591140,0ptp4l0-21swapper/020:30:110
119591140,0ptp4l0-21swapper/020:20:150
119591140,0ptp4l0-21swapper/020:15:130
119591140,0ptp4l0-21swapper/020:00:180
119591140,0ptp4l0-21swapper/019:45:130
119591140,0ptp4l0-21swapper/019:40:220
119591140,0ptp4l0-21swapper/019:35:010
119591140,0ptp4l0-21swapper/019:15:150
119591140,0ptp4l0-21swapper/000:25:030
119591140,0ptp4l0-21swapper/000:05:180
119591130,0ptp4l0-21swapper/223:55:202
119591130,0ptp4l0-21swapper/223:45:182
119591130,0ptp4l0-21swapper/223:30:182
119591130,0ptp4l0-21swapper/222:35:192
119591130,0ptp4l0-21swapper/222:20:152
119591130,0ptp4l0-21swapper/221:55:172
119591130,0ptp4l0-21swapper/221:30:132
119591130,0ptp4l0-21swapper/219:15:232
119591130,0ptp4l0-21swapper/123:35:171
119591130,0ptp4l0-21swapper/123:25:141
119591130,0ptp4l0-21swapper/123:15:131
119591130,0ptp4l0-21swapper/122:20:171
119591130,0ptp4l0-21swapper/122:00:121
119591130,0ptp4l0-21swapper/121:45:111
119591130,0ptp4l0-21swapper/120:50:111
119591130,0ptp4l0-21swapper/119:35:131
119591130,0ptp4l0-21swapper/100:35:141
119591130,0ptp4l0-21swapper/100:10:171
119591130,0ptp4l0-21swapper/023:40:120
119591130,0ptp4l0-21swapper/023:35:140
119591130,0ptp4l0-21swapper/022:55:140
119591130,0ptp4l0-21swapper/022:15:110
119591130,0ptp4l0-21swapper/022:10:140
119591130,0ptp4l0-21swapper/021:40:130
119591130,0ptp4l0-21swapper/021:10:130
119591130,0ptp4l0-21swapper/021:10:130
119591130,0ptp4l0-21swapper/021:05:130
119591130,0ptp4l0-21swapper/020:50:130
119591130,0ptp4l0-21swapper/020:45:140
119591130,0ptp4l0-21swapper/020:35:130
119591130,0ptp4l0-21swapper/020:05:140
119591130,0ptp4l0-21swapper/019:50:130
119591130,0ptp4l0-21swapper/019:25:100
119591130,0ptp4l0-21swapper/019:10:120
119591130,0ptp4l0-21swapper/000:20:130
119591130,0ptp4l0-21swapper/000:10:140
119591130,0ptp4l0-21swapper/000:00:130
119591120,0ptp4l0-21swapper/322:15:153
119591120,0ptp4l0-21swapper/223:25:022
119591120,0ptp4l0-21swapper/221:40:172
119591120,0ptp4l0-21swapper/200:15:182
119591120,0ptp4l0-21swapper/200:10:132
119591110,0ptp4l0-21swapper/223:35:222
119591110,0ptp4l0-21swapper/222:17:232
119591100,1ptp4l8489-21cyclictest20:49:342
119591100,0ptp4l0-21swapper/222:46:552
119591100,0ptp4l0-21swapper/219:49:292
85259997,1cyclictest57592sleep322:04:013
85259997,1cyclictest3363-21seq20:57:403
85259997,1cyclictest31164-21tr20:50:133
85259997,1cyclictest30214-21tr22:50:143
85259997,1cyclictest29639-21taskset22:49:153
85259997,1cyclictest28224-21dpkg19:45:113
85259997,1cyclictest2772-21date23:00:013
85259997,1cyclictest27062-21phc2sys-jitter20:40:193
85259997,1cyclictest26201-21grep19:40:143
85259997,1cyclictest22922-21grep00:35:223
85259997,1cyclictest19597-21chrt19:27:243
85259997,1cyclictest168052sleep321:24:463
85259997,1cyclictest1447-21cut21:55:163
85259997,1cyclictest10246-21tr22:10:213
85259990,8cyclictest5707-21cat21:00:253
85169997,1cyclictest8161-21wc21:05:242
85169997,1cyclictest76062sleep223:06:172
85169997,1cyclictest723-21taskset20:53:052
85169997,1cyclictest24360-21cut23:40:122
85169997,1cyclictest13608-21egrep23:20:122
11959190,1ptp4l0-21swapper/223:01:022
11959190,0ptp4l0-21swapper/320:20:413
11959190,0ptp4l0-21swapper/223:51:342
11959190,0ptp4l0-21swapper/223:15:522
11959190,0ptp4l0-21swapper/222:55:102
11959190,0ptp4l0-21swapper/222:52:042
11959190,0ptp4l0-21swapper/222:41:122
11959190,0ptp4l0-21swapper/222:32:572
11959190,0ptp4l0-21swapper/222:27:232
11959190,0ptp4l0-21swapper/222:06:042
11959190,0ptp4l0-21swapper/222:00:072
11959190,0ptp4l0-21swapper/221:50:532
11959190,0ptp4l0-21swapper/221:36:022
11959190,0ptp4l0-21swapper/221:26:212
11959190,0ptp4l0-21swapper/221:21:202
11959190,0ptp4l0-21swapper/221:16:232
11959190,0ptp4l0-21swapper/221:12:052
11959190,0ptp4l0-21swapper/221:12:052
11959190,0ptp4l0-21swapper/221:01:112
11959190,0ptp4l0-21swapper/220:55:472
11959190,0ptp4l0-21swapper/220:40:372
11959190,0ptp4l0-21swapper/220:35:512
11959190,0ptp4l0-21swapper/220:30:452
11959190,0ptp4l0-21swapper/220:18:432
11959190,0ptp4l0-21swapper/220:11:192
11959190,0ptp4l0-21swapper/220:06:172
11959190,0ptp4l0-21swapper/220:01:212
11959190,0ptp4l0-21swapper/219:51:032
11959190,0ptp4l0-21swapper/219:42:202
11959190,0ptp4l0-21swapper/219:39:492
11959190,0ptp4l0-21swapper/219:32:012
11959190,0ptp4l0-21swapper/219:25:472
11959190,0ptp4l0-21swapper/219:22:372
11959190,0ptp4l0-21swapper/219:14:032
11959190,0ptp4l0-21swapper/200:37:222
11959190,0ptp4l0-21swapper/200:31:052
11959190,0ptp4l0-21swapper/200:25:572
11959190,0ptp4l0-21swapper/200:21:362
85259986,1cyclictest9250-21egrep21:10:133
85259986,1cyclictest9250-21egrep21:10:133
85259986,1cyclictest8905-21tr19:10:123
85259986,1cyclictest8186-21seq00:10:143
85259986,1cyclictest8139-21basename23:10:113
85259986,1cyclictest7631-21sed21:05:183
85259986,1cyclictest6996-21cut22:05:183
85259986,1cyclictest65892sleep320:05:033
85259986,1cyclictest5644-21grep00:05:153
85259986,1cyclictest5474-21chrt23:05:103
85259986,1cyclictest5042-21chrt23:02:223
85259986,1cyclictest4227-21expr20:00:143
85259986,1cyclictest31793-21wc19:50:153
85259986,1cyclictest31244-21python23:50:213
85259986,1cyclictest31058-21fschecks_count21:50:153
85259986,1cyclictest30043-21taskset21:46:533
85259986,1cyclictest28992-21taskset23:45:453
85259986,1cyclictest28400-21egrep20:45:143
85259986,1cyclictest25455-21tr21:40:143
85259986,1cyclictest24913-21tr22:40:123
85259986,1cyclictest2480-21cat19:55:163
85259986,1cyclictest24531-21cut23:40:133
85259986,1cyclictest23515-21tail19:35:153
85259986,1cyclictest22964-21tr20:35:133
85259986,1cyclictest22770-21grep21:35:103
85259986,1cyclictest22233-21cut22:35:143
85259986,1cyclictest22192-21chrt20:31:133
85259986,1cyclictest21687-21stty23:35:133
85259986,1cyclictest21247-21cut21:30:173
85259986,1cyclictest20101-21cut23:30:183
85259986,1cyclictest19798-21ls00:30:163
85259986,1cyclictest193142sleep322:30:033
85259986,1cyclictest17799-21expr20:25:133
85259986,1cyclictest17679-21expr21:25:143
85259986,1cyclictest17047-21expr22:25:143
85259986,1cyclictest16680-21if_enp4s000:25:163
85259986,1cyclictest16517-21cat23:25:143
85259986,1cyclictest15593-21proc_pri22:20:213
85259986,1cyclictest15368-21sed19:20:153
85259986,1cyclictest13613-21expr00:20:133
85259986,1cyclictest13442-21chrt23:20:073
85259986,1cyclictest1322-21tr23:55:203
85259986,1cyclictest12588-21cat21:15:173
85259986,1cyclictest12036-21basename20:15:123
85259986,1cyclictest11572-21ls19:15:023
85259986,1cyclictest11040-21tr23:15:143
85259986,1cyclictest10947-21cat00:15:133
85259986,1cyclictest10627-21ntp_kernel_err20:10:183
85169982,3cyclictest0-21swapper/220:25:122
85259975,1cyclictest2450-21taskset00:00:103
85259975,1cyclictest20761-21wc19:30:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional