You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 14:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot3s.osadl.org (updated Mon Jul 13, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591640,42ptp4l0-21swapper/119:09:491
119591610,31ptp4l0-21swapper/019:08:310
2511625247,3sleep20-21swapper/219:05:212
2608425046,2sleep30-21swapper/319:09:393
27712470,0sleep20-21swapper/222:25:132
34542460,0sleep00-21swapper/000:25:220
262822450,0sleep20-21swapper/200:10:142
24572430,0sleep20-21swapper/223:25:142
119591320,0ptp4l0-21swapper/021:15:160
119591260,0ptp4l0-21swapper/019:55:180
119591220,1ptp4l18664-21apt-get20:55:130
119591200,0ptp4l0-21swapper/121:55:231
119591180,0ptp4l0-21swapper/022:40:220
119591170,2ptp4l0-21swapper/222:13:392
119591170,0ptp4l0-21swapper/123:35:251
119591160,2ptp4l4719-21apt-get23:30:130
119591160,1ptp4l226-21systemd-journal00:25:010
119591160,0ptp4l0-21swapper/123:21:431
119591160,0ptp4l0-21swapper/120:10:181
119591160,0ptp4l0-21swapper/120:05:131
119591160,0ptp4l0-21swapper/119:50:131
119591160,0ptp4l0-21swapper/023:55:240
119591160,0ptp4l0-21swapper/019:40:120
119591160,0ptp4l0-21swapper/000:30:190
119591150,1ptp4l6924-21snmp_o5powerctl21:30:220
119591150,1ptp4l685-21ls23:20:170
119591150,1ptp4l6164-21ls22:30:190
119591150,1ptp4l32701-21kworker/1:000:30:191
119591150,1ptp4l32480-21diskstats22:20:151
119591150,1ptp4l31495-21snmp_o5powerctl19:15:230
119591150,1ptp4l27483-21ls00:10:200
119591150,1ptp4l26845-21apt-get21:10:131
119591150,1ptp4l22831-21ls23:00:240
119591150,1ptp4l20164-21ls22:55:241
119591150,1ptp4l19710-21ls21:55:180
119591150,1ptp4l19565-21ntp_states23:55:211
119591150,1ptp4l17357-21ls23:50:230
119591150,1ptp4l16919-21ntp_states23:50:201
119591150,1ptp4l15421-21snmp_o5powerctl19:45:220
119591150,1ptp4l15039-21snmp_o5powerctl20:45:241
119591150,1ptp4l14344-21snmp_o5powerctl23:45:221
119591150,1ptp4l1313-21ls23:20:242
119591150,0ptp4l0-21swapper/123:40:131
119591150,0ptp4l0-21swapper/123:15:121
119591150,0ptp4l0-21swapper/122:45:111
119591150,0ptp4l0-21swapper/122:35:141
119591150,0ptp4l0-21swapper/122:30:121
119591150,0ptp4l0-21swapper/121:20:121
119591150,0ptp4l0-21swapper/120:40:141
119591150,0ptp4l0-21swapper/119:55:141
119591150,0ptp4l0-21swapper/100:15:231
119591150,0ptp4l0-21swapper/022:50:110
119591150,0ptp4l0-21swapper/021:41:090
119591150,0ptp4l0-21swapper/019:10:130
119591140,1ptp4l8117-21aten2.4-expect20:35:131
119591140,1ptp4l748-21/usr/sbin/munin00:20:221
119591140,1ptp4l4524-21cat23:30:020
119591140,1ptp4l4434-21snmp_o5powerctl20:25:210
119591140,1ptp4l32054-21sendmail20:20:020
119591140,1ptp4l30387-21sed21:15:181
119591140,1ptp4l28518-21snmp_o5powerctl21:10:220
119591140,1ptp4l28445-21unixbench_singl22:10:250
119591140,1ptp4l24621-21cstates21:05:160
119591140,1ptp4l24129-21df_inode23:05:130
119591140,1ptp4l23786-21/usr/sbin/munin22:05:190
119591140,1ptp4l23718-21users20:00:231
119591140,1ptp4l22076-21ls20:00:120
119591140,1ptp4l21386-21cat23:00:131
119591140,1ptp4l21203-21cut22:00:121
119591140,1ptp4l18070-21snmp_o5powerctl19:50:230
119591140,1ptp4l17369-21snmp_o5powerctl22:50:221
119591140,1ptp4l14164-21sed21:45:180
119591140,1ptp4l13679-21irqrtprio23:45:180
119591140,1ptp4l13130-21aten_r9power_po22:45:130
119591140,1ptp4l1238-21head21:20:210
119591140,0ptp4l0-21swapper/123:31:141
119591140,0ptp4l0-21swapper/123:06:511
119591140,0ptp4l0-21swapper/122:42:151
119591140,0ptp4l0-21swapper/122:25:181
119591140,0ptp4l0-21swapper/122:15:191
119591140,0ptp4l0-21swapper/122:13:531
119591140,0ptp4l0-21swapper/121:50:231
119591140,0ptp4l0-21swapper/121:48:371
119591140,0ptp4l0-21swapper/121:42:301
119591140,0ptp4l0-21swapper/121:00:021
119591140,0ptp4l0-21swapper/120:59:191
119591140,0ptp4l0-21swapper/120:25:221
119591140,0ptp4l0-21swapper/120:20:011
119591140,0ptp4l0-21swapper/120:15:231
119591140,0ptp4l0-21swapper/119:45:111
119591140,0ptp4l0-21swapper/119:30:151
119591140,0ptp4l0-21swapper/119:20:231
119591140,0ptp4l0-21swapper/119:15:221
119591140,0ptp4l0-21swapper/119:10:241
119591140,0ptp4l0-21swapper/100:35:241
119591140,0ptp4l0-21swapper/100:10:251
119591140,0ptp4l0-21swapper/100:00:201
119591140,0ptp4l0-21swapper/023:35:190
119591140,0ptp4l0-21swapper/022:35:010
119591140,0ptp4l0-21swapper/022:20:010
119591140,0ptp4l0-21swapper/022:15:100
119591140,0ptp4l0-21swapper/021:35:220
119591140,0ptp4l0-21swapper/020:45:140
119591140,0ptp4l0-21swapper/020:30:130
119591140,0ptp4l0-21swapper/020:20:230
119591140,0ptp4l0-21swapper/020:10:230
119591140,0ptp4l0-21swapper/019:30:010
119591130,1ptp4l16845-21irqrtprio21:50:180
119591130,0ptp4l7974-21apt-get19:35:010
119591130,0ptp4l28154-21strings21:10:202
119591130,0ptp4l0-21swapper/223:50:192
119591130,0ptp4l0-21swapper/223:15:142
119591130,0ptp4l0-21swapper/223:00:192
119591130,0ptp4l0-21swapper/222:50:182
119591130,0ptp4l0-21swapper/222:40:212
119591130,0ptp4l0-21swapper/221:00:092
119591130,0ptp4l0-21swapper/219:50:182
119591130,0ptp4l0-21swapper/123:25:141
119591130,0ptp4l0-21swapper/123:10:161
119591130,0ptp4l0-21swapper/122:05:131
119591130,0ptp4l0-21swapper/121:35:151
119591130,0ptp4l0-21swapper/121:30:151
119591130,0ptp4l0-21swapper/121:25:151
119591130,0ptp4l0-21swapper/121:05:151
119591130,0ptp4l0-21swapper/120:50:201
119591130,0ptp4l0-21swapper/120:30:141
119591130,0ptp4l0-21swapper/119:40:141
119591130,0ptp4l0-21swapper/119:35:181
119591130,0ptp4l0-21swapper/119:25:131
119591130,0ptp4l0-21swapper/100:25:151
119591130,0ptp4l0-21swapper/100:05:161
119591130,0ptp4l0-21swapper/023:40:160
119591130,0ptp4l0-21swapper/023:15:020
119591130,0ptp4l0-21swapper/023:15:010
119591130,0ptp4l0-21swapper/022:55:140
119591130,0ptp4l0-21swapper/022:25:150
119591130,0ptp4l0-21swapper/022:00:130
119591130,0ptp4l0-21swapper/021:25:130
119591130,0ptp4l0-21swapper/021:00:110
119591130,0ptp4l0-21swapper/020:50:160
119591130,0ptp4l0-21swapper/020:40:180
119591130,0ptp4l0-21swapper/020:35:170
119591130,0ptp4l0-21swapper/020:05:170
119591130,0ptp4l0-21swapper/019:25:130
119591130,0ptp4l0-21swapper/019:20:150
119591130,0ptp4l0-21swapper/000:35:130
119591130,0ptp4l0-21swapper/000:15:140
119591130,0ptp4l0-21swapper/000:05:140
119591130,0ptp4l0-21swapper/000:00:160
119591120,0ptp4l0-21swapper/321:45:193
119591120,0ptp4l0-21swapper/221:50:202
119591120,0ptp4l0-21swapper/221:30:132
119591120,0ptp4l0-21swapper/220:50:012
119591120,0ptp4l0-21swapper/220:12:082
119591120,0ptp4l0-21swapper/219:31:532
119591120,0ptp4l0-21swapper/200:20:182
119591110,0ptp4l0-21swapper/223:55:252
119591110,0ptp4l0-21swapper/219:35:222
2637399102,4cyclictest0-21swapper/219:45:102
119591100,0ptp4l0-21swapper/222:05:142
119591100,0ptp4l0-21swapper/220:59:232
119591100,0ptp4l0-21swapper/219:13:252
119591100,0ptp4l0-21swapper/200:37:152
263749997,1cyclictest30676-21tr23:15:213
263749997,1cyclictest29418-21uniq00:15:153
263749997,1cyclictest22466-21pmu-power23:00:213
263749997,1cyclictest19037-21expr20:55:153
263749997,1cyclictest18317-21unixbench_multi19:50:243
263749997,1cyclictest16602sleep322:20:573
263749997,1cyclictest15645-21taskset20:48:333
263749997,1cyclictest121552sleep323:41:373
263749990,8cyclictest10835-21cut20:40:133
263739997,1cyclictest9733-21taskset23:39:472
263739997,1cyclictest8148-21expr22:35:152
263739997,1cyclictest76832sleep220:33:272
263739997,1cyclictest5581-21sed22:30:172
263739997,1cyclictest30219-21cat19:15:132
263739997,1cyclictest20790-21expr19:55:252
263739997,1cyclictest206552sleep221:56:592
263739997,1cyclictest14131-21tr21:45:182
263739997,1cyclictest13016-21expr23:45:142
263739997,1cyclictest10805-21aten_r9power_po20:40:142
263739990,8cyclictest25177-21tr21:05:192
11959190,0ptp4l0-21swapper/223:42:162
11959190,0ptp4l0-21swapper/222:56:332
11959190,0ptp4l0-21swapper/221:35:012
11959190,0ptp4l0-21swapper/221:26:262
11959190,0ptp4l0-21swapper/221:23:402
11959190,0ptp4l0-21swapper/220:47:532
11959190,0ptp4l0-21swapper/220:20:262
11959190,0ptp4l0-21swapper/219:23:382
11959190,0ptp4l0-21swapper/200:34:562
11959190,0ptp4l0-21swapper/200:19:242
11959190,0ptp4l0-21swapper/200:08:022
263749986,1cyclictest9453-21cut19:35:173
263749986,1cyclictest9231-21tr22:35:213
263749986,1cyclictest8349-21expr21:35:153
263749986,1cyclictest8039-21basename20:35:133
263749986,1cyclictest7431-21aten_r9power_po23:35:143
263749986,1cyclictest7400-21taskset21:31:523
263749986,1cyclictest7376-21expr00:35:143
263749986,1cyclictest6648-21cat22:30:253
263749986,1cyclictest6388-21snmp_o5powerctl23:30:243
263749986,1cyclictest567-21forks20:20:153
263749986,1cyclictest4646-21egrep00:30:153
263749986,1cyclictest3679-21tr19:25:163
263749986,1cyclictest3407-21grep20:25:143
263749986,1cyclictest32226-21sh21:20:143
263749986,1cyclictest31621-21sh00:20:123
263749986,1cyclictest30815-21cat20:15:193
263749986,1cyclictest30504-21sh19:15:163
263749986,1cyclictest29842-21if_enp0s31f622:15:143
263749986,1cyclictest29558-21aten_r9power_po21:15:143
263749986,1cyclictest28714-21chrt22:13:103
263749986,1cyclictest28488-21taskset23:12:183
263749986,1cyclictest28229-21cat19:10:243
263749986,1cyclictest27830-21if_err_enp2s020:10:173
263749986,1cyclictest27283-21expr21:10:143
263749986,1cyclictest26542-21tr00:10:163
263749986,1cyclictest24946-21fw_packets20:05:173
263749986,1cyclictest24697-21cat00:05:183
263749986,1cyclictest24669-21diskstats21:05:163
263749986,1cyclictest24653-21cut23:05:173
263749986,1cyclictest2432-21wc22:25:123
263749986,1cyclictest24130-21expr22:05:133
263749986,1cyclictest22984-21expr20:00:173
263749986,1cyclictest22838-21snmp_o5powerctl22:00:223
263749986,1cyclictest22494-21cut21:00:153
263749986,1cyclictest21961-21irqstats00:00:193
263749986,1cyclictest2141-21basename23:25:143
263749986,1cyclictest2108-21expr00:25:143
263749986,1cyclictest20822-21cat19:55:243
263749986,1cyclictest18707-21tr21:55:143
263749986,1cyclictest18564-21expr22:55:143
263749986,1cyclictest18277-21aten_r9power_vo23:55:143
263749986,1cyclictest182742sleep320:53:193
263749986,1cyclictest16464-21grep21:50:163
263749986,1cyclictest154932sleep323:50:053
263749986,1cyclictest14954-21chrt19:45:173
263749986,1cyclictest13620-21tr23:45:183
263749986,1cyclictest13306-21tr22:45:143
263749986,1cyclictest1193-21sed19:20:183
263749986,1cyclictest11225-21cat22:40:173
263749986,1cyclictest11069-21chrt19:40:083
263749986,1cyclictest10629-21stty21:40:133
263749986,1cyclictest1037-21cut23:20:203
263749980,4cyclictest0-21swapper/320:30:133
263739986,1cyclictest9566-21tr20:35:212
263739986,1cyclictest5385-21tail23:30:162
263739986,1cyclictest458-21tr22:20:192
263739986,1cyclictest4571-21sed19:25:242
263739986,1cyclictest39352sleep200:26:272
263739986,1cyclictest30398-21sed21:15:172
263739986,1cyclictest30096-21cut22:15:152
263739986,1cyclictest24543-21cat20:05:152
263739986,1cyclictest22135-21cat20:00:112
263739986,1cyclictest21127-21seq22:00:062
263739986,1cyclictest13232-21chrt19:41:402
263739986,1cyclictest11931-21ntpq21:40:202
263739983,1cyclictest0-21swapper/200:00:142
11959180,0ptp4l0-21swapper/223:10:072
11959180,0ptp4l0-21swapper/223:05:082
11959180,0ptp4l0-21swapper/222:45:322
11959180,0ptp4l0-21swapper/220:25:122
11959180,0ptp4l0-21swapper/220:15:342
263749975,1cyclictest6821-21cat19:30:183
263749975,1cyclictest3283-21tr21:25:163
263749975,1cyclictest17493-21cat22:50:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional