You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 07:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Mon Mar 30, 2026 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591640,44ptp4l0-21swapper/019:05:380
119591640,39ptp4l0-21swapper/119:09:391
1667225144,2sleep20-21swapper/219:05:122
1888825042,6sleep30-21swapper/319:07:243
119591200,0ptp4l0-21swapper/123:40:221
119591200,0ptp4l0-21swapper/120:30:231
119591190,0ptp4l0-21swapper/121:45:011
119591180,0ptp4l0-21swapper/100:30:211
119591180,0ptp4l0-21swapper/023:10:170
119591160,3ptp4l12198-21if_enp0s31f620:55:151
119591160,0ptp4l0-21swapper/020:45:170
119591160,0ptp4l0-21swapper/020:35:120
119591150,1ptp4l6341-21smartctl22:45:170
119591150,1ptp4l3659-21apt-get19:40:142
119591150,1ptp4l28751-21snmp_o5powerctl23:25:220
119591150,1ptp4l27135-21snmp_o5powerctl19:20:211
119591150,1ptp4l2681-21latency_hist22:40:011
119591150,1ptp4l26271-21snmp_o5powerctl22:20:210
119591150,1ptp4l26106-21snmp_o5powerctl23:20:221
119591150,1ptp4l22928-21df20:15:142
119591150,1ptp4l21489-21ls20:10:241
119591150,1ptp4l21275-21snmp_o5powerctl20:10:220
119591150,1ptp4l20580-21snmp_o5powerctl23:10:211
119591150,1ptp4l1784-21ls23:35:231
119591150,1ptp4l17757-21snmp_o5powerctl00:05:230
119591150,1ptp4l17416-21df_inode20:05:130
119591150,1ptp4l17053-21cut21:05:130
119591150,1ptp4l10129-21snmp_o5powerctl21:50:230
119591150,0ptp4l0-21swapper/122:55:101
119591150,0ptp4l0-21swapper/122:50:111
119591150,0ptp4l0-21swapper/022:10:120
119591150,0ptp4l0-21swapper/021:55:120
119591150,0ptp4l0-21swapper/019:45:360
119591150,0ptp4l0-21swapper/000:21:300
119591140,1ptp4l9514-21smartctl20:50:151
119591140,1ptp4l6892-21grep23:45:200
119591140,1ptp4l6217-21date19:45:010
119591140,1ptp4l32038-21ls19:30:151
119591140,1ptp4l31649-21ps19:30:140
119591140,1ptp4l30284-21sed20:30:000
119591140,1ptp4l29950-21diskstats00:30:150
119591140,1ptp4l28842-21users00:25:242
119591140,1ptp4l28382-21irqrtprio21:25:201
119591140,1ptp4l2803-21aten_r9power_cu22:40:122
119591140,1ptp4l26151-21hddtemp_smartct19:20:140
119591140,1ptp4l25814-21hddtemp_smartct20:20:150
119591140,1ptp4l23351-21sort23:15:242
119591140,1ptp4l21984-21df_inode00:15:161
119591140,1ptp4l19550-21hddtemp_smartct00:10:160
119591140,1ptp4l17533-21phc2sys-jitter00:05:201
119591140,1ptp4l16467-21cpuspeed_turbos23:05:130
119591140,1ptp4l1579-21fschecks_time19:35:151
119591140,1ptp4l13411-21/usr/sbin/munin00:00:190
119591140,1ptp4l12912-21ls19:55:151
119591140,1ptp4l12335-21cat20:55:160
119591140,1ptp4l12275-21netstat22:55:172
119591140,1ptp4l12245-21/usr/sbin/munin23:55:220
119591140,1ptp4l10362-21ntpq19:50:180
119591140,1ptp4l1004-21ps22:35:160
119591140,0ptp4l28495-21cstates19:25:150
119591140,0ptp4l0-21swapper/219:50:122
119591140,0ptp4l0-21swapper/219:25:202
119591140,0ptp4l0-21swapper/123:55:231
119591140,0ptp4l0-21swapper/123:25:181
119591140,0ptp4l0-21swapper/122:45:011
119591140,0ptp4l0-21swapper/122:40:231
119591140,0ptp4l0-21swapper/122:30:221
119591140,0ptp4l0-21swapper/122:25:251
119591140,0ptp4l0-21swapper/122:20:031
119591140,0ptp4l0-21swapper/122:10:191
119591140,0ptp4l0-21swapper/122:00:191
119591140,0ptp4l0-21swapper/121:50:121
119591140,0ptp4l0-21swapper/121:35:191
119591140,0ptp4l0-21swapper/121:30:141
119591140,0ptp4l0-21swapper/121:10:231
119591140,0ptp4l0-21swapper/121:10:221
119591140,0ptp4l0-21swapper/121:05:151
119591140,0ptp4l0-21swapper/121:00:221
119591140,0ptp4l0-21swapper/120:40:151
119591140,0ptp4l0-21swapper/120:25:221
119591140,0ptp4l0-21swapper/120:21:011
119591140,0ptp4l0-21swapper/120:18:381
119591140,0ptp4l0-21swapper/119:50:171
119591140,0ptp4l0-21swapper/119:45:131
119591140,0ptp4l0-21swapper/119:42:241
119591140,0ptp4l0-21swapper/119:15:121
119591140,0ptp4l0-21swapper/119:10:181
119591140,0ptp4l0-21swapper/100:29:071
119591140,0ptp4l0-21swapper/100:20:201
119591140,0ptp4l0-21swapper/100:02:471
119591140,0ptp4l0-21swapper/023:40:200
119591140,0ptp4l0-21swapper/023:20:030
119591140,0ptp4l0-21swapper/023:15:540
119591140,0ptp4l0-21swapper/023:00:200
119591140,0ptp4l0-21swapper/022:15:230
119591140,0ptp4l0-21swapper/022:00:170
119591140,0ptp4l0-21swapper/021:30:120
119591140,0ptp4l0-21swapper/021:25:160
119591140,0ptp4l0-21swapper/021:15:230
119591140,0ptp4l0-21swapper/020:50:110
119591140,0ptp4l0-21swapper/020:15:020
119591140,0ptp4l0-21swapper/020:00:120
119591140,0ptp4l0-21swapper/019:35:220
119591140,0ptp4l0-21swapper/019:15:220
119591130,1ptp4l836-21/usr/sbin/munin23:35:170
119591130,1ptp4l33-21ksoftirqd/221:45:252
119591130,0ptp4l0-21swapper/223:00:162
119591130,0ptp4l0-21swapper/222:15:252
119591130,0ptp4l0-21swapper/221:10:162
119591130,0ptp4l0-21swapper/221:10:152
119591130,0ptp4l0-21swapper/220:55:202
119591130,0ptp4l0-21swapper/220:35:182
119591130,0ptp4l0-21swapper/123:50:141
119591130,0ptp4l0-21swapper/123:45:181
119591130,0ptp4l0-21swapper/123:30:131
119591130,0ptp4l0-21swapper/123:15:151
119591130,0ptp4l0-21swapper/123:05:141
119591130,0ptp4l0-21swapper/123:00:111
119591130,0ptp4l0-21swapper/122:15:171
119591130,0ptp4l0-21swapper/122:05:121
119591130,0ptp4l0-21swapper/121:55:131
119591130,0ptp4l0-21swapper/121:40:131
119591130,0ptp4l0-21swapper/121:20:141
119591130,0ptp4l0-21swapper/121:15:171
119591130,0ptp4l0-21swapper/120:45:001
119591130,0ptp4l0-21swapper/120:35:151
119591130,0ptp4l0-21swapper/120:05:111
119591130,0ptp4l0-21swapper/120:00:141
119591130,0ptp4l0-21swapper/119:25:151
119591130,0ptp4l0-21swapper/100:35:231
119591130,0ptp4l0-21swapper/100:10:171
119591130,0ptp4l0-21swapper/023:50:160
119591130,0ptp4l0-21swapper/023:30:140
119591130,0ptp4l0-21swapper/022:55:140
119591130,0ptp4l0-21swapper/022:50:120
119591130,0ptp4l0-21swapper/022:40:160
119591130,0ptp4l0-21swapper/022:30:150
119591130,0ptp4l0-21swapper/022:25:140
119591130,0ptp4l0-21swapper/022:05:160
119591130,0ptp4l0-21swapper/021:45:150
119591130,0ptp4l0-21swapper/021:40:000
119591130,0ptp4l0-21swapper/021:35:110
119591130,0ptp4l0-21swapper/021:20:130
119591130,0ptp4l0-21swapper/021:10:150
119591130,0ptp4l0-21swapper/021:10:150
119591130,0ptp4l0-21swapper/021:00:150
119591130,0ptp4l0-21swapper/020:40:140
119591130,0ptp4l0-21swapper/020:30:160
119591130,0ptp4l0-21swapper/019:55:130
119591130,0ptp4l0-21swapper/019:10:020
119591130,0ptp4l0-21swapper/000:35:160
119591130,0ptp4l0-21swapper/000:25:140
119591130,0ptp4l0-21swapper/000:15:190
119591120,0ptp4l0-21swapper/221:35:112
119591120,0ptp4l0-21swapper/220:45:122
119591120,0ptp4l0-21swapper/220:40:122
119591120,0ptp4l0-21swapper/219:35:162
119591100,2ptp4l0-21swapper/221:44:442
119591100,1ptp4l0-21swapper/219:18:572
119591100,0ptp4l0-21swapper/223:56:132
119591100,0ptp4l0-21swapper/223:24:482
119591100,0ptp4l0-21swapper/222:50:232
119591100,0ptp4l0-21swapper/219:21:392
193549997,1cyclictest8289-21taskset20:46:263
193549997,1cyclictest53772sleep320:40:443
193549997,1cyclictest302052sleep319:26:143
193549997,1cyclictest29819-21chrt20:25:343
193549997,1cyclictest26595-21wc00:25:023
193549997,1cyclictest24784-21seq20:19:073
193549997,1cyclictest23023-21cut22:15:203
193549997,1cyclictest2192-21taskset23:37:563
193549997,1cyclictest21151-21awk19:10:233
193549997,1cyclictest13464-21chrt21:59:423
193549997,1cyclictest11460-21basename20:55:123
193549996,3cyclictest1389-21ntpd19:47:373
193549990,8cyclictest7480-21snmp_o5powerctl21:45:233
193549990,8cyclictest17403-21expr20:05:133
193539997,1cyclictest7489-21cat22:45:242
193539997,1cyclictest32030-21taskset22:31:452
193539997,1cyclictest21058-21head22:10:232
193539990,8cyclictest12238-21cut21:55:182
11959190,0ptp4l0-21swapper/223:50:072
11959190,0ptp4l0-21swapper/223:47:012
11959190,0ptp4l0-21swapper/223:37:022
11959190,0ptp4l0-21swapper/223:31:212
11959190,0ptp4l0-21swapper/223:28:542
11959190,0ptp4l0-21swapper/223:13:302
11959190,0ptp4l0-21swapper/223:09:392
11959190,0ptp4l0-21swapper/222:20:032
11959190,0ptp4l0-21swapper/222:08:372
11959190,0ptp4l0-21swapper/221:30:542
11959190,0ptp4l0-21swapper/221:20:372
11959190,0ptp4l0-21swapper/221:17:542
11959190,0ptp4l0-21swapper/221:09:532
11959190,0ptp4l0-21swapper/220:51:282
11959190,0ptp4l0-21swapper/220:30:302
11959190,0ptp4l0-21swapper/220:20:252
11959190,0ptp4l0-21swapper/220:15:012
11959190,0ptp4l0-21swapper/220:03:222
11959190,0ptp4l0-21swapper/219:58:192
11959190,0ptp4l0-21swapper/219:45:262
11959190,0ptp4l0-21swapper/219:30:282
11959190,0ptp4l0-21swapper/200:36:322
11959190,0ptp4l0-21swapper/200:13:342
11959190,0ptp4l0-21swapper/200:06:052
11959190,0ptp4l0-21swapper/200:00:282
193549987,1cyclictest15063-21mailstats00:00:193
193549986,1cyclictest9946-21cut22:50:193
193549986,1cyclictest9793-21cat19:50:163
193549986,1cyclictest8671-21expr21:50:143
193549986,1cyclictest8024-21chrt22:49:503
193549986,1cyclictest7442-21taskset23:47:103
193549986,1cyclictest4681-21seq23:40:403
193549986,1cyclictest3790-21grep19:40:153
193549986,1cyclictest3307-21ls21:40:133
193549986,1cyclictest32605-21taskset20:32:203
193549986,1cyclictest324992sleep322:35:053
193549986,1cyclictest3210-21cat22:40:143
193549986,1cyclictest31723-21snmp_o5powerctl21:30:213
193549986,1cyclictest30717-21chrt19:30:053
193549986,1cyclictest30043-21expr23:30:133
193549986,1cyclictest29914-21cat00:30:153
193549986,1cyclictest29898-21basename22:30:133
193549986,1cyclictest29102-21cat22:25:243
193549986,1cyclictest28885-21chrt00:25:463
193549986,1cyclictest27970-21cut23:25:173
193549986,1cyclictest27754-21expr21:25:183
193549986,1cyclictest26860-21chrt21:21:193
193549986,1cyclictest26440-21chrt20:20:183
193549986,1cyclictest25640-21cpuspeed_turbos19:20:123
193549986,1cyclictest24937-21ls22:20:133
193549986,1cyclictest24612-21egrep23:20:143
193549986,1cyclictest2367-21cat19:35:193
193549986,1cyclictest22710-21gltestperf19:15:033
193549986,1cyclictest22453-21expr21:15:153
193549986,1cyclictest21987-21cat23:15:133
193549986,1cyclictest21490-21basename00:15:143
193549986,1cyclictest21120-21seq22:10:403
193549986,1cyclictest20865-21cat20:10:183
193549986,1cyclictest20827-21ntpq21:10:203
193549986,1cyclictest20827-21ntpq21:10:203
193549986,1cyclictest19158-21tr23:10:133
193549986,1cyclictest19149-21cat00:10:153
193549986,1cyclictest1786-21grep21:35:193
193549986,1cyclictest1759-21taskset00:35:423
193549986,1cyclictest16972-21cat21:05:133
193549986,1cyclictest16681-21grep22:05:143
193549986,1cyclictest16456-21tr23:05:133
193549986,1cyclictest16414-21expr00:05:153
193549986,1cyclictest163262sleep321:02:263
193549986,1cyclictest16301-21head20:00:243
193549986,1cyclictest16164-21cut23:05:013
193549986,1cyclictest1592-21tr20:35:163
193549986,1cyclictest15002-21sed22:00:183
193549986,1cyclictest12531-21cut19:55:153
193549986,1cyclictest11740-21mii-tool22:55:143
193549986,1cyclictest10595-21aten_r9power_en23:55:123
193549986,1cyclictest10571-21date20:50:213
193539986,1cyclictest779-21sed22:35:152
193539986,1cyclictest29550-21aten_r9power_po00:30:132
193539986,1cyclictest28273-21uniq20:25:142
193539986,1cyclictest27952-21sort21:25:192
193539986,1cyclictest2593-21chrt23:40:062
193539986,1cyclictest22347-21cat00:15:172
193539986,1cyclictest158242sleep222:00:452
193539986,1cyclictest14583-21ls21:00:162
11959180,0ptp4l0-21swapper/222:25:072
11959180,0ptp4l0-21swapper/221:50:102
11959180,0ptp4l0-21swapper/220:05:072
11959180,0ptp4l0-21swapper/219:10:032
11959180,0ptp4l0-21swapper/200:20:052
193549975,1cyclictest8431-21fschecks_count23:50:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional