You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 01:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot3s.osadl.org (updated Tue Aug 18, 2026 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591630,40ptp4l0-21swapper/107:05:201
119591620,38ptp4l0-21swapper/007:09:190
1300915245,2phc2sys0-21swapper/207:05:402
191662510,0sleep10-21swapper/108:15:171
1486725144,5sleep30-21swapper/307:08:503
119591210,1ptp4l31437-21apt-get09:40:121
119591190,1ptp4l20646-21/usr/sbin/munin10:20:200
119591190,0ptp4l0-21swapper/110:40:201
119591180,0ptp4l0-21swapper/110:05:171
119591180,0ptp4l0-21swapper/008:10:200
15218991715,1cyclictest25-21ksoftirqd/111:35:181
119591170,0ptp4l0-21swapper/112:30:161
119591170,0ptp4l0-21swapper/109:20:141
119591170,0ptp4l0-21swapper/010:25:240
119591170,0ptp4l0-21swapper/007:20:120
119591160,1ptp4l9682-21apt-get11:00:131
119591160,1ptp4l29027-21apt-get07:35:011
119591160,1ptp4l16660-21snmp_o5powerctl11:10:241
119591160,1ptp4l15263-21apt-get07:10:120
119591160,1ptp4l11727-21apt-get12:05:020
119591160,0ptp4l0-21swapper/011:50:200
119591160,0ptp4l0-21swapper/011:24:560
119591160,0ptp4l0-21swapper/011:01:430
119591150,1ptp4l9346-21snmp_o5powerctl07:55:241
119591150,1ptp4l9282-21/usr/sbin/munin12:00:220
119591150,1ptp4l8878-21ls07:55:190
119591150,1ptp4l8633-21snmp_o5powerctl09:55:232
119591150,1ptp4l8395-21ls11:55:230
119591150,1ptp4l6306-21ls07:50:170
119591150,1ptp4l29975-21ls09:35:181
119591150,1ptp4l29735-21ls11:35:180
119591150,1ptp4l27110-21snmp_o5powerctl12:30:222
119591150,1ptp4l23629-21df_inode11:25:151
119591150,1ptp4l19833-21snmp_o5powerctl09:15:241
119591150,1ptp4l17384-21apt-get11:15:030
119591150,1ptp4l1658-21unixbench_multi07:40:230
119591150,1ptp4l16413-21irqstats09:10:181
119591150,1ptp4l15046-21expr12:10:140
119591150,1ptp4l11299-21snmp_o5powerctl10:00:231
119591150,1ptp4l10696-21ntp_states12:00:201
119591150,1ptp4l10464-21df09:00:140
119591150,1ptp4l10464-21df09:00:140
119591150,0ptp4l0-21swapper/110:55:241
119591150,0ptp4l0-21swapper/110:45:141
119591150,0ptp4l0-21swapper/110:20:131
119591150,0ptp4l0-21swapper/109:50:161
119591150,0ptp4l0-21swapper/108:31:401
119591150,0ptp4l0-21swapper/107:20:111
119591150,0ptp4l0-21swapper/012:15:130
119591150,0ptp4l0-21swapper/010:10:140
119591150,0ptp4l0-21swapper/009:50:110
119591150,0ptp4l0-21swapper/009:35:240
119591150,0ptp4l0-21swapper/009:29:300
119591150,0ptp4l0-21swapper/009:10:130
119591150,0ptp4l0-21swapper/008:30:130
119591150,0ptp4l0-21swapper/007:35:130
119591140,1ptp4l7115-21df_inode11:55:141
119591140,1ptp4l4729-21expr10:50:141
119591140,1ptp4l32180-21aten2.4-expect07:40:121
119591140,1ptp4l321-21snmp_o5powerctl11:40:211
119591140,1ptp4l30593-21snmp_o5powerctl08:35:201
119591140,1ptp4l29710-21cut10:35:180
119591140,1ptp4l29398-21grep10:35:161
119591140,1ptp4l28456-21ls12:35:140
119591140,1ptp4l25631-21awk08:25:270
119591140,1ptp4l25247-21cat07:25:191
119591140,1ptp4l24375-21memory11:25:180
119591140,1ptp4l23839-21fschecks_count10:25:161
119591140,1ptp4l20954-21apt08:20:141
119591140,1ptp4l20858-21basename12:20:160
119591140,1ptp4l18344-21cpuspeed_turbos09:15:160
119591140,1ptp4l1665-21/usr/sbin/munin09:45:121
119591140,1ptp4l11101-21/usr/sbin/munin08:00:171
119591140,1ptp4l10061-21telnet09:00:132
119591140,1ptp4l10061-21telnet09:00:132
119591140,0ptp4l6354-21snmp_o5powerctl08:50:221
119591140,0ptp4l26122-21apt-get09:30:120
119591140,0ptp4l0-21swapper/209:30:232
119591140,0ptp4l0-21swapper/112:35:231
119591140,0ptp4l0-21swapper/112:25:231
119591140,0ptp4l0-21swapper/112:20:121
119591140,0ptp4l0-21swapper/112:10:221
119591140,0ptp4l0-21swapper/111:50:141
119591140,0ptp4l0-21swapper/111:45:181
119591140,0ptp4l0-21swapper/111:30:181
119591140,0ptp4l0-21swapper/111:05:121
119591140,0ptp4l0-21swapper/110:30:241
119591140,0ptp4l0-21swapper/110:10:231
119591140,0ptp4l0-21swapper/109:55:181
119591140,0ptp4l0-21swapper/109:00:121
119591140,0ptp4l0-21swapper/109:00:121
119591140,0ptp4l0-21swapper/108:59:401
119591140,0ptp4l0-21swapper/108:25:141
119591140,0ptp4l0-21swapper/108:05:231
119591140,0ptp4l0-21swapper/107:34:121
119591140,0ptp4l0-21swapper/107:15:171
119591140,0ptp4l0-21swapper/107:10:141
119591140,0ptp4l0-21swapper/012:25:220
119591140,0ptp4l0-21swapper/011:05:210
119591140,0ptp4l0-21swapper/010:55:160
119591140,0ptp4l0-21swapper/010:50:120
119591140,0ptp4l0-21swapper/010:40:250
119591140,0ptp4l0-21swapper/009:20:220
119591140,0ptp4l0-21swapper/008:55:210
119591140,0ptp4l0-21swapper/008:50:220
119591140,0ptp4l0-21swapper/008:40:020
119591140,0ptp4l0-21swapper/008:20:240
119591140,0ptp4l0-21swapper/007:30:230
119591140,0ptp4l0-21swapper/007:25:230
119591140,0ptp4l0-21swapper/007:15:120
119591130,1ptp4l25434-21apt-get12:30:120
119591130,0ptp4l834-21pluginstate08:40:231
119591130,0ptp4l0-21swapper/212:25:172
119591130,0ptp4l0-21swapper/211:50:222
119591130,0ptp4l0-21swapper/211:45:142
119591130,0ptp4l0-21swapper/211:10:122
119591130,0ptp4l0-21swapper/210:45:152
119591130,0ptp4l0-21swapper/210:20:212
119591130,0ptp4l0-21swapper/210:05:212
119591130,0ptp4l0-21swapper/209:45:152
119591130,0ptp4l0-21swapper/209:10:202
119591130,0ptp4l0-21swapper/208:50:162
119591130,0ptp4l0-21swapper/208:30:182
119591130,0ptp4l0-21swapper/208:05:172
119591130,0ptp4l0-21swapper/207:50:122
119591130,0ptp4l0-21swapper/207:35:212
119591130,0ptp4l0-21swapper/112:15:161
119591130,0ptp4l0-21swapper/112:05:171
119591130,0ptp4l0-21swapper/111:20:161
119591130,0ptp4l0-21swapper/111:15:161
119591130,0ptp4l0-21swapper/110:15:131
119591130,0ptp4l0-21swapper/109:30:151
119591130,0ptp4l0-21swapper/109:25:141
119591130,0ptp4l0-21swapper/109:05:161
119591130,0ptp4l0-21swapper/108:45:151
119591130,0ptp4l0-21swapper/108:10:231
119591130,0ptp4l0-21swapper/107:50:141
119591130,0ptp4l0-21swapper/107:45:141
119591130,0ptp4l0-21swapper/011:45:140
119591130,0ptp4l0-21swapper/011:40:130
119591130,0ptp4l0-21swapper/011:30:150
119591130,0ptp4l0-21swapper/011:10:130
119591130,0ptp4l0-21swapper/010:45:160
119591130,0ptp4l0-21swapper/010:30:160
119591130,0ptp4l0-21swapper/010:15:020
119591130,0ptp4l0-21swapper/010:05:140
119591130,0ptp4l0-21swapper/010:00:140
119591130,0ptp4l0-21swapper/009:55:160
119591130,0ptp4l0-21swapper/009:45:140
119591130,0ptp4l0-21swapper/009:40:140
119591130,0ptp4l0-21swapper/009:05:150
119591130,0ptp4l0-21swapper/008:45:150
119591130,0ptp4l0-21swapper/008:35:120
119591130,0ptp4l0-21swapper/008:15:150
119591130,0ptp4l0-21swapper/008:05:140
119591130,0ptp4l0-21swapper/008:00:140
119591130,0ptp4l0-21swapper/007:45:140
1521999128,2cyclictest4202-21grep07:45:232
119591120,0ptp4l0-21swapper/207:10:122
119591110,2ptp4l0-21swapper/209:15:362
119591110,0ptp4l0-21swapper/211:34:562
119591110,0ptp4l0-21swapper/211:19:572
119591110,0ptp4l0-21swapper/208:49:562
119591100,0ptp4l0-21swapper/208:56:522
152209997,1cyclictest6202-21cat10:50:233
152209997,1cyclictest32718-21cat10:40:203
152209997,1cyclictest29758-21strings11:35:193
152209997,1cyclictest28362-21cat07:30:243
152209997,1cyclictest28079-21chrt11:33:313
152209997,1cyclictest28051-21taskset12:35:123
152209997,1cyclictest24742-21sed12:25:243
152209997,1cyclictest20915-21chrt07:18:143
152209997,1cyclictest20141-21taskset10:16:463
152209997,1cyclictest19912-21cut08:15:213
152209997,1cyclictest17672-21cut10:15:013
152209997,1cyclictest17272-21taskset11:13:443
152209990,8cyclictest31128-21basename11:40:123
152199997,1cyclictest8858-21cat07:55:182
152199997,1cyclictest6739-21chrt10:54:482
152199997,1cyclictest31500-21cut10:40:142
152199997,1cyclictest28498-21cut11:35:132
11959190,1ptp4l0-21swapper/209:50:042
11959190,0ptp4l0-21swapper/311:59:573
11959190,0ptp4l0-21swapper/212:35:102
11959190,0ptp4l0-21swapper/212:20:582
11959190,0ptp4l0-21swapper/212:17:352
11959190,0ptp4l0-21swapper/212:10:032
11959190,0ptp4l0-21swapper/212:05:162
11959190,0ptp4l0-21swapper/212:00:362
11959190,0ptp4l0-21swapper/211:55:282
11959190,0ptp4l0-21swapper/211:42:272
11959190,0ptp4l0-21swapper/211:29:582
11959190,0ptp4l0-21swapper/211:21:122
11959190,0ptp4l0-21swapper/211:06:362
11959190,0ptp4l0-21swapper/211:01:262
11959190,0ptp4l0-21swapper/210:57:402
11959190,0ptp4l0-21swapper/210:35:582
11959190,0ptp4l0-21swapper/210:30:382
11959190,0ptp4l0-21swapper/210:26:212
11959190,0ptp4l0-21swapper/210:15:392
11959190,0ptp4l0-21swapper/210:13:382
11959190,0ptp4l0-21swapper/210:00:442
11959190,0ptp4l0-21swapper/209:40:342
11959190,0ptp4l0-21swapper/209:37:122
11959190,0ptp4l0-21swapper/209:22:502
11959190,0ptp4l0-21swapper/209:08:292
11959190,0ptp4l0-21swapper/208:43:002
11959190,0ptp4l0-21swapper/208:39:402
11959190,0ptp4l0-21swapper/208:28:582
11959190,0ptp4l0-21swapper/208:24:302
11959190,0ptp4l0-21swapper/208:10:372
11959190,0ptp4l0-21swapper/208:00:112
11959190,0ptp4l0-21swapper/207:41:212
11959190,0ptp4l0-21swapper/207:20:392
11959190,0ptp4l0-21swapper/207:16:282
152209986,1cyclictest9605-21cat10:00:133
152209986,1cyclictest95262sleep308:57:303
152209986,1cyclictest823-21cat09:40:243
152209986,1cyclictest7776-21if_enp2s010:55:173
152209986,1cyclictest7731-21telnet07:55:143
152209986,1cyclictest74382sleep309:55:153
152209986,1cyclictest6751-21taskset08:50:493
152209986,1cyclictest5888-21grep11:50:243
152209986,1cyclictest5726-21sed07:50:153
152209986,1cyclictest4526-21tr09:50:123
152209986,1cyclictest3670-21grep07:45:193
152209986,1cyclictest3288-21missed_timers08:45:193
152209986,1cyclictest31757-21gdbus08:40:013
152209986,1cyclictest30966-21seq08:35:293
152209986,1cyclictest30545-21cut07:35:183
152209986,1cyclictest30362-21wc09:35:223
152209986,1cyclictest28700-21rm10:35:013
152209986,1cyclictest26974-21cut12:30:203
152209986,1cyclictest26566-21expr08:30:143
152209986,1cyclictest25988-21aten2.4-expect10:30:133
152209986,1cyclictest25509-21grep07:25:223
152209986,1cyclictest25507-21taskset10:27:293
152209986,1cyclictest2524-21ethtool10:45:183
152209986,1cyclictest24318-21taskset09:25:173
152209986,1cyclictest23947-21expr08:25:153
152209986,1cyclictest23687-21taskset07:24:353
152209986,1cyclictest23380-21tr11:25:143
152209986,1cyclictest2261-21seq09:45:153
152209986,1cyclictest21685-21cat09:20:183
152209986,1cyclictest21162-21sort08:20:153
152209986,1cyclictest21006-21cat10:20:143
152209986,1cyclictest20692-21ls11:20:143
152209986,1cyclictest20117-21chrt12:20:113
152209986,1cyclictest198342sleep309:15:243
152209986,1cyclictest19158-21cut11:15:193
152209986,1cyclictest17861-21expr12:15:143
152209986,1cyclictest16915-21seq12:11:083
152209986,1cyclictest15824-21cat08:10:133
152209986,1cyclictest15729-21expr09:10:143
152209986,1cyclictest15327-21aten2.4-expect07:10:133
152209986,1cyclictest15316-21seq08:09:113
152209986,1cyclictest13834-21cat09:05:183
152209986,1cyclictest1352-21chrt11:45:123
152209986,1cyclictest12955-21grep11:05:143
152209986,1cyclictest12876-21sed12:05:163
152209986,1cyclictest12454-21cpuspeed_turbos10:05:143
152209986,1cyclictest11395-21tr08:00:173
152209986,1cyclictest11306-21head12:00:253
152209986,1cyclictest10948-21sed11:00:193
152209986,1cyclictest10436-21expr09:00:133
152209986,1cyclictest10436-21expr09:00:133
152199986,1cyclictest27309-21smartctl07:30:162
152199986,1cyclictest25351-21cat09:25:262
152199986,1cyclictest24680-21cat07:25:162
152199986,1cyclictest18472-21cat08:15:132
152209975,1cyclictest687-21cut07:40:173
152209975,1cyclictest27270-21grep09:30:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional