You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 14:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot3s.osadl.org (updated Mon Jul 06, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119591670,50ptp4l0-21swapper/119:05:271
119591630,43ptp4l0-21swapper/019:09:240
2473625046,2sleep30-21swapper/319:07:273
2342525047,1sleep20-21swapper/219:05:182
230192440,0sleep023017-21if_enp2s023:05:170
119591290,0ptp4l0-21swapper/000:15:230
119591270,0ptp4l0-21swapper/123:14:561
119591270,0ptp4l0-21swapper/122:50:161
119591270,0ptp4l0-21swapper/019:40:160
119591200,2ptp4l0-21swapper/100:25:171
119591190,1ptp4l10925-21ntp_states20:40:200
119591190,0ptp4l0-21swapper/121:30:231
119591190,0ptp4l0-21swapper/100:15:241
119591180,0ptp4l0-21swapper/222:05:152
119591180,0ptp4l0-21swapper/120:45:161
119591180,0ptp4l0-21swapper/120:45:151
119591180,0ptp4l0-21swapper/023:15:150
119591170,0ptp4l0-21swapper/121:25:181
119591170,0ptp4l0-21swapper/119:55:231
119591170,0ptp4l0-21swapper/100:09:211
119591170,0ptp4l0-21swapper/023:00:230
119591170,0ptp4l0-21swapper/022:55:150
119591170,0ptp4l0-21swapper/020:15:200
119591160,1ptp4l761-21snmp_o5powerctl19:20:220
119591160,1ptp4l28471-21apt-get20:15:111
119591160,1ptp4l16568-21apt-get23:55:121
119591160,0ptp4l0-21swapper/221:20:132
119591160,0ptp4l0-21swapper/119:45:101
119591160,0ptp4l0-21swapper/021:25:180
119591160,0ptp4l0-21swapper/000:35:260
119591150,1ptp4l9784-21basename19:40:141
119591150,1ptp4l8552-21snmp_o5powerctl20:35:220
119591150,1ptp4l5366-21snmp_o5powerctl22:30:212
119591150,1ptp4l5062-21ls21:30:170
119591150,1ptp4l4775-21python23:30:221
119591150,1ptp4l350-21snmp_o5powerctl20:20:241
119591150,1ptp4l3252-21python20:25:211
119591150,1ptp4l32028-21ls22:20:171
119591150,1ptp4l2966-21/usr/sbin/munin19:25:171
119591150,1ptp4l29104-21df_inode19:15:131
119591150,1ptp4l27337-21snmp_o5powerctl21:10:221
119591150,1ptp4l2453-21grep23:25:250
119591150,1ptp4l23921-21python23:05:211
119591150,1ptp4l23772-21snmp_o5powerctl00:05:230
119591150,1ptp4l17718-21wc23:55:180
119591150,1ptp4l16502-21latency_hist23:55:010
119591150,1ptp4l16350-21snmp_o5powerctl21:50:231
119591150,1ptp4l16350-21snmp_o5powerctl21:50:221
119591150,1ptp4l13327-21snmp_o5powerctl22:45:210
119591150,1ptp4l11957-21latency_hist20:45:012
119591150,1ptp4l11747-21df23:45:140
119591150,0ptp4l7043-21apt-get19:35:130
119591150,0ptp4l3069-21apt-get00:30:120
119591150,0ptp4l10753-21ls20:40:171
119591150,0ptp4l0-21swapper/221:15:132
119591150,0ptp4l0-21swapper/221:05:222
119591150,0ptp4l0-21swapper/123:18:491
119591150,0ptp4l0-21swapper/122:25:131
119591150,0ptp4l0-21swapper/120:10:131
119591150,0ptp4l0-21swapper/120:00:121
119591150,0ptp4l0-21swapper/119:30:121
119591150,0ptp4l0-21swapper/023:40:030
119591150,0ptp4l0-21swapper/022:40:130
119591150,0ptp4l0-21swapper/022:00:180
119591150,0ptp4l0-21swapper/021:45:120
119591150,0ptp4l0-21swapper/021:40:130
119591150,0ptp4l0-21swapper/020:10:020
119591150,0ptp4l0-21swapper/019:50:120
119591150,0ptp4l0-21swapper/019:10:120
119591140,1ptp4l7153-21cstates21:35:130
119591140,1ptp4l6600-21apt-config21:35:021
119591140,1ptp4l3534-21df00:30:131
119591140,1ptp4l31292-21irqrtprio00:20:191
119591140,1ptp4l30488-21cpuspeed_turbos23:20:150
119591140,1ptp4l30038-21ls22:15:230
119591140,1ptp4l2729-21snmp_o5powerctl22:25:230
119591140,1ptp4l23762-21irqrtprio22:05:191
119591140,1ptp4l22464-21sort23:05:132
119591140,1ptp4l22004-21users22:00:261
119591140,1ptp4l21989-21snmp_o5powerctl20:00:220
119591140,1ptp4l17234-21apt-get20:55:011
119591140,1ptp4l10312-21snmp_o5powerctl23:40:231
119591140,1ptp4l0-21swapper/121:05:171
119591140,0ptp4l26225-21strings23:10:200
119591140,0ptp4l18381-21hwlatdetect20:55:140
119591140,0ptp4l0-21swapper/219:40:232
119591140,0ptp4l0-21swapper/200:20:242
119591140,0ptp4l0-21swapper/200:00:222
119591140,0ptp4l0-21swapper/123:50:181
119591140,0ptp4l0-21swapper/123:45:181
119591140,0ptp4l0-21swapper/123:25:131
119591140,0ptp4l0-21swapper/123:20:271
119591140,0ptp4l0-21swapper/123:00:231
119591140,0ptp4l0-21swapper/122:55:151
119591140,0ptp4l0-21swapper/122:45:181
119591140,0ptp4l0-21swapper/122:40:211
119591140,0ptp4l0-21swapper/122:35:191
119591140,0ptp4l0-21swapper/122:30:141
119591140,0ptp4l0-21swapper/122:16:551
119591140,0ptp4l0-21swapper/122:10:191
119591140,0ptp4l0-21swapper/121:55:171
119591140,0ptp4l0-21swapper/121:40:151
119591140,0ptp4l0-21swapper/121:20:181
119591140,0ptp4l0-21swapper/121:00:131
119591140,0ptp4l0-21swapper/120:50:161
119591140,0ptp4l0-21swapper/120:30:211
119591140,0ptp4l0-21swapper/120:05:141
119591140,0ptp4l0-21swapper/119:10:151
119591140,0ptp4l0-21swapper/100:39:481
119591140,0ptp4l0-21swapper/100:10:231
119591140,0ptp4l0-21swapper/023:35:140
119591140,0ptp4l0-21swapper/023:30:120
119591140,0ptp4l0-21swapper/022:50:240
119591140,0ptp4l0-21swapper/022:35:210
119591140,0ptp4l0-21swapper/022:05:180
119591140,0ptp4l0-21swapper/021:20:150
119591140,0ptp4l0-21swapper/021:10:240
119591140,0ptp4l0-21swapper/021:00:220
119591140,0ptp4l0-21swapper/020:50:160
119591140,0ptp4l0-21swapper/020:25:020
119591140,0ptp4l0-21swapper/019:30:210
119591140,0ptp4l0-21swapper/019:25:210
119591140,0ptp4l0-21swapper/000:25:160
119591130,0ptp4l0-21swapper/223:50:152
119591130,0ptp4l0-21swapper/223:30:202
119591130,0ptp4l0-21swapper/223:10:252
119591130,0ptp4l0-21swapper/221:45:192
119591130,0ptp4l0-21swapper/220:50:192
119591130,0ptp4l0-21swapper/219:35:172
119591130,0ptp4l0-21swapper/219:30:212
119591130,0ptp4l0-21swapper/219:10:212
119591130,0ptp4l0-21swapper/200:30:222
119591130,0ptp4l0-21swapper/200:25:252
119591130,0ptp4l0-21swapper/123:35:141
119591130,0ptp4l0-21swapper/121:45:131
119591130,0ptp4l0-21swapper/121:15:131
119591130,0ptp4l0-21swapper/120:35:141
119591130,0ptp4l0-21swapper/119:50:141
119591130,0ptp4l0-21swapper/119:35:151
119591130,0ptp4l0-21swapper/119:20:131
119591130,0ptp4l0-21swapper/100:00:121
119591130,0ptp4l0-21swapper/022:30:140
119591130,0ptp4l0-21swapper/022:20:020
119591130,0ptp4l0-21swapper/022:10:150
119591130,0ptp4l0-21swapper/021:55:130
119591130,0ptp4l0-21swapper/021:50:130
119591130,0ptp4l0-21swapper/021:50:120
119591130,0ptp4l0-21swapper/021:15:010
119591130,0ptp4l0-21swapper/021:05:000
119591130,0ptp4l0-21swapper/020:45:120
119591130,0ptp4l0-21swapper/020:45:120
119591130,0ptp4l0-21swapper/020:30:130
119591130,0ptp4l0-21swapper/020:20:140
119591130,0ptp4l0-21swapper/020:05:120
119591130,0ptp4l0-21swapper/019:55:140
119591130,0ptp4l0-21swapper/019:45:010
119591130,0ptp4l0-21swapper/019:15:010
119591130,0ptp4l0-21swapper/000:20:140
119591130,0ptp4l0-21swapper/000:10:140
119591130,0ptp4l0-21swapper/000:00:110
119591120,0ptp4l0-21swapper/223:55:192
119591120,0ptp4l0-21swapper/223:00:202
119591120,0ptp4l0-21swapper/222:45:012
119591120,0ptp4l0-21swapper/221:55:022
119591120,0ptp4l0-21swapper/221:30:192
119591120,0ptp4l0-21swapper/220:45:012
119591120,0ptp4l0-21swapper/220:45:012
119591120,0ptp4l0-21swapper/200:10:182
119591110,0ptp4l0-21swapper/222:58:192
119591110,0ptp4l0-21swapper/220:35:162
119591110,0ptp4l0-21swapper/200:05:202
2519299108,1cyclictest33-21ksoftirqd/220:25:012
2519299108,1cyclictest33-21ksoftirqd/219:55:172
2519299103,6cyclictest0-21swapper/223:45:252
2519299102,1cyclictest33-21ksoftirqd/219:15:022
119591100,1ptp4l0-21swapper/221:27:362
119591100,0ptp4l0-21swapper/220:25:132
119591100,0ptp4l0-21swapper/220:05:142
251939997,1cyclictest6831-21forks22:35:133
251939997,1cyclictest6031-21seq21:32:163
251939997,1cyclictest5556-21cut00:35:013
251939997,1cyclictest5459-21expr20:30:173
251939997,1cyclictest3493-21chrt21:28:393
251939997,1cyclictest25410-21grep19:10:133
251939997,1cyclictest25321-21chrt21:08:573
251939997,1cyclictest19843-21taskset20:56:563
251939997,1cyclictest1796-21cat22:25:173
251939997,1cyclictest16976-21taskset20:51:483
251939997,1cyclictest15375-21cut22:50:193
251939997,1cyclictest1459-21cut00:25:193
251939997,1cyclictest13525-21sshd20:45:183
251939997,1cyclictest13525-21sshd20:45:183
251929999,0cyclictest321ktimersoftd/220:10:132
251929997,1cyclictest7099-21expr21:35:132
251929997,1cyclictest223622sleep220:00:392
251929997,1cyclictest15952-21tr19:50:172
251929997,1cyclictest15788-21grep22:50:212
11959190,1ptp4l0-21swapper/200:37:562
11959190,0ptp4l41-21ksoftirqd/320:02:253
11959190,0ptp4l0-21swapper/223:42:412
11959190,0ptp4l0-21swapper/223:36:202
11959190,0ptp4l0-21swapper/223:26:322
11959190,0ptp4l0-21swapper/223:23:492
11959190,0ptp4l0-21swapper/223:18:362
11959190,0ptp4l0-21swapper/222:43:592
11959190,0ptp4l0-21swapper/222:35:312
11959190,0ptp4l0-21swapper/222:26:012
11959190,0ptp4l0-21swapper/222:23:562
11959190,0ptp4l0-21swapper/222:16:342
11959190,0ptp4l0-21swapper/222:12:132
11959190,0ptp4l0-21swapper/222:00:052
11959190,0ptp4l0-21swapper/221:50:112
11959190,0ptp4l0-21swapper/221:50:112
11959190,0ptp4l0-21swapper/221:42:052
11959190,0ptp4l0-21swapper/221:03:282
11959190,0ptp4l0-21swapper/220:55:092
11959190,0ptp4l0-21swapper/220:17:542
11959190,0ptp4l0-21swapper/219:27:452
11959190,0ptp4l0-21swapper/219:24:532
11959190,0ptp4l0-21swapper/200:18:502
251939986,1cyclictest9428-21aten_r9power_en21:40:143
251939986,1cyclictest9062-21ls23:40:153
251939986,1cyclictest9011-21chrt22:40:123
251939986,1cyclictest8058-21cat20:35:183
251939986,1cyclictest7358-21expr19:35:153
251939986,1cyclictest6552-21readlink21:35:013
251939986,1cyclictest6167-21expr23:35:133
251939986,1cyclictest6063-21cat00:35:143
251939986,1cyclictest4368-21acpi19:30:123
251939986,1cyclictest4111-21tr23:30:163
251939986,1cyclictest3902-21tr22:30:133
251939986,1cyclictest32542-21chrt00:24:293
251939986,1cyclictest31766-21tr19:20:133
251939986,1cyclictest31367-21tr20:20:153
251939986,1cyclictest31244-21cat22:20:143
251939986,1cyclictest30696-21expr23:20:153
251939986,1cyclictest29184-21basename20:15:153
251939986,1cyclictest29086-21sed22:15:173
251939986,1cyclictest29056-21cat19:15:133
251939986,1cyclictest28935-21head21:15:153
251939986,1cyclictest28806-21grep00:15:183
251939986,1cyclictest28668-21irqstats23:15:163
251939986,1cyclictest26177-21expr22:10:153
251939986,1cyclictest26161-21expr20:10:163
251939986,1cyclictest25697-21aten_r9power_en21:10:143
251939986,1cyclictest2541-21tr20:25:183
251939986,1cyclictest25189-21cstates23:10:163
251939986,1cyclictest24879-21cut00:10:143
251939986,1cyclictest23595-21if_enp2s022:05:193
251939986,1cyclictest23264-21cut23:05:183
251939986,1cyclictest22999-21hostname20:05:123
251939986,1cyclictest22592-21cut00:05:163
251939986,1cyclictest21663-21snmp_o5powerctl22:00:233
251939986,1cyclictest20461-21cut21:00:143
251939986,1cyclictest19445-21expr00:00:123
251939986,1cyclictest18615-21tr19:55:183
251939986,1cyclictest17407-21head21:55:133
251939986,1cyclictest17247-21expr22:55:133
251939986,1cyclictest17172sleep319:25:093
251939986,1cyclictest16555-21bc23:55:123
251939986,1cyclictest16000-21chrt23:50:583
251939986,1cyclictest15429-21expr19:50:143
251939986,1cyclictest15380-21wc21:50:173
251939986,1cyclictest15380-21wc21:50:163
251939986,1cyclictest141862sleep321:47:003
251939986,1cyclictest13275-21sed19:45:153
251939986,1cyclictest11982-21sed23:45:153
251939986,1cyclictest1144-21hddtemp_smartct23:25:163
251939986,1cyclictest11421-21cat19:40:253
251939986,1cyclictest10161-21head20:40:163
251929986,1cyclictest4640-21expr20:30:142
251929986,1cyclictest25742-21basename21:10:132
251929986,1cyclictest12762-21ls19:45:132
251939975,1cyclictest31639-21head21:20:163
251939975,1cyclictest20552-21cut23:00:173
251939975,1cyclictest11852-21cat22:45:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional