You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-02 - 05:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot3s.osadl.org (updated Sat Dec 02, 2023 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
105491690,52ptp4l0-21swapper/019:07:180
105491620,45ptp4l0-21swapper/119:07:581
3017725245,2sleep30-21swapper/319:09:233
2952825249,1sleep20-21swapper/219:05:342
57262500,0sleep20-21swapper/221:25:012
103012450,1sleep110304-21proc_pri22:35:371
9082430,0sleep20-21swapper/221:15:232
105491300,0ptp4l0-21swapper/021:05:320
105491220,1ptp4l10914-21apt-get21:35:011
105491190,0ptp4l0-21swapper/122:45:291
105491190,0ptp4l0-21swapper/122:00:341
105491180,0ptp4l0-21swapper/120:55:261
105491170,1ptp4l30179-21grep20:05:371
105491170,0ptp4l0-21swapper/022:50:290
105491170,0ptp4l0-21swapper/021:20:270
105491170,0ptp4l0-21swapper/000:25:260
105491160,2ptp4l32231-21snmp_o5powerctl22:15:331
105491160,1ptp4l9236-21apt-get19:30:020
105491160,1ptp4l30557-21apt22:15:192
105491160,1ptp4l25027-21apt-get21:00:200
105491160,1ptp4l22360-21apt-get20:55:220
105491160,1ptp4l18417-21apt-get00:05:230
105491160,1ptp4l12890-21apt-get23:55:210
105491160,0ptp4l0-21swapper/021:45:350
105491160,0ptp4l0-21swapper/021:30:010
105491160,0ptp4l0-21swapper/000:10:270
105491150,2ptp4l2255-21awk19:15:241
105491150,1ptp4l9227-21df22:35:290
105491150,1ptp4l7572-21irqstats20:25:240
105491150,1ptp4l604-21ls23:25:290
105491150,1ptp4l32062-21snmp_o5powerctl00:35:320
105491150,1ptp4l31939-21ntp_states22:15:290
105491150,1ptp4l2977-21ls20:15:330
105491150,1ptp4l29010-21irqstats22:10:211
105491150,1ptp4l2738-21ls19:15:270
105491150,1ptp4l24627-21snmp_o5powerctl19:55:331
105491150,1ptp4l22464-21df21:55:311
105491150,1ptp4l19332-21snmp_o5powerctl19:45:331
105491150,1ptp4l18385-21snmp_o5powerctl22:50:341
105491150,1ptp4l17381-21ls00:00:320
105491150,1ptp4l15731-21snmp_o5powerctl21:40:351
105491150,1ptp4l10925-21munin-run21:35:011
105491150,0ptp4l0-21swapper/123:40:251
105491150,0ptp4l0-21swapper/121:48:091
105491150,0ptp4l0-21swapper/121:20:181
105491150,0ptp4l0-21swapper/120:30:291
105491150,0ptp4l0-21swapper/120:10:211
105491150,0ptp4l0-21swapper/120:00:181
105491150,0ptp4l0-21swapper/119:35:371
105491150,0ptp4l0-21swapper/119:10:191
105491150,0ptp4l0-21swapper/100:10:181
105491150,0ptp4l0-21swapper/023:30:320
105491150,0ptp4l0-21swapper/020:50:200
105491150,0ptp4l0-21swapper/020:00:190
105491150,0ptp4l0-21swapper/019:55:190
105491150,0ptp4l0-21swapper/019:10:190
142072140,0sleep00-21swapper/021:40:230
105491140,1ptp4l9396-21perf23:45:010
105491140,1ptp4l6995-21irqstats21:25:271
105491140,1ptp4l4719-21/usr/sbin/munin20:20:300
105491140,1ptp4l31348-21cstates20:10:230
105491140,1ptp4l3048699cyclictest22:30:310
105491140,1ptp4l24979-21irqstats00:15:351
105491140,1ptp4l24979-21irqstats00:15:341
105491140,1ptp4l22993-21irqrtprio21:55:340
105491140,1ptp4l19150-21pmu-power19:45:300
105491140,1ptp4l15850-21cstates00:00:201
105491140,1ptp4l15532-21irqstats20:40:251
105491140,1ptp4l11689-21cstates21:35:270
105491140,1ptp4l10705-21df23:50:201
105491140,0ptp4l0-21swapper/222:45:322
105491140,0ptp4l0-21swapper/219:57:502
105491140,0ptp4l0-21swapper/200:35:302
105491140,0ptp4l0-21swapper/123:55:321
105491140,0ptp4l0-21swapper/123:30:251
105491140,0ptp4l0-21swapper/123:27:541
105491140,0ptp4l0-21swapper/123:24:201
105491140,0ptp4l0-21swapper/122:43:461
105491140,0ptp4l0-21swapper/122:30:371
105491140,0ptp4l0-21swapper/122:27:361
105491140,0ptp4l0-21swapper/122:20:211
105491140,0ptp4l0-21swapper/121:50:301
105491140,0ptp4l0-21swapper/121:15:201
105491140,0ptp4l0-21swapper/121:12:161
105491140,0ptp4l0-21swapper/120:48:061
105491140,0ptp4l0-21swapper/120:20:581
105491140,0ptp4l0-21swapper/119:50:321
105491140,0ptp4l0-21swapper/119:32:241
105491140,0ptp4l0-21swapper/119:20:231
105491140,0ptp4l0-21swapper/100:08:591
105491140,0ptp4l0-21swapper/023:00:230
105491140,0ptp4l0-21swapper/022:45:320
105491140,0ptp4l0-21swapper/022:20:360
105491140,0ptp4l0-21swapper/021:50:200
105491140,0ptp4l0-21swapper/021:15:350
105491140,0ptp4l0-21swapper/019:40:330
105491140,0ptp4l0-21swapper/019:35:220
105491130,2ptp4l0-21swapper/023:17:120
105491130,0ptp4l27602-21chrt00:25:191
105491130,0ptp4l20414-21aten_r9power_vo19:50:200
105491130,0ptp4l0-21swapper/222:50:352
105491130,0ptp4l0-21swapper/221:45:232
105491130,0ptp4l0-21swapper/219:20:282
105491130,0ptp4l0-21swapper/200:15:292
105491130,0ptp4l0-21swapper/200:15:282
105491130,0ptp4l0-21swapper/123:35:211
105491130,0ptp4l0-21swapper/123:10:171
105491130,0ptp4l0-21swapper/123:07:131
105491130,0ptp4l0-21swapper/123:00:251
105491130,0ptp4l0-21swapper/122:55:181
105491130,0ptp4l0-21swapper/121:05:221
105491130,0ptp4l0-21swapper/121:00:211
105491130,0ptp4l0-21swapper/120:50:221
105491130,0ptp4l0-21swapper/120:35:281
105491130,0ptp4l0-21swapper/120:25:251
105491130,0ptp4l0-21swapper/120:15:181
105491130,0ptp4l0-21swapper/119:40:221
105491130,0ptp4l0-21swapper/119:25:181
105491130,0ptp4l0-21swapper/100:35:221
105491130,0ptp4l0-21swapper/100:22:161
105491130,0ptp4l0-21swapper/023:50:180
105491130,0ptp4l0-21swapper/023:35:210
105491130,0ptp4l0-21swapper/023:20:170
105491130,0ptp4l0-21swapper/023:10:210
105491130,0ptp4l0-21swapper/022:55:150
105491130,0ptp4l0-21swapper/022:40:240
105491130,0ptp4l0-21swapper/022:25:170
105491130,0ptp4l0-21swapper/022:10:190
105491130,0ptp4l0-21swapper/022:00:230
105491130,0ptp4l0-21swapper/021:25:350
105491130,0ptp4l0-21swapper/021:10:240
105491130,0ptp4l0-21swapper/020:45:200
105491130,0ptp4l0-21swapper/020:40:210
105491130,0ptp4l0-21swapper/020:35:230
105491130,0ptp4l0-21swapper/020:30:210
105491130,0ptp4l0-21swapper/020:05:240
105491130,0ptp4l0-21swapper/019:25:170
105491130,0ptp4l0-21swapper/019:20:230
105491130,0ptp4l0-21swapper/000:31:420
105491130,0ptp4l0-21swapper/000:15:300
105491130,0ptp4l0-21swapper/000:15:300
30488991211,0cyclictest33-21ksoftirqd/219:30:352
105491120,2ptp4l0-21swapper/022:07:360
105491120,0ptp4l0-21swapper/223:45:052
105491120,0ptp4l0-21swapper/222:25:202
105491120,0ptp4l0-21swapper/220:55:322
105491120,0ptp4l0-21swapper/220:10:242
105491120,0ptp4l0-21swapper/219:15:292
105491120,0ptp4l0-21swapper/122:06:441
6032110,0sleep30-21swapper/321:15:213
3048899117,1cyclictest33-21ksoftirqd/222:55:292
30488991110,0cyclictest0-21swapper/219:10:012
105491110,0ptp4l0-21swapper/223:00:262
105491110,0ptp4l0-21swapper/220:45:232
105491110,0ptp4l0-21swapper/123:45:071
105491110,0ptp4l0-21swapper/123:17:331
105491110,0ptp4l0-21swapper/100:34:331
3048899109,0cyclictest33-21ksoftirqd/220:35:212
105491100,1ptp4l0-21swapper/023:49:500
105491100,0ptp4l0-21swapper/221:50:302
105491100,0ptp4l0-21swapper/221:03:322
105491100,0ptp4l0-21swapper/000:21:190
304899997,1cyclictest8132-21tr19:25:233
304899997,1cyclictest6786-21cut22:30:283
304899997,1cyclictest6249-21cut20:25:003
304899997,1cyclictest353-21chrt19:13:433
304899997,1cyclictest30905-21chrt23:24:083
304899997,1cyclictest28885-21cut22:10:213
304899997,1cyclictest27641-21chrt23:14:203
304899997,1cyclictest27486-21cat20:00:333
304899997,1cyclictest27070-21chrt21:00:403
304899997,1cyclictest25929-21cat22:00:283
304899997,1cyclictest24186-21chrt21:57:403
304899997,1cyclictest189632sleep321:48:363
304899997,1cyclictest17784-21sort20:45:233
304899997,1cyclictest11252-21taskset20:31:573
304899990,8cyclictest1462-21cat20:15:233
10549190,1ptp4l0-21swapper/220:53:192
10549190,0ptp4l0-21swapper/300:07:323
10549190,0ptp4l0-21swapper/223:55:582
10549190,0ptp4l0-21swapper/223:40:152
10549190,0ptp4l0-21swapper/223:30:062
10549190,0ptp4l0-21swapper/223:29:462
10549190,0ptp4l0-21swapper/223:20:052
10549190,0ptp4l0-21swapper/223:16:122
10549190,0ptp4l0-21swapper/223:10:142
10549190,0ptp4l0-21swapper/223:07:212
10549190,0ptp4l0-21swapper/222:44:412
10549190,0ptp4l0-21swapper/222:36:042
10549190,0ptp4l0-21swapper/222:30:562
10549190,0ptp4l0-21swapper/222:20:042
10549190,0ptp4l0-21swapper/222:11:532
10549190,0ptp4l0-21swapper/222:06:392
10549190,0ptp4l0-21swapper/222:03:022
10549190,0ptp4l0-21swapper/221:40:252
10549190,0ptp4l0-21swapper/221:35:122
10549190,0ptp4l0-21swapper/221:30:242
10549190,0ptp4l0-21swapper/221:25:302
10549190,0ptp4l0-21swapper/221:05:502
10549190,0ptp4l0-21swapper/220:43:342
10549190,0ptp4l0-21swapper/220:33:152
10549190,0ptp4l0-21swapper/220:25:312
10549190,0ptp4l0-21swapper/220:21:532
10549190,0ptp4l0-21swapper/220:08:362
10549190,0ptp4l0-21swapper/220:00:112
10549190,0ptp4l0-21swapper/219:52:002
10549190,0ptp4l0-21swapper/219:47:022
10549190,0ptp4l0-21swapper/219:42:272
10549190,0ptp4l0-21swapper/219:35:092
10549190,0ptp4l0-21swapper/219:27:312
10549190,0ptp4l0-21swapper/200:33:242
10549190,0ptp4l0-21swapper/200:27:072
10549190,0ptp4l0-21swapper/200:07:152
10549190,0ptp4l0-21swapper/200:04:472
10549190,0ptp4l0-21swapper/023:05:020
304899986,1cyclictest9212-21cut21:30:293
304899986,1cyclictest87222sleep322:35:203
304899986,1cyclictest6959-21taskset23:40:133
304899986,1cyclictest5840-21chrt21:25:093
304899986,1cyclictest4423-21grep19:20:213
304899986,1cyclictest4087-21chrt23:35:173
304899986,1cyclictest36302sleep323:32:083
304899986,1cyclictest3604-21chrt19:16:073
304899986,1cyclictest3458-21tr21:20:213
304899986,1cyclictest3422-21chrt22:25:103
304899986,1cyclictest334-21chrt22:18:143
304899986,1cyclictest31855-21tail23:25:203
304899986,1cyclictest31048-21egrep20:10:223
304899986,1cyclictest30661-21expr21:10:233
304899986,1cyclictest304412sleep300:35:183
304899986,1cyclictest29820-21chrt00:31:173
304899986,1cyclictest29131-21cat20:05:283
304899986,1cyclictest28035-21chrt23:16:393
304899986,1cyclictest276472sleep321:05:203
304899986,1cyclictest27516-21ls00:25:183
304899986,1cyclictest27289-21taskset22:05:313
304899986,1cyclictest25976-21taskset00:16:393
304899986,1cyclictest25976-21taskset00:16:393
304899986,1cyclictest24645-21grep19:55:343
304899986,1cyclictest234112sleep300:12:413
304899986,1cyclictest22390-21telnet20:55:233
304899986,1cyclictest22281-21expr23:00:253
304899986,1cyclictest20491-21grep19:50:213
304899986,1cyclictest19885-21grep20:50:223
304899986,1cyclictest19741-21expr21:50:223
304899986,1cyclictest16938-21tr22:50:243
304899986,1cyclictest15761-21sort00:00:203
304899986,1cyclictest15225-21tr19:40:243
304899986,1cyclictest14885-21expr20:40:213
304899986,1cyclictest14707-21expr21:40:253
304899986,1cyclictest14533-21sh22:45:223
304899986,1cyclictest13260-21expr23:55:233
304899986,1cyclictest13108-21ntpq20:35:273
304899986,1cyclictest12645-21wc19:35:223
304899986,1cyclictest1197-21cat22:20:243
304899986,1cyclictest11661-21grep21:35:253
304899986,1cyclictest113802sleep322:40:123
304899986,1cyclictest10329-21cut23:50:183
304899986,1cyclictest10043-21expr19:30:223
304899980,7cyclictest7118-21sed20:25:223
304899980,7cyclictest18822-21sed19:45:253
304889986,1cyclictest4748-21head23:35:232
304889986,1cyclictest30910-21grep21:10:262
304889986,1cyclictest22211-21grep21:55:312
304889986,1cyclictest21448-21expr00:10:242
10549180,0ptp4l0-21swapper/223:50:122
10549180,0ptp4l0-21swapper/220:15:132
10549180,0ptp4l0-21swapper/200:20:322
304899975,1cyclictest96472sleep323:45:453
304899975,1cyclictest26535-21taskset00:20:483
304899975,1cyclictest21253-21grep22:55:283
304899953,1cyclictest25008-21chrt23:09:313
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional