You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-21 - 23:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Kontron
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot3s.osadl.org (updated Thu Sep 21, 2023 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1069916455,4phc2sys0-21swapper/007:08:470
105491630,31ptp4l0-21swapper/107:08:131
696325147,2sleep20-21swapper/207:05:402
659725047,1sleep30-21swapper/307:05:333
53902390,0sleep30-21swapper/309:05:213
89022360,1sleep3756299cyclictest09:10:273
105491260,0ptp4l0-21swapper/110:35:261
105491190,1ptp4l1326-21users09:55:311
105491190,0ptp4l0-21swapper/112:20:311
105491190,0ptp4l0-21swapper/007:30:280
105491180,0ptp4l0-21swapper/107:35:191
105491170,1ptp4l28814-21grep11:50:231
105491170,0ptp4l0-21swapper/111:04:381
105491170,0ptp4l0-21swapper/108:10:251
105491170,0ptp4l0-21swapper/011:55:220
105491170,0ptp4l0-21swapper/010:50:280
105491160,1ptp4l7989-21apt-get08:10:190
105491160,1ptp4l2306-21apt-get09:00:171
105491160,0ptp4l0-21swapper/111:25:301
105491160,0ptp4l0-21swapper/109:05:291
105491160,0ptp4l0-21swapper/009:25:250
105491160,0ptp4l0-21swapper/008:22:080
105491150,2ptp4l7572-21expr11:10:220
105491150,1ptp4l959-21snmp_o5powerctl09:55:290
105491150,1ptp4l9443-21ls09:10:321
105491150,1ptp4l9294-21snmp_o5powerctl09:10:320
105491150,1ptp4l7011-21snmp_o5powerctl08:05:321
105491150,1ptp4l5921-21snmp_o5powerctl11:05:311
105491150,1ptp4l4378-21snmp_o5powerctl08:00:391
105491150,1ptp4l30995-21ls07:50:260
105491150,1ptp4l25464-21apt-get11:45:211
105491150,1ptp4l24842-21users11:40:351
105491150,1ptp4l22835-21ntp_states08:35:271
105491150,1ptp4l21831-21snmp_o5powerctl11:35:350
105491150,1ptp4l21229-21snmp_o5powerctl12:35:270
105491150,1ptp4l20267-21snmp_o5powerctl08:30:291
105491150,1ptp4l17233-21ls08:25:270
105491150,1ptp4l16618-21irqrtprio09:25:272
105491150,1ptp4l15574-21apt-get09:25:201
105491150,1ptp4l13806-21fschecks_count08:20:231
105491150,1ptp4l12308-21snmp_o5powerctl08:15:330
105491150,1ptp4l11227-21snmp_o5powerctl11:15:342
105491150,0ptp4l0-21swapper/112:10:211
105491150,0ptp4l0-21swapper/112:05:201
105491150,0ptp4l0-21swapper/111:15:221
105491150,0ptp4l0-21swapper/110:51:101
105491150,0ptp4l0-21swapper/110:40:191
105491150,0ptp4l0-21swapper/107:53:581
105491150,0ptp4l0-21swapper/012:15:220
105491150,0ptp4l0-21swapper/011:45:210
105491150,0ptp4l0-21swapper/011:25:200
105491150,0ptp4l0-21swapper/010:45:210
105491150,0ptp4l0-21swapper/008:45:200
105491150,0ptp4l0-21swapper/008:35:180
756299140,6cyclictest0-21swapper/308:10:193
105491140,1ptp4l8923-21users11:10:331
105491140,1ptp4l6299-21snmp_o5powerctl10:05:311
105491140,1ptp4l27729-21snmp_o5powerctl10:45:351
105491140,1ptp4l25964-21snmp_o5powerctl07:40:330
105491140,1ptp4l23140-21apt-config10:40:020
105491140,1ptp4l19448-21df_inode07:30:221
105491140,1ptp4l16915-21snmp_o5powerctl10:25:300
105491140,1ptp4l16039-21if_enp4s010:25:231
105491140,1ptp4l13981-21ntp_states10:20:291
105491140,1ptp4l13902-21snmp_o5powerctl11:20:370
105491140,1ptp4l12562-21expr11:20:241
105491140,0ptp4l1533-21ls08:55:331
105491140,0ptp4l0-21swapper/210:00:242
105491140,0ptp4l0-21swapper/209:55:302
105491140,0ptp4l0-21swapper/112:00:011
105491140,0ptp4l0-21swapper/111:35:341
105491140,0ptp4l0-21swapper/110:55:361
105491140,0ptp4l0-21swapper/110:00:291
105491140,0ptp4l0-21swapper/109:51:041
105491140,0ptp4l0-21swapper/109:40:271
105491140,0ptp4l0-21swapper/109:35:221
105491140,0ptp4l0-21swapper/109:15:451
105491140,0ptp4l0-21swapper/108:25:321
105491140,0ptp4l0-21swapper/107:45:321
105491140,0ptp4l0-21swapper/107:40:491
105491140,0ptp4l0-21swapper/107:15:031
105491140,0ptp4l0-21swapper/012:30:170
105491140,0ptp4l0-21swapper/012:25:210
105491140,0ptp4l0-21swapper/011:05:330
105491140,0ptp4l0-21swapper/009:00:230
105491140,0ptp4l0-21swapper/008:59:270
105491140,0ptp4l0-21swapper/008:05:320
105491140,0ptp4l0-21swapper/007:55:340
105491130,0ptp4l0-21swapper/212:30:282
105491130,0ptp4l0-21swapper/212:25:332
105491130,0ptp4l0-21swapper/211:00:222
105491130,0ptp4l0-21swapper/210:40:222
105491130,0ptp4l0-21swapper/209:10:222
105491130,0ptp4l0-21swapper/208:50:292
105491130,0ptp4l0-21swapper/208:25:202
105491130,0ptp4l0-21swapper/208:15:262
105491130,0ptp4l0-21swapper/207:59:122
105491130,0ptp4l0-21swapper/207:45:222
105491130,0ptp4l0-21swapper/112:35:251
105491130,0ptp4l0-21swapper/112:30:171
105491130,0ptp4l0-21swapper/112:25:241
105491130,0ptp4l0-21swapper/112:15:281
105491130,0ptp4l0-21swapper/111:55:211
105491130,0ptp4l0-21swapper/111:30:231
105491130,0ptp4l0-21swapper/110:30:171
105491130,0ptp4l0-21swapper/110:15:231
105491130,0ptp4l0-21swapper/110:10:181
105491130,0ptp4l0-21swapper/109:45:241
105491130,0ptp4l0-21swapper/109:30:261
105491130,0ptp4l0-21swapper/109:20:271
105491130,0ptp4l0-21swapper/108:50:321
105491130,0ptp4l0-21swapper/108:45:271
105491130,0ptp4l0-21swapper/108:40:221
105491130,0ptp4l0-21swapper/108:15:241
105491130,0ptp4l0-21swapper/107:58:411
105491130,0ptp4l0-21swapper/107:25:191
105491130,0ptp4l0-21swapper/107:20:221
105491130,0ptp4l0-21swapper/107:10:331
105491130,0ptp4l0-21swapper/012:20:200
105491130,0ptp4l0-21swapper/012:10:240
105491130,0ptp4l0-21swapper/012:05:230
105491130,0ptp4l0-21swapper/012:00:240
105491130,0ptp4l0-21swapper/011:50:230
105491130,0ptp4l0-21swapper/011:40:210
105491130,0ptp4l0-21swapper/011:30:300
105491130,0ptp4l0-21swapper/011:15:250
105491130,0ptp4l0-21swapper/011:00:200
105491130,0ptp4l0-21swapper/010:40:300
105491130,0ptp4l0-21swapper/010:30:180
105491130,0ptp4l0-21swapper/010:20:230
105491130,0ptp4l0-21swapper/010:15:240
105491130,0ptp4l0-21swapper/010:10:330
105491130,0ptp4l0-21swapper/010:05:220
105491130,0ptp4l0-21swapper/010:00:200
105491130,0ptp4l0-21swapper/009:50:250
105491130,0ptp4l0-21swapper/009:45:240
105491130,0ptp4l0-21swapper/009:40:270
105491130,0ptp4l0-21swapper/009:35:230
105491130,0ptp4l0-21swapper/009:30:220
105491130,0ptp4l0-21swapper/009:20:250
105491130,0ptp4l0-21swapper/009:15:240
105491130,0ptp4l0-21swapper/009:05:270
105491130,0ptp4l0-21swapper/008:50:250
105491130,0ptp4l0-21swapper/008:40:280
105491130,0ptp4l0-21swapper/008:30:210
105491130,0ptp4l0-21swapper/008:00:330
105491130,0ptp4l0-21swapper/007:45:250
105491130,0ptp4l0-21swapper/007:35:180
105491130,0ptp4l0-21swapper/007:25:190
105491130,0ptp4l0-21swapper/007:20:210
105491130,0ptp4l0-21swapper/007:15:310
105491130,0ptp4l0-21swapper/007:10:010
102592130,0sleep20-21swapper/210:15:232
105491120,0ptp4l0-21swapper/212:10:282
105491120,0ptp4l0-21swapper/212:00:292
105491120,0ptp4l0-21swapper/210:05:192
105491120,0ptp4l0-21swapper/010:55:200
756199111,3cyclictest0-21swapper/210:50:172
105491110,0ptp4l0-21swapper/212:15:272
105491110,0ptp4l0-21swapper/211:55:012
105491110,0ptp4l0-21swapper/211:27:322
105491110,0ptp4l0-21swapper/209:20:222
105491110,0ptp4l0-21swapper/207:20:252
756199103,6cyclictest0-21swapper/208:30:192
756199103,2cyclictest0-21swapper/211:05:202
105491100,0ptp4l0-21swapper/211:24:342
105491100,0ptp4l0-21swapper/210:38:042
105491100,0ptp4l0-21swapper/208:36:302
105491100,0ptp4l0-21swapper/208:10:242
75629997,1cyclictest6510-21taskset11:08:313
75629997,1cyclictest4711-21grep08:00:423
75629997,1cyclictest3356-21ntp_states10:00:253
75629997,1cyclictest31372-21gunzip07:50:303
75629997,1cyclictest3089-21pmu-power11:00:303
75629997,1cyclictest28589-21cut07:45:323
75629997,1cyclictest285312sleep309:46:253
75629997,1cyclictest21856-21tr07:35:193
75629997,1cyclictest20805-21chrt08:32:523
75629997,1cyclictest18487-21uname12:30:263
75629997,1cyclictest18161-21taskset08:27:523
75629997,1cyclictest178462sleep309:28:403
75629997,1cyclictest15546-21ls07:20:323
75629997,1cyclictest12734-21taskset08:16:253
75629997,1cyclictest11123-21cat09:15:303
75629997,1cyclictest11088-21cat10:15:273
75629996,2cyclictest609-21irqbalance09:24:043
75619997,1cyclictest3697-21cut08:00:342
75619997,1cyclictest20305-21cat12:35:222
75619997,1cyclictest11424-21wc09:15:342
75619990,2cyclictest0-21swapper/208:20:202
10549190,1ptp4l0-21swapper/209:08:472
10549190,1ptp4l0-21swapper/209:03:332
10549190,1ptp4l0-21swapper/208:57:102
10549190,0ptp4l0-21swapper/311:53:443
10549190,0ptp4l0-21swapper/212:23:292
10549190,0ptp4l0-21swapper/211:58:192
10549190,0ptp4l0-21swapper/211:45:442
10549190,0ptp4l0-21swapper/211:42:082
10549190,0ptp4l0-21swapper/211:36:112
10549190,0ptp4l0-21swapper/211:30:432
10549190,0ptp4l0-21swapper/211:14:432
10549190,0ptp4l0-21swapper/210:59:582
10549190,0ptp4l0-21swapper/210:30:332
10549190,0ptp4l0-21swapper/210:29:082
10549190,0ptp4l0-21swapper/210:21:152
10549190,0ptp4l0-21swapper/210:10:352
10549190,0ptp4l0-21swapper/209:51:082
10549190,0ptp4l0-21swapper/209:45:072
10549190,0ptp4l0-21swapper/209:40:572
10549190,0ptp4l0-21swapper/208:45:162
10549190,0ptp4l0-21swapper/208:44:462
10549190,0ptp4l0-21swapper/208:09:252
10549190,0ptp4l0-21swapper/207:54:102
10549190,0ptp4l0-21swapper/207:39:132
10549190,0ptp4l0-21swapper/207:30:422
10549190,0ptp4l0-21swapper/207:28:042
10549190,0ptp4l0-21swapper/207:16:482
10549190,0ptp4l0-21swapper/207:13:192
75629986,1cyclictest9943-21expr11:15:243
75629986,1cyclictest8906-21taskset12:15:033
75629986,1cyclictest7913-21cstates07:10:223
75629986,1cyclictest766-21grep09:55:263
75629986,1cyclictest7606-21expr10:10:203
75629986,1cyclictest745-21if_enp0s31f607:55:273
75629986,1cyclictest70752sleep311:10:203
75629986,1cyclictest6558-21expr12:10:223
75629986,1cyclictest6062-21awk08:05:243
75629986,1cyclictest4660-21aten2.4-expect10:05:203
75629986,1cyclictest3656-21apt12:05:203
75629986,1cyclictest32403-21expr08:55:233
75629986,1cyclictest31996-21head10:55:253
75629986,1cyclictest31236-21seq09:52:113
75629986,1cyclictest31217-21df11:55:203
75629986,1cyclictest30791-21ntpq08:50:313
75629986,1cyclictest307512sleep310:50:473
75629986,1cyclictest27962-21grep10:45:373
75629986,1cyclictest27267-21grep08:45:233
75629986,1cyclictest27136-21snmp_o5powerctl11:45:333
75629986,1cyclictest25463-21cut09:40:433
75629986,1cyclictest25049-21taskset07:40:243
75629986,1cyclictest24128-21basename08:40:223
75629986,1cyclictest23678-21expr10:40:213
75629986,1cyclictest22905-21basename11:40:213
75629986,1cyclictest2262-21chrt09:00:053
75629986,1cyclictest22534-21sed08:35:233
75629986,1cyclictest21354-21cat10:35:253
75629986,1cyclictest21201-21cut09:35:203
75629986,1cyclictest201142sleep311:35:113
75629986,1cyclictest19515-21taskset12:35:053
75629986,1cyclictest19280-21expr07:30:223
75629986,1cyclictest18425-21taskset09:30:013
75629986,1cyclictest17955-21basename10:30:173
75629986,1cyclictest17604-21aten2.4-expect11:30:213
75629986,1cyclictest17288-21cat11:30:013
75629986,1cyclictest17109-21if_enp4s007:25:213
75629986,1cyclictest15278-21cut10:25:183
75629986,1cyclictest15168-21sed12:25:273
75629986,1cyclictest13959-21ntpq10:20:293
75629986,1cyclictest12602-21expr11:20:253
75629986,1cyclictest1233-21tr12:00:223
75629986,1cyclictest11976-21cat12:20:203
75629986,1cyclictest10737-21unixbench_multi07:15:033
75629981,1cyclictest0-21swapper/308:20:193
75619986,1cyclictest3903-21tr12:05:222
75619986,1cyclictest27592-21wc10:45:332
75619986,1cyclictest25303-21cut07:40:252
75619986,1cyclictest21349-21tr09:35:202
10549180,0ptp4l0-21swapper/209:30:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional