You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-10 - 15:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackcslot8s.osadl.org (updated Sun Dec 10, 2023 12:46:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
125391650,31ptp4l0-21swapper/107:06:171
125391610,30ptp4l0-21swapper/007:05:520
125391580,14ptp4l0-21swapper/507:05:225
125391570,5ptp4l0-21swapper/407:07:314
2902025331,6sleep70-21swapper/707:09:367
2902725241,6sleep30-21swapper/307:09:413
2875725241,6sleep20-21swapper/207:06:202
2712825039,7sleep60-21swapper/607:05:036
125391370,0ptp4l0-21swapper/410:25:194
125391370,0ptp4l0-21swapper/410:25:184
29345993530,1cyclictest32280-21idleruntime-cro12:20:003
125391320,0ptp4l0-21swapper/111:25:211
125391320,0ptp4l0-21swapper/109:31:071
125391310,0ptp4l0-21swapper/010:44:540
125391310,0ptp4l0-21swapper/009:45:330
125391310,0ptp4l0-21swapper/009:24:360
125391300,0ptp4l0-21swapper/611:43:196
125391300,0ptp4l0-21swapper/412:14:064
125391300,0ptp4l0-21swapper/407:30:384
125391300,0ptp4l0-21swapper/112:13:251
125391300,0ptp4l0-21swapper/111:54:091
125391300,0ptp4l0-21swapper/110:07:491
125391290,2ptp4l0-21swapper/010:27:340
125391290,2ptp4l0-21swapper/010:27:340
125391290,0ptp4l20342-21diskmemload12:08:431
125391290,0ptp4l0-21swapper/512:34:315
125391290,0ptp4l0-21swapper/012:35:120
125391280,0ptp4l0-21swapper/611:15:016
125391280,0ptp4l0-21swapper/511:11:265
125391280,0ptp4l0-21swapper/412:35:484
125391280,0ptp4l0-21swapper/408:24:564
125391280,0ptp4l0-21swapper/211:15:202
125391280,0ptp4l0-21swapper/111:12:501
125391280,0ptp4l0-21swapper/111:02:491
125391280,0ptp4l0-21swapper/109:41:121
125391280,0ptp4l0-21swapper/109:16:441
125391280,0ptp4l0-21swapper/109:14:391
125391280,0ptp4l0-21swapper/010:01:110
125391270,1ptp4l20342-21diskmemload09:30:265
125391270,0ptp4l0-21swapper/408:00:234
125391270,0ptp4l0-21swapper/111:47:421
125391270,0ptp4l0-21swapper/110:37:121
125391270,0ptp4l0-21swapper/110:10:051
125391270,0ptp4l0-21swapper/110:02:471
125391270,0ptp4l0-21swapper/011:17:030
125391270,0ptp4l0-21swapper/010:49:030
125391270,0ptp4l0-21swapper/008:55:270
125391260,3ptp4l0-21swapper/010:21:150
125391260,3ptp4l0-21swapper/010:21:150
125391260,0ptp4l0-21swapper/512:04:145
125391260,0ptp4l0-21swapper/511:31:275
125391260,0ptp4l0-21swapper/511:05:465
125391260,0ptp4l0-21swapper/412:24:134
125391260,0ptp4l0-21swapper/411:20:344
125391260,0ptp4l0-21swapper/410:40:164
125391260,0ptp4l0-21swapper/410:21:174
125391260,0ptp4l0-21swapper/410:21:174
125391260,0ptp4l0-21swapper/409:59:454
125391260,0ptp4l0-21swapper/409:40:534
125391260,0ptp4l0-21swapper/409:35:044
125391260,0ptp4l0-21swapper/110:31:031
125391260,0ptp4l0-21swapper/110:29:381
125391260,0ptp4l0-21swapper/110:29:381
125391260,0ptp4l0-21swapper/110:16:341
125391260,0ptp4l0-21swapper/109:46:301
125391260,0ptp4l0-21swapper/011:55:180
125391260,0ptp4l0-21swapper/011:22:380
125391260,0ptp4l0-21swapper/009:19:120
29351992521,3cyclictest22595-21sh10:37:354
125391250,0ptp4l0-21swapper/611:45:226
125391250,0ptp4l0-21swapper/609:43:516
125391250,0ptp4l0-21swapper/510:10:005
125391250,0ptp4l0-21swapper/408:45:184
125391250,0ptp4l0-21swapper/212:26:302
125391250,0ptp4l0-21swapper/211:43:312
125391250,0ptp4l0-21swapper/210:29:162
125391250,0ptp4l0-21swapper/210:29:162
125391250,0ptp4l0-21swapper/112:27:541
125391250,0ptp4l0-21swapper/111:59:331
125391250,0ptp4l0-21swapper/111:06:041
125391250,0ptp4l0-21swapper/110:40:241
125391250,0ptp4l0-21swapper/109:37:341
125391250,0ptp4l0-21swapper/109:29:301
125391250,0ptp4l0-21swapper/108:15:261
125391250,0ptp4l0-21swapper/011:40:320
125391250,0ptp4l0-21swapper/011:27:050
125391250,0ptp4l0-21swapper/009:54:200
125391250,0ptp4l0-21swapper/009:35:190
125391250,0ptp4l0-21swapper/009:29:550
125391250,0ptp4l0-21swapper/009:14:370
125391250,0ptp4l0-21swapper/008:40:210
125391240,1ptp4l8836-21timerandwakeup12:30:341
125391240,1ptp4l4492-21latency_hist07:25:005
125391240,1ptp4l20840-21/usr/sbin/munin09:10:305
125391240,1ptp4l19418-21irqstats09:50:251
125391240,0ptp4l0-21swapper/610:00:296
125391240,0ptp4l0-21swapper/512:15:275
125391240,0ptp4l0-21swapper/512:09:515
125391240,0ptp4l0-21swapper/511:37:475
125391240,0ptp4l0-21swapper/511:20:435
125391240,0ptp4l0-21swapper/508:50:245
125391240,0ptp4l0-21swapper/412:29:464
125391240,0ptp4l0-21swapper/412:07:084
125391240,0ptp4l0-21swapper/411:19:074
125391240,0ptp4l0-21swapper/410:53:484
125391240,0ptp4l0-21swapper/409:45:324
125391240,0ptp4l0-21swapper/407:55:004
125391240,0ptp4l0-21swapper/211:00:012
125391240,0ptp4l0-21swapper/210:51:152
125391240,0ptp4l0-21swapper/209:43:022
125391240,0ptp4l0-21swapper/207:29:252
125391240,0ptp4l0-21swapper/112:23:391
125391240,0ptp4l0-21swapper/111:34:211
125391240,0ptp4l0-21swapper/108:38:151
125391240,0ptp4l0-21swapper/011:01:560
125391240,0ptp4l0-21swapper/010:36:270
125391240,0ptp4l0-21swapper/010:19:360
125391240,0ptp4l0-21swapper/008:30:250
125391240,0ptp4l0-21swapper/008:05:340
125391230,1ptp4l872-21dbus-daemon08:20:004
125391230,1ptp4l30551-21/usr/sbin/munin07:10:275
125391230,1ptp4l16848-21irqrtprio07:50:241
125391230,1ptp4l16415-21smartctl09:00:215
125391230,0ptp4l0-21swapper/612:00:246
125391230,0ptp4l0-21swapper/512:27:305
125391230,0ptp4l0-21swapper/512:21:335
125391230,0ptp4l0-21swapper/510:55:215
125391230,0ptp4l0-21swapper/510:47:265
125391230,0ptp4l0-21swapper/510:31:535
125391230,0ptp4l0-21swapper/510:24:465
125391230,0ptp4l0-21swapper/510:24:455
125391230,0ptp4l0-21swapper/510:15:255
125391230,0ptp4l0-21swapper/509:50:245
125391230,0ptp4l0-21swapper/509:15:285
125391230,0ptp4l0-21swapper/507:50:255
125391230,0ptp4l0-21swapper/507:25:315
125391230,0ptp4l0-21swapper/507:16:375
125391230,0ptp4l0-21swapper/411:25:194
125391230,0ptp4l0-21swapper/411:00:224
125391230,0ptp4l0-21swapper/410:55:514
125391230,0ptp4l0-21swapper/410:15:364
125391230,0ptp4l0-21swapper/409:23:014
125391230,0ptp4l0-21swapper/409:18:504
125391230,0ptp4l0-21swapper/408:55:234
125391230,0ptp4l0-21swapper/407:40:344
125391230,0ptp4l0-21swapper/211:45:202
125391230,0ptp4l0-21swapper/210:00:302
125391230,0ptp4l0-21swapper/207:35:302
125391230,0ptp4l0-21swapper/112:18:131
125391230,0ptp4l0-21swapper/111:40:301
125391230,0ptp4l0-21swapper/111:20:251
125391230,0ptp4l0-21swapper/110:45:291
125391230,0ptp4l0-21swapper/109:57:531
125391230,0ptp4l0-21swapper/108:00:331
125391230,0ptp4l0-21swapper/107:25:281
125391230,0ptp4l0-21swapper/012:32:330
125391230,0ptp4l0-21swapper/012:26:560
125391230,0ptp4l0-21swapper/012:14:120
125391230,0ptp4l0-21swapper/012:05:280
125391230,0ptp4l0-21swapper/010:55:250
125391230,0ptp4l0-21swapper/010:10:500
125391230,0ptp4l0-21swapper/008:50:000
125391230,0ptp4l0-21swapper/008:25:220
125391230,0ptp4l0-21swapper/007:45:240
125391230,0ptp4l0-21swapper/007:45:240
125391220,4ptp4l0-21swapper/407:20:094
125391220,1ptp4l20342-21diskmemload11:44:344
125391220,1ptp4l16705-21ssh09:46:025
125391220,1ptp4l0-21swapper/110:22:111
125391220,1ptp4l0-21swapper/110:22:101
125391220,0ptp4l0-21swapper/612:07:326
125391220,0ptp4l0-21swapper/610:51:446
125391220,0ptp4l0-21swapper/608:35:246
125391220,0ptp4l0-21swapper/607:50:006
125391220,0ptp4l0-21swapper/607:50:006
125391220,0ptp4l0-21swapper/607:35:256
125391220,0ptp4l0-21swapper/512:36:385
125391220,0ptp4l0-21swapper/512:10:245
125391220,0ptp4l0-21swapper/511:56:115
125391220,0ptp4l0-21swapper/511:50:245
125391220,0ptp4l0-21swapper/511:48:145
125391220,0ptp4l0-21swapper/511:40:225
125391220,0ptp4l0-21swapper/511:25:285
125391220,0ptp4l0-21swapper/511:02:325
125391220,0ptp4l0-21swapper/510:50:235
125391220,0ptp4l0-21swapper/510:40:265
125391220,0ptp4l0-21swapper/510:35:025
125391220,0ptp4l0-21swapper/510:10:185
125391220,0ptp4l0-21swapper/510:03:205
125391220,0ptp4l0-21swapper/509:55:205
125391220,0ptp4l0-21swapper/509:40:195
125391220,0ptp4l0-21swapper/509:37:575
125391220,0ptp4l0-21swapper/509:25:205
125391220,0ptp4l0-21swapper/509:20:165
125391220,0ptp4l0-21swapper/508:20:205
125391220,0ptp4l0-21swapper/508:15:255
125391220,0ptp4l0-21swapper/507:30:265
125391220,0ptp4l0-21swapper/412:30:224
125391220,0ptp4l0-21swapper/412:15:004
125391220,0ptp4l0-21swapper/411:55:014
125391220,0ptp4l0-21swapper/411:50:494
125391220,0ptp4l0-21swapper/411:31:504
125391220,0ptp4l0-21swapper/410:45:314
125391220,0ptp4l0-21swapper/409:52:254
125391220,0ptp4l0-21swapper/409:34:564
125391220,0ptp4l0-21swapper/409:10:124
125391220,0ptp4l0-21swapper/408:53:114
125391220,0ptp4l0-21swapper/408:40:194
125391220,0ptp4l0-21swapper/408:30:194
125391220,0ptp4l0-21swapper/408:25:234
125391220,0ptp4l0-21swapper/408:10:204
125391220,0ptp4l0-21swapper/408:05:324
125391220,0ptp4l0-21swapper/407:55:234
125391220,0ptp4l0-21swapper/407:45:274
125391220,0ptp4l0-21swapper/407:45:274
125391220,0ptp4l0-21swapper/212:05:012
125391220,0ptp4l0-21swapper/212:00:212
125391220,0ptp4l0-21swapper/209:54:062
125391220,0ptp4l0-21swapper/208:35:292
125391220,0ptp4l0-21swapper/208:16:532
125391220,0ptp4l0-21swapper/112:38:331
125391220,0ptp4l0-21swapper/112:01:291
125391220,0ptp4l0-21swapper/111:35:071
125391220,0ptp4l0-21swapper/110:55:201
125391220,0ptp4l0-21swapper/110:50:231
125391220,0ptp4l0-21swapper/109:20:201
125391220,0ptp4l0-21swapper/109:05:351
125391220,0ptp4l0-21swapper/109:00:211
125391220,0ptp4l0-21swapper/108:50:221
125391220,0ptp4l0-21swapper/108:45:281
125391220,0ptp4l0-21swapper/108:25:311
125391220,0ptp4l0-21swapper/108:20:211
125391220,0ptp4l0-21swapper/108:15:011
125391220,0ptp4l0-21swapper/108:05:241
125391220,0ptp4l0-21swapper/107:30:261
125391220,0ptp4l0-21swapper/107:15:261
125391220,0ptp4l0-21swapper/107:10:301
125391220,0ptp4l0-21swapper/012:20:270
125391220,0ptp4l0-21swapper/011:51:320
125391220,0ptp4l0-21swapper/011:31:580
125391220,0ptp4l0-21swapper/010:05:270
125391220,0ptp4l0-21swapper/009:40:360
125391220,0ptp4l0-21swapper/009:33:490
125391220,0ptp4l0-21swapper/008:45:190
125391220,0ptp4l0-21swapper/008:20:240
125391220,0ptp4l0-21swapper/008:10:220
125391220,0ptp4l0-21swapper/008:00:220
125391220,0ptp4l0-21swapper/007:55:210
125391220,0ptp4l0-21swapper/007:41:100
125391220,0ptp4l0-21swapper/007:30:340
125391210,1ptp4l3149-21sh10:10:406
125391210,0ptp4l0-21swapper/711:49:387
125391210,0ptp4l0-21swapper/710:00:037
125391210,0ptp4l0-21swapper/709:36:027
125391210,0ptp4l0-21swapper/611:12:256
125391210,0ptp4l0-21swapper/611:00:026
125391210,0ptp4l0-21swapper/510:25:435
125391210,0ptp4l0-21swapper/510:25:435
125391210,0ptp4l0-21swapper/509:05:275
125391210,0ptp4l0-21swapper/508:45:285
125391210,0ptp4l0-21swapper/508:35:015
125391210,0ptp4l0-21swapper/508:05:365
125391210,0ptp4l0-21swapper/411:13:234
125391210,0ptp4l0-21swapper/410:33:464
125391210,0ptp4l0-21swapper/410:01:504
125391210,0ptp4l0-21swapper/409:25:044
125391210,0ptp4l0-21swapper/408:40:004
125391210,0ptp4l0-21swapper/310:43:103
125391210,0ptp4l0-21swapper/211:15:002
125391210,0ptp4l0-21swapper/211:00:042
125391210,0ptp4l0-21swapper/111:18:241
125391210,0ptp4l0-21swapper/108:34:551
125391210,0ptp4l0-21swapper/107:59:011
125391210,0ptp4l0-21swapper/107:22:371
125391210,0ptp4l0-21swapper/012:18:170
125391210,0ptp4l0-21swapper/011:11:510
125391210,0ptp4l0-21swapper/010:54:270
125391210,0ptp4l0-21swapper/010:31:300
125391210,0ptp4l0-21swapper/009:59:510
125391210,0ptp4l0-21swapper/009:05:220
125391210,0ptp4l0-21swapper/007:20:000
125391200,0ptp4l0-21swapper/612:26:546
125391200,0ptp4l0-21swapper/607:29:286
125391200,0ptp4l0-21swapper/511:19:265
125391200,0ptp4l0-21swapper/411:47:124
125391200,0ptp4l0-21swapper/410:11:074
125391200,0ptp4l0-21swapper/410:05:304
125391200,0ptp4l0-21swapper/409:01:294
125391200,0ptp4l0-21swapper/407:18:124
125391200,0ptp4l0-21swapper/309:35:543
125391200,0ptp4l0-21swapper/210:10:392
125391200,0ptp4l0-21swapper/108:55:251
125391200,0ptp4l0-21swapper/108:42:021
125391200,0ptp4l0-21swapper/107:38:481
125391200,0ptp4l0-21swapper/012:00:400
125391200,0ptp4l0-21swapper/011:36:020
125391200,0ptp4l0-21swapper/011:07:440
125391200,0ptp4l0-21swapper/009:02:290
125391200,0ptp4l0-21swapper/007:17:300
125391190,0ptp4l0-21swapper/610:29:096
125391190,0ptp4l0-21swapper/610:29:096
125391190,0ptp4l0-21swapper/609:53:456
125391190,0ptp4l0-21swapper/607:53:286
125391190,0ptp4l0-21swapper/508:25:375
125391190,0ptp4l0-21swapper/507:47:375
125391190,0ptp4l0-21swapper/507:47:375
125391190,0ptp4l0-21swapper/412:00:424
125391190,0ptp4l0-21swapper/409:08:114
125391190,0ptp4l0-21swapper/311:49:353
125391190,0ptp4l0-21swapper/107:47:161
125391190,0ptp4l0-21swapper/107:47:161
125391180,0ptp4l0-21swapper/710:43:097
125391180,0ptp4l0-21swapper/508:55:265
125391180,0ptp4l0-21swapper/508:10:335
125391180,0ptp4l0-21swapper/411:07:454
125391180,0ptp4l0-21swapper/011:47:170
125391180,0ptp4l0-21swapper/007:36:370
93022170,1sleep233-21ksoftirqd/208:45:182
125391170,0ptp4l65-21ksoftirqd/611:37:316
125391170,0ptp4l0-21swapper/607:34:496
125391170,0ptp4l0-21swapper/508:32:425
125391170,0ptp4l0-21swapper/508:04:235
125391170,0ptp4l0-21swapper/507:55:465
125391160,0ptp4l0-21swapper/411:37:344
125391160,0ptp4l0-21swapper/407:14:294
125391160,0ptp4l0-21swapper/208:11:102
125391160,0ptp4l0-21swapper/207:52:372
125391160,0ptp4l0-21swapper/107:44:331
125391150,0ptp4l0-21swapper/608:15:366
125391150,0ptp4l0-21swapper/607:56:346
125391150,0ptp4l0-21swapper/508:41:465
125391150,0ptp4l0-21swapper/507:44:465
125391150,0ptp4l0-21swapper/507:36:465
125391150,0ptp4l0-21swapper/407:35:394
125391150,0ptp4l0-21swapper/407:25:374
125391150,0ptp4l0-21swapper/310:00:023
125391150,0ptp4l0-21swapper/207:49:472
125391150,0ptp4l0-21swapper/207:49:472
125391150,0ptp4l0-21swapper/207:30:022
125391150,0ptp4l0-21swapper/008:37:580
125391150,0ptp4l0-21swapper/008:17:050
125391150,0ptp4l0-21swapper/007:50:160
125391150,0ptp4l0-21swapper/007:25:350
125391150,0ptp4l0-21swapper/007:13:020
125391140,0ptp4l0-21swapper/608:48:136
125391140,0ptp4l0-21swapper/608:10:596
125391140,0ptp4l0-21swapper/207:56:292
2937299110,1cyclictest6746-21sh12:29:157
2937299110,1cyclictest0-21swapper/710:25:177
2937299110,1cyclictest0-21swapper/710:25:177
2937299110,10cyclictest0-21swapper/708:15:287
2936699119,1cyclictest0-21swapper/610:34:006
2936699110,10cyclictest0-21swapper/612:21:106
2936699110,10cyclictest0-21swapper/611:52:446
2936699110,10cyclictest0-21swapper/609:39:106
2934599110,10cyclictest0-21swapper/310:55:523
2934599110,10cyclictest0-21swapper/310:25:133
2934599110,10cyclictest0-21swapper/310:25:133
2933799119,1cyclictest13203-21ssh11:52:202
2933799110,10cyclictest0-21swapper/212:34:442
2933799110,10cyclictest0-21swapper/212:19:402
2933799110,10cyclictest0-21swapper/210:30:262
2937299100,9cyclictest0-21swapper/709:24:477
2936699109,0cyclictest0-21swapper/611:23:126
2936699109,0cyclictest0-21swapper/610:09:126
2936699100,9cyclictest0-21swapper/610:40:376
2936699100,0cyclictest0-21swapper/610:56:476
2936699100,0cyclictest0-21swapper/610:19:526
2936699100,0cyclictest0-21swapper/609:46:146
2934599109,0cyclictest0-21swapper/312:08:473
2934599109,0cyclictest0-21swapper/311:30:263
2934599109,0cyclictest0-21swapper/311:13:373
2934599109,0cyclictest0-21swapper/310:39:033
2934599109,0cyclictest0-21swapper/310:17:223
2934599109,0cyclictest0-21swapper/309:25:493
2934599109,0cyclictest0-21swapper/308:15:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional