You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-22 - 01:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot3.osadl.org (updated Thu Sep 21, 2023 12:45:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9319422358317,14sleep150-21swapper/1507:09:057
9318172352332,14sleep10-21swapper/107:07:151
9319742348311,31sleep110-21swapper/1107:09:333
9317672348308,13sleep60-21swapper/607:06:3112
9319342346324,15sleep80-21swapper/807:08:5814
9287292344324,14sleep90-21swapper/907:05:1415
9318522343324,13sleep00-21swapper/007:07:460
9319462342306,29sleep20-21swapper/207:09:088
9317732342322,14sleep120-21swapper/1207:06:374
9317682342321,14sleep70-21swapper/707:06:3113
9318552339321,12sleep30-21swapper/307:07:499
9319222338317,14sleep140-21swapper/1407:08:476
9317322338318,14sleep100-21swapper/1007:06:032
9319972336317,13sleep130-21swapper/1307:09:515
9317662336316,14sleep50-21swapper/507:06:3011
9318932335315,14sleep40-21swapper/407:08:2210
9322289912237,44cyclictest1190662-21rm10:46:244
932216999251,20cyclictest1254006-21python311:25:300
932216997916,21cyclictest0-21swapper/011:57:220
932216997916,21cyclictest0-21swapper/011:23:480
932216997916,21cyclictest0-21swapper/010:05:360
932216997916,21cyclictest0-21swapper/009:50:040
932216997916,0cyclictest0-21swapper/012:12:440
932216997916,0cyclictest0-21swapper/011:34:420
932216997916,0cyclictest0-21swapper/010:46:120
932216997916,0cyclictest0-21swapper/009:01:520
932216997816,0cyclictest0-21swapper/012:31:320
932216997816,0cyclictest0-21swapper/009:24:480
932216997815,21cyclictest0-21swapper/011:36:260
932216997736,21cyclictest1178580-21ssh10:40:040
932216997613,21cyclictest0-21swapper/010:58:420
932216997613,21cyclictest0-21swapper/007:32:580
932216997513,20cyclictest0-21swapper/008:01:300
932216997413,19cyclictest0-21swapper/007:46:100
932216997333,20cyclictest1153051-21basename10:25:000
932216997311,42cyclictest0-21swapper/008:27:400
93221699729,21cyclictest0-21swapper/008:14:120
93221699709,20cyclictest0-21swapper/012:20:580
93222899682,42cyclictest0-21swapper/1211:51:404
93221699674,21cyclictest0-21swapper/009:55:300
93221699674,21cyclictest0-21swapper/007:50:070
93222899653,21cyclictest0-21swapper/1209:14:324
93222899652,42cyclictest0-21swapper/1212:09:364
93222899652,42cyclictest0-21swapper/1212:09:364
93222899652,42cyclictest0-21swapper/1211:57:244
93222899643,21cyclictest0-21swapper/1211:03:384
93222899643,20cyclictest0-21swapper/1210:00:004
932228996423,41cyclictest1031557-21diskmemload11:40:504
93222899630,21cyclictest0-21swapper/1212:24:344
93222899630,21cyclictest0-21swapper/1208:46:104
93221699630,21cyclictest0-21swapper/011:15:080
93221699630,21cyclictest0-21swapper/011:15:080
932228996217,21cyclictest0-21swapper/1210:56:444
932228996217,21cyclictest0-21swapper/1208:53:304
932228996217,21cyclictest0-21swapper/1207:24:044
93222899620,41cyclictest0-21swapper/1212:11:064
93222899620,21cyclictest0-21swapper/1212:26:414
93222899620,21cyclictest0-21swapper/1210:05:124
93222899620,20cyclictest0-21swapper/1212:38:164
93222899620,20cyclictest0-21swapper/1210:10:204
93221699620,42cyclictest0-21swapper/012:15:460
932228996116,21cyclictest0-21swapper/1208:16:024
932228996116,21cyclictest0-21swapper/1208:07:044
932228996116,21cyclictest0-21swapper/1207:52:424
932228996116,21cyclictest0-21swapper/1207:19:204
93222899610,19cyclictest0-21swapper/1211:05:144
93222899610,19cyclictest0-21swapper/1209:49:384
932228996016,42cyclictest0-21swapper/1208:02:594
932228996016,21cyclictest1031557-21diskmemload11:13:244
932228996016,21cyclictest1031557-21diskmemload11:13:244
932228996016,21cyclictest0-21swapper/1207:46:364
932228996016,20cyclictest0-21swapper/1209:15:064
932228996015,21cyclictest0-21swapper/1208:59:284
93222899600,60cyclictest0-21swapper/1207:39:324
93222899600,18cyclictest0-21swapper/1211:22:524
93222899600,18cyclictest0-21swapper/1210:18:084
932216996019,41cyclictest1218714-21munin-run11:05:000
932216996016,0cyclictest0-21swapper/010:25:140
93221699600,20cyclictest0-21swapper/012:05:000
932228995917,42cyclictest0-21swapper/1211:27:124
932228995917,42cyclictest0-21swapper/1209:37:484
932228995917,21cyclictest0-21swapper/1210:40:344
932228995917,21cyclictest0-21swapper/1209:20:504
932228995916,42cyclictest0-21swapper/1209:50:564
932228995914,42cyclictest0-21swapper/1211:39:374
932228995914,21cyclictest0-21swapper/1210:50:484
932228995914,21cyclictest0-21swapper/1208:14:084
932228995914,21cyclictest0-21swapper/1207:32:504
932228995914,21cyclictest0-21swapper/1207:28:044
932228995914,21cyclictest0-21swapper/1207:13:194
93222899590,18cyclictest0-21swapper/1210:02:344
932216995917,0cyclictest0-21swapper/011:44:160
932216995917,0cyclictest0-21swapper/008:54:080
932216995917,0cyclictest0-21swapper/007:37:300
10640252590,0sleep60-21swapper/609:29:3612
932228995817,21cyclictest0-21swapper/1211:31:304
932228995817,21cyclictest0-21swapper/1209:34:424
932228995817,21cyclictest0-21swapper/1209:09:464
932228995817,21cyclictest0-21swapper/1208:24:584
932228995817,21cyclictest0-21swapper/1207:41:084
932228995814,21cyclictest0-21swapper/1209:43:304
932228995813,21cyclictest0-21swapper/1209:04:344
932216995817,21cyclictest0-21swapper/011:53:140
932216995817,21cyclictest0-21swapper/009:11:380
932216995817,0cyclictest0-21swapper/010:18:120
932216995817,0cyclictest0-21swapper/008:40:160
932216995817,0cyclictest0-21swapper/008:16:170
932216995816,0cyclictest0-21swapper/012:38:480
932216995816,0cyclictest0-21swapper/011:49:120
932216995816,0cyclictest0-21swapper/011:13:280
932216995816,0cyclictest0-21swapper/011:13:280
932216995816,0cyclictest0-21swapper/011:09:120
932216995816,0cyclictest0-21swapper/010:36:580
932216995816,0cyclictest0-21swapper/010:36:580
932216995816,0cyclictest0-21swapper/010:11:440
932216995816,0cyclictest0-21swapper/009:46:400
932216995816,0cyclictest0-21swapper/008:58:120
932216995816,0cyclictest0-21swapper/008:37:040
932216995815,0cyclictest0-21swapper/012:26:040
932228995716,21cyclictest0-21swapper/1212:03:124
932228995716,21cyclictest0-21swapper/1208:39:464
932228995716,21cyclictest0-21swapper/1208:30:484
932228995716,21cyclictest0-21swapper/1208:29:364
932228995715,21cyclictest0-21swapper/1211:19:144
932228995715,21cyclictest0-21swapper/1211:19:144
932228995715,21cyclictest0-21swapper/1207:55:084
932216995716,21cyclictest0-21swapper/008:07:300
932216995716,0cyclictest0-21swapper/010:54:020
932216995716,0cyclictest0-21swapper/010:04:420
932216995716,0cyclictest0-21swapper/009:30:040
932216995716,0cyclictest0-21swapper/009:26:100
932216995716,0cyclictest0-21swapper/009:16:200
932216995716,0cyclictest0-21swapper/007:40:120
932216995716,0cyclictest0-21swapper/007:28:430
932216995715,42cyclictest0-21swapper/007:20:180
932216995715,0cyclictest0-21swapper/012:09:160
932216995715,0cyclictest0-21swapper/012:09:160
932216995715,0cyclictest0-21swapper/010:32:160
9806542560,0sleep10-21swapper/108:05:261
932228995616,20cyclictest0-21swapper/1210:20:264
932228995615,21cyclictest0-21swapper/1211:48:124
932228995615,21cyclictest0-21swapper/1210:26:424
932228995615,21cyclictest0-21swapper/1208:43:164
932216995615,21cyclictest0-21swapper/009:44:320
932216995615,21cyclictest0-21swapper/008:30:340
932216995615,0cyclictest932865-21/usr/sbin/munin07:10:200
932216995614,42cyclictest0-21swapper/007:19:460
932216995614,0cyclictest0-21swapper/008:45:510
12267342560,1sleep8721rcuc/811:10:0014
932228995510,42cyclictest0-21swapper/1212:15:224
932216995513,0cyclictest0-21swapper/007:55:560
93222899549,21cyclictest0-21swapper/1209:25:304
932216995412,0cyclictest0-21swapper/009:39:320
932216995313,20cyclictest0-21swapper/009:07:120
93221699519,0cyclictest0-21swapper/008:24:160
93222899477,20cyclictest0-21swapper/1212:32:344
93222899477,20cyclictest0-21swapper/1210:34:024
93222199440,44cyclictest0-21swapper/510:25:1411
93222899421,21cyclictest0-21swapper/1210:35:224
93222899421,21cyclictest0-21swapper/1210:35:224
93222699420,42cyclictest0-21swapper/1011:18:102
93222699420,42cyclictest0-21swapper/1011:18:102
93222699420,42cyclictest0-21swapper/1008:46:442
93222699420,42cyclictest0-21swapper/1008:28:442
93222699420,42cyclictest0-21swapper/1007:22:042
93222199420,42cyclictest0-21swapper/511:31:2411
93222199420,0cyclictest0-21swapper/508:16:1811
93222199420,0cyclictest0-21swapper/507:28:4411
93222699410,41cyclictest0-21swapper/1010:59:322
93222699410,41cyclictest0-21swapper/1007:47:312
93222199410,0cyclictest0-21swapper/510:04:4211
93222699400,40cyclictest0-21swapper/1011:08:282
11362672380,0sleep20-21swapper/210:14:078
13690782340,0sleep50-21swapper/512:37:3111
10485622330,1sleep71048563-21latency_hist09:20:0013
12579832320,0sleep110-21swapper/1111:29:173
93222199310,0cyclictest0-21swapper/511:13:2911
93222199310,0cyclictest0-21swapper/511:13:2811
93222199310,0cyclictest0-21swapper/508:52:0211
932220993115,13cyclictest1209437-21kworker/4:111:23:5210
93222399300,0cyclictest0-21swapper/712:30:1613
932222993029,1cyclictest1048953-21kworker/6:010:40:5812
93222199300,0cyclictest0-21swapper/510:32:2411
932227992929,0cyclictest886463-21kworker/11:108:39:453
10042572290,0sleep141141rcuc/1408:35:016
932230992817,11cyclictest186775-21kworker/14:009:16:186
932218992828,0cyclictest999509-21kworker/2:110:18:188
932222992727,0cyclictest3496713-21kworker/6:208:05:5412
93221899260,26cyclictest999509-21kworker/2:109:16:188
93221899250,25cyclictest1177887-21kworker/2:211:40:348
93222799240,13cyclictest94-21ksoftirqd/1110:29:543
93221899240,24cyclictest0-21swapper/211:54:028
932227992323,0cyclictest0-21swapper/1111:13:313
932227992323,0cyclictest0-21swapper/1111:13:303
93222799230,17cyclictest141rcu_preempt09:18:543
932222992322,1cyclictest25050irq/128-ahci[0011:46:3612
932218992323,0cyclictest0-21swapper/212:15:228
932218992323,0cyclictest0-21swapper/209:23:558
932227992222,0cyclictest0-21swapper/1110:10:203
932227992222,0cyclictest0-21swapper/1109:59:003
932224992221,1cyclictest957762-21kworker/8:109:08:5814
932224992221,1cyclictest2209623-21kworker/8:007:30:2514
932224992221,1cyclictest1190777-21kworker/8:211:55:1714
932224992221,1cyclictest1190777-21kworker/8:211:31:5214
932224992221,1cyclictest1070833-21kworker/8:109:44:2014
932224992218,4cyclictest1070833-21kworker/8:110:25:1414
932222992221,1cyclictest25050irq/128-ahci[0011:02:5212
932220992222,0cyclictest235164-21kworker/4:009:10:3210
932220992221,1cyclictest235164-21kworker/4:010:55:0610
932220992221,1cyclictest235164-21kworker/4:010:53:2410
932220992221,1cyclictest235164-21kworker/4:010:46:4810
932220992221,1cyclictest235164-21kworker/4:010:36:0210
932220992221,1cyclictest235164-21kworker/4:010:36:0210
932220992221,1cyclictest235164-21kworker/4:010:30:0210
932220992221,1cyclictest235164-21kworker/4:010:26:2810
932220992221,1cyclictest235164-21kworker/4:010:24:1810
932220992221,1cyclictest235164-21kworker/4:010:17:1210
932220992221,1cyclictest235164-21kworker/4:010:10:2810
932220992221,1cyclictest235164-21kworker/4:010:05:4610
932220992221,1cyclictest235164-21kworker/4:010:03:4610
932220992221,1cyclictest235164-21kworker/4:009:56:1010
932220992221,1cyclictest235164-21kworker/4:009:50:2610
932220992221,1cyclictest235164-21kworker/4:009:47:3810
932220992221,1cyclictest235164-21kworker/4:009:42:4810
932220992221,1cyclictest235164-21kworker/4:009:38:5010
932220992221,1cyclictest235164-21kworker/4:009:30:3410
932220992221,1cyclictest235164-21kworker/4:009:27:4610
932220992221,1cyclictest235164-21kworker/4:009:20:0410
932220992221,1cyclictest235164-21kworker/4:009:17:2010
932220992221,1cyclictest235164-21kworker/4:009:00:2810
932220992221,1cyclictest235164-21kworker/4:008:43:2010
932220992221,1cyclictest235164-21kworker/4:008:30:2010
932220992221,1cyclictest235164-21kworker/4:008:15:2210
932220992221,1cyclictest235164-21kworker/4:007:45:3010
932220992221,1cyclictest235164-21kworker/4:007:32:3210
932220992221,1cyclictest235164-21kworker/4:007:11:3010
932220992221,1cyclictest1209437-21kworker/4:112:27:1410
932220992221,1cyclictest1209437-21kworker/4:112:21:5410
932220992221,1cyclictest1209437-21kworker/4:112:16:3610
932220992221,1cyclictest1209437-21kworker/4:112:10:1010
932220992221,1cyclictest1209437-21kworker/4:112:06:0510
932220992221,1cyclictest1209437-21kworker/4:112:06:0410
932220992221,1cyclictest1209437-21kworker/4:112:00:3410
932220992221,1cyclictest1209437-21kworker/4:111:58:4210
932220992221,1cyclictest1209437-21kworker/4:111:50:0210
932220992221,1cyclictest1209437-21kworker/4:111:49:5610
932220992221,1cyclictest1209437-21kworker/4:111:40:5210
932220992221,1cyclictest1209437-21kworker/4:111:32:4210
932220992221,1cyclictest1209437-21kworker/4:111:25:2810
932220992221,1cyclictest1209437-21kworker/4:111:16:2610
932220992221,1cyclictest1209437-21kworker/4:111:16:2610
932220992221,1cyclictest1209437-21kworker/4:111:10:1610
932220992221,1cyclictest1209437-21kworker/4:111:10:1610
932220992221,1cyclictest1209437-21kworker/4:111:05:2410
932220992221,1cyclictest1209437-21kworker/4:111:01:2410
932220992220,1cyclictest235164-21kworker/4:007:50:1810
93221899220,22cyclictest0-21swapper/212:20:268
93223199210,21cyclictest0-21swapper/1512:31:247
93223199210,21cyclictest0-21swapper/1512:10:347
93223199210,21cyclictest0-21swapper/1512:01:547
93223199210,21cyclictest0-21swapper/1511:59:467
93223199210,21cyclictest0-21swapper/1511:23:467
93223199210,21cyclictest0-21swapper/1511:18:267
93223199210,21cyclictest0-21swapper/1511:18:267
93223199210,21cyclictest0-21swapper/1510:20:107
93223199210,21cyclictest0-21swapper/1509:24:287
93223199210,21cyclictest0-21swapper/1508:43:327
93223199210,21cyclictest0-21swapper/1507:39:327
93223199210,21cyclictest0-21swapper/1507:22:507
93223099210,21cyclictest0-21swapper/1408:07:306
932227992121,0cyclictest0-21swapper/1109:44:283
932227992120,1cyclictest1036228-21kworker/11:209:52:363
93222799210,21cyclictest0-21swapper/1107:58:423
93222699210,21cyclictest0-21swapper/1010:07:382
93222699210,21cyclictest0-21swapper/1008:36:122
93222699210,21cyclictest0-21swapper/1008:14:182
93222699210,21cyclictest0-21swapper/1008:02:282
93222699210,21cyclictest0-21swapper/1007:52:242
93222699210,18cyclictest0-21swapper/1007:36:352
932225992120,1cyclictest891391-21kworker/9:009:16:1815
932224992121,0cyclictest957762-21kworker/8:109:15:1614
932224992121,0cyclictest957762-21kworker/8:109:10:2614
932224992121,0cyclictest957762-21kworker/8:109:01:1414
932224992121,0cyclictest957762-21kworker/8:108:56:0214
932224992121,0cyclictest957762-21kworker/8:108:50:1814
932224992121,0cyclictest957762-21kworker/8:108:45:5914
932224992121,0cyclictest957762-21kworker/8:108:41:4614
932224992121,0cyclictest957762-21kworker/8:108:35:1214
932224992121,0cyclictest957762-21kworker/8:108:30:3414
932224992121,0cyclictest957762-21kworker/8:108:21:0414
932224992121,0cyclictest957762-21kworker/8:108:15:1214
932224992121,0cyclictest957762-21kworker/8:108:11:4614
932224992121,0cyclictest957762-21kworker/8:108:07:4814
932224992121,0cyclictest957762-21kworker/8:108:00:5214
932224992121,0cyclictest957762-21kworker/8:107:55:4614
932224992121,0cyclictest957762-21kworker/8:107:50:1214
932224992121,0cyclictest957762-21kworker/8:107:46:1214
932224992121,0cyclictest957762-21kworker/8:107:40:1214
932224992121,0cyclictest2209623-21kworker/8:007:35:3814
932224992121,0cyclictest2209623-21kworker/8:007:26:1814
932224992121,0cyclictest2209623-21kworker/8:007:20:1014
932224992121,0cyclictest2209623-21kworker/8:007:17:4014
932224992121,0cyclictest2209623-21kworker/8:007:11:4814
932224992121,0cyclictest1190777-21kworker/8:212:38:0414
932224992121,0cyclictest1190777-21kworker/8:212:20:4214
932224992121,0cyclictest1190777-21kworker/8:212:18:4314
932224992121,0cyclictest1190777-21kworker/8:212:10:5014
932224992121,0cyclictest1190777-21kworker/8:212:06:5814
932224992121,0cyclictest1190777-21kworker/8:212:06:5814
932224992121,0cyclictest1190777-21kworker/8:212:01:2814
932224992121,0cyclictest1190777-21kworker/8:211:51:3614
932224992121,0cyclictest1190777-21kworker/8:211:45:5314
932224992121,0cyclictest1190777-21kworker/8:211:27:2814
932224992121,0cyclictest1190777-21kworker/8:211:16:4914
932224992121,0cyclictest1190777-21kworker/8:211:16:4814
932224992121,0cyclictest1190777-21kworker/8:211:00:1014
932224992121,0cyclictest1190777-21kworker/8:210:55:1414
932224992121,0cyclictest1070833-21kworker/8:110:45:3214
932224992121,0cyclictest1070833-21kworker/8:110:41:4414
932224992121,0cyclictest1070833-21kworker/8:110:39:3814
932224992121,0cyclictest1070833-21kworker/8:110:39:3814
932224992121,0cyclictest1070833-21kworker/8:110:20:5814
932224992121,0cyclictest1070833-21kworker/8:110:16:3614
932224992121,0cyclictest1070833-21kworker/8:110:12:2414
932224992121,0cyclictest1070833-21kworker/8:110:05:2814
932224992121,0cyclictest1070833-21kworker/8:110:04:1214
932224992121,0cyclictest1070833-21kworker/8:109:50:1014
932224992121,0cyclictest1070833-21kworker/8:109:47:2814
932224992121,0cyclictest1070833-21kworker/8:109:36:1014
932224992121,0cyclictest1054910-21kworker/8:209:30:3614
932224992121,0cyclictest1054910-21kworker/8:209:24:2614
932224992120,1cyclictest1190777-21kworker/8:211:44:4214
932224992120,1cyclictest1070833-21kworker/8:109:55:2014
93222399210,21cyclictest0-21swapper/710:26:1813
93222399210,21cyclictest0-21swapper/708:25:1613
93222199210,21cyclictest0-21swapper/512:31:2411
93222199210,21cyclictest0-21swapper/512:10:0411
93222199210,21cyclictest0-21swapper/512:06:2011
93222199210,21cyclictest0-21swapper/512:06:2011
93222199210,21cyclictest0-21swapper/512:01:5411
93222199210,21cyclictest0-21swapper/511:23:4611
93222199210,21cyclictest0-21swapper/511:18:2611
93222199210,21cyclictest0-21swapper/511:18:2611
93222199210,21cyclictest0-21swapper/511:08:0811
93222199210,21cyclictest0-21swapper/510:46:4811
93222199210,21cyclictest0-21swapper/510:20:1011
93222199210,21cyclictest0-21swapper/510:19:5411
93222199210,21cyclictest0-21swapper/510:09:2811
93222199210,21cyclictest0-21swapper/509:24:2811
93222199210,21cyclictest0-21swapper/509:12:0011
93222199210,21cyclictest0-21swapper/509:07:4011
93222199210,21cyclictest0-21swapper/508:44:1011
93222199210,21cyclictest0-21swapper/508:05:5411
93222199210,21cyclictest0-21swapper/507:39:3211
93222199210,0cyclictest0-21swapper/509:50:0411
932220992121,0cyclictest235164-21kworker/4:009:05:0810
932220992121,0cyclictest235164-21kworker/4:008:55:3810
932220992121,0cyclictest235164-21kworker/4:008:50:0810
932220992121,0cyclictest235164-21kworker/4:008:45:0410
932220992121,0cyclictest235164-21kworker/4:008:35:1110
932220992121,0cyclictest235164-21kworker/4:008:25:1210
932220992121,0cyclictest235164-21kworker/4:008:12:0810
932220992121,0cyclictest235164-21kworker/4:008:06:0110
932220992121,0cyclictest235164-21kworker/4:008:00:2410
932220992121,0cyclictest235164-21kworker/4:007:25:0810
932220992121,0cyclictest235164-21kworker/4:007:15:1510
932220992121,0cyclictest1209437-21kworker/4:112:35:4010
932220992120,1cyclictest235164-21kworker/4:010:40:4010
932220992120,1cyclictest235164-21kworker/4:008:20:1010
932220992120,1cyclictest235164-21kworker/4:007:55:3610
932220992120,1cyclictest235164-21kworker/4:007:40:0310
932220992120,1cyclictest235164-21kworker/4:007:35:2410
932220992120,1cyclictest235164-21kworker/4:007:21:5410
932220992120,1cyclictest1209437-21kworker/4:112:30:3510
932220992120,1cyclictest1209437-21kworker/4:111:35:3210
932219992121,0cyclictest0-21swapper/311:49:469
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional