You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-14 - 15:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4.osadl.org (updated Thu Jun 13, 2024 12:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25260213258,71sleep20-21swapper/207:07:292
25296212563,7sleep10-21swapper/107:07:571
25303211943,7sleep30-21swapper/307:08:033
25362210697,6sleep00-21swapper/007:08:480
266482810,1sleep326650-21idleruntime-cro08:30:003
271082670,0sleep027113-21cpuspeed_turbos08:30:130
56572600,0sleep10-21swapper/112:02:231
321792590,1sleep032182-21kthreadcore10:35:220
173292590,0sleep20-21swapper/207:55:152
75852570,0sleep30-21swapper/307:20:123
86892560,0sleep10-21swapper/108:15:001
56892560,0sleep30-21swapper/308:35:373
207622550,0sleep10-21swapper/107:55:261
317272540,0sleep30-21swapper/309:20:263
2562999340,33cyclictest0-21swapper/111:35:341
2562999311,29cyclictest0-21swapper/110:36:071
2562999311,19cyclictest0-21swapper/110:44:241
25629992925,2cyclictest15803-21munin-plugin-st10:10:001
2562999291,27cyclictest0-21swapper/110:10:541
2562999291,27cyclictest0-21swapper/109:58:081
2562999291,27cyclictest0-21swapper/109:23:561
2562999290,23cyclictest0-21swapper/112:05:011
2562999290,23cyclictest0-21swapper/111:13:401
2562999280,27cyclictest0-21swapper/111:19:131
2562999280,27cyclictest0-21swapper/110:22:511
2563399270,26cyclictest0-21swapper/211:18:442
2563399270,26cyclictest0-21swapper/208:44:292
2563399270,26cyclictest0-21swapper/207:46:522
2563399270,26cyclictest0-21swapper/207:43:162
25629992717,4cyclictest0-21swapper/110:27:031
2562999270,26cyclictest0-21swapper/107:46:311
2562999270,26cyclictest0-21swapper/107:32:431
2562999270,26cyclictest0-21swapper/107:26:371
2562999270,26cyclictest0-21swapper/107:16:461
2563399260,25cyclictest0-21swapper/212:09:172
2563399260,25cyclictest0-21swapper/211:55:552
2563399260,25cyclictest0-21swapper/210:41:512
2563399260,25cyclictest0-21swapper/208:20:022
25629992616,4cyclictest0-21swapper/111:33:041
2562999260,25cyclictest0-21swapper/109:00:081
2562999260,25cyclictest0-21swapper/107:11:011
2563399250,1cyclictest25753-21ssh09:18:532
25629992516,3cyclictest0-21swapper/112:16:141
25629992516,3cyclictest0-21swapper/112:16:131
2562999250,24cyclictest0-21swapper/108:09:501
2562799250,18cyclictest0-21swapper/009:35:300
2563399243,20cyclictest0-21swapper/210:13:152
2562999246,17cyclictest0-21swapper/110:16:391
2562999240,23cyclictest0-21swapper/110:55:211
2562999240,23cyclictest0-21swapper/109:19:331
25627992415,8cyclictest0-21swapper/011:39:310
844122319,3sleep30-21swapper/308:14:473
3237822319,3sleep30-21swapper/308:32:013
2563399232,20cyclictest0-21swapper/210:23:262
2563399231,21cyclictest0-21swapper/210:49:032
2563399231,16cyclictest0-21swapper/211:10:202
2563399230,22cyclictest0-21swapper/212:27:162
2563399230,22cyclictest0-21swapper/209:57:292
2563399230,22cyclictest0-21swapper/209:13:012
2563399230,22cyclictest0-21swapper/208:29:262
2563399230,17cyclictest0-21swapper/210:27:292
25629992319,3cyclictest0-21swapper/110:30:111
25629992318,4cyclictest0-21swapper/111:02:191
2562999230,22cyclictest0-21swapper/112:20:431
2562999230,22cyclictest0-21swapper/111:29:211
2562999230,22cyclictest0-21swapper/109:28:391
2562999230,21cyclictest0-21swapper/109:54:181
2562799230,22cyclictest0-21swapper/012:32:230
2562799230,22cyclictest0-21swapper/011:43:320
2562799230,22cyclictest0-21swapper/011:08:440
2562799230,22cyclictest0-21swapper/010:27:030
2562799230,22cyclictest0-21swapper/009:20:150
2562799230,22cyclictest0-21swapper/009:11:100
2265122319,3sleep30-21swapper/307:58:493
1751322319,3sleep30-21swapper/308:46:153
2563399222,19cyclictest0-21swapper/210:01:212
2563399222,19cyclictest0-21swapper/209:52:072
25633992213,8cyclictest0-21swapper/211:36:162
2563399221,20cyclictest0-21swapper/210:08:542
2563399221,20cyclictest0-21swapper/207:30:312
2563399221,19cyclictest0-21swapper/210:15:212
2563399220,3cyclictest0-21swapper/209:25:142
2563399220,21cyclictest0-21swapper/212:30:442
2563399220,21cyclictest0-21swapper/212:17:032
2563399220,21cyclictest0-21swapper/212:17:032
2563399220,21cyclictest0-21swapper/212:14:192
2563399220,21cyclictest0-21swapper/212:04:202
2563399220,21cyclictest0-21swapper/211:46:562
2563399220,21cyclictest0-21swapper/211:04:332
2563399220,21cyclictest0-21swapper/210:55:032
2563399220,21cyclictest0-21swapper/210:54:272
2563399220,21cyclictest0-21swapper/210:38:262
2563399220,21cyclictest0-21swapper/210:34:062
2563399220,21cyclictest0-21swapper/209:34:212
2563399220,21cyclictest0-21swapper/207:51:182
2562999222,19cyclictest0-21swapper/111:05:101
25629992214,7cyclictest0-21swapper/111:56:511
2562999221,3cyclictest0-21swapper/109:30:471
25629992213,8cyclictest0-21swapper/112:12:501
2562999221,20cyclictest0-21swapper/109:07:231
2562999220,21cyclictest0-21swapper/112:35:581
2562999220,21cyclictest0-21swapper/112:30:311
2562999220,21cyclictest0-21swapper/111:45:221
2562999220,21cyclictest0-21swapper/111:20:391
2562999220,21cyclictest0-21swapper/110:00:501
2562999220,21cyclictest0-21swapper/109:47:081
2562999220,21cyclictest0-21swapper/109:40:091
2562999220,21cyclictest0-21swapper/109:35:111
2562999220,21cyclictest0-21swapper/109:11:571
2562999220,16cyclictest0-21swapper/112:28:441
2562999220,16cyclictest0-21swapper/110:52:511
2562999220,16cyclictest0-21swapper/110:47:581
2562799228,13cyclictest0-21swapper/012:10:330
25627992216,6cyclictest0-21swapper/010:05:460
2562799221,20cyclictest0-21swapper/012:01:430
2562799221,20cyclictest0-21swapper/011:52:560
2562799220,21cyclictest0-21swapper/012:22:580
2562799220,21cyclictest0-21swapper/012:17:420
2562799220,21cyclictest0-21swapper/012:17:420
2562799220,21cyclictest0-21swapper/011:57:450
2562799220,21cyclictest0-21swapper/011:47:040
2562799220,21cyclictest0-21swapper/011:33:550
2562799220,21cyclictest0-21swapper/011:24:130
2562799220,21cyclictest0-21swapper/011:17:220
2562799220,21cyclictest0-21swapper/011:12:310
2562799220,21cyclictest0-21swapper/010:51:030
2562799220,21cyclictest0-21swapper/010:47:590
2562799220,21cyclictest0-21swapper/010:30:150
2562799220,21cyclictest0-21swapper/010:18:490
2562799220,21cyclictest0-21swapper/010:13:390
2562799220,21cyclictest0-21swapper/009:33:410
2562799220,16cyclictest0-21swapper/011:25:160
2562799220,16cyclictest0-21swapper/009:51:440
1443122218,3sleep30-21swapper/308:16:073
2563399212,14cyclictest0-21swapper/209:24:452
25633992119,1cyclictest10272-21snmpd09:46:562
2563399210,2cyclictest0-21swapper/212:37:462
2563399210,21cyclictest0-21swapper/211:40:332
2563399210,20cyclictest0-21swapper/211:54:402
2563399210,20cyclictest0-21swapper/208:08:412
2563399210,20cyclictest0-21swapper/207:36:582
2563399210,15cyclictest0-21swapper/209:41:062
25629992117,3cyclictest0-21swapper/108:00:091
2562999210,20cyclictest0-21swapper/111:52:221
2562999210,20cyclictest0-21swapper/111:40:231
2562999210,20cyclictest0-21swapper/108:18:591
2562999210,20cyclictest0-21swapper/107:40:371
2562999210,20cyclictest0-21swapper/107:20:551
25627992113,7cyclictest0-21swapper/010:44:010
2562799210,20cyclictest0-21swapper/012:36:090
2562799210,20cyclictest0-21swapper/010:56:590
2562799210,20cyclictest0-21swapper/009:55:250
2562799210,20cyclictest0-21swapper/009:40:030
2562799210,15cyclictest0-21swapper/010:02:360
2562799210,15cyclictest0-21swapper/009:16:520
2562799210,14cyclictest0-21swapper/012:08:330
1883122117,3sleep30-21swapper/307:27:123
2563399205,14cyclictest0-21swapper/208:55:372
25633992018,1cyclictest10272-21snmpd11:20:042
25633992018,1cyclictest10272-21snmpd08:15:432
25633992018,1cyclictest10272-21snmpd08:11:442
25633992017,2cyclictest10272-21snmpd09:35:232
25633992017,2cyclictest0-21swapper/212:20:312
25633992014,6cyclictest0-21swapper/211:25:572
2563399201,17cyclictest0-21swapper/211:05:202
2563399200,19cyclictest0-21swapper/208:50:492
2563399200,13cyclictest0-21swapper/211:32:112
25629992015,4cyclictest0-21swapper/108:25:171
25627992018,1cyclictest10272-21snmpd11:04:270
25627992012,6cyclictest0-21swapper/010:24:340
2562799200,19cyclictest0-21swapper/009:46:080
2562799200,14cyclictest0-21swapper/009:26:540
25633991917,1cyclictest10272-21snmpd08:47:442
25633991917,1cyclictest10272-21snmpd08:32:352
25633991917,1cyclictest10272-21snmpd08:04:162
25629991917,2cyclictest0-21swapper/108:21:351
25629991915,3cyclictest0-21swapper/108:45:091
2562799192,13cyclictest0-21swapper/009:00:320
25627991917,1cyclictest10272-21snmpd08:45:590
25627991917,1cyclictest10272-21snmpd08:41:140
25627991917,1cyclictest10272-21snmpd08:38:590
25627991917,1cyclictest10272-21snmpd08:22:230
25627991917,1cyclictest10272-21snmpd08:11:470
25627991917,1cyclictest10272-21snmpd07:50:190
25627991917,1cyclictest10272-21snmpd07:46:390
25627991917,1cyclictest10272-21snmpd07:28:460
25627991917,1cyclictest10272-21snmpd07:16:580
25627991912,6cyclictest0-21swapper/012:29:500
143302190,1sleep010-21rcuc/008:15:390
1291821916,2sleep30-21swapper/309:47:593
25633991816,1cyclictest10272-21snmpd09:02:262
25633991816,1cyclictest10272-21snmpd08:39:562
25633991816,1cyclictest10272-21snmpd07:27:282
25633991816,1cyclictest10272-21snmpd07:23:462
25633991816,1cyclictest10272-21snmpd07:17:552
25633991816,1cyclictest10272-21snmpd07:13:552
2562999185,8cyclictest385-21/usr/sbin/munin08:35:221
25629991816,2cyclictest0-21swapper/108:57:591
25629991816,2cyclictest0-21swapper/107:53:431
25629991815,3cyclictest0-21swapper/108:33:291
25629991814,3cyclictest0-21swapper/108:41:381
25629991814,3cyclictest0-21swapper/107:37:131
2562799183,14cyclictest0-21swapper/007:20:300
25627991816,1cyclictest10272-21snmpd08:58:560
25627991816,1cyclictest10272-21snmpd08:07:370
25627991816,1cyclictest10272-21snmpd07:56:340
25627991816,1cyclictest10272-21snmpd07:12:340
1180021811,4sleep30-21swapper/310:59:493
3134221713,3sleep30-21swapper/307:39:273
3108221713,3sleep30-21swapper/307:10:393
25633991714,2cyclictest7536-21grep09:05:262
25629991715,2cyclictest0-21swapper/108:53:051
25627991715,1cyclictest10272-21snmpd09:06:290
25627991715,1cyclictest10272-21snmpd08:00:010
25627991715,1cyclictest10272-21snmpd07:42:370
25627991715,1cyclictest10272-21snmpd07:35:130
25627991715,1cyclictest10272-21snmpd07:32:280
2470921712,3sleep30-21swapper/309:17:273
1107021711,3sleep30-21swapper/309:29:093
25627991614,1cyclictest10272-21snmpd08:27:020
1810621611,2sleep30-21swapper/309:31:253
93032159,3sleep30-21swapper/312:21:573
49592159,3sleep30-21swapper/309:44:153
327422151,3sleep30-21swapper/312:16:573
327422151,3sleep30-21swapper/312:16:563
274852159,3sleep30-21swapper/309:37:383
208482151,4sleep30-21swapper/311:03:263
72552140,4sleep30-21swapper/311:12:153
310232148,3sleep30-21swapper/310:16:363
2943621410,3sleep30-21swapper/308:58:453
25627991412,1cyclictest10272-21snmpd08:53:020
1687921411,2sleep30-21swapper/307:54:573
16132142,3sleep30-21swapper/310:54:043
1530621411,2sleep30-21swapper/310:44:113
145442148,3sleep30-21swapper/312:06:593
133492142,3sleep30-21swapper/310:05:503
61072131,3sleep30-21swapper/307:45:323
318492137,3sleep30-21swapper/311:09:273
28172137,3sleep30-21swapper/309:02:413
2746821310,2sleep30-21swapper/311:22:563
24742139,3sleep30-21swapper/308:09:263
246322139,3sleep30-21swapper/307:31:343
244122139,3sleep30-21swapper/311:39:033
211842131,3sleep30-21swapper/309:52:523
192472137,3sleep30-21swapper/310:29:173
129882137,3sleep30-21swapper/311:31:393
117112139,3sleep30-21swapper/308:42:193
87152127,3sleep30-21swapper/309:07:463
272162126,3sleep30-21swapper/311:56:063
173162126,3sleep30-21swapper/311:50:363
161622121,2sleep30-21swapper/310:45:033
58332115,3sleep30-21swapper/310:02:373
311022115,3sleep30-21swapper/312:00:063
306892115,3sleep30-21swapper/309:58:493
292242110,2sleep30-21swapper/312:32:583
285262115,3sleep30-21swapper/310:33:583
27772115,3sleep30-21swapper/311:25:453
202002115,3sleep30-21swapper/312:28:423
90922103,4sleep30-21swapper/311:47:323
75492104,3sleep30-21swapper/312:39:233
40892104,3sleep30-21swapper/310:36:583
325582105,3sleep30-21swapper/307:40:193
288112105,3sleep30-21swapper/308:02:023
251352104,3sleep30-21swapper/312:13:403
165192104,3sleep30-21swapper/309:13:353
32157294,3sleep30-21swapper/311:41:553
22746293,3sleep30-21swapper/310:12:073
17096294,2sleep30-21swapper/311:17:203
1532295,3sleep30-21swapper/307:15:113
2644281,4sleep30-21swapper/310:20:243
20642284,3sleep30-21swapper/308:24:283
23348272,3sleep30-21swapper/308:50:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional