You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 06:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4.osadl.org (updated Sat Jul 27, 2024 00:44:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
87852124115,6sleep10-21swapper/119:06:401
8755212462,8sleep30-21swapper/319:06:183
87422118109,6sleep00-21swapper/019:06:060
8851210996,7sleep20-21swapper/219:07:342
269342960,6sleep1922599cyclictest23:52:421
260952690,1sleep229-21rcuc/222:30:192
221442680,0sleep20-21swapper/223:36:162
291462630,1sleep08-21rcu_preempt21:10:180
59582610,0sleep00-21swapper/023:03:050
240092590,0sleep10-21swapper/122:30:181
199872590,0sleep00-21swapper/020:35:210
103322570,0sleep20-21swapper/223:31:242
29802550,0sleep10-21swapper/121:40:191
192962550,0sleep20-21swapper/223:09:132
93602530,0sleep20-21swapper/200:28:322
230592450,0sleep20-21swapper/222:43:172
922199330,25cyclictest0-21swapper/000:00:100
922199300,2cyclictest17434-21ssh22:55:120
923099271,25cyclictest0-21swapper/222:39:022
923099270,26cyclictest0-21swapper/221:32:562
923099270,26cyclictest0-21swapper/221:14:302
923099270,26cyclictest0-21swapper/219:28:262
922599270,26cyclictest0-21swapper/122:18:031
923099261,24cyclictest0-21swapper/223:13:042
923099260,25cyclictest0-21swapper/223:52:452
923099260,25cyclictest0-21swapper/220:36:232
923099260,24cyclictest4065-21ssh21:27:032
9225992610,15cyclictest0-21swapper/122:23:081
922599260,25cyclictest0-21swapper/120:56:591
9230992523,2cyclictest0-21swapper/223:21:222
9230992523,2cyclictest0-21swapper/223:21:222
923099250,24cyclictest0-21swapper/200:20:162
922599250,24cyclictest0-21swapper/123:18:331
922599250,24cyclictest0-21swapper/122:40:071
922599250,24cyclictest0-21swapper/100:34:561
922199251,23cyclictest0-21swapper/023:47:300
922199250,24cyclictest0-21swapper/022:07:350
923099247,15cyclictest0-21swapper/223:43:382
923099240,23cyclictest0-21swapper/222:47:292
923099240,23cyclictest0-21swapper/222:11:242
923099240,23cyclictest0-21swapper/219:30:282
923099240,23cyclictest0-21swapper/219:14:282
923099240,23cyclictest0-21swapper/200:11:322
9225992416,7cyclictest0-21swapper/121:13:411
922599241,22cyclictest0-21swapper/119:44:551
922599240,9cyclictest0-21swapper/119:15:091
922599240,23cyclictest0-21swapper/123:33:511
922599240,23cyclictest0-21swapper/122:47:061
922599240,23cyclictest0-21swapper/122:38:221
922599240,23cyclictest0-21swapper/121:54:571
922599240,23cyclictest0-21swapper/100:27:441
922599240,18cyclictest0-21swapper/122:50:091
922599240,18cyclictest0-21swapper/100:02:471
9221992416,7cyclictest0-21swapper/022:14:400
9221992415,8cyclictest0-21swapper/023:35:410
922199240,23cyclictest0-21swapper/021:35:290
922199240,23cyclictest0-21swapper/021:32:130
922199240,23cyclictest0-21swapper/000:21:370
923099232,20cyclictest0-21swapper/222:02:442
923099232,20cyclictest0-21swapper/221:42:392
923099231,21cyclictest0-21swapper/220:50:112
923099230,22cyclictest0-21swapper/222:55:532
923099230,22cyclictest0-21swapper/221:50:262
923099230,22cyclictest0-21swapper/221:35:042
923099230,22cyclictest0-21swapper/221:18:182
923099230,22cyclictest0-21swapper/200:03:472
922599237,15cyclictest0-21swapper/123:58:561
9225992316,7cyclictest0-21swapper/123:11:181
9225992314,8cyclictest0-21swapper/121:47:311
922599230,23cyclictest0-21swapper/120:38:371
922599230,22cyclictest0-21swapper/123:43:551
922599230,22cyclictest0-21swapper/123:28:561
922599230,22cyclictest0-21swapper/123:22:451
922599230,22cyclictest0-21swapper/123:22:441
922599230,22cyclictest0-21swapper/123:01:461
922599230,22cyclictest0-21swapper/121:38:451
922599230,22cyclictest0-21swapper/121:16:091
922599230,22cyclictest0-21swapper/100:37:261
922599230,22cyclictest0-21swapper/100:19:461
922599230,22cyclictest0-21swapper/100:09:101
922599230,17cyclictest0-21swapper/123:09:321
922599230,17cyclictest0-21swapper/122:58:411
922599230,17cyclictest0-21swapper/122:25:221
922599230,17cyclictest0-21swapper/121:33:061
9221992316,7cyclictest0-21swapper/000:10:150
922199231,21cyclictest0-21swapper/023:34:140
922199231,21cyclictest0-21swapper/021:55:010
922199231,16cyclictest0-21swapper/022:16:500
922199230,22cyclictest0-21swapper/023:55:480
922199230,22cyclictest0-21swapper/023:44:310
922199230,22cyclictest0-21swapper/023:27:300
922199230,22cyclictest0-21swapper/023:14:240
922199230,22cyclictest0-21swapper/022:32:140
922199230,22cyclictest0-21swapper/022:03:150
922199230,22cyclictest0-21swapper/021:44:140
922199230,22cyclictest0-21swapper/021:25:400
922199230,22cyclictest0-21swapper/000:36:350
922199230,22cyclictest0-21swapper/000:27:240
922199230,17cyclictest0-21swapper/023:20:460
922199230,17cyclictest0-21swapper/023:20:450
922199230,17cyclictest0-21swapper/000:08:020
923099226,14cyclictest0-21swapper/222:19:202
923099222,19cyclictest0-21swapper/223:04:312
923099221,3cyclictest0-21swapper/223:57:262
923099221,20cyclictest0-21swapper/222:51:242
923099220,21cyclictest0-21swapper/222:06:322
923099220,21cyclictest0-21swapper/221:57:402
923099220,21cyclictest0-21swapper/200:19:262
923099220,21cyclictest0-21swapper/200:07:262
923099220,16cyclictest0-21swapper/223:17:432
922599220,21cyclictest0-21swapper/123:48:211
922599220,21cyclictest0-21swapper/122:11:511
922599220,21cyclictest0-21swapper/122:07:041
922599220,21cyclictest0-21swapper/121:25:471
922599220,21cyclictest0-21swapper/120:54:521
922599220,21cyclictest0-21swapper/120:05:101
922599220,21cyclictest0-21swapper/100:22:171
922599220,21cyclictest0-21swapper/100:12:491
922599220,16cyclictest0-21swapper/122:02:451
922199221,15cyclictest0-21swapper/022:21:150
922199220,21cyclictest0-21swapper/023:05:100
922199220,21cyclictest0-21swapper/022:51:080
922199220,21cyclictest0-21swapper/021:47:560
922199220,21cyclictest0-21swapper/021:17:150
922199220,21cyclictest0-21swapper/019:32:350
2118422218,3sleep30-21swapper/320:36:223
1157422218,3sleep30-21swapper/320:02:093
9230992117,3cyclictest0-21swapper/221:45:112
9230992117,3cyclictest0-21swapper/219:59:492
923099210,20cyclictest0-21swapper/223:46:282
923099210,20cyclictest0-21swapper/223:26:052
923099210,20cyclictest0-21swapper/222:26:472
923099210,20cyclictest0-21swapper/221:21:112
923099210,20cyclictest0-21swapper/221:04:262
923099210,20cyclictest0-21swapper/220:42:222
923099210,20cyclictest0-21swapper/220:25:152
923099210,20cyclictest0-21swapper/200:33:432
923099210,19cyclictest30042-21apt-get22:20:022
9225992117,3cyclictest0-21swapper/120:43:161
922599210,3cyclictest0-21swapper/119:47:141
922599210,20cyclictest0-21swapper/121:57:311
922599210,20cyclictest0-21swapper/121:20:011
922599210,20cyclictest0-21swapper/120:32:321
922599210,20cyclictest0-21swapper/120:16:011
922599210,20cyclictest0-21swapper/120:16:011
922599210,20cyclictest0-21swapper/119:55:191
922599210,20cyclictest0-21swapper/119:30:221
922599210,20cyclictest0-21swapper/119:23:371
922599210,20cyclictest0-21swapper/119:11:161
922199211,19cyclictest0-21swapper/023:50:490
922199210,20cyclictest0-21swapper/022:42:110
922199210,20cyclictest0-21swapper/022:37:230
922199210,20cyclictest0-21swapper/022:25:430
922199210,20cyclictest0-21swapper/021:54:140
922199210,15cyclictest0-21swapper/022:49:040
922199210,15cyclictest0-21swapper/000:32:530
1484922117,3sleep30-21swapper/319:13:153
9230992018,1cyclictest10272-21snmpd20:55:162
9230992018,1cyclictest10272-21snmpd20:11:342
9230992018,1cyclictest10272-21snmpd20:02:562
9230992018,1cyclictest10272-21snmpd19:39:562
923099201,14cyclictest0-21swapper/219:40:132
9225992018,2cyclictest0-21swapper/119:52:011
9225992017,3cyclictest0-21swapper/120:13:021
922599200,2cyclictest0-21swapper/121:02:531
922599200,20cyclictest0-21swapper/120:46:021
922599200,20cyclictest0-21swapper/120:22:291
922599200,19cyclictest0-21swapper/123:37:391
922599200,19cyclictest0-21swapper/120:26:041
9221992018,1cyclictest10272-21snmpd20:29:400
9221992018,1cyclictest10272-21snmpd19:44:550
9221992016,3cyclictest0-21swapper/020:18:340
9221992016,3cyclictest0-21swapper/020:18:340
922199200,3cyclictest0-21swapper/020:06:340
922199200,19cyclictest0-21swapper/021:21:320
922199200,19cyclictest0-21swapper/000:16:240
2290022016,3sleep30-21swapper/319:16:003
9230991917,1cyclictest10272-21snmpd20:22:532
9230991917,1cyclictest10272-21snmpd20:18:292
9230991917,1cyclictest10272-21snmpd20:18:282
9230991917,1cyclictest10272-21snmpd20:06:222
9230991917,1cyclictest10272-21snmpd19:20:402
9230991917,1cyclictest10272-21snmpd00:39:232
9230991916,2cyclictest10272-21snmpd21:07:582
923099190,18cyclictest0-21swapper/219:50:332
922599190,19cyclictest0-21swapper/119:36:051
9221991917,1cyclictest10272-21snmpd20:57:200
9221991917,1cyclictest10272-21snmpd20:20:050
9221991917,1cyclictest10272-21snmpd20:10:080
9221991915,2cyclictest10272-21snmpd23:16:100
681421916,2sleep30-21swapper/320:51:043
3038421915,3sleep30-21swapper/300:39:083
923099181,16cyclictest0-21swapper/219:46:282
9225991816,2cyclictest0-21swapper/120:00:051
9225991816,2cyclictest0-21swapper/119:26:281
922199184,8cyclictest13261-21/usr/sbin/munin21:00:220
922199183,14cyclictest0-21swapper/019:10:320
9221991817,1cyclictest0-21swapper/020:45:200
9221991816,1cyclictest10272-21snmpd21:07:070
9221991816,1cyclictest10272-21snmpd20:53:520
9221991816,1cyclictest10272-21snmpd20:33:380
9221991816,1cyclictest10272-21snmpd19:36:160
1540921814,3sleep30-21swapper/320:34:013
9230991715,2cyclictest0-21swapper/219:18:052
923099170,16cyclictest0-21swapper/220:45:442
9225991715,2cyclictest0-21swapper/121:05:371
922199173,13cyclictest0-21swapper/019:25:220
922199170,16cyclictest0-21swapper/020:41:310
922199170,16cyclictest0-21swapper/020:00:170
922199170,11cyclictest0-21swapper/019:20:190
922199162,13cyclictest0-21swapper/019:15:110
9221991614,1cyclictest10272-21snmpd19:52:160
9221991614,1cyclictest10272-21snmpd19:48:320
922199160,15cyclictest0-21swapper/019:55:280
1961021610,3sleep30-21swapper/321:46:583
292682155,3sleep30-21swapper/320:17:153
292682155,3sleep30-21swapper/320:17:143
25392159,3sleep30-21swapper/319:30:013
251942151,3sleep30-21swapper/323:38:433
222392150,1sleep322244-21kthreadcore19:45:183
108621511,3sleep30-21swapper/320:47:583
9230991412,1cyclictest10272-21snmpd20:30:072
88732141,3sleep30-21swapper/322:36:343
234521410,3sleep30-21swapper/319:27:533
198652140,5sleep30-21swapper/321:20:183
89502133,3sleep30-21swapper/320:26:533
538321310,2sleep30-21swapper/319:59:003
51982138,2sleep30-21swapper/323:56:503
47872131,3sleep30-21swapper/322:08:503
173992132,3sleep30-21swapper/320:05:543
171232137,3sleep30-21swapper/321:32:533
314862120,3sleep30-21swapper/322:33:143
274892128,3sleep30-21swapper/320:40:573
220072120,3sleep30-21swapper/322:01:123
188412129,2sleep30-21swapper/321:04:213
73372110,2sleep30-21swapper/300:12:243
235472117,3sleep30-21swapper/320:14:103
211122116,3sleep30-21swapper/300:34:423
200452117,3sleep30-21swapper/319:42:233
128512117,3sleep30-21swapper/320:58:033
125122110,3sleep30-21swapper/322:10:343
105392115,3sleep30-21swapper/323:31:343
81372101,6sleep30-21swapper/321:42:223
71102100,0sleep30-21swapper/322:22:473
319422100,5sleep331957-21ssh00:24:263
288672105,2sleep30-21swapper/300:07:343
246472106,2sleep30-21swapper/322:56:413
199142100,2sleep319930-21ssh00:04:393
140492105,3sleep30-21swapper/319:36:173
125262104,3sleep30-21swapper/321:58:093
9943293,4sleep30-21swapper/323:18:393
907291,5sleep30-21swapper/300:25:143
32612295,2sleep30-21swapper/323:27:443
32210293,3sleep30-21swapper/321:11:293
31843295,3sleep30-21swapper/319:52:523
31396290,1sleep30-21swapper/322:45:303
29739291,4sleep30-21swapper/320:20:113
28842294,3sleep30-21swapper/319:21:483
27024293,4sleep30-21swapper/322:17:383
25972294,3sleep30-21swapper/323:51:563
24443294,4sleep30-21swapper/321:06:083
21047290,6sleep321068-21ssh23:23:013
21047290,6sleep321068-21ssh23:23:003
18880293,3sleep30-21swapper/300:17:363
15972290,6sleep30-21swapper/321:19:433
14041290,1sleep30-21swapper/323:46:523
8705281,4sleep30-21swapper/323:05:053
6393281,4sleep30-21swapper/322:50:153
31230281,4sleep30-21swapper/321:51:433
29243281,4sleep30-21swapper/321:37:573
28356281,4sleep30-21swapper/323:11:593
2190281,4sleep30-21swapper/323:00:303
14896281,4sleep30-21swapper/322:40:183
13472281,4sleep30-21swapper/322:25:243
1067281,4sleep30-21swapper/323:40:543
2610271,3sleep30-21swapper/321:25:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional