You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 02:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4.osadl.org (updated Tue Dec 02, 2025 00:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2961321140,0sleep029599-21munin-run20:50:000
6262211363,8sleep10-21swapper/119:08:011
63632110101,6sleep30-21swapper/319:09:193
63332110100,7sleep00-21swapper/019:08:560
6216210898,7sleep20-21swapper/219:07:262
212872730,0sleep30-21swapper/320:15:143
137712700,1sleep20-21swapper/222:35:482
233962640,1sleep023402-21kthreadcore20:15:190
71092610,1sleep07114-21gltestperf23:05:190
253012550,4sleep0657499cyclictest23:44:320
137262530,0sleep00-21swapper/023:54:530
658299280,27cyclictest0-21swapper/221:35:112
658299273,23cyclictest0-21swapper/200:33:172
658299270,26cyclictest0-21swapper/222:40:012
658299270,26cyclictest0-21swapper/222:12:092
658299270,26cyclictest0-21swapper/221:54:302
658299270,26cyclictest0-21swapper/219:23:472
658299260,25cyclictest0-21swapper/223:33:442
658299260,25cyclictest0-21swapper/223:05:012
658299260,25cyclictest0-21swapper/222:27:312
658299260,25cyclictest0-21swapper/221:25:542
658299260,25cyclictest0-21swapper/200:05:262
658299260,24cyclictest30725-21ssh00:18:352
6582992522,3cyclictest0-21swapper/220:23:582
658299250,24cyclictest0-21swapper/223:00:382
658299250,24cyclictest0-21swapper/221:31:102
658299250,24cyclictest0-21swapper/200:35:122
658299250,23cyclictest0-21swapper/223:50:552
658299240,18cyclictest0-21swapper/200:10:522
658299237,14cyclictest0-21swapper/223:25:102
658299232,20cyclictest0-21swapper/223:56:372
658299232,20cyclictest0-21swapper/223:11:572
658299232,20cyclictest0-21swapper/221:55:492
6582992315,6cyclictest0-21swapper/221:12:432
658299231,21cyclictest0-21swapper/219:18:352
658299230,22cyclictest0-21swapper/222:57:372
658299230,22cyclictest0-21swapper/222:22:002
658299230,22cyclictest0-21swapper/221:24:072
658299230,17cyclictest0-21swapper/223:45:232
658299230,17cyclictest0-21swapper/221:45:122
658299230,16cyclictest0-21swapper/222:15:032
58382230,1sleep30-21swapper/320:00:213
658299227,10cyclictest0-21swapper/219:35:142
658299222,19cyclictest0-21swapper/222:30:452
658299222,19cyclictest0-21swapper/221:40:242
6582992219,3cyclictest0-21swapper/219:12:532
6582992215,6cyclictest0-21swapper/221:16:112
658299220,21cyclictest0-21swapper/223:35:542
658299220,21cyclictest0-21swapper/223:20:322
658299220,21cyclictest0-21swapper/223:17:312
658299220,21cyclictest0-21swapper/222:07:592
658299220,21cyclictest0-21swapper/222:03:282
658299220,21cyclictest0-21swapper/200:26:502
658299220,21cyclictest0-21swapper/200:22:052
658299220,21cyclictest0-21swapper/200:00:152
658299220,16cyclictest0-21swapper/220:55:552
6578992218,2cyclictest27853-21cat20:20:181
289022218,3sleep30-21swapper/319:56:173
6582992119,2cyclictest0-21swapper/220:51:122
6582992119,1cyclictest10272-21snmpd20:26:322
6582992117,3cyclictest0-21swapper/220:36:592
6582992117,3cyclictest0-21swapper/219:59:472
658299210,20cyclictest0-21swapper/223:41:312
658299210,20cyclictest0-21swapper/222:52:322
658299210,20cyclictest0-21swapper/222:45:342
658299210,20cyclictest0-21swapper/220:45:182
658299210,20cyclictest0-21swapper/219:28:232
6578992118,3cyclictest0-21swapper/119:20:531
6578992118,3cyclictest0-21swapper/119:15:201
6578992117,3cyclictest0-21swapper/122:28:191
6578992117,3cyclictest0-21swapper/121:42:181
6578992117,3cyclictest0-21swapper/121:36:331
6574992118,2cyclictest10272-21snmpd23:11:370
6574992118,2cyclictest10272-21snmpd22:30:310
6574992118,2cyclictest10272-21snmpd19:20:080
6574992118,2cyclictest0-21swapper/020:20:180
6574992117,2cyclictest10272-21snmpd22:28:440
593822117,3sleep30-21swapper/320:29:053
658299205,14cyclictest0-21swapper/220:30:202
658299203,16cyclictest0-21swapper/219:42:202
6578992018,2cyclictest0-21swapper/122:46:491
6578992018,1cyclictest14049-21ssh23:07:521
6578992017,3cyclictest0-21swapper/100:34:331
6578992017,3cyclictest0-21swapper/100:11:571
6578992017,2cyclictest10272-21snmpd20:40:291
6578992017,2cyclictest0-21swapper/122:20:191
6578992016,3cyclictest0-21swapper/122:50:161
6578992016,3cyclictest0-21swapper/121:34:211
6578992016,3cyclictest0-21swapper/121:13:181
6578992016,3cyclictest0-21swapper/120:59:211
6578992016,3cyclictest0-21swapper/100:26:011
6578992016,3cyclictest0-21swapper/100:00:021
6574992018,1cyclictest10272-21snmpd23:34:240
6574992018,1cyclictest10272-21snmpd22:55:520
6574992018,1cyclictest10272-21snmpd22:48:400
6574992018,1cyclictest10272-21snmpd22:11:420
6574992018,1cyclictest10272-21snmpd21:16:030
6574992018,1cyclictest10272-21snmpd21:05:150
6574992018,1cyclictest10272-21snmpd20:26:110
6574992018,1cyclictest10272-21snmpd19:26:500
6574992018,1cyclictest10272-21snmpd19:15:200
6574992017,2cyclictest10272-21snmpd00:11:570
6574992016,2cyclictest10272-21snmpd23:16:190
6574992016,2cyclictest10272-21snmpd21:36:330
6582991917,2cyclictest0-21swapper/220:02:262
6582991917,2cyclictest0-21swapper/219:51:292
6582991917,1cyclictest10272-21snmpd20:06:262
6582991917,1cyclictest10272-21snmpd19:31:142
658299191,3cyclictest0-21swapper/221:00:142
6578991917,2cyclictest0-21swapper/123:01:191
6578991917,2cyclictest0-21swapper/122:07:001
6578991917,2cyclictest0-21swapper/121:45:121
6578991917,1cyclictest0-21swapper/122:41:381
6578991916,3cyclictest0-21swapper/123:57:111
6578991916,3cyclictest0-21swapper/123:11:251
6578991916,3cyclictest0-21swapper/122:17:261
6578991916,3cyclictest0-21swapper/122:01:391
6578991916,2cyclictest0-21swapper/123:32:291
6578991916,2cyclictest0-21swapper/123:15:431
6578991916,2cyclictest0-21swapper/120:16:531
6578991916,2cyclictest0-21swapper/119:37:291
6578991916,2cyclictest0-21swapper/119:25:051
6578991916,2cyclictest0-21swapper/119:10:561
6578991915,3cyclictest0-21swapper/122:34:371
6578991915,3cyclictest0-21swapper/121:00:031
6578991915,3cyclictest0-21swapper/100:35:401
6578991915,3cyclictest0-21swapper/100:06:351
6578991915,2cyclictest23812-21ssh23:43:021
6574991917,1cyclictest10272-21snmpd23:01:190
6574991917,1cyclictest10272-21snmpd22:20:190
6574991917,1cyclictest10272-21snmpd22:07:000
6574991917,1cyclictest10272-21snmpd21:45:120
6574991917,1cyclictest10272-21snmpd21:41:270
6574991917,1cyclictest10272-21snmpd21:11:390
6574991917,1cyclictest10272-21snmpd20:55:480
6574991917,1cyclictest10272-21snmpd00:04:200
6574991917,1cyclictest0-21swapper/020:40:290
6574991916,2cyclictest10272-21snmpd23:46:200
6574991916,2cyclictest10272-21snmpd22:41:370
6574991916,2cyclictest10272-21snmpd00:26:000
6574991915,2cyclictest10272-21snmpd22:50:160
6574991915,2cyclictest10272-21snmpd21:34:210
6574991915,2cyclictest10272-21snmpd21:00:030
657499190,5cyclictest0-21swapper/023:28:030
1472321916,2sleep30-21swapper/321:04:173
6582991816,2cyclictest0-21swapper/220:40:022
6582991816,1cyclictest19170-21cat19:45:162
658299180,3cyclictest0-21swapper/220:10:132
6578991817,1cyclictest0-21swapper/120:48:511
6578991816,2cyclictest0-21swapper/123:20:381
6578991816,2cyclictest0-21swapper/121:05:061
6578991816,2cyclictest0-21swapper/120:28:561
6578991816,2cyclictest0-21swapper/120:12:261
6578991816,2cyclictest0-21swapper/119:31:381
6578991816,1cyclictest0-21swapper/123:46:211
6578991815,3cyclictest0-21swapper/120:50:031
6578991815,2cyclictest0-21swapper/120:30:111
6578991815,2cyclictest0-21swapper/120:05:311
6578991815,2cyclictest0-21swapper/119:50:171
6578991814,3cyclictest0-21swapper/120:00:351
6574991816,1cyclictest10272-21snmpd23:20:370
6574991816,1cyclictest10272-21snmpd22:17:250
6574991816,1cyclictest10272-21snmpd20:01:410
6574991816,1cyclictest10272-21snmpd19:54:290
6574991816,1cyclictest10272-21snmpd19:37:290
6574991816,1cyclictest10272-21snmpd19:10:560
6574991816,1cyclictest10272-21snmpd00:31:570
6574991816,1cyclictest10272-21snmpd00:07:020
6574991815,2cyclictest10272-21snmpd22:01:400
6574991815,2cyclictest10272-21snmpd20:14:530
6574991815,2cyclictest10272-21snmpd00:35:400
658299172,14cyclictest0-21swapper/221:05:172
658299170,15cyclictest21053-21/usr/sbin/munin20:15:222
6578991715,2cyclictest0-21swapper/119:46:471
6578991715,2cyclictest0-21swapper/100:18:291
6578991715,1cyclictest0-21swapper/121:55:211
6578991714,3cyclictest0-21swapper/122:10:331
6574991715,1cyclictest10272-21snmpd23:57:110
6574991715,1cyclictest10272-21snmpd20:53:150
6574991715,1cyclictest10272-21snmpd20:30:110
6574991715,1cyclictest10272-21snmpd20:05:320
6574991715,1cyclictest10272-21snmpd19:31:380
6574991714,2cyclictest10272-21snmpd21:55:210
224642170,1sleep30-21swapper/300:30:173
149202175,3sleep30-21swapper/321:50:363
6578991613,2cyclictest0-21swapper/121:27:361
6578991613,2cyclictest0-21swapper/119:43:591
6578991612,3cyclictest0-21swapper/123:37:201
6578991612,3cyclictest0-21swapper/121:20:431
6574991614,1cyclictest10272-21snmpd19:46:470
6574991614,1cyclictest10272-21snmpd00:18:290
6574991612,2cyclictest10272-21snmpd20:35:500
657499160,4cyclictest0-21swapper/023:37:080
6578991513,2cyclictest0-21swapper/119:56:321
6578991513,2cyclictest0-21swapper/100:22:151
6578991512,3cyclictest0-21swapper/120:35:501
657899150,4cyclictest0-21swapper/123:25:411
657899150,4cyclictest0-21swapper/122:36:041
6574991513,1cyclictest10272-21snmpd19:56:320
6574991512,2cyclictest10272-21snmpd21:27:360
6574991512,2cyclictest10272-21snmpd19:43:590
6578991412,2cyclictest0-21swapper/121:17:121
6578991410,3cyclictest0-21swapper/123:51:561
6578991410,3cyclictest0-21swapper/122:58:111
657499142,1cyclictest0-21swapper/021:52:130
6574991412,1cyclictest53450irq/24-enp1s021:20:440
6574991412,1cyclictest53450irq/24-enp1s000:22:150
281552148,3sleep30-21swapper/300:15:453
149282145,2sleep30-21swapper/320:09:513
6578991310,3cyclictest0-21swapper/121:54:081
657499130,3cyclictest0-21swapper/022:38:320
236382138,3sleep30-21swapper/320:44:153
204512138,2sleep30-21swapper/320:10:273
177282139,3sleep30-21swapper/319:41:233
174602132,2sleep30-21swapper/321:37:543
88542128,3sleep30-21swapper/320:59:373
79262126,3sleep30-21swapper/322:04:303
77382127,3sleep30-21swapper/321:18:233
51032120,1sleep30-21swapper/322:32:383
324542129,2sleep30-21swapper/319:25:493
293922129,2sleep30-21swapper/320:47:313
264162126,3sleep30-21swapper/322:42:433
254162126,3sleep30-21swapper/323:29:103
208462128,3sleep30-21swapper/319:19:093
148112120,3sleep30-21swapper/322:05:503
146362126,3sleep30-21swapper/300:25:263
125972122,3sleep30-21swapper/319:13:513
121302128,3sleep30-21swapper/320:35:103
32212110,2sleep30-21swapper/323:49:333
28162117,3sleep30-21swapper/300:36:113
261092110,1sleep30-21swapper/322:58:213
212222117,3sleep30-21swapper/319:20:083
203272111,3sleep30-21swapper/321:05:333
187022115,3sleep30-21swapper/322:25:013
186222110,3sleep30-21swapper/322:24:573
161562110,3sleep30-21swapper/322:38:063
158052110,3sleep30-21swapper/321:20:523
119142118,2sleep30-21swapper/319:37:273
118742117,3sleep30-21swapper/320:34:463
93582104,3sleep30-21swapper/300:07:233
50082104,3sleep30-21swapper/323:35:113
36382100,2sleep30-21swapper/323:02:503
253722100,3sleep30-21swapper/322:10:433
8321293,3sleep30-21swapper/321:49:483
6413294,3sleep30-21swapper/300:21:453
3138294,3sleep30-21swapper/322:46:173
3047293,3sleep30-21swapper/323:18:083
29858290,6sleep30-21swapper/321:13:513
29550296,3sleep30-21swapper/319:52:333
28661294,3sleep30-21swapper/321:28:013
28198294,2sleep30-21swapper/321:42:563
2738295,3sleep30-21swapper/320:51:283
23534295,3sleep30-21swapper/319:45:363
23507294,3sleep30-21swapper/323:42:443
20914294,3sleep30-21swapper/323:56:423
12923294,3sleep30-21swapper/323:06:433
6204284,3sleep30-21swapper/319:34:543
5500283,3sleep30-21swapper/321:31:413
32263284,3sleep30-21swapper/320:21:003
2983282,3sleep30-21swapper/323:33:303
28022282,3sleep30-21swapper/321:57:533
21088282,3sleep30-21swapper/300:14:083
19357281,4sleep30-21swapper/323:10:203
14223280,1sleep30-21swapper/322:51:443
12538283,3sleep30-21swapper/323:53:343
10951282,3sleep30-21swapper/323:20:283
30039271,3sleep30-21swapper/300:00:303
31597261,2sleep30-21swapper/322:15:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional