You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-30 - 10:38

x86 Intel Core i7-E610 @2530 MHz, Linux 4.9.271-rt182 (Profile)

Latency plot of system in rack #5, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4.osadl.org (updated Tue May 30, 2023 00:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1264215893,8sleep10-21swapper/119:05:191
6261212564,6sleep30-21swapper/319:08:153
63402112103,6sleep00-21swapper/019:09:150
5535210996,8sleep20-21swapper/219:05:282
15712640,4sleep0654999cyclictest00:35:310
18372630,0sleep10-21swapper/122:20:411
108852630,1sleep210891-21kthreadcore19:10:212
129812600,0sleep00-21swapper/019:40:230
105912590,0sleep00-21swapper/020:30:250
320912580,0sleep20-21swapper/222:54:462
279302570,0sleep10-21swapper/123:07:431
235352570,4sleep1655499cyclictest00:12:561
14752550,0sleep30-21swapper/321:15:293
252832490,2sleep0654999cyclictest23:23:310
655999270,26cyclictest0-21swapper/223:32:542
655999270,26cyclictest0-21swapper/223:07:562
655999270,26cyclictest0-21swapper/222:24:132
655999270,26cyclictest0-21swapper/220:11:222
655999260,25cyclictest0-21swapper/221:23:372
655999260,25cyclictest0-21swapper/200:19:512
655999250,24cyclictest0-21swapper/200:23:202
655999250,23cyclictest0-21swapper/222:19:292
655999243,20cyclictest0-21swapper/223:16:522
6559992420,3cyclictest0-21swapper/223:21:122
6559992420,3cyclictest0-21swapper/221:48:472
655999240,23cyclictest0-21swapper/222:48:392
655999240,23cyclictest0-21swapper/222:12:562
655999240,23cyclictest0-21swapper/222:00:002
655999240,23cyclictest0-21swapper/221:28:032
655999240,18cyclictest0-21swapper/200:37:572
654999240,18cyclictest0-21swapper/000:12:440
655999232,20cyclictest0-21swapper/221:17:002
6559992320,3cyclictest0-21swapper/219:39:102
6559992316,6cyclictest0-21swapper/200:27:192
6559992316,6cyclictest0-21swapper/200:06:382
655999231,16cyclictest0-21swapper/223:41:122
655999230,22cyclictest0-21swapper/223:54:402
655999230,22cyclictest0-21swapper/222:57:572
655999230,22cyclictest0-21swapper/222:35:582
655999230,22cyclictest0-21swapper/221:33:142
655999230,21cyclictest0-21swapper/223:38:212
655999230,18cyclictest0-21swapper/200:10:232
655999230,17cyclictest0-21swapper/221:41:572
655499231,21cyclictest0-21swapper/120:27:241
655499230,22cyclictest0-21swapper/119:29:231
654999230,22cyclictest0-21swapper/000:08:290
132702230,18sleep220873-21diskmemload22:27:442
6559992219,3cyclictest0-21swapper/220:02:492
6559992218,3cyclictest0-21swapper/200:01:022
6559992218,2cyclictest17993-21snmpd19:42:422
655999221,20cyclictest0-21swapper/223:49:132
655999221,19cyclictest0-21swapper/221:55:202
655999220,3cyclictest0-21swapper/220:21:192
655999220,21cyclictest0-21swapper/223:56:172
655999220,21cyclictest0-21swapper/223:29:342
655999220,21cyclictest0-21swapper/223:10:162
655999220,21cyclictest0-21swapper/222:33:032
655999220,21cyclictest0-21swapper/222:06:502
655999220,21cyclictest0-21swapper/221:36:142
655999220,21cyclictest0-21swapper/221:13:262
655999220,21cyclictest0-21swapper/220:31:182
655999220,21cyclictest0-21swapper/219:57:082
6554992217,4cyclictest0-21swapper/121:06:251
655499220,21cyclictest0-21swapper/123:57:061
655499220,21cyclictest0-21swapper/123:29:451
655499220,21cyclictest0-21swapper/122:58:281
655499220,21cyclictest0-21swapper/121:32:221
655499220,21cyclictest0-21swapper/120:58:431
655499220,21cyclictest0-21swapper/120:53:421
655499220,21cyclictest0-21swapper/120:06:491
655499220,21cyclictest0-21swapper/120:04:151
655499220,21cyclictest0-21swapper/119:21:421
655499220,21cyclictest0-21swapper/119:10:391
655499220,21cyclictest0-21swapper/100:37:181
655499220,20cyclictest0-21swapper/121:39:501
654999220,21cyclictest0-21swapper/023:45:350
654999220,21cyclictest0-21swapper/023:43:000
654999220,21cyclictest0-21swapper/022:06:330
654999220,21cyclictest0-21swapper/022:02:230
655999216,14cyclictest0-21swapper/223:00:272
6559992118,2cyclictest17993-21snmpd20:59:012
6559992117,3cyclictest0-21swapper/221:02:552
655999211,19cyclictest0-21swapper/200:30:052
655999211,15cyclictest0-21swapper/222:41:162
655999210,20cyclictest0-21swapper/219:30:332
655999210,20cyclictest0-21swapper/219:25:192
655999210,16cyclictest0-21swapper/220:17:352
6554992118,3cyclictest0-21swapper/100:02:181
6554992118,2cyclictest0-21swapper/121:26:301
6554992117,3cyclictest0-21swapper/119:33:511
655499211,2cyclictest23744-21ssh23:21:481
655499210,2cyclictest0-21swapper/122:36:051
655499210,20cyclictest0-21swapper/123:16:201
655499210,20cyclictest0-21swapper/123:14:281
655499210,20cyclictest0-21swapper/122:47:261
655499210,20cyclictest0-21swapper/121:59:171
655499210,20cyclictest0-21swapper/121:24:251
655499210,20cyclictest0-21swapper/120:40:061
655499210,20cyclictest0-21swapper/120:32:041
655499210,20cyclictest0-21swapper/119:41:101
655499210,20cyclictest0-21swapper/119:37:571
654999210,20cyclictest0-21swapper/021:29:120
654999210,20cyclictest0-21swapper/021:17:280
654999210,20cyclictest0-21swapper/000:26:090
654999210,20cyclictest0-21swapper/000:03:240
1253322117,3sleep30-21swapper/319:12:473
6559992018,1cyclictest17993-21snmpd20:50:422
6559992018,1cyclictest17993-21snmpd19:52:032
6559992017,2cyclictest17993-21snmpd21:05:422
6559992016,3cyclictest0-21swapper/220:06:212
655999200,2cyclictest0-21swapper/220:28:432
6554992017,3cyclictest0-21swapper/123:38:351
6554992017,3cyclictest0-21swapper/121:46:381
6554992017,3cyclictest0-21swapper/120:48:251
6554992017,3cyclictest0-21swapper/120:48:251
6554992017,3cyclictest0-21swapper/120:16:061
6554992017,2cyclictest17993-21snmpd22:30:311
6554992016,3cyclictest0-21swapper/122:41:021
655499200,2cyclictest0-21swapper/122:03:291
655499200,2cyclictest0-21swapper/121:52:551
655499200,2cyclictest0-21swapper/120:12:191
655499200,2cyclictest0-21swapper/119:59:071
655499200,19cyclictest0-21swapper/122:19:281
655499200,19cyclictest0-21swapper/120:37:191
655499200,19cyclictest0-21swapper/120:20:271
655499200,19cyclictest0-21swapper/119:53:361
6549992018,1cyclictest17993-21snmpd23:10:110
6549992018,1cyclictest17993-21snmpd22:58:280
6549992018,1cyclictest17993-21snmpd22:36:050
6549992018,1cyclictest17993-21snmpd20:59:250
6549992018,1cyclictest17993-21snmpd20:27:240
6549992018,1cyclictest17993-21snmpd20:06:490
6549992018,1cyclictest17993-21snmpd20:04:390
6549992018,1cyclictest17993-21snmpd19:29:240
654999200,2cyclictest0-21swapper/020:36:550
654999200,19cyclictest0-21swapper/023:28:000
3005622016,3sleep30-21swapper/320:50:153
6559991917,1cyclictest17993-21snmpd19:47:012
6559991917,1cyclictest16185-21cat19:15:222
655999190,14cyclictest0-21swapper/221:53:002
6554991917,2cyclictest0-21swapper/100:33:391
6554991917,1cyclictest17993-21snmpd23:42:151
6554991917,1cyclictest17993-21snmpd23:30:301
6554991917,1cyclictest17993-21snmpd00:20:031
6554991916,2cyclictest0-21swapper/123:45:271
655499190,18cyclictest0-21swapper/121:41:401
655499190,18cyclictest0-21swapper/121:00:231
655499190,18cyclictest0-21swapper/119:15:171
655499190,18cyclictest0-21swapper/100:07:061
6549991917,1cyclictest17993-21snmpd23:39:210
6549991917,1cyclictest17993-21snmpd23:08:470
6549991917,1cyclictest17993-21snmpd22:42:400
6549991917,1cyclictest17993-21snmpd21:59:170
6549991917,1cyclictest17993-21snmpd21:52:550
6549991917,1cyclictest17993-21snmpd21:39:500
6549991917,1cyclictest17993-21snmpd21:30:100
6549991917,1cyclictest17993-21snmpd20:40:060
6549991917,1cyclictest17993-21snmpd20:12:180
6549991917,1cyclictest17993-21snmpd19:56:550
6549991917,1cyclictest17993-21snmpd19:33:390
6549991917,1cyclictest17993-21snmpd19:20:510
6549991917,1cyclictest17993-21snmpd19:10:390
654999190,1cyclictest14281-21ssh21:20:490
2053821915,3sleep30-21swapper/321:05:523
6559991816,1cyclictest17993-21snmpd20:49:582
6559991816,1cyclictest17993-21snmpd20:49:582
6559991816,1cyclictest17993-21snmpd19:22:272
6559991814,3cyclictest0-21swapper/220:43:042
6554991816,2cyclictest0-21swapper/122:06:011
6554991816,2cyclictest0-21swapper/100:17:451
6554991815,3cyclictest0-21swapper/122:54:261
6554991815,3cyclictest0-21swapper/119:46:431
6554991815,2cyclictest20440-21sadc23:55:001
655499180,17cyclictest0-21swapper/122:26:441
654999184,13cyclictest0-21swapper/022:13:230
6549991816,1cyclictest27824-21cat20:20:270
6549991816,1cyclictest17993-21snmpd23:56:180
6549991816,1cyclictest17993-21snmpd22:47:260
6549991816,1cyclictest17993-21snmpd22:20:560
6549991816,1cyclictest17993-21snmpd21:43:020
6549991816,1cyclictest17993-21snmpd20:52:490
6549991816,1cyclictest17993-21snmpd19:16:020
6549991814,3cyclictest17993-21snmpd20:49:040
6549991814,3cyclictest17993-21snmpd20:49:030
6549991814,1cyclictest53450irq/24-enp1s023:04:490
654999180,17cyclictest0-21swapper/021:47:360
654999180,13cyclictest0-21swapper/022:17:000
2648121814,3sleep30-21swapper/320:18:033
1790021814,3sleep30-21swapper/319:43:583
98472170,0sleep30-21swapper/321:52:353
655999172,14cyclictest0-21swapper/220:35:372
6554991715,2cyclictest0-21swapper/121:14:521
655499170,2cyclictest0-21swapper/123:04:491
6549991715,1cyclictest17993-21snmpd23:34:480
6549991715,1cyclictest17993-21snmpd23:16:200
6549991715,1cyclictest17993-21snmpd21:05:490
6549991715,1cyclictest17993-21snmpd20:15:090
6549991715,1cyclictest17993-21snmpd19:37:570
654999170,16cyclictest0-21swapper/023:53:570
654999170,16cyclictest0-21swapper/022:51:310
654999170,16cyclictest0-21swapper/022:30:550
654999170,16cyclictest0-21swapper/000:21:030
654999170,16cyclictest0-21swapper/000:19:230
654999170,11cyclictest0-21swapper/022:29:000
654999170,11cyclictest0-21swapper/021:12:340
654999170,11cyclictest0-21swapper/000:30:420
2978621713,3sleep30-21swapper/320:49:393
2978621713,3sleep30-21swapper/320:49:383
230922170,0sleep30-21swapper/322:00:243
180642175,4sleep30-21swapper/320:39:463
1209621711,3sleep30-21swapper/320:33:563
872921612,3sleep30-21swapper/320:01:053
6554991614,1cyclictest17993-21snmpd00:26:091
655499160,15cyclictest0-21swapper/121:19:241
6549991614,1cyclictest17993-21snmpd19:53:360
6549991614,1cyclictest17993-21snmpd19:48:000
6549991614,1cyclictest10284-21cat21:00:230
3248621612,3sleep30-21swapper/319:26:523
6554991511,2cyclictest18635-21sadc22:15:001
305621511,3sleep30-21swapper/319:59:083
204002150,0sleep30-21swapper/323:20:313
298652149,3sleep30-21swapper/323:41:033
264712148,3sleep30-21swapper/322:17:553
151632142,3sleep30-21swapper/322:30:013
1490921410,3sleep30-21swapper/321:04:013
73802136,4sleep30-21swapper/322:57:173
327522137,3sleep30-21swapper/321:47:593
225122131,7sleep30-21swapper/319:20:323
209512131,3sleep30-21swapper/322:48:433
156112131,3sleep30-21swapper/300:09:393
8602126,3sleep30-21swapper/323:26:323
56412125,4sleep30-21swapper/300:03:223
322572128,3sleep30-21swapper/320:21:473
317452120,2sleep30-21swapper/322:54:203
25122126,3sleep30-21swapper/321:31:283
235162128,3sleep30-21swapper/319:45:433
207352128,3sleep30-21swapper/320:14:313
185162121,3sleep30-21swapper/321:25:043
132342120,2sleep30-21swapper/321:37:303
92762117,3sleep30-21swapper/320:05:133
83442115,3sleep30-21swapper/321:20:033
81472115,3sleep30-21swapper/300:21:253
6542116,3sleep30-21swapper/320:25:163
59332116,3sleep30-21swapper/322:06:383
54942115,3sleep30-21swapper/300:39:113
289412114,4sleep30-21swapper/300:34:303
268032115,3sleep30-21swapper/323:06:223
181772110,2sleep30-21swapper/323:52:233
180992115,3sleep30-21swapper/300:27:453
11652115,3sleep30-21swapper/323:45:073
92882100,3sleep30-21swapper/322:41:353
61512106,3sleep30-21swapper/319:34:583
5202100,2sleep30-21swapper/322:37:423
45932100,2sleep30-21swapper/323:11:553
32372100,2sleep30-21swapper/322:22:113
212092103,4sleep30-21swapper/321:59:283
206292106,3sleep30-21swapper/319:15:443
101142100,2sleep30-21swapper/323:31:013
8903295,3sleep30-21swapper/320:57:323
27076294,3sleep30-21swapper/321:10:503
8387281,4sleep30-21swapper/323:15:273
6381284,3sleep30-21swapper/319:35:023
26636281,4sleep30-21swapper/323:55:533
25642281,4sleep30-21swapper/300:15:193
22908282,3sleep30-21swapper/321:42:343
19866282,4sleep30-21swapper/323:35:543
18083283,3sleep30-21swapper/323:02:573
16103282,3sleep30-21swapper/300:10:033
14807281,4sleep30-21swapper/322:29:373
9111270,4sleep30-21swapper/322:10:023
25356273,2sleep327088-21cut19:50:283
18336273,3sleep30-21swapper/320:40:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional