You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-28 - 13:35

x86 Intel Core i7-E610 @2530 MHz, Linux 4.9.271-rt182 (Profile)

Latency plot of system in rack #5, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot4.osadl.org (updated Tue Mar 28, 2023 00:44:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13429212563,7sleep10-21swapper/119:07:211
13429212563,7sleep10-21swapper/119:07:211
8000211863,52sleep20-21swapper/219:05:062
8000211863,52sleep20-21swapper/219:05:062
133442111101,7sleep00-21swapper/019:06:160
133442111101,7sleep00-21swapper/019:06:160
135032109100,6sleep30-21swapper/319:08:193
135032109100,6sleep30-21swapper/319:08:193
240732960,0sleep30-21swapper/320:35:253
76342550,1sleep30-21swapper/323:33:373
226052550,0sleep30-21swapper/300:34:023
292942540,0sleep00-21swapper/019:45:200
1380799281,25cyclictest29930-21munin-run22:55:002
1380799280,27cyclictest0-21swapper/200:29:142
1380499280,27cyclictest0-21swapper/120:50:541
1380499280,27cyclictest0-21swapper/100:14:441
1380799270,26cyclictest0-21swapper/223:49:192
1380799270,26cyclictest0-21swapper/222:15:062
1380799270,26cyclictest0-21swapper/219:20:042
1380499270,26cyclictest0-21swapper/123:22:171
1380499270,26cyclictest0-21swapper/121:33:501
1380499270,26cyclictest0-21swapper/121:12:171
1380499270,26cyclictest0-21swapper/120:43:051
1380499270,26cyclictest0-21swapper/120:00:551
1379699270,26cyclictest0-21swapper/023:39:430
1379699270,26cyclictest0-21swapper/019:14:250
1380799260,25cyclictest0-21swapper/222:01:382
1380799260,25cyclictest0-21swapper/220:55:412
1380499260,25cyclictest0-21swapper/122:09:211
1380499260,25cyclictest0-21swapper/121:27:591
1380499260,25cyclictest0-21swapper/120:08:251
1380499260,25cyclictest0-21swapper/119:54:221
1380499260,25cyclictest0-21swapper/119:46:491
1380499260,25cyclictest0-21swapper/119:32:221
1379699260,25cyclictest0-21swapper/023:09:040
1379699260,25cyclictest0-21swapper/022:59:520
1379699260,25cyclictest0-21swapper/021:17:230
1379699260,25cyclictest0-21swapper/020:31:470
13807992522,2cyclictest0-21swapper/221:00:592
1380799250,23cyclictest0-21swapper/221:31:552
13804992516,8cyclictest0-21swapper/123:48:341
1380499250,24cyclictest0-21swapper/121:05:501
1380499250,24cyclictest0-21swapper/119:26:341
1380499250,24cyclictest0-21swapper/119:24:131
1379699250,24cyclictest0-21swapper/022:12:020
1379699250,19cyclictest0-21swapper/022:07:470
1380799240,23cyclictest0-21swapper/222:22:402
1380799240,23cyclictest0-21swapper/222:22:402
1380799240,23cyclictest0-21swapper/219:37:282
1380499240,23cyclictest0-21swapper/122:56:571
1380499240,23cyclictest0-21swapper/120:30:531
1380499240,23cyclictest0-21swapper/119:59:401
1380499240,23cyclictest0-21swapper/100:19:221
1380499240,18cyclictest0-21swapper/121:52:001
1380499240,18cyclictest0-21swapper/121:48:391
13796992415,8cyclictest0-21swapper/023:18:140
1379699240,23cyclictest0-21swapper/022:23:040
1379699240,23cyclictest0-21swapper/022:23:030
1379699240,23cyclictest0-21swapper/000:39:170
2878122319,3sleep30-21swapper/321:44:353
1380799238,14cyclictest0-21swapper/221:10:442
13807992321,1cyclictest0-21swapper/223:13:262
13807992314,8cyclictest0-21swapper/200:01:532
1380799231,21cyclictest0-21swapper/221:42:592
1380799230,22cyclictest0-21swapper/223:41:252
1380799230,22cyclictest0-21swapper/222:27:272
1380799230,22cyclictest0-21swapper/221:28:492
1380499231,21cyclictest0-21swapper/120:45:051
1380499230,22cyclictest0-21swapper/123:43:181
1380499230,22cyclictest0-21swapper/123:19:321
1380499230,22cyclictest0-21swapper/123:10:231
1380499230,22cyclictest0-21swapper/122:26:381
1380499230,22cyclictest0-21swapper/121:21:111
1380499230,22cyclictest0-21swapper/120:56:351
1380499230,22cyclictest0-21swapper/100:09:101
13796992315,7cyclictest0-21swapper/000:29:070
1379699230,22cyclictest0-21swapper/021:59:010
1379699230,22cyclictest0-21swapper/021:44:540
1379699230,22cyclictest0-21swapper/000:01:420
1002522319,3sleep30-21swapper/319:57:213
3125722218,3sleep30-21swapper/320:45:033
1644222218,3sleep30-21swapper/321:00:093
1380799222,19cyclictest0-21swapper/223:34:362
13807992218,3cyclictest0-21swapper/220:37:562
13807992218,2cyclictest17993-21snmpd20:45:202
1380799221,20cyclictest0-21swapper/200:09:032
1380799220,21cyclictest0-21swapper/223:53:292
1380799220,21cyclictest0-21swapper/223:27:212
1380799220,21cyclictest0-21swapper/222:15:012
1380799220,21cyclictest0-21swapper/221:38:102
1380799220,21cyclictest0-21swapper/220:31:202
1380799220,21cyclictest0-21swapper/219:51:582
1380799220,21cyclictest0-21swapper/219:15:102
1380799220,20cyclictest0-21swapper/223:55:292
1380799220,17cyclictest0-21swapper/222:46:202
1380799220,16cyclictest0-21swapper/222:55:512
1380799220,15cyclictest0-21swapper/223:09:082
1380499222,19cyclictest0-21swapper/121:42:161
1380499222,14cyclictest10184-21irqcore23:35:191
13804992219,3cyclictest0-21swapper/122:41:211
13804992217,5cyclictest22-21ksoftirqd/122:18:001
1380499220,22cyclictest0-21swapper/119:19:401
1380499220,21cyclictest0-21swapper/123:59:341
1380499220,21cyclictest0-21swapper/123:25:251
1380499220,21cyclictest0-21swapper/123:06:001
1380499220,21cyclictest0-21swapper/122:47:571
1380499220,21cyclictest0-21swapper/122:30:041
1380499220,21cyclictest0-21swapper/122:21:281
1380499220,21cyclictest0-21swapper/122:21:271
1380499220,21cyclictest0-21swapper/122:11:241
1380499220,21cyclictest0-21swapper/121:56:291
1380499220,21cyclictest0-21swapper/121:35:061
1380499220,21cyclictest0-21swapper/120:35:201
1380499220,21cyclictest0-21swapper/120:22:101
1380499220,21cyclictest0-21swapper/120:16:581
1380499220,21cyclictest0-21swapper/120:13:281
1380499220,21cyclictest0-21swapper/100:38:421
1380499220,21cyclictest0-21swapper/100:22:251
1380499220,21cyclictest0-21swapper/100:03:531
1380499220,20cyclictest0-21swapper/122:01:071
1380499220,16cyclictest0-21swapper/121:16:081
13796992215,6cyclictest0-21swapper/022:16:530
1379699220,21cyclictest0-21swapper/023:04:480
1379699220,21cyclictest0-21swapper/022:52:050
1379699220,21cyclictest0-21swapper/022:47:150
1379699220,21cyclictest0-21swapper/022:39:000
1379699220,21cyclictest0-21swapper/022:27:390
1379699220,21cyclictest0-21swapper/021:23:100
1379699220,21cyclictest0-21swapper/000:08:030
1379699220,20cyclictest0-21swapper/021:34:510
1379699220,16cyclictest0-21swapper/021:45:400
104922217,3sleep30-21swapper/319:22:413
869322117,3sleep30-21swapper/321:32:533
2979422118,2sleep30-21swapper/321:45:083
13807992118,2cyclictest17993-21snmpd20:07:552
1380799211,18cyclictest0-21swapper/221:18:042
1380799210,20cyclictest0-21swapper/223:21:122
1380799210,20cyclictest0-21swapper/223:16:072
1380799210,20cyclictest0-21swapper/222:40:592
1380799210,20cyclictest0-21swapper/222:31:442
1380799210,20cyclictest0-21swapper/221:49:302
1380799210,20cyclictest0-21swapper/221:21:242
1380799210,20cyclictest0-21swapper/200:10:422
1380799210,15cyclictest0-21swapper/223:36:292
1380799210,15cyclictest0-21swapper/223:00:112
13804992113,6cyclictest211ktimersoftd/122:35:261
1380499210,20cyclictest0-21swapper/123:51:521
1380499210,20cyclictest0-21swapper/123:30:161
1380499210,20cyclictest0-21swapper/123:00:231
1380499210,20cyclictest0-21swapper/122:51:431
1380499210,20cyclictest0-21swapper/120:25:071
1380499210,20cyclictest0-21swapper/119:37:011
1380499210,20cyclictest0-21swapper/100:31:191
13796992119,1cyclictest17993-21snmpd23:42:160
13796992117,3cyclictest0-21swapper/021:11:420
13796992113,7cyclictest0-21swapper/000:17:130
1379699210,20cyclictest0-21swapper/023:26:420
1379699210,20cyclictest0-21swapper/023:21:180
1379699210,20cyclictest0-21swapper/023:11:210
1379699210,20cyclictest0-21swapper/022:32:310
1379699210,20cyclictest0-21swapper/000:30:480
1379699210,20cyclictest0-21swapper/000:12:380
1379699210,16cyclictest0-21swapper/023:34:380
1379699210,15cyclictest0-21swapper/023:50:310
1303322117,3sleep30-21swapper/320:29:573
1158222117,3sleep30-21swapper/323:51:143
434622016,3sleep30-21swapper/319:54:333
13807992018,1cyclictest17993-21snmpd21:50:112
13807992018,1cyclictest17993-21snmpd21:05:332
13807992018,1cyclictest17993-21snmpd19:32:312
13807992018,1cyclictest17993-21snmpd19:26:222
13807992018,1cyclictest17993-21snmpd00:37:172
13807992016,3cyclictest17993-21snmpd20:50:112
13807992013,6cyclictest0-21swapper/200:31:562
1380799200,2cyclictest0-21swapper/222:36:542
1380799200,19cyclictest0-21swapper/222:05:332
1380799200,19cyclictest0-21swapper/200:20:322
1380799200,18cyclictest25104-21turbostat19:45:002
13804992016,3cyclictest0-21swapper/121:02:531
13804992016,3cyclictest0-21swapper/100:29:461
1380499200,19cyclictest0-21swapper/119:40:141
1380499200,19cyclictest0-21swapper/119:10:431
13796992018,1cyclictest17993-21snmpd21:36:110
13796992018,1cyclictest17993-21snmpd20:48:410
13796992012,7cyclictest0-21swapper/022:42:390
1379699200,19cyclictest0-21swapper/021:26:470
1379699200,19cyclictest0-21swapper/000:24:280
1379699200,14cyclictest0-21swapper/021:50:150
2217721913,3sleep30-21swapper/323:24:333
13807991917,1cyclictest17993-21snmpd20:23:582
13807991917,1cyclictest17993-21snmpd19:56:492
13807991917,1cyclictest17993-21snmpd19:12:162
13807991917,1cyclictest16112-21sadc20:04:592
13807991915,3cyclictest0-21swapper/221:55:032
13807991915,3cyclictest0-21swapper/220:27:192
13796991917,1cyclictest17993-21snmpd22:04:090
13796991917,1cyclictest17993-21snmpd21:02:540
13796991917,1cyclictest17993-21snmpd20:40:350
13796991917,1cyclictest17993-21snmpd20:24:550
13796991917,1cyclictest17993-21snmpd20:13:430
13796991917,1cyclictest17993-21snmpd19:17:160
47222185,3sleep30-21swapper/322:23:453
47222185,3sleep30-21swapper/322:23:443
2777421814,3sleep30-21swapper/319:19:453
2413521813,2sleep30-21swapper/323:07:023
2199321814,3sleep30-21swapper/320:09:473
13807991816,1cyclictest17993-21snmpd20:44:212
13807991816,1cyclictest17993-21snmpd19:49:222
13807991815,2cyclictest17993-21snmpd20:11:162
1380799181,15cyclictest0-21swapper/200:15:002
1379699183,14cyclictest0-21swapper/023:47:020
13796991816,2cyclictest0-21swapper/020:35:110
13796991816,2cyclictest0-21swapper/020:27:320
13796991816,1cyclictest17993-21snmpd20:17:010
13796991816,1cyclictest17993-21snmpd20:05:040
13796991816,1cyclictest17993-21snmpd20:00:100
13796991816,1cyclictest17993-21snmpd19:57:250
13796991816,1cyclictest17993-21snmpd19:41:280
13796991816,1cyclictest17993-21snmpd19:32:070
13796991816,1cyclictest0-21swapper/023:55:040
399821711,3sleep30-21swapper/322:56:213
3094421713,3sleep30-21swapper/320:43:553
2760521713,3sleep30-21swapper/320:11:113
1900621713,2sleep30-21swapper/319:37:193
1380799171,15cyclictest0-21swapper/220:15:172
1379699174,12cyclictest0-21swapper/020:50:240
13796991715,2cyclictest0-21swapper/019:38:520
13796991715,1cyclictest17993-21snmpd20:59:410
13796991715,1cyclictest17993-21snmpd19:52:520
1379699170,16cyclictest0-21swapper/019:25:240
2655921612,3sleep30-21swapper/300:17:213
1379699162,13cyclictest0-21swapper/021:05:180
1235721610,3sleep30-21swapper/322:26:293
3120321511,3sleep30-21swapper/321:27:173
277002159,3sleep30-21swapper/321:06:423
188402159,3sleep30-21swapper/320:34:033
1759221511,2sleep30-21swapper/322:12:113
1379699150,10cyclictest0-21swapper/019:20:250
50062148,4sleep30-21swapper/300:24:493
4592148,3sleep30-21swapper/322:03:473
318682142,3sleep30-21swapper/300:02:513
312302148,3sleep30-21swapper/323:29:153
219702148,3sleep30-21swapper/321:56:213
132732149,2sleep30-21swapper/319:34:233
73452139,3sleep30-21swapper/319:28:463
72842137,3sleep30-21swapper/322:40:313
71642139,2sleep30-21swapper/320:24:413
41812137,3sleep30-21swapper/323:49:123
239782138,3sleep30-21swapper/323:40:313
169422137,3sleep30-21swapper/323:04:553
159612133,3sleep30-21swapper/320:03:143
151122137,3sleep30-21swapper/321:54:363
253192127,3sleep30-21swapper/319:45:083
216382126,3sleep30-21swapper/323:56:453
174382126,3sleep30-21swapper/322:46:333
166532120,0sleep30-21swapper/321:20:203
99812117,3sleep30-21swapper/320:50:323
89332111,2sleep30-21swapper/322:07:503
85252115,3sleep30-21swapper/300:07:593
31212115,3sleep30-21swapper/323:14:243
267482110,3sleep30-21swapper/322:16:593
216412115,3sleep30-21swapper/322:31:223
192672115,3sleep30-21swapper/300:14:523
17312116,2sleep30-21swapper/321:10:543
121532110,1sleep30-21swapper/321:17:113
11172115,3sleep30-21swapper/320:17:283
103292114,3sleep30-21swapper/320:55:003
321282104,2sleep30-21swapper/322:37:513
320182100,2sleep30-21swapper/300:39:313
263992100,2sleep30-21swapper/322:50:483
250842106,3sleep30-21swapper/319:45:003
193652106,3sleep30-21swapper/319:12:043
191252104,3sleep30-21swapper/321:39:063
166222105,3sleep30-21swapper/323:38:113
9693292,4sleep30-21swapper/323:15:403
11738283,3sleep30-21swapper/300:26:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional