You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-16 - 05:58

x86 Intel Core i7-E610 @2530 MHz, Linux 4.9.271-rt182 (Profile)

Latency plot of system in rack #5, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot4.osadl.org (updated Tue Aug 16, 2022 00:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22539212261,7sleep00-21swapper/019:07:220
22484212161,8sleep20-21swapper/219:06:412
3159721120,0sleep10-21swapper/120:05:261
22639210594,8sleep30-21swapper/319:08:423
22730210091,6sleep10-21swapper/119:09:531
15872710,0sleep30-21swapper/300:20:223
286382700,0sleep10-21swapper/122:57:061
319032630,0sleep30-21swapper/300:35:293
164642620,1sleep30-21swapper/321:13:533
9672610,0sleep229-21rcuc/223:32:282
276452610,1sleep231-21ksoftirqd/221:35:262
71662600,0sleep229-21rcuc/223:35:242
69072600,0sleep00-21swapper/023:50:230
93182590,0sleep30-21swapper/322:00:073
31302590,0sleep20-21swapper/223:50:172
256822580,1sleep010-21rcuc/021:35:210
178062560,1sleep117809-21switchtime21:45:261
86912550,0sleep30-21swapper/323:20:193
247352510,0sleep20-21swapper/200:15:252
242512390,0sleep324259-21kthreadcore00:15:233
2292299300,29cyclictest0-21swapper/121:52:461
22917993015,14cyclictest0-21swapper/022:35:130
22925992915,2cyclictest0-21swapper/223:20:582
2292299291,3cyclictest0-21swapper/121:55:341
2292299290,3cyclictest0-21swapper/100:30:581
2292299280,3cyclictest0-21swapper/123:59:361
2292299280,27cyclictest0-21swapper/123:03:531
2292299280,26cyclictest0-21swapper/100:20:361
2292299280,17cyclictest0-21swapper/121:22:351
2292299280,17cyclictest0-21swapper/121:00:131
2291799280,27cyclictest0-21swapper/022:10:180
2292599270,26cyclictest0-21swapper/220:34:082
22922992722,4cyclictest0-21swapper/119:29:091
2292299270,4cyclictest0-21swapper/123:16:341
2292299270,4cyclictest0-21swapper/123:16:341
2292299270,26cyclictest0-21swapper/123:20:261
2292299270,26cyclictest0-21swapper/119:36:141
2292299270,21cyclictest0-21swapper/100:13:381
2292299270,20cyclictest0-21swapper/122:47:071
22925992622,3cyclictest0-21swapper/222:56:132
2292599260,25cyclictest0-21swapper/200:00:422
2292299262,23cyclictest0-21swapper/122:25:461
22922992621,4cyclictest0-21swapper/119:50:011
2292299261,3cyclictest0-21swapper/122:42:331
2292299260,3cyclictest0-21swapper/100:09:321
2292299260,25cyclictest0-21swapper/122:31:251
2292299260,25cyclictest0-21swapper/121:43:421
2292299260,20cyclictest0-21swapper/122:10:461
2292299260,16cyclictest0-21swapper/123:31:391
22925992521,3cyclictest0-21swapper/223:15:322
22925992521,3cyclictest0-21swapper/223:15:312
22925992521,3cyclictest0-21swapper/219:56:532
22925992521,3cyclictest0-21swapper/200:10:332
22925992520,5cyclictest0-21swapper/219:43:222
22925992519,5cyclictest0-21swapper/219:46:352
2292599250,24cyclictest0-21swapper/221:57:552
2292599250,20cyclictest0-21swapper/220:25:472
2292299254,14cyclictest0-21swapper/123:40:211
2292299254,14cyclictest0-21swapper/121:37:241
22922992511,7cyclictest0-21swapper/122:02:221
2292299250,24cyclictest0-21swapper/122:21:521
2292299250,24cyclictest0-21swapper/100:36:181
2292299250,20cyclictest0-21swapper/123:52:541
2292299250,1cyclictest0-21swapper/122:51:191
2292299250,15cyclictest0-21swapper/123:07:141
2292299250,15cyclictest0-21swapper/122:39:021
22917992516,8cyclictest0-21swapper/000:28:360
2291799250,24cyclictest0-21swapper/021:24:200
2292599248,14cyclictest0-21swapper/219:30:222
22925992421,2cyclictest0-21swapper/222:19:362
2292599240,23cyclictest0-21swapper/223:14:132
2292599240,18cyclictest10852-21diskmemload22:31:362
2292599240,18cyclictest0-21swapper/222:24:112
22922992416,7cyclictest0-21swapper/123:28:231
2292299240,2cyclictest29065-21awk00:20:001
2292299240,23cyclictest0-21swapper/122:16:391
2292299240,23cyclictest0-21swapper/121:11:391
2292299240,23cyclictest0-21swapper/119:47:351
2292299240,1cyclictest0-21swapper/120:51:541
2292299240,18cyclictest0-21swapper/122:09:391
2292299240,17cyclictest0-21swapper/100:00:341
2292299240,14cyclictest0-21swapper/121:31:341
2292299240,11cyclictest0-21swapper/123:39:251
22917992416,7cyclictest0-21swapper/021:48:200
2291799240,23cyclictest0-21swapper/023:33:520
2291799240,23cyclictest0-21swapper/022:20:200
2292599232,20cyclictest0-21swapper/222:50:382
2292599231,21cyclictest0-21swapper/222:03:062
2292299237,15cyclictest0-21swapper/123:47:271
22922992316,1cyclictest0-21swapper/120:55:201
22922992314,3cyclictest0-21swapper/121:18:091
2292299230,22cyclictest0-21swapper/100:26:021
2291799237,15cyclictest0-21swapper/023:19:270
2291799237,15cyclictest0-21swapper/023:19:260
2291799230,3cyclictest0-21swapper/023:35:150
2291799230,22cyclictest0-21swapper/023:00:140
2291799230,22cyclictest0-21swapper/022:50:480
2291799230,22cyclictest0-21swapper/022:31:280
2291799230,22cyclictest0-21swapper/022:26:100
2291799230,22cyclictest0-21swapper/021:32:230
2291799230,22cyclictest0-21swapper/021:19:150
2291799230,22cyclictest0-21swapper/000:04:520
2291799230,21cyclictest0-21swapper/021:54:030
2291799230,17cyclictest0-21swapper/022:41:210
22925992218,3cyclictest0-21swapper/200:30:532
2292599221,19cyclictest2991-21ssh00:20:502
2292599220,21cyclictest0-21swapper/223:29:432
2292599220,21cyclictest0-21swapper/223:01:382
2292599220,20cyclictest0-21swapper/221:11:012
2292299221,20cyclictest0-21swapper/123:13:021
2292299221,20cyclictest0-21swapper/120:42:261
2292299220,21cyclictest0-21swapper/121:26:571
2292299220,21cyclictest0-21swapper/119:40:201
2292299220,21cyclictest0-21swapper/119:21:221
2292299220,21cyclictest0-21swapper/119:10:341
2291799225,16cyclictest0-21swapper/022:16:400
2291799222,14cyclictest0-21swapper/023:56:200
22917992215,6cyclictest0-21swapper/021:56:210
22917992213,8cyclictest0-21swapper/021:42:560
22917992213,8cyclictest0-21swapper/000:06:330
2291799221,20cyclictest0-21swapper/021:28:350
2291799220,21cyclictest0-21swapper/023:47:020
2291799220,21cyclictest0-21swapper/023:42:150
2291799220,21cyclictest0-21swapper/023:11:510
2291799220,21cyclictest0-21swapper/023:07:520
2291799220,21cyclictest0-21swapper/022:56:010
2291799220,21cyclictest0-21swapper/022:49:000
2291799220,21cyclictest0-21swapper/021:14:300
2291799220,21cyclictest0-21swapper/000:30:050
2291799220,21cyclictest0-21swapper/000:16:420
2291799220,16cyclictest0-21swapper/022:05:220
22925992118,2cyclictest743-21snmpd22:10:252
22925992117,3cyclictest0-21swapper/219:20:432
2292599210,20cyclictest0-21swapper/223:05:072
2292599210,20cyclictest0-21swapper/222:41:072
2292599210,20cyclictest0-21swapper/222:05:012
2292599210,20cyclictest0-21swapper/221:54:402
2292599210,20cyclictest0-21swapper/221:21:142
2292599210,20cyclictest0-21swapper/221:18:032
2292599210,20cyclictest0-21swapper/200:36:392
2292599210,19cyclictest0-21swapper/222:36:152
2292299212,11cyclictest0-21swapper/120:15:311
22922992116,4cyclictest0-21swapper/120:46:261
2292299210,20cyclictest0-21swapper/120:31:341
2292299210,20cyclictest0-21swapper/120:03:291
2292299210,20cyclictest0-21swapper/119:18:241
22917992119,1cyclictest743-21snmpd19:30:250
2291799210,20cyclictest0-21swapper/023:28:230
2291799210,20cyclictest0-21swapper/023:21:190
2291799210,20cyclictest0-21swapper/000:20:370
2291799210,20cyclictest0-21swapper/000:10:040
2291799210,1cyclictest0-21swapper/022:00:100
2292599204,14cyclictest0-21swapper/200:05:492
22925992018,1cyclictest743-21snmpd22:48:492
22925992018,1cyclictest743-21snmpd20:41:262
22925992018,1cyclictest743-21snmpd19:50:142
22925992018,1cyclictest743-21snmpd19:39:592
22925992018,1cyclictest0-21swapper/221:40:362
2292599201,18cyclictest0-21swapper/223:40:162
2292599201,15cyclictest22613-21kworker/2:221:25:282
2292599200,2cyclictest0-21swapper/223:56:202
2292599200,20cyclictest0-21swapper/223:49:352
2292599200,20cyclictest0-21swapper/219:14:582
2292599200,19cyclictest0-21swapper/200:27:302
2292599200,15cyclictest0-21swapper/221:30:512
2292299200,2cyclictest0-21swapper/119:55:201
22917992018,1cyclictest743-21snmpd20:45:110
22917992018,1cyclictest743-21snmpd20:32:310
2292599194,14cyclictest0-21swapper/222:26:062
22925991917,1cyclictest743-21snmpd20:50:242
22925991917,1cyclictest743-21snmpd20:16:262
22925991917,1cyclictest743-21snmpd20:04:142
2292599190,19cyclictest0-21swapper/220:55:512
2292599190,18cyclictest0-21swapper/221:49:122
22922991917,2cyclictest0-21swapper/121:08:571
22922991916,3cyclictest0-21swapper/120:12:171
2291799194,14cyclictest0-21swapper/000:37:350
22917991917,1cyclictest743-21snmpd20:43:220
22917991917,1cyclictest743-21snmpd20:37:410
22917991917,1cyclictest743-21snmpd20:15:250
22917991917,1cyclictest743-21snmpd20:01:370
22917991917,1cyclictest743-21snmpd19:48:530
22917991917,1cyclictest743-21snmpd19:44:050
22917991915,3cyclictest0-21swapper/020:25:130
2292599182,15cyclictest0-21swapper/220:20:232
22925991816,2cyclictest0-21swapper/221:07:512
22925991816,2cyclictest0-21swapper/220:08:222
22925991816,1cyclictest743-21snmpd21:00:112
22925991816,1cyclictest743-21snmpd20:48:192
22925991816,1cyclictest743-21snmpd20:36:412
22925991816,1cyclictest743-21snmpd19:29:192
22922991816,2cyclictest0-21swapper/120:24:321
22922991815,3cyclictest0-21swapper/119:31:551
22922991814,3cyclictest0-21swapper/120:35:261
22917991816,1cyclictest743-21snmpd21:01:390
22917991816,1cyclictest743-21snmpd20:12:140
22917991816,1cyclictest743-21snmpd19:38:430
22917991816,1cyclictest743-21snmpd19:29:150
22917991816,1cyclictest743-21snmpd19:22:490
22925991715,1cyclictest743-21snmpd19:16:462
22917991715,1cyclictest743-21snmpd20:50:270
22917991715,1cyclictest743-21snmpd20:21:380
22917991715,1cyclictest743-21snmpd19:11:430
2291799171,14cyclictest0-21swapper/021:05:200
2291799170,16cyclictest0-21swapper/019:15:170
2291799170,11cyclictest0-21swapper/019:54:130
22925991612,3cyclictest0-21swapper/220:11:472
22922991614,2cyclictest0-21swapper/120:25:021
2291799167,8cyclictest0-21swapper/020:55:370
22917991614,1cyclictest743-21snmpd20:05:290
2291799160,9cyclictest0-21swapper/019:55:150
219982120,1sleep37444-21kworker/3:123:10:283
217152100,6sleep30-21swapper/323:59:403
9922291,5sleep30-21swapper/300:10:183
5361292,4sleep30-21swapper/323:19:323
5361292,4sleep30-21swapper/323:19:313
29098292,4sleep30-21swapper/300:01:183
25505291,5sleep30-21swapper/320:30:213
23670292,4sleep30-21swapper/321:33:453
1790292,4sleep30-21swapper/321:39:343
1694290,1sleep30-21swapper/322:27:403
6729282,3sleep30-21swapper/323:02:493
5848280,5sleep30-21swapper/300:05:373
3012280,5sleep30-21swapper/322:11:303
28627280,5sleep30-21swapper/321:51:263
27361282,3sleep30-21swapper/322:55:353
2532282,3sleep30-21swapper/321:22:233
24639282,3sleep30-21swapper/300:33:333
24421280,5sleep30-21swapper/323:45:063
23271282,3sleep30-21swapper/322:05:283
23009282,3sleep30-21swapper/323:27:123
22817282,3sleep30-21swapper/323:43:343
21324282,3sleep30-21swapper/321:49:233
19970282,3sleep30-21swapper/319:55:273
17642282,3sleep30-21swapper/321:15:013
1760281,4sleep30-21swapper/322:45:143
1667282,3sleep30-21swapper/323:33:133
15749281,3sleep30-21swapper/323:06:463
14823282,3sleep30-21swapper/300:28:263
13466282,3sleep30-21swapper/322:16:463
12260280,5sleep30-21swapper/323:38:103
11447282,3sleep30-21swapper/321:26:153
10882281,3sleep30-21swapper/321:43:373
10394282,3sleep30-21swapper/319:20:283
8788271,4sleep30-21swapper/319:50:163
8430270,4sleep30-21swapper/323:51:083
5839271,3sleep30-21swapper/320:14:113
3938271,3sleep30-21swapper/320:40:023
3805272,3sleep30-21swapper/320:38:573
32006271,3sleep30-21swapper/321:55:163
30661270,4sleep30-21swapper/322:41:213
26356270,3sleep30-21swapper/320:05:013
23956271,3sleep30-21swapper/320:25:283
23037270,4sleep30-21swapper/319:10:153
22364270,4sleep30-21swapper/322:20:353
21662272,3sleep30-21swapper/320:52:113
20273270,4sleep30-21swapper/322:35:543
18081270,4sleep30-21swapper/322:51:283
17871272,3sleep30-21swapper/320:20:263
16637272,3sleep30-21swapper/319:28:373
1486272,3sleep30-21swapper/321:04:563
11672270,4sleep30-21swapper/322:32:323
7466260,3sleep30-21swapper/320:15:193
7159260,3sleep30-21swapper/321:05:293
4430262,3sleep30-21swapper/319:16:043
29051262,3sleep30-21swapper/319:40:063
27556262,3sleep30-21swapper/320:55:443
2603260,3sleep30-21swapper/319:45:113
23020260,3sleep30-21swapper/319:35:143
22547262,3sleep30-21swapper/319:32:223
20325261,3sleep30-21swapper/320:00:013
15675260,3sleep30-21swapper/320:47:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional