You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-27 - 03:47

x86 Intel Core i7-E610 @2530 MHz, Linux 4.9.271-rt182 (Profile)

Latency plot of system in rack #5, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4.osadl.org (updated Mon Jun 27, 2022 00:44:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24577210490,8sleep30-21swapper/319:07:043
2448028575,7sleep00-21swapper/019:05:480
2459128475,6sleep20-21swapper/219:07:152
2479728373,7sleep10-21swapper/119:09:551
176062670,1sleep1211ktimersoftd/120:20:221
267982610,0sleep30-21swapper/321:17:403
279552580,1sleep027948-21apt-get00:30:110
232162570,0sleep00-21swapper/021:30:300
291762560,1sleep20-21swapper/221:50:192
23922550,1sleep30-21swapper/300:31:543
187992540,0sleep10-21swapper/119:30:111
2497999340,32cyclictest0-21swapper/222:03:542
2497499320,19cyclictest0-21swapper/123:20:281
2497499310,20cyclictest0-21swapper/123:06:201
2497499303,4cyclictest0-21swapper/123:52:101
2497499302,27cyclictest0-21swapper/100:35:321
2497499300,18cyclictest0-21swapper/100:34:221
2497499300,14cyclictest0-21swapper/122:16:251
2497499290,2cyclictest0-21swapper/123:13:201
2497499290,22cyclictest0-21swapper/100:20:381
2497499284,20cyclictest0-21swapper/121:48:001
24974992817,4cyclictest0-21swapper/122:50:581
24974992813,13cyclictest0-21swapper/121:16:351
24974992813,12cyclictest0-21swapper/122:43:111
2497499281,21cyclictest0-21swapper/123:39:461
24974992812,12cyclictest0-21swapper/123:47:071
2497499280,6cyclictest0-21swapper/100:15:231
2497499280,2cyclictest0-21swapper/122:06:391
2497499280,27cyclictest0-21swapper/120:39:521
2497499280,26cyclictest0-21swapper/122:28:401
2497499280,1cyclictest0-21swapper/123:02:261
2497499280,13cyclictest0-21swapper/122:30:471
24979992723,3cyclictest0-21swapper/221:33:442
2497999270,26cyclictest0-21swapper/220:15:132
24974992711,14cyclictest0-21swapper/122:23:061
24974992710,15cyclictest0-21swapper/123:15:201
2497499270,26cyclictest0-21swapper/121:44:591
2497499270,26cyclictest0-21swapper/120:57:251
2497499270,26cyclictest0-21swapper/120:00:441
2497499270,26cyclictest0-21swapper/119:14:001
2497499270,21cyclictest0-21swapper/120:51:431
2497499270,16cyclictest0-21swapper/123:55:301
2497499270,14cyclictest0-21swapper/121:34:321
24979992622,3cyclictest0-21swapper/219:58:342
2497999260,25cyclictest13139-21ssh00:37:592
2497999260,25cyclictest0-21swapper/222:59:492
2497999260,25cyclictest0-21swapper/222:46:182
2497999260,25cyclictest0-21swapper/220:44:102
2497499262,2cyclictest1851-21irqstats00:00:181
24974992618,7cyclictest743-21snmpd20:33:011
2497499260,6cyclictest0-21swapper/121:05:111
2497499260,24cyclictest0-21swapper/100:28:571
2497499260,19cyclictest0-21swapper/121:13:461
2497499260,15cyclictest0-21swapper/121:21:511
2497499260,10cyclictest0-21swapper/122:37:571
24967992610,15cyclictest0-21swapper/021:41:490
24979992517,7cyclictest0-21swapper/220:59:222
2497999251,23cyclictest0-21swapper/222:21:032
2497999250,23cyclictest13406-21munin-run23:35:002
24974992521,3cyclictest0-21swapper/119:55:551
24974992521,3cyclictest0-21swapper/119:28:541
24974992511,12cyclictest0-21swapper/121:27:211
2497499250,3cyclictest0-21swapper/122:13:121
2497499250,2cyclictest0-21swapper/119:35:551
2497499250,24cyclictest0-21swapper/123:25:191
2497499250,24cyclictest0-21swapper/120:29:071
2497499250,24cyclictest0-21swapper/100:13:441
2497499250,19cyclictest0-21swapper/120:06:521
2497499250,15cyclictest0-21swapper/121:56:301
24967992516,8cyclictest0-21swapper/023:38:080
2496799250,24cyclictest0-21swapper/021:21:000
24979992421,2cyclictest0-21swapper/221:36:472
24979992418,6cyclictest0-21swapper/223:54:442
2497999241,22cyclictest0-21swapper/223:01:012
2497999240,23cyclictest0-21swapper/223:18:262
24974992414,9cyclictest0-21swapper/122:45:591
2497499241,22cyclictest0-21swapper/121:02:581
2497499241,17cyclictest0-21swapper/100:08:291
2497499240,16cyclictest0-21swapper/123:41:541
2497499240,12cyclictest0-21swapper/122:56:401
24967992417,7cyclictest0-21swapper/000:14:310
24967992416,7cyclictest0-21swapper/023:18:570
24967992416,7cyclictest0-21swapper/022:57:020
24967992415,8cyclictest0-21swapper/023:46:370
2496799241,17cyclictest0-21swapper/000:37:500
2496799240,23cyclictest0-21swapper/023:52:080
2496799240,23cyclictest0-21swapper/022:26:150
2496799240,23cyclictest0-21swapper/022:14:320
2496799240,18cyclictest0-21swapper/022:52:510
24979992319,3cyclictest0-21swapper/222:52:372
2497999230,22cyclictest0-21swapper/223:07:472
2497999230,17cyclictest0-21swapper/221:20:262
24974992319,3cyclictest0-21swapper/119:44:191
24974992319,3cyclictest0-21swapper/119:18:331
24974992313,3cyclictest0-21swapper/121:35:301
2497499231,21cyclictest0-21swapper/122:01:521
2497499230,22cyclictest0-21swapper/120:47:531
2497499230,11cyclictest0-21swapper/123:31:501
24967992315,7cyclictest0-21swapper/023:30:470
2496799230,22cyclictest0-21swapper/022:45:420
2496799230,22cyclictest0-21swapper/022:35:520
2496799230,22cyclictest0-21swapper/022:32:000
2496799230,22cyclictest0-21swapper/022:06:370
2496799230,22cyclictest0-21swapper/021:46:370
2497999229,12cyclictest0-21swapper/222:25:022
24979992216,6cyclictest0-21swapper/220:30:042
2497999220,21cyclictest0-21swapper/223:43:592
2497999220,21cyclictest0-21swapper/222:41:102
2497999220,21cyclictest0-21swapper/222:08:422
2497999220,21cyclictest0-21swapper/221:19:162
2497999220,21cyclictest0-21swapper/200:16:212
2497999220,21cyclictest0-21swapper/200:05:092
2497999220,20cyclictest0-21swapper/222:12:032
24974992217,4cyclictest0-21swapper/120:15:551
2497499221,20cyclictest0-21swapper/120:14:281
2497499221,20cyclictest0-21swapper/120:14:281
2497499220,21cyclictest0-21swapper/119:47:051
2497499220,11cyclictest0-21swapper/121:52:201
2496799221,20cyclictest0-21swapper/023:27:500
2496799221,20cyclictest0-21swapper/023:06:220
2496799221,15cyclictest5151-21kworker/0:221:12:380
2496799220,21cyclictest0-21swapper/023:55:100
2496799220,21cyclictest0-21swapper/023:11:420
2496799220,21cyclictest0-21swapper/023:01:190
2496799220,21cyclictest0-21swapper/022:40:360
2496799220,21cyclictest0-21swapper/022:22:080
2496799220,21cyclictest0-21swapper/022:01:290
2496799220,21cyclictest0-21swapper/021:38:080
2496799220,21cyclictest0-21swapper/021:15:090
2496799220,21cyclictest0-21swapper/000:06:560
2496799220,21cyclictest0-21swapper/000:00:150
2496799220,16cyclictest0-21swapper/023:42:200
2496799220,16cyclictest0-21swapper/021:25:320
2496799220,16cyclictest0-21swapper/000:17:060
24979992119,2cyclictest0-21swapper/220:48:462
24979992119,2cyclictest0-21swapper/219:16:042
24979992118,1cyclictest749-21lldpd23:47:332
24979992117,3cyclictest0-21swapper/219:29:432
24979992117,3cyclictest0-21swapper/219:10:422
24979992116,5cyclictest0-21swapper/223:23:342
2497999211,19cyclictest0-21swapper/200:24:222
2497999210,20cyclictest0-21swapper/223:56:062
2497999210,20cyclictest0-21swapper/223:39:002
2497999210,20cyclictest0-21swapper/223:13:452
2497999210,20cyclictest0-21swapper/221:55:242
2497999210,20cyclictest0-21swapper/221:49:392
2497999210,20cyclictest0-21swapper/221:13:322
2497999210,20cyclictest0-21swapper/221:02:082
2497999210,20cyclictest0-21swapper/220:04:592
2497999210,20cyclictest0-21swapper/219:24:542
2497999210,20cyclictest0-21swapper/200:30:392
2497999210,20cyclictest0-21swapper/200:14:122
2497499210,20cyclictest0-21swapper/120:40:231
2497499210,20cyclictest0-21swapper/119:54:131
2497499210,20cyclictest0-21swapper/119:21:061
2496799210,20cyclictest0-21swapper/022:15:240
2496799210,20cyclictest0-21swapper/021:58:450
2496799210,20cyclictest0-21swapper/021:50:500
2496799210,20cyclictest0-21swapper/000:25:030
2496799210,20cyclictest0-21swapper/000:21:010
24979992018,1cyclictest743-21snmpd22:17:482
24979992018,1cyclictest743-21snmpd20:35:502
24979992018,1cyclictest743-21snmpd20:11:592
24979992018,1cyclictest743-21snmpd20:11:582
24979992018,1cyclictest743-21snmpd00:25:562
24979992017,2cyclictest743-21snmpd22:35:302
2497999200,2cyclictest0-21swapper/221:09:112
2497999200,2cyclictest0-21swapper/220:21:232
2497999200,19cyclictest0-21swapper/200:04:052
2497999200,18cyclictest0-21swapper/221:25:182
24967992018,1cyclictest743-21snmpd20:29:010
24967992018,1cyclictest743-21snmpd20:06:250
24967992018,1cyclictest743-21snmpd19:39:330
24967992017,3cyclictest0-21swapper/023:22:010
2497999193,9cyclictest0-21swapper/219:45:502
24979991917,1cyclictest743-21snmpd20:50:222
24979991917,1cyclictest743-21snmpd20:05:432
24979991917,1cyclictest743-21snmpd19:50:412
24979991917,1cyclictest743-21snmpd19:31:152
24979991913,6cyclictest0-21swapper/223:28:342
2497999190,13cyclictest0-21swapper/221:41:072
24967991917,1cyclictest743-21snmpd21:08:560
24967991917,1cyclictest743-21snmpd20:55:380
24967991917,1cyclictest743-21snmpd20:53:220
24967991917,1cyclictest743-21snmpd20:41:550
24967991917,1cyclictest743-21snmpd20:23:160
24967991917,1cyclictest743-21snmpd20:16:130
24967991917,1cyclictest743-21snmpd20:14:470
24967991917,1cyclictest743-21snmpd20:14:460
24967991917,1cyclictest743-21snmpd20:00:520
24967991917,1cyclictest743-21snmpd19:51:040
24967991917,1cyclictest743-21snmpd19:25:180
24967991917,1cyclictest743-21snmpd19:14:400
24979991816,1cyclictest743-21snmpd22:31:572
24979991816,1cyclictest743-21snmpd19:38:372
24967991816,1cyclictest743-21snmpd20:46:250
24967991816,1cyclictest743-21snmpd19:43:390
24967991816,1cyclictest743-21snmpd19:21:490
24967991816,1cyclictest743-21snmpd19:16:570
138782180,0sleep30-21swapper/319:25:183
24979991715,1cyclictest743-21snmpd20:27:072
24979991715,1cyclictest743-21snmpd19:42:512
2496799179,7cyclictest0-21swapper/020:36:180
24967991715,1cyclictest743-21snmpd19:57:010
24967991715,1cyclictest743-21snmpd19:47:140
24967991614,1cyclictest743-21snmpd20:32:260
24967991614,1cyclictest743-21snmpd19:31:520
2496799160,15cyclictest0-21swapper/021:04:230
309082101,6sleep30-21swapper/322:39:273
124572101,5sleep30-21swapper/300:37:123
6997291,5sleep30-21swapper/321:40:203
5609292,4sleep30-21swapper/321:23:413
3479290,4sleep30-21swapper/322:55:513
32293292,4sleep30-21swapper/322:07:273
2326292,3sleep30-21swapper/323:11:523
22348291,4sleep30-21swapper/322:02:423
19915290,3sleep30-21swapper/323:35:593
18507292,4sleep30-21swapper/322:32:143
17898292,4sleep30-21swapper/300:07:323
16925292,4sleep30-21swapper/322:47:163
15948291,5sleep30-21swapper/323:20:133
1568294,3sleep30-21swapper/323:28:103
11761292,4sleep30-21swapper/323:16:093
10182290,6sleep30-21swapper/322:12:403
9868282,3sleep30-21swapper/319:50:023
9545282,3sleep30-21swapper/323:30:473
7943282,3sleep30-21swapper/322:26:503
7937282,3sleep30-21swapper/321:07:263
7872282,3sleep30-21swapper/300:02:233
5086280,5sleep30-21swapper/322:40:313
4009282,3sleep30-21swapper/300:15:413
31408282,3sleep30-21swapper/323:58:473
28670280,5sleep30-21swapper/322:20:333
26782281,4sleep30-21swapper/323:09:123
26732282,3sleep30-21swapper/300:10:563
26232282,3sleep30-21swapper/322:51:213
25812280,5sleep30-21swapper/300:27:583
25507280,3sleep325638-21if_enp0s25.319:35:153
24582281,5sleep30-21swapper/320:25:253
24010281,4sleep30-21swapper/323:40:123
22792280,5sleep30-21swapper/321:30:263
21994281,4sleep30-21swapper/320:00:103
21845280,5sleep30-21swapper/323:54:463
19099282,3sleep30-21swapper/322:16:163
18541282,3sleep30-21swapper/320:20:283
17034282,3sleep30-21swapper/300:24:143
16416282,3sleep30-21swapper/321:45:043
15731282,3sleep30-21swapper/321:12:073
14866282,3sleep30-21swapper/321:27:333
13256281,4sleep30-21swapper/323:00:263
11963281,4sleep30-21swapper/320:45:203
7366272,3sleep30-21swapper/320:15:123
723271,3sleep30-21swapper/321:51:213
30694272,3sleep30-21swapper/319:40:053
28790271,3sleep30-21swapper/321:00:023
27998270,3sleep30-21swapper/321:35:023
25266272,3sleep30-21swapper/320:30:023
24186272,3sleep30-21swapper/319:31:063
23908270,5sleep30-21swapper/320:55:173
21704272,3sleep30-21swapper/319:59:343
12593272,3sleep30-21swapper/319:24:463
10653270,4sleep30-21swapper/321:56:013
952260,3sleep30-21swapper/319:15:133
7309261,2sleep30-21swapper/323:45:253
7011262,3sleep30-21swapper/320:13:373
7011262,3sleep30-21swapper/320:13:363
5150261,3sleep30-21swapper/320:40:073
4184262,3sleep30-21swapper/319:45:043
4155260,3sleep30-21swapper/320:35:233
30753262,3sleep30-21swapper/319:14:083
27914262,3sleep30-21swapper/320:05:033
17068260,3sleep30-21swapper/320:50:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional