You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-06-27 - 02:24

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.19.8-rt6 (Profile)

Latency plot of system in rack #4, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack4slot0.osadl.org (updated Mon Jun 27, 2022 00:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8069999287,4cyclictest1397-21ipmitool23:45:150
40312810,1sleep3391rcuc/323:41:543
125742800,1sleep112575-21sshd00:28:461
125742800,1sleep112575-21sshd00:28:451
317342760,1sleep031736-21bash22:25:560
317342760,1sleep031736-21bash22:25:550
102742760,0sleep30-21swapper/321:33:253
247892750,0sleep30-21swapper/321:45:433
8081997270,1cyclictest21612-21ipmitool23:40:152
127172720,0sleep20-21swapper/200:28:472
127172720,0sleep20-21swapper/200:28:462
47942710,0sleep20-21swapper/200:04:102
309262710,0sleep30-21swapper/323:26:513
8087997063,6cyclictest26063-21ipmitool23:55:143
269262700,1sleep2808199cyclictest23:01:132
73062690,0sleep30-21swapper/322:55:243
8073996866,1cyclictest3182-21ipmitool20:15:151
304442680,0sleep10-21swapper/122:36:311
195212680,3sleep2808199cyclictest23:32:472
195212680,3sleep2808199cyclictest23:32:472
167452670,2sleep2808199cyclictest21:26:582
141812670,0sleep00-21swapper/023:57:300
266582660,0sleep20-21swapper/223:48:022
10332640,0sleep20-21swapper/221:50:192
95532610,0sleep20-21swapper/222:09:112
244662600,0sleep00-21swapper/022:21:350
322512570,0sleep30-21swapper/323:34:133
322512570,0sleep30-21swapper/323:34:133
154582570,0sleep00-21swapper/000:01:270
8081995654,1cyclictest13927-21ipmitool23:50:152
8069995654,1cyclictest21630-21ipmitool23:40:140
783025425,9sleep30-21swapper/319:09:053
766925424,9sleep20-21swapper/219:07:152
8073995351,1cyclictest13893-21ipmitool23:50:151
306012530,0sleep20-21swapper/222:00:452
8073995149,1cyclictest26042-21ipmitool23:55:141
789024429,9sleep10-21swapper/119:09:421
642924422,6sleep00-21swapper/019:05:130
154002420,0sleep20-21swapper/223:10:432
8087993735,1cyclictest1404-21ipmitool23:45:153
77042290,1sleep00-21swapper/000:24:160
226922290,1sleep322673-21munin-run00:30:003
226922290,1sleep322673-21munin-run00:30:003
283892270,1sleep3391rcuc/323:04:593
8081992612,1cyclictest25840-21nfsd22:37:492
123992250,0sleep10-21swapper/121:15:431
808199243,2cyclictest16202-21sshd00:33:052
808199243,2cyclictest16202-21sshd00:33:052
806999243,3cyclictest0-21swapper/000:31:500
806999243,3cyclictest0-21swapper/000:31:500
289602240,1sleep128959-21id22:18:281
123872240,17sleep3102550irq/24-eno122:27:233
123872240,17sleep3102550irq/24-eno122:27:233
99682230,0sleep00-21swapper/021:11:530
99682230,0sleep00-21swapper/021:11:530
807399234,1cyclictest0-21swapper/123:06:171
806999230,4cyclictest0-21swapper/021:59:390
216442230,1sleep20-21swapper/222:49:552
88582220,1sleep08849-21sshd22:19:510
808799222,2cyclictest28330-21lspci23:08:353
8087992210,2cyclictest102550irq/24-eno122:49:173
808799220,4cyclictest0-21swapper/322:09:003
808799220,4cyclictest0-21swapper/320:38:203
808799220,4cyclictest0-21swapper/319:26:583
808199222,2cyclictest0-21swapper/220:00:172
808199222,1cyclictest29066-21sshd00:11:022
808199221,2cyclictest0-21swapper/220:45:252
808199220,4cyclictest0-21swapper/219:53:162
807399222,2cyclictest0-21swapper/100:16:281
806999222,2cyclictest0-21swapper/021:05:140
806999222,1cyclictest9533-21bash22:55:410
806999222,1cyclictest0-21swapper/019:11:220
806999220,4cyclictest0-21swapper/023:51:250
806999220,4cyclictest0-21swapper/021:18:020
806999220,3cyclictest0-21swapper/022:53:470
227482220,0sleep10-21swapper/121:45:251
177642220,1sleep3391rcuc/322:20:503
8087992113,2cyclictest7399-21sshd00:39:503
808799211,2cyclictest0-21swapper/321:40:413
808799210,4cyclictest0-21swapper/321:07:373
808799210,4cyclictest0-21swapper/319:19:213
808799210,3cyclictest0-21swapper/322:19:553
808799210,3cyclictest0-21swapper/320:19:353
808799210,3cyclictest0-21swapper/300:10:433
808799210,2cyclictest14973-21lspci21:23:143
808799210,2cyclictest0-21swapper/300:05:133
808799210,1cyclictest0-21swapper/323:39:273
808199212,2cyclictest0-21swapper/219:25:042
808199210,4cyclictest0-21swapper/222:33:002
808199210,3cyclictest29360-21sshd22:11:222
808199210,3cyclictest0-21swapper/223:20:322
808199210,3cyclictest0-21swapper/222:43:202
808199210,3cyclictest0-21swapper/219:36:202
807399211,2cyclictest26738-21bash23:19:141
807399210,4cyclictest0-21swapper/119:22:231
807399210,3cyclictest30239-21sshd00:07:151
807399210,3cyclictest0-21swapper/122:04:301
806999212,2cyclictest15191-21in:imjournal22:30:340
806999211,2cyclictest0-21swapper/000:06:070
806999210,3cyclictest32331-21bash21:21:320
806999210,3cyclictest11292-21sshd23:28:170
806999210,3cyclictest0-21swapper/023:09:260
806999210,2cyclictest0-21swapper/022:47:230
269192210,0sleep20-21swapper/200:38:162
252692210,0sleep00-21swapper/022:07:190
13182210,0sleep31310-21sshd00:15:333
808799203,2cyclictest23529-21lspci22:42:553
808799202,2cyclictest0-21swapper/323:51:493
808799202,2cyclictest0-21swapper/300:02:373
808799201,1cyclictest0-21swapper/322:34:193
808799200,2cyclictest23987-21lspci22:14:213
808799200,2cyclictest0-21swapper/322:51:143
808199203,2cyclictest29165-21sshd22:57:532
808199200,2cyclictest0-21swapper/223:27:572
808199200,2cyclictest0-21swapper/220:10:172
808199200,2cyclictest0-21swapper/219:46:442
808199200,2cyclictest0-21swapper/219:46:442
807399200,2cyclictest0-21swapper/120:37:211
807399200,2cyclictest0-21swapper/120:11:151
807399200,2cyclictest0-21swapper/119:19:021
806999201,1cyclictest0-21swapper/019:21:250
806999200,4cyclictest0-21swapper/019:59:470
806999200,3cyclictest0-21swapper/020:06:330
806999200,2cyclictest0-21swapper/020:56:340
808799190,4cyclictest0-21swapper/321:03:073
808799190,1cyclictest0-21swapper/323:19:173
808799190,1cyclictest0-21swapper/321:55:133
808799190,1cyclictest0-21swapper/321:25:473
808799190,1cyclictest0-21swapper/321:16:373
808799190,1cyclictest0-21swapper/321:10:463
808799190,1cyclictest0-21swapper/321:10:463
808799190,1cyclictest0-21swapper/320:48:283
808799190,1cyclictest0-21swapper/320:27:363
808799190,1cyclictest0-21swapper/320:11:273
808799190,1cyclictest0-21swapper/320:06:593
808799190,1cyclictest0-21swapper/319:45:143
808799190,1cyclictest0-21swapper/319:45:143
808799190,1cyclictest0-21swapper/319:40:013
808799190,1cyclictest0-21swapper/319:36:493
808799190,1cyclictest0-21swapper/319:23:413
808799190,1cyclictest0-21swapper/319:11:463
808199192,2cyclictest0-21swapper/219:14:122
808199192,0cyclictest0-21swapper/219:18:592
808199191,3cyclictest0-21swapper/223:35:332
808199190,3cyclictest6290-21bash23:16:562
808199190,2cyclictest0-21swapper/219:44:412
808199190,1cyclictest0-21swapper/223:59:162
808199190,1cyclictest0-21swapper/222:50:522
808199190,1cyclictest0-21swapper/221:58:272
808199190,1cyclictest0-21swapper/221:39:142
808199190,1cyclictest0-21swapper/221:30:372
808199190,1cyclictest0-21swapper/221:19:082
808199190,1cyclictest0-21swapper/221:13:412
808199190,1cyclictest0-21swapper/221:13:402
808199190,1cyclictest0-21swapper/221:09:252
808199190,1cyclictest0-21swapper/220:40:422
808199190,1cyclictest0-21swapper/220:30:322
808199190,1cyclictest0-21swapper/220:27:332
808199190,1cyclictest0-21swapper/220:22:062
808199190,1cyclictest0-21swapper/220:09:272
808199190,1cyclictest0-21swapper/219:20:472
808199190,1cyclictest0-21swapper/200:22:282
807399192,2cyclictest0-21swapper/122:24:491
807399191,2cyclictest0-21swapper/122:57:141
807399190,3cyclictest0-21swapper/123:39:361
807399190,2cyclictest23165-21lspci21:34:501
807399190,2cyclictest0-21swapper/122:53:141
807399190,1cyclictest0-21swapper/123:46:151
807399190,1cyclictest0-21swapper/123:13:451
807399190,1cyclictest0-21swapper/122:44:011
807399190,1cyclictest0-21swapper/122:25:491
807399190,1cyclictest0-21swapper/122:25:481
807399190,1cyclictest0-21swapper/122:14:471
807399190,1cyclictest0-21swapper/122:08:031
807399190,1cyclictest0-21swapper/121:54:381
807399190,1cyclictest0-21swapper/121:25:311
807399190,1cyclictest0-21swapper/121:21:381
807399190,1cyclictest0-21swapper/121:07:461
807399190,1cyclictest0-21swapper/120:58:101
807399190,1cyclictest0-21swapper/120:45:191
807399190,1cyclictest0-21swapper/120:34:091
807399190,1cyclictest0-21swapper/120:00:561
807399190,1cyclictest0-21swapper/119:37:591
807399190,1cyclictest0-21swapper/119:10:431
807399190,1cyclictest0-21swapper/100:10:141
806999192,2cyclictest0-21swapper/023:10:020
806999191,5cyclictest593-21systemd-journal00:12:470
8069991915,2cyclictest21191-21sshd23:00:350
806999190,1cyclictest0-21swapper/023:35:540
806999190,1cyclictest0-21swapper/023:20:130
806999190,1cyclictest0-21swapper/022:35:520
806999190,1cyclictest0-21swapper/021:47:230
806999190,1cyclictest0-21swapper/021:38:080
806999190,1cyclictest0-21swapper/020:44:100
806999190,1cyclictest0-21swapper/020:35:120
806999190,1cyclictest0-21swapper/020:28:410
806999190,1cyclictest0-21swapper/020:20:150
806999190,1cyclictest0-21swapper/020:18:150
806999190,1cyclictest0-21swapper/020:10:090
806999190,1cyclictest0-21swapper/020:00:590
806999190,1cyclictest0-21swapper/019:42:260
806999190,1cyclictest0-21swapper/019:39:110
806999190,1cyclictest0-21swapper/019:25:120
806999190,1cyclictest0-21swapper/019:17:070
806999190,1cyclictest0-21swapper/000:36:470
808799181,2cyclictest2673-21df23:20:113
808799180,3cyclictest0-21swapper/300:34:233
808799180,3cyclictest0-21swapper/300:34:233
808799180,2cyclictest0-21swapper/319:30:443
808799180,1cyclictest0-21swapper/322:39:333
808799180,1cyclictest0-21swapper/320:55:243
808799180,1cyclictest0-21swapper/320:53:283
808799180,1cyclictest0-21swapper/320:33:123
808799180,0cyclictest0-21swapper/323:10:143
808799180,0cyclictest0-21swapper/320:40:033
808199182,1cyclictest1510-21snmpd20:39:452
808199180,1cyclictest0-21swapper/221:22:262
808199180,1cyclictest0-21swapper/221:00:582
808199180,1cyclictest0-21swapper/200:07:372
808199180,0cyclictest0-21swapper/220:50:562
808199180,0cyclictest0-21swapper/219:31:202
807399182,1cyclictest0-21swapper/121:40:151
807399180,3cyclictest0-21swapper/120:53:541
807399180,2cyclictest0-21swapper/100:21:011
807399180,1cyclictest18335-21lspci21:55:511
807399180,1cyclictest0-21swapper/119:51:231
807399180,1cyclictest0-21swapper/100:36:491
807399180,1cyclictest0-21swapper/100:04:401
807399180,0cyclictest0-21swapper/119:30:501
806999180,3cyclictest0-21swapper/020:45:180
806999180,2cyclictest25333-21tty23:33:270
806999180,2cyclictest25333-21tty23:33:270
806999180,1cyclictest12573-21sshd22:13:060
806999180,1cyclictest0-21swapper/022:41:100
806999180,1cyclictest0-21swapper/021:32:260
808799170,4cyclictest9240-21lspci21:54:543
808199170,1cyclictest0-21swapper/222:15:322
807399170,4cyclictest0-21swapper/123:32:151
807399170,4cyclictest0-21swapper/123:32:151
807399170,2cyclictest25839-21nfsd22:45:411
807399170,2cyclictest0-21swapper/123:02:051
807399170,2cyclictest0-21swapper/122:33:071
807399170,1cyclictest0-21swapper/123:40:301
807399170,1cyclictest0-21swapper/119:43:351
294122170,0sleep00-21swapper/023:15:540
808799160,1cyclictest0-21swapper/321:38:253
808799160,1cyclictest0-21swapper/320:03:443
808199160,1cyclictest0-21swapper/220:19:152
807399160,3cyclictest0-21swapper/121:02:371
807399160,1cyclictest0-21swapper/121:12:591
807399160,1cyclictest0-21swapper/121:12:581
807399160,1cyclictest0-21swapper/120:28:351
807399160,1cyclictest0-21swapper/120:20:091
807399160,1cyclictest0-21swapper/120:05:251
807399160,1cyclictest0-21swapper/100:30:081
807399160,1cyclictest0-21swapper/100:30:081
806999162,1cyclictest21735-21lspci00:29:530
806999162,1cyclictest21735-21lspci00:29:530
806999160,4cyclictest0-21swapper/021:04:520
806999160,1cyclictest26989-21strings22:00:240
808799150,3cyclictest0-21swapper/322:01:333
808799150,1cyclictest0-21swapper/320:20:193
808199154,2cyclictest24350-21bash21:45:372
808199150,3cyclictest0-21swapper/222:25:312
808199150,3cyclictest0-21swapper/222:25:312
808199150,3cyclictest0-21swapper/219:58:472
807399150,3cyclictest0-21swapper/123:27:421
807399150,1cyclictest0-21swapper/121:39:051
807399150,1cyclictest0-21swapper/119:55:591
806999150,3cyclictest0-21swapper/021:40:150
806999150,1cyclictest0-21swapper/019:30:410
806999150,14cyclictest0-21swapper/019:45:120
806999150,14cyclictest0-21swapper/019:45:110
808799141,3cyclictest0-21swapper/300:24:203
808799140,3cyclictest0-21swapper/319:51:173
8081991410,3cyclictest19591-21sshd21:41:312
808199140,1cyclictest0-21swapper/222:22:152
808199140,0cyclictest0-21swapper/220:56:372
807399140,2cyclictest0-21swapper/120:42:281
8069991411,2cyclictest8251-21sshd21:26:010
808799130,12cyclictest0-21swapper/319:55:193
808199132,2cyclictest4155-21rm23:09:312
806999131,2cyclictest0-21swapper/021:50:230
806999130,1cyclictest0-21swapper/019:54:530
808199120,10cyclictest30687-21sshd00:15:142
807399120,10cyclictest13311-21sshd23:21:181
806999120,2cyclictest593-21systemd-journal00:17:060
806999120,1cyclictest0-21swapper/020:50:400
806999120,1cyclictest0-21swapper/020:30:120
807399110,1cyclictest15071-21diskstats19:25:121
807399110,10cyclictest23184-21df19:45:121
807399110,10cyclictest23184-21df19:45:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional