You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-17 - 05:14

Intel(R) Core(TM) i3-4360 CPU @ 3.70GHz, Linux 5.10.1-rt20 (Profile)

Latency plot of system in rack #0, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack0slot4.osadl.org (updated Mon Oct 11, 2021 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1387960212171,18sleep10-21swapper/119:07:281
1387873210678,17sleep30-21swapper/319:06:453
1387872210371,19sleep20-21swapper/219:06:452
1387819210372,18sleep00-21swapper/019:06:110
1388440998424,30cyclictest0-21swapper/221:32:462
138844099699,28cyclictest0-21swapper/221:42:462
1388440996910,28cyclictest0-21swapper/222:27:462
138844099679,28cyclictest0-21swapper/221:07:462
138844099674,29cyclictest0-21swapper/222:07:462
1388440996710,29cyclictest0-21swapper/222:42:462
1388440996710,26cyclictest0-21swapper/223:12:472
1388440996610,30cyclictest0-21swapper/200:02:472
138844899640,0cyclictest0-21swapper/300:18:583
138844099649,29cyclictest0-21swapper/200:22:462
138844099649,28cyclictest0-21swapper/222:52:462
1388448996363,0cyclictest1482622-21kworker/3:221:45:593
1388448996363,0cyclictest1400563-21kworker/3:120:31:003
1388448996363,0cyclictest1400563-21kworker/3:120:24:593
1388448996363,0cyclictest1400563-21kworker/3:119:48:003
138844899630,63cyclictest0-21swapper/320:53:593
138844899630,0cyclictest0-21swapper/323:11:593
138844899630,0cyclictest0-21swapper/321:31:003
1388440996316,29cyclictest0-21swapper/220:47:472
1388440996310,27cyclictest0-21swapper/222:17:462
13950092620,0sleep00-21swapper/019:20:400
1388448996262,0cyclictest1482622-21kworker/3:221:59:593
1388448996262,0cyclictest1432899-21kworker/3:221:08:593
1388448996262,0cyclictest1400563-21kworker/3:120:03:003
1388448996262,0cyclictest1400563-21kworker/3:119:57:593
1388448996261,1cyclictest1482622-21kworker/3:222:02:593
138844899620,62cyclictest0-21swapper/321:01:003
138844899620,62cyclictest0-21swapper/320:19:003
138844899620,0cyclictest0-21swapper/322:34:593
138844899620,0cyclictest0-21swapper/319:54:593
138844099629,27cyclictest0-21swapper/221:52:462
1388440996210,24cyclictest0-21swapper/223:37:472
1388448996161,0cyclictest1400563-21kworker/3:120:40:593
1388448996161,0cyclictest1400563-21kworker/3:120:35:593
1388448996161,0cyclictest1400563-21kworker/3:119:42:593
1388448996113,28cyclictest0-21swapper/319:12:463
138844899610,61cyclictest0-21swapper/319:33:003
138844899610,61cyclictest0-21swapper/300:22:593
138844899610,0cyclictest0-21swapper/323:55:593
138844899610,0cyclictest0-21swapper/321:29:593
138844899610,0cyclictest0-21swapper/320:56:593
138844099610,61cyclictest0-21swapper/223:00:202
1388436996160,1cyclictest1000-21snmpd20:00:581
1388436996158,1cyclictest0-21swapper/122:45:231
1388448996060,0cyclictest1400563-21kworker/3:120:26:593
1388448996060,0cyclictest1400563-21kworker/3:120:14:593
1388448996060,0cyclictest1400563-21kworker/3:120:09:593
138844899600,0cyclictest0-21swapper/322:50:593
1388436996059,1cyclictest0-21swapper/121:05:251
1388436996058,1cyclictest1389744-21sensors19:10:301
138844899599,28cyclictest0-21swapper/319:27:463
1388448995959,0cyclictest1634267-21kworker/3:000:28:593
1388448995959,0cyclictest1598530-21kworker/3:223:46:583
138844899590,59cyclictest0-21swapper/323:15:593
138844899590,59cyclictest0-21swapper/322:10:593
138844899590,0cyclictest0-21swapper/323:35:593
138844899590,0cyclictest0-21swapper/319:35:593
1388440995958,1cyclictest0-21swapper/223:16:312
138843699590,59cyclictest0-21swapper/119:40:521
138843699590,0cyclictest0-21swapper/100:19:071
15376302580,0sleep20-21swapper/222:38:572
14942202580,0sleep20-21swapper/221:56:322
1388440995858,0cyclictest0-21swapper/221:18:202
1388440995857,1cyclictest0-21swapper/220:38:252
1388436995857,1cyclictest0-21swapper/100:35:221
1388448995757,0cyclictest1634267-21kworker/3:000:30:583
1388448995757,0cyclictest1499659-21kworker/3:122:06:593
1388448995756,1cyclictest0-21swapper/300:04:583
138844899570,57cyclictest0-21swapper/323:40:593
138844899570,57cyclictest0-21swapper/322:38:593
138844899570,0cyclictest0-21swapper/323:54:593
1388431995755,1cyclictest1555766-21sensors22:55:330
138843199570,0cyclictest0-21swapper/023:18:210
1388448995656,0cyclictest1445180-21kworker/3:021:10:593
1388448995656,0cyclictest0-21swapper/321:36:583
1388448995655,1cyclictest0-21swapper/322:19:583
1388448995655,1cyclictest0-21swapper/300:36:593
138843699560,0cyclictest0-21swapper/120:20:301
1388431995656,0cyclictest0-21swapper/021:55:290
1388431995655,1cyclictest1000-21snmpd23:06:590
1388448995554,1cyclictest0-21swapper/321:20:283
1388440995554,1cyclictest1000-21snmpd22:46:482
1388431995554,1cyclictest0-21swapper/023:28:210
15205572540,0sleep20-21swapper/222:21:552
1388448995453,1cyclictest0-21swapper/323:03:593
1388448995449,2cyclictest213849-21CPU3
138844899540,54cyclictest0-21swapper/322:43:593
138843699540,54cyclictest0-21swapper/100:30:221
1388431995452,1cyclictest3508964-21gnome-shell23:52:580
1388448995353,0cyclictest0-21swapper/323:25:593
1388448995353,0cyclictest0-21swapper/322:28:593
1388448995352,1cyclictest0-21swapper/321:40:233
1388436995351,1cyclictest0-21swapper/123:52:581
1388431995352,1cyclictest1000-21snmpd00:03:330
1388440995250,1cyclictest3508964-21gnome-shell21:47:582
1388436995251,1cyclictest0-21swapper/123:10:201
1388431995252,0cyclictest0-21swapper/021:35:260
1388431995252,0cyclictest0-21swapper/000:20:190
1388448995150,1cyclictest0-21swapper/323:30:293
1388448995150,1cyclictest0-21swapper/323:23:593
1388448995149,1cyclictest3508964-21gnome-shell00:07:593
1388431995151,0cyclictest0-21swapper/023:31:590
1388431995150,1cyclictest0-21swapper/019:35:370
1388448995049,1cyclictest0-21swapper/322:23:583
1388448995048,1cyclictest3508964-21gnome-shell23:06:593
1388448995048,1cyclictest3508964-21gnome-shell22:58:593
1388440995049,1cyclictest1446134-21sensors21:10:262
1388440995049,1cyclictest1438907-21sensors20:55:282
1388436995049,1cyclictest0-21swapper/123:31:591
1388436995049,1cyclictest0-21swapper/119:15:341
1388436995048,1cyclictest3508964-21gnome-shell23:46:591
1388431995050,0cyclictest0-21swapper/023:46:590
1388431995050,0cyclictest0-21swapper/000:15:590
1388431995048,1cyclictest1000-21snmpd21:06:110
1388431995047,1cyclictest0-21swapper/021:41:580
1388448994948,1cyclictest0-21swapper/300:10:243
1388436994948,1cyclictest1408886-21sensors19:50:351
1388436994948,1cyclictest0-21swapper/122:15:581
1388436994948,1cyclictest0-21swapper/121:50:191
1388436994948,1cyclictest0-21swapper/120:35:341
1388431994948,1cyclictest1602506-21sensors23:40:230
1388431994948,1cyclictest1374481-21kworker/0:220:22:350
1388448994848,0cyclictest0-21swapper/319:20:583
1388448994847,1cyclictest0-21swapper/321:50:583
1388448994847,1cyclictest0-21swapper/321:16:593
1388431994848,0cyclictest0-21swapper/023:11:590
1388431994746,1cyclictest1000-21snmpd22:35:530
1388448994645,1cyclictest0-21swapper/319:17:593
1388436994644,1cyclictest3508964-21gnome-shell21:41:581
1388431994645,1cyclictest1000-21snmpd20:48:490
1388431994545,0cyclictest0-21swapper/022:41:590
1388436994443,1cyclictest0-21swapper/122:41:591
1388431994444,0cyclictest0-21swapper/022:50:250
1388431994444,0cyclictest0-21swapper/022:05:350
1388440994342,0cyclictest1638738-21sensors00:15:222
1388436994342,1cyclictest0-21swapper/122:20:241
1388431994343,0cyclictest0-21swapper/000:27:590
1388431994342,1cyclictest1000-21snmpd20:13:370
1388436994241,1cyclictest0-21swapper/121:20:281
1388436994241,1cyclictest0-21swapper/120:40:331
1388436994241,1cyclictest0-21swapper/119:45:301
1388431994240,1cyclictest3508964-21gnome-shell21:30:580
1388436994141,0cyclictest0-21swapper/100:27:591
1388431994141,0cyclictest0-21swapper/022:13:580
1388431994140,1cyclictest1438905-21sensors20:55:280
1388431994140,1cyclictest0-21swapper/000:38:580
1388440994040,0cyclictest0-21swapper/223:06:592
1388431994039,1cyclictest1000-21snmpd20:05:170
1388440993939,0cyclictest0-21swapper/222:55:332
1388436993939,0cyclictest0-21swapper/122:13:581
1388436993938,1cyclictest0-21swapper/121:30:581
1388440993838,0cyclictest1000-21snmpd23:28:212
1388440993736,1cyclictest1472219-21sensors21:35:252
1388440993736,1cyclictest0-21swapper/223:52:592
1388431993736,1cyclictest0-21swapper/023:20:280
1388431993736,1cyclictest0-21swapper/000:10:590
1388440993635,1cyclictest1401958-21sensors19:35:372
1388436993636,0cyclictest0-21swapper/121:59:581
1388431993636,0cyclictest1000-21snmpd19:45:550
1388440993535,0cyclictest0-21swapper/223:31:592
1388440993533,1cyclictest1000-21snmpd23:46:172
1388436993534,1cyclictest1628415-21sensors00:05:231
1388436993534,1cyclictest0-21swapper/123:35:251
1388431993535,0cyclictest0-21swapper/023:04:590
1388431993535,0cyclictest0-21swapper/021:27:580
1388436993434,0cyclictest0-21swapper/100:10:591
1388436993433,1cyclictest0-21swapper/123:04:591
1388431993434,0cyclictest0-21swapper/022:30:590
1388431993434,0cyclictest0-21swapper/000:08:580
1388448993330,1cyclictest0-21swapper/322:45:233
1388440993333,0cyclictest0-21swapper/219:20:412
1388436993333,0cyclictest0-21swapper/121:27:581
1388431993333,0cyclictest0-21swapper/019:53:590
1388431993331,1cyclictest1482610-21sensors21:45:190
1388440993232,0cyclictest0-21swapper/223:40:232
1388440993232,0cyclictest0-21swapper/220:22:342
1388431993232,0cyclictest0-21swapper/022:46:590
1388431993232,0cyclictest0-21swapper/021:11:580
1388436993131,0cyclictest0-21swapper/122:30:591
1388436993130,1cyclictest0-21swapper/120:30:321
1388431993131,0cyclictest0-21swapper/019:18:590
1388436993030,0cyclictest0-21swapper/121:12:581
1388436993029,1cyclictest0-21swapper/120:05:331
1388440992927,1cyclictest3508964-21gnome-shell00:27:592
1388436992929,0cyclictest0-21swapper/121:46:581
1388436992927,1cyclictest3508964-21gnome-shell21:38:581
1388431992928,1cyclictest1646748-21kworker/0:000:30:440
1388431992928,1cyclictest0-21swapper/022:27:590
1388436992828,0cyclictest0-21swapper/123:27:591
1388436992828,0cyclictest0-21swapper/122:09:581
1388436992726,1cyclictest0-21swapper/123:07:581
1388440992626,0cyclictest0-21swapper/220:13:372
1388440992525,0cyclictest0-21swapper/222:13:582
1388436992525,0cyclictest0-21swapper/122:27:591
1388436992524,1cyclictest1000-21snmpd00:01:201
1388431992525,0cyclictest0-21swapper/023:39:580
1388431992525,0cyclictest0-21swapper/022:17:580
1388440992424,0cyclictest0-21swapper/200:38:582
138843699240,1cyclictest0-21swapper/119:25:301
138843699240,0cyclictest0-21swapper/123:22:561
1388431992424,0cyclictest0-21swapper/020:28:580
1388431992424,0cyclictest0-21swapper/019:28:580
1388440992323,0cyclictest0-21swapper/220:05:162
1388431992323,0cyclictest0-21swapper/020:43:580
1388431992323,0cyclictest0-21swapper/019:41:580
1388436992222,0cyclictest0-21swapper/120:28:581
1388431992222,0cyclictest0-21swapper/021:00:580
1388440992120,1cyclictest3508964-21gnome-shell00:10:592
1388436992121,0cyclictest0-21swapper/121:03:581
1388440992020,0cyclictest1581752-21sensors23:20:292
1388440992020,0cyclictest0-21swapper/219:45:562
1388440992018,1cyclictest3508964-21gnome-shell22:30:592
138843699200,20cyclictest0-21swapper/119:31:021
1388431992020,0cyclictest0-21swapper/019:58:580
1388431992018,1cyclictest3508964-21gnome-shell21:17:580
1388440991919,0cyclictest0-21swapper/221:27:582
1388440991919,0cyclictest0-21swapper/200:08:582
1388436991918,1cyclictest1000-21snmpd23:41:351
1388436991918,1cyclictest0-21swapper/119:55:361
1388431991919,0cyclictest0-21swapper/020:30:580
138844099187,8cyclictest0-21swapper/221:02:472
1388436991818,0cyclictest0-21swapper/120:59:581
1388436991818,0cyclictest0-21swapper/119:38:591
1388431991817,1cyclictest1374481-21kworker/0:220:19:400
1388440991717,0cyclictest0-21swapper/219:53:582
138843699170,16cyclictest1551330-21ssh22:51:101
138843699170,16cyclictest0-21swapper/122:00:571
1388440991616,0cyclictest0-21swapper/219:18:592
1388436991616,0cyclictest0-21swapper/121:17:581
1388431991616,0cyclictest0-21swapper/020:50:590
138844099154,5cyclictest0-21swapper/221:22:462
138844099153,8cyclictest213848-21CPU2
1388436991515,0cyclictest1000-21snmpd19:22:511
1388436991515,0cyclictest0-21swapper/120:15:591
1388431991515,0cyclictest1000-21snmpd21:21:130
1388431991513,1cyclictest1000-21snmpd22:20:190
138844099142,11cyclictest0-21swapper/220:42:462
138844099140,0cyclictest0-21swapper/220:04:032
138843699145,6cyclictest213848-21CPU1
138843699143,8cyclictest213849-21CPU1
350901899130,2rtkit-daemon3509017-21rtkit-daemon20:49:091
138844099134,6cyclictest213848-21CPU2
138844099133,10cyclictest0-21swapper/222:02:462
138844099132,1cyclictest0-21swapper/223:57:472
1388440991313,0cyclictest0-21swapper/200:30:442
138843699136,4cyclictest213848-21CPU1
138843699135,5cyclictest213848-21CPU1
1388436991313,0cyclictest0-21swapper/120:50:581
138844099121,8cyclictest213848-21CPU2
1388440991210,1cyclictest1226-21ntpd19:41:092
138843699121,8cyclictest213848-21CPU1
138843699121,8cyclictest213848-21CPU1
1388431991212,0cyclictest0-21swapper/020:03:580
1388431991210,1cyclictest1000-21snmpd21:50:250
138844099112,9cyclictest0-21swapper/219:11:572
138843199113,5cyclictest213848-21CPU0
138843199112,6cyclictest213849-21CPU0
138843199112,6cyclictest213848-21CPU0
138844099103,5cyclictest213848-21CPU2
138844099102,5cyclictest213848-21CPU2
138843199108,1cyclictest1000-21snmpd19:31:520
138843199102,6cyclictest213848-21CPU0
13884409990,9cyclictest0-21swapper/219:31:112
13884409982,2cyclictest213848-21CPU2
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional