You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2022-01-17 - 02:00

Intel(R) Core(TM) i3-4360 CPU @ 3.70GHz, Linux 5.14.2-rt21 (Profile)

Latency plot of system in rack #0, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack0slot4.osadl.org (updated Mon Jan 17, 2022 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1402774211883,27sleep10-21swapper/119:08:041
1402755211482,25sleep20-21swapper/219:07:492
1402569210869,29sleep30-21swapper/319:05:293
1402814210581,18sleep00-21swapper/019:08:360
15356962850,0sleep00-21swapper/022:46:100
140320099650,64cyclictest0-21swapper/120:39:311
140319999640,63cyclictest0-21swapper/023:40:210
1403202996362,1cyclictest1097-21snmpd20:39:323
1403201996261,1cyclictest1438998-21kworker/2:021:30:592
140320099620,61cyclictest0-21swapper/100:05:221
1403201996160,1cyclictest1614396-21sensors00:20:202
140320199610,60cyclictest0-21swapper/221:35:222
1403200996160,1cyclictest3671486-21gnome-shell19:35:581
1403202996059,1cyclictest1601852-21sensors00:05:223
1403202996058,1cyclictest1097-21snmpd20:44:313
1403201996059,1cyclictest1436538-21sensors20:25:212
1403200996059,1cyclictest1097-21snmpd23:51:191
140320099600,60cyclictest0-21swapper/120:44:311
1403202995958,1cyclictest1589272-21sensors23:50:203
1403201995958,1cyclictest0-21swapper/222:31:592
1403201995957,1cyclictest3671486-21gnome-shell22:44:592
1403201995857,1cyclictest1497403-21sensors22:00:242
1403201995857,1cyclictest1428128-21sensors20:05:242
1403201995857,1cyclictest0-21swapper/221:52:582
1403201995856,1cyclictest3671486-21gnome-shell23:56:592
140320099580,57cyclictest0-21swapper/120:45:201
1403199995855,3cyclictest0-21swapper/020:35:250
1403202995756,1cyclictest1444942-21sensors20:45:203
1403201995756,1cyclictest0-21swapper/223:48:592
1403201995756,1cyclictest0-21swapper/223:37:592
1403201995756,1cyclictest0-21swapper/221:14:582
1403201995754,2cyclictest3671486-21gnome-shell23:12:582
1403200995756,1cyclictest1097-21snmpd23:09:591
1403200995756,1cyclictest0-21swapper/119:25:191
1403200995754,2cyclictest3671486-21gnome-shell23:27:581
140320099570,56cyclictest0-21swapper/119:20:211
1403199995756,1cyclictest1505751-21sensors22:10:220
1403199995756,1cyclictest1097-21snmpd23:46:190
1403202995655,1cyclictest1447053-21sensors20:50:273
1403200995655,1cyclictest0-21swapper/120:00:231
15530512550,0sleep20-21swapper/223:07:262
1403202995554,1cyclictest1409212-21sensors19:20:213
1403202995554,1cyclictest0-21swapper/323:09:593
1403202995553,1cyclictest1411307-21sensors19:25:203
1403201995554,1cyclictest0-21swapper/222:21:592
1403201995553,1cyclictest3671486-21gnome-shell20:19:582
1403201995552,2cyclictest3671486-21gnome-shell22:08:592
1403200995554,1cyclictest1497412-21sensors22:00:241
1403200995554,1cyclictest0-21swapper/121:44:431
1403200995553,1cyclictest3671486-21gnome-shell19:55:591
1403199995554,1cyclictest0-21swapper/022:55:260
1403199995554,1cyclictest0-21swapper/021:30:250
1403201995453,1cyclictest0-21swapper/220:46:582
1403201995453,1cyclictest0-21swapper/219:48:592
1403201995453,1cyclictest0-21swapper/219:32:592
1403201995452,1cyclictest3671486-21gnome-shell22:28:592
1403201995452,1cyclictest3671486-21gnome-shell21:02:592
1403201995452,1cyclictest3671486-21gnome-shell21:02:582
1403200995453,1cyclictest0-21swapper/100:30:261
1403200995453,1cyclictest0-21swapper/100:16:221
14652462530,0sleep10-21swapper/121:22:171
14206702530,1sleep013-21ksoftirqd/019:50:150
1403202995352,1cyclictest1539146-21sensors22:50:213
1403202995352,1cyclictest1426020-21sensors20:00:233
1403202995352,1cyclictest0-21swapper/323:27:583
1403202995352,1cyclictest0-21swapper/322:00:243
1403201995353,0cyclictest0-21swapper/223:17:592
1403201995352,1cyclictest0-21swapper/219:41:592
1403201995350,2cyclictest3671486-21gnome-shell00:25:592
1403199995352,1cyclictest1614387-21sensors00:20:200
1403199995352,1cyclictest0-21swapper/021:40:220
1403199995352,1cyclictest0-21swapper/019:35:200
15646722520,0sleep30-21swapper/323:20:373
1403202995251,1cyclictest1626910-21sensors00:35:213
1403202995251,1cyclictest1622789-21sensors00:30:253
1403202995251,1cyclictest1097-21snmpd21:44:443
1403202995251,1cyclictest0-21swapper/319:55:593
1403201995251,1cyclictest1454071-21diskmemload23:03:592
1403201995251,1cyclictest1454071-21diskmemload23:03:592
1403201995251,1cyclictest0-21swapper/222:35:592
1403201995250,1cyclictest3671486-21gnome-shell21:16:582
1403200995251,1cyclictest3671486-21gnome-shell22:37:591
14847022510,0sleep10-21swapper/121:45:201
1403202995150,1cyclictest1097-21snmpd00:16:213
1403201995151,0cyclictest0-21swapper/200:10:592
1403201995150,1cyclictest1539148-21sensors22:50:202
1403201995150,1cyclictest1536605-21ssh22:47:592
1403200995150,1cyclictest0-21swapper/119:45:591
1403199995150,1cyclictest0-21swapper/020:24:280
1403199995149,1cyclictest1514101-21sensors22:20:220
1403202995049,1cyclictest0-21swapper/322:37:583
1403202995048,1cyclictest3671486-21gnome-shell19:45:583
1403201995049,1cyclictest0-21swapper/221:24:592
1403201995047,2cyclictest3671486-21gnome-shell20:33:582
1403200995049,1cyclictest0-21swapper/123:57:591
1403199995049,1cyclictest1417608-21sensors19:40:200
1403202994946,2cyclictest3671486-21gnome-shell23:57:593
1403201994948,1cyclictest1493854-21ssh21:56:002
1403201994948,1cyclictest0-21swapper/223:21:592
1403201994948,1cyclictest0-21swapper/219:20:002
1403201994947,1cyclictest3671486-21gnome-shell00:00:592
1403200994948,1cyclictest0-21swapper/120:59:341
1403199994948,1cyclictest0-21swapper/023:25:020
1403199994947,1cyclictest1468156-21sensors21:25:230
1403201994847,1cyclictest3671486-21gnome-shell20:10:592
1403201994847,1cyclictest0-21swapper/221:05:592
1403201994847,1cyclictest0-21swapper/220:21:592
1403201994847,1cyclictest0-21swapper/219:10:592
1403201994847,1cyclictest0-21swapper/200:39:592
1403201994846,1cyclictest3671486-21gnome-shell21:41:582
1403201994747,0cyclictest0-21swapper/223:29:582
1403201994747,0cyclictest0-21swapper/220:38:002
1403201994746,1cyclictest1438998-21kworker/2:021:29:592
1403201994746,1cyclictest0-21swapper/220:55:592
1403201994746,1cyclictest0-21swapper/220:54:002
1403201994746,1cyclictest0-21swapper/219:28:592
1403201994746,0cyclictest1545465-21ssh22:58:592
1403201994745,1cyclictest3671486-21gnome-shell22:15:592
1403202994645,1cyclictest1097-21snmpd20:59:343
1403201994646,0cyclictest0-21swapper/220:00:002
1403201994645,1cyclictest1573675-21kworker/2:223:50:582
1403201994645,1cyclictest1573675-21kworker/2:223:44:592
1403201994645,1cyclictest0-21swapper/222:10:592
1403201994645,1cyclictest0-21swapper/200:18:592
1403201994645,1cyclictest0-21swapper/200:05:582
1403200994645,1cyclictest1576751-21sensors23:35:231
1403200994645,1cyclictest0-21swapper/121:15:591
14365672450,1sleep334-21ksoftirqd/320:25:213
1403202994541,4cyclictest0-21swapper/323:03:003
1403202994541,4cyclictest0-21swapper/323:02:593
1403201994544,1cyclictest3671486-21gnome-shell20:01:582
1403201994544,1cyclictest1483081-21kworker/2:021:45:592
1403201994544,1cyclictest1407681-21kworker/2:019:24:592
1403201994544,1cyclictest0-21swapper/219:53:592
1403201994544,1cyclictest0-21swapper/219:37:592
1403201994542,2cyclictest3671486-21gnome-shell20:41:582
1403199994544,1cyclictest0-21swapper/000:11:220
1403199994542,3cyclictest0-21swapper/020:55:200
1403201994443,1cyclictest1616594-21kworker/2:200:30:582
1403200994443,1cyclictest1540793-21kworker/1:023:03:001
1403200994443,1cyclictest1540793-21kworker/1:023:03:001
1403200994443,1cyclictest1530814-21sensors22:40:241
1403200994443,1cyclictest0-21swapper/122:05:231
1403199994440,3cyclictest1564214-21sensors23:20:220
15515282430,0sleep00-21swapper/023:05:200
1403202994342,1cyclictest3671486-21gnome-shell21:15:583
1403202994342,1cyclictest0-21swapper/323:35:223
1403200994342,1cyclictest3671486-21gnome-shell21:57:581
1403200994342,1cyclictest1540793-21kworker/1:023:31:401
1403200994342,1cyclictest1536130-21kworker/1:222:55:391
1403200994342,1cyclictest1432325-21sensors20:15:201
1403200994342,1cyclictest0-21swapper/123:15:211
1403200994341,1cyclictest1578906-21kworker/1:000:01:121
1403202994241,1cyclictest0-21swapper/322:40:243
1403200994241,1cyclictest1489026-21sensors21:50:221
15545852410,0sleep30-21swapper/323:10:033
1403202994140,1cyclictest1501583-21sensors22:05:233
1403202994140,1cyclictest1463942-21sensors21:20:203
1403200994140,1cyclictest1498931-21kworker/1:122:20:191
16179442400,1sleep11617766-21ssh00:25:141
1403202994040,0cyclictest1543791-21ssh22:55:393
1403202994039,1cyclictest1560037-21sensors23:15:213
1403202994039,1cyclictest0-21swapper/323:31:403
1403202994039,1cyclictest0-21swapper/321:57:583
1403202994039,1cyclictest0-21swapper/321:50:223
1403202994039,1cyclictest0-21swapper/320:15:203
1403202994039,1cyclictest0-21swapper/300:01:123
1403201994039,1cyclictest1558443-21kworker/2:123:30:592
1403200994039,1cyclictest1569683-21kworker/1:123:41:121
1403200994039,1cyclictest1498931-21kworker/1:122:32:061
1403200994039,1cyclictest1498931-21kworker/1:122:11:371
1403200994039,1cyclictest0-21swapper/121:32:581
1403202993938,1cyclictest0-21swapper/321:49:163
1403200993937,1cyclictest3671486-21gnome-shell00:35:581
1403199993938,1cyclictest0-21swapper/000:06:210
1403199993937,1cyclictest3671486-21gnome-shell22:18:590
1403202993837,1cyclictest0-21swapper/323:41:133
1403202993837,1cyclictest0-21swapper/322:32:063
1403202993837,1cyclictest0-21swapper/322:20:193
1403200993837,1cyclictest1536130-21kworker/1:222:50:521
1403200993837,1cyclictest1457460-21kworker/1:121:25:121
1403202993737,0cyclictest0-21swapper/321:32:583
1403202993736,1cyclictest0-21swapper/322:11:373
1403200993736,1cyclictest1540793-21kworker/1:023:11:421
1403200993736,1cyclictest1536130-21kworker/1:222:49:311
1403200993736,1cyclictest1445619-21kworker/1:120:51:351
1403200993735,1cyclictest1578906-21kworker/1:000:10:141
1403199993736,1cyclictest1097-21snmpd19:34:190
1403202993635,1cyclictest0-21swapper/321:25:123
1403200993635,1cyclictest1612148-21kworker/1:200:23:531
1403200993635,1cyclictest1498931-21kworker/1:122:25:061
1403200993635,1cyclictest1457460-21kworker/1:121:39:011
1403200993635,1cyclictest1390374-21kworker/1:019:13:161
1403202993534,1cyclictest0-21swapper/322:49:313
1403202993433,1cyclictest34-21ksoftirqd/300:10:143
1403202993433,1cyclictest0-21swapper/322:29:513
1403202993433,1cyclictest0-21swapper/321:39:013
1403202993433,1cyclictest0-21swapper/319:13:173
1403202993433,1cyclictest0-21swapper/300:23:543
1403200993332,1cyclictest1583244-21kworker/1:223:47:221
1403200993332,1cyclictest1540793-21kworker/1:023:22:071
1403200993332,1cyclictest1498931-21kworker/1:122:18:271
1403200993332,1cyclictest1453876-21kworker/1:021:11:431
14983472320,2sleep013-21ksoftirqd/022:01:370
1403202993231,1cyclictest0-21swapper/300:27:083
1403200993231,1cyclictest0-21swapper/121:00:251
1403200993231,1cyclictest0-21swapper/121:00:241
1403202993130,1cyclictest0-21swapper/323:47:223
1403202993130,1cyclictest0-21swapper/321:11:433
1403200993130,1cyclictest0-21swapper/120:30:231
1403202993029,1cyclictest0-21swapper/322:18:273
1403202992928,1cyclictest1451247-21sensors21:00:243
1403202992928,1cyclictest1451247-21sensors21:00:243
1403200992928,1cyclictest1407851-21kworker/1:119:44:501
1403202992827,1cyclictest1438645-21sensors20:30:233
1403202992726,1cyclictest0-21swapper/319:44:513
140319999272,25cyclictest0-21swapper/020:48:070
140319999270,3cyclictest0-21swapper/023:30:210
140319999270,26cyclictest0-21swapper/020:12:340
1403199992522,3cyclictest0-21swapper/021:00:580
1403199992522,3cyclictest0-21swapper/021:00:580
1403200992422,1cyclictest3671486-21gnome-shell19:51:581
140319999246,17cyclictest0-21swapper/021:18:170
1403199992421,3cyclictest0-21swapper/022:35:200
1403200992322,1cyclictest1430566-21kworker/1:120:14:331
1403200992322,1cyclictest1390374-21kworker/1:019:19:461
140319999239,11cyclictest0-21swapper/020:08:070
140319999230,15cyclictest0-21swapper/023:01:140
140319999230,15cyclictest0-21swapper/023:01:130
1403200992221,1cyclictest1432834-21kworker/1:020:20:101
1403199992219,3cyclictest0-21swapper/022:51:590
1403199992219,3cyclictest0-21swapper/022:25:200
1403199992210,11cyclictest0-21swapper/019:48:080
1403199992118,3cyclictest0-21swapper/000:39:580
1403202992019,1cyclictest1315207-21kworker/u8:120:14:323
1403202992019,1cyclictest0-21swapper/320:20:113
1403202992019,1cyclictest0-21swapper/319:51:583
1403202992019,1cyclictest0-21swapper/319:19:463
140319999206,11cyclictest0-21swapper/021:23:070
1403199992019,1cyclictest0-21swapper/021:58:070
1403199991913,5cyclictest1555417-21cat23:10:180
140319999190,3cyclictest0-21swapper/022:43:590
140319999190,18cyclictest0-21swapper/019:22:140
140319999186,11cyclictest0-21swapper/021:38:070
140319999186,11cyclictest0-21swapper/021:13:070
140319999186,11cyclictest0-21swapper/021:08:070
140319999186,11cyclictest0-21swapper/020:03:070
1403199991815,2cyclictest1097-21snmpd20:18:210
140319999180,18cyclictest0-21swapper/020:25:040
140319999180,17cyclictest0-21swapper/020:50:210
1403202991715,2cyclictest1097-21snmpd20:06:003
1403200991716,1cyclictest1453876-21kworker/1:021:10:001
140319999175,11cyclictest0-21swapper/020:43:080
1403199991715,1cyclictest1097-21snmpd19:15:380
1403199991714,2cyclictest1097-21snmpd22:33:370
1403199991714,2cyclictest1097-21snmpd22:08:300
140319999170,16cyclictest0-21swapper/021:50:240
140319999170,16cyclictest0-21swapper/019:29:380
140319999170,16cyclictest0-21swapper/000:34:210
140319999170,16cyclictest0-21swapper/000:26:320
1403202991614,2cyclictest1097-21snmpd19:33:483
140320099160,15cyclictest0-21swapper/120:05:591
140320099160,15cyclictest0-21swapper/119:33:481
140319999160,16cyclictest0-21swapper/019:12:130
140319999160,15cyclictest0-21swapper/019:58:090
1403199991514,1cyclictest0-21swapper/021:45:220
15916202140,0sleep00-21swapper/023:54:260
1403202991313,0cyclictest1454234-21ssh21:10:003
1403202991312,1cyclictest0-21swapper/319:36:183
1403200991312,1cyclictest1432834-21kworker/1:020:26:101
1403199991312,1cyclictest1560042-21sensors23:15:210
15956472120,1sleep013-21ksoftirqd/023:59:050
140319999128,4cyclictest0-21swapper/000:01:430
140319999123,8cyclictest0-21swapper/023:37:010
140319999110,10cyclictest0-21swapper/020:33:070
234199100,1rtkit-daemon2340-21rtkit-daemon00:19:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional