You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2022-01-23 - 18:57

Intel(R) Core(TM) i3-4360 CPU @ 3.70GHz, Linux 5.14.2-rt21 (Profile)

Latency plot of system in rack #0, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot4.osadl.org (updated Sun Jan 23, 2022 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1235078211365,41sleep00-21swapper/019:09:360
1234911211267,23sleep20-21swapper/219:07:292
1234902211284,19sleep30-21swapper/319:07:223
1234763210780,20sleep10-21swapper/119:05:351
13778132900,2sleep334-21ksoftirqd/322:55:303
14116002880,1sleep334-21ksoftirqd/323:35:223
13279892860,1sleep30-21swapper/321:58:033
13096242800,0sleep00-21swapper/021:35:340
12416162640,1sleep30-21swapper/319:20:273
1235386996462,1cyclictest13177-21gnome-shell20:35:590
1235387996361,1cyclictest13177-21gnome-shell21:25:591
1235386996362,1cyclictest13177-21gnome-shell00:31:580
1235386996361,1cyclictest13177-21gnome-shell19:36:590
1235388996260,2cyclictest0-21swapper/222:10:262
1235387996261,1cyclictest1341391-21kworker/1:122:25:561
1235387996261,1cyclictest1097-21snmpd21:05:191
1235387996260,1cyclictest13177-21gnome-shell23:04:591
1235386996260,2cyclictest13177-21gnome-shell23:10:580
123538999610,60cyclictest0-21swapper/319:17:593
1235386996159,2cyclictest13177-21gnome-shell19:13:590
1235389996059,1cyclictest1313492-21sensors21:40:253
1235387996059,1cyclictest1248461-21kworker/1:119:43:181
1235387996059,1cyclictest0-21swapper/121:40:001
1235387996059,1cyclictest0-21swapper/120:25:581
1235386996059,1cyclictest1405317-21kworker/0:023:49:590
123538699600,60cyclictest0-21swapper/000:23:590
13568702590,0sleep20-21swapper/222:30:592
1235389995957,2cyclictest1386166-21sensors23:05:253
1235387995958,1cyclictest0-21swapper/119:51:591
1235387995957,2cyclictest13177-21gnome-shell00:26:581
1235387995956,2cyclictest13177-21gnome-shell20:30:591
1235386995958,1cyclictest1380356-21kworker/0:123:19:000
1235386995958,1cyclictest13177-21gnome-shell20:02:590
1235386995957,1cyclictest13177-21gnome-shell21:02:580
1235389995856,1cyclictest1258219-21sensors20:00:273
1235389995853,4cyclictest13177-21gnome-shell00:25:583
123538999580,1cyclictest0-21swapper/323:15:273
1235387995857,1cyclictest0-21swapper/119:39:591
1235387995857,1cyclictest0-21swapper/119:30:271
1235387995856,1cyclictest13177-21gnome-shell19:27:591
1235386995858,0cyclictest0-21swapper/023:04:000
1235386995857,1cyclictest1400345-21kworker/0:223:28:590
1235386995857,1cyclictest1339493-21kworker/0:222:11:590
1235386995857,1cyclictest0-21swapper/020:40:260
1235386995856,1cyclictest13177-21gnome-shell20:27:580
1235386995856,1cyclictest13177-21gnome-shell19:16:580
123538699580,0cyclictest0-21swapper/022:32:000
1235388995753,3cyclictest0-21swapper/221:35:272
1235387995756,1cyclictest1448628-21kworker/1:000:21:001
1235387995756,1cyclictest1412579-21kworker/1:023:43:371
1235387995756,1cyclictest13177-21gnome-shell00:33:581
1235387995756,1cyclictest0-21swapper/100:37:591
1235387995755,1cyclictest13177-21gnome-shell22:10:581
1235387995755,1cyclictest13177-21gnome-shell21:34:581
1235386995756,1cyclictest13177-21gnome-shell19:21:590
1235386995756,1cyclictest0-21swapper/021:12:590
1235386995755,1cyclictest13177-21gnome-shell20:24:590
1235386995755,1cyclictest13177-21gnome-shell19:48:590
1235389995655,1cyclictest0-21swapper/322:15:283
1235388995651,4cyclictest13177-21gnome-shell21:26:582
1235386995656,0cyclictest0-21swapper/023:37:590
1235386995655,1cyclictest1427417-21kworker/0:200:16:590
1235386995655,1cyclictest1405317-21kworker/0:023:51:590
1235386995655,1cyclictest1318335-21kworker/0:022:09:000
1235386995655,1cyclictest1276732-21kworker/0:020:47:590
1235386995655,1cyclictest1276732-21kworker/0:020:47:590
1235386995655,1cyclictest0-21swapper/022:24:000
123538699560,55cyclictest0-21swapper/021:25:270
1235389995552,3cyclictest0-21swapper/320:05:273
1235388995554,1cyclictest0-21swapper/222:00:262
1235387995554,1cyclictest1396457-21kworker/1:223:34:541
1235387995554,1cyclictest1341391-21kworker/1:122:31:051
1235387995554,1cyclictest1326321-21sensors21:55:271
1235386995555,0cyclictest0-21swapper/023:40:590
1235386995555,0cyclictest0-21swapper/000:27:590
1235386995553,1cyclictest13177-21gnome-shell19:44:590
1235386995553,1cyclictest0-21swapper/022:59:590
13619232540,0sleep00-21swapper/022:37:280
1235389995453,1cyclictest0-21swapper/320:40:263
1235388995452,1cyclictest1245615-21sensors19:30:272
1235388995449,4cyclictest1283450-21taskset21:00:272
1235387995453,1cyclictest1427339-21kworker/1:100:00:401
1235387995453,1cyclictest1341391-21kworker/1:122:35:201
1235387995453,1cyclictest1097-21snmpd00:10:511
1235387995452,1cyclictest13177-21gnome-shell22:52:581
1235387995452,1cyclictest13177-21gnome-shell19:45:591
1235386995454,0cyclictest1279975-21kworker/0:221:20:590
1235386995454,0cyclictest0-21swapper/021:44:590
1235386995454,0cyclictest0-21swapper/000:35:590
1235386995453,1cyclictest1405317-21kworker/0:023:30:590
1235386995453,1cyclictest0-21swapper/022:03:590
1235386995453,1cyclictest0-21swapper/020:32:590
1235386995453,1cyclictest0-21swapper/020:14:580
1235386995453,1cyclictest0-21swapper/020:08:590
1235386995453,1cyclictest0-21swapper/019:55:270
1235386995452,1cyclictest0-21swapper/021:30:580
1235389995352,1cyclictest0-21swapper/321:45:283
1235387995352,1cyclictest1433817-21kworker/1:200:05:571
1235387995352,1cyclictest1396457-21kworker/1:223:18:201
1235387995352,1cyclictest1261351-21kworker/1:020:20:201
1235387995351,1cyclictest13177-21gnome-shell21:17:581
1235387995350,2cyclictest13177-21gnome-shell20:46:591
1235387995350,2cyclictest13177-21gnome-shell20:46:581
1235386995353,0cyclictest0-21swapper/020:15:590
1235386995352,1cyclictest1252870-21kworker/0:219:53:590
1235386995352,1cyclictest1237188-21kworker/0:119:28:590
1235386995352,1cyclictest0-21swapper/021:05:590
1235389995250,1cyclictest1300660-21sensors21:25:263
1235388995248,4cyclictest0-21swapper/219:50:282
1235387995251,1cyclictest1412579-21kworker/1:023:45:181
1235387995251,1cyclictest1334870-21sensors22:05:261
1235387995251,1cyclictest1264529-21sensors20:15:241
1235387995250,1cyclictest13177-21gnome-shell21:43:581
1235386995252,0cyclictest0-21swapper/020:56:590
1235386995251,1cyclictest1427417-21kworker/0:200:14:590
1235386995251,1cyclictest1318335-21kworker/0:021:55:000
1235388995147,3cyclictest13177-21gnome-shell23:49:582
1235387995150,1cyclictest1320219-21kworker/1:021:52:411
1235387995150,1cyclictest1296382-21sensors21:20:261
1235387995150,1cyclictest1284188-21kworker/1:221:14:161
1235387995149,2cyclictest13177-21gnome-shell21:45:581
1235386995150,1cyclictest1427417-21kworker/0:223:56:000
1235386995150,1cyclictest1237188-21kworker/0:119:31:580
1235386995150,1cyclictest0-21swapper/023:05:590
14646662500,0sleep30-21swapper/300:37:533
1235389995049,1cyclictest0-21swapper/322:50:273
1235388995049,1cyclictest0-21swapper/220:50:242
1235387995049,1cyclictest1427339-21kworker/1:123:57:361
1235387995049,1cyclictest1412579-21kworker/1:023:52:081
1235387995049,1cyclictest1403269-21sensors23:25:261
1235387995049,1cyclictest1396457-21kworker/1:223:39:201
1235387995049,1cyclictest1364814-21sensors22:40:271
1235387995049,1cyclictest1336498-21kworker/1:222:17:561
1235387995049,1cyclictest1320219-21kworker/1:022:04:271
1235389994946,3cyclictest0-21swapper/319:35:263
1235387994948,1cyclictest1367275-21kworker/1:022:56:401
1235387994948,1cyclictest1341391-21kworker/1:122:45:251
1235387994947,1cyclictest13177-21gnome-shell21:03:581
1235386994948,1cyclictest0-21swapper/020:50:580
14500832480,0sleep30-21swapper/300:20:233
1235389994847,1cyclictest0-21swapper/319:55:273
1235389994846,2cyclictest1437484-21sensors00:05:283
1235388994847,1cyclictest1247722-21sensors19:35:262
1235387994847,1cyclictest1443395-21kworker/1:200:15:101
1235387994847,1cyclictest1396457-21kworker/1:223:22:161
1235387994847,1cyclictest1341391-21kworker/1:122:22:321
1235387994846,1cyclictest13177-21gnome-shell20:44:591
1235386994847,1cyclictest0-21swapper/022:16:590
1235389994746,1cyclictest0-21swapper/320:23:553
1235388994746,1cyclictest0-21swapper/223:15:272
1235388994743,3cyclictest13177-21gnome-shell22:37:582
1235387994746,1cyclictest1367275-21kworker/1:023:10:291
1235387994746,1cyclictest1367275-21kworker/1:023:05:121
1235387994746,1cyclictest1279645-21kworker/1:220:55:301
1235387994746,1cyclictest1248461-21kworker/1:120:06:001
1235387994746,1cyclictest1248461-21kworker/1:120:01:441
1235387994745,1cyclictest13177-21gnome-shell19:55:581
1235388994644,2cyclictest1351979-21sensors22:25:262
1235389994542,3cyclictest0-21swapper/323:49:583
1235387994544,1cyclictest1275772-21kworker/1:020:50:231
1235387994544,1cyclictest1248461-21kworker/1:120:11:061
1235387994544,1cyclictest1196717-21kworker/1:219:20:261
1235387994544,1cyclictest1196717-21kworker/1:219:15:291
1235388994440,3cyclictest0-21swapper/222:20:322
1235387994443,1cyclictest1267189-21kworker/1:120:35:321
1235387994443,1cyclictest1196717-21kworker/1:219:10:121
1235389994342,1cyclictest1339152-21sensors22:10:263
1235389994342,1cyclictest0-21swapper/320:11:423
1235388994341,1cyclictest1322061-21sensors21:50:282
1235388994140,1cyclictest0-21swapper/200:20:252
1235388994035,4cyclictest13177-21gnome-shell22:15:592
1235388993938,1cyclictest1285552-21sensors21:05:272
1235388993837,1cyclictest0-21swapper/223:50:292
1235388993833,4cyclictest13177-21gnome-shell23:20:582
1235389993736,1cyclictest0-21swapper/320:15:243
1235388993733,4cyclictest13177-21gnome-shell23:30:582
1235386993736,1cyclictest1369100-21sensors22:45:280
1235388993635,1cyclictest0-21swapper/223:40:292
1235389993534,1cyclictest0-21swapper/323:20:263
1235389993534,1cyclictest0-21swapper/322:05:253
123538999350,34cyclictest0-21swapper/319:34:033
1235389993433,1cyclictest0-21swapper/323:10:283
1235389993431,3cyclictest0-21swapper/322:40:273
1235389993332,1cyclictest0-21swapper/322:20:263
1235388993229,3cyclictest0-21swapper/200:03:582
1235388993130,1cyclictest0-21swapper/221:15:262
1235388993130,1cyclictest0-21swapper/220:40:272
1235389993029,1cyclictest0-21swapper/321:20:223
1235389993029,1cyclictest0-21swapper/320:55:263
1235388993029,1cyclictest0-21swapper/221:45:282
123538999290,29cyclictest0-21swapper/319:53:103
123538999290,29cyclictest0-21swapper/319:28:103
1235389992827,1cyclictest0-21swapper/323:55:253
123538999280,4cyclictest0-21swapper/321:34:313
1235388992827,1cyclictest1266638-21sensors20:20:262
1235388992827,1cyclictest0-21swapper/222:05:252
1235389992724,3cyclictest0-21swapper/300:10:263
1235388992724,3cyclictest13177-21gnome-shell22:44:582
1235388992622,3cyclictest13177-21gnome-shell00:16:582
1235386992624,2cyclictest0-21swapper/022:25:260
1235388992423,1cyclictest0-21swapper/219:15:012
1235388992420,3cyclictest13177-21gnome-shell23:57:582
1235389992322,1cyclictest0-21swapper/323:40:283
1235389992320,3cyclictest0-21swapper/300:19:583
123538999231,11cyclictest0-21swapper/323:33:103
123538699230,15cyclictest0-21swapper/022:50:290
1235389992221,1cyclictest0-21swapper/319:10:273
1235388992221,1cyclictest1236556-21sensors19:10:262
1235389992120,1cyclictest0-21swapper/320:25:283
1235389992111,9cyclictest0-21swapper/322:38:413
1235388992120,1cyclictest0-21swapper/223:25:442
123538899210,13cyclictest0-21swapper/222:45:422
123538999209,11cyclictest0-21swapper/321:53:093
1235389992019,1cyclictest0-21swapper/319:45:063
1235388992011,9cyclictest0-21swapper/200:12:442
1235389991918,1cyclictest0-21swapper/300:00:283
1235389991916,3cyclictest0-21swapper/323:51:583
1235389991916,3cyclictest0-21swapper/323:25:593
1235389991914,4cyclictest1097-21snmpd21:13:593
123538999186,11cyclictest0-21swapper/321:03:103
1235388991817,1cyclictest0-21swapper/220:45:272
1235388991817,1cyclictest0-21swapper/220:45:262
123538899180,15cyclictest0-21swapper/220:06:402
1235389991716,1cyclictest0-21swapper/320:50:243
1235389991712,4cyclictest1097-21snmpd20:37:343
123538899170,16cyclictest0-21swapper/222:53:532
1235386991714,2cyclictest1097-21snmpd00:01:590
123538999164,11cyclictest0-21swapper/322:33:103
123538999160,7cyclictest0-21swapper/319:40:053
1235388991614,2cyclictest0-21swapper/200:09:592
123538899160,15cyclictest0-21swapper/220:15:212
1235386991613,2cyclictest0-21swapper/023:20:580
1235389991514,1cyclictest0-21swapper/321:35:273
1235388991513,1cyclictest1097-21snmpd23:35:222
1235388991510,4cyclictest13177-21gnome-shell00:38:592
123538899150,14cyclictest0-21swapper/219:27:362
123538999143,11cyclictest0-21swapper/300:33:103
123538999142,11cyclictest0-21swapper/320:33:103
123538899149,4cyclictest13177-21gnome-shell22:56:582
123538899149,4cyclictest1097-21snmpd20:56:392
123538899149,4cyclictest1097-21snmpd20:32:502
1235388991410,3cyclictest1097-21snmpd21:42:332
123538899140,5cyclictest0-21swapper/220:03:172
123538699145,9cyclictest1366023-21ssh22:42:080
123538699144,9cyclictest1326144-21ssh21:55:240
123538999134,9cyclictest34-21ksoftirqd/322:02:203
123538999130,3cyclictest0-21swapper/320:48:103
123538999130,3cyclictest0-21swapper/320:48:093
123538999130,13cyclictest0-21swapper/321:16:173
123538899139,3cyclictest1268318-21cat20:25:212
123538899138,4cyclictest1097-21snmpd23:03:122
1235388991311,1cyclictest0-21swapper/221:34:062
1235388991310,2cyclictest1097-21snmpd00:26:542
123538899130,1cyclictest0-21swapper/223:10:252
123538899130,1cyclictest0-21swapper/200:30:192
1235386991312,1cyclictest0-21swapper/000:08:020
123538999127,4cyclictest1097-21snmpd22:46:443
123538999121,8cyclictest0-21swapper/323:03:093
123538899129,3cyclictest0-21swapper/219:20:042
123538899129,2cyclictest1097-21snmpd23:06:002
123538899129,2cyclictest1097-21snmpd21:22:332
123538899129,2cyclictest1097-21snmpd19:48:362
123538899127,4cyclictest1097-21snmpd19:57:032
1235388991210,1cyclictest1091-21nmbd21:14:142
123538999118,2cyclictest1097-21snmpd22:26:583
123538999110,1cyclictest0-21swapper/321:08:103
123538899118,3cyclictest13177-21gnome-shell21:55:582
123538899117,4cyclictest1249384-21cat19:40:192
123538899100,9cyclictest0-21swapper/220:35:192
123538699109,1cyclictest1292106-21sensors21:15:260
123538699107,2cyclictest1097-21snmpd21:45:000
12353889985,2cyclictest1097-21snmpd20:10:072
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional