You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-08-05 - 06:39

Intel(R) Core(TM) i3-4360 CPU @ 3.70GHz, Linux 5.10.1-rt20 (Profile)

Latency plot of system in rack #0, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack0slot4.osadl.org (updated Thu Aug 05, 2021 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3497537211071,18sleep10-21swapper/119:06:061
3497577210769,17sleep30-21swapper/319:06:203
3498057210660,20sleep20-21swapper/219:09:592
3497511210274,21sleep00-21swapper/019:05:480
36383442660,0sleep10-21swapper/122:28:011
3498211996563,1cyclictest3508964-21gnome-shell22:51:590
3498223996457,3cyclictest3524502-21systemd-userwor20:05:092
3498215996463,1cyclictest3508964-21gnome-shell19:58:581
3498215996463,1cyclictest3508964-21gnome-shell00:10:581
3498215996462,1cyclictest3508964-21gnome-shell21:23:591
3498211996462,1cyclictest3508964-21gnome-shell22:39:590
3498211996462,1cyclictest3508964-21gnome-shell21:09:590
349822399630,62cyclictest0-21swapper/222:22:582
349822399630,0cyclictest0-21swapper/223:05:512
3498211996361,1cyclictest3508964-21gnome-shell20:47:580
3498211996361,1cyclictest3508964-21gnome-shell19:30:580
3498215996260,1cyclictest3508964-21gnome-shell00:31:591
349821599620,62cyclictest0-21swapper/120:58:591
3498211996262,0cyclictest1000-21snmpd20:30:350
3498211996260,1cyclictest3508964-21gnome-shell23:14:580
3498211996260,1cyclictest3508964-21gnome-shell21:52:590
3498211996260,1cyclictest3508964-21gnome-shell20:42:580
349821199620,62cyclictest0-21swapper/021:40:180
37524552610,0sleep00-21swapper/000:16:250
349822799610,61cyclictest92650irq/30-p4p122:38:583
3498223996156,2cyclictest3584351-21systemd-userwor21:40:532
3498223996155,3cyclictest3512712-21systemd-userwor19:40:022
3498223996155,2cyclictest3768250-21systemd-userwor00:36:292
349822399610,61cyclictest0-21swapper/200:31:332
349822399610,60cyclictest0-21swapper/221:45:252
3498215996160,1cyclictest1000-21snmpd20:28:361
349821599610,61cyclictest0-21swapper/119:44:581
3498211996160,1cyclictest1000-21snmpd00:08:140
3498211996159,1cyclictest3508964-21gnome-shell22:10:580
3498211996159,1cyclictest3508964-21gnome-shell20:08:580
3498223996056,1cyclictest3716297-21systemd-userwor23:42:332
3498223996055,2cyclictest3726187-21systemd-userwor23:54:402
3498223996055,2cyclictest3642792-21systemd-userwor22:35:392
3498223996055,2cyclictest3574434-21systemd-userwor21:28:462
349822399600,59cyclictest0-21swapper/223:20:222
349822399600,59cyclictest0-21swapper/200:27:282
3498211996059,1cyclictest3508964-21gnome-shell19:36:580
3498211996058,1cyclictest3508964-21gnome-shell22:46:590
3498211996058,1cyclictest3508964-21gnome-shell21:13:590
3498211996058,1cyclictest3508964-21gnome-shell20:58:590
3498211996058,1cyclictest3508964-21gnome-shell20:16:580
3498211996058,1cyclictest3508964-21gnome-shell19:45:580
3498211996058,1cyclictest3508964-21gnome-shell00:20:590
3498227995958,1cyclictest1000-21snmpd23:51:083
3498227995957,1cyclictest3761893-21sensors00:25:213
3498223995958,1cyclictest3644016-21ssh22:33:372
3498223995958,1cyclictest3628398-21ssh22:18:462
3498223995958,1cyclictest0-21swapper/223:28:242
3498223995958,1cyclictest0-21swapper/222:14:402
3498223995954,2cyclictest3742572-21systemd-userwor00:07:392
3498223995954,2cyclictest3522020-21systemd-userwor20:00:312
349822399590,0cyclictest0-21swapper/223:56:022
3498215995958,1cyclictest3508964-21gnome-shell23:10:581
3498215995957,2cyclictest3730431-21sensors23:55:241
3498215995957,1cyclictest3508964-21gnome-shell20:43:581
3498215995957,1cyclictest3508964-21gnome-shell19:52:591
349821599590,0cyclictest0-21swapper/119:15:581
3498211995957,2cyclictest3535878-21sensors20:25:200
3498211995957,1cyclictest3508964-21gnome-shell19:44:580
3498211995957,1cyclictest3508964-21gnome-shell19:10:590
3498227995857,1cyclictest3735741-21sensors00:00:303
3498223995857,1cyclictest3712590-21ssh23:39:192
3498223995857,1cyclictest3566226-21ssh21:19:532
3498223995857,1cyclictest3528523-21strings20:10:152
3498223995857,1cyclictest0-21swapper/222:47:472
3498223995857,1cyclictest0-21swapper/200:20:472
3498223995857,0cyclictest3747100-21ssh00:11:142
3498223995857,0cyclictest3670748-21ssh22:59:232
3498223995857,0cyclictest0-21swapper/222:52:122
3498223995854,1cyclictest3553018-21systemd-userwor21:03:402
3498223995852,2cyclictest3550482-21systemd-userwor20:59:042
3498215995857,1cyclictest3508964-21gnome-shell21:10:591
3498215995857,1cyclictest3508964-21gnome-shell20:13:581
3498215995856,1cyclictest3508964-21gnome-shell23:40:581
3498211995856,1cyclictest3508964-21gnome-shell23:37:590
3498211995856,1cyclictest3508964-21gnome-shell23:08:590
3498211995856,1cyclictest3508964-21gnome-shell21:29:590
3498211995856,1cyclictest3508964-21gnome-shell20:21:580
3498211995856,1cyclictest3508964-21gnome-shell19:15:580
349821199580,57cyclictest0-21swapper/023:42:580
35684192570,0sleep00-21swapper/021:20:350
3498227995756,1cyclictest3573215-21sensors21:25:273
3498223995757,0cyclictest493-21jbd2/dm-0-819:20:252
3498223995757,0cyclictest0-21swapper/200:16:122
3498223995756,1cyclictest3686723-21ssh23:14:452
3498223995756,1cyclictest0-21swapper/223:00:452
3498223995756,1cyclictest0-21swapper/222:43:312
3498223995756,1cyclictest0-21swapper/222:02:442
3498223995756,1cyclictest0-21swapper/221:54:212
3498223995756,0cyclictest0-21swapper/221:30:182
3498223995756,0cyclictest0-21swapper/221:10:202
349822399570,57cyclictest0-21swapper/221:58:282
3498211995755,1cyclictest3508964-21gnome-shell22:15:590
3498227995655,1cyclictest3521664-21sensors19:55:263
3498223995656,0cyclictest493-21jbd2/dm-0-823:19:212
3498223995656,0cyclictest3638551-21ssh22:28:202
3498223995655,1cyclictest0-21swapper/223:46:192
3498223995655,1cyclictest0-21swapper/200:03:542
3498215995655,1cyclictest3740925-21sensors00:05:231
3498215995655,1cyclictest3508964-21gnome-shell21:43:591
3498215995655,1cyclictest3508964-21gnome-shell20:38:581
3498215995655,1cyclictest3508964-21gnome-shell20:06:581
3498215995654,2cyclictest3599371-21sensors21:50:211
349821199560,56cyclictest0-21swapper/022:05:210
3498223995555,0cyclictest0-21swapper/221:38:182
3498223995554,1cyclictest0-21swapper/221:20:552
3498223995554,0cyclictest0-21swapper/220:35:202
3498223995551,1cyclictest3508895-21systemd-userdbd20:21:522
3498223995550,2cyclictest3536427-21systemd-userwor20:30:132
349822399550,55cyclictest0-21swapper/223:33:112
3498215995555,0cyclictest3509824-21sensors19:30:221
3498215995554,1cyclictest3508964-21gnome-shell19:12:591
3498215995553,1cyclictest3508964-21gnome-shell21:01:591
3498211995555,0cyclictest0-21swapper/000:31:590
3498211995554,1cyclictest0-21swapper/000:25:580
3498211995552,1cyclictest3500085-21kworker/0:219:56:460
3498227995453,1cyclictest0-21swapper/320:45:213
3498227995452,1cyclictest3552432-21sensors21:00:183
3498223995453,1cyclictest3616861-21ssh22:07:192
3498223995453,1cyclictest3530990-21ntp_states20:15:222
3498223995453,1cyclictest0-21swapper/219:50:182
3498223995453,1cyclictest0-21swapper/219:45:102
3498223995453,1cyclictest0-21swapper/219:35:172
3498223995453,0cyclictest0-21swapper/220:26:282
3498223995450,1cyclictest3545853-21systemd-userwor20:46:572
3498215995453,1cyclictest3508964-21gnome-shell20:03:581
349821599540,54cyclictest0-21swapper/120:23:581
3498211995452,1cyclictest3508964-21gnome-shell20:10:580
3498227995352,1cyclictest3730427-21sensors23:55:243
3498223995353,0cyclictest0-21swapper/221:07:262
3498223995353,0cyclictest0-21swapper/219:59:502
3498223995353,0cyclictest0-21swapper/219:27:462
3498223995353,0cyclictest0-21swapper/219:27:452
3498223995352,1cyclictest0-21swapper/220:41:502
3498223995352,0cyclictest0-21swapper/219:34:552
3498223995348,2cyclictest3545744-21systemd-userwor20:50:422
3498211995351,1cyclictest3508964-21gnome-shell22:44:580
3498223995251,1cyclictest0-21swapper/219:10:012
3498223995250,1cyclictest3497469-21kworker/u8:219:17:412
3498215995250,2cyclictest3688463-21sensors23:15:191
3498211995252,0cyclictest0-21swapper/022:28:580
3498211995252,0cyclictest0-21swapper/019:52:580
3498211995252,0cyclictest0-21swapper/000:14:580
3498211995250,1cyclictest3578419-21sensors21:30:230
3498211995250,1cyclictest3508964-21gnome-shell20:35:580
3498211995250,1cyclictest1000-21snmpd23:19:070
3498215995150,1cyclictest3508964-21gnome-shell20:52:591
3498215995150,1cyclictest3508964-21gnome-shell20:45:581
3498215995049,1cyclictest1000-21snmpd22:38:591
3498211995050,0cyclictest0-21swapper/023:20:190
3498211995048,1cyclictest3508964-21gnome-shell21:00:590
3498227994949,0cyclictest0-21swapper/319:15:223
3498211994848,0cyclictest0-21swapper/020:03:580
3498227994747,0cyclictest1000-21snmpd20:37:303
3498227994746,1cyclictest3667635-21sensors22:55:283
3498215994646,0cyclictest0-21swapper/123:51:091
3498227994545,0cyclictest0-21swapper/321:30:233
3498215994545,0cyclictest0-21swapper/100:25:211
3498211994545,0cyclictest0-21swapper/020:52:590
3498227994444,0cyclictest0-21swapper/320:03:323
3498227994443,1cyclictest3756647-21sensors00:20:223
3498215994444,0cyclictest0-21swapper/121:25:271
3498215994444,0cyclictest0-21swapper/100:00:301
3498227994339,0cyclictest0-21swapper/322:45:233
3498211994241,1cyclictest0-21swapper/021:55:220
3498211994140,1cyclictest3672758-21sensors23:00:190
3498227994039,1cyclictest3636130-21sensors22:25:243
3498227993938,1cyclictest3504900-21sensors19:20:203
3498227993837,1cyclictest0-21swapper/321:05:373
3498227993636,0cyclictest0-21swapper/323:39:093
3498227993635,1cyclictest3528750-21sensors20:10:183
3498227993634,1cyclictest3683383-21sensors23:10:313
3498211993534,1cyclictest0-21swapper/019:25:200
3498211993534,1cyclictest0-21swapper/019:25:200
3498227993433,1cyclictest1000-21snmpd20:56:313
3498215993434,0cyclictest0-21swapper/122:55:271
3498227993333,0cyclictest1000-21snmpd22:16:193
3498215993332,1cyclictest3578425-21sensors21:30:231
3498211993332,1cyclictest0-21swapper/023:50:180
3498227993232,0cyclictest0-21swapper/320:05:193
3498211993231,1cyclictest0-21swapper/023:26:350
3498215993030,0cyclictest0-21swapper/100:20:221
3498215993026,1cyclictest3657089-21sensors22:45:231
3498211993029,1cyclictest0-21swapper/021:15:190
3498227992726,1cyclictest0-21swapper/322:11:443
3498227992626,0cyclictest0-21swapper/319:45:233
3498227992625,1cyclictest3583594-21sensors21:35:173
3498227992525,0cyclictest0-21swapper/322:00:233
3498215992525,0cyclictest0-21swapper/119:20:201
3498227992424,0cyclictest0-21swapper/319:25:213
3498227992424,0cyclictest0-21swapper/319:25:203
3498227992422,1cyclictest3557421-21sensors21:10:233
3498215992424,0cyclictest1000-21snmpd21:05:371
3498215992423,1cyclictest1000-21snmpd23:39:091
3498211992423,1cyclictest0-21swapper/021:35:180
3498227992222,0cyclictest0-21swapper/321:40:353
3498227992019,1cyclictest92650irq/30-p4p122:33:583
3498215992020,0cyclictest0-21swapper/122:16:191
3498227991817,1cyclictest3672767-21sensors23:00:193
3498211991817,1cyclictest0-21swapper/023:30:210
349821199180,17cyclictest3613312-21ssh22:04:410
3498227991717,0cyclictest0-21swapper/320:33:363
3498227991716,1cyclictest1000-21snmpd00:31:043
349821599178,0cyclictest0-21swapper/100:19:481
349821599170,0cyclictest0-21swapper/122:13:411
3498211991715,1cyclictest1000-21snmpd23:47:290
349822799161,14cyclictest0-21swapper/323:25:253
349822799160,1cyclictest0-21swapper/323:24:103
349822799160,1cyclictest0-21swapper/322:09:313
36881712150,0sleep30-21swapper/323:15:163
349821199150,7cyclictest0-21swapper/022:55:060
3498215991413,1cyclictest3516929-21sensors19:45:231
3498211991412,1cyclictest1000-21snmpd19:23:000
36055852130,0sleep10-21swapper/121:56:131
350901899130,2rtkit-daemon3509017-21rtkit-daemon22:23:460
350901899130,2rtkit-daemon3509017-21rtkit-daemon19:36:341
349822799133,9cyclictest0-21swapper/300:11:353
3498227991313,0cyclictest0-21swapper/300:35:243
3498215991312,1cyclictest3609878-21sensors22:00:231
3498215991312,1cyclictest1000-21snmpd22:05:381
349821199138,4cyclictest3738596-21ssh00:04:000
3498211991312,1cyclictest1000-21snmpd21:48:500
349822799129,3cyclictest0-21swapper/322:52:273
349822799128,4cyclictest0-21swapper/323:32:283
349822799127,1cyclictest0-21swapper/320:17:273
349822799123,9cyclictest0-21swapper/321:47:273
349822799123,8cyclictest0-21swapper/320:51:573
349822799122,10cyclictest0-21swapper/321:22:273
349822799122,10cyclictest0-21swapper/300:17:283
349821599129,2cyclictest3771916-21cat00:35:161
349821599123,9cyclictest0-21swapper/120:30:051
3498215991212,0cyclictest0-21swapper/121:35:181
3498215991211,1cyclictest3507264-21sensors19:25:211
3498215991211,1cyclictest3507264-21sensors19:25:201
349821599120,11cyclictest3700763-21ssh23:27:251
349821199123,8cyclictest0-21swapper/023:56:560
349822799119,2cyclictest0-21swapper/319:32:273
349822799118,2cyclictest1000-21snmpd23:05:303
349822799114,7cyclictest0-21swapper/323:42:283
349822799114,7cyclictest0-21swapper/320:42:273
349822799114,7cyclictest0-21swapper/319:42:273
349822799112,8cyclictest0-21swapper/300:05:563
349822799112,3cyclictest0-21swapper/320:22:283
349822799111,10cyclictest0-21swapper/322:42:283
349822799111,10cyclictest0-21swapper/321:57:273
3498227991110,1cyclictest0-21swapper/320:27:273
349822799110,9cyclictest0-21swapper/321:50:433
349822799110,5cyclictest0-21swapper/319:50:183
349821599112,9cyclictest0-21swapper/120:17:111
349821199119,1cyclictest1000-21snmpd00:38:280
349821199118,2cyclictest1000-21snmpd22:31:420
349822799108,1cyclictest1000-21snmpd21:15:013
3498227991010,0cyclictest0-21swapper/323:46:533
3498227991010,0cyclictest0-21swapper/319:12:283
349822799100,1cyclictest0-21swapper/322:22:413
349821599109,1cyclictest1000-21snmpd22:52:371
349821599109,1cyclictest1000-21snmpd21:15:341
349821599108,2cyclictest3677559-21cat23:05:151
349821599100,10cyclictest0-21swapper/123:49:351
349821599100,10cyclictest0-21swapper/121:45:211
34982279990,1cyclictest0-21swapper/319:35:293
34982159998,1cyclictest1000-21snmpd22:40:201
34982159990,9cyclictest0-21swapper/123:23:191
34982159990,9cyclictest0-21swapper/122:30:561
34982159990,9cyclictest0-21swapper/122:20:391
34982159990,0cyclictest0-21swapper/123:03:261
34982159950,3cyclictest1013-21lldpd23:32:391
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional