You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-09 - 01:16

x86 Intel Core i3-4360 CPU @3700 MHz, Linux 5.14.2-rt21 (Profile)

Latency plot of system in rack #0, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot4.osadl.org (updated Tue Aug 09, 2022 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35551729660,27sleep20-21swapper/219:07:512
151199860,8ntpd13-21ksoftirqd/019:08:280
35558528462,19sleep30-21swapper/319:08:453
35382228260,19sleep10-21swapper/119:05:021
355819996761,2cyclictest203631-21gnome-shell23:17:591
355814996562,2cyclictest203631-21gnome-shell19:29:590
355819996463,1cyclictest391179-21sensors20:30:221
355819996426,38cyclictest0-21swapper/100:10:461
355819996360,2cyclictest203631-21gnome-shell22:25:591
355819996360,2cyclictest203631-21gnome-shell21:19:581
355819996259,2cyclictest203631-21gnome-shell20:00:581
355819996211,49cyclictest0-21swapper/100:35:451
355822996160,1cyclictest370888-21kworker/2:020:28:572
355822996159,1cyclictest203631-21gnome-shell22:11:592
355822996158,2cyclictest203631-21gnome-shell23:50:582
355819996158,2cyclictest203631-21gnome-shell22:03:591
355819996158,2cyclictest203631-21gnome-shell00:07:581
35581999610,60cyclictest0-21swapper/122:10:241
35581999610,1cyclictest0-21swapper/122:33:591
355814996158,2cyclictest203631-21gnome-shell19:58:590
35581499610,60cyclictest0-21swapper/019:49:580
355823996059,1cyclictest575172-21sensors00:30:233
355822996059,1cyclictest531001-21kworker/2:023:41:282
355822996059,1cyclictest0-21swapper/222:43:592
355822996059,1cyclictest0-21swapper/222:04:592
355822995958,1cyclictest0-21swapper/220:45:582
355822995958,1cyclictest0-21swapper/219:47:582
355822995957,2cyclictest203631-21gnome-shell21:35:582
355822995956,2cyclictest203631-21gnome-shell21:25:582
35582299590,59cyclictest0-21swapper/220:30:582
355819995958,1cyclictest0-21swapper/121:05:591
355819995958,1cyclictest0-21swapper/121:00:581
355819995958,1cyclictest0-21swapper/120:38:581
355819995957,2cyclictest203631-21gnome-shell21:12:581
355819995956,2cyclictest203631-21gnome-shell21:30:581
355819995956,2cyclictest203631-21gnome-shell00:03:591
35581999590,58cyclictest0-21swapper/120:10:251
355822995857,1cyclictest370888-21kworker/2:020:10:522
355822995857,1cyclictest0-21swapper/219:20:582
355822995856,2cyclictest203631-21gnome-shell23:25:592
355822995856,2cyclictest203631-21gnome-shell20:20:582
355822995856,1cyclictest203631-21gnome-shell19:40:592
35582299580,1cyclictest0-21swapper/200:05:582
355819995857,1cyclictest0-21swapper/122:50:591
355819995857,1cyclictest0-21swapper/121:42:581
355819995855,2cyclictest203631-21gnome-shell23:52:581
355819995855,2cyclictest203631-21gnome-shell23:40:591
355814995857,1cyclictest429004-21sensors21:35:270
355814995856,1cyclictest203631-21gnome-shell20:41:580
355823995756,1cyclictest520874-21sensors23:25:223
355823995710,42cyclictest0-21swapper/322:05:463
355822995756,1cyclictest558500-21sensors00:10:262
355822995756,1cyclictest203631-21gnome-shell20:57:582
355822995755,1cyclictest203631-21gnome-shell23:01:592
35582299570,57cyclictest0-21swapper/200:22:582
355819995756,1cyclictest0-21swapper/120:49:581
355819995755,2cyclictest203631-21gnome-shell22:45:591
355819995755,2cyclictest203631-21gnome-shell22:45:591
35581999570,1cyclictest0-21swapper/122:07:591
355823995655,1cyclictest570972-21sensors00:25:223
355822995654,2cyclictest203631-21gnome-shell21:20:582
355822995653,2cyclictest203631-21gnome-shell23:48:592
355822995653,2cyclictest203631-21gnome-shell22:18:592
355819995655,1cyclictest0-21swapper/121:58:581
355819995655,1cyclictest0-21swapper/119:46:581
355819995655,1cyclictest0-21swapper/119:36:581
355814995654,1cyclictest558497-21sensors00:10:250
355823995554,1cyclictest0-21swapper/322:25:213
355822995554,1cyclictest0-21swapper/221:04:582
355822995554,1cyclictest0-21swapper/219:32:582
355822995554,1cyclictest0-21swapper/219:10:592
355822995553,2cyclictest203631-21gnome-shell22:24:592
355819995554,1cyclictest0-21swapper/120:05:581
355819995554,1cyclictest0-21swapper/119:15:021
355819995552,2cyclictest203631-21gnome-shell19:30:581
4503962540,1sleep30-21swapper/322:00:423
355823995453,1cyclictest529219-21sensors23:35:223
355823995410,44cyclictest0-21swapper/322:50:463
355822995453,1cyclictest489016-21kworker/2:222:51:182
355822995453,1cyclictest384898-21sensors20:15:212
355822995453,1cyclictest0-21swapper/220:02:582
355822995452,2cyclictest203631-21gnome-shell21:54:582
355822995452,2cyclictest203631-21gnome-shell19:28:592
355819995453,1cyclictest0-21swapper/122:35:141
355819995453,1cyclictest0-21swapper/100:16:591
355814995453,1cyclictest0-21swapper/022:31:590
355823995311,42cyclictest0-21swapper/319:25:473
355822995352,1cyclictest480157-21kworker/2:222:38:192
355822995352,1cyclictest203631-21gnome-shell23:15:592
355819995352,1cyclictest0-21swapper/119:26:591
355819995350,2cyclictest203631-21gnome-shell23:46:591
355814995352,1cyclictest0-21swapper/023:05:240
5310392520,0sleep00-21swapper/023:38:220
4675722520,0sleep10-21swapper/122:21:341
4318722520,0sleep30-21swapper/321:40:043
355823995251,1cyclictest424799-21sensors21:30:243
355823995251,1cyclictest0-21swapper/321:50:213
355823995237,15cyclictest355808-21cyclictest20:55:463
355823995211,41cyclictest0-21swapper/322:30:463
355822995251,1cyclictest203631-21gnome-shell21:33:582
355822995250,1cyclictest203631-21gnome-shell22:06:592
355819995250,2cyclictest203631-21gnome-shell23:20:591
355814995251,1cyclictest562635-21sensors00:15:230
355814995251,1cyclictest366103-21sensors19:30:230
4729272510,0sleep20-21swapper/222:28:562
4325302510,0sleep00-21swapper/021:40:170
355823995123,28cyclictest0-21swapper/319:45:463
355823995110,41cyclictest0-21swapper/322:40:463
355822995150,1cyclictest203631-21gnome-shell21:07:582
355822995150,1cyclictest0-21swapper/221:45:222
355822995150,1cyclictest0-21swapper/220:40:582
355819995150,1cyclictest0-21swapper/120:50:591
355819995150,1cyclictest0-21swapper/119:22:581
355819995148,2cyclictest203631-21gnome-shell21:48:581
355823995047,2cyclictest203631-21gnome-shell20:25:583
355822995049,1cyclictest203631-21gnome-shell21:57:582
355819995049,1cyclictest0-21swapper/120:29:581
355819995049,1cyclictest0-21swapper/119:14:591
355819995047,2cyclictest203631-21gnome-shell23:28:591
355819995047,2cyclictest203631-21gnome-shell22:59:581
355822994948,1cyclictest393269-21sensors20:35:262
355819994946,2cyclictest203631-21gnome-shell22:42:591
355814994948,1cyclictest0-21swapper/022:00:240
355814994948,1cyclictest0-21swapper/020:50:220
35582399489,39cyclictest0-21swapper/321:20:463
355823994847,1cyclictest537565-21sensors23:45:223
355823994846,1cyclictest5136572chrt23:16:593
355822994847,1cyclictest380729-21sensors20:05:262
355819994847,1cyclictest0-21swapper/120:24:581
355819994845,2cyclictest203631-21gnome-shell20:17:581
355814994847,1cyclictest1117-21snmpd21:20:020
4931282470,0sleep00-21swapper/022:52:410
355823994710,37cyclictest0-21swapper/322:15:463
355822994746,1cyclictest203631-21gnome-shell23:38:582
355822994746,1cyclictest203631-21gnome-shell23:21:592
355822994746,1cyclictest0-21swapper/223:55:222
355819994744,2cyclictest203631-21gnome-shell20:42:581
355819994744,2cyclictest203631-21gnome-shell19:55:591
355814994745,1cyclictest380737-21sensors20:05:260
355822994645,1cyclictest408058-21sensors21:10:232
355822994644,2cyclictest203631-21gnome-shell19:39:582
355819994643,2cyclictest203631-21gnome-shell21:37:581
355814994644,1cyclictest462467-21sensors22:15:230
5487852450,0sleep00-21swapper/000:00:010
355823994510,35cyclictest0-21swapper/321:55:463
355822994544,1cyclictest399526-21sensors20:50:232
355819994542,2cyclictest203631-21gnome-shell21:26:581
355814994544,1cyclictest0-21swapper/019:10:210
4068402440,0sleep00-21swapper/021:10:130
355823994443,1cyclictest0-21swapper/319:24:583
355823994411,33cyclictest0-21swapper/320:35:473
355823994411,33cyclictest0-21swapper/320:10:463
355822994443,1cyclictest203631-21gnome-shell22:46:592
355822994443,1cyclictest203631-21gnome-shell22:46:582
355822994443,1cyclictest203631-21gnome-shell00:29:592
355819994441,2cyclictest203631-21gnome-shell23:59:591
355819994441,2cyclictest203631-21gnome-shell19:51:581
5038602430,0sleep10-21swapper/123:05:191
355823994342,1cyclictest378634-21sensors20:00:233
355822994341,2cyclictest203631-21gnome-shell19:59:592
355814994342,1cyclictest445744-21sensors21:55:250
355819994239,2cyclictest508176-21ntpq23:10:201
355823994140,1cyclictest403711-21sensors21:00:253
355819994140,1cyclictest462469-21ssh22:15:231
355814994140,1cyclictest0-21swapper/023:10:220
355814994139,1cyclictest1117-21snmpd22:25:130
355823994039,1cyclictest0-21swapper/321:13:583
355823993939,0cyclictest0-21swapper/300:18:203
355814993938,1cyclictest441517-21sensors21:50:210
355814993938,1cyclictest0-21swapper/023:00:240
355814993938,1cyclictest0-21swapper/000:05:290
355823993837,1cyclictest0-21swapper/322:38:593
355814993837,1cyclictest0-21swapper/023:40:250
355814993837,1cyclictest0-21swapper/021:05:240
355823993736,0cyclictest0-21swapper/323:24:583
355823993734,2cyclictest203631-21gnome-shell19:37:583
355814993736,1cyclictest0-21swapper/021:45:050
355814993736,1cyclictest0-21swapper/021:25:270
355814993735,1cyclictest1117-21snmpd22:05:100
355823993534,1cyclictest477647-21kworker/3:022:46:593
355823993534,1cyclictest477647-21kworker/3:022:46:593
355823993534,1cyclictest0-21swapper/321:46:593
355819993534,1cyclictest0-21swapper/121:51:581
355814993534,1cyclictest382820-21sensors20:10:250
355823993433,1cyclictest534660-21kworker/3:223:43:593
355823993433,1cyclictest0-21swapper/300:20:583
355822993432,2cyclictest203631-21gnome-shell22:31:592
355814993433,1cyclictest0-21swapper/022:55:210
355823993333,0cyclictest0-21swapper/323:56:593
355823993332,1cyclictest477647-21kworker/3:023:01:593
355823993331,2cyclictest203631-21gnome-shell19:33:583
355823993231,1cyclictest534660-21kworker/3:223:50:583
355823993231,0cyclictest0-21swapper/323:11:593
355823993230,2cyclictest0-21swapper/300:14:593
355823993230,1cyclictest580492-21ssh00:36:583
355822993231,1cyclictest504195-21sensors23:05:242
355819993231,1cyclictest0-21swapper/123:00:241
355814993231,1cyclictest479168-21sensors22:35:250
355823993130,1cyclictest0-21swapper/322:21:593
355823993130,0cyclictest0-21swapper/323:09:593
355823993030,0cyclictest0-21swapper/322:12:593
355823993029,1cyclictest0-21swapper/319:41:003
355823993028,1cyclictest0-21swapper/320:30:593
355822993029,1cyclictest0-21swapper/200:15:232
355823992929,0cyclictest0-21swapper/320:45:593
355823992928,1cyclictest398167-21kworker/3:121:17:593
355823992928,1cyclictest383433-21kworker/3:220:21:003
355823992928,1cyclictest383433-21kworker/3:220:18:593
355823992928,1cyclictest340873-21kworker/3:219:13:003
355823992928,1cyclictest0-21swapper/321:28:593
355814992928,1cyclictest0-21swapper/020:45:220
355823992828,0cyclictest0-21swapper/320:51:593
355823992828,0cyclictest0-21swapper/319:51:003
355823992827,1cyclictest418135-21kworker/3:021:38:593
355823992827,1cyclictest375191-21kworker/3:119:57:593
151199260,1ntpd13-21ksoftirqd/020:36:420
355823992524,1cyclictest0-21swapper/320:41:593
355819992510,15cyclictest0-21swapper/100:25:461
151199250,1ntpd13-21ksoftirqd/020:19:070
151199250,1ntpd13-21ksoftirqd/020:01:130
151199250,1ntpd13-21ksoftirqd/019:43:480
355823992423,1cyclictest398167-21kworker/3:121:09:593
355814992423,1cyclictest0-21swapper/020:59:580
355823992210,12cyclictest0-21swapper/319:15:463
355819992221,1cyclictest370276-21sensors19:40:211
355822992019,1cyclictest508369-21sensors23:10:232
35582299200,4cyclictest0-21swapper/219:19:232
35581499200,19cyclictest0-21swapper/021:18:130
151199200,1ntpd13-21ksoftirqd/000:25:570
35582399198,11cyclictest0-21swapper/323:30:463
35581999198,11cyclictest0-21swapper/100:30:461
355814991918,1cyclictest0-21swapper/021:30:240
151199190,2ntpd487283-21ntpq22:45:200
151199190,2ntpd487283-21ntpq22:45:200
151199190,1ntpd13-21ksoftirqd/023:33:030
151199190,1ntpd13-21ksoftirqd/022:40:360
151199190,1ntpd13-21ksoftirqd/022:23:230
35581999180,18cyclictest0-21swapper/100:22:161
151199180,1ntpd28-21ksoftirqd/222:57:432
35582299173,8cyclictest0-21swapper/221:42:532
35582299170,17cyclictest0-21swapper/219:54:402
355814991715,1cyclictest1117-21snmpd23:18:110
355814991714,2cyclictest203631-21gnome-shell00:34:590
355814991714,2cyclictest1117-21snmpd23:57:570
35582399160,15cyclictest0-21swapper/300:00:073
35581499160,7cyclictest0-21swapper/020:29:390
35582399154,10cyclictest0-21swapper/320:06:053
35582399153,11cyclictest0-21swapper/322:55:463
35582399150,15cyclictest0-21swapper/300:09:453
35582299150,7cyclictest0-21swapper/200:04:462
35582299150,6cyclictest0-21swapper/221:19:342
355814991512,2cyclictest1117-21snmpd23:20:350
35581499150,7cyclictest536327-21sh23:45:090
35581499150,7cyclictest0-21swapper/022:11:540
355822991310,2cyclictest1117-21snmpd00:36:312
35581999130,13cyclictest0-21swapper/123:35:321
35581499133,4cyclictest0-21swapper/019:17:030
355814991312,1cyclictest0-21swapper/019:50:210
35581499130,1cyclictest0-21swapper/023:25:170
35581999129,2cyclictest1117-21snmpd23:32:301
35581499129,2cyclictest1117-21snmpd19:22:150
355814991210,1cyclictest1117-21snmpd21:02:180
35582299110,11cyclictest0-21swapper/223:30:392
35581999118,2cyclictest1117-21snmpd20:55:181
35581999110,10cyclictest0-21swapper/121:23:371
35581499118,2cyclictest1117-21snmpd00:24:220
35581499110,10cyclictest0-21swapper/023:51:240
35581499110,10cyclictest0-21swapper/019:36:210
35581499100,9cyclictest0-21swapper/000:36:460
3558229990,9cyclictest0-21swapper/200:33:352
3558149990,9cyclictest0-21swapper/020:30:500
15119980,1ntpd0-21swapper/020:20:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional