You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-05 - 17:15

x86 Intel Core i3-4360 CPU @3700 MHz, Linux 5.14.2-rt21 (Profile)

Latency plot of system in rack #0, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot4.osadl.org (updated Tue Jul 05, 2022 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
927746211884,26sleep10-21swapper/119:07:191
927896211481,26sleep30-21swapper/319:09:143
927624210570,27sleep00-21swapper/019:05:460
927626210268,26sleep20-21swapper/219:05:482
928222999424,39cyclictest0-21swapper/200:09:452
928222998910,48cyclictest0-21swapper/219:49:442
928222998811,45cyclictest0-21swapper/223:49:432
928222998711,45cyclictest0-21swapper/220:54:442
928222998710,45cyclictest0-21swapper/220:34:442
9708572850,1sleep3331rcuc/320:50:123
92822299857,70cyclictest28-21ksoftirqd/223:24:442
928222998511,46cyclictest0-21swapper/219:24:452
10667762850,1sleep30-21swapper/322:55:013
928222998311,45cyclictest0-21swapper/221:44:442
92822299818,47cyclictest0-21swapper/223:04:442
92822299818,45cyclictest0-21swapper/220:09:452
928222998010,47cyclictest0-21swapper/221:19:432
928222997910,42cyclictest0-21swapper/222:04:442
928222997724,41cyclictest0-21swapper/222:39:442
928222997210,41cyclictest0-21swapper/200:34:442
928222997128,43cyclictest28-21ksoftirqd/219:34:442
928222997010,43cyclictest0-21swapper/219:14:452
92822299669,42cyclictest0-21swapper/219:59:442
92822099650,1cyclictest0-21swapper/019:35:190
928222996463,1cyclictest1011177-21kworker/2:021:51:592
928221996463,1cyclictest1009460-21sensors21:45:191
92822199640,63cyclictest0-21swapper/123:40:191
92822199640,63cyclictest0-21swapper/120:07:591
92822199640,1cyclictest0-21swapper/119:50:081
928223996361,2cyclictest776221-21gnome-shell00:19:583
928222996358,4cyclictest281ksoftirqd/221:59:592
92822299630,62cyclictest0-21swapper/219:54:592
92822199630,62cyclictest0-21swapper/123:16:591
92822399620,61cyclictest0-21swapper/322:10:183
928222996261,1cyclictest1006953-21kworker/2:221:47:582
92822299620,1cyclictest0-21swapper/220:28:582
928221996261,1cyclictest1134897-21sensors00:15:191
928222996160,1cyclictest1107464-21kworker/2:000:12:002
928222996160,1cyclictest1079332-21kworker/2:023:11:582
928222996158,2cyclictest776221-21gnome-shell22:56:582
928222996158,2cyclictest776221-21gnome-shell21:05:592
928222996158,2cyclictest776221-21gnome-shell19:26:582
92822099610,1cyclictest0-21swapper/019:30:190
928223996057,2cyclictest776221-21gnome-shell00:11:593
928222996059,1cyclictest989225-21kworker/2:121:25:592
928222996059,1cyclictest974399-21kworker/2:221:23:592
928222996059,1cyclictest1074827-21kworker/2:123:09:592
928222996059,1cyclictest1011177-21kworker/2:022:41:582
928222996057,2cyclictest776221-21gnome-shell22:47:592
92822299600,60cyclictest0-21swapper/222:14:582
92822299600,60cyclictest0-21swapper/200:38:002
92822299600,1cyclictest0-21swapper/219:16:582
928221996059,1cyclictest0-21swapper/100:20:181
928220996058,1cyclictest1101464-21sensors23:35:190
928220996057,3cyclictest1101-21snmpd21:55:320
928222995958,1cyclictest955719-21kworker/2:120:43:592
928222995958,1cyclictest1098653-21kworker/2:223:39:582
928222995956,2cyclictest776221-21gnome-shell22:16:592
928222995956,2cyclictest776221-21gnome-shell21:34:582
928221995958,1cyclictest0-21swapper/119:20:191
928221995956,2cyclictest776221-21gnome-shell22:19:591
92822199590,58cyclictest1153235-21ssh00:37:581
928220995958,1cyclictest0-21swapper/023:10:190
928220995955,3cyclictest1130709-21sensors00:10:190
92822099590,59cyclictest0-21swapper/020:25:200
928223995857,1cyclictest1101-21snmpd22:45:423
92822399580,1cyclictest0-21swapper/322:29:583
928222995858,0cyclictest0-21swapper/223:31:582
928222995858,0cyclictest0-21swapper/223:25:592
928222995858,0cyclictest0-21swapper/223:25:582
928222995858,0cyclictest0-21swapper/222:52:592
928222995857,1cyclictest989225-21kworker/2:121:38:592
928222995857,1cyclictest974399-21kworker/2:221:04:592
928222995857,1cyclictest955719-21kworker/2:120:35:592
928222995857,1cyclictest955719-21kworker/2:120:23:592
928222995857,1cyclictest1011177-21kworker/2:022:07:592
928222995857,1cyclictest0-21swapper/200:00:002
928222995855,2cyclictest776221-21gnome-shell20:55:592
92822299580,57cyclictest0-21swapper/200:29:002
928221995857,1cyclictest980165-21sensors21:10:191
928221995857,1cyclictest0-21swapper/122:26:591
928220995854,3cyclictest965449-21sensors20:35:180
928223995751,1cyclictest0-21swapper/321:50:193
928222995757,0cyclictest0-21swapper/220:49:592
928222995756,1cyclictest1136236-21kworker/2:100:21:002
928222995756,1cyclictest0-21swapper/223:17:592
928222995756,1cyclictest0-21swapper/221:13:592
928222995754,2cyclictest776221-21gnome-shell22:24:592
928222995754,2cyclictest776221-21gnome-shell20:15:582
92822299570,57cyclictest0-21swapper/200:00:592
92822299570,0cyclictest0-21swapper/223:53:592
928221995756,1cyclictest1143233-21sensors00:25:191
928223995655,1cyclictest0-21swapper/320:35:173
928222995655,1cyclictest1131753-21kworker/2:200:15:592
928222995655,1cyclictest0-21swapper/222:31:592
928221995655,1cyclictest1101-21snmpd21:00:221
928223995554,1cyclictest1139064-21sensors00:20:193
928223995554,1cyclictest1101-21snmpd19:55:093
928223995554,1cyclictest0-21swapper/322:41:583
928223995554,1cyclictest0-21swapper/321:36:593
928223995550,1cyclictest980161-21sensors21:10:193
928222995554,1cyclictest0-21swapper/222:26:582
928222995552,2cyclictest776221-21gnome-shell20:11:582
92822299550,1cyclictest28-21ksoftirqd/220:00:152
928221995554,1cyclictest0-21swapper/122:14:581
928221995553,1cyclictest776221-21gnome-shell22:30:591
928220995554,1cyclictest1055499-21sensors22:40:190
928223995453,1cyclictest1143226-21sensors00:25:183
928223995453,1cyclictest0-21swapper/321:26:593
928222995453,1cyclictest1098653-21kworker/2:223:40:592
928222995452,2cyclictest776221-21gnome-shell19:38:582
928221995453,1cyclictest1101-21snmpd21:40:301
928221995453,1cyclictest0-21swapper/121:37:591
928220995453,1cyclictest1101-21snmpd22:00:310
928220995453,1cyclictest0-21swapper/022:55:200
928223995352,1cyclictest0-21swapper/321:18:593
928223995352,1cyclictest0-21swapper/319:10:583
928223995350,2cyclictest776221-21gnome-shell21:49:593
928221995352,1cyclictest0-21swapper/121:25:191
928221995351,1cyclictest1098436-21ssh23:31:591
928221995350,2cyclictest776221-21gnome-shell00:03:581
928220995352,1cyclictest0-21swapper/019:15:010
928223995251,1cyclictest0-21swapper/322:54:593
928221995251,1cyclictest967525-21sensors20:40:181
928220995250,1cyclictest776221-21gnome-shell22:05:590
928220995247,4cyclictest0-21swapper/023:00:190
9497722510,0sleep3949773-21grep20:00:103
928222995150,1cyclictest915138-21kworker/2:219:43:592
928221995149,1cyclictest776221-21gnome-shell22:46:591
928220995148,3cyclictest0-21swapper/020:55:200
928221995049,1cyclictest0-21swapper/123:52:581
928221995049,1cyclictest0-21swapper/123:05:451
928221995047,2cyclictest776221-21gnome-shell21:55:591
11180132500,0sleep00-21swapper/023:55:180
928221994948,1cyclictest948762-21sensors19:55:191
928220994947,1cyclictest944595-21sensors19:45:190
928223994847,1cyclictest0-21swapper/323:15:183
928223994847,1cyclictest0-21swapper/321:00:593
928223994847,1cyclictest0-21swapper/320:57:593
928221994847,1cyclictest963362-21sensors20:30:211
928221994847,1cyclictest0-21swapper/122:40:181
928221994847,1cyclictest0-21swapper/122:09:591
928223994746,1cyclictest0-21swapper/321:33:593
928221994746,1cyclictest0-21swapper/123:47:581
928220994745,1cyclictest776221-21gnome-shell23:42:590
928223994645,1cyclictest1093100-21sensors23:25:183
928223994645,1cyclictest1093100-21sensors23:25:183
928223994645,1cyclictest0-21swapper/319:52:593
928221994645,1cyclictest996896-21sensors21:30:181
928221994645,1cyclictest1013635-21sensors21:50:191
928220994645,1cyclictest0-21swapper/022:25:370
928221994544,1cyclictest1080597-21sensors23:10:191
928221994543,1cyclictest776221-21gnome-shell20:10:581
928221994542,2cyclictest776221-21gnome-shell19:43:581
928220994544,1cyclictest1097350-21sensors23:30:270
928220994544,1cyclictest0-21swapper/021:20:180
928220994543,1cyclictest984347-21sensors21:15:200
928220994442,1cyclictest776221-21gnome-shell21:40:590
928220994441,2cyclictest776221-21gnome-shell21:50:590
928223994342,1cyclictest1026193-21sensors22:05:193
928223994342,1cyclictest0-21swapper/321:09:593
928220994342,1cyclictest0-21swapper/000:30:580
928220994339,4cyclictest0-21swapper/000:25:190
10485362430,1sleep00-21swapper/022:32:280
928223994241,1cyclictest0-21swapper/319:34:583
928220994241,1cyclictest0-21swapper/023:50:200
928220994140,1cyclictest0-21swapper/000:02:580
928220994037,2cyclictest776221-21gnome-shell22:38:590
928223993938,1cyclictest1034564-21sensors22:15:193
928223993938,1cyclictest0-21swapper/300:35:193
928220993837,1cyclictest0-21swapper/022:20:590
928223993736,1cyclictest0-21swapper/323:59:593
928220993732,4cyclictest0-21swapper/019:20:190
928221993635,1cyclictest0-21swapper/122:37:591
928221993633,2cyclictest776221-21gnome-shell21:17:591
928221993534,1cyclictest969608-21sensors20:45:191
928221993532,2cyclictest776221-21gnome-shell23:23:591
928221993532,2cyclictest776221-21gnome-shell22:58:581
928221993433,1cyclictest0-21swapper/122:52:591
928220993433,1cyclictest936268-21sensors19:25:200
928220993432,2cyclictest0-21swapper/020:50:180
928221993332,1cyclictest0-21swapper/123:25:591
928221993332,1cyclictest0-21swapper/123:25:581
928223993229,2cyclictest776221-21gnome-shell19:19:583
928221993231,1cyclictest0-21swapper/121:22:591
928221993130,1cyclictest938344-21sensors19:30:191
928220993130,1cyclictest0-21swapper/000:15:190
92822099310,14cyclictest0-21swapper/020:49:190
151299300,1ntpd34-21ksoftirqd/320:09:573
928221992928,1cyclictest0-21swapper/122:02:591
928221992926,2cyclictest776221-21gnome-shell23:35:581
928220992928,1cyclictest1101-21snmpd22:50:430
928220992928,1cyclictest1088926-21sensors23:20:180
928223992826,1cyclictest1072224-21ssh23:00:193
928221992827,1cyclictest0-21swapper/100:33:581
928220992827,1cyclictest1101-21snmpd20:05:110
928223992725,1cyclictest0-21swapper/300:05:583
928221992726,1cyclictest0-21swapper/123:58:591
928221992726,1cyclictest0-21swapper/119:49:581
928220992726,1cyclictest0-21swapper/021:05:190
928221992625,1cyclictest0-21swapper/120:16:581
928221992524,1cyclictest959180-21sensors20:20:201
928221992524,1cyclictest0-21swapper/120:50:581
928221992522,2cyclictest776221-21gnome-shell22:22:591
928220992524,1cyclictest1101-21snmpd21:10:240
151299250,1ntpd34-21ksoftirqd/320:44:393
92822399240,15cyclictest0-21swapper/321:44:363
928221992423,1cyclictest1101-21snmpd21:05:231
928220992423,1cyclictest0-21swapper/020:44:580
928220992423,1cyclictest0-21swapper/019:40:590
92822099240,15cyclictest0-21swapper/020:02:450
151299230,1ntpd34-21ksoftirqd/320:27:333
928221992221,1cyclictest0-21swapper/120:38:581
928221992221,1cyclictest0-21swapper/119:36:581
928221992217,1cyclictest0-21swapper/119:11:271
928220992019,1cyclictest0-21swapper/023:45:190
928220992019,1cyclictest0-21swapper/023:15:180
151299200,1ntpd34-21ksoftirqd/300:33:153
928223991918,1cyclictest969610-21sensors20:45:193
928223991918,1cyclictest1109797-21sensors23:45:183
928221991918,1cyclictest0-21swapper/120:55:211
928221991916,2cyclictest776221-21gnome-shell19:15:581
928221991817,1cyclictest0-21swapper/120:25:201
151299180,1ntpd34-21ksoftirqd/323:22:163
10238182180,1sleep30-21swapper/322:03:163
92822399178,9cyclictest0-21swapper/323:09:283
928223991714,2cyclictest1101-21snmpd20:33:433
92822399170,16cyclictest0-21swapper/320:20:183
928220991715,1cyclictest946677-21sensors19:50:180
928223991613,2cyclictest1101-21snmpd19:27:323
92822399160,7cyclictest0-21swapper/323:31:093
92822399160,7cyclictest0-21swapper/320:11:093
92822399160,16cyclictest0-21swapper/323:54:293
92822399160,15cyclictest0-21swapper/322:24:323
92822399160,15cyclictest0-21swapper/321:55:553
928221991615,1cyclictest0-21swapper/123:01:201
92822099160,7cyclictest0-21swapper/021:48:310
928223991514,1cyclictest0-21swapper/320:15:193
92822399150,7cyclictest0-21swapper/300:04:203
92822399150,6cyclictest1081492-21ssh23:11:273
92822399150,6cyclictest0-21swapper/319:35:153
92822399150,15cyclictest0-21swapper/323:39:443
928221991514,1cyclictest0-21swapper/100:10:591
92822199150,6cyclictest0-21swapper/100:05:411
92822199150,15cyclictest0-21swapper/119:25:291
92822099150,7cyclictest0-21swapper/020:14:030
92822099150,7cyclictest0-21swapper/000:08:200
92822099150,6cyclictest0-21swapper/020:24:460
928223991411,2cyclictest1101-21snmpd23:43:443
92822099140,6cyclictest0-21swapper/000:38:420
92822099140,1cyclictest0-21swapper/021:35:170
928223991310,2cyclictest1101-21snmpd19:42:053
928220991312,1cyclictest0-21swapper/019:57:130
92822099130,1cyclictest0-21swapper/021:00:180
92822399129,2cyclictest1101-21snmpd22:32:413
928223991211,1cyclictest0-21swapper/321:20:183
92822099129,2cyclictest1101-21snmpd20:19:370
92822099120,1cyclictest0-21swapper/022:15:140
92822099120,1cyclictest0-21swapper/021:30:010
92822399110,10cyclictest0-21swapper/322:36:593
92822399110,10cyclictest0-21swapper/319:24:363
92822099118,2cyclictest1101-21snmpd20:30:010
92822099118,2cyclictest1101-21snmpd19:10:140
92822099112,6cyclictest0-21swapper/023:25:150
92822099112,6cyclictest0-21swapper/023:25:140
92822099112,6cyclictest0-21swapper/022:10:170
92822099110,10cyclictest0-21swapper/021:33:090
92822399102,5cyclictest0-21swapper/319:45:173
92822099100,9cyclictest0-21swapper/023:05:360
92822099100,9cyclictest0-21swapper/022:45:090
92822099100,9cyclictest0-21swapper/000:20:290
15129980,2ntpd22-21ksoftirqd/120:00:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional