You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-04 - 03:52

x86 Intel Core i9-9900K @3600 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot7.osadl.org (updated Sun Dec 04, 2022 00:45:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23913802210204,3sleep100-21swapper/1019:08:422
23912162197157,11sleep60-21swapper/619:06:4612
23910692183175,4sleep50-21swapper/519:05:4011
23912592175157,9sleep130-21swapper/1319:07:095
23913592171150,12sleep80-21swapper/819:08:2414
23914612170155,4sleep40-21swapper/419:09:4010
23912632169160,6sleep00-21swapper/019:07:120
7692201660,163pipewire-pulse0-21swapper/1119:06:373
23913632140120,10sleep120-21swapper/1219:08:284
23913032140108,30sleep150-21swapper/1519:07:447
23912942130119,5sleep70-21swapper/719:07:3513
23911142116113,1sleep90-21swapper/919:05:4515
2391176211282,28sleep140-21swapper/1419:06:226
239143329998,0sleep20-21swapper/219:09:228
769220930,48pipewire-pulse0-21swapper/319:07:359
769720760,33pipewire95-21ksoftirqd/1121:38:323
2391949997063,0cyclictest7863-21gsd-media-keys21:08:411
239126426351,5sleep10-21swapper/119:07:131
132299620,0ntpd0-21swapper/020:51:130
2391949996054,4cyclictest25-21ksoftirqd/121:55:381
2391987995716,0cyclictest769220pipewire-pulse23:12:333
23949692540,0sleep110-21swapper/1119:10:183
2391982995311,0cyclictest0-21swapper/1000:24:562
239198299496,43cyclictest0-21swapper/1022:11:142
2391982994816,32cyclictest0-21swapper/1020:07:572
132299480,0ntpd0-21swapper/019:51:130
239198299475,42cyclictest0-21swapper/1020:32:532
2391982994513,32cyclictest0-21swapper/1020:47:232
239197999457,25cyclictest0-21swapper/923:10:1215
2391979994435,2cyclictest0-21swapper/922:29:2115
239200199430,1cyclictest0-21swapper/1521:45:217
239200199430,0cyclictest0-21swapper/1500:18:087
769720420,41pipewire0-21swapper/420:01:4710
239198999420,21cyclictest0-21swapper/1219:34:284
239198999420,21cyclictest0-21swapper/1200:09:254
769720410,20pipewire95-21ksoftirqd/1119:21:023
2391964994123,14cyclictest3467964-21systemd-udevd00:25:2611
769720400,19pipewire3239106-21kworker/11:123:30:373
239200199400,0cyclictest0-21swapper/1521:42:047
239198999401,4cyclictest780232-21chrome20:10:384
239198299409,10cyclictest0-21swapper/1020:01:092
2391972994039,1cyclictest67-21ksoftirqd/722:45:2313
769220390,0pipewire-pulse0-21swapper/1123:50:443
239200199398,14cyclictest0-21swapper/1522:53:477
239200199390,18cyclictest0-21swapper/1523:17:127
239200199390,0cyclictest0-21swapper/1522:23:087
239200199390,0cyclictest0-21swapper/1522:23:087
239200199390,0cyclictest0-21swapper/1521:06:127
239200199390,0cyclictest0-21swapper/1519:33:397
239200199390,0cyclictest0-21swapper/1519:28:357
239200199390,0cyclictest0-21swapper/1500:36:567
239200199390,0cyclictest0-21swapper/1500:21:237
239197999390,0cyclictest0-21swapper/921:20:2315
769720380,17pipewire2341903-21Isolated13:50:493
239200199380,4cyclictest0-21swapper/1523:53:297
239200199380,0cyclictest0-21swapper/1522:30:447
239200199380,0cyclictest0-21swapper/1522:06:597
239200199380,0cyclictest0-21swapper/1521:36:447
239200199380,0cyclictest0-21swapper/1521:14:027
239200199380,0cyclictest0-21swapper/1520:51:157
239200199380,0cyclictest0-21swapper/1500:08:057
239198999380,17cyclictest0-21swapper/1223:36:564
2391982993837,1cyclictest2718592-21cstates20:55:112
239196499381,33cyclictest0-21swapper/521:49:1311
239200199370,4cyclictest0-21swapper/1519:20:057
239200199370,37cyclictest0-21swapper/1521:52:597
239200199370,37cyclictest0-21swapper/1521:52:587
239200199370,20cyclictest0-21swapper/1521:31:367
239200199370,17cyclictest0-21swapper/1522:36:247
239200199370,17cyclictest0-21swapper/1521:25:087
239200199370,16cyclictest0-21swapper/1523:31:337
239200199370,0cyclictest0-21swapper/1523:39:397
239200199370,0cyclictest0-21swapper/1523:25:167
239200199370,0cyclictest0-21swapper/1523:05:097
239200199370,0cyclictest0-21swapper/1521:56:327
239200199370,0cyclictest0-21swapper/1520:44:297
239200199370,0cyclictest0-21swapper/1520:36:207
239200199370,0cyclictest0-21swapper/1520:33:177
239200199370,0cyclictest0-21swapper/1520:16:457
239200199370,0cyclictest0-21swapper/1520:16:457
239200199370,0cyclictest0-21swapper/1520:10:277
239200199370,0cyclictest0-21swapper/1520:06:427
239200199370,0cyclictest0-21swapper/1520:00:537
239194199370,13cyclictest3150873-21ssh22:58:170
2391993993631,2cyclictest0-21swapper/1322:25:205
2391972993610,26cyclictest3233793-21kworker/7:223:30:2113
2391949993631,2cyclictest0-21swapper/120:45:261
239199799350,10cyclictest0-21swapper/1422:40:036
239199399355,10cyclictest0-21swapper/1323:05:435
239198999354,10cyclictest0-21swapper/1221:18:174
239198999351,26cyclictest2824495-21opera19:55:214
2391982993514,21cyclictest0-21swapper/1019:37:532
239197999350,10cyclictest0-21swapper/919:41:3115
239196499350,2cyclictest2824619-21opera22:52:0311
2391958993516,14cyclictest2824327-21opera21:10:129
2391953993528,1cyclictest2763220-21systemd-udevd21:08:418
132299350,0ntpd0-21swapper/022:51:120
239198999341,2cyclictest769220pipewire-pulse00:15:354
239198299343,31cyclictest0-21swapper/1022:06:502
2391982993420,11cyclictest3467970-21spawn00:25:262
2391982993413,21cyclictest0-21swapper/1023:17:202
2391982993413,21cyclictest0-21swapper/1021:44:002
2391982993413,21cyclictest0-21swapper/1000:05:012
239198299341,29cyclictest780232-21chrome21:37:582
239197999349,25cyclictest24564-21thunderbird20:58:2415
2391979993410,24cyclictest31304901kworker/u32:023:42:5815
2391968993432,2cyclictest60-21ksoftirqd/622:20:1212
2391968993432,2cyclictest60-21ksoftirqd/622:20:1212
239196499341,2cyclictest780232-21chrome22:31:3211
239196499340,1cyclictest2341918-21TaskCon~ller11
2391941993418,16cyclictest0-21swapper/021:10:060
2392001993333,0cyclictest0-21swapper/1523:22:207
2391989993319,11cyclictest2401480-21DOM13:50:494
2391989993312,21cyclictest0-21swapper/1222:11:144
239198999330,31cyclictest0-21swapper/1200:25:254
239198299332,31cyclictest0-21swapper/1021:58:052
239198299332,0cyclictest0-21swapper/1020:17:092
239198299332,0cyclictest0-21swapper/1020:17:092
2391982993312,21cyclictest0-21swapper/1020:51:492
239198299330,33cyclictest0-21swapper/1019:42:442
239197999337,26cyclictest0-21swapper/900:38:0415
239197999330,33cyclictest0-21swapper/921:31:2115
239197999330,33cyclictest0-21swapper/920:47:2515
239197999330,33cyclictest0-21swapper/920:25:2715
239197999330,33cyclictest0-21swapper/920:14:2815
239197999330,33cyclictest0-21swapper/919:30:3315
239197999330,33cyclictest0-21swapper/919:19:3315
2391941993331,0cyclictest7772-21gvfs-mtp-volume21:08:410
2391989993224,6cyclictest0-21swapper/1223:15:264
239198799329,21cyclictest769220pipewire-pulse22:53:383
2391987993232,0cyclictest2371566-21neo4j.BoltWorke20:10:133
2391987993231,0cyclictest780232-21chrome20:27:583
2391987993212,20cyclictest0-21swapper/1121:20:273
2391987993211,21cyclictest0-21swapper/1122:33:203
2391987993211,21cyclictest0-21swapper/1120:01:093
2391987993211,21cyclictest0-21swapper/1119:48:193
2391987993211,21cyclictest0-21swapper/1100:39:153
2391987993210,21cyclictest2193177-21neo4j.BoltWorke20:55:323
239198799320,21cyclictest0-21swapper/1121:08:413
2391982993228,4cyclictest3294018-21ThreadPoolForeg23:50:242
239198299321,31cyclictest0-21swapper/1019:57:462
2391982993211,0cyclictest0-21swapper/1021:52:492
2391982993211,0cyclictest0-21swapper/1021:52:482
2391982993211,0cyclictest0-21swapper/1000:00:292
239198299320,7cyclictest0-21swapper/1020:20:402
239198299320,31cyclictest0-21swapper/1023:05:502
239197999327,25cyclictest0-21swapper/923:32:1115
239197999327,25cyclictest0-21swapper/921:09:2415
2391979993227,3cyclictest81-21ksoftirqd/919:25:1515
239196499321,2cyclictest0-21swapper/519:43:4011
239195399320,25cyclictest374470-21chrome00:27:228
239195399320,20cyclictest780232-21chrome00:24:508
2391993993126,3cyclictest0-21swapper/1321:45:285
239199399310,29cyclictest0-21swapper/1320:49:335
239198999310,1cyclictest780232-21chrome00:02:514
2391987993120,3cyclictest2824204-21VizCompositorTh20:31:093
2391987993111,20cyclictest0-21swapper/1122:46:053
2391987993111,20cyclictest0-21swapper/1120:15:393
2391987993111,20cyclictest0-21swapper/1120:15:393
2391987993111,20cyclictest0-21swapper/1100:05:393
2391987993110,21cyclictest0-21swapper/1123:43:553
239198799310,10cyclictest0-21swapper/1123:35:083
239198799310,10cyclictest0-21swapper/1121:59:573
239198799310,10cyclictest0-21swapper/1100:32:593
239198299314,27cyclictest0-21swapper/1019:17:372
239197999317,24cyclictest0-21swapper/900:16:0715
239197999316,25cyclictest0-21swapper/900:27:0415
2391979993130,1cyclictest81-21ksoftirqd/922:51:5515
2391976993126,4cyclictest2686575-21unixbench_singl20:40:3214
2391964993118,12cyclictest0-21swapper/522:20:1211
2391964993118,12cyclictest0-21swapper/522:20:1111
2391964993117,10cyclictest0-21swapper/522:58:2111
239196499310,30cyclictest0-21swapper/521:23:0611
239195899314,26cyclictest2905007-21kworker/u32:122:43:079
239195899310,0cyclictest0-21swapper/300:25:269
2391953993128,1cyclictest0-21swapper/223:15:258
239195399310,29cyclictest0-21swapper/200:01:248
239194999310,28cyclictest3363609-21systemd-udevd23:58:551
2391997993029,0cyclictest0-21swapper/1419:30:366
239199399308,1cyclictest0-21swapper/1320:40:325
2391993993028,2cyclictest0-21swapper/1322:01:485
2391993993028,0cyclictest3432640-21sendmail_mailtr00:15:315
2391989993024,5cyclictest0-21swapper/1223:50:344
2391989993024,5cyclictest0-21swapper/1221:41:574
2391989993024,4cyclictest0-21swapper/1221:22:444
239198999301,4cyclictest769720pipewire21:31:044
239198799309,21cyclictest0-21swapper/1122:12:563
239198799309,21cyclictest0-21swapper/1119:17:373
239198799309,20cyclictest2735150-21hddtemp_smartct21:00:183
239198799308,21cyclictest2341903-21Isolated13:50:493
2391987993023,6cyclictest0-21swapper/1100:25:283
2391987993010,20cyclictest0-21swapper/1120:41:133
2391987993010,0cyclictest0-21swapper/1100:10:083
239198799300,9cyclictest0-21swapper/1121:10:123
239198299300,0cyclictest0-21swapper/1023:40:342
239198299300,0cyclictest0-21swapper/1022:28:532
239198299300,0cyclictest0-21swapper/1021:10:102
2391979993029,1cyclictest81-21ksoftirqd/921:55:3815
2391979993027,2cyclictest81-21ksoftirqd/921:15:2815
239197999301,2cyclictest769720pipewire21:00:4615
239197699300,30cyclictest0-21swapper/822:05:2014
239196499307,20cyclictest374470-21chrome19:15:2011
239196499306,24cyclictest0-21swapper/519:35:0711
2391964993018,8cyclictest0-21swapper/500:35:2711
239196499301,4cyclictest374868-21VizCompositorTh20:36:4111
239195899300,20cyclictest3481517-21kthreadcore00:30:289
239195899300,0cyclictest0-21swapper/323:50:289
2391953993023,6cyclictest0-21swapper/200:11:008
2391953993018,8cyclictest0-21swapper/219:55:218
239195399300,21cyclictest780232-21chrome19:19:068
769220290,0pipewire-pulse0-21swapper/1220:50:594
239200199290,0cyclictest0-21swapper/1523:59:107
239199399295,23cyclictest0-21swapper/1319:25:235
2391993992928,0cyclictest780232-21chrome00:25:375
2391993992927,2cyclictest0-21swapper/1300:10:345
2391993992927,1cyclictest8204-21pcscd23:50:255
2391993992926,1cyclictest2341903-21Isolated13:50:495
2391993992923,4cyclictest3481132-21tr00:30:275
2391993992923,4cyclictest0-21swapper/1321:50:455
2391993992923,4cyclictest0-21swapper/1321:50:455
2391989992919,9cyclictest0-21swapper/1223:11:324
239198999290,28cyclictest0-21swapper/1222:20:244
239198999290,28cyclictest0-21swapper/1222:20:234
239198999290,28cyclictest0-21swapper/1221:57:294
239198999290,0cyclictest0-21swapper/1219:48:484
239198799299,20cyclictest0-21swapper/1123:20:123
239198799299,20cyclictest0-21swapper/1123:00:173
239198799299,20cyclictest0-21swapper/1122:20:273
239198799299,20cyclictest0-21swapper/1122:20:263
239198799299,20cyclictest0-21swapper/1122:15:073
239198799299,20cyclictest0-21swapper/1122:15:063
239198799299,20cyclictest0-21swapper/1120:09:173
239198799299,0cyclictest0-21swapper/1122:27:563
239198799299,0cyclictest0-21swapper/1122:08:203
239198799298,21cyclictest0-21swapper/1123:18:583
239198799298,21cyclictest0-21swapper/1100:21:063
239198799298,0cyclictest0-21swapper/1119:42:053
2391987992923,6cyclictest0-21swapper/1119:25:223
239198799290,8cyclictest0-21swapper/1121:49:383
239198299290,27cyclictest780232-21chrome22:45:062
239197999290,27cyclictest2824132-21opera22:11:5315
2391976992926,2cyclictest74-21ksoftirqd/823:58:5414
2391976992923,3cyclictest74-21ksoftirqd/821:16:5614
2391968992926,2cyclictest60-21ksoftirqd/622:11:5312
239196499292,7cyclictest374470-21chrome19:14:3611
239196499292,2cyclictest374867-21Chrome_ChildIOT23:09:3211
2391964992919,9cyclictest0-21swapper/522:25:2011
2391964992919,10cyclictest0-21swapper/522:01:2611
239196499291,8cyclictest780232-21chrome21:59:0011
2391964992918,9cyclictest0-21swapper/523:59:0711
2391964992917,11cyclictest0-21swapper/519:55:2211
239196499291,2cyclictest2824622-21Chrome_ChildIOT19:45:5611
239196499291,25cyclictest374470-21chrome00:00:3511
239196499291,1cyclictest780232-21chrome19:31:0311
239196499290,28cyclictest0-21swapper/500:15:3511
239196499290,24cyclictest0-21swapper/521:30:2411
239196499290,19cyclictest0-21swapper/521:40:3311
239196499290,0cyclictest0-21swapper/521:05:2111
2391958992920,7cyclictest780232-21chrome20:57:009
239195899290,25cyclictest374470-21chrome19:58:509
2391953992924,5cyclictest0-21swapper/200:15:238
2391953992924,4cyclictest2341903-21Isolated13:50:498
2391953992922,6cyclictest0-21swapper/221:38:538
2391953992922,5cyclictest24564-21thunderbird21:16:028
239195399290,29cyclictest0-21swapper/223:50:388
2391941992919,8cyclictest374504-21ThreadPoolForeg22:20:120
2391941992919,8cyclictest374504-21ThreadPoolForeg22:20:110
239199399285,21cyclictest0-21swapper/1322:55:195
239199399284,0cyclictest0-21swapper/1322:05:165
2391993992827,1cyclictest2847953-21libvirt-ifstat21:30:285
2391993992827,1cyclictest1081rcuc/1323:24:305
2391993992827,0cyclictest0-21swapper/1321:05:225
2391993992826,2cyclictest0-21swapper/1320:55:235
2391993992826,2cyclictest0-21swapper/1320:27:545
2391993992826,2cyclictest0-21swapper/1319:50:235
2391993992825,3cyclictest0-21swapper/1321:37:575
2391993992825,2cyclictest0-21swapper/1320:19:375
2391993992825,2cyclictest0-21swapper/1320:19:365
2391993992822,5cyclictest0-21swapper/1300:21:165
2391989992819,6cyclictest0-21swapper/1220:56:564
2391989992816,8cyclictest0-21swapper/1223:40:314
2391989992815,10cyclictest0-21swapper/1200:33:474
239198999280,24cyclictest0-21swapper/1222:28:534
239198999280,0cyclictest0-21swapper/1222:58:204
239198999280,0cyclictest0-21swapper/1219:25:264
239198799288,20cyclictest0-21swapper/1123:59:543
239198799288,20cyclictest0-21swapper/1123:08:403
239198799288,20cyclictest0-21swapper/1122:41:483
239198799288,20cyclictest0-21swapper/1119:38:333
239198799287,21cyclictest0-21swapper/1121:30:263
239198799287,21cyclictest0-21swapper/1119:33:253
239198799287,21cyclictest0-21swapper/1100:19:293
239198799285,20cyclictest769220pipewire-pulse20:22:133
239198799280,21cyclictest2341903-21Isolated13:50:493
239198799280,21cyclictest2341903-21Isolated13:50:493
2391982992822,5cyclictest780232-21chrome21:30:322
2391982992822,5cyclictest2815041-21ssh21:23:062
239198299280,23cyclictest3009832-21ssh22:19:072
239198299280,23cyclictest3009832-21ssh22:19:062
239198299280,1cyclictest0-21swapper/1000:36:452
239197999284,24cyclictest2761730-21kworker/u32:021:41:5615
2391979992827,1cyclictest0-21swapper/919:50:2015
2391976992825,2cyclictest2717281-21ThreadPoolForeg21:08:4214
2391972992828,0cyclictest56650irq/134-i91522:55:2313
2391972992828,0cyclictest56650irq/134-i91520:02:0513
2391972992810,10cyclictest2938686-21systemd-udevd21:58:2013
2391968992828,0cyclictest0-21swapper/620:27:5412
2391968992822,3cyclictest60-21ksoftirqd/600:21:5612
239196499282,5cyclictest374470-21chrome20:50:3611
2391964992824,3cyclictest0-21swapper/523:15:2911
2391964992820,5cyclictest0-21swapper/522:14:1411
2391964992817,11cyclictest0-21swapper/521:10:1911
239196499281,3cyclictest780232-21chrome20:18:5211
239196499281,3cyclictest780232-21chrome20:18:5211
239196499280,27cyclictest0-21swapper/500:30:2511
239196499280,26cyclictest780232-21chrome23:40:3911
239196499280,1cyclictest780232-21chrome00:09:3011
2391961992817,2cyclictest46-21ksoftirqd/421:10:2810
239195899283,16cyclictest769220pipewire-pulse20:30:029
2391958992823,5cyclictest0-21swapper/322:24:599
2391958992823,5cyclictest0-21swapper/322:24:589
2391958992823,4cyclictest8945-21URL13:50:499
239195899281,24cyclictest2824625-21Compositor21:15:369
239195899281,0cyclictest780232-21chrome21:08:409
239195899280,21cyclictest2744043-21Isolated13:50:499
239195899280,0cyclictest0-21swapper/320:17:139
239195899280,0cyclictest0-21swapper/320:17:139
239195899280,0cyclictest0-21swapper/319:17:289
2391953992824,4cyclictest0-21swapper/221:50:498
2391953992824,4cyclictest0-21swapper/221:50:488
2391953992823,4cyclictest8715-21Renderer21:29:348
2391953992817,0cyclictest0-21swapper/200:30:318
239195399280,28cyclictest0-21swapper/221:55:418
239195399280,28cyclictest0-21swapper/220:20:278
239195399280,19cyclictest0-21swapper/221:10:078
766298270,23rtkit-daemon7786-21packagekitd23:04:455
2392001992727,0cyclictest0-21swapper/1520:22:477
2392001992722,1cyclictest0-21swapper/1519:42:477
239200199270,0cyclictest0-21swapper/1520:55:257
239200199270,0cyclictest0-21swapper/1519:15:357
239199399275,1cyclictest0-21swapper/1322:52:035
239199399274,22cyclictest0-21swapper/1323:15:265
239199399274,1cyclictest0-21swapper/1323:35:345
239199399273,23cyclictest0-21swapper/1322:32:065
2391993992726,1cyclictest0-21swapper/1323:42:555
2391993992726,0cyclictest0-21swapper/1321:15:335
2391993992726,0cyclictest0-21swapper/1321:10:105
2391993992726,0cyclictest0-21swapper/1319:20:205
2391993992723,2cyclictest0-21swapper/1322:20:245
2391993992723,2cyclictest0-21swapper/1322:20:235
239199399272,24cyclictest0-21swapper/1320:21:325
2391989992722,5cyclictest0-21swapper/1220:22:154
2391989992719,7cyclictest0-21swapper/1221:54:294
2391989992719,7cyclictest0-21swapper/1221:54:294
2391989992719,6cyclictest0-21swapper/1221:01:134
2391989992719,1cyclictest769720pipewire20:15:444
2391989992719,1cyclictest769720pipewire20:15:444
239198999271,2cyclictest769220pipewire-pulse19:53:054
239198999270,25cyclictest2867869-21ssh21:37:464
239198999270,0cyclictest0-21swapper/1222:00:404
239198799278,11cyclictest780232-21chrome19:58:393
239198799277,20cyclictest2525824-21kthreadcore19:50:213
239198799277,20cyclictest0-21swapper/1122:04:363
239198799277,0cyclictest0-21swapper/1121:42:293
239198799277,0cyclictest0-21swapper/1121:27:083
239198799276,21cyclictest0-21swapper/1123:45:293
239198799276,21cyclictest0-21swapper/1100:00:533
2391987992721,0cyclictest0-21swapper/1123:26:343
239198799271,5cyclictest780232-21chrome20:50:463
2391982992724,2cyclictest780232-21chrome21:25:232
2391982992722,5cyclictest0-21swapper/1000:33:432
2391982992718,8cyclictest780232-21chrome19:22:142
239198299270,1cyclictest374470-21chrome23:20:132
239198299270,1cyclictest2824175-21opera20:27:582
239198299270,1cyclictest0-21swapper/1021:47:342
239198299270,0cyclictest2341903-21Isolated13:50:492
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional