You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-27 - 03:33

x86 Intel Core i9-9900K @3600 MHz, Linux 5.15.2-rt19 (Profile)

Latency plot of system in rack #0, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot3.osadl.org (updated Mon Mar 27, 2023 00:45:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7708202399379,14sleep50-21swapper/519:09:1111
7708402375369,4sleep70-21swapper/719:09:2913
7706172355314,14sleep120-21swapper/1219:06:214
7707842353334,13sleep60-21swapper/619:08:4012
7705912347307,13sleep40-21swapper/419:05:5810
7706392342322,14sleep130-21swapper/1319:06:385
7705652342323,13sleep140-21swapper/1419:05:356
7708252341322,13sleep90-21swapper/919:09:1515
7706552341322,13sleep100-21swapper/1019:06:522
7706412341321,14sleep150-21swapper/1519:06:407
7705572340321,13sleep80-21swapper/819:05:2914
7707222339320,13sleep30-21swapper/319:07:509
7705702336316,14sleep20-21swapper/219:05:398
7706562333314,13sleep110-21swapper/1119:06:533
7705882331314,11sleep10-21swapper/119:05:541
7706042327308,13sleep00-21swapper/019:06:100
771131999634,42cyclictest111650irq/131-enp2s0-22:18:593
771131997714,63cyclictest0-21swapper/1123:00:293
771131997714,42cyclictest0-21swapper/1120:05:233
771131997714,21cyclictest0-21swapper/1123:55:553
771131997714,21cyclictest0-21swapper/1123:55:553
771131997714,21cyclictest0-21swapper/1121:15:423
771131997714,21cyclictest0-21swapper/1119:42:133
771131997714,21cyclictest0-21swapper/1119:36:073
771131997614,42cyclictest0-21swapper/1123:12:583
771131997614,21cyclictest0-21swapper/1119:30:233
771131997614,20cyclictest0-21swapper/1122:10:363
771131997614,20cyclictest0-21swapper/1121:20:033
771131997613,63cyclictest0-21swapper/1123:38:303
771131997613,63cyclictest0-21swapper/1123:38:293
771131997613,42cyclictest0-21swapper/1120:16:193
771131997613,21cyclictest0-21swapper/1123:52:333
771131997613,21cyclictest0-21swapper/1122:41:313
771131997613,21cyclictest0-21swapper/1100:21:293
771131997513,62cyclictest0-21swapper/1121:25:253
771131997513,21cyclictest0-21swapper/1122:47:253
771131997513,21cyclictest0-21swapper/1120:53:483
771131997513,21cyclictest0-21swapper/1100:33:303
771131997413,41cyclictest0-21swapper/1122:24:193
77113399718,21cyclictest0-21swapper/1323:10:135
77113199630,21cyclictest0-21swapper/1123:23:453
77113199630,21cyclictest0-21swapper/1100:35:013
771131995814,20cyclictest0-21swapper/1100:15:113
77113199580,36cyclictest0-21swapper/1121:59:103
771131995715,42cyclictest0-21swapper/1123:33:503
771131995715,42cyclictest0-21swapper/1123:33:503
771131995715,42cyclictest0-21swapper/1121:05:073
771131995715,21cyclictest0-21swapper/1100:05:183
771131995714,23cyclictest0-21swapper/1121:41:373
77113199570,36cyclictest0-21swapper/1122:30:023
771131995615,41cyclictest0-21swapper/1123:09:063
771131995615,41cyclictest0-21swapper/1100:00:173
771131995615,21cyclictest0-21swapper/1122:05:513
771131995614,42cyclictest0-21swapper/1122:50:103
771131995614,42cyclictest0-21swapper/1122:50:093
771131995614,42cyclictest0-21swapper/1122:25:533
771131995614,42cyclictest0-21swapper/1119:20:173
771131995614,21cyclictest0-21swapper/1123:45:473
771131995514,41cyclictest0-21swapper/1123:27:483
771131995514,21cyclictest0-21swapper/1123:44:273
771131995514,21cyclictest0-21swapper/1123:15:473
771131995514,21cyclictest0-21swapper/1121:53:103
771131995514,21cyclictest0-21swapper/1121:13:393
771131995514,21cyclictest0-21swapper/1121:02:473
771131995514,21cyclictest0-21swapper/1119:16:093
771131995514,21cyclictest0-21swapper/1119:11:233
771131995514,20cyclictest0-21swapper/1119:51:373
771131995514,20cyclictest0-21swapper/1119:51:373
771131995513,42cyclictest0-21swapper/1120:28:363
771131995513,21cyclictest0-21swapper/1122:03:113
771131995513,21cyclictest0-21swapper/1121:48:453
771131995513,21cyclictest0-21swapper/1120:33:393
771131995513,21cyclictest0-21swapper/1100:26:403
771131995513,21cyclictest0-21swapper/1100:10:243
771131995513,20cyclictest0-21swapper/1122:36:313
771131995414,21cyclictest0-21swapper/1122:57:573
771131995414,20cyclictest0-21swapper/1121:30:123
771131995414,20cyclictest0-21swapper/1120:36:093
771131995413,41cyclictest0-21swapper/1120:47:593
771131995413,21cyclictest0-21swapper/1121:36:043
771131995413,21cyclictest0-21swapper/1120:55:233
771131995413,21cyclictest0-21swapper/1120:41:153
771131995413,21cyclictest0-21swapper/1120:01:103
771131995413,21cyclictest0-21swapper/1119:49:073
771131995412,42cyclictest0-21swapper/1119:26:143
771133995211,21cyclictest0-21swapper/1320:45:225
77113399519,21cyclictest0-21swapper/1321:50:335
771133995110,21cyclictest0-21swapper/1323:32:165
771133995110,21cyclictest0-21swapper/1323:32:165
77113399509,21cyclictest0-21swapper/1322:30:255
77113399508,21cyclictest0-21swapper/1320:55:215
77113399508,21cyclictest0-21swapper/1319:10:595
771133995012,18cyclictest0-21swapper/1300:30:335
77113399498,41cyclictest0-21swapper/1323:16:535
77113399498,21cyclictest0-21swapper/1322:20:255
77113399497,21cyclictest0-21swapper/1321:10:145
77113399487,21cyclictest0-21swapper/1323:25:295
77113399487,21cyclictest0-21swapper/1320:20:255
77113399487,21cyclictest0-21swapper/1319:40:175
77113399487,20cyclictest0-21swapper/1322:15:055
77113399486,42cyclictest0-21swapper/1300:16:495
77113399486,21cyclictest0-21swapper/1323:50:205
77113399485,23cyclictest0-21swapper/1319:54:375
77113399485,23cyclictest0-21swapper/1319:54:375
771127994818,9cyclictest0-21swapper/700:17:2413
77113399477,20cyclictest0-21swapper/1322:51:485
77113399477,20cyclictest0-21swapper/1322:51:475
77113399477,20cyclictest0-21swapper/1320:40:185
77113399476,21cyclictest0-21swapper/1321:42:375
77113399476,21cyclictest0-21swapper/1320:25:135
77113399476,21cyclictest0-21swapper/1300:35:235
77113399476,20cyclictest0-21swapper/1321:24:435
77113399475,21cyclictest0-21swapper/1322:43:155
771127994717,10cyclictest0-21swapper/700:29:5113
77113399465,21cyclictest0-21swapper/1323:45:145
77113399465,21cyclictest0-21swapper/1320:19:345
77113399465,21cyclictest0-21swapper/1319:37:345
77113399465,21cyclictest0-21swapper/1319:28:475
77113399465,21cyclictest0-21swapper/1319:17:575
77113399454,41cyclictest0-21swapper/1320:32:095
77113399454,41cyclictest0-21swapper/1300:00:145
77113399454,21cyclictest0-21swapper/1322:00:255
77113399454,21cyclictest0-21swapper/1321:16:335
77113399454,21cyclictest0-21swapper/1319:20:205
77113399453,42cyclictest0-21swapper/1321:49:085
77113399453,42cyclictest0-21swapper/1300:29:525
77113399443,41cyclictest0-21swapper/1323:05:305
77113399443,41cyclictest0-21swapper/1321:30:415
77113399443,21cyclictest0-21swapper/1323:04:455
77113399443,21cyclictest0-21swapper/1320:00:195
77113399442,42cyclictest0-21swapper/1321:07:185
77113399442,41cyclictest0-21swapper/1322:35:255
77113399442,21cyclictest0-21swapper/1322:45:135
77113399442,21cyclictest0-21swapper/1322:08:005
77113399432,41cyclictest0-21swapper/1323:40:205
77113399432,41cyclictest0-21swapper/1320:35:015
77113399432,41cyclictest0-21swapper/1320:06:355
77113399432,41cyclictest0-21swapper/1300:13:375
77113399432,21cyclictest0-21swapper/1322:26:365
77113399432,21cyclictest0-21swapper/1321:55:195
77113399432,21cyclictest0-21swapper/1321:39:475
77113399432,21cyclictest0-21swapper/1300:20:125
77113399431,42cyclictest0-21swapper/1323:37:425
77113399431,42cyclictest0-21swapper/1323:37:425
77113399431,42cyclictest0-21swapper/1321:25:145
77113399431,42cyclictest0-21swapper/1321:02:435
77113399431,42cyclictest0-21swapper/1320:52:595
77113399431,21cyclictest0-21swapper/1322:13:555
77113399431,21cyclictest0-21swapper/1300:05:125
77113499424,13cyclictest0-21swapper/1422:06:146
77113399421,41cyclictest0-21swapper/1323:56:115
77113399421,41cyclictest0-21swapper/1323:56:115
77113399421,41cyclictest0-21swapper/1323:23:195
77113399421,41cyclictest0-21swapper/1322:55:515
77113399421,41cyclictest0-21swapper/1319:55:125
77113399421,21cyclictest0-21swapper/1319:45:115
77113399421,21cyclictest0-21swapper/1319:33:375
77113499413,13cyclictest0-21swapper/1423:01:096
771134993939,0cyclictest0-21swapper/1419:44:016
77113399390,0cyclictest0-21swapper/1320:10:355
77113199390,39cyclictest0-21swapper/1119:55:413
77112799393,10cyclictest0-21swapper/722:01:3613
77113199380,17cyclictest0-21swapper/1120:10:173
8336702370,0sleep151211rcuc/1520:40:227
77113499371,11cyclictest0-21swapper/1421:44:156
77113499370,24cyclictest0-21swapper/1421:00:196
77112799377,9cyclictest0-21swapper/719:15:1213
77112799376,10cyclictest0-21swapper/720:33:0313
77113499360,23cyclictest0-21swapper/1422:50:106
77113499360,23cyclictest0-21swapper/1422:50:096
77113199360,36cyclictest0-21swapper/1120:23:143
77112799366,10cyclictest0-21swapper/721:28:1013
771127993615,21cyclictest0-21swapper/723:52:5113
9593632350,0sleep00-21swapper/023:15:130
9287352340,1sleep2928733-21awk22:40:018
8195452340,0sleep30-21swapper/320:25:149
771127993313,20cyclictest0-21swapper/720:26:3713
771127993312,21cyclictest0-21swapper/722:26:5013
771123993321,12cyclictest735915-21kworker/3:019:51:439
771123993321,12cyclictest735915-21kworker/3:019:51:439
771123993120,11cyclictest735915-21kworker/3:019:41:519
10227852310,0sleep30-21swapper/300:30:009
9804192300,0sleep120-21swapper/1223:40:144
77112799309,11cyclictest0-21swapper/720:36:1313
77112799290,19cyclictest0-21swapper/722:43:0913
77112799280,18cyclictest0-21swapper/721:12:5113
77113499273,13cyclictest0-21swapper/1423:12:076
77113499273,13cyclictest0-21swapper/1420:38:216
77113499273,13cyclictest0-21swapper/1400:18:026
77113499273,13cyclictest0-21swapper/1400:07:026
77113099272,25cyclictest87-21ksoftirqd/1019:20:172
77113099271,26cyclictest87-21ksoftirqd/1023:35:392
77113099271,26cyclictest87-21ksoftirqd/1023:35:392
77112799276,21cyclictest0-21swapper/721:55:5313
77112799276,21cyclictest0-21swapper/700:20:3613
771127992717,10cyclictest0-21swapper/719:30:0513
8401732260,0sleep40-21swapper/420:50:0510
771127992616,10cyclictest0-21swapper/721:37:0313
771125992616,10cyclictest906779-21kworker/5:022:43:0911
8289342250,0sleep10-21swapper/120:35:211
77113499250,25cyclictest0-21swapper/1420:27:226
77113099250,25cyclictest87-21ksoftirqd/1019:18:032
77113099250,25cyclictest651412-21kworker/10:021:27:272
77113099250,25cyclictest651412-21kworker/10:020:25:542
77113099250,25cyclictest0-21swapper/1023:44:112
77113099250,25cyclictest0-21swapper/1021:41:412
77113099250,25cyclictest0-21swapper/1000:30:302
77113099250,25cyclictest0-21swapper/1000:06:092
77112799254,21cyclictest0-21swapper/722:17:3313
771127992515,10cyclictest0-21swapper/721:33:5113
77113099240,24cyclictest651412-21kworker/10:020:56:202
77113099240,24cyclictest0-21swapper/1023:29:222
77113099240,24cyclictest0-21swapper/1023:01:532
77113099240,24cyclictest0-21swapper/1019:14:132
77113099240,24cyclictest0-21swapper/1000:25:432
77112799244,20cyclictest0-21swapper/723:07:4213
771127992415,9cyclictest0-21swapper/719:43:1513
77113499239,14cyclictest0-21swapper/1420:16:246
77113099230,23cyclictest0-21swapper/1022:21:532
77113099230,23cyclictest0-21swapper/1020:19:152
77113099230,23cyclictest0-21swapper/1019:27:162
77112799232,11cyclictest0-21swapper/720:12:4713
771127992313,10cyclictest0-21swapper/723:34:4413
771127992313,10cyclictest0-21swapper/723:34:4413
771127992313,10cyclictest0-21swapper/700:13:5113
771123992322,1cyclictest735915-21kworker/3:021:24:159
77111599230,23cyclictest798340-21kworker/1:120:23:491
77113099220,22cyclictest0-21swapper/1020:40:372
77112799221,21cyclictest0-21swapper/721:51:5713
771127992212,10cyclictest0-21swapper/720:03:0913
771125992222,0cyclictest906779-21kworker/5:023:40:4711
771125992221,1cyclictest847304-21kworker/5:121:48:4511
771125992210,12cyclictest0-21swapper/519:31:0111
771123992221,1cyclictest735915-21kworker/3:020:50:499
77113299210,18cyclictest0-21swapper/1219:42:404
77113099210,21cyclictest0-21swapper/1021:23:202
771129992121,0cyclictest0-21swapper/900:01:0515
77112999210,21cyclictest0-21swapper/923:37:3815
77112999210,21cyclictest0-21swapper/923:37:3715
77112999210,21cyclictest0-21swapper/923:06:2515
77112999210,21cyclictest0-21swapper/922:45:3615
77112999210,21cyclictest0-21swapper/921:24:0415
77112999210,21cyclictest0-21swapper/921:16:2115
77112999210,21cyclictest0-21swapper/920:37:4215
77112999210,21cyclictest0-21swapper/919:28:0115
77112999210,21cyclictest0-21swapper/900:06:0915
77112899210,21cyclictest0-21swapper/823:37:3814
77112899210,21cyclictest0-21swapper/823:37:3714
77112899210,21cyclictest0-21swapper/823:11:5314
77112899210,21cyclictest0-21swapper/822:51:4514
77112899210,21cyclictest0-21swapper/822:51:4514
77112899210,21cyclictest0-21swapper/822:27:2314
77112899210,21cyclictest0-21swapper/822:17:1914
77112899210,21cyclictest0-21swapper/821:16:2114
77112899210,21cyclictest0-21swapper/820:37:4214
77112899210,21cyclictest0-21swapper/819:28:0114
77112899210,21cyclictest0-21swapper/800:06:0914
77112899210,18cyclictest0-21swapper/822:57:0114
771127992110,11cyclictest0-21swapper/723:38:4013
771127992110,11cyclictest0-21swapper/723:38:4013
77112799210,21cyclictest0-21swapper/722:35:1213
77112799210,21cyclictest0-21swapper/720:05:5313
77112699210,21cyclictest0-21swapper/623:37:3812
77112699210,21cyclictest0-21swapper/623:37:3712
77112699210,21cyclictest0-21swapper/621:16:2112
77112699210,21cyclictest0-21swapper/620:37:4112
77112699210,21cyclictest0-21swapper/600:33:3112
77112699210,21cyclictest0-21swapper/600:06:1012
771125992121,0cyclictest906779-21kworker/5:023:55:4711
771125992121,0cyclictest906779-21kworker/5:023:55:4711
771125992121,0cyclictest906779-21kworker/5:023:50:1111
771125992121,0cyclictest906779-21kworker/5:023:45:3711
771125992121,0cyclictest906779-21kworker/5:023:35:2611
771125992121,0cyclictest906779-21kworker/5:023:35:2511
771125992121,0cyclictest906779-21kworker/5:023:32:0411
771125992121,0cyclictest906779-21kworker/5:023:32:0311
771125992121,0cyclictest906779-21kworker/5:023:26:0611
771125992121,0cyclictest906779-21kworker/5:023:20:5011
771125992121,0cyclictest906779-21kworker/5:023:15:1511
771125992121,0cyclictest906779-21kworker/5:023:10:2711
771125992121,0cyclictest906779-21kworker/5:023:05:2011
771125992121,0cyclictest906779-21kworker/5:023:00:0111
771125992121,0cyclictest906779-21kworker/5:022:55:3511
771125992121,0cyclictest906779-21kworker/5:022:50:3011
771125992121,0cyclictest906779-21kworker/5:022:50:2911
771125992121,0cyclictest906779-21kworker/5:022:46:0111
771125992121,0cyclictest906779-21kworker/5:022:36:2711
771125992121,0cyclictest906779-21kworker/5:022:30:0411
771125992121,0cyclictest906779-21kworker/5:022:25:1011
771125992121,0cyclictest906779-21kworker/5:022:20:1911
771125992121,0cyclictest906779-21kworker/5:022:15:0711
771125992121,0cyclictest906779-21kworker/5:000:35:2911
771125992121,0cyclictest906779-21kworker/5:000:30:4311
771125992121,0cyclictest906779-21kworker/5:000:25:3611
771125992121,0cyclictest906779-21kworker/5:000:20:2311
771125992121,0cyclictest906779-21kworker/5:000:15:0711
771125992121,0cyclictest906779-21kworker/5:000:10:1611
771125992121,0cyclictest906779-21kworker/5:000:05:2811
771125992121,0cyclictest906779-21kworker/5:000:00:0911
771125992121,0cyclictest898447-21kworker/5:122:10:0611
771125992121,0cyclictest898447-21kworker/5:122:05:1011
771125992121,0cyclictest889743-21kworker/5:022:00:0711
771125992121,0cyclictest889743-21kworker/5:021:56:0311
771125992121,0cyclictest847304-21kworker/5:121:50:0811
771125992121,0cyclictest847304-21kworker/5:121:40:0911
771125992121,0cyclictest847304-21kworker/5:121:36:3311
771125992121,0cyclictest847304-21kworker/5:121:30:2011
771125992121,0cyclictest847304-21kworker/5:121:25:1111
771125992121,0cyclictest847304-21kworker/5:121:20:1711
771125992121,0cyclictest847304-21kworker/5:121:15:3911
771125992121,0cyclictest847304-21kworker/5:121:10:0411
771125992121,0cyclictest847304-21kworker/5:121:05:0911
771125992121,0cyclictest847304-21kworker/5:121:00:3911
771125992121,0cyclictest782894-21kworker/5:020:55:2911
771125992121,0cyclictest782894-21kworker/5:020:50:3611
771125992121,0cyclictest782894-21kworker/5:020:45:2211
771125992121,0cyclictest782894-21kworker/5:020:40:0711
771125992121,0cyclictest782894-21kworker/5:020:35:0911
771125992121,0cyclictest782894-21kworker/5:020:30:3511
771125992121,0cyclictest782894-21kworker/5:020:25:5311
771125992121,0cyclictest782894-21kworker/5:020:20:1411
771125992121,0cyclictest782894-21kworker/5:020:19:0911
771125992121,0cyclictest782894-21kworker/5:020:10:4511
771125992121,0cyclictest782894-21kworker/5:020:05:1711
771125992121,0cyclictest782894-21kworker/5:020:00:2411
771125992121,0cyclictest782894-21kworker/5:019:55:3011
771125992121,0cyclictest782894-21kworker/5:019:50:0711
771125992121,0cyclictest782894-21kworker/5:019:50:0711
771125992121,0cyclictest782894-21kworker/5:019:45:0111
771125992121,0cyclictest782894-21kworker/5:019:40:4611
771125992121,0cyclictest782894-21kworker/5:019:35:0111
771125992121,0cyclictest782894-21kworker/5:019:25:5911
771125992121,0cyclictest764381-21kworker/5:119:20:4811
771125992121,0cyclictest764381-21kworker/5:119:16:1711
771125992121,0cyclictest764381-21kworker/5:119:10:4911
771123992121,0cyclictest735915-21kworker/3:023:55:049
771123992121,0cyclictest735915-21kworker/3:023:55:039
771123992121,0cyclictest735915-21kworker/3:023:50:119
771123992121,0cyclictest735915-21kworker/3:023:45:379
771123992121,0cyclictest735915-21kworker/3:023:41:459
771123992121,0cyclictest735915-21kworker/3:023:35:039
771123992121,0cyclictest735915-21kworker/3:023:35:039
771123992121,0cyclictest735915-21kworker/3:023:31:079
771123992121,0cyclictest735915-21kworker/3:023:31:079
771123992121,0cyclictest735915-21kworker/3:023:25:089
771123992121,0cyclictest735915-21kworker/3:023:20:169
771123992121,0cyclictest735915-21kworker/3:023:15:169
771123992121,0cyclictest735915-21kworker/3:023:10:289
771123992121,0cyclictest735915-21kworker/3:023:05:199
771123992121,0cyclictest735915-21kworker/3:023:00:399
771123992121,0cyclictest735915-21kworker/3:022:55:109
771123992121,0cyclictest735915-21kworker/3:022:52:269
771123992121,0cyclictest735915-21kworker/3:022:52:259
771123992121,0cyclictest735915-21kworker/3:022:45:439
771123992121,0cyclictest735915-21kworker/3:022:40:219
771123992121,0cyclictest735915-21kworker/3:022:36:289
771123992121,0cyclictest735915-21kworker/3:022:30:229
771123992121,0cyclictest735915-21kworker/3:022:25:279
771123992121,0cyclictest735915-21kworker/3:022:20:559
771123992121,0cyclictest735915-21kworker/3:022:15:149
771123992121,0cyclictest735915-21kworker/3:022:10:039
771123992121,0cyclictest735915-21kworker/3:022:05:099
771123992121,0cyclictest735915-21kworker/3:022:00:079
771123992121,0cyclictest735915-21kworker/3:021:55:149
771123992121,0cyclictest735915-21kworker/3:021:50:079
771123992121,0cyclictest735915-21kworker/3:021:45:319
771123992121,0cyclictest735915-21kworker/3:021:40:519
771123992121,0cyclictest735915-21kworker/3:021:36:349
771123992121,0cyclictest735915-21kworker/3:021:25:119
771123992121,0cyclictest735915-21kworker/3:021:15:409
771123992121,0cyclictest735915-21kworker/3:021:11:259
771123992121,0cyclictest735915-21kworker/3:021:05:499
771123992121,0cyclictest735915-21kworker/3:021:02:599
771123992121,0cyclictest735915-21kworker/3:020:55:309
771123992121,0cyclictest735915-21kworker/3:020:45:219
771123992121,0cyclictest735915-21kworker/3:020:40:079
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional