You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-09 - 01:21

x86 Intel Core i7-3770K @3500 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #0, slot #5
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot5.osadl.org (updated Tue Aug 09, 2022 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22898542390371,10sleep100-21swapper/1019:09:332
22895102360341,10sleep40-21swapper/419:07:1910
22897462338332,3sleep00-21swapper/019:08:510
22896632320298,4sleep150-21swapper/1519:08:187
22898082312294,10sleep90-21swapper/919:09:1615
22898042310291,10sleep60-21swapper/619:09:1312
22897922304295,5sleep10-21swapper/119:09:081
22891632303284,10sleep130-21swapper/1319:05:035
22893602302284,10sleep110-21swapper/1119:06:223
22895472301283,10sleep30-21swapper/319:07:349
22892812291274,10sleep120-21swapper/1219:05:504
22893082284248,10sleep50-21swapper/519:06:0011
22892552275255,11sleep20-21swapper/219:05:408
22896422273254,10sleep70-21swapper/719:08:1013
22884252132130,1sleep80-21swapper/819:04:5814
228965728783,1sleep140-21swapper/1419:08:176
25704802350,0sleep50-21swapper/523:29:2811
2290197992711,0cyclictest0-21swapper/1419:43:296
229016699250,25cyclictest0-21swapper/720:13:0913
229015099250,15cyclictest0-21swapper/321:35:499
229020199240,14cyclictest0-21swapper/1519:26:477
229014699240,14cyclictest0-21swapper/220:13:368
229020199230,13cyclictest0-21swapper/1522:23:047
229016699230,9cyclictest0-21swapper/719:29:1313
229016699230,13cyclictest0-21swapper/721:12:3513
229016699230,10cyclictest0-21swapper/700:14:4713
229016699230,10cyclictest0-21swapper/700:14:4713
229015899232,13cyclictest0-21swapper/523:46:4811
229019399220,12cyclictest0-21swapper/1319:13:045
229018199220,12cyclictest0-21swapper/1000:22:162
229018199220,12cyclictest0-21swapper/1000:22:162
2290166992213,6cyclictest305950-21CPU13
2290166992210,4cyclictest0-21swapper/719:17:5413
229016699220,16cyclictest378920pipewire-pulse22:04:2113
229013999220,12cyclictest0-21swapper/023:11:040
2290193992111,10cyclictest0-21swapper/1300:14:575
2290193992111,10cyclictest0-21swapper/1300:14:575
2290190992111,10cyclictest0-21swapper/1223:51:474
229018199210,11cyclictest0-21swapper/1020:05:042
2290166992115,3cyclictest2626530-21ssh00:12:5113
2290166992115,3cyclictest2626530-21ssh00:12:5113
2290166992115,3cyclictest2562164-21ssh23:21:0113
2290166992110,8cyclictest1154048-21nautilus19:45:4213
2290158992111,10cyclictest0-21swapper/520:27:1011
2290155992111,10cyclictest0-21swapper/422:45:0410
378820200,15pipewire67-21ksoftirqd/722:53:0513
2290193992010,10cyclictest0-21swapper/1322:00:545
2290193992010,10cyclictest0-21swapper/1321:55:345
2290190992010,10cyclictest0-21swapper/1222:38:554
2290190992010,10cyclictest0-21swapper/1200:03:494
2290181992010,10cyclictest0-21swapper/1022:35:302
2290181992010,10cyclictest0-21swapper/1000:08:572
2290181992010,10cyclictest0-21swapper/1000:08:572
2290166992014,3cyclictest305951-21CPU13
229016699200,15cyclictest0-21swapper/723:51:5713
2290158992010,10cyclictest0-21swapper/523:23:0511
2290158992010,10cyclictest0-21swapper/519:39:1911
2290158992010,0cyclictest0-21swapper/520:23:4911
2290155992010,10cyclictest0-21swapper/420:05:0010
2290150992010,10cyclictest0-21swapper/320:08:359
2290144992010,10cyclictest0-21swapper/123:11:521
229020199199,10cyclictest0-21swapper/1522:57:437
229020199199,10cyclictest0-21swapper/1500:06:567
229020199199,10cyclictest0-21swapper/1500:06:567
229019099199,10cyclictest0-21swapper/1222:06:044
229019099199,10cyclictest0-21swapper/1220:50:514
2290166991914,3cyclictest305950-21CPU13
2290166991913,3cyclictest4795-21thunderbird20:20:4213
2290166991913,3cyclictest305953-21CPU13
229016699190,18cyclictest305952-21CPU13
229016699190,18cyclictest305952-21CPU13
229016699190,18cyclictest1776317-21Isolated08:47:0313
229015899199,10cyclictest4923-21Renderer23:43:5811
229015899199,10cyclictest0-21swapper/500:09:0711
229015899199,10cyclictest0-21swapper/500:09:0711
229015899199,0cyclictest0-21swapper/521:22:4911
229015099190,16cyclictest0-21swapper/321:06:449
229014699199,10cyclictest0-21swapper/223:31:058
229014699199,10cyclictest0-21swapper/223:27:318
229014499199,10cyclictest0-21swapper/121:27:191
229014499190,9cyclictest0-21swapper/123:05:351
137099190,1ntpd95-21ksoftirqd/1120:23:133
137099190,1ntpd39-21ksoftirqd/320:40:389
229019399188,10cyclictest0-21swapper/1322:44:345
229019399188,10cyclictest0-21swapper/1320:42:075
229019399188,10cyclictest0-21swapper/1320:11:045
229018699188,10cyclictest0-21swapper/1123:42:193
229018699188,10cyclictest0-21swapper/1123:19:493
229018199188,10cyclictest0-21swapper/1023:47:052
2290166991812,3cyclictest3943-21gsd-housekeepin20:05:5013
2290166991812,3cyclictest0-21swapper/721:25:0413
2290166991812,3cyclictest0-21swapper/720:29:5813
2290166991812,3cyclictest0-21swapper/700:36:5513
2290166991812,0cyclictest0-21swapper/723:15:4913
2290166991810,1cyclictest1432-21snmpd21:43:1213
229016699180,18cyclictest0-21swapper/723:44:4913
229016699180,16cyclictest2574554-21ssh23:30:3113
229016699180,15cyclictest0-21swapper/719:11:1813
229016699180,15cyclictest0-21swapper/700:05:4713
229016699180,15cyclictest0-21swapper/700:05:4713
229015899188,10cyclictest0-21swapper/520:39:3811
229015899180,18cyclictest0-21swapper/519:30:0211
229015099180,15cyclictest0-21swapper/321:34:309
229014699188,10cyclictest0-21swapper/220:25:088
229014499188,10cyclictest0-21swapper/123:23:341
137099180,1ntpd95-21ksoftirqd/1123:53:413
137099180,1ntpd95-21ksoftirqd/1119:48:053
229020199177,10cyclictest0-21swapper/1523:04:047
2290201991716,1cyclictest2118264-21kworker/15:019:34:067
2290201991716,1cyclictest1432-21snmpd23:54:407
2290201991716,1cyclictest1432-21snmpd20:58:377
229020199170,17cyclictest0-21swapper/1520:31:167
229020199170,14cyclictest0-21swapper/1521:00:477
229020199170,0cyclictest0-21swapper/1522:01:377
229019399170,1cyclictest2648735-21fw_forwarded_lo00:29:535
229019099170,14cyclictest0-21swapper/1219:50:144
229018699177,10cyclictest0-21swapper/1121:43:283
229018199177,10cyclictest0-21swapper/1023:10:042
2290177991716,1cyclictest1432-21snmpd21:26:5615
229016699177,6cyclictest378820pipewire20:45:3613
2290166991712,5cyclictest0-21swapper/722:17:4913
2290166991712,3cyclictest0-21swapper/722:57:4113
2290166991712,3cyclictest0-21swapper/721:44:5113
2290166991712,3cyclictest0-21swapper/720:43:4013
2290166991712,3cyclictest0-21swapper/719:54:4613
2290166991712,2cyclictest0-21swapper/700:26:2113
229016699170,15cyclictest0-21swapper/720:52:0613
229016699170,14cyclictest0-21swapper/723:40:0513
229016699170,14cyclictest0-21swapper/723:27:4313
229016699170,14cyclictest0-21swapper/700:30:3713
2290163991716,1cyclictest1432-21snmpd22:45:1412
229015899177,10cyclictest0-21swapper/520:05:0911
2290158991716,1cyclictest1432-21snmpd21:10:3511
229015599177,10cyclictest0-21swapper/420:49:0110
229015599177,10cyclictest0-21swapper/420:31:1010
229015599177,10cyclictest0-21swapper/400:23:3310
229015599177,10cyclictest0-21swapper/400:23:3310
2290155991715,2cyclictest1432-21snmpd23:01:1410
229015599170,0cyclictest0-21swapper/422:09:3110
229015099177,10cyclictest4923-21Renderer22:59:309
229014699177,10cyclictest0-21swapper/220:33:278
229014699170,14cyclictest0-21swapper/223:09:158
229014699170,14cyclictest0-21swapper/221:54:488
229014699170,14cyclictest0-21swapper/220:45:438
229014499170,14cyclictest0-21swapper/100:32:171
229013999170,14cyclictest0-21swapper/022:12:130
2290201991616,0cyclictest2583318-21kworker/15:100:18:437
2290201991616,0cyclictest2583318-21kworker/15:100:18:437
2290201991616,0cyclictest2555443-21kworker/15:023:40:437
2290201991616,0cyclictest2118264-21kworker/15:022:32:137
2290201991616,0cyclictest2118264-21kworker/15:020:37:007
2290201991616,0cyclictest2118264-21kworker/15:020:20:107
2290201991616,0cyclictest2118264-21kworker/15:019:53:087
2290201991616,0cyclictest2118264-21kworker/15:019:46:347
2290201991616,0cyclictest2118264-21kworker/15:019:36:407
2290201991615,1cyclictest2118264-21kworker/15:019:44:227
2290201991615,1cyclictest1432-21snmpd22:51:477
2290201991615,1cyclictest1432-21snmpd20:53:167
2290201991614,2cyclictest1432-21snmpd21:44:487
2290201991614,2cyclictest1432-21snmpd20:08:577
2290197991615,1cyclictest1432-21snmpd21:17:086
229019799160,16cyclictest0-21swapper/1423:32:126
229019799160,16cyclictest0-21swapper/1422:50:346
229019799160,16cyclictest0-21swapper/1422:08:366
229019799160,16cyclictest0-21swapper/1421:45:536
229019799160,16cyclictest0-21swapper/1420:30:056
229019799160,16cyclictest0-21swapper/1419:51:036
229019799160,16cyclictest0-21swapper/1400:32:246
229019799160,16cyclictest0-21swapper/1400:27:086
229019799160,16cyclictest0-21swapper/1400:10:486
229019799160,16cyclictest0-21swapper/1400:10:486
229019799160,13cyclictest0-21swapper/1423:15:126
229019799160,13cyclictest0-21swapper/1400:18:426
229019799160,13cyclictest0-21swapper/1400:18:426
229019799160,0cyclictest0-21swapper/1423:48:046
229019799160,0cyclictest0-21swapper/1422:32:346
229019799160,0cyclictest0-21swapper/1422:18:506
229019799160,0cyclictest0-21swapper/1422:10:366
229019799160,0cyclictest0-21swapper/1421:53:006
229019799160,0cyclictest0-21swapper/1421:24:576
229019799160,0cyclictest0-21swapper/1421:20:316
229019799160,0cyclictest0-21swapper/1421:04:116
229019799160,0cyclictest0-21swapper/1420:52:196
229019799160,0cyclictest0-21swapper/1420:46:216
229019799160,0cyclictest0-21swapper/1420:35:536
229019799160,0cyclictest0-21swapper/1420:22:256
229019799160,0cyclictest0-21swapper/1420:06:236
229019799160,0cyclictest0-21swapper/1419:55:596
229019799160,0cyclictest0-21swapper/1419:14:496
2290193991614,2cyclictest1432-21snmpd21:12:055
2290193991610,3cyclictest0-21swapper/1300:25:535
229019399160,16cyclictest0-21swapper/1319:24:195
229019399160,0cyclictest0-21swapper/1319:25:255
229019099166,10cyclictest0-21swapper/1220:39:344
2290190991614,1cyclictest26329881kworker/u32:300:35:574
229019099160,16cyclictest0-21swapper/1221:34:184
229019099160,16cyclictest0-21swapper/1220:12:514
229019099160,0cyclictest0-21swapper/1221:57:094
229019099160,0cyclictest0-21swapper/1200:23:354
229019099160,0cyclictest0-21swapper/1200:23:354
2290186991616,0cyclictest1432-21snmpd20:37:463
229018699160,16cyclictest0-21swapper/1100:02:373
229018199166,10cyclictest0-21swapper/1022:29:152
2290181991616,0cyclictest1432-21snmpd23:09:272
2290181991615,1cyclictest23201001kworker/u32:120:19:192
2290181991614,2cyclictest1432-21snmpd22:05:432
2290181991614,2cyclictest1432-21snmpd21:30:122
2290181991614,2cyclictest1432-21snmpd19:44:562
2290181991614,1cyclictest1180-21lldpd21:46:572
229017799166,10cyclictest0-21swapper/923:07:1915
2290177991616,0cyclictest1432-21snmpd20:02:1515
2290177991615,1cyclictest1432-21snmpd22:27:1315
2290177991615,1cyclictest1432-21snmpd21:32:4515
2290177991614,2cyclictest1432-21snmpd00:19:4715
2290177991614,2cyclictest1432-21snmpd00:19:4715
229017799160,16cyclictest0-21swapper/919:38:2315
229017799160,16cyclictest0-21swapper/919:11:4915
229016999166,10cyclictest0-21swapper/819:13:2414
2290169991616,0cyclictest1432-21snmpd22:57:5614
2290169991615,1cyclictest1432-21snmpd23:29:1214
2290169991615,1cyclictest1432-21snmpd22:33:3514
2290169991614,2cyclictest1432-21snmpd20:31:5514
229016999160,15cyclictest0-21swapper/819:33:1014
2290166991614,2cyclictest23121191kworker/u32:020:03:2613
2290166991614,2cyclictest0-21swapper/722:32:2713
2290166991611,3cyclictest0-21swapper/722:49:1113
2290166991611,3cyclictest0-21swapper/721:55:5513
2290166991611,3cyclictest0-21swapper/721:15:0413
2290166991611,3cyclictest0-21swapper/700:00:3913
2290166991611,2cyclictest2446484-21ssh21:49:5313
2290166991611,2cyclictest0-21swapper/722:06:4313
2290166991610,3cyclictest0-21swapper/721:37:5813
2290166991610,3cyclictest0-21swapper/721:04:5613
229016699160,1cyclictest2310702-21pmu-power19:29:5813
229016699160,16cyclictest0-21swapper/721:24:1413
229016699160,14cyclictest0-21swapper/723:13:1713
229016699160,14cyclictest0-21swapper/722:24:5313
229016699160,14cyclictest0-21swapper/720:39:2613
229016699160,13cyclictest0-21swapper/722:44:0713
229016699160,0cyclictest0-21swapper/720:55:3113
2290163991616,0cyclictest0-21swapper/621:10:5612
2290163991615,1cyclictest23077031kworker/u32:319:39:0812
2290163991615,1cyclictest1432-21snmpd22:32:0412
2290163991615,1cyclictest1432-21snmpd21:25:3512
2290163991614,2cyclictest1432-21snmpd22:26:2212
229016399160,16cyclictest0-21swapper/623:52:2212
229016399160,0cyclictest0-21swapper/623:43:4612
229016399160,0cyclictest0-21swapper/622:19:1312
229016399160,0cyclictest0-21swapper/600:15:5012
229016399160,0cyclictest0-21swapper/600:15:5012
229015899167,9cyclictest0-21swapper/519:55:0411
229015899166,10cyclictest0-21swapper/522:58:5411
229015899166,10cyclictest0-21swapper/521:36:5211
229015899166,10cyclictest0-21swapper/521:15:1911
229015899166,10cyclictest0-21swapper/520:35:0411
229015899163,8cyclictest1144610-21IPC11
2290158991616,0cyclictest1432-21snmpd23:06:4511
229015599166,10cyclictest0-21swapper/420:18:4110
2290155991616,0cyclictest1432-21snmpd21:41:2410
2290155991615,1cyclictest23844141kworker/u32:321:18:5210
2290155991614,2cyclictest1432-21snmpd21:55:1510
2290155991614,2cyclictest1432-21snmpd21:49:3310
2290155991614,2cyclictest1432-21snmpd21:33:3910
229015599160,16cyclictest0-21swapper/421:07:5910
229015599160,13cyclictest0-21swapper/421:21:1110
229015599160,0cyclictest0-21swapper/423:16:0310
229015099167,0cyclictest0-21swapper/323:37:589
229015099162,7cyclictest0-21swapper/320:31:489
2290150991615,1cyclictest1432-21snmpd23:42:379
2290150991615,1cyclictest1432-21snmpd19:16:409
2290150991614,1cyclictest23484391kworker/u32:220:58:449
229015099160,16cyclictest0-21swapper/321:46:099
229015099160,16cyclictest0-21swapper/321:26:269
229015099160,16cyclictest0-21swapper/320:37:439
229015099160,13cyclictest0-21swapper/322:09:289
229014699166,10cyclictest0-21swapper/222:19:358
2290146991615,1cyclictest1432-21snmpd00:21:538
2290146991615,1cyclictest1432-21snmpd00:21:538
2290146991614,2cyclictest1432-21snmpd23:46:558
2290146991613,3cyclictest1432-21snmpd19:39:418
229014699160,0cyclictest0-21swapper/223:12:458
229014499160,16cyclictest0-21swapper/121:06:141
229014499160,13cyclictest0-21swapper/100:08:551
229014499160,13cyclictest0-21swapper/100:08:551
229014499160,0cyclictest0-21swapper/100:19:021
229014499160,0cyclictest0-21swapper/100:19:021
2290139991616,0cyclictest1432-21snmpd20:55:400
2290139991614,1cyclictest1180-21lldpd22:06:570
229013999160,16cyclictest0-21swapper/021:25:440
229013999160,14cyclictest0-21swapper/020:00:300
229013999160,13cyclictest0-21swapper/022:31:310
378820150,1pipewire95-21ksoftirqd/1122:00:453
2290201991515,0cyclictest2583318-21kworker/15:123:44:397
2290201991515,0cyclictest2583318-21kworker/15:100:35:157
2290201991515,0cyclictest2583318-21kworker/15:100:12:097
2290201991515,0cyclictest2583318-21kworker/15:100:12:097
2290201991515,0cyclictest2542596-21kworker/15:223:20:037
2290201991515,0cyclictest2542596-21kworker/15:223:10:417
2290201991515,0cyclictest2542596-21kworker/15:223:06:037
2290201991515,0cyclictest2118264-21kworker/15:022:26:177
2290201991515,0cyclictest2118264-21kworker/15:021:55:037
2290201991515,0cyclictest2118264-21kworker/15:021:50:257
2290201991515,0cyclictest2118264-21kworker/15:021:40:097
2290201991515,0cyclictest2118264-21kworker/15:021:21:307
2290201991515,0cyclictest2118264-21kworker/15:021:17:527
2290201991515,0cyclictest2118264-21kworker/15:021:11:067
2290201991515,0cyclictest2118264-21kworker/15:021:09:367
2290201991515,0cyclictest2118264-21kworker/15:020:16:527
2290201991515,0cyclictest2118264-21kworker/15:020:12:207
2290201991515,0cyclictest2118264-21kworker/15:019:15:567
2290201991515,0cyclictest2118264-21kworker/15:019:12:007
2290201991514,1cyclictest2118264-21kworker/15:022:11:037
2290201991510,2cyclictest0-21swapper/1523:36:437
229020199150,15cyclictest0-21swapper/1521:36:357
229020199150,15cyclictest0-21swapper/1500:24:567
2290197991515,0cyclictest1432-21snmpd21:09:596
2290197991514,1cyclictest1432-21snmpd23:43:466
229019799150,13cyclictest0-21swapper/1422:20:126
229019799150,13cyclictest0-21swapper/1422:02:046
229019799150,13cyclictest0-21swapper/1421:39:566
229019799150,13cyclictest0-21swapper/1419:47:536
229019799150,13cyclictest0-21swapper/1419:21:556
2290193991514,1cyclictest2515792-21cat22:44:535
2290193991514,1cyclictest24810811kworker/u32:222:29:305
2290193991513,2cyclictest1432-21snmpd20:07:095
229019399150,13cyclictest0-21swapper/1319:58:425
229019399150,0cyclictest0-21swapper/1319:39:255
2290190991515,0cyclictest991irq_work/1219:30:494
2290190991515,0cyclictest1432-21snmpd23:58:524
2290190991514,1cyclictest1432-21snmpd21:47:214
2290186991515,0cyclictest1432-21snmpd21:26:173
2290186991515,0cyclictest1432-21snmpd21:20:383
2290186991514,1cyclictest1432-21snmpd22:38:173
2290186991513,2cyclictest1432-21snmpd22:47:173
2290186991513,2cyclictest1432-21snmpd21:30:543
2290186991513,2cyclictest1432-21snmpd00:34:593
2290186991510,2cyclictest0-21swapper/1119:21:343
229018699150,15cyclictest0-21swapper/1123:28:493
229018699150,12cyclictest0-21swapper/1120:44:313
229018699150,0cyclictest0-21swapper/1122:26:103
229018699150,0cyclictest0-21swapper/1120:14:423
229018699150,0cyclictest0-21swapper/1119:26:043
229018199159,3cyclictest0-21swapper/1023:57:012
229018199153,8cyclictest0-21swapper/1019:55:572
2290181991515,0cyclictest1432-21snmpd20:39:012
2290181991514,1cyclictest23502801kworker/u32:420:23:102
2290181991514,1cyclictest1432-21snmpd22:22:222
2290181991513,2cyclictest1432-21snmpd20:44:432
229018199150,15cyclictest0-21swapper/1020:42:432
229018199150,0cyclictest0-21swapper/1000:27:042
2290177991515,0cyclictest1432-21snmpd21:44:3915
2290177991514,1cyclictest25069281kworker/u32:022:42:5415
2290177991514,1cyclictest1432-21snmpd23:55:3415
2290177991514,1cyclictest1432-21snmpd22:34:5915
2290177991513,2cyclictest1432-21snmpd22:13:5815
2290177991513,2cyclictest1432-21snmpd20:18:4515
2290177991513,2cyclictest1432-21snmpd00:33:1715
2290177991513,2cyclictest1432-21snmpd00:07:0415
2290177991513,2cyclictest1432-21snmpd00:07:0415
229017799150,15cyclictest0-21swapper/923:20:1215
229017799150,15cyclictest0-21swapper/921:19:2615
229017799150,0cyclictest0-21swapper/920:56:0115
229016999155,10cyclictest0-21swapper/820:56:4514
2290169991514,1cyclictest23841091kworker/u32:121:34:0414
2290169991514,1cyclictest1432-21snmpd22:05:1914
2290169991513,2cyclictest1432-21snmpd21:53:4814
2290169991513,2cyclictest1432-21snmpd19:47:3814
229016999150,1cyclictest0-21swapper/823:35:2214
229016999150,0cyclictest0-21swapper/820:26:4214
229016699152,6cyclictest0-21swapper/723:36:0013
2290166991512,3cyclictest0-21swapper/721:30:4613
2290166991512,3cyclictest0-21swapper/720:14:4813
229016699150,15cyclictest0-21swapper/722:35:0113
229016699150,15cyclictest0-21swapper/719:44:0613
229016699150,13cyclictest0-21swapper/720:28:1013
229016699150,13cyclictest0-21swapper/719:49:5213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional