You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-22 - 11:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackbslot1.osadl.org (updated Fri Jun 21, 2024 12:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3012282213189,14sleep20-21swapper/207:06:532
3013542205174,22sleep10-21swapper/107:08:331
3012532199171,19sleep00-21swapper/007:07:110
3012392198170,18sleep30-21swapper/307:07:033
301634996562,2cyclictest423866-21kworker/u8:2+events_unbound10:15:062
301630996543,21cyclictest0-21swapper/111:05:021
301634996359,3cyclictest379204-21kworker/u8:4+events_unbound09:45:362
301634996245,4cyclictest432356-21/usr/share/muni09:50:112
30163999616,55cyclictest536863-21kworker/u8:3+efi_rts_wq12:36:093
301639996056,3cyclictest468057-21kworker/u8:2+events_unbound10:45:463
301639996056,3cyclictest456105-21kworker/u8:1+events_unbound11:05:013
301634996054,4cyclictest456105-21kworker/u8:1+flush-179:011:15:152
301639995953,3cyclictest302019-21kworker/u8:2+events_unbound07:17:043
301634995945,13cyclictest387070-21kworker/u8:1+events_unbound08:55:122
301634995945,13cyclictest387070-21kworker/u8:1+events_unbound08:55:112
301634995855,2cyclictest371288-21kworker/u8:3+flush-179:008:40:382
301634995855,2cyclictest371288-21kworker/u8:3+flush-179:008:40:372
301634995751,2cyclictest436168-21kworker/u8:0+flush-179:010:25:302
301630995750,5cyclictest335384-21/usr/share/muni07:50:021
301634995552,2cyclictest322373-21kworker/u8:3+events_unbound07:35:352
301634995551,3cyclictest359498-21kworker/u8:2+flush-179:008:25:012
301634995528,26cyclictest468057-21kworker/u8:2+flush-179:010:35:412
301628995550,3cyclictest347545-21chrome08:05:010
301639995448,4cyclictest315787-21ntpq07:25:163
301639995447,5cyclictest553898-21/usr/share/muni12:20:083
301634995346,5cyclictest304665-31munin-html07:10:332
30162899530,51cyclictest1-21systemd09:05:010
301634995249,2cyclictest359498-21kworker/u8:2+flush-179:008:25:202
301634995148,2cyclictest354741-21kworker/u8:0+events_unbound09:30:012
301634995147,4cyclictest456105-21kworker/u8:1+events_unbound12:40:002
301630995147,3cyclictest443290-31munin-html10:00:391
301634995046,3cyclictest379204-21kworker/u8:4+events_unbound09:30:132
301628995043,5cyclictest314343-21apt-get07:24:590
301639994945,3cyclictest354741-21kworker/u8:0+flush-179:009:17:013
301639994941,7cyclictest524948-21kworker/u8:0+events_unbound11:50:343
301639994929,19cyclictest121830-1kworker/3:0H+kblockd11:29:103
301628994943,4cyclictest403641-31munin-graph09:10:420
301634994845,2cyclictest524948-21kworker/u8:0+events_unbound11:45:132
301634994845,2cyclictest524948-21kworker/u8:0+events_unbound11:45:122
301634994845,2cyclictest460416-21kworker/u8:3+flush-179:010:35:012
301634994743,3cyclictest302019-21kworker/u8:2+events_unbound07:15:182
30163099470,46cyclictest0-21swapper/112:27:531
301639994644,2cyclictest423866-21kworker/u8:2+events_unbound10:20:423
301639994643,2cyclictest516308-21kworker/u8:2+flush-179:012:00:193
301639994643,2cyclictest456105-21kworker/u8:1+flush-179:011:50:003
301639994643,2cyclictest456105-21kworker/u8:1+flush-179:011:50:003
301639994642,3cyclictest536863-21kworker/u8:3+events_unbound12:05:133
301634994642,3cyclictest549318-21kworker/u8:0+flush-179:012:20:332
301634994641,2cyclictest280396-21kworker/u8:4+events_unbound07:55:242
301639994542,2cyclictest516308-21kworker/u8:2+events_unbound11:35:293
301639994541,3cyclictest423866-21kworker/u8:2+flush-179:010:17:023
301634994541,3cyclictest536863-21kworker/u8:3+flush-179:012:10:372
301630994534,8cyclictest284485-1kworker/1:0H+kblockd08:59:351
301630994534,8cyclictest284485-1kworker/1:0H+kblockd08:59:351
301630994533,4cyclictest284485-1kworker/1:0H+kblockd08:31:231
301639994436,7cyclictest322373-21kworker/u8:3+flush-179:007:55:203
301634994441,2cyclictest504879-21kworker/2:1+pm11:51:052
301634994441,2cyclictest280396-21kworker/u8:4+flush-179:008:10:292
301628994441,2cyclictest423866-21kworker/u8:2+flush-179:010:11:210
301628994441,2cyclictest407265-21kworker/u8:1+flush-179:009:35:470
301628994440,3cyclictest371288-21kworker/u8:3+flush-179:008:36:080
301628994436,6cyclictest7473-21ThreadPoolForeg12:35:160
5332602430,1chrt533033-21munin-update11:55:000
301639994339,3cyclictest308474-21kworker/u8:0+events_unbound07:40:093
301639994338,3cyclictest424361-21/usr/share/muni09:40:053
301639994336,3cyclictest354741-21kworker/u8:0+events_unbound09:23:053
301634994341,1cyclictest92248-1kworker/2:2H+kblockd08:05:062
301634994340,2cyclictest495695-21kworker/u8:2+flush-179:011:10:062
301634994339,3cyclictest456105-21kworker/u8:1+flush-179:010:46:472
301630994338,4cyclictest379977-21/usr/share/muni08:45:021
301639994239,2cyclictest354741-21kworker/u8:0+events_unbound09:30:443
301639994238,2cyclictest339281-21kworker/u8:1+events_unbound08:27:403
301634994239,2cyclictest379204-21kworker/u8:4+events_unbound10:00:012
301634994239,2cyclictest308474-21kworker/u8:0+flush-179:007:55:002
301634994239,2cyclictest280396-21kworker/u8:4+flush-179:007:45:302
301634994236,4cyclictest509261-21/usr/share/muni11:25:072
301634994236,3cyclictest379204-21kworker/u8:4+flush-179:009:42:062
301630994238,2cyclictest541351-21/usr/share/muni12:05:021
301630994237,4cyclictest395042-31munin-html09:00:351
301630994234,7cyclictest284485-1kworker/1:0H+kblockd11:30:151
301630994229,12cyclictest284485-1kworker/1:0H+kblockd11:14:361
301628994236,4cyclictest354741-21kworker/u8:0+flush-179:009:25:350
301639994138,2cyclictest460416-21kworker/u8:3+events_unbound10:50:583
301639994138,2cyclictest379204-21kworker/u8:4+events_unbound09:45:133
301639994138,2cyclictest359498-21kworker/u8:2+events_unbound08:30:333
301634994138,2cyclictest456105-21kworker/u8:1+events_unbound12:25:072
301634994137,3cyclictest436168-21kworker/u8:0+events_unbound10:20:132
301634994137,3cyclictest354741-21kworker/u8:0+flush-179:009:20:302
301634994136,3cyclictest516294-31munin-html11:30:382
301634994129,11cyclictest504879-21kworker/2:1+pm12:06:042
301630994138,2cyclictest284485-1kworker/1:0H+kblockd07:30:001
301630994134,6cyclictest346440-31munin-html08:00:341
301628994136,3cyclictest436168-21kworker/u8:0+flush-179:010:31:010
301628994135,4cyclictest301805-21/usr/share/muni07:10:140
301639994037,2cyclictest308474-21kworker/u8:0+events_unbound07:52:033
301639994036,3cyclictest280396-21kworker/u8:4+events_unbound07:36:083
301634994037,2cyclictest336404-21kworker/2:1+pm08:17:022
301634994037,2cyclictest280396-21kworker/u8:4+flush-179:007:25:432
301630994036,3cyclictest488163-31munin-html10:55:421
301630994025,14cyclictest1291-21snmpd08:16:411
301628994034,4cyclictest383887-21latency_hist08:50:000
301628994034,4cyclictest119725-1kworker/0:0H+kblockd12:34:110
301628994034,3cyclictest119725-1kworker/0:0H+kblockd08:41:310
301628994034,3cyclictest119725-1kworker/0:0H+kblockd08:41:310
301628994034,3cyclictest119725-1kworker/0:0H+kblockd08:25:130
301639993937,2cyclictest436168-21kworker/u8:0+events_unbound10:10:113
301639993935,3cyclictest524948-21kworker/u8:0+flush-179:011:55:033
301639993935,3cyclictest516653-21kworker/u8:3+flush-179:011:40:333
301639993935,3cyclictest468057-21kworker/u8:2+events_unbound10:33:323
301634993938,1cyclictest474801-21kworker/2:0+pm11:07:562
301634993937,1cyclictest474801-21kworker/2:0+pm10:52:412
301634993937,1cyclictest396378-21kworker/2:1+pm09:10:262
301634993937,1cyclictest371288-21kworker/u8:3+events_unbound08:50:172
301634993936,2cyclictest536863-21kworker/u8:3+flush-179:012:17:032
301634993936,2cyclictest536863-21kworker/u8:3+flush-179:012:17:022
301634993936,2cyclictest504879-21kworker/2:1+pm11:55:042
301634993936,2cyclictest504879-21kworker/2:1+pm11:41:002
301634993936,2cyclictest444431-21chrome10:05:022
301634993936,2cyclictest336404-21kworker/2:1+pm08:45:142
301634993935,3cyclictest558161-21kworker/u8:2+events_unbound12:30:462
301634993935,2cyclictest305773-21kworker/2:3+pm07:20:302
301634993933,2cyclictest387070-21kworker/u8:1+events_unbound09:05:122
301634993916,21cyclictest0-21swapper/210:01:332
301630993932,6cyclictest284485-1kworker/1:0H+kblockd11:15:321
301630993928,6cyclictest1291-21snmpd07:34:071
301630993925,2cyclictest516308-21kworker/u8:2+flush-179:012:02:171
301628993936,2cyclictest322373-21kworker/u8:3+flush-179:007:51:270
301628993936,2cyclictest119725-1kworker/0:0H+kblockd09:58:050
301628993932,5cyclictest452522-21/usr/share/muni10:15:070
301628993931,6cyclictest390897-21munin-limits08:55:310
301628993931,6cyclictest390897-21munin-limits08:55:310
301639993837,1cyclictest492630-21kworker/3:2+pm11:06:113
301639993836,1cyclictest375578-21kworker/3:2+pm08:42:203
301639993836,1cyclictest375578-21kworker/3:2+pm08:42:193
301639993834,2cyclictest121830-1kworker/3:0H+kblockd08:20:013
301639993834,2cyclictest121830-1kworker/3:0H+kblockd08:10:043
301634993837,1cyclictest442990-21kworker/2:2+pm10:10:182
301634993836,1cyclictest396378-21kworker/2:1+pm09:38:062
301634993836,1cyclictest396378-21kworker/2:1+pm09:15:152
301634993836,1cyclictest336404-21kworker/2:1+pm08:30:442
301634993835,2cyclictest504879-21kworker/2:1+pm12:00:122
301634993835,2cyclictest460416-21kworker/u8:3+events_unbound10:40:122
301634993835,2cyclictest383565-21kworker/2:0+pm09:00:042
301630993836,1cyclictest468221-21kworker/1:2+pm10:42:561
301630993836,1cyclictest339281-21kworker/u8:1+flush-179:008:06:271
301630993835,2cyclictest284485-1kworker/1:0H+kblockd12:19:511
301630993835,2cyclictest284485-1kworker/1:0H+kblockd12:19:511
301630993834,2cyclictest444149-21munin-update10:05:021
301630993834,2cyclictest284485-1kworker/1:0H+kblockd09:15:041
301628993836,1cyclictest544965-21kworker/0:0+pm12:08:060
301628993835,2cyclictest524880-21kworker/0:2+pm11:49:250
301628993835,2cyclictest524880-21kworker/0:2+pm11:49:250
301628993835,2cyclictest408140-21kworker/0:0+pm11:29:060
301628993834,2cyclictest119725-1kworker/0:0H+kblockd10:02:400
301628993833,3cyclictest351605-21/usr/share/muni08:10:070
301639993736,1cyclictest375578-21kworker/3:2+pm09:56:163
301639993735,1cyclictest121830-1kworker/3:0H+kblockd10:40:003
301639993734,2cyclictest492630-21kworker/3:2+pm12:34:453
301639993734,2cyclictest436168-21kworker/u8:0+events_unbound10:00:223
301639993734,2cyclictest121830-1kworker/3:0H+kblockd10:08:303
301639993734,2cyclictest121830-1kworker/3:0H+kblockd09:26:453
301639993734,2cyclictest121830-1kworker/3:0H+kblockd08:17:013
301639993734,2cyclictest121830-1kworker/3:0H+kblockd08:05:143
301639993731,4cyclictest331067-21/usr/share/muni07:45:113
301634993736,1cyclictest336404-21kworker/2:1+pm08:37:112
301634993735,1cyclictest504879-21kworker/2:1+pm11:20:252
301634993734,2cyclictest474801-21kworker/2:0+pm10:58:332
301634993734,2cyclictest305773-21kworker/2:3+pm07:41:262
301630993734,2cyclictest460416-21kworker/u8:3+flush-179:010:35:521
301630993734,2cyclictest284485-1kworker/1:0H+kblockd10:32:301
301630993733,3cyclictest409134-21apt-get09:20:111
301630993732,4cyclictest7507-21ThreadPoolForeg12:10:141
301630993732,3cyclictest339470-21/usr/share/muni07:55:041
301628993734,2cyclictest408140-21kworker/0:0+pm09:33:300
301628993734,2cyclictest301533-21kworker/0:1+pm07:49:310
301628993734,2cyclictest119725-1kworker/0:0H+kblockd11:00:170
301628993734,2cyclictest119725-1kworker/0:0H+kblockd09:46:250
301628993734,2cyclictest119725-1kworker/0:0H+kblockd09:43:330
301628993734,2cyclictest119725-1kworker/0:0H+kblockd07:17:550
301628993733,3cyclictest323917-21apt-get07:35:130
301639993633,2cyclictest456105-21kworker/u8:1+flush-179:011:30:103
301639993633,2cyclictest375578-21kworker/3:2+pm09:54:003
301639993632,3cyclictest280396-21kworker/u8:4+events_unbound08:00:233
301639993631,4cyclictest384132-21/usr/share/muni08:50:153
301634993634,1cyclictest504879-21kworker/2:1+pm11:36:122
301634993633,2cyclictest322373-21kworker/u8:3+flush-179:007:30:412
301634993632,2cyclictest460416-21kworker/u8:3+events_unbound11:00:432
301630993634,1cyclictest564823-1kworker/1:1H+kblockd12:31:321
301630993633,2cyclictest284485-1kworker/1:0H+kblockd10:25:141
301630993633,2cyclictest284485-1kworker/1:0H+kblockd10:10:311
301630993633,2cyclictest284485-1kworker/1:0H+kblockd07:15:311
301630993633,1cyclictest284485-1kworker/1:0H+kblockd09:28:501
301630993630,5cyclictest284485-1kworker/1:0H+kblockd11:00:191
301630993629,6cyclictest1291-21snmpd07:38:221
30163099360,35cyclictest0-21swapper/111:20:041
301628993634,1cyclictest334867-21kworker/0:2+pm08:51:350
301628993634,1cyclictest119725-1kworker/0:0H+kblockd11:51:120
301628993633,2cyclictest119725-1kworker/0:0H+kblockd12:17:140
301628993633,2cyclictest119725-1kworker/0:0H+kblockd12:17:130
301628993633,2cyclictest119725-1kworker/0:0H+kblockd11:20:180
301628993633,2cyclictest119725-1kworker/0:0H+kblockd10:07:240
301628993633,2cyclictest119725-1kworker/0:0H+kblockd08:22:190
301628993628,6cyclictest7474-21Chrome_ChildIOT10:35:550
301639993532,2cyclictest379204-21kworker/u8:4+events_unbound08:59:463
301639993532,2cyclictest379204-21kworker/u8:4+events_unbound08:59:463
301639993532,2cyclictest280396-21kworker/u8:4+events_unbound07:20:083
301639993532,2cyclictest121830-1kworker/3:0H+kblockd12:15:043
301639993532,2cyclictest121830-1kworker/3:0H+kblockd12:15:043
301639993529,6cyclictest121830-1kworker/3:0H+kblockd07:10:113
30163499359,25cyclictest7458-20Chrome_IOThread08:01:042
301630993533,1cyclictest284485-1kworker/1:0H+kblockd11:55:141
301630993531,2cyclictest284485-1kworker/1:0H+kblockd10:15:031
301630993530,3cyclictest480897-21/usr/share/muni10:50:041
301630993528,5cyclictest423231-31munin-html09:35:451
301630993527,6cyclictest529270-21/usr/share/muni11:50:021
301630993526,8cyclictest7474-21Chrome_ChildIOT11:40:111
30163099351,33cyclictest7506-20Chrome_ChildIOT09:05:121
30163099350,3cyclictest7474-21Chrome_ChildIOT12:23:061
301628993533,1cyclictest119725-1kworker/0:0H+kblockd10:56:430
301628993533,1cyclictest119725-1kworker/0:0H+kblockd08:34:310
301628993533,1cyclictest119725-1kworker/0:0H+kblockd07:44:370
301628993532,2cyclictest119725-1kworker/0:0H+kblockd12:25:490
301628993531,2cyclictest119725-1kworker/0:0H+kblockd09:15:010
301639993433,1cyclictest121830-1kworker/3:0H+kblockd09:36:353
301639993432,1cyclictest121830-1kworker/3:0H+kblockd11:10:553
301639993432,1cyclictest121830-1kworker/3:0H+kblockd08:45:163
301639993431,3cyclictest456105-21kworker/u8:1+flush-179:012:12:003
301639993431,2cyclictest121830-1kworker/3:0H+kblockd11:17:153
301630993431,2cyclictest284485-1kworker/1:0H+kblockd08:29:401
301630993431,2cyclictest284485-1kworker/1:0H+kblockd07:44:101
301630993431,2cyclictest284485-1kworker/1:0H+kblockd07:11:301
301630993428,5cyclictest354727-31munin-html08:10:391
301630993427,6cyclictest359702-21/usr/share/muni08:20:121
301630993425,7cyclictest284485-1kworker/1:0H+kblockd11:47:561
301630993425,7cyclictest284485-1kworker/1:0H+kblockd11:47:561
301628993431,2cyclictest119725-1kworker/0:0H+kblockd12:20:150
301628993431,2cyclictest119725-1kworker/0:0H+kblockd11:37:580
301628993430,3cyclictest1291-21snmpd10:52:210
301628993430,2cyclictest119725-1kworker/0:0H+kblockd12:10:040
301628993429,4cyclictest500176-21munin-limits11:10:330
301628993429,3cyclictest119725-1kworker/0:0H+kblockd10:20:040
301628993428,4cyclictest501151-21/usr/share/muni11:15:120
301639993331,2cyclictest456105-21kworker/u8:1+events_unbound10:35:193
301639993331,1cyclictest121830-1kworker/3:0H+kblockd10:55:523
301639993331,1cyclictest121830-1kworker/3:0H+kblockd09:10:483
301639993328,4cyclictest557891-21/usr/share/muni12:25:073
301630993331,1cyclictest1291-21snmpd08:54:241
301630993329,2cyclictest1140-21isc-net-000010:20:071
301630993327,5cyclictest7503-20chrome08:40:201
301630993327,5cyclictest7503-20chrome08:40:201
301630993312,9cyclictest7505-21ThreadPoolForeg09:56:121
301628993331,1cyclictest119725-1kworker/0:0H+kblockd10:29:000
301628993330,2cyclictest536863-21kworker/u8:3+flush-179:012:01:150
301628993317,3cyclictest119725-1kworker/0:0H+kblockd11:30:190
301639993229,3cyclictest354741-21kworker/u8:0+flush-179:009:00:543
301639993229,2cyclictest456105-21kworker/u8:1+events_unbound11:20:103
301639993226,5cyclictest354741-21kworker/u8:0+flush-179:008:35:003
301630993229,2cyclictest284485-1kworker/1:0H+kblockd09:45:131
301630993229,2cyclictest1291-21snmpd11:35:031
301630993229,2cyclictest1291-21snmpd09:52:461
301630993225,5cyclictest509246-21/usr/share/muni11:25:021
301628993230,1cyclictest334867-21kworker/0:2+pm08:18:250
301628993229,2cyclictest1291-21snmpd09:50:130
301628993229,2cyclictest1291-21snmpd07:26:320
301628993228,3cyclictest119725-1kworker/0:0H+kblockd08:01:500
301628993228,2cyclictest119725-1kworker/0:0H+kblockd09:20:550
301628993225,5cyclictest476625-21/usr/share/muni10:45:080
301639993126,4cyclictest399212-31munin-html09:05:393
301639993124,6cyclictest7473-21ThreadPoolForeg10:25:203
301630993130,1cyclictest1291-21snmpd09:13:391
301630993127,2cyclictest416485-21cat09:30:041
301630993112,11cyclictest7506-20Chrome_ChildIOT07:45:351
301630993110,20cyclictest7507-21ThreadPoolForeg10:47:131
30163099310,31cyclictest0-21swapper/112:39:471
301628993129,2cyclictest119725-1kworker/0:0H+kblockd11:06:300
301628993129,1cyclictest1291-21snmpd11:43:170
301628993129,1cyclictest1140-21isc-net-000010:42:070
301628993128,2cyclictest301533-21kworker/0:1+pm07:32:350
301628993128,2cyclictest119725-1kworker/0:0H+kblockd09:01:390
301639993029,1cyclictest1291-21snmpd07:31:433
301630993028,2cyclictest268528-21kworker/1:1+pm07:24:401
301630993028,1cyclictest1291-21snmpd08:35:291
301628993028,1cyclictest1140-21isc-net-000007:57:070
30163099281,26cyclictest7411-21python309:41:531
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional