You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-20 - 09:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackbslot1.osadl.org (updated Wed Jun 19, 2024 12:44:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21419012211188,13sleep30-21swapper/307:09:313
21417162209186,13sleep00-21swapper/007:07:020
21417882207186,12sleep20-21swapper/207:08:012
21418622197171,14sleep10-21swapper/107:09:011
2142126996651,5cyclictest2203401-21/usr/share/muni08:25:011
214212699596,53cyclictest2159367-21kworker/u8:1+efi_rts_wq08:00:421
2142119995953,5cyclictest7473-21ThreadPoolForeg07:25:500
2142135995851,5cyclictest2370184-21/usr/share/muni11:50:013
23330572560,1chrt2333052-21snmp_wanpowerct11:05:041
21994442560,1chrt2199443-21snmp_wlanswitch08:20:020
22158442540,1chrt2215586-21munin-update08:40:020
2142126995449,4cyclictest2190169-31munin-html08:05:351
2142119995451,2cyclictest2294217-21kworker/u8:0+events_unbound11:05:000
2142135995345,6cyclictest7507-21ThreadPoolForeg09:55:413
2142126995349,3cyclictest2220251-21kworker/u8:0+flush-179:009:00:151
2142130995248,3cyclictest2410284-21latency_hist12:40:012
2142130995131,19cyclictest2187250-21munin-update08:05:002
2142126995147,2cyclictest2159367-21kworker/u8:1+flush-179:007:46:161
2142130995036,13cyclictest2219513-21kworker/2:0+pm09:18:002
2142126995044,4cyclictest2195307-21/usr/share/muni08:15:081
2142119995045,4cyclictest7505-21ThreadPoolForeg10:25:100
2142135994944,4cyclictest7505-21ThreadPoolForeg11:20:003
2142130994944,4cyclictest7505-21ThreadPoolForeg08:40:002
2142130994936,12cyclictest2259664-21kworker/2:2+pm09:50:582
2142126994944,4cyclictest2211282-21cp08:35:011
2142119994945,3cyclictest2278721-31munin-html09:55:320
2142135994843,3cyclictest2170888-21latency_hist07:45:003
2142135994842,4cyclictest2316800-21/usr/share/muni10:45:083
2142135994730,16cyclictest1021706-1kworker/3:1H+kblockd08:33:253
214213599461,44cyclictest7474-21Chrome_ChildIOT07:14:003
2142126994539,5cyclictest7505-21ThreadPoolForeg08:45:091
2142119994541,3cyclictest2306652-21munin-limits10:30:290
2142135994438,4cyclictest2327354-31munin-html10:55:373
2142126994439,4cyclictest2374295-21/usr/share/muni11:55:021
2142119994441,2cyclictest2275573-21kworker/u8:2+flush-179:010:51:180
2142119994441,2cyclictest2154607-21kworker/u8:2+flush-179:007:31:410
2142135994338,4cyclictest2267078-31munin-graph09:40:463
2142130994341,1cyclictest2259664-21kworker/2:2+pm10:14:452
2142126994337,4cyclictest2252086-21/usr/share/muni09:25:091
2142135994228,13cyclictest1291-21snmpd08:47:123
2142130994238,3cyclictest2378308-21/usr/share/muni12:00:042
2142130994238,3cyclictest2361886-21/usr/share/muni11:40:112
2142130994234,7cyclictest2259664-21kworker/2:2+pm09:57:002
2142119994237,4cyclictest2165811-21munin-limits07:35:290
2142135994138,2cyclictest7474-21Chrome_ChildIOT10:18:213
2142135994135,4cyclictest2260105-21/usr/share/muni09:35:093
2142135994133,7cyclictest2187026-21kworker/3:2+pm08:18:253
2142135994133,6cyclictest7505-21ThreadPoolForeg09:30:103
2142135994131,9cyclictest1021706-1kworker/3:1H+kblockd09:05:153
2142135994130,10cyclictest1021706-1kworker/3:1H+kblockd08:43:303
214213599411,38cyclictest2191409-21snmp_ryswitch.c08:10:033
2142130994137,3cyclictest2159367-21kworker/u8:1+flush-179:008:30:482
2142135994037,2cyclictest2332272-1kworker/3:2H+kblockd11:32:453
2142126994036,3cyclictest2373652-21kworker/u8:2+flush-179:012:15:061
2142126994028,11cyclictest1291-21snmpd11:00:551
2142119994036,3cyclictest2355291-21apt-get11:30:140
2142135993936,1cyclictest2287693-21kworker/3:0+pm11:13:353
2142135993935,3cyclictest1291-21snmpd08:35:413
2142135993933,2cyclictest2332272-1kworker/3:2H+kblockd11:45:103
214213599390,2cyclictest0-21swapper/312:29:413
2142130993938,1cyclictest2219513-21kworker/2:0+pm08:56:362
2142130993937,1cyclictest2347797-21kworker/2:1+pm11:53:482
2142130993937,1cyclictest2259664-21kworker/2:2+pm10:53:462
2142130993937,1cyclictest2219513-21kworker/2:0+pm09:39:582
2142130993937,1cyclictest2190733-21kworker/2:1+pm08:21:172
2142130993936,2cyclictest2219513-21kworker/2:0+pm09:11:032
2142130993936,2cyclictest2128459-21kworker/2:1+pm07:55:172
214213099392,37cyclictest2159367-21kworker/u8:1+efi_rts_wq08:00:422
2142130993913,24cyclictest2283100-31munin-graph10:01:062
2142130993913,24cyclictest2283100-31munin-graph10:01:062
2142126993935,3cyclictest2330973-21kworker/u8:1+events_unbound11:20:441
2142119993937,1cyclictest2158915-21kworker/0:0+pm07:41:110
2142119993936,2cyclictest2275573-21kworker/u8:2+events_unbound10:05:480
2142119993936,2cyclictest2231652-21kworker/0:1+pm09:43:560
2142119993935,3cyclictest2207405-21/usr/share/muni08:30:110
2142119993934,3cyclictest2148348-21apt-get07:15:140
2142135993836,2cyclictest2287693-21kworker/3:0+pm10:21:123
2142135993835,2cyclictest1021706-1kworker/3:1H+kblockd07:17:453
2142135993833,3cyclictest1021706-1kworker/3:1H+kblockd10:44:463
2142135993828,9cyclictest1021706-1kworker/3:1H+kblockd10:12:263
2142135993824,3cyclictest2252078-21/usr/share/muni09:25:093
2142130993837,1cyclictest2128459-21kworker/2:1+pm07:16:242
2142130993836,2cyclictest2259664-21kworker/2:2+pm10:16:452
2142130993836,1cyclictest2347797-21kworker/2:1+pm12:31:262
2142130993836,1cyclictest2347797-21kworker/2:1+pm12:05:052
2142130993836,1cyclictest2347797-21kworker/2:1+pm11:55:582
2142130993836,1cyclictest2259664-21kworker/2:2+pm10:43:562
2142130993836,1cyclictest2259664-21kworker/2:2+pm10:33:462
2142130993836,1cyclictest2219513-21kworker/2:0+pm09:30:162
2142130993836,1cyclictest2219513-21kworker/2:0+pm08:54:452
2142130993836,1cyclictest2190733-21kworker/2:1+pm08:44:592
2142130993836,1cyclictest2128459-21kworker/2:1+pm07:31:022
2142130993835,2cyclictest2347797-21kworker/2:1+pm12:15:112
2142130993835,2cyclictest2259664-21kworker/2:2+pm11:09:062
2142130993835,2cyclictest2259664-21kworker/2:2+pm10:36:362
2142130993835,2cyclictest2259664-21kworker/2:2+pm10:20:172
2142130993835,2cyclictest2259664-21kworker/2:2+pm09:40:432
2142130993835,2cyclictest2190733-21kworker/2:1+pm08:10:012
2142130993835,2cyclictest2128459-21kworker/2:1+pm07:21:112
2142130993834,3cyclictest2145335-31munin-html07:10:352
214213099381,3cyclictest7503-20chrome08:45:452
2142126993836,1cyclictest2369518-21kworker/1:0+pm12:34:001
2142126993836,1cyclictest2255556-21kworker/1:2+pm09:47:341
2142126993836,1cyclictest2133728-21kworker/1:0+pm09:18:101
2142119993836,1cyclictest2158915-21kworker/0:0+pm08:58:560
2142119993835,2cyclictest2288581-21kworker/u8:1+flush-179:010:11:090
2142119993833,4cyclictest2235963-21/usr/share/muni09:05:130
2142119993832,4cyclictest2370417-21apt-get11:50:030
2142119993826,11cyclictest1291-21snmpd08:05:440
2142119993821,4cyclictest2336947-21/usr/share/muni11:10:140
2142135993736,1cyclictest2357720-21kworker/3:2+pm12:37:553
2142135993735,1cyclictest2162774-21kworker/3:0+pm07:49:153
2142135993735,1cyclictest1021706-1kworker/3:1H+kblockd07:54:253
2142135993735,1cyclictest1021706-1kworker/3:1H+kblockd07:54:253
2142135993734,2cyclictest2332272-1kworker/3:2H+kblockd12:15:183
2142135993734,2cyclictest1021706-1kworker/3:1H+kblockd10:25:293
2142135993733,3cyclictest1021706-1kworker/3:1H+kblockd10:40:013
2142135993732,3cyclictest1021706-1kworker/3:1H+kblockd09:47:203
2142135993730,5cyclictest2323571-31munin-html10:50:373
2142135993726,9cyclictest2332272-1kworker/3:2H+kblockd12:23:253
2142135993726,9cyclictest2332272-1kworker/3:2H+kblockd12:23:253
2142135993726,10cyclictest1021706-1kworker/3:1H+kblockd08:07:503
214213599370,36cyclictest0-21swapper/307:39:453
2142130993736,1cyclictest2347797-21kworker/2:1+pm11:32:132
2142130993735,2cyclictest2219513-21kworker/2:0+pm09:00:552
2142130993735,1cyclictest2347797-21kworker/2:1+pm12:20:432
2142130993735,1cyclictest2347797-21kworker/2:1+pm12:20:422
2142130993735,1cyclictest2347797-21kworker/2:1+pm11:40:012
2142130993735,1cyclictest2347797-21kworker/2:1+pm11:25:352
2142130993735,1cyclictest2259664-21kworker/2:2+pm10:25:122
2142130993735,1cyclictest2190733-21kworker/2:1+pm08:26:452
2142130993735,1cyclictest2190733-21kworker/2:1+pm08:16:332
2142130993735,1cyclictest2128459-21kworker/2:1+pm07:35:132
2142130993734,2cyclictest2259664-21kworker/2:2+pm11:01:462
2142130993734,1cyclictest2101430-1kworker/2:0H+kblockd12:11:462
2142126993736,1cyclictest2133728-21kworker/1:0+pm07:43:301
2142126993735,1cyclictest2133728-21kworker/1:0+pm07:23:211
2142126993734,2cyclictest2332640-21kworker/1:3+pm11:45:001
2142126993734,2cyclictest2332640-21kworker/1:3+pm11:19:511
2142126993734,2cyclictest1508591-1kworker/1:0H+kblockd10:21:561
2142126993732,4cyclictest2378324-21/usr/share/muni12:00:021
2142126993732,4cyclictest2312700-21/usr/share/muni10:40:011
2142119993735,2cyclictest2373652-21kworker/u8:2+flush-179:012:36:240
2142119993733,2cyclictest1604126-1kworker/0:2H+kblockd08:48:410
2142119993726,10cyclictest1140-21isc-net-000009:02:050
22360942360,1chrt2236092-21snmp_areswitch.09:05:041
2142135993634,1cyclictest2187026-21kworker/3:2+pm08:59:203
2142135993634,1cyclictest1021706-1kworker/3:1H+kblockd10:02:413
2142135993634,1cyclictest1021706-1kworker/3:1H+kblockd10:02:403
2142135993634,1cyclictest1021706-1kworker/3:1H+kblockd07:21:063
2142135993633,2cyclictest1021706-1kworker/3:1H+kblockd07:26:153
2142135993631,3cyclictest2251189-31munin-html09:20:423
2142130993635,1cyclictest2347797-21kworker/2:1+pm11:22:032
2142130993634,1cyclictest2128459-21kworker/2:1+pm07:50:132
2142130993634,1cyclictest2128459-21kworker/2:1+pm07:50:132
2142130993634,1cyclictest2101430-1kworker/2:0H+kblockd09:20:312
2142130993632,3cyclictest2235921-21chrome09:05:012
214213099361,13cyclictest2344367-31munin-html11:15:412
214213099360,1cyclictest2319389-31munin-html10:45:362
2142126993634,1cyclictest2255556-21kworker/1:2+pm09:54:401
2142126993634,1cyclictest2133728-21kworker/1:0+pm09:21:561
2142126993634,1cyclictest2133728-21kworker/1:0+pm08:11:551
2142126993634,1cyclictest1508591-1kworker/1:0H+kblockd12:39:511
2142126993634,1cyclictest1508591-1kworker/1:0H+kblockd11:50:221
2142126993634,1cyclictest1508591-1kworker/1:0H+kblockd07:36:291
2142126993634,1cyclictest1508591-1kworker/1:0H+kblockd07:28:001
2142126993633,2cyclictest1508591-1kworker/1:0H+kblockd10:00:291
2142126993633,2cyclictest1508591-1kworker/1:0H+kblockd10:00:291
2142126993633,2cyclictest1508591-1kworker/1:0H+kblockd09:11:411
2142126993633,1cyclictest1508591-1kworker/1:0H+kblockd10:05:141
2142119993634,1cyclictest2339531-1kworker/0:0H+kblockd12:01:050
2142119993634,1cyclictest2339531-1kworker/0:0H+kblockd11:41:300
2142119993634,1cyclictest2231652-21kworker/0:1+pm09:12:310
2142119993633,2cyclictest2339531-1kworker/0:0H+kblockd12:22:110
2142119993633,2cyclictest2339531-1kworker/0:0H+kblockd12:22:110
2142119993633,1cyclictest1604126-1kworker/0:2H+kblockd09:17:310
2142119993632,3cyclictest2287896-21kworker/0:0+pm11:07:450
2142119993623,2cyclictest2339531-1kworker/0:0H+kblockd11:45:300
2142135993533,1cyclictest2357720-21kworker/3:2+pm12:34:113
2142135993533,1cyclictest2332272-1kworker/3:2H+kblockd12:12:323
2142135993532,2cyclictest2357720-21kworker/3:2+pm11:44:153
2142135993532,2cyclictest2332272-1kworker/3:2H+kblockd12:05:303
2142135993532,2cyclictest2332272-1kworker/3:2H+kblockd11:55:483
2142135993532,2cyclictest2332272-1kworker/3:2H+kblockd11:35:203
2142130993534,1cyclictest2347797-21kworker/2:1+pm11:46:212
2142130993533,1cyclictest2347797-21kworker/2:1+pm12:25:182
2142130993533,1cyclictest2259664-21kworker/2:2+pm10:05:402
2142130993533,1cyclictest2128459-21kworker/2:1+pm07:45:292
2142130993533,1cyclictest2101430-1kworker/2:0H+kblockd09:27:202
2142130993532,2cyclictest2128459-21kworker/2:1+pm07:26:552
214213099350,1cyclictest2327276-31munin-html10:55:372
2142126993533,1cyclictest1508591-1kworker/1:0H+kblockd09:56:301
2142126993533,1cyclictest1508591-1kworker/1:0H+kblockd09:31:521
2142126993533,1cyclictest1508591-1kworker/1:0H+kblockd08:54:061
2142126993532,2cyclictest2138432-21kworker/u8:4+flush-179:007:15:101
2142126993532,2cyclictest1508591-1kworker/1:0H+kblockd10:17:001
2142126993532,2cyclictest1508591-1kworker/1:0H+kblockd07:30:041
2142126993530,3cyclictest2357867-21/usr/share/muni11:35:081
2142119993534,1cyclictest1604126-1kworker/0:2H+kblockd08:10:220
2142119993533,1cyclictest2339531-1kworker/0:0H+kblockd11:36:290
2142119993533,1cyclictest1604126-1kworker/0:2H+kblockd09:30:300
2142119993532,2cyclictest2339531-1kworker/0:0H+kblockd12:10:490
2142119993532,2cyclictest2166813-21kworker/u8:3+flush-179:008:15:060
2142119993531,3cyclictest1604126-1kworker/0:2H+kblockd09:22:130
2142119993524,0cyclictest1291-21snmpd08:02:170
2142135993433,1cyclictest2125068-21kworker/3:3+pm07:34:253
2142135993432,1cyclictest1021706-1kworker/3:1H+kblockd10:30:293
2142135993432,1cyclictest1021706-1kworker/3:1H+kblockd08:24:553
2142135993431,2cyclictest2332272-1kworker/3:2H+kblockd11:25:143
2142135993424,9cyclictest1021706-1kworker/3:1H+kblockd09:12:353
2142130993433,1cyclictest2259664-21kworker/2:2+pm11:10:272
2142130993431,2cyclictest2101430-1kworker/2:0H+kblockd07:42:002
2142130993430,3cyclictest2268110-21/usr/share/muni09:45:082
2142126993432,1cyclictest1508591-1kworker/1:0H+kblockd12:30:001
2142126993432,1cyclictest1508591-1kworker/1:0H+kblockd10:31:261
2142126993432,1cyclictest1508591-1kworker/1:0H+kblockd07:11:361
2142126993431,2cyclictest2294217-21kworker/u8:0+flush-179:010:35:061
2142126993431,2cyclictest1508591-1kworker/1:0H+kblockd09:35:181
2142126993431,2cyclictest1508591-1kworker/1:0H+kblockd08:23:501
2142126993431,1cyclictest1508591-1kworker/1:0H+kblockd10:25:421
2142126993430,3cyclictest2318306-21apt-get10:45:151
2142126993430,2cyclictest1508591-1kworker/1:0H+kblockd12:20:161
2142126993430,2cyclictest1508591-1kworker/1:0H+kblockd12:20:161
214212699342,32cyclictest0-21swapper/112:10:121
2142119993432,1cyclictest1604126-1kworker/0:2H+kblockd09:35:150
2142119993431,2cyclictest2287896-21kworker/0:0+pm11:28:050
2142119993431,2cyclictest2287896-21kworker/0:0+pm11:20:290
2142119993431,2cyclictest1604126-1kworker/0:2H+kblockd08:26:560
2142119993430,3cyclictest2390425-21/usr/share/muni12:15:170
2142119993430,2cyclictest2339531-1kworker/0:0H+kblockd12:30:040
2142119993430,2cyclictest1604126-1kworker/0:2H+kblockd10:20:170
2142119993428,4cyclictest2341237-21/usr/share/muni11:15:180
2142119993428,4cyclictest2154607-21kworker/u8:2+flush-179:007:24:560
2142135993331,1cyclictest2332272-1kworker/3:2H+kblockd11:09:053
2142135993331,1cyclictest1291-21snmpd10:06:543
2142135993330,2cyclictest1291-21snmpd09:16:523
2142135993330,2cyclictest1021706-1kworker/3:1H+kblockd08:04:363
2142135993329,2cyclictest2332272-1kworker/3:2H+kblockd11:20:033
2142135993320,10cyclictest0-21swapper/311:00:043
2142126993332,1cyclictest1508591-1kworker/1:0H+kblockd10:51:101
2142119993331,1cyclictest1604126-1kworker/0:2H+kblockd07:11:400
2142119993331,1cyclictest1291-21snmpd10:04:180
2142119993331,1cyclictest1291-21snmpd10:04:180
2142119993330,2cyclictest1604126-1kworker/0:2H+kblockd07:55:200
2142119993330,2cyclictest1604126-1kworker/0:2H+kblockd07:46:360
2142119993328,3cyclictest474-21systemd-journal09:26:070
2142135993229,2cyclictest2332272-1kworker/3:2H+kblockd12:00:293
2142126993230,1cyclictest1291-21snmpd07:59:551
2142126993220,11cyclictest2211930-21snmp_wanpowerct08:35:041
2142119993230,1cyclictest1604126-1kworker/0:2H+kblockd10:17:350
2142119993230,1cyclictest1291-21snmpd10:55:550
2142119993227,3cyclictest1604126-1kworker/0:2H+kblockd08:35:020
2142135993129,1cyclictest1291-21snmpd09:01:093
2142126993130,1cyclictest2288043-21kworker/1:3+pm10:14:551
2142126993129,1cyclictest1508591-1kworker/1:0H+kblockd11:34:411
2142126993129,1cyclictest1291-21snmpd11:25:021
2142126993129,1cyclictest1291-21snmpd07:50:281
2142126993129,1cyclictest1291-21snmpd07:50:281
2142126993129,1cyclictest1140-21isc-net-000008:58:051
2142126993128,2cyclictest1508591-1kworker/1:0H+kblockd11:10:211
2142119993130,1cyclictest1291-21snmpd12:27:000
2142119993129,1cyclictest1140-21isc-net-000010:38:040
2142119993128,2cyclictest1604126-1kworker/0:2H+kblockd09:50:180
2142119993128,2cyclictest1291-21snmpd12:05:170
2142119993127,3cyclictest2339531-1kworker/0:0H+kblockd11:55:160
2142119993111,18cyclictest2312689-21/usr/share/muni10:40:020
22239392300,1chrt2223908-21snmp_ryswitch2.08:50:023
2142135993028,1cyclictest1291-21snmpd09:50:333
2142135993010,18cyclictest7503-20chrome08:25:193
2142126993030,0cyclictest1291-21snmpd10:56:071
2142126993028,1cyclictest1291-21snmpd08:40:461
2142119993028,1cyclictest1291-21snmpd09:46:570
2142119993027,2cyclictest7499-20VizCompositorTh08:53:260
2142135992926,2cyclictest1140-21isc-net-000007:55:043
2142126992929,0cyclictest1291-21snmpd09:44:231
2142126992926,2cyclictest1508591-1kworker/1:0H+kblockd11:45:041
2142119992929,0cyclictest1291-21snmpd07:54:170
2142119992929,0cyclictest1291-21snmpd07:54:170
2142126992826,2cyclictest2369518-21kworker/1:0+pm12:06:101
2142119992724,2cyclictest1291-21snmpd10:46:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional