You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-15 - 22:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackbslot1.osadl.org (updated Tue Jul 15, 2025 12:44:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1687812210182,18sleep20-21swapper/207:08:412
1687482203182,12sleep00-21swapper/007:08:180
1687312202179,13sleep30-21swapper/307:08:063
1686742191146,34sleep10-21swapper/107:07:231
16907099930,90cyclictest207222-21snmp_wanswitch.07:45:010
16907099930,90cyclictest207222-21snmp_wanswitch.07:45:010
169070996610,55cyclictest351329-21kworker/u8:1+efi_rts_wq10:31:460
169072996347,2cyclictest393687-13chrome10:45:021
169072995650,4cyclictest399279-21/usr/share/muni10:50:101
169076995551,3cyclictest191384-21/usr/share/muni07:30:022
169080995249,2cyclictest366701-21kworker/u8:4+flush-179:012:20:093
169080995249,2cyclictest366701-21kworker/u8:4+flush-179:012:20:093
169080995248,3cyclictest366701-21kworker/u8:4+flush-179:012:10:363
169080995248,3cyclictest268480-21kworker/u8:2+flush-179:009:25:323
2792802510,3sleep140576-13Chrome_IOThread08:55:021
16908099516,45cyclictest366701-21kworker/u8:4+efi_rts_wq10:31:433
169070995147,3cyclictest351329-21kworker/u8:1+events_unbound12:10:300
169070995147,3cyclictest158297-21kworker/u8:4+events_unbound07:20:100
169080994943,2cyclictest268480-21kworker/u8:2+events_unbound09:40:313
169076994936,1cyclictest242652-21kworker/2:0+pm08:26:502
169076994931,13cyclictest263508-21kworker/2:1+pm08:48:452
169076994742,4cyclictest315309-21kworker/2:1+pm10:41:052
169076994735,11cyclictest181936-21kworker/2:1+pm07:51:472
169080994542,2cyclictest134767-1kworker/3:1H+kblockd09:31:013
169080994541,3cyclictest191395-21/usr/share/muni07:30:073
169076994533,8cyclictest315309-21kworker/2:1+pm10:09:512
169076994533,8cyclictest315309-21kworker/2:1+pm10:09:512
169076994533,1cyclictest3042803-1kworker/2:0H+kblockd11:06:472
169072994543,1cyclictest4033645-1kworker/1:2H+kblockd08:06:211
169080994440,3cyclictest366701-21kworker/u8:4+flush-179:011:45:083
169080994440,3cyclictest366701-21kworker/u8:4+flush-179:010:50:253
169076994441,2cyclictest315309-21kworker/2:1+pm11:53:162
169076994438,5cyclictest40612-21ThreadPoolForeg12:05:012
169076994434,9cyclictest315309-21kworker/2:1+pm10:49:062
169076994434,9cyclictest3042803-1kworker/2:0H+kblockd12:25:532
16907699441,42cyclictest40654-21chrome10:01:352
16907699440,5cyclictest40518-21python307:20:582
1916012430,1chrt191580-21snmp_wlanswitch07:30:031
169080994340,2cyclictest366701-21kworker/u8:4+flush-179:011:55:273
169080994339,3cyclictest434764-21kworker/u8:0+events_unbound12:00:163
169080994338,4cyclictest180825-21/usr/share/muni07:20:033
16908099431,41cyclictest0-21swapper/311:13:463
169076994333,9cyclictest466261-21kworker/2:2+pm12:32:332
16907699430,13cyclictest310058-31munin-html09:20:362
169070994341,1cyclictest0-21swapper/008:21:530
169070994338,3cyclictest403395-21munin-limits10:50:310
169080994240,2cyclictest351329-21kworker/u8:1+flush-179:010:45:263
169080994240,1cyclictest76778-21kworker/u8:1+flush-179:007:15:143
169080994238,3cyclictest268480-21kworker/u8:2+flush-179:008:50:103
169076994239,2cyclictest76405-21systemd-journal09:55:002
169076994236,5cyclictest315309-21kworker/2:1+pm09:40:532
169076994234,7cyclictest181936-21kworker/2:1+pm07:55:342
16907699421,2cyclictest201053-31munin-html07:35:502
169072994236,5cyclictest76405-21systemd-journal11:15:011
169070994237,4cyclictest40614-21Chrome_ChildIOT12:19:060
169080994139,1cyclictest211906-21kworker/u8:1+events_unbound08:01:543
169080994137,3cyclictest247779-21kworker/u8:4+flush-179:008:21:233
169076994131,9cyclictest315309-21kworker/2:1+pm10:33:412
169076994127,13cyclictest40557-13chrome07:46:172
169076994127,13cyclictest40557-13chrome07:46:172
169076994121,13cyclictest190480-31munin-graph07:26:182
16907699410,40cyclictest0-21swapper/208:15:572
169072994137,2cyclictest4033645-1kworker/1:2H+kblockd08:01:181
169070994138,2cyclictest1260-21snmpd08:47:180
169070994137,3cyclictest186218-21kworker/u8:0+flush-179:007:55:330
169070994135,4cyclictest341550-21/usr/share/muni09:55:150
169080994037,2cyclictest40614-21Chrome_ChildIOT08:38:223
169080994037,2cyclictest40614-21Chrome_ChildIOT08:38:223
169080994037,2cyclictest186218-21kworker/u8:0+events_unbound07:45:253
169080994037,2cyclictest186218-21kworker/u8:0+events_unbound07:45:253
169080994033,4cyclictest378051-21kworker/u8:0+events_unbound10:43:423
16907699407,2cyclictest40657-21ThreadPoolForeg09:00:452
169076994038,1cyclictest315309-21kworker/2:1+pm10:10:322
169076994038,1cyclictest181936-21kworker/2:1+pm07:44:572
169076994037,2cyclictest315309-21kworker/2:1+pm11:20:012
169076994037,2cyclictest315309-21kworker/2:1+pm10:26:192
169076994037,2cyclictest315309-21kworker/2:1+pm10:16:522
169076994037,2cyclictest242652-21kworker/2:0+pm08:30:222
169076994035,4cyclictest40766-21mqtt2munin09:35:342
169076994033,6cyclictest3042803-1kworker/2:0H+kblockd09:45:132
169076994025,11cyclictest289618-21kworker/2:3+pm09:08:532
16907699401,5cyclictest40654-21chrome08:50:522
16907699400,39cyclictest227256-31munin-html08:00:542
169072994038,1cyclictest4033645-1kworker/1:2H+kblockd12:14:201
169072994038,1cyclictest143254-21kworker/1:0+pm07:29:291
169072994026,7cyclictest268927-21ThreadPoolForeg08:45:031
16907299402,37cyclictest366701-21kworker/u8:4+efi_rts_wq10:31:461
169070994037,2cyclictest263201-21kworker/0:1+pm10:39:010
169080993937,2cyclictest134767-1kworker/3:1H+kblockd09:04:153
169080993936,2cyclictest315235-21kworker/u8:3+events_unbound09:50:103
169080993936,2cyclictest273908-21kworker/u8:0+flush-179:008:55:333
169080993936,2cyclictest247779-21kworker/u8:4+flush-179:008:25:093
169080993936,2cyclictest232354-21kworker/u8:3+flush-179:008:10:263
169080993935,3cyclictest366701-21kworker/u8:4+flush-179:010:55:213
169080993935,3cyclictest211906-21kworker/u8:1+flush-179:008:05:253
169080993934,4cyclictest190830-21latency_hist07:30:013
169076993937,1cyclictest40467-21kworker/2:0+pm07:10:052
169076993937,1cyclictest289618-21kworker/2:3+pm09:17:552
169076993937,1cyclictest242652-21kworker/2:0+pm08:24:582
169076993936,2cyclictest315309-21kworker/2:1+pm10:55:042
169076993935,3cyclictest409501-21/usr/share/muni11:00:062
169076993934,4cyclictest456006-21chrome11:45:022
169076993931,7cyclictest174313-21kworker/2:3+pm07:15:052
169076993929,9cyclictest1260-21snmpd08:38:402
169076993929,9cyclictest1260-21snmpd08:38:402
169076993927,11cyclictest40518-21python312:15:202
169072993925,13cyclictest4033645-1kworker/1:2H+kblockd09:38:341
169070993937,1cyclictest460784-21kworker/0:2+pm11:53:250
169070993936,2cyclictest366701-21kworker/u8:4+flush-179:011:20:080
169070993936,2cyclictest366701-21kworker/u8:4+events_unbound11:15:350
169070993935,3cyclictest76778-21kworker/u8:1+flush-179:007:15:000
16907099390,38cyclictest40654-21chrome12:40:010
169080993836,1cyclictest366701-21kworker/u8:4+flush-179:011:30:273
169080993832,2cyclictest268480-21kworker/u8:2+events_unbound09:55:093
169080993823,14cyclictest366701-21kworker/u8:4+flush-179:010:35:073
169076993836,1cyclictest315309-21kworker/2:1+pm11:40:062
169076993836,1cyclictest315309-21kworker/2:1+pm11:16:412
169076993836,1cyclictest315309-21kworker/2:1+pm11:14:272
169076993836,1cyclictest315309-21kworker/2:1+pm09:57:062
169076993835,2cyclictest466261-21kworker/2:2+pm12:11:122
16907699381,36cyclictest40657-21ThreadPoolForeg09:26:022
16907699381,13cyclictest40654-21chrome08:11:092
169076993810,26cyclictest40629-21Chrome_DevTools08:55:462
169072993836,1cyclictest341066-21kworker/1:1+pm12:03:511
169072993835,2cyclictest341066-21kworker/1:1+pm11:04:561
169072993833,4cyclictest312047-21diskstats09:25:151
169070993836,1cyclictest440173-21kworker/0:1+pm11:34:400
169070993835,2cyclictest85117-1kworker/0:2H+kblockd10:47:300
169070993835,2cyclictest366701-21kworker/u8:4+flush-179:012:05:060
169080993735,1cyclictest481758-21kworker/3:0+pm12:34:573
169080993734,2cyclictest268480-21kworker/u8:2+flush-179:009:10:223
169080993734,2cyclictest211906-21kworker/u8:1+flush-179:008:30:273
169080993734,2cyclictest134767-1kworker/3:1H+kblockd12:36:513
169080993734,2cyclictest134767-1kworker/3:1H+kblockd09:22:473
169080993734,2cyclictest134767-1kworker/3:1H+kblockd07:10:583
169080993728,8cyclictest366701-21kworker/u8:4+flush-179:011:20:093
169076993735,1cyclictest466261-21kworker/2:2+pm12:35:482
169076993735,1cyclictest466261-21kworker/2:2+pm12:00:172
169076993735,1cyclictest315309-21kworker/2:1+pm11:37:212
169076993735,1cyclictest315309-21kworker/2:1+pm09:31:002
169076993735,1cyclictest181936-21kworker/2:1+pm08:05:172
169076993734,2cyclictest315309-21kworker/2:1+pm10:37:072
169076993730,6cyclictest315309-21kworker/2:1+pm11:26:082
16907699371,35cyclictest265359-21grep08:40:172
169072993734,2cyclictest4033645-1kworker/1:2H+kblockd12:30:011
169072993734,2cyclictest4033645-1kworker/1:2H+kblockd11:51:131
169072993734,2cyclictest4033645-1kworker/1:2H+kblockd10:47:411
169072993734,2cyclictest4033645-1kworker/1:2H+kblockd07:22:211
169072993734,2cyclictest4033645-1kworker/1:2H+kblockd07:19:211
169072993733,3cyclictest4033645-1kworker/1:2H+kblockd12:08:351
169070993735,1cyclictest263201-21kworker/0:1+pm08:38:420
169070993735,1cyclictest263201-21kworker/0:1+pm08:38:410
169070993734,2cyclictest85117-1kworker/0:2H+kblockd12:04:590
169070993734,2cyclictest85117-1kworker/0:2H+kblockd10:17:460
169070993734,2cyclictest85117-1kworker/0:2H+kblockd09:42:460
169070993734,2cyclictest85117-1kworker/0:2H+kblockd08:10:190
169070993733,3cyclictest85117-1kworker/0:2H+kblockd08:54:500
169070993733,2cyclictest85117-1kworker/0:2H+kblockd09:15:000
169070993732,4cyclictest99884-21rs:main0
169070993732,3cyclictest196336-21latency_hist07:35:010
169080993634,1cyclictest134767-1kworker/3:1H+kblockd09:45:133
169080993633,2cyclictest268480-21kworker/u8:2+flush-179:010:10:263
169080993633,2cyclictest268480-21kworker/u8:2+flush-179:009:15:263
169080993633,2cyclictest134767-1kworker/3:1H+kblockd12:29:513
169080993633,2cyclictest134767-1kworker/3:1H+kblockd10:06:053
169080993633,2cyclictest134767-1kworker/3:1H+kblockd10:06:043
169080993633,2cyclictest134767-1kworker/3:1H+kblockd08:45:363
169076993635,1cyclictest315309-21kworker/2:1+pm10:21:172
169076993634,1cyclictest3042803-1kworker/2:0H+kblockd12:20:142
169076993634,1cyclictest3042803-1kworker/2:0H+kblockd12:20:142
169076993634,1cyclictest289618-21kworker/2:3+pm09:10:072
169076993633,2cyclictest315309-21kworker/2:1+pm10:50:072
169076993633,1cyclictest315309-21kworker/2:1+pm11:30:022
169072993634,1cyclictest4033645-1kworker/1:2H+kblockd11:30:321
169072993634,1cyclictest341066-21kworker/1:1+pm10:58:311
169072993633,2cyclictest4033645-1kworker/1:2H+kblockd11:37:411
169072993633,2cyclictest4033645-1kworker/1:2H+kblockd11:06:411
169072993633,2cyclictest4033645-1kworker/1:2H+kblockd10:26:261
169072993633,2cyclictest4033645-1kworker/1:2H+kblockd10:22:261
169072993633,2cyclictest4033645-1kworker/1:2H+kblockd08:37:041
169072993633,2cyclictest4033645-1kworker/1:2H+kblockd08:37:041
169072993633,2cyclictest4033645-1kworker/1:2H+kblockd08:24:561
169072993633,2cyclictest4033645-1kworker/1:2H+kblockd07:40:101
169072993632,3cyclictest4033645-1kworker/1:2H+kblockd09:22:011
169070993634,1cyclictest85117-1kworker/0:2H+kblockd09:51:140
169070993634,1cyclictest85117-1kworker/0:2H+kblockd09:46:060
169070993634,1cyclictest85117-1kworker/0:2H+kblockd07:29:120
169070993633,2cyclictest85117-1kworker/0:2H+kblockd11:46:040
169070993633,2cyclictest85117-1kworker/0:2H+kblockd11:25:310
169070993633,2cyclictest85117-1kworker/0:2H+kblockd11:06:020
169070993633,2cyclictest85117-1kworker/0:2H+kblockd07:50:100
169070993633,1cyclictest263201-21kworker/0:1+pm10:23:370
169080993534,1cyclictest134767-1kworker/3:1H+kblockd10:04:273
169080993533,1cyclictest232821-21kworker/3:1+pm08:44:073
169080993532,2cyclictest378051-21kworker/u8:0+flush-179:011:05:173
169080993532,2cyclictest134767-1kworker/3:1H+kblockd10:26:213
169080993532,2cyclictest134767-1kworker/3:1H+kblockd07:36:183
169080993531,3cyclictest351329-21kworker/u8:1+flush-179:011:19:113
169080993530,4cyclictest238075-21/usr/share/muni08:15:033
169076993511,24cyclictest0-21swapper/211:56:102
169072993533,1cyclictest4033645-1kworker/1:2H+kblockd09:12:211
169072993533,1cyclictest4033645-1kworker/1:2H+kblockd07:46:201
169072993533,1cyclictest4033645-1kworker/1:2H+kblockd07:46:201
169072993532,2cyclictest4033645-1kworker/1:2H+kblockd11:25:041
169072993532,2cyclictest4033645-1kworker/1:2H+kblockd11:18:261
169072993532,2cyclictest4033645-1kworker/1:2H+kblockd08:31:491
169072993531,3cyclictest143254-21kworker/1:0+pm09:05:001
169072993521,12cyclictest143254-21kworker/1:0+pm09:09:561
169070993533,1cyclictest460784-21kworker/0:2+pm12:29:300
169070993532,2cyclictest85117-1kworker/0:2H+kblockd09:37:510
169070993532,2cyclictest85117-1kworker/0:2H+kblockd09:22:070
169070993532,2cyclictest85117-1kworker/0:2H+kblockd08:56:170
169070993531,3cyclictest366701-21kworker/u8:4+events_unbound10:55:100
169080993433,1cyclictest134767-1kworker/3:1H+kblockd07:56:413
169080993431,2cyclictest366701-21kworker/u8:4+flush-179:011:40:273
169080993431,2cyclictest273908-21kworker/u8:0+events_unbound09:05:083
169072993431,2cyclictest4033645-1kworker/1:2H+kblockd09:40:101
169072993431,2cyclictest4033645-1kworker/1:2H+kblockd07:54:501
169072993431,2cyclictest21050usb-storage10:00:061
169072993430,2cyclictest4033645-1kworker/1:2H+kblockd09:45:251
169070993432,1cyclictest85117-1kworker/0:2H+kblockd09:09:280
169070993431,2cyclictest85117-1kworker/0:2H+kblockd11:12:500
169070993431,2cyclictest85117-1kworker/0:2H+kblockd09:34:160
169070993431,2cyclictest85117-1kworker/0:2H+kblockd08:40:000
169070993431,2cyclictest85117-1kworker/0:2H+kblockd07:40:030
169070993431,2cyclictest85117-1kworker/0:2H+kblockd07:37:540
169070993431,2cyclictest434764-21kworker/u8:0+flush-179:012:31:480
169080993330,2cyclictest378051-21kworker/u8:0+flush-179:011:03:053
169080993330,2cyclictest134767-1kworker/3:1H+kblockd12:18:213
169080993329,3cyclictest434764-21kworker/u8:0+flush-179:011:25:123
169072993331,1cyclictest1260-21snmpd08:25:451
169072993331,1cyclictest105470-21isc-net-000012:27:021
169072993326,5cyclictest487469-21/usr/share/muni12:15:011
169070993331,1cyclictest85117-1kworker/0:2H+kblockd10:11:260
169070993331,1cyclictest263201-21kworker/0:1+pm09:02:180
169070993330,2cyclictest85117-1kworker/0:2H+kblockd12:24:410
169070993330,2cyclictest85117-1kworker/0:2H+kblockd12:24:410
169070993330,2cyclictest85117-1kworker/0:2H+kblockd10:41:200
169080993231,1cyclictest134767-1kworker/3:1H+kblockd07:50:163
169080993230,1cyclictest134767-1kworker/3:1H+kblockd10:18:403
169080993230,1cyclictest105470-21isc-net-000012:08:023
169080993229,2cyclictest351329-21kworker/u8:1+flush-179:010:21:113
169080993228,3cyclictest351329-21kworker/u8:1+flush-179:011:35:293
169080993228,3cyclictest186218-21kworker/u8:0+events_unbound07:43:033
169072993230,1cyclictest4033645-1kworker/1:2H+kblockd07:59:111
169072993230,1cyclictest4033645-1kworker/1:2H+kblockd07:35:561
169072993229,2cyclictest4033645-1kworker/1:2H+kblockd10:17:361
169072993229,2cyclictest4033645-1kworker/1:2H+kblockd09:34:251
169072993229,2cyclictest1260-21snmpd09:16:431
169072993229,2cyclictest1260-21snmpd08:15:201
169072993228,2cyclictest1260-21snmpd08:10:351
169072993226,3cyclictest508276-21/usr/share/muni12:35:021
169072993221,10cyclictest341573-21/usr/sbin/munin09:55:021
169070993230,1cyclictest85117-1kworker/0:2H+kblockd10:02:060
169070993229,2cyclictest85117-1kworker/0:2H+kblockd11:40:020
169070993229,2cyclictest105470-21isc-net-000008:08:010
169080993129,1cyclictest134767-1kworker/3:1H+kblockd09:39:563
169080993129,1cyclictest105470-21isc-net-000011:51:023
169072993130,1cyclictest4033645-1kworker/1:2H+kblockd11:56:511
169072993129,1cyclictest4033645-1kworker/1:2H+kblockd11:21:141
169072993129,1cyclictest1260-21snmpd11:49:021
169072993127,2cyclictest4033645-1kworker/1:2H+kblockd10:10:051
169070993128,2cyclictest263201-21kworker/0:1+pm10:07:350
169070993128,2cyclictest263201-21kworker/0:1+pm10:07:350
169072993029,1cyclictest1260-21snmpd07:12:461
16907299300,27cyclictest263725-21snmp_ryswitch2.08:40:021
169070993030,0cyclictest1260-21snmpd11:02:190
169070993029,1cyclictest1260-21snmpd08:26:490
169070993028,1cyclictest85117-1kworker/0:2H+kblockd08:30:210
169070993027,2cyclictest85117-1kworker/0:2H+kblockd11:36:490
169070993027,2cyclictest85117-1kworker/0:2H+kblockd07:15:310
169072992927,1cyclictest1260-21snmpd12:21:481
169072992927,1cyclictest1260-21snmpd12:21:481
169072992927,1cyclictest1260-21snmpd08:52:121
169072992925,3cyclictest4033645-1kworker/1:2H+kblockd09:53:551
169070992927,1cyclictest85117-1kworker/0:2H+kblockd11:57:260
169070992927,1cyclictest263201-21kworker/0:1+pm09:27:070
169070992926,2cyclictest132557-21kworker/u8:2+events_unbound08:15:200
169072992826,1cyclictest4033645-1kworker/1:2H+kblockd10:06:181
169072992826,1cyclictest4033645-1kworker/1:2H+kblockd10:06:181
169072992825,2cyclictest4033645-1kworker/1:2H+kblockd11:41:151
169072992825,2cyclictest4033645-1kworker/1:2H+kblockd10:35:161
169070992826,1cyclictest1260-21snmpd10:28:370
169070992519,5cyclictest40692-21ThreadPoolForeg09:17:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional