You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-21 - 13:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackbslot1.osadl.org (updated Mon Oct 20, 2025 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17577472215186,18sleep20-21swapper/207:08:272
17576762205176,19sleep10-21swapper/107:07:341
17576652205182,13sleep00-21swapper/007:07:250
17575672201172,19sleep30-21swapper/307:06:063
175967021280,2sleep3247505-21Chrome_DevTools07:10:113
1758222996862,4cyclictest2038707-21latency_hist11:40:012
1758216996259,2cyclictest2038785-21kworker/u8:3+flush-179:012:15:000
1758225996058,1cyclictest1919308-13chrome09:45:023
1758225996057,2cyclictest1795472-21chrome07:45:023
1758219995954,4cyclictest1826069-21/usr/share/muni08:15:021
1758222995741,14cyclictest1981753-21snmp_wlanpowerc10:45:012
1758225995551,3cyclictest1736800-21kworker/u8:0+flush-179:007:20:193
1758225995551,3cyclictest1736800-21kworker/u8:0+flush-179:007:20:193
1758225995452,1cyclictest0-21swapper/311:45:013
1758222995348,3cyclictest2073846-31munin-html12:10:362
1758216995249,2cyclictest1747378-21kworker/u8:2+flush-179:007:25:200
1758216995248,3cyclictest1960077-21kworker/u8:0+flush-179:010:25:330
1758216995245,2cyclictest1965731-21kworker/u8:1+events_unbound11:00:010
1758216995148,3cyclictest1851444-21kworker/u8:0+events_unbound08:55:090
1758216995147,3cyclictest1903427-21kworker/u8:1+flush-179:009:55:220
1758225995047,2cyclictest2038785-21kworker/u8:3+flush-179:012:05:213
1758219995045,3cyclictest1877579-21/usr/share/muni09:05:151
1758216995047,2cyclictest1877294-21kworker/u8:2+flush-179:009:15:100
1758216995047,2cyclictest1830911-21kworker/u8:4+flush-179:009:25:290
1758216995047,2cyclictest1830911-21kworker/u8:4+flush-179:009:25:290
1758219994944,4cyclictest1893180-21apt-key09:20:011
175821699490,47cyclictest1763639-21snmp_wlanswitch07:15:020
1758219994845,2cyclictest2059056-21kworker/u8:1+flush-179:012:10:331
1758216994845,2cyclictest2059056-21kworker/u8:1+flush-179:012:05:190
1758216994845,2cyclictest1747378-21kworker/u8:2+flush-179:008:10:010
1758225994741,4cyclictest2090055-21latency_hist12:30:013
1758222994744,2cyclictest1965736-21kworker/2:3+pm12:31:002
1758219994743,3cyclictest1995322-21kworker/u8:0+flush-179:011:10:361
1758219994743,3cyclictest1944622-21kworker/u8:2+flush-179:010:15:291
1758219994743,3cyclictest1820787-21kworker/u8:1+flush-179:008:15:071
1758216994743,2cyclictest1857030-21/usr/share/muni08:45:010
1758216994733,13cyclictest1898242-21kworker/u8:0+flush-179:009:30:270
1758225994639,5cyclictest247560-21ThreadPoolForeg10:00:293
1758222994641,4cyclictest1750592-21kworker/2:2+pm07:30:212
1758222994640,4cyclictest1830911-21kworker/u8:4+flush-179:008:40:252
1758222994633,2cyclictest1790101-21kworker/2:1+pm07:55:072
175822299460,45cyclictest247505-21Chrome_DevTools07:17:342
1758219994640,5cyclictest1810957-21/usr/share/muni08:00:021
1758219994640,5cyclictest1810957-21/usr/share/muni08:00:011
1758216994644,2cyclictest1830911-21kworker/u8:4+flush-179:008:25:270
1758216994643,2cyclictest1830911-21kworker/u8:4+events_unbound08:30:150
1758216994643,2cyclictest1796235-21kworker/u8:0+flush-179:007:45:370
1758216994643,2cyclictest1789854-21kworker/u8:1+events_unbound07:50:240
1758225994539,5cyclictest1981765-21ThreadPoolForeg10:45:223
1758222994542,2cyclictest1965736-21kworker/2:3+pm12:22:042
1758222994535,6cyclictest1965736-21kworker/2:3+pm11:34:342
1758222994534,5cyclictest1965736-21kworker/2:3+pm10:40:002
175822299451,43cyclictest247557-21chrome10:50:592
1758219994540,4cyclictest247561-21ThreadPoolForeg10:45:191
1758216994542,2cyclictest1970689-21kworker/u8:3+flush-179:010:40:270
1758216994541,3cyclictest247560-21ThreadPoolForeg10:00:090
1758216994541,3cyclictest1982522-21ld10:45:120
1758216994541,3cyclictest1747378-21kworker/u8:2+events_unbound07:32:360
1758225994437,5cyclictest1763645-21/usr/share/muni07:15:033
1758222994438,4cyclictest1944622-21kworker/u8:2+flush-179:010:15:302
1758222994429,13cyclictest1841423-21kworker/2:3+pm08:30:052
1758216994442,2cyclictest2038785-21kworker/u8:3+flush-179:011:50:170
1758216994441,2cyclictest2038785-21kworker/u8:3+flush-179:011:45:140
1758216994441,2cyclictest1944622-21kworker/u8:2+flush-179:011:15:220
1758216994441,2cyclictest1747378-21kworker/u8:2+events_unbound08:20:010
1758216994440,3cyclictest2079601-21kworker/u8:4+flush-179:012:21:290
1758216994440,3cyclictest1988301-21apt-get10:50:160
1758216994440,3cyclictest1789854-21kworker/u8:1+events_unbound08:00:270
1758216994440,3cyclictest1789854-21kworker/u8:1+events_unbound08:00:260
1758216994439,3cyclictest1866354-21munin-limits08:50:330
1758222994335,5cyclictest2044111-21ThreadPoolForeg11:45:192
1758222994333,9cyclictest1750592-21kworker/2:2+pm07:25:042
1758216994340,2cyclictest1960077-21kworker/u8:0+flush-179:010:33:560
1758216994340,2cyclictest1929248-21kworker/u8:4+events_unbound10:08:020
1758225994238,3cyclictest1944622-21kworker/u8:2+events_unbound11:55:153
1758225994237,3cyclictest247515-21ThreadPoolForeg09:05:343
1758225994237,3cyclictest2037878-31munin-html11:35:333
1758225994237,3cyclictest1960077-21kworker/u8:0+flush-179:010:30:353
1758225994235,2cyclictest1944622-21kworker/u8:2+flush-179:011:15:063
1758222994239,2cyclictest1965736-21kworker/2:3+pm12:01:262
1758222994239,2cyclictest1965736-21kworker/2:3+pm11:12:442
1758222994237,3cyclictest1893062-21kworker/2:1+pm10:20:462
1758222994235,6cyclictest247561-21ThreadPoolForeg09:42:292
1758222994235,6cyclictest1207567-1kworker/2:0H+kblockd12:37:442
1758222994230,8cyclictest1207567-1kworker/2:0H+kblockd11:40:322
1758219994239,2cyclictest1726126-21kworker/u8:1+flush-179:007:10:111
1758216994239,2cyclictest1995322-21kworker/u8:0+flush-179:011:00:290
1758216994239,2cyclictest1736800-21kworker/u8:0+events_unbound07:19:380
1758216994238,3cyclictest1965731-21kworker/u8:1+flush-179:011:05:140
1758225994136,4cyclictest1747378-21kworker/u8:2+flush-179:008:00:183
1758225994136,4cyclictest1747378-21kworker/u8:2+flush-179:008:00:183
1758225994136,3cyclictest1903427-21kworker/u8:1+flush-179:009:32:283
1758225994135,3cyclictest1856993-21chrome08:45:013
1758222994136,3cyclictest1820582-21kworker/2:0+pm08:28:392
1758222994136,3cyclictest1790101-21kworker/2:1+pm08:08:432
1758222994128,12cyclictest1919357-21chrome09:45:022
1758222994126,3cyclictest1207567-1kworker/2:0H+kblockd10:12:342
175822299411,39cyclictest1260-21snmpd08:45:122
175822299410,40cyclictest247545-13VizCompositorTh09:21:022
1758219994138,2cyclictest1898242-21kworker/u8:0+flush-179:009:37:151
1758219994137,3cyclictest1747378-21kworker/u8:2+flush-179:007:54:531
1758219994134,5cyclictest1893662-21/usr/share/muni09:20:021
1758219994130,10cyclictest1260-21snmpd12:00:041
1758216994139,2cyclictest1820787-21kworker/u8:1+events_unbound08:10:300
1758216994138,2cyclictest2079601-21kworker/u8:4+flush-179:012:25:220
1758216994138,2cyclictest1789854-21kworker/u8:1+events_unbound07:57:310
1758216994138,2cyclictest1747378-21kworker/u8:2+flush-179:007:20:150
1758216994138,2cyclictest1747378-21kworker/u8:2+flush-179:007:20:140
1758216994137,3cyclictest2091587-21kworker/u8:1+flush-179:012:30:290
1758225994036,3cyclictest1736800-21kworker/u8:0+flush-179:007:35:233
1758225994033,6cyclictest1126430-1kworker/3:0H+kblockd10:58:393
1758222994037,2cyclictest1965736-21kworker/2:3+pm12:17:312
1758222994037,2cyclictest1965736-21kworker/2:3+pm11:50:322
1758222994037,2cyclictest1965736-21kworker/2:3+pm11:09:342
1758222994037,2cyclictest1893062-21kworker/2:1+pm10:02:122
1758222994037,2cyclictest1841423-21kworker/2:3+pm09:17:042
1758222994037,2cyclictest1820582-21kworker/2:0+pm08:14:022
1758222994037,1cyclictest1841423-21kworker/2:3+pm08:53:382
1758222994036,2cyclictest1750592-21kworker/2:2+pm07:39:392
1758222994033,5cyclictest2028449-21latency_hist11:30:012
1758222994030,9cyclictest247557-21chrome09:33:242
1758222994027,12cyclictest1965736-21kworker/2:3+pm10:31:102
175822299402,15cyclictest247418-21python309:35:582
175822299401,3cyclictest247418-21python309:27:232
175822299401,3cyclictest247418-21python309:27:232
175822299401,38cyclictest1815437-31munin-graph08:01:492
175822299401,38cyclictest1815437-31munin-graph08:01:492
1758219994037,2cyclictest1830911-21kworker/u8:4+flush-179:008:45:321
1758219994034,2cyclictest1965731-21kworker/u8:1+flush-179:010:50:231
1758216994037,2cyclictest1995322-21kworker/u8:0+flush-179:011:40:130
1758216994037,2cyclictest1796235-21kworker/u8:0+flush-179:008:20:150
1758216994036,3cyclictest2059056-21kworker/u8:1+events_unbound12:15:330
1758216994036,3cyclictest1903427-21kworker/u8:1+flush-179:009:35:370
1758225993934,3cyclictest1779811-21latency_hist07:30:013
1758222993937,1cyclictest1750592-21kworker/2:2+pm07:12:212
1758222993936,2cyclictest1965736-21kworker/2:3+pm10:57:592
1758222993936,2cyclictest1893062-21kworker/2:1+pm10:28:462
1758222993936,2cyclictest1841423-21kworker/2:3+pm09:14:132
1758222993936,2cyclictest1841423-21kworker/2:3+pm09:05:292
1758222993936,2cyclictest1841423-21kworker/2:3+pm08:55:322
1758222993936,2cyclictest1820582-21kworker/2:0+pm08:19:572
1758222993930,5cyclictest1790101-21kworker/2:1+pm07:45:272
1758219993935,3cyclictest1747378-21kworker/u8:2+flush-179:008:30:321
175821999393,35cyclictest247468-13Chrome_IOThread12:16:341
1758216993936,2cyclictest1877294-21kworker/u8:2+flush-179:009:05:270
1758225993836,1cyclictest1795263-21kworker/3:0+pm10:27:243
1758225993835,2cyclictest2091587-21kworker/u8:1+flush-179:012:31:563
1758225993833,4cyclictest1815807-21munin-update08:05:323
1758222993836,1cyclictest1965736-21kworker/2:3+pm11:00:192
1758222993835,2cyclictest1841423-21kworker/2:3+pm09:02:592
1758222993835,2cyclictest1841423-21kworker/2:3+pm08:37:402
1758222993835,2cyclictest1790101-21kworker/2:1+pm07:42:392
1758222993835,1cyclictest1965736-21kworker/2:3+pm12:25:462
1758222993835,1cyclictest1924296-21kworker/2:0+pm09:50:262
1758222993834,3cyclictest1965736-21kworker/2:3+pm12:08:262
1758222993833,3cyclictest1750592-21kworker/2:2+pm07:20:132
1758222993833,3cyclictest1750592-21kworker/2:2+pm07:20:132
1758222993832,5cyclictest1965736-21kworker/2:3+pm10:44:252
1758222993830,7cyclictest1790101-21kworker/2:1+pm07:51:492
1758219993833,4cyclictest1321570-21apache207:55:051
1758219993833,3cyclictest1959786-31munin-html10:20:391
1758216993836,2cyclictest1877294-21kworker/u8:2+flush-179:009:40:320
1758216993835,2cyclictest1970689-21kworker/u8:3+flush-179:010:35:050
1758216993834,3cyclictest1995322-21kworker/u8:0+events_unbound11:30:330
1758216993834,3cyclictest1944622-21kworker/u8:2+flush-179:011:55:050
1758216993834,2cyclictest1898242-21kworker/u8:0+flush-179:009:21:030
175822599375,31cyclictest0-21swapper/311:45:363
1758225993735,2cyclictest1851444-21kworker/u8:0+flush-179:008:55:463
1758225993733,3cyclictest1830911-21kworker/u8:4+events_unbound08:25:093
1758222993735,1cyclictest1965736-21kworker/2:3+pm11:17:172
1758222993735,1cyclictest1893062-21kworker/2:1+pm09:58:002
1758222993734,2cyclictest1965736-21kworker/2:3+pm11:23:382
1758222993734,2cyclictest1207567-1kworker/2:0H+kblockd08:21:192
1758219993736,1cyclictest1846254-21kworker/1:0+pm09:13:081
1758219993734,2cyclictest604375-1kworker/1:2H+kblockd08:35:161
1758219993734,2cyclictest1774594-21kworker/1:1+pm07:33:191
1758219993733,3cyclictest247573-21ThreadPoolForeg12:33:591
1758219993733,3cyclictest1835531-31munin-html08:20:331
1758216993734,2cyclictest1944622-21kworker/u8:2+events_unbound10:10:350
1758216993734,2cyclictest1861633-21kworker/u8:1+flush-179:009:00:200
1758216993733,2cyclictest1697933-1kworker/0:2H+kblockd11:37:140
1758216993724,12cyclictest1877294-21kworker/u8:2+flush-179:009:53:390
1758225993634,1cyclictest1126430-1kworker/3:0H+kblockd11:50:183
1758225993633,2cyclictest1126430-1kworker/3:0H+kblockd12:20:213
1758225993633,2cyclictest1126430-1kworker/3:0H+kblockd11:27:343
1758225993633,2cyclictest1126430-1kworker/3:0H+kblockd09:51:463
1758225993633,2cyclictest1126430-1kworker/3:0H+kblockd08:35:043
1758225993633,1cyclictest1126430-1kworker/3:0H+kblockd09:37:343
1758225993632,3cyclictest1126430-1kworker/3:0H+kblockd09:27:393
1758225993632,3cyclictest1126430-1kworker/3:0H+kblockd09:27:393
1758225993632,3cyclictest1126430-1kworker/3:0H+kblockd07:59:393
1758225993632,2cyclictest1126430-1kworker/3:0H+kblockd11:33:043
1758225993632,2cyclictest1126430-1kworker/3:0H+kblockd08:30:133
1758225993631,4cyclictest2078815-31munin-html12:15:343
1758225993628,2cyclictest1126430-1kworker/3:0H+kblockd08:21:443
1758225993621,13cyclictest2008024-21python311:10:043
175822299369,26cyclictest0-21swapper/210:06:092
1758222993632,3cyclictest247449-2159acd6cd00851b411:55:142
1758219993634,1cyclictest604375-1kworker/1:2H+kblockd08:50:131
1758219993634,1cyclictest604375-1kworker/1:2H+kblockd07:40:461
1758219993633,2cyclictest1909236-1kworker/1:1H+kblockd11:24:581
1758219993632,3cyclictest2038785-21kworker/u8:3+flush-179:012:35:231
1758219993632,3cyclictest1934832-21/usr/share/muni10:00:011
1758219993632,3cyclictest1918407-31munin-html09:40:371
1758219993632,3cyclictest1903427-21kworker/u8:1+events_unbound10:10:291
175821999361,34cyclictest0-21swapper/109:30:061
1758216993634,1cyclictest1697933-1kworker/0:2H+kblockd08:44:340
1758216993633,2cyclictest1995322-21kworker/u8:0+flush-179:011:20:090
1758216993632,3cyclictest1944622-21kworker/u8:2+flush-179:010:18:170
1758225993532,2cyclictest1795263-21kworker/3:0+pm10:17:193
1758225993532,2cyclictest1126430-1kworker/3:0H+kblockd08:54:293
1758225993532,2cyclictest1126430-1kworker/3:0H+kblockd07:54:093
1758225993530,4cyclictest247560-21ThreadPoolForeg08:15:093
1758225993530,3cyclictest1886898-31munin-html09:10:363
1758225993529,5cyclictest1877294-21kworker/u8:2+flush-179:009:20:313
1758219993534,1cyclictest1997443-21kworker/1:0+pm11:32:291
1758219993533,1cyclictest604375-1kworker/1:2H+kblockd08:42:081
1758219993533,1cyclictest1909236-1kworker/1:1H+kblockd11:05:031
1758219993533,1cyclictest1909236-1kworker/1:1H+kblockd10:05:031
1758219993532,2cyclictest604375-1kworker/1:2H+kblockd07:45:101
1758219993532,2cyclictest1995322-21kworker/u8:0+events_unbound11:00:271
1758219993530,4cyclictest76405-21systemd-journal10:40:001
1758219993530,4cyclictest247561-21ThreadPoolForeg10:58:041
1758219993528,3cyclictest1903427-21kworker/u8:1+flush-179:009:55:161
1758216993534,1cyclictest1697933-1kworker/0:2H+kblockd11:25:070
1758216993532,3cyclictest1903427-21kworker/u8:1+flush-179:009:45:570
1758216993531,3cyclictest2007384-21kworker/u8:3+flush-179:011:10:230
1758216993531,3cyclictest1747378-21kworker/u8:2+flush-179:007:35:430
1758225993432,1cyclictest1126430-1kworker/3:0H+kblockd11:20:343
1758225993432,1cyclictest1126430-1kworker/3:0H+kblockd08:12:293
1758225993431,2cyclictest1929248-21kworker/u8:4+flush-179:010:06:333
1758225993431,2cyclictest1126430-1kworker/3:0H+kblockd07:41:193
1758225993430,3cyclictest247468-13Chrome_IOThread07:30:423
1758225993430,3cyclictest1970689-21kworker/u8:3+flush-179:010:35:243
175822599340,33cyclictest247418-21python309:55:143
1758219993433,1cyclictest1997443-21kworker/1:0+pm11:38:041
1758219993431,2cyclictest1909236-1kworker/1:1H+kblockd12:09:401
1758219993431,2cyclictest1909236-1kworker/1:1H+kblockd11:55:031
1758219993431,2cyclictest1747378-21kworker/u8:2+events_unbound07:20:361
1758219993431,2cyclictest1747378-21kworker/u8:2+events_unbound07:20:361
1758219993430,3cyclictest2084422-31munin-html12:20:381
1758219993430,3cyclictest1918845-21kworker/u8:3+flush-179:009:50:171
1758216993431,3cyclictest2059056-21kworker/u8:1+flush-179:012:00:240
1758216993431,2cyclictest2084807-21kworker/u8:0+events_unbound12:36:290
1758216993429,4cyclictest1882684-21/usr/share/muni09:10:090
1758216993428,5cyclictest247516-21Chrome_ChildIOT08:35:140
1758216993427,2cyclictest1944622-21kworker/u8:2+flush-179:010:20:080
1758225993330,2cyclictest1126430-1kworker/3:0H+kblockd09:17:013
1758225993329,3cyclictest1965731-21kworker/u8:1+flush-179:011:05:323
1758225993329,3cyclictest1929248-21kworker/u8:4+flush-179:010:10:163
1758219993332,1cyclictest604375-1kworker/1:2H+kblockd07:26:261
1758219993331,1cyclictest1909236-1kworker/1:1H+kblockd11:48:291
1758219993330,2cyclictest604375-1kworker/1:2H+kblockd08:27:391
1758219993330,2cyclictest604375-1kworker/1:2H+kblockd07:16:471
1758219993330,2cyclictest1944622-21kworker/u8:2+flush-179:011:50:281
1758219993330,2cyclictest1909236-1kworker/1:1H+kblockd10:34:591
1758219993329,3cyclictest2079601-21kworker/u8:4+events_unbound12:25:491
1758216993330,2cyclictest1747378-21kworker/u8:2+events_unbound07:40:210
1758225993231,1cyclictest1830911-21kworker/u8:4+flush-179:008:40:143
1758225993230,1cyclictest1260-21snmpd11:02:233
1758225993229,2cyclictest1260-21snmpd09:43:083
1758225993228,3cyclictest1929248-21kworker/u8:4+flush-179:010:20:103
1758225993227,3cyclictest2095407-21/usr/share/muni12:35:113
1758219993230,2cyclictest2028082-21kworker/u8:4+flush-179:011:26:041
1758219993230,1cyclictest1909236-1kworker/1:1H+kblockd10:44:191
1758219993229,2cyclictest1909236-1kworker/1:1H+kblockd10:25:041
1758219993219,12cyclictest247450-13chrome11:42:021
175821999320,31cyclictest247450-13chrome08:55:401
1758225993129,1cyclictest1260-21snmpd10:40:343
1758225993128,2cyclictest1260-21snmpd12:02:343
1758225993126,4cyclictest247560-21ThreadPoolForeg09:00:083
1758219993129,1cyclictest1260-21snmpd07:39:281
1758219993127,3cyclictest1919397-21ThreadPoolForeg09:45:201
1758219993127,3cyclictest1876589-21munin-limits09:00:331
1758225993028,1cyclictest1260-21snmpd12:10:403
1758225993028,1cyclictest105470-21isc-net-000010:50:293
1758219993028,1cyclictest604375-1kworker/1:2H+kblockd08:08:441
1758219993028,1cyclictest1260-21snmpd11:17:111
1758219992929,0cyclictest1260-21snmpd09:29:341
1758219992929,0cyclictest1260-21snmpd09:29:341
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional