You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 15:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackbslot1.osadl.org (updated Mon Nov 03, 2025 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16931922213158,14sleep20-21swapper/207:07:262
16932422200176,14sleep10-21swapper/107:08:051
16932712198168,19sleep30-21swapper/307:08:283
16933542192168,14sleep00-21swapper/007:09:240
178236721320,1sleep01782363-21snmp_ryswitch2.08:35:020
1693595996661,3cyclictest1869701-21latency_hist10:00:001
1693596995956,2cyclictest1848250-31munin-html09:35:352
1693595995855,2cyclictest1771488-21kworker/u8:1+events_unbound08:35:091
1693595995653,2cyclictest1952457-21kworker/u8:3+flush-179:011:20:011
1693595995546,8cyclictest1709533-21kworker/u8:2+flush-179:007:25:241
1693595995451,2cyclictest1812640-21kworker/u8:1+events_unbound09:10:091
1693594995346,5cyclictest1756680-21/usr/share/muni08:10:130
1693594995345,6cyclictest1730689-21latency_hist07:45:000
1693594995340,7cyclictest2024903-21/usr/share/muni12:30:200
1693595995248,3cyclictest1962375-21kworker/u8:3+flush-179:011:40:111
1693595995248,3cyclictest1843567-21kworker/u8:0+flush-179:009:50:081
1693598995045,4cyclictest1732357-21ThreadPoolForeg07:45:153
1693596994943,4cyclictest1896253-21/usr/share/muni10:25:022
1693595994946,2cyclictest1771488-21kworker/u8:1+flush-179:008:25:141
1693595994944,4cyclictest1776597-21kworker/u8:2+flush-179:008:45:191
1693598994842,5cyclictest247515-21ThreadPoolForeg08:16:133
1693596994843,4cyclictest1712063-21ntpq07:25:162
1693596994829,18cyclictest1905951-31munin-graph10:30:502
1693595994845,2cyclictest1978670-21kworker/u8:4+flush-179:012:15:091
1693595994844,3cyclictest1969396-21apt-get11:35:141
1693595994844,3cyclictest1889813-21kworker/u8:4+flush-179:011:05:221
1693595994844,3cyclictest1672654-21kworker/u8:4+events_unbound07:30:131
1693595994744,3cyclictest1936936-21kworker/u8:2+events_unbound11:56:151
1693595994740,5cyclictest247561-21ThreadPoolForeg09:37:131
1693596994641,4cyclictest1781188-31munin-html08:30:342
1693595994644,2cyclictest1740839-21kworker/u8:1+flush-179:008:00:201
1693595994643,2cyclictest1771488-21kworker/u8:1+flush-179:008:40:341
1693595994642,3cyclictest1879865-21kworker/u8:2+flush-179:010:13:291
1693594994641,4cyclictest1943732-21apt-get11:10:120
1693594994637,7cyclictest1927210-21/usr/share/muni10:55:160
169359899451,4cyclictest247557-21chrome07:19:143
1693596994540,4cyclictest1787394-21/usr/share/muni08:40:172
1693596994532,1cyclictest1890168-21kworker/2:1+pm10:22:432
1693595994543,2cyclictest1740825-21kworker/u8:0+flush-179:009:19:431
1693595994541,3cyclictest1978670-21kworker/u8:4+flush-179:012:05:161
1693595994541,3cyclictest1776597-21kworker/u8:2+flush-179:009:21:391
1693594994538,5cyclictest1984987-21apt-get11:50:150
1693598994439,3cyclictest1926955-21latency_hist10:55:003
1693596994438,4cyclictest1915792-31munin-html10:40:342
1693595994442,2cyclictest1865086-21kworker/u8:1+events_unbound10:45:251
1693595994442,1cyclictest0-21swapper/108:20:341
1693595994441,2cyclictest1831320-21kworker/u8:4+events_unbound09:30:081
1693595994441,2cyclictest1776597-21kworker/u8:2+flush-179:008:30:351
1693595994440,3cyclictest1843567-21kworker/u8:0+flush-179:009:45:261
1693595994440,3cyclictest1709533-21kworker/u8:2+events_unbound07:40:101
1693594994440,3cyclictest1776597-21kworker/u8:2+flush-179:009:14:390
1693594994440,3cyclictest1720133-21kworker/u8:1+flush-179:007:35:320
1693598994340,2cyclictest1776597-21kworker/u8:2+flush-179:009:45:123
1693598994339,3cyclictest1709533-21kworker/u8:2+flush-179:007:44:143
1693598994338,4cyclictest247515-21ThreadPoolForeg07:50:093
169359899430,2cyclictest247560-21ThreadPoolForeg07:59:483
1693596994339,2cyclictest1725264-21kworker/u8:3+flush-179:008:25:022
1693595994341,2cyclictest1735641-21kworker/u8:4+events_unbound07:55:321
1693595994340,2cyclictest1889813-21kworker/u8:4+flush-179:010:40:321
1693595994340,2cyclictest1889813-21kworker/u8:4+flush-179:010:30:271
1693595994340,2cyclictest1812640-21kworker/u8:1+flush-179:009:25:361
1693595994339,3cyclictest1889813-21kworker/u8:4+flush-179:010:50:201
1693595994337,5cyclictest76405-21systemd-journal07:20:341
1693595994329,13cyclictest1260-21snmpd07:15:291
1693594994340,1cyclictest1731033-21ThreadPoolForeg07:45:200
1693594994337,4cyclictest1827524-21munin-limits09:15:340
1693598994239,2cyclictest1843567-21kworker/u8:0+flush-179:010:00:163
1693598994237,3cyclictest2014191-21kworker/u8:3+flush-179:012:20:083
1693598994229,12cyclictest1746494-21/usr/share/muni08:00:043
1693596994239,2cyclictest1978670-21kworker/u8:4+events_unbound12:05:172
1693595994240,2cyclictest1889813-21kworker/u8:4+flush-179:010:18:031
1693595994239,2cyclictest2029760-21kworker/u8:2+events_unbound12:35:291
1693595994238,3cyclictest1978670-21kworker/u8:4+flush-179:012:10:111
1693595994238,3cyclictest1889813-21kworker/u8:4+events_unbound10:35:341
1693595994237,4cyclictest2014191-21kworker/u8:3+events_unbound12:30:091
1693595994235,5cyclictest1802658-21latency_hist08:55:011
1693595994229,12cyclictest1260-21snmpd07:12:281
1693594994221,12cyclictest1854380-13chrome09:45:020
1693598994129,11cyclictest1260-21snmpd11:01:103
169359899410,2cyclictest247557-21chrome12:15:033
1693596994136,4cyclictest247560-21ThreadPoolForeg07:20:182
1693596994136,3cyclictest1890168-21kworker/2:1+pm11:15:042
1693596994135,4cyclictest1808033-21/usr/share/muni09:00:122
1693596994117,23cyclictest1889745-31munin-html10:15:472
1693595994139,2cyclictest1725264-21kworker/u8:3+flush-179:008:15:351
1693595994138,2cyclictest1932121-21kworker/1:0+pm11:03:341
1693595994138,2cyclictest1740825-21kworker/u8:0+events_unbound08:58:591
1693595994137,3cyclictest1978670-21kworker/u8:4+flush-179:011:53:231
1693595994137,3cyclictest1931799-21kworker/u8:0+flush-179:011:10:091
1693595994137,3cyclictest1889813-21kworker/u8:4+events_unbound10:28:291
1693595994137,3cyclictest1776597-21kworker/u8:2+flush-179:009:00:221
1693594994135,4cyclictest1736278-21/usr/share/muni07:50:140
1693594994134,5cyclictest247561-21ThreadPoolForeg07:30:080
18750912400,0chrt1875090-21sshd10:05:012
1693598994037,2cyclictest1843567-21kworker/u8:0+flush-179:009:35:073
1693598994037,2cyclictest1260-21snmpd10:17:463
1693596994038,1cyclictest1746329-21kworker/2:0+pm08:57:052
1693596994037,2cyclictest1890168-21kworker/2:1+pm11:25:032
1693596994037,2cyclictest1746329-21kworker/2:0+pm09:18:442
1693596994036,2cyclictest1746329-21kworker/2:0+pm08:09:192
169359699401,27cyclictest247557-21chrome07:31:202
1693595994038,2cyclictest1725264-21kworker/u8:3+events_unbound07:45:351
1693595994036,3cyclictest2014191-21kworker/u8:3+flush-179:012:25:251
1693595994034,4cyclictest1879865-21kworker/u8:2+flush-179:010:20:211
1693594994034,6cyclictest1260-21snmpd07:20:080
1693598993937,1cyclictest1901339-21kworker/3:2+pm10:49:183
1693598993936,2cyclictest1889813-21kworker/u8:4+flush-179:010:40:153
1693596993937,1cyclictest1890168-21kworker/2:1+pm11:10:592
1693596993937,1cyclictest1890168-21kworker/2:1+pm11:09:182
1693596993937,1cyclictest1874618-21kworker/2:2+pm10:10:172
1693596993936,2cyclictest1996056-21kworker/2:0+pm12:35:052
1693596993936,2cyclictest1996056-21kworker/2:0+pm12:13:452
1693596993936,2cyclictest1890168-21kworker/2:1+pm11:46:152
1693596993936,2cyclictest1890168-21kworker/2:1+pm11:42:012
1693596993936,2cyclictest1890168-21kworker/2:1+pm11:33:342
1693596993936,2cyclictest1746329-21kworker/2:0+pm09:45:012
1693596993936,2cyclictest1746329-21kworker/2:0+pm09:26:092
1693596993936,2cyclictest1688300-21kworker/2:2+pm07:50:352
1693596993936,2cyclictest1688300-21kworker/2:2+pm07:17:132
1693596993936,2cyclictest1688300-21kworker/2:2+pm07:11:392
1693596993935,3cyclictest2014985-21/usr/share/muni12:20:112
1693596993935,3cyclictest1996056-21kworker/2:0+pm12:30:322
1693596993934,3cyclictest1688300-21kworker/2:2+pm08:00:342
1693596993914,24cyclictest247468-13Chrome_IOThread07:46:152
1693595993936,2cyclictest1865086-21kworker/u8:1+flush-179:010:00:241
1693595993935,3cyclictest1720133-21kworker/u8:1+flush-179:007:35:301
1693595993935,2cyclictest1978431-21snmp_ryswitch.c11:45:011
1693595993935,2cyclictest1926883-21kworker/1:2+pm10:59:191
1693595993931,7cyclictest1931799-21kworker/u8:0+flush-179:011:21:261
1693594993935,3cyclictest1865086-21kworker/u8:1+flush-179:010:34:080
1693594993935,3cyclictest1140727-1kworker/0:1H+kblockd09:29:230
1693594993935,3cyclictest1140727-1kworker/0:1H+kblockd08:01:120
1693594993934,4cyclictest1890757-21/usr/share/muni10:20:240
1693594993933,5cyclictest247561-21ThreadPoolForeg11:30:040
1693594993933,4cyclictest1710309-21base6407:25:000
1693594993929,8cyclictest1853304-21ntpq09:40:330
1693598993836,1cyclictest1730423-21kworker/3:0+pm09:54:493
1693598993836,1cyclictest1730423-21kworker/3:0+pm08:32:433
1693598993834,3cyclictest2014191-21kworker/u8:3+flush-179:012:35:183
1693598993832,4cyclictest1906563-21/usr/share/muni10:35:063
1693596993836,1cyclictest1989653-21kworker/2:2+pm12:02:472
1693596993836,1cyclictest1746329-21kworker/2:0+pm09:57:232
1693596993836,1cyclictest1746329-21kworker/2:0+pm09:53:442
1693596993836,1cyclictest1746329-21kworker/2:0+pm08:36:342
1693596993836,1cyclictest1746329-21kworker/2:0+pm08:19:192
1693596993836,1cyclictest1688300-21kworker/2:2+pm07:42:242
1693596993835,2cyclictest1890168-21kworker/2:1+pm11:39:042
1693596993835,2cyclictest1890168-21kworker/2:1+pm11:00:102
1693596993835,2cyclictest1865086-21kworker/u8:1+flush-179:010:00:202
1693596993835,2cyclictest1746329-21kworker/2:0+pm09:47:342
1693596993835,2cyclictest1746329-21kworker/2:0+pm08:50:062
1693596993835,2cyclictest1746329-21kworker/2:0+pm08:10:042
1693596993835,2cyclictest1688300-21kworker/2:2+pm07:38:022
1693596993834,3cyclictest1890168-21kworker/2:1+pm11:53:192
1693596993834,2cyclictest1890168-21kworker/2:1+pm10:38:552
1693595993833,4cyclictest247516-21Chrome_ChildIOT09:40:231
1693595993832,4cyclictest2019165-31munin-html12:20:371
1693595993824,13cyclictest1735641-21kworker/u8:4+events_unbound08:13:001
1693594993834,2cyclictest1140727-1kworker/0:1H+kblockd11:15:040
1693594993833,4cyclictest247516-21Chrome_ChildIOT09:20:080
1693594993832,4cyclictest1844125-21/usr/share/muni09:35:090
1693598993735,1cyclictest1730423-21kworker/3:0+pm08:12:543
1693598993734,2cyclictest586384-1kworker/3:0H+kblockd11:24:333
1693598993734,2cyclictest586384-1kworker/3:0H+kblockd11:10:013
1693598993734,2cyclictest586384-1kworker/3:0H+kblockd09:15:043
1693598993734,2cyclictest586384-1kworker/3:0H+kblockd09:09:443
1693598993733,3cyclictest1962375-21kworker/u8:3+events_unbound11:31:483
1693596993735,1cyclictest1890168-21kworker/2:1+pm11:57:342
1693596993735,1cyclictest1890168-21kworker/2:1+pm10:55:212
1693596993735,1cyclictest1890168-21kworker/2:1+pm10:53:532
1693596993735,1cyclictest1746329-21kworker/2:0+pm08:49:102
1693596993735,1cyclictest1688300-21kworker/2:2+pm07:55:342
1693596993734,2cyclictest1890168-21kworker/2:1+pm10:47:482
1693596993733,3cyclictest1936936-21kworker/u8:2+events_unbound11:20:132
1693596993732,4cyclictest2021300-21apt-get12:25:142
1693595993734,2cyclictest1053170-1kworker/1:0H+kblockd12:03:491
1693595993733,3cyclictest1931799-21kworker/u8:0+events_unbound11:30:201
1693594993735,1cyclictest1766325-21kworker/0:0+pm08:34:030
1693594993734,2cyclictest1140727-1kworker/0:1H+kblockd12:28:500
1693594993734,2cyclictest1140727-1kworker/0:1H+kblockd11:43:120
1693594993734,2cyclictest1140727-1kworker/0:1H+kblockd11:02:190
1693594993734,2cyclictest1140727-1kworker/0:1H+kblockd10:41:070
1693594993734,2cyclictest1140727-1kworker/0:1H+kblockd08:17:070
1693594993733,3cyclictest2004515-21kworker/0:2+pm12:23:440
1693594993733,3cyclictest1140727-1kworker/0:1H+kblockd08:08:030
1693594993733,2cyclictest1140727-1kworker/0:1H+kblockd12:38:040
1693594993733,2cyclictest1140727-1kworker/0:1H+kblockd08:55:150
1693594993732,4cyclictest1781861-21kworker/0:2+pm08:42:030
1693594993729,6cyclictest247516-21Chrome_ChildIOT11:07:290
1693594993727,9cyclictest247505-21Chrome_DevTools11:45:170
1693598993634,1cyclictest586384-1kworker/3:0H+kblockd08:55:143
1693598993634,1cyclictest586384-1kworker/3:0H+kblockd08:44:283
1693598993634,1cyclictest586384-1kworker/3:0H+kblockd07:20:193
1693598993634,1cyclictest1901339-21kworker/3:2+pm11:18:273
1693598993633,2cyclictest586384-1kworker/3:0H+kblockd12:10:243
1693598993633,2cyclictest586384-1kworker/3:0H+kblockd11:59:083
1693598993633,2cyclictest586384-1kworker/3:0H+kblockd08:23:483
1693598993631,4cyclictest1879865-21kworker/u8:2+flush-179:010:26:303
1693598993631,4cyclictest1771488-21kworker/u8:1+flush-179:008:35:333
1693598993624,1cyclictest1260-21snmpd08:25:363
1693596993634,1cyclictest1746329-21kworker/2:0+pm09:05:262
1693596993634,1cyclictest1746329-21kworker/2:0+pm08:22:542
1693596993633,2cyclictest1996056-21kworker/2:0+pm12:18:592
1693596993633,2cyclictest1746329-21kworker/2:0+pm09:30:092
1693595993633,2cyclictest1053170-1kworker/1:0H+kblockd11:26:121
1693595993632,3cyclictest1865086-21kworker/u8:1+events_unbound10:05:191
1693595993628,7cyclictest1260-21snmpd08:05:131
169359599360,2cyclictest281ktimers/107:50:031
1693594993633,2cyclictest1140727-1kworker/0:1H+kblockd10:54:290
1693594993633,2cyclictest1140727-1kworker/0:1H+kblockd10:38:200
1693594993632,3cyclictest1771488-21kworker/u8:1+flush-179:008:25:310
1693594993631,4cyclictest1869984-21/usr/share/muni10:00:140
1693594993631,4cyclictest1817166-21munin-limits09:05:320
1693594993631,3cyclictest1854099-21kworker/0:1+pm10:05:290
1693594993630,5cyclictest1961911-31munin-html11:25:450
1693598993534,1cyclictest586384-1kworker/3:0H+kblockd09:21:353
1693598993534,1cyclictest1901339-21kworker/3:2+pm12:02:233
1693598993533,1cyclictest586384-1kworker/3:0H+kblockd10:34:243
1693598993533,1cyclictest1730423-21kworker/3:0+pm09:57:043
1693598993533,1cyclictest1730423-21kworker/3:0+pm09:10:293
1693598993533,1cyclictest1730423-21kworker/3:0+pm08:49:033
1693598993533,1cyclictest1704774-21kworker/3:3+pm07:27:043
1693598993532,2cyclictest586384-1kworker/3:0H+kblockd11:43:233
1693598993532,2cyclictest586384-1kworker/3:0H+kblockd09:33:043
1693598993532,2cyclictest586384-1kworker/3:0H+kblockd07:38:093
1693598993532,2cyclictest1901339-21kworker/3:2+pm12:29:043
1693598993532,2cyclictest1740825-21kworker/u8:0+flush-179:008:50:033
1693598993530,4cyclictest1833604-21/usr/share/muni09:25:243
1693596993532,2cyclictest1746329-21kworker/2:0+pm09:20:022
1693596993532,2cyclictest1746329-21kworker/2:0+pm09:10:562
1693595993532,2cyclictest1053170-1kworker/1:0H+kblockd09:06:131
1693594993533,1cyclictest1140727-1kworker/0:1H+kblockd10:20:010
1693594993533,1cyclictest1140727-1kworker/0:1H+kblockd07:18:480
1693594993532,2cyclictest2004515-21kworker/0:2+pm12:15:290
1693594993532,2cyclictest1916817-21ThreadPoolForeg10:45:020
1693594993532,2cyclictest1854099-21kworker/0:1+pm09:53:290
1693594993532,2cyclictest1140727-1kworker/0:1H+kblockd09:55:130
1693594993532,2cyclictest1140727-1kworker/0:1H+kblockd07:55:050
1693594993531,2cyclictest247468-13Chrome_IOThread08:45:020
1693594993528,6cyclictest1260-21snmpd12:11:580
1693594993528,4cyclictest1972952-21latency_hist11:40:010
1693598993431,2cyclictest586384-1kworker/3:0H+kblockd09:41:133
1693598993430,3cyclictest1936936-21kworker/u8:2+flush-179:011:25:293
1693598993430,3cyclictest1879865-21kworker/u8:2+flush-179:010:20:303
1693598993429,3cyclictest2004232-21latency_hist12:10:003
1693598993428,5cyclictest247468-13Chrome_IOThread08:07:203
1693598993428,5cyclictest1693645-21/usr/share/muni07:10:173
1693594993432,1cyclictest1140727-1kworker/0:1H+kblockd07:10:350
1693594993431,2cyclictest1140727-1kworker/0:1H+kblockd11:21:440
1693594993430,3cyclictest1781861-21kworker/0:2+pm08:52:570
1693594993430,3cyclictest1260-21snmpd12:00:250
1693598993331,1cyclictest586384-1kworker/3:0H+kblockd07:32:053
1693598993331,1cyclictest1901339-21kworker/3:2+pm11:48:133
1693594993331,1cyclictest1140727-1kworker/0:1H+kblockd12:05:580
1693594993330,2cyclictest1140727-1kworker/0:1H+kblockd09:00:040
1693594993328,4cyclictest1993617-21munin-limits11:55:390
1693598993230,1cyclictest586384-1kworker/3:0H+kblockd10:55:063
1693598993229,2cyclictest586384-1kworker/3:0H+kblockd11:05:003
1693598993229,2cyclictest2024959-1kworker/3:2H+kblockd12:30:153
169359499325,5cyclictest247505-13Chrome_DevTools10:11:420
1693594993229,2cyclictest1260-21snmpd08:24:210
1693594993229,2cyclictest1140727-1kworker/0:1H+kblockd10:26:100
1693598993129,1cyclictest586384-1kworker/3:0H+kblockd10:08:093
1693598993129,1cyclictest1260-21snmpd11:51:513
1693598993128,2cyclictest586384-1kworker/3:0H+kblockd11:35:323
1693598993126,4cyclictest247561-21ThreadPoolForeg09:01:293
1693598993116,14cyclictest247562-13Chrome_ChildIOT10:10:143
169359499319,11cyclictest247557-21chrome09:34:370
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional