You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 00:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Tue Dec 16, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21929562610,0sleep72192957-21uname12:04:597
161472325520,30sleep70-21swapper/707:05:187
1615322994239,2cyclictest2239874-21kworker/u16:4+events_unbound12:29:564
1615332993730,6cyclictest1735345-21latency_hist08:09:437
161487823727,7sleep60-21swapper/607:07:256
1615327993532,2cyclictest2065130-21kworker/u16:4+flush-8:010:59:565
1615332993428,5cyclictest1686859-21latency_hist07:44:437
1615322993431,2cyclictest2006642-21kworker/u16:2+events_unbound11:04:434
1615322993331,2cyclictest1726017-21kworker/u16:2+events_unbound08:29:454
161500023321,9sleep40-21swapper/407:09:084
1615322993231,1cyclictest1861527-21kworker/u16:0+flush-8:009:49:424
161479423221,8sleep50-21swapper/507:06:125
1615322993129,2cyclictest2152897-21kworker/u16:3+events_unbound12:15:024
1615328993028,2cyclictest2006642-21kworker/u16:2+flush-8:010:40:126
1615328992927,2cyclictest2041656-21kworker/u16:0+events_unbound11:02:546
1615327992927,2cyclictest2143207-21kworker/u16:1+flush-8:012:05:115
1615327992927,2cyclictest2025336-21kworker/u16:3+events_unbound11:17:535
1615322992927,2cyclictest1948904-21kworker/u16:2+events_unbound10:09:584
19478892280,1chrt1939382-21/usr/sbin/munin09:55:117
1615328992826,2cyclictest2216109-21kworker/u16:2+events_unbound12:27:136
1615328992826,2cyclictest2025336-21kworker/u16:3+events_unbound11:24:596
1615328992826,2cyclictest2025336-21kworker/u16:3+events_unbound11:24:596
1615328992826,2cyclictest1821770-21kworker/u16:4+events_unbound09:03:536
1615328992826,2cyclictest1821770-21kworker/u16:4+events_unbound09:03:536
1615327992826,2cyclictest1657821-21kworker/u16:1+events_unbound07:39:455
1615328992725,2cyclictest1975695-21kworker/u16:3+events_unbound10:17:496
1615328992725,2cyclictest1850834-21kworker/u16:5+events_unbound09:05:176
1615328992724,2cyclictest1881086-21kworker/u16:2+events_unbound09:24:456
1615322992725,2cyclictest2041656-21kworker/u16:0+flush-8:010:49:374
1615322992725,2cyclictest2006642-21kworker/u16:2+flush-8:010:50:024
1615328992624,2cyclictest2239874-21kworker/u16:4+flush-8:012:39:426
1615328992624,2cyclictest2216109-21kworker/u16:2+events_unbound12:31:536
1615328992624,2cyclictest2143207-21kworker/u16:1+events_unbound12:07:136
1615328992624,2cyclictest2006642-21kworker/u16:2+events_unbound11:59:056
1615327992624,2cyclictest2152897-21kworker/u16:3+events_unbound12:01:535
1615327992624,2cyclictest1861527-21kworker/u16:0+events_unbound09:53:535
1615327992624,2cyclictest1821770-21kworker/u16:4+events_unbound10:24:305
1615327992624,2cyclictest1745291-21kworker/u16:3+events_unbound08:29:065
1615327992624,2cyclictest1726017-21kworker/u16:2+events_unbound08:15:545
1615327992623,2cyclictest1821770-21kworker/u16:4+flush-8:010:14:585
1615327992623,2cyclictest1764594-21kworker/u16:0+events_unbound08:39:455
1615322992624,2cyclictest1915219-21kworker/u16:1+events_unbound09:54:434
1615322992624,2cyclictest1821770-21kworker/u16:4+flush-8:009:10:064
1615328992523,2cyclictest2041656-21kworker/u16:0+events_unbound11:08:576
1615328992523,2cyclictest2025336-21kworker/u16:3+events_unbound10:50:536
1615328992523,2cyclictest1915219-21kworker/u16:1+events_unbound09:53:336
1615328992523,2cyclictest1614293-21kworker/u16:0+events_unbound07:10:016
1615327992524,1cyclictest2006642-21kworker/u16:2+events_unbound11:19:565
1615327992523,2cyclictest2216109-21kworker/u16:2+events_unbound12:25:535
1615327992523,2cyclictest1915219-21kworker/u16:1+events_unbound10:11:345
1615327992523,2cyclictest1821770-21kworker/u16:4+events_unbound09:31:595
1615327992523,2cyclictest1821770-21kworker/u16:4+events_unbound09:26:585
1615327992523,2cyclictest1764594-21kworker/u16:0+events_unbound08:35:545
1615327992523,2cyclictest1657821-21kworker/u16:1+events_unbound08:02:025
1615328992422,2cyclictest2216109-21kworker/u16:2+events_unbound12:17:136
1615328992422,2cyclictest1726017-21kworker/u16:2+events_unbound08:19:436
1615327992422,2cyclictest2152897-21kworker/u16:3+events_unbound12:10:035
1615327992422,2cyclictest2025336-21kworker/u16:3+events_unbound11:30:005
1615327992422,2cyclictest2025336-21kworker/u16:3+events_unbound10:57:535
1615327992422,2cyclictest2006642-21kworker/u16:2+flush-8:011:50:085
1615327992422,2cyclictest1726017-21kworker/u16:2+events_unbound08:22:075
1615322992422,2cyclictest2152897-21kworker/u16:3+flush-8:012:00:064
1615328992321,2cyclictest2006642-21kworker/u16:2+flush-8:011:35:076
1615328992321,2cyclictest2006642-21kworker/u16:2+events_unbound11:10:026
1615328992321,2cyclictest1783945-21kworker/u16:1+events_unbound09:31:426
1615328992321,2cyclictest1783945-21kworker/u16:1+events_unbound08:46:536
1615328992320,2cyclictest1821770-21kworker/u16:4+events_unbound09:34:476
1615327992321,2cyclictest2006642-21kworker/u16:2+events_unbound10:38:515
1615327992321,2cyclictest2006642-21kworker/u16:2+events_unbound10:38:515
1615327992321,2cyclictest1861527-21kworker/u16:0+events_unbound09:40:535
1615327992321,2cyclictest1783945-21kworker/u16:1+events_unbound08:56:535
1615327992321,2cyclictest1614293-21kworker/u16:0+events_unbound07:53:065
1615327992320,2cyclictest1861527-21kworker/u16:0+events_unbound09:44:475
1615322992321,2cyclictest2152897-21kworker/u16:3+flush-8:012:34:534
1615322992321,2cyclictest1813216-21kworker/u16:3+flush-8:009:04:434
1615322992321,2cyclictest1813216-21kworker/u16:3+flush-8:009:04:434
1615322992321,2cyclictest1726017-21kworker/u16:2+events_unbound08:49:374
1615322992321,2cyclictest1726017-21kworker/u16:2+events_unbound08:10:024
1615322992321,2cyclictest1726017-21kworker/u16:2+events_unbound08:10:024
1615332992221,0cyclictest0-21swapper/709:45:137
161533299220,20cyclictest2210741-21latency_hist12:14:427
1615328992220,2cyclictest2152897-21kworker/u16:3+events_unbound11:49:346
1615328992220,2cyclictest2041656-21kworker/u16:0+flush-8:010:45:156
1615328992220,2cyclictest2006642-21kworker/u16:2+events_unbound11:43:136
1615328992220,2cyclictest1987845-21kworker/u16:0+events_unbound10:39:116
1615328992220,2cyclictest1987845-21kworker/u16:0+events_unbound10:39:116
1615328992220,2cyclictest1915219-21kworker/u16:1+events_unbound10:11:426
1615328992220,2cyclictest1861527-21kworker/u16:0+flush-8:010:05:126
1615328992220,2cyclictest1861527-21kworker/u16:0+events_unbound10:03:336
1615328992220,2cyclictest1821770-21kworker/u16:4+events_unbound10:22:586
1615328992220,2cyclictest1614293-21kworker/u16:0+events_unbound07:26:436
1615328992219,2cyclictest1614293-21kworker/u16:0+events_unbound07:19:476
1615327992220,2cyclictest2117307-21kworker/u16:0+events_unbound12:15:125
1615327992220,2cyclictest2006642-21kworker/u16:2+events_unbound11:42:525
1615327992220,2cyclictest1821770-21kworker/u16:4+flush-8:009:09:535
1615327992220,2cyclictest1657821-21kworker/u16:1+events_unbound07:35:545
1615322992220,2cyclictest1861527-21kworker/u16:0+events_unbound10:05:014
1615322992220,2cyclictest1861527-21kworker/u16:0+events_unbound09:59:384
1615322992220,2cyclictest1745291-21kworker/u16:3+flush-8:008:20:014
1615328992119,2cyclictest2025336-21kworker/u16:3+events_unbound11:33:036
1615328992119,2cyclictest1915219-21kworker/u16:1+flush-8:010:25:106
1615328992119,2cyclictest1850834-21kworker/u16:5+events_unbound09:11:506
1615328992119,2cyclictest1821770-21kworker/u16:4+events_unbound09:23:196
1615328992119,2cyclictest1764594-21kworker/u16:0+events_unbound08:36:146
1615328992119,2cyclictest1745291-21kworker/u16:3+events_unbound08:17:266
1615328992119,2cyclictest1657821-21kworker/u16:1+events_unbound08:03:186
1615328992119,2cyclictest1605078-21kworker/u16:4+events_unbound07:52:526
1615328992118,2cyclictest2006642-21kworker/u16:2+events_unbound11:19:466
1615328992118,2cyclictest1861527-21kworker/u16:0+events_unbound09:14:536
1615328992118,2cyclictest1657821-21kworker/u16:1+flush-8:007:45:106
1615327992119,2cyclictest2152897-21kworker/u16:3+events_unbound11:49:135
1615327992119,2cyclictest2006642-21kworker/u16:2+events_unbound11:39:015
1615327992119,2cyclictest1861527-21kworker/u16:0+events_unbound09:38:095
1615327992119,2cyclictest1850834-21kworker/u16:5+events_unbound09:07:185
1615322992119,2cyclictest1657821-21kworker/u16:1+events_unbound07:39:434
1615322992117,3cyclictest2065072-21pool-/usr/libex10:59:364
1615328992018,2cyclictest2117307-21kworker/u16:0+events_unbound12:21:146
1615328992018,2cyclictest2025336-21kworker/u16:3+events_unbound11:17:146
1615328992018,2cyclictest2006642-21kworker/u16:2+events_unbound11:49:566
1615328992018,2cyclictest2006642-21kworker/u16:2+events_unbound10:58:346
1615328992018,2cyclictest1915219-21kworker/u16:1+events_unbound09:58:506
1615328992018,2cyclictest1821770-21kworker/u16:4+events_unbound10:32:546
1615328992018,2cyclictest1783945-21kworker/u16:1+events_unbound08:59:156
1615328992018,2cyclictest1726017-21kworker/u16:2+events_unbound08:41:506
1615328992018,2cyclictest1726017-21kworker/u16:2+events_unbound08:04:506
1615327992018,2cyclictest2216109-21kworker/u16:2+events_unbound12:24:105
1615327992018,2cyclictest2117307-21kworker/u16:0+events_unbound11:26:345
1615327992018,2cyclictest2117307-21kworker/u16:0+events_unbound11:26:345
1615327992018,2cyclictest2006642-21kworker/u16:2+events_unbound10:45:055
1615327992018,2cyclictest2006642-21kworker/u16:2+events_unbound10:40:195
1615327992018,2cyclictest1915219-21kworker/u16:1+events_unbound10:03:535
1615327992018,2cyclictest1821770-21kworker/u16:4+events_unbound10:26:335
1615327992018,2cyclictest1783945-21kworker/u16:1+events_unbound08:51:465
1615327992018,2cyclictest1726017-21kworker/u16:2+events_unbound08:30:355
1615327992018,2cyclictest1614293-21kworker/u16:0+events_unbound07:30:535
1615327992018,2cyclictest1605078-21kworker/u16:4+flush-8:007:10:335
1615327992017,2cyclictest1726017-21kworker/u16:2+events_unbound08:04:445
1615322992018,2cyclictest2025336-21kworker/u16:3+events_unbound11:20:064
1615328991917,2cyclictest2152897-21kworker/u16:3+events_unbound12:02:446
1615328991917,2cyclictest1915219-21kworker/u16:1+events_unbound09:42:216
1615328991917,2cyclictest1726017-21kworker/u16:2+events_unbound08:28:386
1615328991917,2cyclictest1668614-21kworker/u16:2+events_unbound07:36:356
1615328991917,2cyclictest1614293-21kworker/u16:0+events_unbound07:57:266
1615328991917,2cyclictest1614293-21kworker/u16:0+events_unbound07:33:436
1615327991917,2cyclictest2239874-21kworker/u16:4+events_unbound12:36:385
1615327991917,2cyclictest2239874-21kworker/u16:4+events_unbound12:32:145
1615327991917,2cyclictest2065130-21kworker/u16:4+events_unbound11:06:335
1615327991917,2cyclictest2025336-21kworker/u16:3+events_unbound10:52:425
1615327991917,2cyclictest1821770-21kworker/u16:4+events_unbound10:32:305
1615327991917,2cyclictest1813216-21kworker/u16:3+events_unbound09:01:525
1615327991917,2cyclictest1813216-21kworker/u16:3+events_unbound09:01:525
1615327991917,2cyclictest1614293-21kworker/u16:0+events_unbound07:23:305
1615327991917,2cyclictest1595438-21kworker/u16:3+events_unbound07:18:155
1615327991916,2cyclictest1735728-21kworker/u16:0+flush-8:008:09:535
1615327991916,2cyclictest1735728-21kworker/u16:0+flush-8:008:09:535
1615322991917,2cyclictest2117307-21kworker/u16:0+events_unbound11:49:424
1615322991917,2cyclictest1783945-21kworker/u16:1+events_unbound09:30:124
1615322991917,2cyclictest1745291-21kworker/u16:3+flush-8:008:19:384
1615332991812,5cyclictest1812977-21latency_hist08:49:427
1615328991816,2cyclictest2152897-21kworker/u16:3+events_unbound12:13:546
1615328991816,2cyclictest1764594-21kworker/u16:0+events_unbound08:31:506
1615328991816,2cyclictest1668614-21kworker/u16:2+events_unbound07:43:516
1615327991816,2cyclictest1783945-21kworker/u16:1+events_unbound08:47:535
1615322991816,2cyclictest2006642-21kworker/u16:2+events_unbound11:30:074
1615322991816,2cyclictest1915219-21kworker/u16:1+flush-8:010:25:254
1615322991815,2cyclictest1657821-21kworker/u16:1+events_unbound07:44:504
1615332991713,3cyclictest1267-21snmpd07:44:597
161533299170,2cyclictest2068209-21cut11:00:007
1615328991715,2cyclictest1821770-21kworker/u16:4+events_unbound09:47:186
1615328991715,2cyclictest1595438-21kworker/u16:3+events_unbound07:18:276
1615327991715,2cyclictest1821770-21kworker/u16:4+events_unbound09:21:345
1615322991715,2cyclictest2006642-21kworker/u16:2+events_unbound11:54:454
1615322991715,2cyclictest1987845-21kworker/u16:0+flush-8:010:20:024
1615322991715,2cyclictest1850834-21kworker/u16:5+events_unbound09:05:154
1615322991715,2cyclictest1783945-21kworker/u16:1+events_unbound09:27:184
1615322991714,2cyclictest1861527-21kworker/u16:0+events_unbound09:19:584
1615332991611,4cyclictest1977757-21latency_hist10:14:437
1615328991614,2cyclictest1735728-21kworker/u16:0+events_unbound08:11:546
1615328991614,2cyclictest1735728-21kworker/u16:0+events_unbound08:11:546
1615327991614,2cyclictest1915219-21kworker/u16:1+events_unbound09:57:515
1615327991614,2cyclictest1605078-21kworker/u16:4+events_unbound07:29:145
1615327991613,2cyclictest1821770-21kworker/u16:4+events_unbound09:14:455
1615322991614,2cyclictest2065130-21kworker/u16:4+events_unbound11:07:534
1615322991614,2cyclictest2025336-21kworker/u16:3+events_unbound11:35:124
1615322991614,2cyclictest1783945-21kworker/u16:1+flush-8:008:40:074
1615322991614,2cyclictest1605078-21kworker/u16:4+flush-8:007:25:124
1615327991513,2cyclictest2152897-21kworker/u16:3+events_unbound11:56:425
1615327991513,2cyclictest2006642-21kworker/u16:2+events_unbound11:10:335
1615322991513,2cyclictest2025336-21kworker/u16:3+events_unbound10:40:064
1615322991513,2cyclictest1987845-21kworker/u16:0+events_unbound10:33:454
1615322991513,2cyclictest1614293-21kworker/u16:0+events_unbound08:00:304
1615322991513,2cyclictest1605078-21kworker/u16:4+events_unbound07:50:144
1615322991512,2cyclictest1614293-21kworker/u16:0+flush-8:007:14:444
161533299148,5cyclictest6184-21gvfs-afc-volume07:50:057
161533299148,5cyclictest1624887-21latency_hist07:14:437
161533299146,6cyclictest6184-21gvfs-afc-volume08:19:557
161533299143,5cyclictest902-21dbus-daemon10:59:407
1615332991410,3cyclictest2035119-21ntpq10:40:097
161533299140,12cyclictest2053723-21kthreadcore10:50:057
1615328991412,2cyclictest1783945-21kworker/u16:1+events_unbound08:52:076
1615327991412,2cyclictest1657821-21kworker/u16:1+events_unbound07:56:515
1615322991413,1cyclictest0-21swapper/411:15:064
1615322991412,2cyclictest1783945-21kworker/u16:1+events_unbound08:35:034
1615322991411,2cyclictest1975695-21kworker/u16:3+flush-8:010:15:134
161532299140,1cyclictest0-21swapper/410:34:544
161532299140,1cyclictest0-21swapper/410:34:544
161533299139,3cyclictest1850780-21ntpq09:05:077
161533299139,3cyclictest1267-21snmpd12:14:457
161533299139,3cyclictest1267-21snmpd12:00:007
161533299139,3cyclictest1267-21snmpd11:22:417
161533299139,3cyclictest1267-21snmpd10:33:007
161533299139,3cyclictest1267-21snmpd08:13:187
161533299139,3cyclictest1267-21snmpd08:13:187
161533299139,3cyclictest1267-21snmpd07:22:297
161533299138,4cyclictest1267-21snmpd11:36:237
161533299137,5cyclictest1638384-21latency_hist07:19:437
161533299137,4cyclictest2086392-21grep11:09:597
161533299136,6cyclictest0-21swapper/712:38:047
1615332991310,2cyclictest2123442-21idleruntime-cro11:29:427
1615332991310,2cyclictest2123442-21idleruntime-cro11:29:427
161533299130,12cyclictest1932882-21kthreadcore09:50:007
1615327991311,2cyclictest1668614-21kworker/u16:2+events_unbound07:46:535
1615322991312,1cyclictest0-21swapper/411:27:524
1615322991312,1cyclictest0-21swapper/411:27:524
1615322991312,1cyclictest0-21swapper/408:06:424
1615322991311,2cyclictest2143207-21kworker/u16:1+flush-8:011:50:054
1615322991311,2cyclictest2006642-21kworker/u16:2+events_unbound11:10:294
1615322991311,2cyclictest1915219-21kworker/u16:1+events_unbound09:59:504
1615322991310,2cyclictest2143207-21kworker/u16:1+events_unbound11:40:004
1615322991310,2cyclictest1668614-21kworker/u16:2+events_unbound07:39:514
161533299129,2cyclictest2151557-21ntpq11:40:097
161533299129,2cyclictest1267-21snmpd11:46:547
161533299128,3cyclictest2230495-21/usr/sbin/munin12:25:107
161533299128,3cyclictest2220789-21/usr/sbin/munin12:20:087
161533299128,3cyclictest2075325-21/usr/sbin/munin11:04:577
161533299128,3cyclictest1267-21snmpd10:08:427
161533299128,3cyclictest1267-21snmpd09:19:047
161533299128,3cyclictest1267-21snmpd08:18:457
161533299128,3cyclictest1267-21snmpd07:57:247
161533299127,4cyclictest1783771-21sshd-session08:32:517
161533299127,3cyclictest1978150-21/usr/sbin/munin10:14:577
161533299125,6cyclictest5944-21gmain10:44:577
161533299125,6cyclictest0-21swapper/708:59:517
161533299125,6cyclictest0-21swapper/708:59:517
1615332991210,1cyclictest0-21swapper/710:20:027
161533299120,4cyclictest2165267-21cat11:50:017
161533299120,2cyclictest0-21swapper/709:10:017
161533299120,11cyclictest2181652-21munin-run11:59:427
161533299120,11cyclictest0-21swapper/708:40:017
161533299120,10cyclictest1998076-21diskstats10:24:567
161533299120,10cyclictest1951995-21grep10:00:017
161533299120,10cyclictest1885304-21grep09:25:027
161533299120,10cyclictest1773347-21pmu-power08:25:097
161533299120,10cyclictest1659542-21kthreadcore07:30:007
161532299129,2cyclictest1614293-21kworker/u16:0+events_unbound07:09:514
1615322991211,1cyclictest0-21swapper/409:35:374
1615322991211,1cyclictest0-21swapper/408:25:474
161532299120,1cyclictest0-21swapper/408:57:384
161533299118,2cyclictest1267-21snmpd12:31:557
161533299118,2cyclictest0-21swapper/711:14:567
161533299117,3cyclictest1267-21snmpd09:19:497
161533299117,3cyclictest1267-21snmpd08:51:377
161533299113,7cyclictest1238-21tuned-ppd07:35:057
161533299110,9cyclictest2124585-21cat11:29:577
161533299110,1cyclictest0-21swapper/708:35:027
161533299110,10cyclictest1267-21snmpd09:38:267
161532799118,2cyclictest1861527-21kworker/u16:0+flush-8:010:05:005
161532299110,11cyclictest0-21swapper/407:24:274
161533299107,2cyclictest1267-21snmpd07:26:147
161533299106,3cyclictest1267-21snmpd08:58:407
161533299105,4cyclictest1919692-21cut09:44:427
161533299104,5cyclictest6045-21gmain08:00:017
161533299103,6cyclictest0-21swapper/709:30:507
161533299100,9cyclictest2016991-21/usr/sbin/munin10:35:097
161533299100,9cyclictest2016991-21/usr/sbin/munin10:35:097
161532299109,1cyclictest0-21swapper/412:10:074
161532299109,1cyclictest0-21swapper/409:44:084
161532299108,2cyclictest1605078-21kworker/u16:4+events_unbound07:54:504
16153229998,1cyclictest0-21swapper/412:08:044
16153229997,2cyclictest1861527-21kworker/u16:0+events_unbound09:16:544
16153229997,2cyclictest1614293-21kworker/u16:0+events_unbound07:31:254
16153229986,1cyclictest0-21swapper/408:50:014
16153229976,1cyclictest0-21swapper/412:24:574
16153229976,1cyclictest0-21swapper/412:22:544
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional