You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 01:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Tue Sep 01, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
205952121030,1sleep72059522-21kthreadcore23:44:557
144104126857,7sleep40-21swapper/419:05:514
144131425746,8sleep50-21swapper/519:09:375
143204125319,29sleep70-21swapper/719:04:417
1441639995247,4cyclictest1861797-21latency_hist22:24:387
1441635994341,2cyclictest1862183-21kworker/u16:1+flush-8:022:34:386
1441635994341,2cyclictest1862183-21kworker/u16:1+flush-8:022:34:386
1441635994038,2cyclictest1862183-21kworker/u16:1+flush-8:022:59:396
1441627993835,2cyclictest1650539-21kworker/u16:0+events_unbound21:14:544
1441627993735,2cyclictest2033114-21kworker/u16:5+events_unbound23:35:364
1441627993735,2cyclictest1862183-21kworker/u16:1+events_unbound23:07:004
1441627993735,2cyclictest1650539-21kworker/u16:0+events_unbound21:54:204
1441627993735,2cyclictest1650539-21kworker/u16:0+events_unbound21:54:204
1441627993634,2cyclictest1862183-21kworker/u16:1+events_unbound22:56:004
1441627993634,2cyclictest1568612-21kworker/u16:4+events_unbound21:27:574
1441627993533,2cyclictest2033114-21kworker/u16:5+events_unbound00:25:034
1441627993533,2cyclictest1862183-21kworker/u16:1+events_unbound22:31:244
1441627993533,2cyclictest1862183-21kworker/u16:1+events_unbound22:31:244
1441627993533,2cyclictest1739741-21kworker/u16:2+events_unbound22:25:404
1441627993533,2cyclictest1650539-21kworker/u16:0+events_unbound21:42:134
1441627993533,2cyclictest1650539-21kworker/u16:0+events_unbound21:11:404
1441627993432,2cyclictest2008569-21kworker/u16:4+events_unbound00:22:114
1441627993432,2cyclictest1947487-21kworker/u16:0+events_unbound23:22:134
19442342330,1chrt1944236-21missed_timers22:55:037
1441627993331,2cyclictest1800853-21kworker/u16:4+events_unbound22:43:024
1441627993331,2cyclictest1800853-21kworker/u16:4+events_unbound22:18:194
1441627993331,2cyclictest1800852-21kworker/u16:3+events_unbound22:08:134
1441627993331,2cyclictest1650539-21kworker/u16:0+events_unbound22:03:414
21589662320,1chrt2158967-21cstates00:29:517
1441627993230,2cyclictest2008569-21kworker/u16:4+events_unbound23:58:574
1441627993230,2cyclictest1973253-21kworker/u16:2+events_unbound00:06:234
1441627993230,2cyclictest1650539-21kworker/u16:0+events_unbound22:12:054
144128523221,8sleep60-21swapper/619:09:146
1441639993130,0cyclictest0-21swapper/700:06:047
1441635993129,2cyclictest1431764-21kworker/u16:0+flush-8:019:25:106
1441627993129,2cyclictest1973253-21kworker/u16:2+events_unbound23:32:034
1441627993129,2cyclictest1973253-21kworker/u16:2+events_unbound23:26:394
1441627993129,2cyclictest1800853-21kworker/u16:4+events_unbound22:22:444
1441627993028,2cyclictest1650539-21kworker/u16:0+events_unbound21:47:124
1441627993028,2cyclictest1650539-21kworker/u16:0+events_unbound20:59:374
1441627993028,2cyclictest1524210-21kworker/u16:0+events_unbound20:29:414
1441627993028,2cyclictest1431764-21kworker/u16:0+events_unbound19:28:054
1441635992927,2cyclictest2008569-21kworker/u16:4+flush-8:000:29:566
1441635992925,3cyclictest2033114-21kworker/u16:5+events_unbound23:34:536
1441627992927,2cyclictest2146064-21kworker/u16:2+events_unbound00:37:354
1441627992927,2cyclictest2008569-21kworker/u16:4+events_unbound00:31:354
1441627992927,2cyclictest1959800-21kworker/u16:3+events_unbound23:16:544
1441627992927,2cyclictest1862183-21kworker/u16:1+events_unbound23:03:514
1441627992927,2cyclictest1800853-21kworker/u16:4+events_unbound22:52:194
1441627992927,2cyclictest1800853-21kworker/u16:4+events_unbound22:38:074
1441627992927,2cyclictest1524210-21kworker/u16:0+events_unbound20:09:374
21802442280,1chrt2180242-21ssh00:35:207
1441627992826,2cyclictest2008569-21kworker/u16:4+events_unbound00:16:544
1441627992826,2cyclictest1739741-21kworker/u16:2+events_unbound21:38:324
1441627992825,2cyclictest1687620-21kworker/u16:5+flush-8:021:19:594
144163999270,26cyclictest1739740-21cat21:34:397
1441627992725,2cyclictest585456-21kworker/u16:3+events_unbound19:59:064
1441627992725,2cyclictest2033114-21kworker/u16:5+flush-8:023:50:094
1441627992725,2cyclictest1723310-21kworker/u16:1+events_unbound21:34:074
1441627992725,2cyclictest1650539-21kworker/u16:0+events_unbound21:58:074
1441627992725,2cyclictest1568612-21kworker/u16:4+events_unbound21:09:374
1441627992725,2cyclictest1431764-21kworker/u16:0+events_unbound19:21:054
1441639992621,4cyclictest1996396-21latency_hist23:19:387
1441630992625,1cyclictest1568612-21kworker/u16:4+flush-8:021:34:395
1441630992623,3cyclictest2103344-21kworker/u16:0+flush-8:000:01:135
1441627992624,2cyclictest1973253-21kworker/u16:2+events_unbound23:40:434
1441627992624,2cyclictest1610606-21kworker/u16:2+events_unbound20:38:464
1441627992624,2cyclictest1568612-21kworker/u16:4+events_unbound20:54:054
1441627992624,2cyclictest1494214-21kworker/u16:2+events_unbound19:45:174
1441627992523,2cyclictest2103344-21kworker/u16:0+events_unbound00:11:144
1441627992523,2cyclictest2008569-21kworker/u16:4+events_unbound23:46:274
1441627992523,2cyclictest2008569-21kworker/u16:4+events_unbound00:01:384
1441627992523,2cyclictest1947487-21kworker/u16:0+events_unbound23:13:104
1441627992523,2cyclictest1591376-21kworker/u16:1+flush-8:020:25:334
1441627992523,2cyclictest1591376-21kworker/u16:1+flush-8:020:25:334
1441627992523,2cyclictest1591376-21kworker/u16:1+events_unbound20:41:174
1441627992523,2cyclictest1552295-21kworker/u16:2+events_unbound20:17:224
1441627992523,2cyclictest1472502-21kworker/u16:1+events_unbound20:01:214
1441627992523,2cyclictest1472502-21kworker/u16:1+events_unbound19:37:094
1441639992422,1cyclictest0-21swapper/721:52:297
1441639992422,1cyclictest0-21swapper/721:52:297
1441639992418,5cyclictest1649346-21latency_hist20:54:397
1441627992422,2cyclictest585456-21kworker/u16:3+events_unbound19:52:214
1441627992422,2cyclictest585456-21kworker/u16:3+events_unbound19:14:254
1441627992422,2cyclictest1800853-21kworker/u16:4+events_unbound22:46:434
1441627992422,2cyclictest1568612-21kworker/u16:4+events_unbound21:02:004
144163999230,21cyclictest1776193-21latency_hist21:49:387
1441627992321,2cyclictest1568612-21kworker/u16:4+events_unbound20:21:564
1441627992321,2cyclictest1472502-21kworker/u16:1+events_unbound19:41:014
1441627992321,2cyclictest1472502-21kworker/u16:1+events_unbound19:41:014
1441627992321,2cyclictest1451191-21kworker/u16:2+events_unbound19:16:144
1441635992219,2cyclictest1568612-21kworker/u16:4+events_unbound20:39:536
1441639992115,5cyclictest1513282-21latency_hist19:44:397
1441639992115,5cyclictest1513282-21latency_hist19:44:397
144163099211,13cyclictest0-21swapper/519:59:555
1441627992119,2cyclictest1568612-21kworker/u16:4+events_unbound20:49:214
1441627992119,2cyclictest1524210-21kworker/u16:0+events_unbound20:13:534
1441627992119,2cyclictest1472502-21kworker/u16:1+events_unbound19:31:214
1441635991917,2cyclictest1723310-21kworker/u16:1+flush-8:021:40:096
18656562180,0sleep71865658-21tr22:24:577
1441635991816,2cyclictest1947487-21kworker/u16:0+flush-8:023:29:566
1441635991816,2cyclictest1862183-21kworker/u16:1+flush-8:022:29:336
144163599180,18cyclictest0-21swapper/621:56:276
1441639991714,2cyclictest1812938-21idleruntime-cro22:04:387
144163999160,14cyclictest1874520-21/usr/sbin/munin22:29:517
144163999160,14cyclictest1874520-21/usr/sbin/munin22:29:517
15578102150,1sleep70-21swapper/720:04:587
144163999159,5cyclictest1764017-21latency_hist21:44:387
144163999159,5cyclictest1571541-21latency_hist20:14:387
1441639991513,1cyclictest0-21swapper/722:05:047
1441639991512,2cyclictest0-21swapper/722:44:387
1441639991512,2cyclictest0-21swapper/719:14:397
1441639991510,4cyclictest648-21systemd-journal21:04:387
1441635991513,2cyclictest1862183-21kworker/u16:1+flush-8:022:50:046
1441630991510,5cyclictest1959800-21kworker/u16:3+flush-8:023:14:385
1441639991413,0cyclictest0-21swapper/723:55:587
1441639991411,2cyclictest0-21swapper/723:20:047
144163999140,13cyclictest0-21swapper/720:20:027
144163999140,12cyclictest1659073-21latency_hist20:59:387
144163599140,14cyclictest0-21swapper/623:52:006
144163599140,14cyclictest0-21swapper/622:09:516
1441630991413,1cyclictest0-21swapper/522:34:405
1441630991413,1cyclictest0-21swapper/522:19:235
1441630991413,1cyclictest0-21swapper/521:44:045
144163099140,1cyclictest0-21swapper/523:24:395
144163099140,1cyclictest0-21swapper/521:54:385
144163099140,1cyclictest0-21swapper/521:54:385
144163099140,1cyclictest0-21swapper/521:19:385
144163099140,14cyclictest0-21swapper/522:25:035
144163099140,14cyclictest0-21swapper/521:57:285
144163099140,14cyclictest0-21swapper/500:32:175
144163099140,13cyclictest0-21swapper/520:29:495
144163099140,13cyclictest0-21swapper/500:09:165
144163999139,3cyclictest2022102-21cat23:29:547
144163999139,3cyclictest1277-21snmpd19:56:007
1441639991311,1cyclictest0-21swapper/721:55:087
1441639991311,1cyclictest0-21swapper/720:40:027
1441639991310,2cyclictest0-21swapper/721:15:087
1441639991310,2cyclictest0-21swapper/721:10:057
1441639991310,2cyclictest0-21swapper/700:20:077
144163999130,2cyclictest1677578-21ntpq21:05:057
144163999130,2cyclictest1600371-21users20:25:097
144163999130,2cyclictest1600371-21users20:25:097
144163999130,11cyclictest2133739-21latency_hist00:19:387
144163999130,11cyclictest1277-21snmpd19:11:597
1441635991312,1cyclictest0-21swapper/622:20:256
1441635991312,1cyclictest0-21swapper/621:14:316
1441635991311,2cyclictest585456-21kworker/u16:3+flush-8:019:14:456
1441635991311,2cyclictest1552295-21kworker/u16:2+flush-8:020:10:086
144163599130,1cyclictest0-21swapper/600:26:326
144163599130,13cyclictest0-21swapper/623:09:176
144163599130,13cyclictest0-21swapper/622:43:166
144163599130,13cyclictest0-21swapper/600:00:226
144163599130,0cyclictest0-21swapper/621:51:346
144163599130,0cyclictest0-21swapper/621:51:346
1441630991312,1cyclictest0-21swapper/523:58:325
1441630991312,1cyclictest0-21swapper/523:43:245
1441630991312,1cyclictest0-21swapper/523:30:385
1441630991312,1cyclictest0-21swapper/523:18:395
1441630991312,1cyclictest0-21swapper/522:57:325
1441630991312,1cyclictest0-21swapper/522:49:295
1441630991312,1cyclictest0-21swapper/522:30:165
1441630991312,1cyclictest0-21swapper/522:30:165
1441630991312,1cyclictest0-21swapper/522:05:125
1441630991312,1cyclictest0-21swapper/519:34:575
1441630991312,1cyclictest0-21swapper/500:25:305
144163099130,1cyclictest0-21swapper/519:39:415
144163099130,1cyclictest0-21swapper/519:39:415
144163099130,13cyclictest0-21swapper/523:37:255
144163999129,2cyclictest1277-21snmpd22:16:487
144163999129,2cyclictest1277-21snmpd00:02:127
144163999128,3cyclictest5988-21gmain20:29:567
144163999128,3cyclictest1277-21snmpd23:44:207
144163999128,3cyclictest1277-21snmpd23:13:527
144163999128,3cyclictest1277-21snmpd19:26:177
1441639991212,0cyclictest0-21swapper/723:37:317
144163999120,3cyclictest1971413-21sh23:08:437
144163999120,2cyclictest2070637-21df23:49:507
144163999120,2cyclictest1835503-21ssh22:11:147
144163999120,11cyclictest1726118-21ssh21:27:207
144163999120,11cyclictest0-21swapper/720:15:537
144163599123,8cyclictest1554503-21kthreadcore20:04:566
1441635991211,1cyclictest0-21swapper/623:45:146
1441635991211,1cyclictest0-21swapper/622:07:016
1441635991211,1cyclictest0-21swapper/621:37:226
1441635991211,1cyclictest0-21swapper/620:23:176
1441635991211,1cyclictest0-21swapper/600:36:096
1441635991211,1cyclictest0-21swapper/600:09:306
144163599120,1cyclictest0-21swapper/620:50:436
144163599120,1cyclictest0-21swapper/619:22:266
144163599120,12cyclictest0-21swapper/619:34:156
1441630991211,1cyclictest0-21swapper/523:04:195
1441630991211,1cyclictest0-21swapper/521:23:445
1441630991211,1cyclictest0-21swapper/520:50:285
144163099120,12cyclictest0-21swapper/519:45:045
144163999118,2cyclictest1277-21snmpd22:54:077
144163999118,2cyclictest1277-21snmpd20:37:127
144163999118,2cyclictest1277-21snmpd19:47:237
144163999118,2cyclictest1277-21snmpd19:20:537
144163999117,3cyclictest1277-21snmpd19:38:267
144163999117,3cyclictest1277-21snmpd00:28:127
144163999115,5cyclictest6175-21gvfs-afc-volume00:09:457
144163999110,9cyclictest1741496-21kthreadcore21:34:557
144163999110,10cyclictest1277-21snmpd21:24:317
144163599119,2cyclictest1959800-21kworker/u16:3+flush-8:023:19:336
1441635991110,1cyclictest0-21swapper/623:22:036
1441635991110,1cyclictest0-21swapper/622:46:546
1441635991110,1cyclictest0-21swapper/621:31:426
1441635991110,1cyclictest0-21swapper/621:24:466
1441635991110,1cyclictest0-21swapper/621:00:486
144163599110,4cyclictest1506017-21kthreadcore19:39:576
144163599110,4cyclictest1506017-21kthreadcore19:39:576
144163599110,11cyclictest0-21swapper/619:45:176
144163099116,4cyclictest1533908-21cat19:54:545
144163099116,4cyclictest1524182-21cat19:49:535
1441630991110,1cyclictest0-21swapper/521:27:505
1441630991110,1cyclictest0-21swapper/521:07:015
1441630991110,1cyclictest0-21swapper/520:44:485
144163999107,2cyclictest0-21swapper/719:59:397
144163999106,3cyclictest1277-21snmpd19:30:507
144163999104,4cyclictest1947944-21grep22:59:497
144163999100,9cyclictest1277-21snmpd22:37:037
144163999100,1cyclictest2019215-21ssh23:26:427
144163599109,1cyclictest0-21swapper/623:28:506
144163599109,1cyclictest0-21swapper/621:48:446
144163599109,1cyclictest0-21swapper/620:26:076
144163599109,1cyclictest0-21swapper/620:26:076
144163599109,1cyclictest0-21swapper/620:18:526
144163599108,2cyclictest86-21ksoftirqd/622:14:446
144163599100,9cyclictest1541697-21switchtime19:55:076
144163599100,3cyclictest1532772-21true19:54:396
144163099109,1cyclictest0-21swapper/522:13:425
144163099109,1cyclictest0-21swapper/521:12:425
144163099109,1cyclictest0-21swapper/520:59:465
144163099109,1cyclictest0-21swapper/520:41:575
144163099108,1cyclictest0-21swapper/521:34:465
144163099100,5cyclictest0-21swapper/520:14:545
14416399996,2cyclictest0-21swapper/722:44:447
14416399994,4cyclictest1631794-21cut20:44:577
14416399990,8cyclictest1532739-21turbostat19:54:387
14416359998,1cyclictest0-21swapper/622:37:176
14416359998,1cyclictest0-21swapper/621:22:436
14416359998,1cyclictest0-21swapper/620:37:476
14416359998,1cyclictest0-21swapper/620:29:456
14416359997,2cyclictest86-21ksoftirqd/623:57:356
14416359997,2cyclictest1524210-21kworker/u16:0+flush-8:019:59:546
14416359995,3cyclictest1442386-21tune2fs19:09:536
14416359990,8cyclictest0-21swapper/619:34:536
14416309998,1cyclictest1493436-21unixbench_multi19:30:135
14416309998,1cyclictest0-21swapper/523:49:245
14416309998,1cyclictest0-21swapper/522:02:215
14416309996,2cyclictest0-21swapper/519:10:085
14416359986,2cyclictest86-21ksoftirqd/623:12:576
14416359986,2cyclictest86-21ksoftirqd/623:02:116
14416359986,2cyclictest86-21ksoftirqd/622:00:126
14416359986,2cyclictest86-21ksoftirqd/600:24:356
14416359986,2cyclictest86-21ksoftirqd/600:18:456
14416359980,7cyclictest2120225-21taskset00:12:116
14416359980,7cyclictest2055914-21taskset23:41:506
14416309987,1cyclictest0-21swapper/522:53:075
14416309987,1cyclictest0-21swapper/522:44:175
14416309987,1cyclictest0-21swapper/522:21:265
14416309987,1cyclictest0-21swapper/500:36:425
14416309986,1cyclictest0-21swapper/519:24:545
14416309985,2cyclictest0-21swapper/520:04:585
14416309984,3cyclictest1581682-21/usr/sbin/munin20:20:015
14416309983,4cyclictest1461232-21cut19:14:595
14416359976,1cyclictest0-21swapper/620:47:056
14416359971,6cyclictest0-21swapper/621:15:066
14416309976,1cyclictest0-21swapper/521:46:075
14416309976,1cyclictest0-21swapper/520:35:295
14416309976,1cyclictest0-21swapper/520:26:115
14416309976,1cyclictest0-21swapper/520:26:115
14416309975,1cyclictest0-21swapper/519:19:555
14416309973,3cyclictest1563175-21sed20:09:565
14416309972,2cyclictest0-21swapper/523:52:285
14416359960,1cyclictest0-21swapper/621:04:576
14416309963,2cyclictest5709-21JS16:05:365
14416309960,1cyclictest0-21swapper/520:57:325
14416309960,1cyclictest0-21swapper/500:16:505
14416309960,1cyclictest0-21swapper/500:10:355
14416359950,1cyclictest0-21swapper/620:54:426
14416309952,2cyclictest0-21swapper/500:19:585
14416309950,3cyclictest0-21swapper/523:04:505
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional