You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 18:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Tue Dec 23, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
133449625443,8sleep50-21swapper/507:08:055
133449625443,8sleep50-21swapper/507:08:055
133439325341,8sleep40-21swapper/407:06:354
133439325341,8sleep40-21swapper/407:06:354
133436625319,30sleep70-21swapper/707:06:147
133436625319,30sleep70-21swapper/707:06:147
1334864994038,2cyclictest1795093-21kworker/u16:0+events_unbound11:14:285
1334864993935,3cyclictest1261595-21kworker/u16:2+events_unbound07:09:335
133426023928,7sleep60-21swapper/607:04:536
133426023928,7sleep60-21swapper/607:04:536
133486999370,35cyclictest1542308-21latency_hist08:54:157
1334864993735,2cyclictest1620336-21kworker/u16:2+events_unbound09:59:095
1334864993634,2cyclictest1368159-21kworker/u16:3+flush-8:008:09:305
1334860993532,2cyclictest1795093-21kworker/u16:0+events_unbound11:09:174
1334860993331,2cyclictest1911046-21kworker/u16:3+events_unbound12:37:254
1334860993331,2cyclictest1561961-21kworker/u16:0+events_unbound09:07:344
1334860993331,2cyclictest1561961-21kworker/u16:0+events_unbound09:07:344
133486999320,1cyclictest0-21swapper/709:24:427
1334860993230,2cyclictest1436030-21kworker/u16:1+events_unbound08:48:344
1334869993126,4cyclictest1522970-21latency_hist08:44:167
1334860993129,2cyclictest1368159-21kworker/u16:3+events_unbound08:27:344
1334869993024,5cyclictest1474458-21latency_hist08:19:157
1334860993027,2cyclictest1561961-21kworker/u16:0+events_unbound10:29:254
1334860992927,2cyclictest1765969-21kworker/u16:0+events_unbound10:53:334
1334860992927,2cyclictest1756083-21kworker/u16:4+events_unbound10:46:254
1334860992927,2cyclictest1746077-21kworker/u16:1+events_unbound11:41:324
1334860992927,2cyclictest1697825-21kworker/u16:3+flush-8:010:15:174
1334860992927,2cyclictest1436030-21kworker/u16:1+events_unbound08:42:334
1334860992826,2cyclictest1631413-21kworker/u16:1+events_unbound09:45:344
1334860992826,2cyclictest1571816-21kworker/u16:2+flush-8:009:10:054
1334864992725,2cyclictest1911046-21kworker/u16:3+flush-8:012:34:305
1334860992725,2cyclictest1795093-21kworker/u16:0+events_unbound11:53:174
133486999260,24cyclictest1852867-21latency_hist11:34:157
1334860992624,2cyclictest1911046-21kworker/u16:3+events_unbound12:08:324
1334860992624,2cyclictest1795093-21kworker/u16:0+flush-8:011:25:254
1334860992624,2cyclictest1795093-21kworker/u16:0+flush-8:011:25:254
1334860992624,2cyclictest1436030-21kworker/u16:1+events_unbound08:31:134
1334865992522,2cyclictest1261595-21kworker/u16:2+flush-8:007:14:416
1334864992523,2cyclictest1795093-21kworker/u16:0+flush-8:011:44:305
1334864992523,2cyclictest1368159-21kworker/u16:3+flush-8:007:49:365
1334860992523,2cyclictest1795093-21kworker/u16:0+flush-8:011:34:574
1334860992523,2cyclictest1620336-21kworker/u16:2+events_unbound09:54:064
1334860992523,2cyclictest1561961-21kworker/u16:0+flush-8:010:38:304
1334860992523,2cyclictest1541387-21kworker/u16:2+events_unbound08:58:254
1334860992523,2cyclictest1387187-21kworker/u16:4+events_unbound07:51:344
1334860992522,2cyclictest1261595-21kworker/u16:2+flush-8:007:54:334
1334864992421,2cyclictest1795093-21kworker/u16:0+events_unbound11:04:325
1334860992422,2cyclictest1911046-21kworker/u16:3+events_unbound12:27:174
1334860992422,2cyclictest1368159-21kworker/u16:3+events_unbound08:17:344
1334860992422,2cyclictest1261595-21kworker/u16:2+events_unbound07:15:334
1334864992321,2cyclictest1436030-21kworker/u16:1+events_unbound07:59:295
1334860992321,2cyclictest1600962-21kworker/u16:1+flush-8:009:30:344
1334869992217,4cyclictest1755878-21latency_hist10:44:157
1334869992217,4cyclictest1755878-21latency_hist10:44:157
1334864992219,2cyclictest1649404-21kworker/u16:4+flush-8:009:49:415
1334860992220,2cyclictest1872274-21kworker/u16:2+events_unbound11:57:164
1334860992220,2cyclictest1561961-21kworker/u16:0+events_unbound10:22:014
1334860992220,2cyclictest1387187-21kworker/u16:4+flush-8:008:02:254
1334860992220,2cyclictest1387187-21kworker/u16:4+events_unbound07:47:344
1334864992119,2cyclictest1561961-21kworker/u16:0+events_unbound09:09:335
1334864992119,2cyclictest1541387-21kworker/u16:2+flush-8:008:54:295
1334864992119,2cyclictest1425993-21kworker/u16:0+flush-8:008:39:165
1334864992119,2cyclictest1368159-21kworker/u16:3+flush-8:007:24:335
1334860992119,2cyclictest1765969-21kworker/u16:0+events_unbound10:56:334
1334860992119,2cyclictest1571816-21kworker/u16:2+events_unbound09:21:304
1334860992119,2cyclictest1368159-21kworker/u16:3+events_unbound08:13:324
1334860992119,2cyclictest1261595-21kworker/u16:2+events_unbound07:30:304
1334860992119,2cyclictest1261595-21kworker/u16:2+events_unbound07:30:304
1334864992018,2cyclictest1746077-21kworker/u16:1+events_unbound10:49:315
1334860992018,2cyclictest1561961-21kworker/u16:0+flush-8:009:59:474
1334860992018,2cyclictest1315341-21kworker/u16:1+events_unbound07:22:334
1334860992017,2cyclictest1551739-21kworker/u16:3+flush-8:009:34:264
1334865991915,3cyclictest1688379-21munin-node10:09:276
1334864991917,2cyclictest1911046-21kworker/u16:3+flush-8:012:24:285
1334864991917,2cyclictest1746077-21kworker/u16:1+flush-8:011:54:365
1334864991917,2cyclictest1668475-21kworker/u16:1+flush-8:009:59:225
1334864991917,2cyclictest1387187-21kworker/u16:4+events_unbound07:44:305
1334864991917,2cyclictest1315341-21kworker/u16:1+events_unbound07:24:015
1334864991917,2cyclictest1261595-21kworker/u16:2+events_unbound07:54:445
1334860991917,2cyclictest1795093-21kworker/u16:0+events_unbound11:14:454
1334860991917,2cyclictest1600962-21kworker/u16:1+flush-8:009:29:124
1334860991917,2cyclictest1561961-21kworker/u16:0+flush-8:010:43:574
1334860991917,2cyclictest1561961-21kworker/u16:0+flush-8:010:43:574
1334860991917,2cyclictest1436030-21kworker/u16:1+events_unbound08:59:534
1334864991816,2cyclictest1425993-21kworker/u16:0+flush-8:008:49:375
1334864991816,2cyclictest1368159-21kworker/u16:3+flush-8:007:29:295
1334864991816,2cyclictest1368159-21kworker/u16:3+flush-8:007:29:295
1334864991815,2cyclictest1561961-21kworker/u16:0+events_unbound10:04:185
1334860991816,2cyclictest1911046-21kworker/u16:3+flush-8:012:14:494
1334860991816,2cyclictest1911046-21kworker/u16:3+flush-8:012:14:494
1334860991816,2cyclictest1795093-21kworker/u16:0+flush-8:011:47:374
1334860991816,2cyclictest1795093-21kworker/u16:0+events_unbound11:04:454
1334860991816,2cyclictest1551739-21kworker/u16:3+flush-8:009:39:524
1334860991816,2cyclictest1541387-21kworker/u16:2+events_unbound08:53:414
1334860991816,2cyclictest1261595-21kworker/u16:2+events_unbound07:37:304
1334860991815,2cyclictest1872274-21kworker/u16:2+events_unbound11:59:154
1334869991716,0cyclictest0-21swapper/709:09:367
1334869991715,1cyclictest0-21swapper/709:59:137
133486999170,15cyclictest650-21systemd-journal11:54:157
1334864991715,2cyclictest1872274-21kworker/u16:2+flush-8:012:19:315
1334864991715,2cyclictest1425993-21kworker/u16:0+flush-8:008:29:445
1334864991715,2cyclictest1368159-21kworker/u16:3+events_unbound07:36:515
1334860991715,2cyclictest1756083-21kworker/u16:4+events_unbound11:01:364
1334860991715,2cyclictest1620336-21kworker/u16:2+flush-8:009:54:484
1334860991715,2cyclictest1561961-21kworker/u16:0+events_unbound10:27:264
1334860991715,2cyclictest1436030-21kworker/u16:1+events_unbound08:21:424
1334860991715,2cyclictest1425993-21kworker/u16:0+events_unbound08:04:324
1334860991715,2cyclictest1368159-21kworker/u16:3+events_unbound07:26:224
1334869991613,2cyclictest1267-21snmpd07:30:037
1334869991613,2cyclictest1267-21snmpd07:30:037
1334864991614,2cyclictest1911046-21kworker/u16:3+flush-8:012:09:355
1334864991614,2cyclictest1765969-21kworker/u16:0+flush-8:010:58:585
1334864991614,2cyclictest1756083-21kworker/u16:4+events_unbound11:01:225
1334864991614,2cyclictest1436030-21kworker/u16:1+flush-8:008:44:165
1334864991614,2cyclictest1368159-21kworker/u16:3+flush-8:007:39:385
1334860991614,2cyclictest1911046-21kworker/u16:3+flush-8:012:20:124
1334860991614,2cyclictest1436030-21kworker/u16:1+events_unbound08:38:094
133486999158,6cyclictest0-21swapper/709:06:337
133486999158,6cyclictest0-21swapper/709:06:337
1334869991513,1cyclictest0-21swapper/711:59:387
133486999150,14cyclictest0-21swapper/711:14:377
133486999150,14cyclictest0-21swapper/710:54:417
1334864991513,2cyclictest1795093-21kworker/u16:0+flush-8:011:24:395
1334864991513,2cyclictest1795093-21kworker/u16:0+flush-8:011:24:395
1334864991513,2cyclictest1620336-21kworker/u16:2+flush-8:010:32:065
1334864991513,2cyclictest1561961-21kworker/u16:0+events_unbound10:14:305
1334864991513,2cyclictest1561961-21kworker/u16:0+events_unbound09:39:335
1334864991513,2cyclictest1368159-21kworker/u16:3+events_unbound08:18:505
1334864991513,2cyclictest1368159-21kworker/u16:3+events_unbound08:04:405
1334864991513,2cyclictest1261595-21kworker/u16:2+flush-8:007:15:195
1334860991513,2cyclictest1959655-21kworker/u16:4+events_unbound12:31:534
1334860991513,2cyclictest1746077-21kworker/u16:1+events_unbound11:23:374
1334869991411,2cyclictest0-21swapper/710:59:167
1334869991411,2cyclictest0-21swapper/707:49:167
1334869991410,3cyclictest650-21systemd-journal09:19:107
133486599149,4cyclictest1912177-21cat12:04:306
1334865991413,1cyclictest0-21swapper/608:54:346
133486599140,13cyclictest0-21swapper/609:44:336
1334864991413,1cyclictest1551739-21kworker/u16:3+flush-8:009:29:415
1334864991412,2cyclictest1911046-21kworker/u16:3+events_unbound12:04:225
1334864991412,2cyclictest1795093-21kworker/u16:0+flush-8:011:19:485
1334864991412,2cyclictest1795093-21kworker/u16:0+events_unbound11:49:325
1334864991412,2cyclictest1746077-21kworker/u16:1+events_unbound11:39:385
1334864991412,2cyclictest1551739-21kworker/u16:3+events_unbound09:44:265
1334864991412,2cyclictest1436030-21kworker/u16:1+events_unbound08:24:305
133486499140,1cyclictest0-21swapper/512:14:415
133486499140,1cyclictest0-21swapper/512:14:415
133486999139,3cyclictest1267-21snmpd12:28:477
133486999139,3cyclictest1267-21snmpd12:04:557
133486999139,3cyclictest1267-21snmpd11:34:277
133486999139,3cyclictest1267-21snmpd08:23:257
133486999137,5cyclictest6184-21gvfs-afc-volume11:39:337
133486999137,5cyclictest5756-21JS21:50:157
133486999137,5cyclictest1843177-21latency_hist11:29:157
133486999137,5cyclictest1843177-21latency_hist11:29:157
133486999133,9cyclictest958-21gmain07:39:127
1334869991312,0cyclictest0-21swapper/709:59:197
1334869991310,2cyclictest1938854-21kthreadcore12:14:377
1334869991310,2cyclictest1938854-21kthreadcore12:14:377
133486999130,4cyclictest1524460-21irqcore08:44:327
133486999130,11cyclictest1610679-21/usr/sbin/munin09:29:427
133486599139,3cyclictest1261595-21kworker/u16:2+flush-8:007:29:426
133486599139,3cyclictest1261595-21kworker/u16:2+flush-8:007:29:426
1334865991310,2cyclictest1395832-21needreboot07:34:386
1334864991312,1cyclictest0-21swapper/509:03:275
1334864991311,2cyclictest1795093-21kworker/u16:0+flush-8:011:09:315
1334864991311,2cyclictest1746077-21kworker/u16:1+events_unbound10:39:395
1334864991311,2cyclictest1746077-21kworker/u16:1+events_unbound10:39:395
1334864991311,2cyclictest1436030-21kworker/u16:1+events_unbound09:04:325
1334864991311,2cyclictest1436030-21kworker/u16:1+events_unbound09:04:325
133486099130,13cyclictest0-21swapper/407:39:374
133486999129,2cyclictest0-21swapper/707:39:377
133486999128,3cyclictest1267-21snmpd12:19:467
133486999128,3cyclictest1267-21snmpd10:10:407
133486999128,3cyclictest1267-21snmpd10:05:437
133486999128,3cyclictest1267-21snmpd08:05:097
133486999128,3cyclictest1267-21snmpd08:02:547
133486999128,3cyclictest1267-21snmpd07:45:337
133486999128,3cyclictest1267-21snmpd07:18:387
133486999127,4cyclictest1267-21snmpd12:37:147
133486999125,6cyclictest0-21swapper/711:56:337
133486999123,8cyclictest0-21swapper/711:19:337
133486999120,5cyclictest1367497-21sshd-session07:20:337
133486999120,2cyclictest0-21swapper/710:29:407
133486999120,2cyclictest0-21swapper/707:54:397
133486999120,11cyclictest1116-21lldpd11:44:367
133486999120,10cyclictest1267-21snmpd08:35:137
133486599120,1cyclictest0-21swapper/607:46:476
133486599120,12cyclictest0-21swapper/612:34:306
133486599120,11cyclictest0-21swapper/610:29:196
1334864991210,2cyclictest1956659-21kworker/u16:0+events_unbound12:29:325
1334864991210,2cyclictest1795093-21kworker/u16:0+flush-8:011:34:585
1334864991210,2cyclictest1756083-21kworker/u16:4+events_unbound10:44:575
1334864991210,2cyclictest1620336-21kworker/u16:2+flush-8:010:24:315
1334864991210,2cyclictest1561961-21kworker/u16:0+flush-8:009:20:085
1334864991210,2cyclictest1561961-21kworker/u16:0+events_unbound09:25:255
133486499120,0cyclictest0-21swapper/511:29:265
133486099129,2cyclictest1911046-21kworker/u16:3+events_unbound12:09:214
1334860991210,2cyclictest1620336-21kworker/u16:2+flush-8:010:09:304
133486999118,2cyclictest1267-21snmpd12:12:197
133486999118,2cyclictest1267-21snmpd10:35:447
133486999118,2cyclictest1267-21snmpd09:21:447
133486999118,2cyclictest0-21swapper/708:24:417
133486999117,3cyclictest1267-21snmpd10:18:317
133486999117,3cyclictest1267-21snmpd09:35:307
133486999117,3cyclictest1267-21snmpd08:30:107
133486999117,3cyclictest1267-21snmpd08:10:347
133486999114,6cyclictest0-21swapper/708:59:447
133486999114,6cyclictest0-21swapper/708:56:397
133486999114,6cyclictest0-21swapper/707:26:217
133486999113,7cyclictest5944-21gmain12:29:367
133486999110,9cyclictest1267-21snmpd11:09:337
133486999110,2cyclictest0-21swapper/709:44:317
133486999110,10cyclictest1116-21lldpd10:44:367
133486599119,2cyclictest1368159-21kworker/u16:3+flush-8:007:25:126
133486599116,4cyclictest1679459-21iostat_ios10:04:326
1334865991110,1cyclictest0-21swapper/612:13:136
1334865991110,1cyclictest0-21swapper/611:38:136
1334865991110,1cyclictest0-21swapper/610:44:566
1334865991110,1cyclictest0-21swapper/610:26:196
1334865991110,1cyclictest0-21swapper/609:09:236
1334865991110,1cyclictest0-21swapper/608:34:236
1334865991110,1cyclictest0-21swapper/608:11:226
133486599110,1cyclictest0-21swapper/610:00:096
133486599110,1cyclictest0-21swapper/607:21:056
133486599110,11cyclictest0-21swapper/612:26:276
133486599110,11cyclictest0-21swapper/611:21:596
133486599110,11cyclictest0-21swapper/609:31:476
133486599110,11cyclictest0-21swapper/609:19:196
133486599110,11cyclictest0-21swapper/607:51:406
133486599110,0cyclictest0-21swapper/611:15:506
133486599110,0cyclictest0-21swapper/609:42:016
133486599110,0cyclictest0-21swapper/608:29:116
133486499119,2cyclictest1620336-21kworker/u16:2+events_unbound10:19:585
133486499118,2cyclictest1872274-21kworker/u16:2+events_unbound11:59:175
133486499110,11cyclictest0-21swapper/510:38:595
133486499110,11cyclictest0-21swapper/508:21:035
133486099119,2cyclictest1795093-21kworker/u16:0+events_unbound11:31:324
133486099119,2cyclictest1335077-21kworker/u16:4+events_unbound07:11:274
133486099118,2cyclictest1561961-21kworker/u16:0+flush-8:010:04:164
133486999107,2cyclictest0-21swapper/711:04:407
133486999106,3cyclictest1267-21snmpd10:25:317
133486999104,5cyclictest6184-21gvfs-afc-volume09:39:427
1334869991010,0cyclictest0-21swapper/709:50:367
133486999100,2cyclictest0-21swapper/710:49:467
133486999100,2cyclictest0-21swapper/710:19:307
133486599109,1cyclictest0-21swapper/612:31:496
133486599109,1cyclictest0-21swapper/611:12:406
133486599109,1cyclictest0-21swapper/611:00:046
133486599109,1cyclictest0-21swapper/610:35:386
133486599109,1cyclictest0-21swapper/607:56:336
133486599109,1cyclictest0-21swapper/607:41:546
133486599109,1cyclictest0-21swapper/607:12:156
133486599100,9cyclictest0-21swapper/609:49:306
133486599100,0cyclictest0-21swapper/608:23:506
133486499108,2cyclictest1436030-21kworker/u16:1+events_unbound08:48:445
13348659998,1cyclictest0-21swapper/612:21:066
13348659998,1cyclictest0-21swapper/611:57:176
13348659998,1cyclictest0-21swapper/609:01:596
13348659995,3cyclictest1873407-21cat11:44:306
13348649997,2cyclictest1668475-21kworker/u16:1+flush-8:010:10:565
13348649997,2cyclictest1561961-21kworker/u16:0+events_unbound09:37:365
13348649997,1cyclictest1582261-21tune2fs09:14:285
13348659987,1cyclictest0-21swapper/608:16:166
13348659986,1cyclictest0-21swapper/611:49:286
13348659986,1cyclictest0-21swapper/610:54:446
13348659984,3cyclictest1699261-21cut10:14:326
13348659983,4cyclictest1909246-21kthreadcore11:59:366
13348659983,4cyclictest1863100-21expr11:39:286
13348659983,4cyclictest1837492-21grep11:24:336
13348659983,4cyclictest1837492-21grep11:24:336
13348659983,4cyclictest1713652-21tr10:19:366
13348659983,4cyclictest1620536-21grep09:34:296
13348659983,4cyclictest1537839-21grep08:49:366
13348659983,4cyclictest1502495-21missed_timers08:29:376
13348659983,4cyclictest1446987-21cut08:04:336
13348659983,4cyclictest1436566-21awk07:59:286
13348609984,3cyclictest1582892-21kthreadcore09:14:314
13348659976,1cyclictest0-21swapper/609:14:176
13348659975,1cyclictest0-21swapper/611:29:296
13348659975,1cyclictest0-21swapper/610:39:326
13348659975,1cyclictest0-21swapper/610:39:326
13348659975,1cyclictest0-21swapper/609:54:356
13348659974,2cyclictest1604471-21kthreadcore09:24:356
13348659974,2cyclictest1529680-21kthreadcore08:44:366
13348659973,3cyclictest1797159-21cut11:04:326
13348659973,3cyclictest1562819-21grep09:04:316
13348659973,3cyclictest1562819-21grep09:04:316
13348659973,3cyclictest1515396-21cat08:39:346
13348659972,4cyclictest1931218-21cat12:14:286
13348659972,4cyclictest1931218-21cat12:14:286
13348659972,4cyclictest1766134-21expr10:49:316
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional