You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 01:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Fri Apr 24, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
122660825646,7sleep40-21swapper/419:07:014
1227081994945,3cyclictest1725722-21kworker/u16:0+flush-8:000:14:226
1227081994541,3cyclictest1521667-21kworker/u16:4+flush-8:022:09:236
12183752423,32sleep70-21swapper/719:04:397
1227083994135,5cyclictest1593928-21latency_hist22:04:237
1227078994037,2cyclictest1725722-21kworker/u16:0+events_unbound00:26:305
1227078993734,2cyclictest1725722-21kworker/u16:0+flush-8:000:19:055
1227078993734,2cyclictest1725722-21kworker/u16:0+flush-8:000:19:055
1227081993634,2cyclictest1518260-21kworker/u16:0+events_unbound22:09:386
1227078993634,2cyclictest1787342-21kworker/u16:1+events_unbound23:50:305
122658723627,6sleep50-21swapper/519:06:465
1227081993533,2cyclictest1326446-21kworker/u16:0+flush-8:020:24:246
1227078993533,2cyclictest1772831-21kworker/u16:4+events_unbound00:08:145
1227078993533,2cyclictest1725722-21kworker/u16:0+events_unbound23:02:025
1227078993533,2cyclictest1606135-21kworker/u16:3+flush-8:022:15:425
1227078993533,2cyclictest1521667-21kworker/u16:4+events_unbound22:06:545
1227081993430,3cyclictest1653810-21kworker/u16:1+flush-8:022:39:246
1227078993432,2cyclictest1954350-21kworker/u16:1+flush-8:000:37:415
1227078993432,2cyclictest1772831-21kworker/u16:4+flush-8:023:24:495
1227078993432,2cyclictest1772831-21kworker/u16:4+events_unbound00:10:175
1227078993432,2cyclictest1700275-21kworker/u16:3+events_unbound23:12:105
1227078993432,2cyclictest1653810-21kworker/u16:1+events_unbound22:39:095
1227078993432,2cyclictest1569856-21kworker/u16:1+events_unbound22:04:105
1227078993432,2cyclictest1518260-21kworker/u16:0+events_unbound22:25:305
1227078993331,2cyclictest1810783-21kworker/u16:2+flush-8:000:00:175
1227078993331,2cyclictest1810783-21kworker/u16:2+events_unbound23:57:505
1227078993331,2cyclictest1772831-21kworker/u16:4+events_unbound23:38:235
1227078993331,2cyclictest1772831-21kworker/u16:4+events_unbound23:38:235
1227078993331,2cyclictest1739404-21kworker/u16:2+events_unbound23:21:575
1227078993331,2cyclictest1725722-21kworker/u16:0+events_unbound23:06:385
1227078993331,2cyclictest1518260-21kworker/u16:0+flush-8:022:12:505
1227078993331,2cyclictest1518260-21kworker/u16:0+events_unbound21:58:145
1227078993331,2cyclictest1461286-21kworker/u16:3+events_unbound21:38:555
1227078993331,2cyclictest1461286-21kworker/u16:3+events_unbound21:10:585
1227078993331,2cyclictest1336082-21kworker/u16:1+events_unbound21:31:145
1227078993230,2cyclictest1954350-21kworker/u16:1+events_unbound00:32:395
1227078993230,2cyclictest1810783-21kworker/u16:2+events_unbound00:23:095
1227078993230,2cyclictest1725722-21kworker/u16:0+events_unbound23:43:095
1227078993230,2cyclictest1700275-21kworker/u16:3+flush-8:022:49:225
1227078993230,2cyclictest1666380-21kworker/u16:2+events_unbound22:53:215
1227078993230,2cyclictest1521667-21kworker/u16:4+flush-8:021:44:105
1227078993230,2cyclictest1518260-21kworker/u16:0+flush-8:021:53:035
1227078993230,2cyclictest1518260-21kworker/u16:0+flush-8:021:48:345
1227078993230,2cyclictest1461286-21kworker/u16:3+flush-8:021:22:505
1227083993130,0cyclictest0-21swapper/700:29:027
1227078993129,2cyclictest1810783-21kworker/u16:2+events_unbound23:46:385
1227078993129,2cyclictest1739404-21kworker/u16:2+events_unbound23:17:115
1227078993129,2cyclictest1521667-21kworker/u16:4+flush-8:022:40:035
1227078993129,2cyclictest1521667-21kworker/u16:4+events_unbound22:24:025
1227078993129,2cyclictest1336082-21kworker/u16:1+events_unbound21:28:105
18844982300,1chrt1884497-21ssh00:04:327
1227078993028,2cyclictest1787342-21kworker/u16:1+events_unbound23:30:255
1227078993028,2cyclictest1700275-21kworker/u16:3+flush-8:022:59:055
122675323020,7sleep60-21swapper/619:09:046
1227078992927,2cyclictest1198207-21kworker/u16:3+events_unbound20:06:075
1227083992825,2cyclictest1534015-21ssh21:39:347
1227083992824,2cyclictest1929262-21ntpq00:19:517
1227078992826,2cyclictest1336082-21kworker/u16:1+events_unbound21:16:465
1227083992726,0cyclictest0-21swapper/722:49:427
122708399270,26cyclictest635-21systemd-journal23:24:237
1227081992725,2cyclictest1772831-21kworker/u16:4+flush-8:000:39:186
1227081992725,2cyclictest1700275-21kworker/u16:3+flush-8:023:19:466
1227081992723,3cyclictest1666380-21kworker/u16:2+flush-8:022:49:236
1227078992725,2cyclictest1422777-21kworker/u16:0+flush-8:020:49:335
1227083992622,2cyclictest1259545-21munin-run19:24:237
122708399260,24cyclictest1569823-21latency_hist21:54:247
1227081992624,2cyclictest1370324-21kworker/u16:4+flush-8:020:44:546
1227081992624,2cyclictest1370324-21kworker/u16:4+flush-8:020:44:546
1227081992624,2cyclictest1207721-21kworker/u16:4+flush-8:019:39:506
1227081992623,2cyclictest1336082-21kworker/u16:1+flush-8:020:34:506
1227078992624,2cyclictest1521667-21kworker/u16:4+events_unbound22:30:295
1227078992624,2cyclictest1207721-21kworker/u16:4+flush-8:019:26:065
1227078992624,2cyclictest1198207-21kworker/u16:3+flush-8:019:17:345
1227078992624,2cyclictest1198207-21kworker/u16:3+flush-8:019:17:345
1227078992624,2cyclictest1198207-21kworker/u16:3+flush-8:019:12:075
1227083992521,3cyclictest1884053-21/usr/sbin/munin00:04:237
1227081992523,2cyclictest1336082-21kworker/u16:1+flush-8:021:19:236
1227081992523,2cyclictest1240674-21kworker/u16:0+flush-8:019:39:246
1227078992523,2cyclictest1422777-21kworker/u16:0+events_unbound20:58:595
1227078992523,2cyclictest1336082-21kworker/u16:1+flush-8:020:34:525
1227078992523,2cyclictest1269117-21kworker/u16:1+flush-8:019:38:345
1227083992422,1cyclictest0-21swapper/720:29:467
1227078992422,2cyclictest1240674-21kworker/u16:0+flush-8:019:31:345
1227083992322,0cyclictest0-21swapper/723:09:037
1227083992322,0cyclictest0-21swapper/719:24:467
122708399230,1cyclictest0-21swapper/722:04:507
1227081992321,2cyclictest1772831-21kworker/u16:4+flush-8:000:24:226
1227078992321,2cyclictest1411992-21kworker/u16:3+flush-8:020:45:075
1227078992321,2cyclictest1411992-21kworker/u16:3+flush-8:020:45:075
1227078992321,2cyclictest1336082-21kworker/u16:1+events_unbound21:02:345
1227083992220,1cyclictest1852684-21tr23:49:427
1227083992217,4cyclictest635-21systemd-journal23:00:227
1227081992220,2cyclictest1772831-21kworker/u16:4+flush-8:023:17:296
1227081992220,2cyclictest1521667-21kworker/u16:4+flush-8:022:14:536
1227078992220,2cyclictest1336082-21kworker/u16:1+flush-8:020:19:525
1227078992220,2cyclictest1326446-21kworker/u16:0+events_unbound20:12:345
1227078992220,2cyclictest1198207-21kworker/u16:3+flush-8:019:50:065
1227078992219,2cyclictest1269117-21kworker/u16:1+events_unbound19:44:265
1227083992117,2cyclictest1471701-21ssh21:11:477
1227083992019,0cyclictest0-21swapper/723:40:417
1227081992018,2cyclictest1336082-21kworker/u16:1+flush-8:020:09:396
1227081992017,2cyclictest1336082-21kworker/u16:1+flush-8:020:39:496
13597312190,0sleep71359732-21grep20:14:427
1227083991917,1cyclictest1555807-21ssh21:45:557
1227083991913,5cyclictest1871920-21latency_hist23:59:237
122708399190,17cyclictest1580710-21ssh21:57:137
1227081991916,3cyclictest1518260-21kworker/u16:0+flush-8:021:54:306
1227081991914,5cyclictest0-21swapper/621:02:306
1227078991917,2cyclictest1326446-21kworker/u16:0+flush-8:020:27:435
1227083991817,0cyclictest0-21swapper/723:39:037
1227083991817,0cyclictest0-21swapper/723:39:037
1227083991816,1cyclictest1919691-21ssh00:18:237
1227083991816,1cyclictest1919691-21ssh00:18:237
1227083991816,1cyclictest1485065-21ssh21:19:157
1227083991816,1cyclictest0-21swapper/721:34:487
1227083991815,2cyclictest0-21swapper/723:12:427
1227083991814,2cyclictest1788607-21if_p4p123:24:397
1227083991813,4cyclictest635-21systemd-journal20:24:187
122708399180,16cyclictest1617762-21ssh22:13:497
1227081991815,2cyclictest1518260-21kworker/u16:0+events_unbound21:59:366
1227081991812,6cyclictest1725722-21kworker/u16:0+events_unbound23:59:306
1227078991816,2cyclictest1240674-21kworker/u16:0+flush-8:019:21:305
18360572170,1sleep40-21swapper/423:44:264
1227083991716,0cyclictest0-21swapper/719:54:427
1227083991716,0cyclictest0-21swapper/719:29:357
1227083991715,1cyclictest0-21swapper/700:29:537
1227083991713,3cyclictest1234-21snmpd20:45:147
1227083991713,3cyclictest1234-21snmpd20:45:147
1227081991715,2cyclictest1521667-21kworker/u16:4+flush-8:021:34:466
1227078991715,2cyclictest1336082-21kworker/u16:1+flush-8:020:29:255
1227083991615,0cyclictest0-21swapper/722:47:497
1227083991615,0cyclictest0-21swapper/720:04:387
1227083991614,1cyclictest0-21swapper/720:54:427
1227083991613,2cyclictest0-21swapper/722:39:497
122708399160,14cyclictest635-21systemd-journal00:09:237
122708399160,14cyclictest1640278-21sh22:20:417
1227081991614,2cyclictest1198207-21kworker/u16:3+events_unbound19:14:266
1227081991614,2cyclictest1198207-21kworker/u16:3+events_unbound19:14:266
1227078991614,2cyclictest1336082-21kworker/u16:1+events_unbound21:05:225
1227083991515,0cyclictest0-21swapper/719:09:517
1227083991512,2cyclictest1496335-21ssh21:22:427
1227081991513,2cyclictest1461286-21kworker/u16:3+flush-8:021:34:236
1227074991513,2cyclictest1772831-21kworker/u16:4+flush-8:023:19:514
1227074991512,2cyclictest1725722-21kworker/u16:0+flush-8:023:34:344
1227074991512,2cyclictest1725722-21kworker/u16:0+flush-8:023:34:344
1227074991512,2cyclictest1725722-21kworker/u16:0+flush-8:000:19:534
122707499150,15cyclictest0-21swapper/421:28:524
122708399148,5cyclictest1775223-21latency_hist23:19:237
1227083991411,2cyclictest0-21swapper/722:34:247
1227083991410,3cyclictest1234-21snmpd19:41:067
1227081991413,1cyclictest0-21swapper/621:53:426
1227081991412,2cyclictest1461286-21kworker/u16:3+flush-8:021:24:536
1227081991410,4cyclictest0-21swapper/619:20:066
122708199140,14cyclictest0-21swapper/623:57:096
122708199140,14cyclictest0-21swapper/622:57:336
122708199140,13cyclictest0-21swapper/621:44:486
1227078991412,2cyclictest1326446-21kworker/u16:0+flush-8:019:56:065
1227078991412,2cyclictest1240674-21kworker/u16:0+flush-8:019:41:075
1227074991413,1cyclictest0-21swapper/423:12:374
1227074991413,1cyclictest0-21swapper/422:18:424
122707499140,14cyclictest0-21swapper/422:36:024
122707499140,14cyclictest0-21swapper/419:39:464
1227083991310,2cyclictest1507081-21ssh21:25:147
1227083991310,2cyclictest1234-21snmpd22:54:497
122708399130,11cyclictest1234-21snmpd19:39:187
1227081991311,2cyclictest1518260-21kworker/u16:0+events_unbound22:19:386
1227078991311,2cyclictest1198207-21kworker/u16:3+flush-8:020:04:005
1227074991312,1cyclictest0-21swapper/420:40:004
1227074991312,1cyclictest0-21swapper/400:29:144
122708399129,2cyclictest1234-21snmpd20:27:347
122708399128,3cyclictest1234-21snmpd23:48:377
122708399128,3cyclictest1234-21snmpd20:52:567
122708399128,3cyclictest1234-21snmpd19:53:067
122708399127,4cyclictest6382-21gvfs-afc-volume20:59:497
122708399126,5cyclictest6382-21gvfs-afc-volume23:29:567
122708399126,5cyclictest6382-21gvfs-afc-volume19:14:277
122708399126,5cyclictest6382-21gvfs-afc-volume19:14:277
122708399123,7cyclictest6895-21gmain21:29:497
122708399120,11cyclictest1234-21snmpd20:09:287
1227081991211,1cyclictest0-21swapper/621:40:566
122708199120,12cyclictest0-21swapper/620:50:576
1227078991210,2cyclictest1336082-21kworker/u16:1+flush-8:020:44:065
122707499129,3cyclictest0-21swapper/419:33:174
122707499129,2cyclictest1692149-21irqcore22:44:404
1227074991211,1cyclictest0-21swapper/421:50:474
122708399118,2cyclictest1234-21snmpd00:37:117
122708399117,3cyclictest1234-21snmpd22:24:447
122708399116,5cyclictest6382-21gvfs-afc-volume22:15:307
122708399116,4cyclictest1402602-21ntpq20:34:477
1227083991111,0cyclictest0-21swapper/722:31:577
122708199119,2cyclictest1725722-21kworker/u16:0+flush-8:023:04:536
122708199116,4cyclictest1703938-21cat22:49:376
1227081991110,1cyclictest0-21swapper/621:08:366
122708199110,4cyclictest1318584-21irqcore19:54:406
122707899119,2cyclictest1326446-21kworker/u16:0+flush-8:020:14:475
122707499112,8cyclictest0-21swapper/422:09:074
1227074991110,1cyclictest0-21swapper/422:54:104
1227074991110,1cyclictest0-21swapper/422:04:214
122707499110,11cyclictest0-21swapper/419:37:244
122708399107,2cyclictest1234-21snmpd20:43:117
122708399106,3cyclictest1234-21snmpd21:04:537
122708199108,2cyclictest86-21ksoftirqd/622:59:516
122708199108,2cyclictest1521667-21kworker/u16:4+events_unbound22:40:336
122708199104,5cyclictest0-21swapper/623:34:426
122708199104,5cyclictest0-21swapper/623:34:426
122708199100,9cyclictest1826216-21kthreadcore23:39:406
122708199100,9cyclictest1755224-21kthreadcore23:09:436
122708199100,9cyclictest1493390-21kthreadcore21:19:446
122708199100,9cyclictest1441044-21/usr/sbin/munin20:54:486
122708199100,4cyclictest1655726-21irqcore22:29:396
122708199100,3cyclictest1647122-21cut22:24:426
122708199100,3cyclictest1467631-21cut21:09:446
122708199100,3cyclictest1381762-21kthreadcore20:24:446
122708199100,3cyclictest1331367-21cut19:59:426
122707499109,1cyclictest0-21swapper/421:39:174
122707499107,2cyclictest1378442-21kthreadcore20:24:424
12270839996,2cyclictest1234-21snmpd19:46:067
12270839992,6cyclictest6514-21gmain19:59:467
12270819997,2cyclictest86-21ksoftirqd/600:17:356
12270819997,2cyclictest86-21ksoftirqd/600:17:356
12270819996,2cyclictest1240674-21kworker/u16:0+flush-8:019:44:356
12270819995,3cyclictest1840215-21kthreadcore23:44:406
12270819991,7cyclictest1806756-21kthreadcore23:29:446
12270819990,8cyclictest1852230-21kthreadcore23:49:416
12270819990,8cyclictest1271720-21kthreadcore19:29:406
12270819990,1cyclictest0-21swapper/600:29:446
12270749998,1cyclictest0-21swapper/421:19:154
12270749996,2cyclictest1725722-21kworker/u16:0+flush-8:023:59:284
12270819987,1cyclictest86-21ksoftirqd/600:04:386
12270819986,2cyclictest86-21ksoftirqd/600:26:266
12270819983,4cyclictest1385194-21expr20:29:356
12270819983,4cyclictest1338131-21cut20:04:406
12270819983,2cyclictest0-21swapper/619:09:396
12270819980,7cyclictest1356179-21cat20:14:356
12270819980,2cyclictest0-21swapper/619:49:386
12270749986,1cyclictest0-21swapper/423:14:364
12270749986,1cyclictest0-21swapper/421:29:444
12270749986,1cyclictest0-21swapper/420:54:424
12270749985,2cyclictest1260761-21irqcore19:24:404
12270749985,2cyclictest0-21swapper/423:04:394
12270749984,3cyclictest1715794-21df_inode22:54:374
12270749984,3cyclictest1577500-21kthreadcore21:54:464
12270749984,3cyclictest1246081-21cut19:14:434
12270749984,3cyclictest1246081-21cut19:14:434
12270749983,4cyclictest1862861-21cut23:54:404
12270749983,4cyclictest1850595-21tr23:49:404
12270749983,4cyclictest1799875-21/usr/sbin/munin23:29:354
12270749983,4cyclictest1637700-21cut22:19:444
12270749983,4cyclictest1612191-21cut22:09:434
12270749983,4cyclictest1486215-21cut21:19:374
12270749983,4cyclictest1467917-21cut21:09:444
12270749983,4cyclictest1364456-21wc20:14:514
12270749983,4cyclictest1351342-21cut20:09:434
12270749983,4cyclictest1338075-21cut20:04:404
12270749983,4cyclictest1333007-21cut19:59:424
12270749983,4cyclictest1313863-21cut19:49:434
12270749983,4cyclictest1227926-21tune2fs19:09:374
12270749980,7cyclictest1322608-21kthreadcore19:54:434
12270819973,3cyclictest1260048-21grep19:24:366
12270819970,6cyclictest0-21swapper/623:24:366
12270749975,1cyclictest0-21swapper/421:44:354
12270749975,1cyclictest0-21swapper/420:49:354
12270749975,1cyclictest0-21swapper/420:44:404
12270749975,1cyclictest0-21swapper/420:44:404
12270749974,2cyclictest1788332-21entropy23:24:374
12270749973,3cyclictest1824451-21expr23:39:354
12270749973,3cyclictest1534154-21cat21:39:364
12270749973,3cyclictest1459790-21grep21:04:454
12270749973,3cyclictest1442628-21expr20:59:354
12270749973,3cyclictest1397039-21cut20:34:414
12270749973,3cyclictest1384857-21cpuspeed_turbos20:29:354
12270749973,3cyclictest1-21systemd00:39:234
12270749972,4cyclictest1727994-21grep22:59:364
12270749972,4cyclictest1682111-21cut22:39:414
12270749972,4cyclictest1655332-21cat22:29:354
12270749972,4cyclictest1644707-21cat22:24:414
12270749972,4cyclictest1298416-21cpuspeed_turbos19:44:354
12270749972,4cyclictest1250669-21expr19:19:344
12270749971,1cyclictest201rcu_preempt00:04:404
12270749964,1cyclictest0-21swapper/400:33:554
12270749960,1cyclictest0-21swapper/400:18:124
12270749960,1cyclictest0-21swapper/400:18:124
12270749950,5cyclictest0-21swapper/420:19:354
12270749950,4cyclictest1906139-21taskset00:10:384
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional