You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 18:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Wed Nov 19, 2025 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
126647827059,7sleep60-21swapper/615:22:396
1266912996054,5cyclictest1553713-21latency_hist17:43:427
1266912995954,4cyclictest1402005-21latency_hist16:28:437
1266912995954,4cyclictest1402005-21latency_hist16:28:437
126650425848,7sleep50-21swapper/515:23:025
126632425848,7sleep40-21swapper/415:20:364
1266905995350,2cyclictest1695085-21kworker/u16:2+events_unbound19:18:425
1266901995149,2cyclictest1432129-21kworker/u16:3+flush-8:016:55:214
1266912995044,5cyclictest589235-21systemd-journal18:38:427
1266901995048,2cyclictest1806375-21kworker/u16:0+flush-8:019:49:124
1266901994845,2cyclictest1406456-21kworker/u16:1+flush-8:016:34:214
1266901994845,2cyclictest1381630-21kworker/u16:3+events_unbound16:28:214
1266901994845,2cyclictest1381630-21kworker/u16:3+events_unbound16:28:214
1266901994745,2cyclictest1847271-21kworker/u16:2+events_unbound20:26:214
1266901994744,2cyclictest1816541-21kworker/u16:1+events_unbound19:53:454
1266901994644,2cyclictest1858372-21kworker/u16:1+events_unbound20:16:214
1266901994644,2cyclictest1542855-21kworker/u16:4+events_unbound17:44:224
1266901994644,2cyclictest1542855-21kworker/u16:4+events_unbound17:42:214
1266901994644,2cyclictest1442338-21kworker/u16:0+events_unbound18:13:204
1266901994543,2cyclictest1675242-21kworker/u16:0+events_unbound18:56:214
1266901994543,2cyclictest1236043-21kworker/u16:4+flush-8:015:40:214
1266901994543,2cyclictest1236043-21kworker/u16:4+flush-8:015:40:214
1266905994440,3cyclictest1246153-21kworker/u16:0+flush-8:015:44:125
1266901994442,2cyclictest1406456-21kworker/u16:1+flush-8:017:23:204
1266901994441,2cyclictest1725412-21kworker/u16:1+events_unbound19:28:444
1266901994441,2cyclictest1236043-21kworker/u16:4+flush-8:015:48:454
1266901994240,2cyclictest1846862-21kworker/u16:0+events_unbound20:11:204
1266901994240,2cyclictest1846862-21kworker/u16:0+events_unbound20:11:204
1266901994240,2cyclictest1725412-21kworker/u16:1+events_unbound19:44:204
1266901994240,2cyclictest1675242-21kworker/u16:0+events_unbound18:51:224
1266901994240,2cyclictest1503112-21kworker/u16:2+flush-8:017:29:164
1266901994239,2cyclictest1442338-21kworker/u16:0+events_unbound18:15:214
1266901994038,2cyclictest1897606-21kworker/u16:4+flush-8:020:34:204
1266901994038,2cyclictest1786257-21kworker/u16:4+flush-8:019:43:204
1266901994038,2cyclictest1725412-21kworker/u16:1+events_unbound19:14:454
1266901994038,2cyclictest1665007-21kworker/u16:1+flush-8:018:39:204
1266901994038,2cyclictest1665007-21kworker/u16:1+flush-8:018:39:204
1266901993937,2cyclictest1847271-21kworker/u16:2+flush-8:020:21:204
1266901993937,2cyclictest1593897-21kworker/u16:1+events_unbound18:26:214
1266901993937,2cyclictest1452395-21kworker/u16:4+events_unbound17:15:214
1266901993936,2cyclictest1267106-21kworker/u16:1+flush-8:015:44:094
12656402391,32sleep70-21swapper/715:19:197
1266905993834,3cyclictest1432129-21kworker/u16:3+flush-8:016:48:435
1266901993836,2cyclictest1351249-21kworker/u16:0+events_unbound16:32:214
1266901993836,2cyclictest1341081-21kworker/u16:2+events_unbound16:42:214
1266901993835,2cyclictest1746042-21kworker/u16:3+events_unbound19:22:214
1266912993732,4cyclictest1341332-21latency_hist15:58:437
1266901993735,2cyclictest1897606-21kworker/u16:4+flush-8:020:44:284
18137612360,0sleep71813760-21grep19:49:057
1266901993634,2cyclictest1267106-21kworker/u16:1+events_unbound16:00:224
1266901993633,2cyclictest1654721-21kworker/u16:3+events_unbound19:08:444
1266901993533,2cyclictest1406456-21kworker/u16:1+flush-8:017:10:534
1266901993533,2cyclictest1406456-21kworker/u16:1+flush-8:017:10:534
1266901993533,2cyclictest1351249-21kworker/u16:0+events_unbound16:17:304
1266912993428,5cyclictest1695407-21latency_hist18:53:437
1266905993430,3cyclictest1907762-21kworker/u16:2+flush-8:020:38:575
1266901993431,2cyclictest1886702-21kworker/u16:3+flush-8:020:28:524
1266901993431,2cyclictest1442338-21kworker/u16:0+events_unbound17:23:534
1266912993327,4cyclictest1432352-21latency_hist16:43:437
1266905993330,2cyclictest1634529-21kworker/u16:4+flush-8:019:10:535
1266905993329,3cyclictest1341081-21kworker/u16:2+flush-8:015:59:535
1266901993331,2cyclictest1826764-21kworker/u16:4+events_unbound20:05:524
1266901993330,2cyclictest1442338-21kworker/u16:0+events_unbound18:03:454
1266912993231,0cyclictest0-21swapper/717:14:187
1266905993230,2cyclictest1614202-21kworker/u16:3+events_unbound18:19:075
1266901993230,2cyclictest1695085-21kworker/u16:2+events_unbound19:05:214
1266901993230,2cyclictest1503112-21kworker/u16:2+events_unbound18:19:544
1266901993230,2cyclictest1351249-21kworker/u16:0+flush-8:016:19:204
1266901993129,2cyclictest1442338-21kworker/u16:0+events_unbound17:53:204
1266905993026,3cyclictest1442338-21kworker/u16:0+flush-8:017:13:135
1266905993026,3cyclictest1442338-21kworker/u16:0+flush-8:017:13:135
1266901993028,2cyclictest1766123-21kworker/u16:0+flush-8:019:35:304
1266901993028,2cyclictest1281080-21kworker/u16:3+events_unbound16:06:344
126691299290,27cyclictest589235-21systemd-journal18:47:207
1266901992927,2cyclictest1928095-21kworker/u16:1+flush-8:020:53:294
1266901992927,2cyclictest1442338-21kworker/u16:0+flush-8:017:37:454
1266901992927,2cyclictest1432129-21kworker/u16:3+events_unbound16:53:224
1266901992927,2cyclictest1281080-21kworker/u16:3+flush-8:015:28:534
1266912992827,0cyclictest0-21swapper/720:51:527
1266912992826,1cyclictest0-21swapper/720:19:017
1266905992826,2cyclictest1897606-21kworker/u16:4+flush-8:020:48:575
1266905992825,2cyclictest1886702-21kworker/u16:3+events_unbound20:28:575
1266905992725,2cyclictest1341081-21kworker/u16:2+flush-8:016:59:015
1266905992724,2cyclictest1776718-21kworker/u16:2+flush-8:019:34:035
1266905992723,3cyclictest1391777-21kworker/u16:4+flush-8:016:29:045
1266901992725,2cyclictest1432129-21kworker/u16:3+events_unbound17:06:294
1266901992724,2cyclictest1654721-21kworker/u16:3+events_unbound18:58:524
1266905992624,2cyclictest1897606-21kworker/u16:4+flush-8:020:34:055
1266905992624,2cyclictest1826764-21kworker/u16:4+flush-8:019:58:385
1266901992624,2cyclictest1675242-21kworker/u16:0+events_unbound18:44:204
1266901992624,2cyclictest1236043-21kworker/u16:4+flush-8:015:37:094
1266912992524,0cyclictest0-21swapper/717:59:057
1266912992524,0cyclictest0-21swapper/716:09:037
1266905992522,2cyclictest1654721-21kworker/u16:3+flush-8:018:34:045
1266901992522,2cyclictest1695085-21kworker/u16:2+events_unbound19:23:434
1266901992522,2cyclictest1695085-21kworker/u16:2+events_unbound19:23:434
1266901992522,2cyclictest1644769-21kworker/u16:2+flush-8:018:29:084
1266912992418,5cyclictest1836940-21latency_hist20:03:427
1266905992422,2cyclictest1634529-21kworker/u16:4+events_unbound19:04:065
1266905992422,2cyclictest1542855-21kworker/u16:4+events_unbound17:58:385
1266905992422,2cyclictest1542855-21kworker/u16:4+events_unbound17:58:385
1266905992422,2cyclictest1351249-21kworker/u16:0+events_unbound16:14:195
1266905992421,3cyclictest1542855-21kworker/u16:4+flush-8:017:43:515
17767752230,1chrt0-21swapper/619:33:576
1266912992322,0cyclictest0-21swapper/715:49:007
1266905992321,2cyclictest1886702-21kworker/u16:3+events_unbound20:28:425
1266905992321,2cyclictest1654721-21kworker/u16:3+flush-8:018:44:125
1266905992321,2cyclictest1452395-21kworker/u16:4+flush-8:017:18:435
1266905992320,2cyclictest1816541-21kworker/u16:1+flush-8:020:08:365
1266901992321,2cyclictest1442338-21kworker/u16:0+flush-8:018:36:454
1266901992321,2cyclictest1341081-21kworker/u16:2+events_unbound16:46:534
1266901992321,2cyclictest1281080-21kworker/u16:3+flush-8:015:54:204
1266912992221,0cyclictest0-21swapper/718:54:047
1266912992221,0cyclictest0-21swapper/716:34:037
1266912992217,4cyclictest1766229-21latency_hist19:28:437
1266912992217,4cyclictest1766229-21latency_hist19:28:437
1266912992215,5cyclictest589235-21systemd-journal17:08:437
1266910992220,2cyclictest1432129-21kworker/u16:3+events_unbound16:44:136
1266905992220,2cyclictest1826764-21kworker/u16:4+flush-8:020:03:375
1266905992220,2cyclictest1267106-21kworker/u16:1+events_unbound16:04:055
1266905992218,3cyclictest1725412-21kworker/u16:1+events_unbound19:18:595
1266901992220,2cyclictest1806375-21kworker/u16:0+events_unbound19:59:274
1266901992220,2cyclictest1246486-21kworker/u16:2+events_unbound15:27:014
1266912992120,0cyclictest0-21swapper/720:24:027
1266912992120,0cyclictest0-21swapper/716:48:587
1266912992119,1cyclictest1675241-21sed18:43:437
1266912992119,1cyclictest1675241-21sed18:43:437
1266905992119,2cyclictest1634529-21kworker/u16:4+events_unbound18:53:415
1266905992117,3cyclictest1725412-21kworker/u16:1+flush-8:019:38:565
1266901992119,2cyclictest1503112-21kworker/u16:2+flush-8:017:57:214
1266901992119,2cyclictest1503112-21kworker/u16:2+flush-8:017:57:214
1266901992119,2cyclictest1351249-21kworker/u16:0+events_unbound16:12:144
1266912992015,4cyclictest1493034-21latency_hist17:13:437
1266912992015,4cyclictest1493034-21latency_hist17:13:437
1266905992018,2cyclictest1766123-21kworker/u16:0+events_unbound19:29:175
1266905992018,2cyclictest1593897-21kworker/u16:1+flush-8:018:04:025
1266905992018,2cyclictest1341081-21kworker/u16:2+flush-8:016:39:075
1266905992018,2cyclictest1341081-21kworker/u16:2+events_unbound17:08:385
1266905992017,3cyclictest1675242-21kworker/u16:0+flush-8:018:59:095
1266905992017,3cyclictest1406456-21kworker/u16:1+flush-8:016:34:115
1266901992018,2cyclictest1858372-21kworker/u16:1+flush-8:020:39:564
1266901992018,2cyclictest1452395-21kworker/u16:4+events_unbound16:59:294
1266912991917,1cyclictest0-21swapper/719:04:097
126691299190,17cyclictest0-21swapper/718:24:087
1266905991917,2cyclictest1593897-21kworker/u16:1+flush-8:018:29:125
1266905991917,2cyclictest1593897-21kworker/u16:1+flush-8:018:24:115
1266905991917,2cyclictest1503112-21kworker/u16:2+events_unbound17:31:525
1266905991917,2cyclictest1503112-21kworker/u16:2+events_unbound17:23:435
1266905991917,2cyclictest1406456-21kworker/u16:1+flush-8:016:57:335
1266905991916,2cyclictest1858372-21kworker/u16:1+flush-8:020:14:035
1266905991916,2cyclictest1846862-21kworker/u16:0+events_unbound20:08:445
1266905991916,2cyclictest1846862-21kworker/u16:0+events_unbound20:08:445
1266905991916,2cyclictest1675242-21kworker/u16:0+flush-8:018:56:525
1266905991916,2cyclictest1442338-21kworker/u16:0+flush-8:017:51:275
1266912991815,2cyclictest0-21swapper/718:33:427
1266912991812,5cyclictest0-21swapper/720:34:127
1266910991816,2cyclictest1786257-21kworker/u16:4+flush-8:019:38:586
1266905991816,2cyclictest1806375-21kworker/u16:0+flush-8:019:48:585
1266905991815,2cyclictest1442338-21kworker/u16:0+flush-8:018:03:245
1266905991815,2cyclictest1351249-21kworker/u16:0+flush-8:016:21:525
1266905991814,3cyclictest1267106-21kworker/u16:1+flush-8:015:49:095
1266905991814,3cyclictest1246153-21kworker/u16:0+flush-8:015:33:435
126691299179,6cyclictest589235-21systemd-journal19:33:427
1266912991716,0cyclictest0-21swapper/715:28:477
1266912991713,2cyclictest0-21swapper/720:04:097
1266912991712,4cyclictest1276852-21latency_hist15:28:437
1266905991715,2cyclictest1503112-21kworker/u16:2+events_unbound17:39:085
1266905991715,2cyclictest1246153-21kworker/u16:0+events_unbound15:28:215
1266912991613,2cyclictest0-21swapper/719:33:437
1266912991611,4cyclictest589235-21systemd-journal15:36:297
1266912991611,4cyclictest1573991-21latency_hist17:53:437
126691099160,15cyclictest1446640-21kthreadcore16:49:026
1266905991614,2cyclictest1442338-21kworker/u16:0+events_unbound17:24:075
1266905991614,2cyclictest1381630-21kworker/u16:3+flush-8:016:23:585
1266905991614,2cyclictest1381630-21kworker/u16:3+flush-8:016:23:585
1266905991613,2cyclictest1786257-21kworker/u16:4+flush-8:019:43:585
126691299157,7cyclictest27394-21gmain16:44:047
1266912991510,4cyclictest589235-21systemd-journal20:31:197
1266912991510,4cyclictest1391883-21latency_hist16:23:437
126691299149,4cyclictest1756154-21latency_hist19:23:427
126691299149,3cyclictest1320213-21ntp_states15:44:127
1266912991410,3cyclictest0-21swapper/716:08:437
1266912991410,2cyclictest1411331-21smart_sda16:29:147
1266910991412,2cyclictest1406456-21kworker/u16:1+events_unbound16:54:136
126691099140,14cyclictest0-21swapper/617:48:576
1266905991412,2cyclictest1746042-21kworker/u16:3+flush-8:019:24:085
1266905991412,2cyclictest1746042-21kworker/u16:3+flush-8:019:24:085
1266905991412,2cyclictest1442338-21kworker/u16:0+flush-8:016:49:125
1266905991412,2cyclictest1267106-21kworker/u16:1+flush-8:015:39:175
1266905991412,2cyclictest1267106-21kworker/u16:1+flush-8:015:39:175
1266905991410,3cyclictest1826764-21kworker/u16:4+flush-8:020:22:505
126691299139,3cyclictest4175659-21snmpd19:01:287
126691299138,4cyclictest27763-21gvfs-afc-volume17:53:587
126691299138,4cyclictest27763-21gvfs-afc-volume17:53:587
126691299136,7cyclictest27204-21gmain20:39:127
1266912991312,0cyclictest0-21swapper/719:13:317
1266912991310,2cyclictest0-21swapper/720:13:427
1266912991310,2cyclictest0-21swapper/720:13:427
1266910991312,1cyclictest0-21swapper/618:59:446
1266910991312,1cyclictest0-21swapper/615:28:486
1266905991311,2cyclictest1917762-21kworker/u16:3+events_unbound20:47:215
1266905991311,2cyclictest1351249-21kworker/u16:0+events_unbound16:12:215
1266905991311,2cyclictest1281080-21kworker/u16:3+events_unbound15:36:225
126691299129,2cyclictest4175659-21snmpd19:17:587
126691299129,2cyclictest4175659-21snmpd18:12:247
126691299129,2cyclictest4175659-21snmpd17:20:597
126691299126,5cyclictest1928106-21latency_hist20:48:427
126691299124,7cyclictest0-21swapper/718:08:067
1266912991212,0cyclictest0-21swapper/717:27:287
1266912991211,0cyclictest0-21swapper/719:53:567
126691299120,5cyclictest1634586-21sshd-session18:21:207
1266910991211,1cyclictest0-21swapper/620:32:256
1266910991211,1cyclictest0-21swapper/619:27:096
1266910991211,1cyclictest0-21swapper/619:27:096
1266910991211,1cyclictest0-21swapper/616:03:576
1266910991211,1cyclictest0-21swapper/615:39:596
1266910991211,1cyclictest0-21swapper/615:39:596
126691099120,1cyclictest0-21swapper/617:47:226
126691099120,12cyclictest0-21swapper/620:08:096
126691099120,12cyclictest0-21swapper/618:03:466
126691099120,12cyclictest0-21swapper/617:00:236
126691099120,12cyclictest0-21swapper/616:26:306
126691099120,12cyclictest0-21swapper/616:26:306
126690599129,2cyclictest1666478-21irqcore18:39:035
126690599129,2cyclictest1666478-21irqcore18:39:035
1266901991210,2cyclictest1442338-21kworker/u16:0+flush-8:017:59:204
126691299118,2cyclictest4175659-21snmpd19:46:087
126691299118,2cyclictest4175659-21snmpd18:17:187
126691299117,3cyclictest1523783-21/usr/sbin/munin17:29:107
126691299115,5cyclictest1462674-21latency_hist16:58:437
126691299111,8cyclictest589356-21tuned-ppd16:14:037
126691299110,9cyclictest1341726-21/usr/sbin/munin15:59:137
126691299110,2cyclictest21523-21lldpd19:39:047
126691299110,10cyclictest4175659-21snmpd20:15:327
126691099119,1cyclictest1590738-21kthreadcore17:59:066
126691099118,2cyclictest1442338-21kworker/u16:0+flush-8:018:13:436
126691099117,3cyclictest1886341-21tr20:24:056
126691099117,3cyclictest1771357-21grep19:29:046
126691099116,4cyclictest1490575-21kthreadcore17:09:066
126691099116,4cyclictest1490575-21kthreadcore17:09:066
126691099112,4cyclictest18173891cpuspeed_turbos19:53:556
1266910991110,1cyclictest0-21swapper/620:49:366
1266910991110,1cyclictest0-21swapper/618:16:136
1266910991110,1cyclictest0-21swapper/617:20:256
1266910991110,1cyclictest0-21swapper/616:40:136
126691099110,11cyclictest0-21swapper/618:27:066
126691099110,0cyclictest0-21swapper/619:21:296
126690599110,11cyclictest0-21swapper/518:09:285
126691299107,2cyclictest0-21swapper/717:34:077
126691299107,2cyclictest0-21swapper/715:39:187
126691299107,2cyclictest0-21swapper/715:39:187
126691299106,3cyclictest96-21ksoftirqd/716:58:597
126691299102,7cyclictest0-21swapper/717:44:077
126691099109,1cyclictest0-21swapper/620:46:186
126691099109,1cyclictest0-21swapper/620:18:426
126691099108,1cyclictest1726284-21grep19:08:576
126691099106,3cyclictest1657463-21tr18:34:026
126691099106,3cyclictest1520012-21kthreadcore17:24:056
126691099106,3cyclictest1341965-21grep15:58:566
126691099102,7cyclictest19100021kthreadcore20:39:026
126691099102,7cyclictest1332104-21expr15:53:576
126691099101,5cyclictest15473501kthreadcore17:39:026
126690599100,10cyclictest0-21swapper/518:17:125
12669109998,1cyclictest0-21swapper/616:32:586
12669109997,1cyclictest1534696-21iostat17:34:016
12669109997,1cyclictest0-21swapper/618:39:046
12669109997,1cyclictest0-21swapper/618:39:046
12669109994,4cyclictest984965-21wsdd19:49:586
12669109994,4cyclictest1797691-21cat19:43:586
12669109993,5cyclictest1473820-21cut17:03:576
12669109993,5cyclictest1382834-21grep16:18:586
12669109992,6cyclictest1867777-21cpu20:18:556
12669109992,6cyclictest1828093-21sed19:59:016
12669109992,6cyclictest1740083-21cut19:14:046
12669109992,6cyclictest1628332-21kthreadcore18:19:026
12669109992,6cyclictest1583859-21chrt17:55:426
12669109992,6cyclictest1583859-21chrt17:55:426
12669109992,6cyclictest1524594-21iostat_ios17:28:596
12669109992,6cyclictest1414749-21cat16:34:026
12669109992,6cyclictest1372792-21grep16:14:016
12669109992,6cyclictest1365571-21grep16:09:036
12669109992,6cyclictest1314495-21kthreadcore15:44:046
12669109992,6cyclictest1300882-21chrt15:37:286
12669109992,6cyclictest12725811cut15:24:036
12669109990,8cyclictest0-21swapper/615:49:026
12669059994,4cyclictest1332248-21grep15:53:585
12669109986,1cyclictest0-21swapper/618:53:576
12669109983,4cyclictest1645680-21expr18:28:566
12669109982,5cyclictest1898660-21expr20:33:596
12669109982,5cyclictest1847551-21cat20:08:566
12669109982,5cyclictest1847551-21cat20:08:566
12669109982,5cyclictest1716338-21expr19:03:576
12669109982,5cyclictest1687380-21cat18:49:046
12669109982,5cyclictest1676021-21cat18:43:576
12669109982,5cyclictest1493931-21cstates17:13:596
12669059975,1cyclictest0-21swapper/517:33:585
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional