You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 08:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Thu Aug 06, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1541443994842,5cyclictest1958552-21latency_hist22:23:307
154085324712,30sleep70-21swapper/719:04:267
1541438994239,2cyclictest2003534-21kworker/u16:2+events_unbound23:53:316
1541429994139,2cyclictest1718966-21kworker/u16:0+events_unbound21:18:304
1541443994039,0cyclictest0-21swapper/720:39:007
1541429994037,2cyclictest1838242-21kworker/u16:1+events_unbound22:08:324
1541443993933,5cyclictest1994674-21latency_hist22:38:307
1541438993836,2cyclictest2163491-21kworker/u16:0+events_unbound00:16:326
1541429993836,2cyclictest2150288-21kworker/u16:3+events_unbound00:06:154
1541429993836,2cyclictest2150288-21kworker/u16:3+events_unbound00:06:154
154083023827,7sleep50-21swapper/519:04:085
1541438993735,2cyclictest2016899-21kworker/u16:3+events_unbound23:06:486
1541443993634,1cyclictest0-21swapper/723:27:597
1541443993634,1cyclictest0-21swapper/723:27:597
1541438993634,2cyclictest1946591-21kworker/u16:0+events_unbound22:35:286
1541438993634,2cyclictest1838242-21kworker/u16:1+events_unbound23:18:286
1541438993634,2cyclictest1690312-21kworker/u16:2+flush-8:020:38:546
1541429993633,2cyclictest1838242-21kworker/u16:1+events_unbound21:48:324
1541429993632,3cyclictest1790008-21kworker/u16:4+flush-8:021:23:304
1541443993534,0cyclictest0-21swapper/721:33:337
1541443993530,4cyclictest2079086-21latency_hist23:13:307
1541438993533,2cyclictest1811762-21kworker/u16:2+events_unbound21:25:566
1541438993533,2cyclictest1790008-21kworker/u16:4+events_unbound21:42:566
1541429993534,1cyclictest1838242-21kworker/u16:1+events_unbound22:04:164
1541429993533,2cyclictest2079128-21kworker/u16:0+events_unbound23:39:404
1541429993533,2cyclictest1946591-21kworker/u16:0+events_unbound22:19:564
1541429993533,2cyclictest1910512-21kworker/u16:4+events_unbound22:36:094
1541429993533,2cyclictest1838242-21kworker/u16:1+events_unbound22:51:164
1541429993532,3cyclictest1718966-21kworker/u16:0+events_unbound22:02:484
1541443993433,0cyclictest0-21swapper/723:21:287
1541443993432,1cyclictest1777957-21diskmemload22:26:487
1541438993432,2cyclictest2079128-21kworker/u16:0+events_unbound23:29:236
1541438993432,2cyclictest1838242-21kworker/u16:1+events_unbound21:46:566
1541429993432,2cyclictest2079128-21kworker/u16:0+flush-8:023:30:434
1541429993432,2cyclictest2003534-21kworker/u16:2+flush-8:022:44:164
1541429993432,2cyclictest2003534-21kworker/u16:2+flush-8:022:44:164
1541429993432,2cyclictest1838242-21kworker/u16:1+events_unbound23:24:594
1541429993432,2cyclictest1838242-21kworker/u16:1+events_unbound23:24:594
1541443993331,1cyclictest2042262-21ssh22:57:207
1541443993327,5cyclictest1574202-21latency_hist19:23:317
1541438993331,2cyclictest1838242-21kworker/u16:1+flush-8:022:48:036
1541438993331,2cyclictest1838242-21kworker/u16:1+flush-8:022:48:036
1541438993331,2cyclictest1838242-21kworker/u16:1+flush-8:022:41:446
1541438993330,2cyclictest1718966-21kworker/u16:0+flush-8:020:53:336
1541429993331,2cyclictest2235183-21kworker/u16:1+flush-8:000:30:274
1541429993331,2cyclictest2235183-21kworker/u16:1+events_unbound00:35:324
1541429993331,2cyclictest2150288-21kworker/u16:3+flush-8:023:48:084
1541429993331,2cyclictest2079128-21kworker/u16:0+events_unbound23:17:594
1541429993331,2cyclictest2003534-21kworker/u16:2+flush-8:022:42:364
1541429993331,2cyclictest2003534-21kworker/u16:2+flush-8:000:12:114
1541429993331,2cyclictest1838242-21kworker/u16:1+flush-8:023:57:514
1541429993331,2cyclictest1748001-21kworker/u16:1+events_unbound21:12:174
1541429993330,2cyclictest1946591-21kworker/u16:0+flush-8:022:28:564
154090423323,7sleep40-21swapper/419:05:114
1541443993231,0cyclictest0-21swapper/723:47:007
1541443993231,0cyclictest0-21swapper/722:48:287
1541443993231,0cyclictest0-21swapper/722:48:287
1541443993231,0cyclictest0-21swapper/700:17:297
1541443993230,1cyclictest0-21swapper/721:57:087
1541438993230,2cyclictest2150288-21kworker/u16:3+events_unbound23:50:356
1541438993230,2cyclictest2003534-21kworker/u16:2+events_unbound00:20:256
1541438993230,2cyclictest1838242-21kworker/u16:1+events_unbound21:56:256
1541438993230,2cyclictest1811762-21kworker/u16:2+events_unbound22:12:486
1541438993230,2cyclictest1790008-21kworker/u16:4+flush-8:021:23:256
1541429993230,2cyclictest2016899-21kworker/u16:3+events_unbound23:01:164
1541429993230,2cyclictest1811762-21kworker/u16:2+flush-8:021:47:284
1541443993130,0cyclictest0-21swapper/723:56:017
1541443993128,1cyclictest2136962-21/usr/sbin/munin23:34:027
1541443993127,2cyclictest1787934-21ssh21:09:377
1541438993130,1cyclictest2150288-21kworker/u16:3+events_unbound00:06:526
1541438993130,1cyclictest2150288-21kworker/u16:3+events_unbound00:06:526
1541438993129,2cyclictest2030983-21kworker/u16:0+events_unbound22:57:006
1541438993129,2cyclictest2016899-21kworker/u16:3+events_unbound22:59:526
1541438993129,2cyclictest1838242-21kworker/u16:1+events_unbound23:40:096
1541438993129,2cyclictest1838242-21kworker/u16:1+events_unbound23:24:376
1541438993129,2cyclictest1838242-21kworker/u16:1+events_unbound23:24:376
1541438993129,2cyclictest1811762-21kworker/u16:2+events_unbound22:16:136
1541438993129,2cyclictest1718966-21kworker/u16:0+events_unbound21:35:056
1541438993129,2cyclictest1652184-21kworker/u16:4+events_unbound20:08:526
1541438993125,6cyclictest1718966-21kworker/u16:0+events_unbound21:30:336
1541429993129,2cyclictest2163491-21kworker/u16:0+flush-8:000:26:114
1541429993129,2cyclictest2079128-21kworker/u16:0+events_unbound23:22:204
1541429993129,2cyclictest2016899-21kworker/u16:3+events_unbound23:08:204
1541429993129,2cyclictest2003534-21kworker/u16:2+events_unbound00:22:404
1541429993129,2cyclictest1838242-21kworker/u16:1+flush-8:022:58:284
1541429993129,2cyclictest1838242-21kworker/u16:1+events_unbound23:36:444
1541429993129,2cyclictest1811762-21kworker/u16:2+events_unbound22:17:044
1541429993129,2cyclictest1718966-21kworker/u16:0+flush-8:021:39:174
1541429993129,2cyclictest1718966-21kworker/u16:0+events_unbound21:27:284
1541443993029,0cyclictest0-21swapper/721:18:287
1541443993029,0cyclictest0-21swapper/700:38:007
1541443993029,0cyclictest0-21swapper/700:10:527
1541438993028,2cyclictest2016899-21kworker/u16:3+events_unbound23:11:046
1541438993028,2cyclictest1910512-21kworker/u16:4+events_unbound22:31:496
1541438993028,2cyclictest1838242-21kworker/u16:1+events_unbound00:00:176
1541438993028,2cyclictest1811762-21kworker/u16:2+events_unbound22:05:486
1541429993028,2cyclictest2150288-21kworker/u16:3+events_unbound00:16:114
1541429993028,2cyclictest1838242-21kworker/u16:1+events_unbound23:49:324
1541429993028,2cyclictest1838242-21kworker/u16:1+events_unbound22:24:044
1541429993028,2cyclictest1718966-21kworker/u16:0+events_unbound21:30:294
154107823019,8sleep60-21swapper/619:07:386
1541443992928,0cyclictest0-21swapper/723:33:017
1541443992928,0cyclictest0-21swapper/721:24:447
1541443992927,1cyclictest0-21swapper/723:00:007
1541438992927,2cyclictest2079128-21kworker/u16:0+flush-8:023:33:596
1541438992927,2cyclictest2003534-21kworker/u16:2+flush-8:000:34:436
1541438992927,2cyclictest2003534-21kworker/u16:2+events_unbound23:47:046
1541438992927,2cyclictest1838242-21kworker/u16:1+events_unbound21:51:286
1541438992927,2cyclictest1718966-21kworker/u16:0+events_unbound21:17:496
1541429992927,2cyclictest2016899-21kworker/u16:3+events_unbound23:11:204
1541429992927,2cyclictest2003534-21kworker/u16:2+events_unbound00:01:594
1541429992927,2cyclictest1811762-21kworker/u16:2+flush-8:021:56:004
1541429992926,2cyclictest1718966-21kworker/u16:0+flush-8:021:03:324
1541429992926,2cyclictest1541202-21kworker/u16:2+flush-8:019:23:404
1541443992827,0cyclictest0-21swapper/700:31:447
1541443992827,0cyclictest0-21swapper/700:05:127
1541443992827,0cyclictest0-21swapper/700:05:127
1541438992826,2cyclictest1838242-21kworker/u16:1+flush-8:022:02:046
1541438992826,2cyclictest1748001-21kworker/u16:1+events_unbound21:08:286
1541438992826,2cyclictest1530542-21kworker/u16:3+flush-8:019:41:426
1541429992826,2cyclictest1790008-21kworker/u16:4+flush-8:021:36:484
1541429992826,2cyclictest1652184-21kworker/u16:4+flush-8:020:19:044
1541429992826,2cyclictest1530542-21kworker/u16:3+flush-8:020:02:414
1541429992826,2cyclictest1530542-21kworker/u16:3+flush-8:020:02:414
1541429992825,2cyclictest1559126-21kworker/u16:1+flush-8:020:13:414
1541443992726,0cyclictest0-21swapper/723:17:087
1541443992726,0cyclictest0-21swapper/722:18:167
1541443992726,0cyclictest0-21swapper/722:00:457
1541443992726,0cyclictest0-21swapper/721:52:137
1541443992726,0cyclictest0-21swapper/721:31:407
1541443992726,0cyclictest0-21swapper/721:20:287
1541443992726,0cyclictest0-21swapper/700:28:127
1541443992726,0cyclictest0-21swapper/700:22:517
1541443992722,3cyclictest1302-21snmpd22:52:347
1541438992725,2cyclictest2079128-21kworker/u16:0+events_unbound23:20:336
1541438992725,2cyclictest2003534-21kworker/u16:2+events_unbound22:50:296
1541438992725,2cyclictest1946591-21kworker/u16:0+events_unbound22:19:526
1541438992725,2cyclictest1718966-21kworker/u16:0+events_unbound20:49:006
1541438992724,2cyclictest1652184-21kworker/u16:4+flush-8:020:13:566
1541443992625,0cyclictest0-21swapper/722:43:007
1541443992625,0cyclictest0-21swapper/721:44:497
1541438992624,2cyclictest2003534-21kworker/u16:2+events_unbound00:12:576
1541438992624,2cyclictest1593946-21kworker/u16:0+flush-8:019:54:406
1541438992624,2cyclictest1559126-21kworker/u16:1+events_unbound20:31:406
1541433992622,3cyclictest1838242-21kworker/u16:1+flush-8:023:43:515
1541443992524,0cyclictest0-21swapper/723:52:077
1541443992523,1cyclictest1982002-21ssh22:32:167
1541438992523,2cyclictest2235183-21kworker/u16:1+flush-8:000:30:176
1541438992523,2cyclictest1946591-21kworker/u16:0+events_unbound22:25:096
1541438992523,2cyclictest1559126-21kworker/u16:1+flush-8:020:19:406
1541433992524,1cyclictest1748001-21kworker/u16:1+flush-8:021:13:315
1541443992422,1cyclictest1777957-21diskmemload23:39:037
1541438992422,2cyclictest1690312-21kworker/u16:2+flush-8:021:10:526
1541438992422,2cyclictest1593946-21kworker/u16:0+events_unbound19:51:406
1541438992422,2cyclictest1530542-21kworker/u16:3+flush-8:019:44:176
1541438992421,2cyclictest1718966-21kworker/u16:0+events_unbound20:58:326
1541429992422,2cyclictest1690312-21kworker/u16:2+events_unbound20:38:404
1541443992322,0cyclictest0-21swapper/722:05:137
1541443992322,0cyclictest0-21swapper/700:01:527
1541429992321,2cyclictest1559126-21kworker/u16:1+events_unbound20:36:414
1541438992220,2cyclictest2163491-21kworker/u16:0+events_unbound00:25:246
1541438992220,2cyclictest1652184-21kworker/u16:4+events_unbound20:06:416
1541438992220,2cyclictest1559126-21kworker/u16:1+events_unbound19:21:426
1541433992219,2cyclictest1559126-21kworker/u16:1+flush-8:020:18:485
1541443992120,0cyclictest0-21swapper/719:44:007
1541438992119,2cyclictest1530542-21kworker/u16:3+events_unbound19:10:406
1541433992118,2cyclictest1718966-21kworker/u16:0+events_unbound20:58:445
1541433992117,3cyclictest2003534-21kworker/u16:2+flush-8:000:03:515
1541433992117,3cyclictest2003534-21kworker/u16:2+flush-8:000:03:515
1541429992119,2cyclictest1718966-21kworker/u16:0+flush-8:020:59:314
1541429992119,2cyclictest1559126-21kworker/u16:1+events_unbound19:36:414
1541443992019,0cyclictest0-21swapper/720:16:417
1541438992018,2cyclictest1530542-21kworker/u16:3+events_unbound20:01:176
1541438992018,2cyclictest1530542-21kworker/u16:3+events_unbound20:01:176
1541429992018,2cyclictest1690312-21kworker/u16:2+events_unbound20:47:404
1541429992018,2cyclictest1690312-21kworker/u16:2+events_unbound20:47:404
1541429992018,2cyclictest1559126-21kworker/u16:1+flush-8:020:33:264
1541429992017,2cyclictest1690312-21kworker/u16:2+events_unbound20:48:324
1541438991917,2cyclictest1530542-21kworker/u16:3+events_unbound19:35:416
1541443991817,0cyclictest0-21swapper/720:06:087
1541443991815,2cyclictest648-21systemd-journal19:18:307
154144399180,16cyclictest1612948-21latency_hist19:43:307
1541438991816,2cyclictest1718966-21kworker/u16:0+events_unbound20:44:286
1541438991816,2cyclictest1718966-21kworker/u16:0+events_unbound20:44:286
1541429991816,2cyclictest1530542-21kworker/u16:3+events_unbound19:57:184
1541443991716,0cyclictest0-21swapper/720:28:467
1541443991715,1cyclictest0-21swapper/720:58:527
154144399170,15cyclictest1671175-21sshd-session20:13:167
1541438991715,2cyclictest1690312-21kworker/u16:2+events_unbound20:36:066
154143399160,2cyclictest1707353-21kthreadcore20:28:505
154144399159,5cyclictest1758513-21latency_hist20:58:307
1541443991514,0cyclictest0-21swapper/723:07:517
1541443991513,1cyclictest0-21swapper/720:23:547
1541438991513,2cyclictest1541202-21kworker/u16:2+events_unbound19:32:176
154143399150,1cyclictest0-21swapper/521:23:525
1541429991513,2cyclictest1541202-21kworker/u16:2+events_unbound19:23:204
1541443991413,0cyclictest0-21swapper/721:03:477
154144399140,1cyclictest0-21swapper/720:18:537
1541438991412,2cyclictest1690312-21kworker/u16:2+flush-8:020:24:016
1541433991413,1cyclictest0-21swapper/521:18:115
1541433991413,1cyclictest0-21swapper/519:48:195
1541433991413,1cyclictest0-21swapper/500:18:335
154143399140,1cyclictest0-21swapper/522:15:155
154143399140,1cyclictest0-21swapper/519:53:595
154143399140,14cyclictest0-21swapper/522:46:295
154143399140,14cyclictest0-21swapper/522:46:295
154143399140,14cyclictest0-21swapper/522:05:015
154143399140,14cyclictest0-21swapper/521:35:135
154143399140,14cyclictest0-21swapper/521:33:105
154143399140,14cyclictest0-21swapper/500:34:385
154143399140,0cyclictest0-21swapper/523:31:445
1541429991411,2cyclictest1530542-21kworker/u16:3+events_unbound19:28:374
154144399136,6cyclictest6124-21gmain22:10:477
1541443991312,0cyclictest0-21swapper/719:56:337
1541443991310,2cyclictest0-21swapper/721:38:317
1541438991310,2cyclictest1272967-21kworker/u16:0+events_unbound19:13:346
1541433991312,1cyclictest0-21swapper/521:58:525
1541433991312,1cyclictest0-21swapper/500:31:005
154143399130,13cyclictest0-21swapper/523:33:465
154143399130,13cyclictest0-21swapper/522:52:375
154143399130,13cyclictest0-21swapper/522:31:395
154143399130,13cyclictest0-21swapper/522:11:105
154143399130,13cyclictest0-21swapper/520:18:265
154143399130,0cyclictest0-21swapper/522:21:245
1541429991311,2cyclictest1652184-21kworker/u16:4+flush-8:020:09:164
1541429991311,2cyclictest1559126-21kworker/u16:1+flush-8:019:18:304
154142999130,13cyclictest0-21swapper/420:08:164
154144399129,2cyclictest1302-21snmpd20:53:047
154144399129,2cyclictest1302-21snmpd19:50:597
1541433991211,1cyclictest0-21swapper/523:51:175
1541433991211,1cyclictest0-21swapper/523:41:305
1541433991211,1cyclictest0-21swapper/523:14:425
1541433991211,1cyclictest0-21swapper/522:59:155
1541433991211,1cyclictest0-21swapper/521:44:595
1541433991211,1cyclictest0-21swapper/520:02:495
1541433991211,1cyclictest0-21swapper/520:02:495
1541433991211,1cyclictest0-21swapper/519:28:365
1541433991211,1cyclictest0-21swapper/500:27:235
1541433991211,1cyclictest0-21swapper/500:10:505
1541433991211,1cyclictest0-21swapper/500:01:035
1541433991210,2cyclictest0-21swapper/522:40:205
154143399120,12cyclictest0-21swapper/520:06:275
154143399120,12cyclictest0-21swapper/519:50:225
1541429991210,2cyclictest1690312-21kworker/u16:2+flush-8:020:24:524
1541429991210,2cyclictest1530542-21kworker/u16:3+events_unbound19:40:324
154142999120,12cyclictest0-21swapper/419:09:564
154144399118,2cyclictest1302-21snmpd20:00:297
154144399118,2cyclictest1302-21snmpd20:00:297
154144399117,3cyclictest6124-21gmain19:28:447
154144399117,3cyclictest1302-21snmpd20:44:067
154144399117,3cyclictest1302-21snmpd20:44:067
154144399117,3cyclictest1302-21snmpd19:35:467
154144399117,3cyclictest1082-21tuned19:08:497
154144399115,5cyclictest6466-21gmain20:34:007
1541433991110,1cyclictest0-21swapper/521:20:145
1541433991110,1cyclictest0-21swapper/521:04:375
1541433991110,1cyclictest0-21swapper/520:54:135
1541433991110,1cyclictest0-21swapper/520:10:045
1541433991110,1cyclictest0-21swapper/519:39:295
154143399110,0cyclictest0-21swapper/519:26:335
154143399110,0cyclictest0-21swapper/519:17:155
154142999119,2cyclictest1593946-21kworker/u16:0+flush-8:019:44:564
154144399104,5cyclictest6466-21gmain19:24:167
154143899108,1cyclictest0-21swapper/619:23:456
154143399109,1cyclictest0-21swapper/521:54:465
154143399109,1cyclictest0-21swapper/521:42:565
154143399109,1cyclictest0-21swapper/520:46:585
154143399109,1cyclictest0-21swapper/520:46:585
154143399109,1cyclictest0-21swapper/520:43:205
154143399109,1cyclictest0-21swapper/520:34:315
154142999108,2cyclictest1690312-21kworker/u16:2+events_unbound20:53:454
154142999108,1cyclictest0-21swapper/419:48:514
15414339998,1cyclictest0-21swapper/523:05:245
15414339998,1cyclictest0-21swapper/519:35:525
15414339998,1cyclictest0-21swapper/500:14:565
15414339986,1cyclictest0-21swapper/523:23:415
15414339986,1cyclictest0-21swapper/523:23:415
15414339983,4cyclictest2180136-21grep23:53:485
15414339983,4cyclictest2094598-21cut23:18:475
15414339983,4cyclictest2031815-21cat22:53:435
15414339983,4cyclictest1960811-21cut22:23:455
15414339983,4cyclictest1879298-21grep21:48:505
15414339983,4cyclictest1745401-21cut20:48:495
15414339983,4cyclictest1569123-21cut19:18:485
15414339983,4cyclictest1542017-21cat19:08:435
15414339981,1cyclictest201rcu_preempt22:33:505
15414339974,2cyclictest2068795-21kthreadcore23:08:475
15414339973,3cyclictest1691114-21grep20:23:435
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional