You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 01:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Sun Apr 05, 2026 00:43:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
182629721080,1sleep71826299-21sh22:22:427
139784025646,7sleep50-21swapper/518:59:515
139787025545,7sleep60-21swapper/619:00:176
1398310995045,4cyclictest2028417-21latency_hist23:47:257
1398309995047,2cyclictest1526660-21kworker/u16:4+flush-8:020:52:256
1398309995047,2cyclictest1526660-21kworker/u16:4+flush-8:020:52:256
1398303995048,2cyclictest1750180-21kworker/u16:2+events_unbound22:57:254
626589450,38rtkit-daemon0-21swapper/418:58:404
13977952431,38sleep70-21swapper/718:59:137
1398310994236,5cyclictest1956090-21latency_hist23:17:257
1398303994139,2cyclictest1646032-21kworker/u16:1+flush-8:021:17:534
1398303994138,2cyclictest1920102-21kworker/u16:1+events_unbound00:17:294
1398309993735,2cyclictest1646032-21kworker/u16:1+flush-8:021:47:256
1398303993735,2cyclictest1631944-21kworker/u16:0+events_unbound21:48:324
1398303993634,2cyclictest1992626-21kworker/u16:5+events_unbound23:52:324
1398303993634,2cyclictest1631944-21kworker/u16:0+events_unbound21:42:094
1398303993533,2cyclictest688121-21kworker/u16:3+events_unbound21:11:324
1398303993533,2cyclictest2039487-21kworker/u16:3+events_unbound00:32:244
1398303993533,2cyclictest2039487-21kworker/u16:3+events_unbound00:26:114
1398303993533,2cyclictest2015677-21kworker/u16:0+events_unbound00:17:174
1398303993533,2cyclictest1775601-21kworker/u16:4+events_unbound23:27:214
1398303993533,2cyclictest1646032-21kworker/u16:1+events_unbound22:25:364
139831099340,32cyclictest2061446-21runrttasks23:57:487
1398303993432,2cyclictest1773810-21kworker/u16:0+events_unbound23:21:004
1398303993432,2cyclictest1773810-21kworker/u16:0+events_unbound23:14:214
1398303993432,2cyclictest1750180-21kworker/u16:2+events_unbound22:46:364
1398303993332,1cyclictest1752026-21kworker/u16:3+events_unbound22:10:174
1398303993331,2cyclictest2015677-21kworker/u16:0+events_unbound23:59:014
1398303993331,2cyclictest1992626-21kworker/u16:5+events_unbound23:41:004
1398303993230,2cyclictest2049623-21kworker/u16:4+events_unbound00:10:524
1398303993230,2cyclictest2049623-21kworker/u16:4+events_unbound00:10:524
1398303993230,2cyclictest1773810-21kworker/u16:0+events_unbound22:39:014
1398303993229,2cyclictest1773810-21kworker/u16:0+events_unbound23:11:084
1398309993129,2cyclictest1775601-21kworker/u16:4+events_unbound23:07:516
1398303993129,2cyclictest688121-21kworker/u16:3+events_unbound21:14:244
1398303993129,2cyclictest1775601-21kworker/u16:4+flush-8:022:13:084
1398303993129,2cyclictest1773810-21kworker/u16:0+events_unbound23:29:054
1398303993129,2cyclictest1773810-21kworker/u16:0+events_unbound22:02:214
1398303993129,2cyclictest1667934-21kworker/u16:4+events_unbound21:34:324
1398303993129,2cyclictest1646032-21kworker/u16:1+events_unbound21:56:094
1398303993129,2cyclictest1631944-21kworker/u16:0+flush-8:021:43:044
139831099300,29cyclictest2100650-21latency_hist00:17:247
1398309993028,2cyclictest1646032-21kworker/u16:1+events_unbound21:17:206
1398303993028,2cyclictest1773810-21kworker/u16:0+events_unbound22:21:044
1398303993028,2cyclictest1667934-21kworker/u16:4+events_unbound21:23:394
1398303993028,2cyclictest1667934-21kworker/u16:4+events_unbound21:23:394
1398309992927,2cyclictest1775601-21kworker/u16:4+events_unbound22:12:526
1398303992928,1cyclictest1884254-21kworker/u16:3+events_unbound22:51:084
1398303992928,1cyclictest1884254-21kworker/u16:3+events_unbound22:51:084
1398303992927,2cyclictest2049623-21kworker/u16:4+events_unbound00:06:244
1398303992927,2cyclictest1775601-21kworker/u16:4+events_unbound23:05:444
1398303992927,2cyclictest1775601-21kworker/u16:4+events_unbound22:04:084
1398303992927,2cyclictest1775601-21kworker/u16:4+events_unbound22:04:084
1398309992825,2cyclictest1990711-21kworker/u16:2+events_unbound23:32:366
1398303992826,2cyclictest1646032-21kworker/u16:1+events_unbound22:30:084
1398309992725,2cyclictest688121-21kworker/u16:3+flush-8:019:32:516
1398309992724,2cyclictest1955724-21kworker/u16:3+flush-8:023:17:256
1398303992725,2cyclictest1773810-21kworker/u16:0+events_unbound22:59:324
1398303992725,2cyclictest1773810-21kworker/u16:0+events_unbound22:34:244
1398303992725,2cyclictest1459170-21kworker/u16:0+flush-8:019:32:494
1398303992624,2cyclictest688121-21kworker/u16:3+events_unbound21:04:024
1398303992624,2cyclictest1920102-21kworker/u16:1+events_unbound23:33:484
1398303992624,2cyclictest1646032-21kworker/u16:1+events_unbound21:30:254
1398309992523,2cyclictest1667934-21kworker/u16:4+events_unbound21:32:446
1398309992523,2cyclictest1459170-21kworker/u16:0+flush-8:020:07:206
1398309992523,2cyclictest1459170-21kworker/u16:0+flush-8:020:07:206
1398303992523,2cyclictest2015677-21kworker/u16:0+events_unbound23:47:044
1398303992523,2cyclictest1920102-21kworker/u16:1+flush-8:023:47:404
1398310992424,0cyclictest0-21swapper/721:47:497
1398310992423,0cyclictest0-21swapper/720:32:367
139831099240,23cyclictest1859890-21latency_hist22:37:247
1398309992422,2cyclictest1884254-21kworker/u16:3+events_unbound22:47:496
1398309992422,2cyclictest1884254-21kworker/u16:3+events_unbound22:47:496
1398303992422,2cyclictest688121-21kworker/u16:3+events_unbound19:24:574
1398310992217,4cyclictest650-21systemd-journal20:02:257
1398303992220,2cyclictest667967-21kworker/u16:0+flush-8:019:07:544
1398310992115,5cyclictest1799792-21latency_hist22:12:257
1398309992119,2cyclictest1646032-21kworker/u16:1+flush-8:021:57:526
1398309992119,2cyclictest1421192-21kworker/u16:2+events_unbound19:20:576
1398309992119,2cyclictest1421192-21kworker/u16:2+events_unbound19:20:576
1398309992118,2cyclictest1750180-21kworker/u16:2+events_unbound22:42:446
1398310992020,0cyclictest0-21swapper/721:57:397
1398310992015,4cyclictest1895858-21latency_hist22:52:257
1398310992015,4cyclictest1895858-21latency_hist22:52:257
1398310992014,5cyclictest2124733-21latency_hist00:27:257
1398309992018,2cyclictest2101070-21kworker/u16:5+events_unbound00:22:476
1398309992018,2cyclictest1992626-21kworker/u16:5+events_unbound23:47:436
1398309992017,2cyclictest1526660-21kworker/u16:4+events_unbound20:52:426
1398307992017,2cyclictest1920102-21kworker/u16:1+flush-8:023:07:415
1398309991917,2cyclictest1990711-21kworker/u16:2+flush-8:023:42:456
1398307991916,2cyclictest2015677-21kworker/u16:0+flush-8:023:52:415
1398303991917,2cyclictest1517077-21kworker/u16:1+flush-8:020:12:204
139831099184,7cyclictest5750-21gmain23:42:197
1398310991818,0cyclictest0-21swapper/721:07:527
1398310991815,2cyclictest1267-21snmpd22:05:067
1398310991815,2cyclictest1267-21snmpd22:05:067
139831099180,16cyclictest1430705-21ls19:17:257
1398309991816,2cyclictest688121-21kworker/u16:3+events_unbound21:02:546
1398309991815,2cyclictest1646032-21kworker/u16:1+events_unbound21:17:336
1398303991816,2cyclictest688121-21kworker/u16:3+events_unbound19:15:214
1398303991816,2cyclictest1546551-21kworker/u16:0+flush-8:020:19:474
1398303991815,2cyclictest1526660-21kworker/u16:4+events_unbound20:57:434
139831099179,7cyclictest0-21swapper/721:32:447
1398310991711,5cyclictest1631519-21latency_hist21:02:257
139831099170,1cyclictest0-21swapper/722:52:497
139831099170,16cyclictest2112830-21latency_hist00:22:257
1398309991715,2cyclictest1750180-21kworker/u16:2+events_unbound22:27:436
1398309991714,2cyclictest1773810-21kworker/u16:0+events_unbound23:22:326
139830799170,1cyclictest0-21swapper/523:26:515
1398303991715,2cyclictest688121-21kworker/u16:3+events_unbound20:51:364
1398303991715,2cyclictest688121-21kworker/u16:3+events_unbound20:51:364
139831099168,7cyclictest0-21swapper/722:37:397
139831099160,14cyclictest901-21avahi-daemon23:07:537
1398309991614,2cyclictest688121-21kworker/u16:3+events_unbound19:12:486
1398309991614,2cyclictest2049623-21kworker/u16:4+events_unbound00:07:376
1398309991614,2cyclictest2049623-21kworker/u16:4+events_unbound00:07:376
1398309991614,2cyclictest1750180-21kworker/u16:2+events_unbound21:52:506
1398309991614,2cyclictest1388541-21kworker/u16:4+flush-8:019:22:416
1398309991613,2cyclictest1773810-21kworker/u16:0+events_unbound23:27:296
1398307991612,3cyclictest1775601-21kworker/u16:4+flush-8:022:07:355
139830799160,13cyclictest0-21swapper/521:57:005
1398303991614,2cyclictest1526660-21kworker/u16:4+flush-8:020:57:204
1398303991614,2cyclictest1379001-21kworker/u16:1+events_unbound19:04:564
15839232150,0sleep40-21swapper/420:37:254
139831099159,5cyclictest1988183-21ssh23:27:457
139831099159,5cyclictest1478472-21latency_hist19:42:267
139831099158,6cyclictest0-21swapper/723:17:497
139831099157,7cyclictest0-21swapper/722:12:437
139831099157,7cyclictest0-21swapper/721:42:427
139831099157,7cyclictest0-21swapper/721:02:447
139831099156,8cyclictest0-21swapper/721:22:417
139831099156,8cyclictest0-21swapper/721:22:417
139831099156,8cyclictest0-21swapper/700:07:467
139831099156,8cyclictest0-21swapper/700:07:467
1398310991510,4cyclictest1679485-21latency_hist21:22:257
139831099150,14cyclictest1916899-21ssh22:57:507
1398309991513,2cyclictest2039487-21kworker/u16:3+events_unbound23:53:406
1398309991513,2cyclictest1920102-21kworker/u16:1+events_unbound23:39:366
1398309991513,2cyclictest1526660-21kworker/u16:4+flush-8:020:22:446
139830999150,14cyclictest0-21swapper/622:02:366
139830999150,14cyclictest0-21swapper/622:02:366
139830799150,1cyclictest0-21swapper/523:37:535
139830799150,15cyclictest0-21swapper/521:08:365
139830799150,14cyclictest0-21swapper/521:32:435
139830799150,13cyclictest0-21swapper/521:22:185
139830799150,13cyclictest0-21swapper/500:08:475
139830799150,13cyclictest0-21swapper/500:08:475
139831099148,5cyclictest5750-21gmain23:48:117
139831099147,6cyclictest0-21swapper/722:27:377
139831099146,7cyclictest0-21swapper/723:52:487
139831099146,7cyclictest0-21swapper/723:33:147
139831099146,7cyclictest0-21swapper/721:41:267
139831099146,7cyclictest0-21swapper/700:32:227
1398310991411,2cyclictest0-21swapper/719:02:277
1398310991410,3cyclictest1880783-21ssh22:42:477
139831099140,1cyclictest0-21swapper/720:02:487
139831099140,1cyclictest0-21swapper/720:02:487
1398309991413,1cyclictest0-21swapper/621:11:316
1398309991412,2cyclictest2049623-21kworker/u16:4+flush-8:000:02:486
1398309991412,2cyclictest1773810-21kworker/u16:0+flush-8:022:22:406
1398309991412,2cyclictest1773810-21kworker/u16:0+events_unbound23:17:566
1398309991412,2cyclictest1750180-21kworker/u16:2+flush-8:022:32:536
1398309991412,2cyclictest1469295-21kworker/u16:2+flush-8:019:52:406
139830999140,14cyclictest0-21swapper/622:41:326
1398307991413,1cyclictest0-21swapper/522:30:445
139830799140,1cyclictest0-21swapper/519:22:485
139830799140,14cyclictest0-21swapper/520:12:475
139830799140,12cyclictest0-21swapper/521:30:595
139831099139,3cyclictest1267-21snmpd19:27:537
139831099138,4cyclictest1267-21snmpd19:07:417
139831099136,6cyclictest0-21swapper/721:12:577
139831099136,6cyclictest0-21swapper/719:19:217
139831099136,6cyclictest0-21swapper/719:19:217
139831099135,7cyclictest0-21swapper/700:02:447
139831099135,6cyclictest0-21swapper/723:02:397
139831099134,8cyclictest0-21swapper/723:22:427
139831099134,8cyclictest0-21swapper/721:56:077
139831099133,9cyclictest1700642-21ntpq21:27:517
1398310991312,0cyclictest0-21swapper/719:42:547
1398310991310,2cyclictest1820880-21ntpq22:17:507
1398310991310,2cyclictest0-21swapper/720:52:257
1398310991310,2cyclictest0-21swapper/720:52:257
139830999139,3cyclictest1775601-21kworker/u16:4+events_unbound23:05:086
1398309991312,1cyclictest0-21swapper/622:20:066
1398309991312,1cyclictest0-21swapper/622:07:486
1398309991312,1cyclictest0-21swapper/621:38:476
1398309991312,1cyclictest0-21swapper/620:57:486
1398309991312,1cyclictest0-21swapper/620:16:586
139830999130,13cyclictest0-21swapper/620:09:246
139830999130,13cyclictest0-21swapper/600:15:016
139830999130,0cyclictest0-21swapper/600:18:486
139830799139,3cyclictest1489195-21cat19:47:405
1398307991312,1cyclictest0-21swapper/523:43:245
1398307991312,1cyclictest0-21swapper/522:50:265
1398307991312,1cyclictest0-21swapper/522:50:265
1398307991312,1cyclictest0-21swapper/500:02:575
1398307991310,3cyclictest0-21swapper/522:32:285
139830799130,8cyclictest1767585-21cut21:57:435
139830799130,1cyclictest0-21swapper/521:43:175
139830799130,13cyclictest0-21swapper/523:04:475
139830799130,13cyclictest0-21swapper/521:41:335
139830799130,13cyclictest0-21swapper/500:26:085
139830799130,13cyclictest0-21swapper/500:18:245
139830799130,13cyclictest0-21swapper/500:01:045
1398303991311,2cyclictest1469295-21kworker/u16:2+flush-8:019:52:504
139831099128,3cyclictest1267-21snmpd20:15:547
139831099125,6cyclictest0-21swapper/719:34:017
139831099120,2cyclictest1533645-21grep20:07:457
139831099120,2cyclictest0-21swapper/720:42:437
139831099120,2cyclictest0-21swapper/719:52:417
1398309991211,1cyclictest0-21swapper/621:50:466
1398309991211,1cyclictest0-21swapper/620:20:366
1398309991211,1cyclictest0-21swapper/619:09:016
1398309991210,2cyclictest1920102-21kworker/u16:1+events_unbound23:58:006
1398309991210,2cyclictest1546551-21kworker/u16:0+events_unbound20:32:506
139830799129,1cyclictest0-21swapper/519:33:225
1398307991211,1cyclictest0-21swapper/500:31:485
1398307991211,1cyclictest0-21swapper/500:16:315
139830799120,12cyclictest0-21swapper/522:45:055
1398303991210,2cyclictest667967-21kworker/u16:0+events_unbound19:21:224
1398303991210,2cyclictest667967-21kworker/u16:0+events_unbound19:21:224
1398303991210,2cyclictest1469295-21kworker/u16:2+flush-8:019:57:534
139831099118,2cyclictest1267-21snmpd19:49:087
139831099118,2cyclictest0-21swapper/719:22:537
139831099117,3cyclictest1563645-21ntpq20:22:497
139831099117,3cyclictest1267-21snmpd20:28:247
139831099117,3cyclictest1267-21snmpd20:18:427
139831099110,9cyclictest0-21swapper/720:52:397
139830999119,2cyclictest2039487-21kworker/u16:3+events_unbound00:27:526
139830999119,2cyclictest1526660-21kworker/u16:4+flush-8:020:37:466
139830999119,2cyclictest1459170-21kworker/u16:0+flush-8:019:42:206
139830999116,4cyclictest1508324-21cat19:57:416
1398309991110,1cyclictest0-21swapper/622:55:346
1398309991110,1cyclictest0-21swapper/619:06:586
139830799119,2cyclictest0-21swapper/519:31:195
139830799119,0cyclictest0-21swapper/522:27:065
1398307991110,1cyclictest0-21swapper/523:32:225
1398307991110,1cyclictest0-21swapper/522:19:515
1398307991110,1cyclictest0-21swapper/522:14:295
1398307991110,1cyclictest0-21swapper/520:49:035
1398307991110,1cyclictest0-21swapper/520:49:035
1398307991110,1cyclictest0-21swapper/520:47:095
1398307991110,1cyclictest0-21swapper/520:03:195
1398307991110,1cyclictest0-21swapper/520:03:195
139830799110,1cyclictest0-21swapper/520:41:195
139830799110,11cyclictest0-21swapper/520:18:285
139830799110,11cyclictest0-21swapper/519:53:055
139830399119,2cyclictest1469295-21kworker/u16:2+flush-8:020:42:494
139830399119,2cyclictest1469295-21kworker/u16:2+events_unbound19:41:224
139830399119,2cyclictest1421192-21kworker/u16:2+events_unbound19:29:254
1398303991110,1cyclictest0-21swapper/420:17:114
1398303991110,1cyclictest0-21swapper/420:05:504
1398303991110,1cyclictest0-21swapper/420:05:504
139831099107,2cyclictest1267-21snmpd20:39:397
139830999108,2cyclictest1646032-21kworker/u16:1+events_unbound21:22:406
139830999108,2cyclictest1646032-21kworker/u16:1+events_unbound21:22:406
139830999108,2cyclictest1469295-21kworker/u16:2+events_unbound19:42:506
139830799109,1cyclictest0-21swapper/520:59:555
139830799109,1cyclictest0-21swapper/519:13:595
139830799106,3cyclictest1945347-21cat23:12:395
139830399108,2cyclictest1526660-21kworker/u16:4+events_unbound20:37:434
139830399108,2cyclictest1469295-21kworker/u16:2+events_unbound20:30:374
13983099998,1cyclictest0-21swapper/621:28:236
13983099997,2cyclictest1773810-21kworker/u16:0+events_unbound22:59:096
13983099994,4cyclictest1495674-21cut19:47:456
13983079998,1cyclictest0-21swapper/522:55:485
13983079998,1cyclictest0-21swapper/520:35:295
13983079998,1cyclictest0-21swapper/520:10:535
13983079998,1cyclictest0-21swapper/519:44:155
13983079998,1cyclictest0-21swapper/519:20:365
13983079998,1cyclictest0-21swapper/519:20:365
13983079996,2cyclictest1572907-21cut20:27:465
13983079996,1cyclictest0-21swapper/520:54:345
13983039998,1cyclictest0-21swapper/419:49:274
13983039997,2cyclictest1526660-21kworker/u16:4+events_unbound20:22:404
13983039994,4cyclictest1479619-21hwlatdetect19:42:404
13983099986,1cyclictest0-21swapper/619:27:396
13983099984,3cyclictest1566167-21sed20:27:416
13983079987,1cyclictest0-21swapper/522:07:245
13983079987,1cyclictest0-21swapper/522:07:245
13983079986,1cyclictest0-21swapper/523:32:425
13983079984,3cyclictest1914671-21cut22:57:465
13983079984,3cyclictest1742121-21cut21:47:415
13983079983,4cyclictest1957342-21sed23:17:395
13983079983,4cyclictest1681512-21tr21:22:435
13983079983,4cyclictest1681512-21tr21:22:435
13983079980,7cyclictest1662145-21cut21:12:455
13983079980,7cyclictest0-21swapper/519:57:465
13983099972,4cyclictest1594060-21expr20:42:386
13983079976,1cyclictest0-21swapper/523:51:085
13983079974,2cyclictest0-21swapper/519:07:295
13983079973,3cyclictest1862935-21grep22:37:445
13983079973,3cyclictest1555579-21expr20:22:385
13983079973,3cyclictest1470114-21iostat_ios19:37:405
13983079973,3cyclictest1398623-21tr19:02:365
13983079970,6cyclictest0-21swapper/521:02:385
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional