You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 15:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Fri Apr 03, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18344762940,1sleep71834478-21ssh09:36:327
1516455995755,2cyclictest2079824-21kworker/u16:3+events_unbound11:42:574
151617825242,7sleep40-21swapper/407:02:294
1516455994846,2cyclictest1942651-21kworker/u16:4+events_unbound10:47:334
1516460994745,2cyclictest2079824-21kworker/u16:3+events_unbound11:53:015
1516460994745,2cyclictest1896269-21kworker/u16:2+events_unbound10:05:135
1516455994644,2cyclictest1701625-21kworker/u16:3+events_unbound09:08:384
1516455994442,2cyclictest2079824-21kworker/u16:3+events_unbound11:20:334
151613624434,7sleep50-21swapper/507:01:585
1516461994341,2cyclictest1673313-21kworker/u16:0+events_unbound08:32:586
1516460994341,2cyclictest2079824-21kworker/u16:3+events_unbound11:28:495
1516455994341,2cyclictest1871813-21kworker/u16:0+flush-8:010:08:094
1516460994240,2cyclictest2225135-21kworker/u16:1+events_unbound12:30:175
1516460994240,2cyclictest2079824-21kworker/u16:3+events_unbound12:10:135
1516460994240,2cyclictest1615716-21kworker/u16:1+events_unbound09:09:545
1516460994239,2cyclictest1749763-21kworker/u16:4+events_unbound09:34:145
1516460994238,3cyclictest2102635-21kworker/u16:5+flush-8:011:32:315
1516455994240,2cyclictest2102634-21kworker/u16:4+events_unbound11:49:054
1516455994240,2cyclictest1896269-21kworker/u16:2+events_unbound10:06:544
15158942423,31sleep70-21swapper/706:58:317
1516465994140,0cyclictest0-21swapper/711:58:027
1516465994136,4cyclictest1653847-21latency_hist08:12:317
1516460994139,2cyclictest1995813-21kworker/u16:1+events_unbound11:00:255
1516460994139,2cyclictest1995813-21kworker/u16:1+events_unbound11:00:255
1516460994139,2cyclictest1749763-21kworker/u16:4+events_unbound10:00:235
1516455994139,2cyclictest2226997-21kworker/u16:5+events_unbound12:21:204
1516455994139,2cyclictest1995813-21kworker/u16:1+events_unbound10:47:144
1516455994139,2cyclictest1749763-21kworker/u16:4+events_unbound09:33:454
1516455994139,2cyclictest1615716-21kworker/u16:1+events_unbound09:23:534
151611924131,7sleep60-21swapper/607:01:436
1516460994038,2cyclictest2226997-21kworker/u16:5+events_unbound12:21:165
1516460994038,2cyclictest2153530-21kworker/u16:0+events_unbound11:59:525
1516460994038,2cyclictest2079824-21kworker/u16:3+events_unbound12:06:385
1516460994038,2cyclictest2079824-21kworker/u16:3+events_unbound11:48:495
1516460994038,2cyclictest1995813-21kworker/u16:1+events_unbound11:18:575
1516460994038,2cyclictest1942651-21kworker/u16:4+events_unbound11:05:535
1516460994038,2cyclictest1942651-21kworker/u16:4+events_unbound10:55:145
1516460994038,2cyclictest1896269-21kworker/u16:2+events_unbound10:19:465
1516460994038,2cyclictest1896269-21kworker/u16:2+events_unbound10:15:095
1516460994038,2cyclictest1835093-21kworker/u16:2+events_unbound09:46:175
1516455994039,1cyclictest1896269-21kworker/u16:2+events_unbound10:30:534
1516455994038,2cyclictest2225135-21kworker/u16:1+events_unbound12:29:574
1516455994038,2cyclictest1995813-21kworker/u16:1+events_unbound10:59:544
1516455994038,2cyclictest1995813-21kworker/u16:1+events_unbound10:59:544
1516455994038,2cyclictest1932928-21kworker/u16:3+events_unbound10:18:034
1516455994038,2cyclictest1786149-21kworker/u16:0+events_unbound09:30:374
1516455994038,2cyclictest1615716-21kworker/u16:1+events_unbound09:21:554
17736272390,0sleep71773628-21rm09:12:047
1516460993937,2cyclictest2225135-21kworker/u16:1+events_unbound12:25:325
1516460993937,2cyclictest2079824-21kworker/u16:3+events_unbound11:39:135
1516460993937,2cyclictest2079824-21kworker/u16:3+events_unbound11:39:135
1516460993937,2cyclictest1995813-21kworker/u16:1+events_unbound10:46:015
1516460993937,2cyclictest1942651-21kworker/u16:4+events_unbound11:09:095
1516460993937,2cyclictest1942651-21kworker/u16:4+events_unbound10:51:535
1516460993937,2cyclictest1942651-21kworker/u16:4+events_unbound10:23:335
1516460993937,2cyclictest1871813-21kworker/u16:0+flush-8:009:52:495
1516460993937,2cyclictest1871813-21kworker/u16:0+events_unbound10:35:225
1516460993937,2cyclictest1749763-21kworker/u16:4+events_unbound09:40:455
1516460993937,2cyclictest1615716-21kworker/u16:1+events_unbound09:24:145
1516455993937,2cyclictest2153530-21kworker/u16:0+events_unbound12:24:124
1516455993937,2cyclictest2102634-21kworker/u16:4+events_unbound11:39:344
1516455993937,2cyclictest2102634-21kworker/u16:4+events_unbound11:39:344
1516455993937,2cyclictest2079824-21kworker/u16:3+events_unbound11:54:334
1516455993937,2cyclictest2079824-21kworker/u16:3+events_unbound11:24:144
1516455993936,3cyclictest2079824-21kworker/u16:3+events_unbound12:14:254
1516465993833,4cyclictest2251514-21latency_hist12:27:307
1516455993836,2cyclictest1995813-21kworker/u16:1+events_unbound11:13:334
1516455993836,2cyclictest1871813-21kworker/u16:0+events_unbound10:38:264
1516455993836,2cyclictest1835093-21kworker/u16:2+flush-8:009:45:214
1516455993836,2cyclictest1835093-21kworker/u16:2+events_unbound09:42:174
1516455993836,2cyclictest1701625-21kworker/u16:3+events_unbound09:03:064
1516460993735,2cyclictest2079824-21kworker/u16:3+events_unbound11:43:425
1516460993735,2cyclictest1995813-21kworker/u16:1+events_unbound11:15:185
1516460993735,2cyclictest1749763-21kworker/u16:4+events_unbound09:19:135
1516460993733,3cyclictest2102491-21fwupd11:24:315
1516455993735,2cyclictest2102635-21kworker/u16:5+events_unbound11:36:464
1516455993735,2cyclictest1942651-21kworker/u16:4+events_unbound11:05:574
1516455993735,2cyclictest1942651-21kworker/u16:4+events_unbound10:23:414
1516455993735,2cyclictest1871813-21kworker/u16:0+events_unbound11:11:144
1516455993735,2cyclictest1871813-21kworker/u16:0+events_unbound10:02:014
1516455993735,2cyclictest1835093-21kworker/u16:2+events_unbound09:49:384
1516455993735,2cyclictest1615716-21kworker/u16:1+events_unbound08:26:414
1516465993631,4cyclictest1548709-21latency_hist07:17:317
1516465993630,5cyclictest1847356-21latency_hist09:42:317
1516460993634,2cyclictest2225135-21kworker/u16:1+events_unbound12:15:325
1516460993634,2cyclictest1871813-21kworker/u16:0+events_unbound10:10:255
1516460993634,2cyclictest1739495-21kworker/u16:0+events_unbound09:06:375
1516460993634,2cyclictest1701625-21kworker/u16:3+events_unbound09:14:305
1516460993634,2cyclictest1615716-21kworker/u16:1+events_unbound09:48:345
1516455993634,2cyclictest2102634-21kworker/u16:4+events_unbound11:30:134
1516455993634,2cyclictest2079824-21kworker/u16:3+events_unbound12:05:574
1516455993634,2cyclictest1739495-21kworker/u16:0+flush-8:008:57:534
1516455993634,2cyclictest1701625-21kworker/u16:3+events_unbound09:14:104
1516455993634,2cyclictest1615716-21kworker/u16:1+events_unbound10:15:344
1516460993533,2cyclictest1942651-21kworker/u16:4+events_unbound10:41:265
1516460993533,2cyclictest1786149-21kworker/u16:0+events_unbound09:30:495
1516460993533,2cyclictest1598411-21kworker/u16:2+events_unbound08:28:505
1516455993533,2cyclictest2079824-21kworker/u16:3+events_unbound12:10:544
1516455993533,2cyclictest1995813-21kworker/u16:1+flush-8:010:53:314
1516455993533,2cyclictest1749763-21kworker/u16:4+events_unbound09:55:344
1516465993433,0cyclictest0-21swapper/710:28:017
1516461993431,2cyclictest2153530-21kworker/u16:0+flush-8:012:07:496
1516460993432,2cyclictest1567822-21kworker/u16:0+events_unbound07:42:335
1516460993331,2cyclictest1896269-21kworker/u16:2+events_unbound10:29:135
1516460993331,2cyclictest1673313-21kworker/u16:0+events_unbound08:33:025
1516455993331,2cyclictest2102634-21kworker/u16:4+events_unbound12:01:104
1516455993331,2cyclictest1871813-21kworker/u16:0+events_unbound10:36:314
1516465993230,1cyclictest1749331-21diskmemload12:17:407
1516465993230,1cyclictest1749331-21diskmemload10:56:097
151646599320,31cyclictest2078570-21ssh11:15:267
1516460993230,2cyclictest1598411-21kworker/u16:2+events_unbound09:00:145
1516460993230,2cyclictest1598411-21kworker/u16:2+events_unbound08:09:295
1516465993130,0cyclictest0-21swapper/710:04:497
1516465993128,2cyclictest2200253-21sh12:03:467
1516455993129,2cyclictest1567822-21kworker/u16:0+events_unbound07:36:274
1516465993030,0cyclictest0-21swapper/710:46:177
1516465993027,2cyclictest1759693-21ssh09:04:147
1516465993026,3cyclictest1821014-21ssh09:29:217
1516460993028,2cyclictest1548914-21kworker/u16:3+events_unbound07:49:155
20433952290,1chrt2043396-21sed11:02:317
20433952290,1chrt2043396-21sed11:02:317
1516465992923,4cyclictest1784747-21ssh09:15:137
1516460992927,2cyclictest45019-21kworker/u16:3+events_unbound07:03:475
1516460992927,2cyclictest1598411-21kworker/u16:2+events_unbound08:46:455
1516460992927,2cyclictest1548914-21kworker/u16:3+events_unbound07:42:155
1516465992826,1cyclictest1955643-21ssh10:24:377
1516465992822,5cyclictest2104328-21latency_hist11:27:317
151646599280,27cyclictest1919853-21ssh10:11:107
1516460992826,2cyclictest1739495-21kworker/u16:0+events_unbound08:57:185
1516460992826,2cyclictest1615716-21kworker/u16:1+events_unbound08:24:425
1516460992826,2cyclictest1598411-21kworker/u16:2+events_unbound08:49:155
1516460992826,2cyclictest1598411-21kworker/u16:2+events_unbound08:18:385
1516460992826,2cyclictest1548914-21kworker/u16:3+events_unbound07:30:475
1516460992826,2cyclictest1538160-21kworker/u16:2+events_unbound07:27:015
1516460992824,3cyclictest1615716-21kworker/u16:1+flush-8:007:52:575
1516455992826,2cyclictest1615716-21kworker/u16:1+events_unbound08:51:424
1516465992725,1cyclictest1796294-21ssh09:18:597
1516465992724,2cyclictest2150412-21ssh11:42:597
1516465992724,2cyclictest1942890-21sh10:18:427
1516461992725,2cyclictest2079824-21kworker/u16:3+flush-8:011:22:566
1516461992725,2cyclictest1995813-21kworker/u16:1+flush-8:010:52:576
1516461992725,2cyclictest1516228-21kworker/u16:1+events_unbound07:07:346
1516460992725,2cyclictest1615716-21kworker/u16:1+events_unbound08:04:425
1516455992725,2cyclictest1598411-21kworker/u16:2+events_unbound08:10:144
1516465992626,0cyclictest0-21swapper/710:33:587
1516461992624,2cyclictest2079824-21kworker/u16:3+flush-8:011:37:536
1516461992624,2cyclictest2079824-21kworker/u16:3+flush-8:011:37:536
1516461992623,2cyclictest1625221-21kworker/u16:4+events_unbound08:02:336
1516455992624,2cyclictest1615716-21kworker/u16:1+events_unbound08:46:154
1516455992624,2cyclictest1567822-21kworker/u16:0+events_unbound07:49:374
1516455992624,2cyclictest1516228-21kworker/u16:1+events_unbound07:08:464
1516465992525,0cyclictest0-21swapper/711:21:337
1516465992523,1cyclictest1869761-21ssh09:49:057
1516465992522,2cyclictest1698536-21kthreadcore08:32:527
1516465992521,3cyclictest1709813-21kthreadcore08:37:517
1516461992523,2cyclictest1615716-21kworker/u16:1+flush-8:010:03:076
1516455992523,2cyclictest1615716-21kworker/u16:1+flush-8:007:58:134
1516455992523,2cyclictest1548914-21kworker/u16:3+events_unbound07:41:464
1516465992424,0cyclictest0-21swapper/709:24:477
1516465992421,2cyclictest1896187-21ssh10:02:287
1516461992422,2cyclictest1615716-21kworker/u16:1+flush-8:008:27:576
1516461992421,2cyclictest1786149-21kworker/u16:0+events_unbound09:22:386
1516461992421,2cyclictest1749763-21kworker/u16:4+flush-8:009:02:366
1516460992422,2cyclictest1673313-21kworker/u16:0+events_unbound08:42:295
1516460992422,2cyclictest1598411-21kworker/u16:2+events_unbound08:15:255
1516460992422,2cyclictest1598411-21kworker/u16:2+events_unbound08:15:255
1516460992422,2cyclictest1548914-21kworker/u16:3+events_unbound07:21:425
1516460992422,2cyclictest1516228-21kworker/u16:1+events_unbound07:09:575
1516455992422,2cyclictest1567822-21kworker/u16:0+events_unbound07:32:154
1516455992422,2cyclictest1538160-21kworker/u16:2+events_unbound07:26:314
17076022230,0sleep60-21swapper/608:37:496
1516465992323,0cyclictest0-21swapper/711:34:357
1516465992323,0cyclictest0-21swapper/711:08:577
1516465992322,0cyclictest0-21swapper/707:27:517
1516461992321,2cyclictest1701625-21kworker/u16:3+events_unbound09:13:256
1516460992321,2cyclictest1598411-21kworker/u16:2+events_unbound07:57:555
1516460992321,2cyclictest1567822-21kworker/u16:0+events_unbound07:33:475
1516465992221,0cyclictest0-21swapper/711:37:557
1516465992221,0cyclictest0-21swapper/711:37:557
1516465992220,1cyclictest2214100-21ssh12:11:337
1516465992216,5cyclictest1567783-21latency_hist07:27:317
1516461992220,2cyclictest1615716-21kworker/u16:1+flush-8:009:48:026
1516461992220,2cyclictest1548914-21kworker/u16:3+flush-8:007:27:496
1516465992121,0cyclictest0-21swapper/712:15:187
1516465992121,0cyclictest0-21swapper/710:41:577
1516465992120,1cyclictest2177737-21ssh11:57:097
1516461992119,2cyclictest1995813-21kworker/u16:1+flush-8:011:17:556
1516461992119,2cyclictest1871813-21kworker/u16:0+flush-8:011:02:466
1516461992119,2cyclictest1548914-21kworker/u16:3+events_unbound07:52:436
1516461992118,2cyclictest1932928-21kworker/u16:3+events_unbound10:17:316
1516460992119,2cyclictest1516228-21kworker/u16:1+events_unbound07:14:425
1516455992119,2cyclictest1615716-21kworker/u16:1+events_unbound08:38:424
1516455992119,2cyclictest1615716-21kworker/u16:1+events_unbound08:19:154
1516455992119,2cyclictest1516228-21kworker/u16:1+events_unbound07:15:464
16966772200,0chrt0-21swapper/408:32:504
1516465992020,0cyclictest0-21swapper/709:55:137
1516461992018,2cyclictest2079824-21kworker/u16:3+events_unbound11:57:456
1516461992018,2cyclictest1739495-21kworker/u16:0+events_unbound08:56:566
1516461992018,2cyclictest1615716-21kworker/u16:1+flush-8:009:57:466
1516461992018,2cyclictest1615716-21kworker/u16:1+events_unbound08:43:596
1516461992018,2cyclictest1598411-21kworker/u16:2+events_unbound08:17:406
1516455992018,2cyclictest1598411-21kworker/u16:2+events_unbound08:15:464
1516455992018,2cyclictest1598411-21kworker/u16:2+events_unbound08:15:464
1516455992017,2cyclictest1548914-21kworker/u16:3+events_unbound07:52:414
1516465991919,0cyclictest0-21swapper/711:51:067
1516465991919,0cyclictest0-21swapper/709:45:507
1516465991918,0cyclictest0-21swapper/707:17:547
1516465991917,1cyclictest0-21swapper/708:52:567
1516465991914,4cyclictest1539175-21latency_hist07:12:317
1516461991917,2cyclictest2079824-21kworker/u16:3+flush-8:012:13:076
1516461991917,2cyclictest1942651-21kworker/u16:4+events_unbound10:32:586
1516461991917,2cyclictest1932928-21kworker/u16:3+events_unbound10:21:106
1516461991917,2cyclictest1615716-21kworker/u16:1+events_unbound08:47:556
1516461991917,2cyclictest1567822-21kworker/u16:0+events_unbound07:40:576
1516461991917,2cyclictest1548914-21kworker/u16:3+events_unbound07:49:136
1516461991917,2cyclictest1548914-21kworker/u16:3+events_unbound07:25:096
1516461991917,2cyclictest1516228-21kworker/u16:1+events_unbound07:20:046
1516455991917,2cyclictest45019-21kworker/u16:3+events_unbound07:03:554
1516455991917,2cyclictest1739495-21kworker/u16:0+events_unbound08:56:494
1516465991818,0cyclictest0-21swapper/710:16:337
1516465991814,3cyclictest2253130-21ssh12:27:457
1516461991816,2cyclictest2153530-21kworker/u16:0+events_unbound12:06:306
1516461991816,2cyclictest1871813-21kworker/u16:0+flush-8:009:53:236
1516461991816,2cyclictest1615716-21kworker/u16:1+events_unbound08:11:246
1516461991816,2cyclictest1598411-21kworker/u16:2+events_unbound08:22:546
1516461991816,2cyclictest1598411-21kworker/u16:2+events_unbound08:14:366
1516461991816,2cyclictest1598411-21kworker/u16:2+events_unbound08:14:366
1516461991816,2cyclictest1548914-21kworker/u16:3+events_unbound07:45:406
1516461991815,2cyclictest1995813-21kworker/u16:1+flush-8:010:42:496
1516455991816,2cyclictest1673313-21kworker/u16:0+events_unbound08:27:554
151646599178,8cyclictest0-21swapper/711:27:497
1516465991714,2cyclictest0-21swapper/708:02:317
1516465991711,5cyclictest1730187-21latency_hist08:52:317
151646599170,1cyclictest0-21swapper/710:48:087
1516461991715,2cyclictest2153530-21kworker/u16:0+flush-8:011:53:506
1516461991715,2cyclictest1871813-21kworker/u16:0+events_unbound11:00:026
1516461991715,2cyclictest1871813-21kworker/u16:0+events_unbound11:00:026
1516461991715,2cyclictest1739495-21kworker/u16:0+events_unbound08:59:566
1516461991715,2cyclictest1701625-21kworker/u16:3+flush-8:009:07:556
1516461991715,2cyclictest1625221-21kworker/u16:4+events_unbound07:57:476
1516461991715,2cyclictest1567822-21kworker/u16:0+events_unbound07:37:036
1516461991715,2cyclictest1516228-21kworker/u16:1+events_unbound07:02:586
1516465991615,0cyclictest0-21swapper/708:17:567
1516461991614,2cyclictest1835093-21kworker/u16:2+events_unbound09:46:376
1516465991513,1cyclictest0-21swapper/707:42:487
151646599150,14cyclictest1586801-21sshd-session07:36:277
1516461991513,2cyclictest385961-21kworker/u16:0+events_unbound07:12:546
1516461991513,2cyclictest2079824-21kworker/u16:3+flush-8:011:42:556
1516461991513,2cyclictest1942651-21kworker/u16:4+events_unbound10:47:456
1516455991513,2cyclictest1615716-21kworker/u16:1+events_unbound08:06:494
1516455991513,2cyclictest1548914-21kworker/u16:3+events_unbound07:47:304
151646599146,7cyclictest0-21swapper/708:31:417
1516465991411,2cyclictest0-21swapper/707:37:327
151646599140,12cyclictest1682462-21sshd-session08:27:147
1516461991413,1cyclictest0-21swapper/612:23:276
1516461991413,1cyclictest0-21swapper/611:11:346
1516461991413,1cyclictest0-21swapper/610:24:076
1516461991412,2cyclictest1786149-21kworker/u16:0+events_unbound09:27:456
1516461991412,2cyclictest1615716-21kworker/u16:1+events_unbound09:20:006
151646199140,14cyclictest0-21swapper/610:28:136
151646199140,14cyclictest0-21swapper/610:11:586
1516455991412,2cyclictest1516228-21kworker/u16:1+events_unbound07:18:584
151646599139,3cyclictest1267-21snmpd07:47:547
151646599136,6cyclictest0-21swapper/707:03:147
151646599135,7cyclictest0-21swapper/711:03:047
151646599130,12cyclictest650-21systemd-journal08:47:307
1516461991312,1cyclictest0-21swapper/611:15:406
1516461991311,2cyclictest2226997-21kworker/u16:5+flush-8:012:32:306
1516461991311,2cyclictest2102634-21kworker/u16:4+events_unbound11:48:206
1516461991311,2cyclictest1786149-21kworker/u16:0+events_unbound09:33:316
151646199130,13cyclictest0-21swapper/611:37:066
151646599129,2cyclictest1748357-21ntpq08:57:557
151646599128,3cyclictest1267-21snmpd08:17:107
151646599128,3cyclictest1267-21snmpd08:17:107
151646599126,5cyclictest1634686-21latency_hist08:02:317
1516461991210,2cyclictest2226997-21kworker/u16:5+flush-8:012:17:556
1516461991210,2cyclictest1942651-21kworker/u16:4+flush-8:010:38:296
1516465991110,0cyclictest0-21swapper/707:52:437
151646199119,2cyclictest1615716-21kworker/u16:1+events_unbound09:41:556
15164619997,2cyclictest2079824-21kworker/u16:3+events_unbound11:29:486
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional