You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 21:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Tue May 26, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24825821000,1sleep7248256-21ssh11:29:197
1622812990,0sleep60-21swapper/610:53:046
2372892970,1sleep60-21swapper/611:26:306
3855699995856,2cyclictest298727-21kworker/u16:2+events_unbound11:57:455
385512025242,7sleep50-21swapper/507:03:225
385533324939,7sleep40-21swapper/407:06:264
3855701994644,2cyclictest4173334-21kworker/u16:3+events_unbound10:18:566
3855699994543,2cyclictest3870171-21kworker/u16:1+flush-8:008:37:375
3855699994139,2cyclictest4125761-21kworker/u16:0+events_unbound09:43:405
3855699994139,2cyclictest4125761-21kworker/u16:0+events_unbound09:43:405
3855699994139,2cyclictest3870171-21kworker/u16:1+events_unbound07:22:365
3855699994038,2cyclictest3801129-21kworker/u16:0+flush-8:007:07:395
3855699994038,2cyclictest323947-21kworker/u16:0+events_unbound12:06:335
3855699994037,2cyclictest323947-21kworker/u16:0+events_unbound12:31:325
38547602403,31sleep70-21swapper/707:02:527
3855699993937,2cyclictest4022981-21kworker/u16:2+events_unbound09:49:125
3855699993937,2cyclictest18792-21kworker/u16:1+events_unbound10:11:565
3855699993836,2cyclictest4125761-21kworker/u16:0+flush-8:009:27:045
3855699993836,2cyclictest223004-21kworker/u16:0+events_unbound11:20:495
3855699993735,2cyclictest4173334-21kworker/u16:3+events_unbound10:39:005
3855699993735,2cyclictest4173334-21kworker/u16:3+events_unbound09:39:165
3855699993735,2cyclictest4022981-21kworker/u16:2+events_unbound09:35:215
3855699993735,2cyclictest236575-21kworker/u16:1+events_unbound12:10:005
3855699993734,2cyclictest323947-21kworker/u16:0+events_unbound12:19:465
3855699993734,2cyclictest262477-21kworker/u16:0+flush-8:011:42:245
3855696993735,2cyclictest55006-21kworker/u16:2+events_unbound10:42:294
3855699993634,2cyclictest91683-21kworker/u16:0+events_unbound10:31:215
3855699993634,2cyclictest4051962-21kworker/u16:3+events_unbound09:27:175
3855699993634,2cyclictest4051962-21kworker/u16:3+events_unbound09:18:295
3855699993634,2cyclictest392779-21kworker/u16:3+events_unbound12:33:295
3855699993634,2cyclictest3801129-21kworker/u16:0+events_unbound09:08:215
3855699993634,2cyclictest201213-21kworker/u16:4+events_unbound11:24:535
3855699993634,2cyclictest186609-21kworker/u16:0+events_unbound11:03:285
3855699993634,2cyclictest186609-21kworker/u16:0+events_unbound11:03:285
3855699993634,2cyclictest137786-21kworker/u16:4+events_unbound10:54:525
3855699993633,2cyclictest55006-21kworker/u16:2+flush-8:010:42:245
385570599350,33cyclictest635-21systemd-journal10:17:097
3855699993533,2cyclictest64709-21kworker/u16:4+events_unbound10:14:445
3855699993533,2cyclictest55006-21kworker/u16:2+events_unbound10:24:485
3855699993533,2cyclictest55006-21kworker/u16:2+events_unbound10:24:485
3855699993533,2cyclictest55006-21kworker/u16:2+events_unbound10:20:445
3855699993533,2cyclictest4173334-21kworker/u16:3+events_unbound10:04:055
3855699993533,2cyclictest4125761-21kworker/u16:0+events_unbound09:52:495
3855699993533,2cyclictest4051962-21kworker/u16:3+events_unbound09:15:375
3855699993533,2cyclictest236575-21kworker/u16:1+events_unbound11:54:165
3855699993533,2cyclictest201213-21kworker/u16:4+events_unbound11:34:405
3855699993533,2cyclictest166350-21kworker/u16:2+events_unbound11:28:405
3855699993533,2cyclictest137786-21kworker/u16:4+events_unbound10:48:175
3855701993433,1cyclictest347700-21kworker/u16:2+events_unbound12:24:026
3855699993432,2cyclictest262477-21kworker/u16:0+events_unbound11:39:335
3855699993432,2cyclictest166350-21kworker/u16:2+events_unbound10:58:485
3855699993431,2cyclictest4173334-21kworker/u16:3+flush-8:010:32:165
3855699993331,2cyclictest3801129-21kworker/u16:0+events_unbound07:32:145
3855699993331,2cyclictest236575-21kworker/u16:1+events_unbound12:15:175
3855699993331,2cyclictest201213-21kworker/u16:4+events_unbound11:15:335
3855696993331,2cyclictest4125761-21kworker/u16:0+flush-8:009:57:294
3855705993226,5cyclictest4138793-21latency_hist09:27:147
3855701993230,2cyclictest4173334-21kworker/u16:3+flush-8:010:32:366
3855699993230,2cyclictest4125761-21kworker/u16:0+events_unbound09:58:545
3855699993230,2cyclictest4022981-21kworker/u16:2+events_unbound08:48:255
3855699993230,2cyclictest236575-21kworker/u16:1+events_unbound11:50:085
3855699993229,2cyclictest3955865-21kworker/u16:4+flush-8:008:07:155
3855696993230,2cyclictest201213-21kworker/u16:4+flush-8:011:52:374
3855696993230,2cyclictest166350-21kworker/u16:2+flush-8:011:32:434
3855699993129,2cyclictest347700-21kworker/u16:2+events_unbound12:23:255
3855699993129,2cyclictest186609-21kworker/u16:0+flush-8:011:07:565
3855696993129,2cyclictest4125761-21kworker/u16:0+flush-8:009:22:284
3855696993129,2cyclictest4051962-21kworker/u16:3+flush-8:009:17:414
3855705993025,4cyclictest635-21systemd-journal07:22:147
3855699993028,2cyclictest3801129-21kworker/u16:0+events_unbound07:45:245
3855699993027,2cyclictest3926276-21kworker/u16:3+events_unbound08:02:245
3855696993028,2cyclictest18792-21kworker/u16:1+flush-8:010:12:244
3855701992926,2cyclictest201213-21kworker/u16:4+events_unbound11:17:146
3855696992927,2cyclictest236575-21kworker/u16:1+flush-8:011:57:294
384626422919,7sleep60-21swapper/607:02:276
40259872280,1chrt4025988-21kthreadcore08:32:337
3855701992826,2cyclictest55006-21kworker/u16:2+events_unbound10:27:446
3855696992826,2cyclictest64709-21kworker/u16:4+flush-8:010:22:294
3855696992826,2cyclictest64709-21kworker/u16:4+flush-8:010:22:294
3855696992826,2cyclictest3801129-21kworker/u16:0+events_unbound07:32:284
3855705992726,0cyclictest0-21swapper/710:07:347
3855705992726,0cyclictest0-21swapper/709:27:337
3855701992725,2cyclictest262477-21kworker/u16:0+events_unbound11:37:366
3855696992725,2cyclictest4022981-21kworker/u16:2+events_unbound09:12:294
3855696992725,2cyclictest3870171-21kworker/u16:1+flush-8:008:17:254
3855696992725,2cyclictest128093-21kworker/u16:1+flush-8:011:12:294
3855701992624,2cyclictest3801129-21kworker/u16:0+events_unbound09:02:276
3855701992624,2cyclictest3801129-21kworker/u16:0+events_unbound09:02:276
3855701992624,2cyclictest236575-21kworker/u16:1+events_unbound12:22:136
3855699992624,2cyclictest3801129-21kworker/u16:0+events_unbound07:19:145
40227442250,0sleep40-21swapper/408:32:144
3855705992520,4cyclictest347270-21latency_hist12:12:147
3855701992523,2cyclictest392779-21kworker/u16:3+events_unbound12:27:456
3855701992522,2cyclictest4125761-21kworker/u16:0+flush-8:009:27:356
3855696992523,2cyclictest55006-21kworker/u16:2+events_unbound10:37:284
3855696992523,2cyclictest4022981-21kworker/u16:2+flush-8:009:32:324
3855696992523,2cyclictest4022981-21kworker/u16:2+flush-8:008:32:284
3855696992523,2cyclictest236575-21kworker/u16:1+events_unbound11:27:284
3855705992423,0cyclictest0-21swapper/707:52:287
3855705992419,4cyclictest274225-21latency_hist11:42:137
3855701992422,2cyclictest3801129-21kworker/u16:0+flush-8:008:58:296
3855701992422,2cyclictest3801129-21kworker/u16:0+flush-8:008:42:366
3855701992421,2cyclictest4022981-21kworker/u16:2+flush-8:008:37:326
3855699992422,2cyclictest4051962-21kworker/u16:3+events_unbound08:58:375
3855699992422,2cyclictest3926276-21kworker/u16:3+events_unbound08:18:255
3855696992422,2cyclictest4022981-21kworker/u16:2+events_unbound09:51:094
3855705992322,0cyclictest0-21swapper/710:19:477
3855705992322,0cyclictest0-21swapper/709:47:337
3855705992321,1cyclictest0-21swapper/710:37:327
3855705992320,2cyclictest0-21swapper/710:27:427
3855701992321,2cyclictest55006-21kworker/u16:2+events_unbound10:37:426
3855701992321,2cyclictest4173334-21kworker/u16:3+flush-8:010:27:096
3855701992321,2cyclictest4173334-21kworker/u16:3+flush-8:010:27:096
3855701992321,2cyclictest4173334-21kworker/u16:3+flush-8:009:47:296
3855699992321,2cyclictest4022981-21kworker/u16:2+events_unbound08:44:335
3855696992321,2cyclictest3955865-21kworker/u16:4+events_unbound07:57:344
3855696992321,2cyclictest236575-21kworker/u16:1+flush-8:012:22:354
3855696992321,2cyclictest201213-21kworker/u16:4+flush-8:011:37:394
3855696992320,2cyclictest3870171-21kworker/u16:1+events_unbound07:22:284
3855705992220,1cyclictest0-21swapper/711:02:377
3855705992220,1cyclictest0-21swapper/711:02:377
3855699992220,2cyclictest3801129-21kworker/u16:0+flush-8:007:54:455
3855696992220,2cyclictest4051962-21kworker/u16:3+flush-8:009:27:434
3855696992220,2cyclictest4051962-21kworker/u16:3+flush-8:008:47:384
3855696992220,2cyclictest4022981-21kworker/u16:2+flush-8:009:42:374
3855696992220,2cyclictest4022981-21kworker/u16:2+flush-8:009:42:374
3855696992220,2cyclictest3926276-21kworker/u16:3+events_unbound08:26:404
3855696992220,2cyclictest3926276-21kworker/u16:3+events_unbound08:26:404
3855696992220,2cyclictest128093-21kworker/u16:1+flush-8:011:17:384
3855696992219,3cyclictest151521-21kworker/u16:0+flush-8:010:52:364
3855705992120,0cyclictest0-21swapper/712:17:447
3855705992120,0cyclictest0-21swapper/710:32:337
3855705992120,0cyclictest0-21swapper/709:32:427
3855701992119,2cyclictest18792-21kworker/u16:1+events_unbound10:07:286
3855699992119,2cyclictest3926276-21kworker/u16:3+events_unbound08:13:055
3855696992119,2cyclictest4051962-21kworker/u16:3+events_unbound08:57:304
3855696992118,3cyclictest186609-21kworker/u16:0+flush-8:011:07:384
3855705992019,0cyclictest0-21swapper/707:27:417
3855705992018,1cyclictest4090120-21diskmemload09:52:327
3855705992014,5cyclictest383754-21latency_hist12:27:137
3855701992018,2cyclictest3888564-21kworker/u16:2+events_unbound07:42:326
3855701992018,2cyclictest166350-21kworker/u16:2+flush-8:011:07:136
3855701992018,2cyclictest166350-21kworker/u16:2+flush-8:011:07:136
3855701992017,2cyclictest3801129-21kworker/u16:0+events_unbound07:32:266
3855699992018,2cyclictest3870171-21kworker/u16:1+events_unbound08:24:255
3855699992018,2cyclictest3870171-21kworker/u16:1+events_unbound08:24:255
3855696992018,2cyclictest236575-21kworker/u16:1+flush-8:012:12:374
3855696992018,2cyclictest137786-21kworker/u16:4+flush-8:011:02:304
3855696992018,2cyclictest137786-21kworker/u16:4+flush-8:011:02:304
3855705991916,1cyclictest0-21swapper/711:57:267
385570599190,17cyclictest213473-21sed11:17:147
3855701991917,2cyclictest3888564-21kworker/u16:2+events_unbound07:52:266
3855699991917,2cyclictest3801129-21kworker/u16:0+events_unbound09:06:595
3855699991917,2cyclictest3801129-21kworker/u16:0+events_unbound09:06:595
3855699991917,2cyclictest3801129-21kworker/u16:0+events_unbound08:27:155
3855696991917,2cyclictest4173334-21kworker/u16:3+events_unbound10:03:144
3855696991917,2cyclictest3888564-21kworker/u16:2+flush-8:007:47:404
3855696991917,2cyclictest3801129-21kworker/u16:0+flush-8:008:07:434
3855696991917,2cyclictest236575-21kworker/u16:1+flush-8:011:47:484
3855696991916,2cyclictest323947-21kworker/u16:0+events_unbound12:07:324
3855701991816,2cyclictest262477-21kworker/u16:0+events_unbound11:47:286
3855696991816,2cyclictest55006-21kworker/u16:2+flush-8:010:19:574
3855696991816,2cyclictest3801129-21kworker/u16:0+events_unbound08:40:404
3855696991816,2cyclictest3801129-21kworker/u16:0+events_unbound07:54:354
3855696991816,2cyclictest236575-21kworker/u16:1+flush-8:012:27:284
3855705991716,0cyclictest0-21swapper/711:26:457
3855705991715,1cyclictest4093951-21ssh09:07:327
3855705991715,1cyclictest4090120-21diskmemload09:17:407
3855705991712,4cyclictest286414-21latency_hist11:47:147
3855705991711,5cyclictest3965125-21latency_hist08:02:157
3855701991715,2cyclictest4022981-21kworker/u16:2+flush-8:008:32:436
3855701991715,2cyclictest3888564-21kworker/u16:2+flush-8:007:47:376
3855701991715,2cyclictest3870171-21kworker/u16:1+flush-8:008:17:366
3855701991715,2cyclictest323947-21kworker/u16:0+events_unbound12:02:426
3855701991715,2cyclictest236575-21kworker/u16:1+events_unbound11:32:336
3855701991714,2cyclictest3870171-21kworker/u16:1+events_unbound07:17:336
3855699991715,2cyclictest4022981-21kworker/u16:2+events_unbound08:32:315
3855696991715,2cyclictest3801129-21kworker/u16:0+events_unbound07:18:354
3855696991715,2cyclictest18792-21kworker/u16:1+flush-8:010:07:354
385570599168,7cyclictest6514-21gmain07:32:367
3855705991615,0cyclictest0-21swapper/708:47:417
3855705991613,2cyclictest1234-21snmpd12:36:197
385570599160,2cyclictest198012-21ssh11:07:387
3855701991614,2cyclictest4022981-21kworker/u16:2+events_unbound09:37:136
3855701991614,2cyclictest347700-21kworker/u16:2+flush-8:012:12:296
3855701991614,2cyclictest223004-21kworker/u16:0+events_unbound11:19:176
3855699991613,2cyclictest3801129-21kworker/u16:0+events_unbound07:32:185
3855696991614,2cyclictest4173334-21kworker/u16:3+flush-8:010:32:244
3855696991614,2cyclictest4022981-21kworker/u16:2+flush-8:009:37:394
3855696991614,2cyclictest4022981-21kworker/u16:2+flush-8:009:12:094
3855696991614,2cyclictest3888564-21kworker/u16:2+flush-8:007:42:344
3855696991614,2cyclictest3848018-21kworker/u16:3+events_unbound07:12:494
3855696991612,2cyclictest262477-21kworker/u16:0+flush-8:011:42:454
3855705991514,0cyclictest0-21swapper/712:12:427
3855705991514,0cyclictest0-21swapper/709:02:297
3855705991514,0cyclictest0-21swapper/709:02:297
3855705991511,3cyclictest1234-21snmpd10:42:197
385570599150,14cyclictest306426-21kthreadcore11:52:337
3855701991513,2cyclictest64709-21kworker/u16:4+flush-8:010:17:056
3855701991513,2cyclictest4051962-21kworker/u16:3+events_unbound09:27:096
3855701991513,2cyclictest3888564-21kworker/u16:2+flush-8:007:37:376
3855701991513,2cyclictest323947-21kworker/u16:0+flush-8:012:07:296
3855699991513,2cyclictest3801129-21kworker/u16:0+events_unbound07:50:235
3855699991513,2cyclictest3801129-21kworker/u16:0+events_unbound07:39:165
3855696991513,2cyclictest4173334-21kworker/u16:3+events_unbound09:54:114
3855696991513,2cyclictest3926276-21kworker/u16:3+events_unbound08:07:034
3855696991513,2cyclictest236575-21kworker/u16:1+flush-8:012:03:034
3855696991513,2cyclictest128093-21kworker/u16:1+flush-8:011:00:054
3855696991513,2cyclictest128093-21kworker/u16:1+flush-8:010:47:274
3855696991512,2cyclictest347700-21kworker/u16:2+flush-8:012:17:344
385570599149,4cyclictest152425-21latency_hist10:52:147
385570599149,3cyclictest0-21swapper/707:47:147
3855705991413,0cyclictest0-21swapper/712:29:017
3855705991412,1cyclictest297928-21sh11:51:027
3855705991412,1cyclictest225448-21ssh11:22:097
3855705991411,2cyclictest0-21swapper/710:02:157
3855705991411,1cyclictest0-21swapper/710:22:327
3855705991411,1cyclictest0-21swapper/710:22:327
3855705991410,3cyclictest5819-21gnome-shell09:01:237
3855705991410,3cyclictest1234-21snmpd09:58:537
3855705991410,3cyclictest1234-21snmpd08:46:007
3855701991413,1cyclictest0-21swapper/610:04:536
3855701991412,2cyclictest4090278-21kworker/u16:1+events_unbound09:12:166
3855701991412,2cyclictest4022981-21kworker/u16:2+flush-8:008:52:346
3855701991410,2cyclictest3870171-21kworker/u16:1+events_unbound07:22:436
385570199140,1cyclictest0-21swapper/610:42:256
385570199140,14cyclictest0-21swapper/609:22:106
3855699991412,2cyclictest4022981-21kworker/u16:2+events_unbound08:53:365
3855699991412,2cyclictest3926276-21kworker/u16:3+events_unbound08:00:465
3855696991412,2cyclictest3801129-21kworker/u16:0+events_unbound07:32:044
3855696991412,2cyclictest3591001-21kworker/u16:2+events_unbound07:09:124
3855696991412,2cyclictest223004-21kworker/u16:0+events_unbound11:22:294
3855696991411,2cyclictest55006-21kworker/u16:2+flush-8:010:27:244
385569699140,1cyclictest0-21swapper/408:42:334
385570599139,3cyclictest1234-21snmpd10:59:077
385570599137,5cyclictest3993955-21latency_hist08:17:147
3855705991312,0cyclictest0-21swapper/709:42:517
3855705991312,0cyclictest0-21swapper/709:42:517
3855705991310,2cyclictest0-21swapper/711:32:347
3855705991310,1cyclictest325249-21ssh12:02:327
3855701991312,1cyclictest0-21swapper/611:59:496
3855701991312,1cyclictest0-21swapper/609:56:136
3855701991311,2cyclictest3801129-21kworker/u16:0+flush-8:007:27:336
385570199130,13cyclictest0-21swapper/609:38:336
3855696991311,2cyclictest3926276-21kworker/u16:3+events_unbound08:12:474
3855696991311,2cyclictest3801129-21kworker/u16:0+events_unbound09:04:134
3855696991311,2cyclictest3801129-21kworker/u16:0+events_unbound09:04:134
385569699130,13cyclictest0-21swapper/412:33:214
385570599129,2cyclictest1234-21snmpd08:17:357
385570599129,2cyclictest1234-21snmpd07:10:277
385570599129,2cyclictest0-21swapper/707:22:367
385570599128,3cyclictest1234-21snmpd08:09:267
385570599127,4cyclictest4174245-21rm09:40:207
3855705991210,1cyclictest154137-21ssh10:52:297
3855705991210,1cyclictest0-21swapper/708:27:257
385570599120,11cyclictest0-21swapper/707:12:397
385570599120,10cyclictest1234-21snmpd08:23:547
385570599120,10cyclictest1234-21snmpd08:23:547
3855701991211,1cyclictest0-21swapper/609:47:146
3855701991211,1cyclictest0-21swapper/609:47:146
3855701991210,2cyclictest3926276-21kworker/u16:3+flush-8:008:02:466
3855701991210,2cyclictest128093-21kworker/u16:1+events_unbound10:48:426
385570199120,1cyclictest0-21swapper/607:12:056
3855696991210,2cyclictest4051962-21kworker/u16:3+events_unbound08:53:594
385570599119,1cyclictest0-21swapper/708:52:307
385570599118,2cyclictest1234-21snmpd07:48:147
385570599117,3cyclictest1234-21snmpd07:40:197
385570599115,5cyclictest6101-21gmain08:37:327
385570599115,5cyclictest4111310-21ssh09:12:387
385570199119,2cyclictest86-21ksoftirqd/612:32:366
3855701991110,1cyclictest0-21swapper/608:31:336
3855701991110,1cyclictest0-21swapper/607:57:396
385570199110,3cyclictest244010-21cut11:27:336
385570199110,1cyclictest0-21swapper/608:09:006
385570599106,3cyclictest1234-21snmpd08:03:297
385570199108,2cyclictest128093-21kworker/u16:1+events_unbound10:57:166
385570199107,2cyclictest3869337-21/usr/sbin/munin07:12:426
385570199106,3cyclictest299883-21cat11:52:286
385570199106,3cyclictest191607-21kthreadcore11:07:316
385570199100,9cyclictest4006994-21kthreadcore08:22:336
385570199100,9cyclictest4006994-21kthreadcore08:22:336
385570199100,2cyclictest0-21swapper/608:12:306
385569999108,2cyclictest3801129-21kworker/u16:0+events_unbound07:12:265
385569699108,2cyclictest3888564-21kworker/u16:2+flush-8:007:37:304
38557019997,2cyclictest86-21ksoftirqd/610:00:266
38557019995,3cyclictest4094494-21kthreadcore09:07:336
38557019990,8cyclictest4051964-21/usr/sbin/munin08:47:336
38557019985,2cyclictest275391-21grep11:42:286
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional