You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 17:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Wed Dec 10, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44101526049,7sleep50-21swapper/515:22:025
44072125948,7sleep60-21swapper/615:18:026
44079125722,30sleep70-21swapper/715:18:597
441356995550,4cyclictest515643-21latency_hist15:57:197
441356995548,6cyclictest707266-21latency_hist17:32:197
441344995553,2cyclictest606395-21kworker/u16:5+flush-8:016:52:196
441344995553,2cyclictest606395-21kworker/u16:5+flush-8:016:52:196
44077925240,8sleep40-21swapper/415:18:484
441344995149,2cyclictest1010509-21kworker/u16:3+events_unbound20:17:466
441356994843,4cyclictest757741-21latency_hist17:57:207
441343994846,2cyclictest3185582-21kworker/u16:3+flush-8:015:22:355
441356994337,5cyclictest589235-21systemd-journal20:47:387
441343994341,2cyclictest889465-21kworker/u16:0+events_unbound19:06:345
441343994341,2cyclictest505560-21kworker/u16:4+events_unbound16:41:205
441343994341,2cyclictest3185582-21kworker/u16:3+events_unbound16:03:235
441343994341,2cyclictest3185582-21kworker/u16:3+events_unbound16:03:235
441356994237,4cyclictest589235-21systemd-journal20:26:387
441343994239,2cyclictest354755-21kworker/u16:0+flush-8:015:47:505
441343994139,2cyclictest968917-21kworker/u16:2+events_unbound20:03:345
441343994139,2cyclictest505560-21kworker/u16:4+flush-8:016:12:455
441343994139,2cyclictest1039541-21kworker/u16:5+events_unbound20:13:345
441343994139,2cyclictest1009282-21kworker/u16:1+events_unbound20:28:395
441343994038,2cyclictest968917-21kworker/u16:2+flush-8:019:45:345
441343994038,2cyclictest818702-21kworker/u16:3+events_unbound19:24:335
441343994038,2cyclictest787076-21kworker/u16:5+events_unbound19:54:335
441343994038,2cyclictest1009282-21kworker/u16:1+events_unbound20:41:395
441344993936,2cyclictest3185582-21kworker/u16:3+events_unbound15:22:386
441343993937,2cyclictest827573-21kworker/u16:4+events_unbound18:40:335
441344993836,2cyclictest827573-21kworker/u16:4+events_unbound20:45:196
441343993836,2cyclictest818702-21kworker/u16:3+events_unbound19:13:195
441343993836,2cyclictest606395-21kworker/u16:5+flush-8:017:02:145
441343993836,2cyclictest354755-21kworker/u16:0+events_unbound16:20:235
441343993735,2cyclictest818702-21kworker/u16:3+events_unbound18:50:335
441343993734,2cyclictest827573-21kworker/u16:4+flush-8:020:46:095
441344993634,2cyclictest606395-21kworker/u16:5+events_unbound17:29:196
441343993634,2cyclictest827573-21kworker/u16:4+events_unbound18:56:345
441343993633,2cyclictest606395-21kworker/u16:5+flush-8:016:47:365
441343993633,2cyclictest606395-21kworker/u16:5+flush-8:016:47:365
441344993533,2cyclictest666691-21kworker/u16:0+events_unbound17:14:316
441343993533,2cyclictest666691-21kworker/u16:0+flush-8:017:37:145
441343993533,2cyclictest1009282-21kworker/u16:1+flush-8:020:01:535
441356993428,5cyclictest868897-21latency_hist18:52:197
441344993432,2cyclictest726327-21kworker/u16:1+events_unbound17:41:336
441344993432,2cyclictest666691-21kworker/u16:0+events_unbound17:10:316
44135699330,31cyclictest1080786-21latency_hist20:37:197
441344993332,1cyclictest768206-21kworker/u16:2+flush-8:018:28:426
441344993331,2cyclictest726327-21kworker/u16:1+events_unbound18:09:326
441344993331,2cyclictest606395-21kworker/u16:5+events_unbound16:56:276
441343993331,2cyclictest768206-21kworker/u16:2+events_unbound18:30:295
441343993331,2cyclictest768206-21kworker/u16:2+events_unbound18:20:335
441343993331,2cyclictest585275-21kworker/u16:3+events_unbound18:04:335
441343993331,2cyclictest576112-21kworker/u16:0+events_unbound16:27:555
441356993230,1cyclictest0-21swapper/720:17:387
441344993230,2cyclictest827573-21kworker/u16:4+events_unbound19:45:186
441344993230,2cyclictest606395-21kworker/u16:5+flush-8:016:43:306
441344993229,2cyclictest787076-21kworker/u16:5+flush-8:018:37:296
441343993230,2cyclictest354755-21kworker/u16:0+events_unbound15:57:085
441356993126,4cyclictest576161-21latency_hist16:27:207
441344993129,2cyclictest827573-21kworker/u16:4+events_unbound19:09:226
441344993129,2cyclictest666691-21kworker/u16:0+events_unbound17:34:516
441344993129,2cyclictest646193-21kworker/u16:2+flush-8:017:19:586
441344993129,2cyclictest1009282-21kworker/u16:1+events_unbound20:30:266
441344993129,2cyclictest1009282-21kworker/u16:1+events_unbound20:22:226
441343993129,2cyclictest768206-21kworker/u16:2+events_unbound18:34:085
441343993129,2cyclictest726551-21kworker/u16:4+events_unbound17:43:335
441343993129,2cyclictest566022-21kworker/u16:1+events_unbound16:25:305
441343993129,2cyclictest354755-21kworker/u16:0+events_unbound15:36:135
441344993028,2cyclictest818702-21kworker/u16:3+flush-8:019:12:586
441344993028,2cyclictest818702-21kworker/u16:3+events_unbound18:50:156
441344993028,2cyclictest808260-21kworker/u16:0+events_unbound18:25:266
441344993028,2cyclictest585275-21kworker/u16:3+events_unbound16:36:036
441344993028,2cyclictest536184-21kworker/u16:2+events_unbound16:13:316
441344993028,2cyclictest354755-21kworker/u16:0+events_unbound16:00:596
441344993028,2cyclictest3185582-21kworker/u16:3+events_unbound15:54:046
441344993028,2cyclictest3185582-21kworker/u16:3+events_unbound15:44:476
441344993027,2cyclictest787076-21kworker/u16:5+events_unbound19:17:236
441343993028,2cyclictest475320-21kworker/u16:1+events_unbound15:42:445
441343993028,2cyclictest354755-21kworker/u16:0+events_unbound15:32:195
441343993028,2cyclictest1010509-21kworker/u16:3+flush-8:020:20:295
441344992927,2cyclictest818702-21kworker/u16:3+flush-8:018:42:586
441344992927,2cyclictest787076-21kworker/u16:5+events_unbound19:28:336
441344992927,2cyclictest505560-21kworker/u16:4+events_unbound16:42:156
441344992927,2cyclictest505560-21kworker/u16:4+events_unbound16:20:066
441344992927,2cyclictest475320-21kworker/u16:1+events_unbound15:39:586
441344992927,2cyclictest3185582-21kworker/u16:3+events_unbound16:03:316
441344992927,2cyclictest3185582-21kworker/u16:3+events_unbound16:03:316
441344992927,2cyclictest1039541-21kworker/u16:5+events_unbound20:14:506
441343992927,2cyclictest946095-21kworker/u16:1+events_unbound19:29:595
441343992927,2cyclictest808260-21kworker/u16:0+events_unbound18:25:305
441356992822,5cyclictest990129-21latency_hist19:52:197
441344992826,2cyclictest889465-21kworker/u16:0+flush-8:019:02:466
441344992826,2cyclictest827573-21kworker/u16:4+events_unbound19:25:146
441344992826,2cyclictest768206-21kworker/u16:2+events_unbound18:56:466
441344992826,2cyclictest726327-21kworker/u16:1+flush-8:018:05:426
441344992826,2cyclictest726327-21kworker/u16:1+events_unbound18:18:516
441344992826,2cyclictest606395-21kworker/u16:5+flush-8:017:55:586
441344992826,2cyclictest606395-21kworker/u16:5+events_unbound17:26:036
441344992826,2cyclictest566022-21kworker/u16:1+flush-8:016:23:476
441344992825,2cyclictest818702-21kworker/u16:3+flush-8:018:57:286
441343992826,2cyclictest827573-21kworker/u16:4+events_unbound20:48:295
441343992826,2cyclictest818702-21kworker/u16:3+events_unbound19:38:355
441343992826,2cyclictest636546-21kworker/u16:1+flush-8:017:03:435
441343992826,2cyclictest606395-21kworker/u16:5+flush-8:017:28:335
441343992826,2cyclictest585275-21kworker/u16:3+events_unbound17:39:425
441343992826,2cyclictest1009282-21kworker/u16:1+flush-8:020:32:445
441343992825,2cyclictest585275-21kworker/u16:3+events_unbound16:52:245
441356992726,0cyclictest0-21swapper/718:52:357
441344992725,2cyclictest999951-21kworker/u16:0+events_unbound20:09:146
441344992725,2cyclictest946095-21kworker/u16:1+events_unbound19:34:156
441344992725,2cyclictest726327-21kworker/u16:1+events_unbound17:59:506
441344992725,2cyclictest3930797-21kworker/u16:2+events_unbound15:30:516
441344992725,2cyclictest3185582-21kworker/u16:3+flush-8:015:50:186
441344992725,2cyclictest1009282-21kworker/u16:1+events_unbound20:33:096
441344992724,2cyclictest968917-21kworker/u16:2+events_unbound19:57:256
441343992725,2cyclictest946095-21kworker/u16:1+events_unbound19:36:505
441343992725,2cyclictest818702-21kworker/u16:3+events_unbound18:59:305
441343992725,2cyclictest757746-21kworker/u16:0+events_unbound17:59:345
441343992724,2cyclictest475320-21kworker/u16:1+events_unbound15:37:225
441343992723,3cyclictest787076-21kworker/u16:5+flush-8:019:07:345
441344992624,2cyclictest818702-21kworker/u16:3+events_unbound19:39:286
441344992624,2cyclictest768206-21kworker/u16:2+events_unbound18:16:286
441344992624,2cyclictest606395-21kworker/u16:5+flush-8:017:00:146
441344992624,2cyclictest354755-21kworker/u16:0+events_unbound16:09:506
441344992624,2cyclictest3185582-21kworker/u16:3+events_unbound15:34:266
441344992624,2cyclictest1010509-21kworker/u16:3+events_unbound20:38:586
441343992624,2cyclictest768206-21kworker/u16:2+events_unbound18:14:335
441343992624,2cyclictest606394-21kworker/u16:2+events_unbound16:44:315
441344992523,2cyclictest999951-21kworker/u16:0+flush-8:019:55:146
441344992523,2cyclictest968917-21kworker/u16:2+events_unbound20:04:216
441344992523,2cyclictest827573-21kworker/u16:4+events_unbound19:50:426
441344992523,2cyclictest818702-21kworker/u16:3+flush-8:018:32:296
441344992523,2cyclictest606395-21kworker/u16:5+events_unbound17:48:186
441344992523,2cyclictest585275-21kworker/u16:3+flush-8:017:02:346
441343992523,2cyclictest787076-21kworker/u16:5+flush-8:019:19:345
441356992422,1cyclictest0-21swapper/716:52:407
441356992419,4cyclictest616478-21latency_hist16:47:197
441356992419,4cyclictest589235-21systemd-journal15:52:197
441343992422,2cyclictest726327-21kworker/u16:1+events_unbound17:49:225
441343992422,2cyclictest636546-21kworker/u16:1+events_unbound17:09:155
441356992320,2cyclictest976-21in:imjournal20:12:337
441356992318,4cyclictest451313-21latency_hist15:27:207
441344992321,2cyclictest585275-21kworker/u16:3+events_unbound16:29:366
441343992321,2cyclictest677377-21kworker/u16:1+events_unbound17:21:305
441343992321,2cyclictest606395-21kworker/u16:5+events_unbound17:53:585
441356992221,0cyclictest0-21swapper/717:57:357
441356992221,0cyclictest0-21swapper/717:47:397
441344992220,2cyclictest726327-21kworker/u16:1+events_unbound17:45:146
441343992220,2cyclictest787076-21kworker/u16:5+events_unbound18:46:305
441343992220,2cyclictest726327-21kworker/u16:1+events_unbound18:11:315
441343992220,2cyclictest606395-21kworker/u16:5+events_unbound17:13:195
441356992118,2cyclictest721235-21kthreadcore17:37:367
441343992117,3cyclictest354755-21kworker/u16:0+flush-8:015:57:485
441356992019,0cyclictest0-21swapper/718:42:407
441356992016,3cyclictest919348-21sshd19:16:457
441356992015,4cyclictest939561-21latency_hist19:27:197
441343992017,2cyclictest354755-21kworker/u16:0+flush-8:016:11:545
441344991917,2cyclictest1091225-21kworker/u16:2+events_unbound20:49:326
441356991817,0cyclictest0-21swapper/717:07:437
441356991816,1cyclictest0-21swapper/719:42:197
441356991816,1cyclictest0-21swapper/717:01:037
441356991815,2cyclictest4175659-21snmpd19:37:437
441356991814,3cyclictest4175659-21snmpd20:03:497
44135699180,17cyclictest0-21swapper/716:27:477
441343991816,2cyclictest968917-21kworker/u16:2+events_unbound19:48:195
441343991816,2cyclictest606395-21kworker/u16:5+flush-8:017:22:415
441343991816,2cyclictest1009282-21kworker/u16:1+events_unbound20:22:535
44134099181,1cyclictest631rcuc/418:10:324
441356991716,0cyclictest0-21swapper/719:02:327
441356991714,2cyclictest4175659-21snmpd19:01:547
441356991712,4cyclictest697185-21latency_hist17:27:197
441356991711,5cyclictest808234-21latency_hist18:22:197
44135699170,16cyclictest0-21swapper/718:07:467
441343991715,2cyclictest999951-21kworker/u16:0+flush-8:020:07:205
44134099170,1cyclictest0-21swapper/418:38:114
44134099170,1cyclictest0-21swapper/418:34:054
44134099170,1cyclictest0-21swapper/418:31:014
44134099170,1cyclictest0-21swapper/418:24:524
44134099170,1cyclictest0-21swapper/418:18:444
44134099170,1cyclictest0-21swapper/418:12:354
441356991613,2cyclictest4175659-21snmpd20:42:417
441356991613,2cyclictest4175659-21snmpd16:33:357
441340991615,1cyclictest0-21swapper/415:32:454
44135699158,6cyclictest27394-21gmain18:32:377
441356991514,0cyclictest0-21swapper/718:37:397
441356991514,0cyclictest0-21swapper/715:36:387
441356991513,1cyclictest0-21swapper/718:12:397
441356991512,2cyclictest0-21swapper/720:37:197
44135699150,13cyclictest4175659-21snmpd16:47:577
44135699150,13cyclictest4175659-21snmpd16:47:577
44135699149,4cyclictest676991-21latency_hist17:17:207
441356991414,0cyclictest0-21swapper/719:34:587
441356991413,0cyclictest0-21swapper/720:07:407
441343991412,2cyclictest505560-21kworker/u16:4+events_unbound16:35:075
441340991413,1cyclictest0-21swapper/415:27:484
441340991412,1cyclictest6975822sleep417:27:324
441340991411,2cyclictest968917-21kworker/u16:2+flush-8:019:52:384
44134099140,7cyclictest0-21swapper/416:37:354
44135699138,4cyclictest828413-21latency_hist18:32:197
44135699136,6cyclictest27394-21gmain19:07:377
44135699136,6cyclictest0-21swapper/720:32:017
44135699135,7cyclictest0-21swapper/716:21:217
441356991312,0cyclictest0-21swapper/717:42:467
441356991310,2cyclictest4175659-21snmpd18:24:597
441356991310,2cyclictest0-21swapper/719:57:407
44134099137,5cyclictest617002-21cpuspeed_turbos16:47:324
44134099137,5cyclictest617002-21cpuspeed_turbos16:47:324
44134099130,5cyclictest0-21swapper/415:42:384
44135699129,2cyclictest4175659-21snmpd19:21:277
44135699128,3cyclictest4175659-21snmpd15:31:527
44135699127,4cyclictest4175659-21snmpd19:56:517
441356991210,1cyclictest0-21swapper/715:57:357
44135699120,4cyclictest528117-21kthreadcore16:02:387
44135699120,4cyclictest528117-21kthreadcore16:02:387
44134099128,3cyclictest607548-21cat16:42:354
441340991211,1cyclictest0-21swapper/420:35:594
441340991211,1cyclictest0-21swapper/417:39:264
44134099120,1cyclictest65-21ksoftirqd/417:11:034
44134099120,1cyclictest0-21swapper/417:33:364
44134099120,1cyclictest0-21swapper/416:34:194
44134099120,12cyclictest0-21swapper/418:49:354
44135699119,1cyclictest555078-21ntpq16:12:457
44135699119,1cyclictest0-21swapper/716:37:417
44135699118,2cyclictest4175659-21snmpd18:06:417
44135699118,2cyclictest4175659-21snmpd17:17:307
44135699118,2cyclictest4175659-21snmpd16:08:237
44135699116,4cyclictest589235-21systemd-journal19:29:207
44135699116,4cyclictest589235-21systemd-journal17:34:327
44135699110,4cyclictest489749-21grep15:42:427
44134099117,3cyclictest882649-21kthreadcore18:57:404
44134099115,5cyclictest569326-21kthreadcore16:22:374
441340991110,1cyclictest0-21swapper/419:58:004
441340991110,1cyclictest0-21swapper/419:23:384
441340991110,1cyclictest0-21swapper/417:21:564
441340991110,1cyclictest0-21swapper/417:03:294
44134099110,1cyclictest0-21swapper/419:47:464
44134099110,11cyclictest0-21swapper/419:14:014
44134099110,11cyclictest0-21swapper/417:24:274
44134099110,0cyclictest0-21swapper/420:22:074
44135699100,9cyclictest4175659-21snmpd17:02:217
44134099109,1cyclictest0-21swapper/418:42:394
44134099109,1cyclictest0-21swapper/416:12:154
44134099108,2cyclictest0-21swapper/420:12:394
44134099108,1cyclictest0-21swapper/419:27:354
44134099108,1cyclictest0-21swapper/417:42:484
44134099106,3cyclictest890249-21cat19:02:354
44134099106,3cyclictest1093126-21cut20:42:374
44134099106,3cyclictest1069738-21nfs_client20:27:434
44134099105,4cyclictest878268-21switchtime18:52:494
44134099102,7cyclictest676214-21awk17:12:484
44134099102,7cyclictest586082-21chrt16:30:194
44134099102,4cyclictest5645661kthreadcore16:17:414
44134099100,10cyclictest0-21swapper/418:06:274
4413569996,2cyclictest0-21swapper/715:37:447
4413409998,1cyclictest0-21swapper/420:41:594
4413409998,1cyclictest0-21swapper/420:07:274
4413409998,1cyclictest0-21swapper/419:36:334
4413409998,1cyclictest0-21swapper/416:57:304
4413409998,1cyclictest0-21swapper/416:05:284
4413409998,1cyclictest0-21swapper/416:05:284
4413409998,1cyclictest0-21swapper/416:01:134
4413409998,1cyclictest0-21swapper/415:52:424
4413409998,1cyclictest0-21swapper/415:26:044
4413409995,3cyclictest750068-21tr17:52:374
4413409994,4cyclictest967541-21kthreadcore19:37:424
4413409992,6cyclictest926042-21grep19:17:394
4413409992,6cyclictest765152-21cut17:57:414
4413409992,6cyclictest1060579-21chrt20:26:084
4413409991,7cyclictest1101302-21chrt20:47:234
4413409987,1cyclictest0-21swapper/416:55:464
4413409984,3cyclictest1010638-21cpu20:02:334
4413409982,5cyclictest970383-21grep19:42:314
4413409982,5cyclictest547986-21kthreadcore16:12:374
4413409982,5cyclictest478858-21kthreadcore15:37:394
4413409981,6cyclictest900120-21entropy19:07:344
4413409981,6cyclictest738502-21expr17:47:334
4413409981,6cyclictest495973-21cpuspeed_turbos15:47:334
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional