You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 15:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Mon Dec 08, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
229160126151,7sleep40-21swapper/415:22:124
229157625747,7sleep60-21swapper/615:21:506
2291930995553,2cyclictest2749386-21kworker/u16:5+events_unbound19:22:535
229158425545,7sleep50-21swapper/515:21:575
2291930995250,2cyclictest2788357-21kworker/u16:0+events_unbound20:22:555
229143024815,29sleep70-21swapper/715:19:517
2291937994539,5cyclictest2608396-21latency_hist17:57:277
2291937994140,0cyclictest0-21swapper/718:24:377
2291937994039,0cyclictest0-21swapper/716:12:307
2291935994037,2cyclictest2657801-21kworker/u16:1+flush-8:018:32:296
2291930993836,2cyclictest2739716-21kworker/u16:1+flush-8:019:08:385
2291937993734,2cyclictest2315963-21munin-run15:32:287
2291935993735,2cyclictest2291457-21kworker/u16:1+flush-8:015:42:516
2291930993735,2cyclictest2597357-21kworker/u16:3+flush-8:017:48:375
2291937993629,5cyclictest589235-21systemd-journal20:12:267
2291935993634,2cyclictest2577830-21kworker/u16:0+events_unbound18:44:396
2291930993634,2cyclictest2788357-21kworker/u16:0+events_unbound20:09:245
2291937993534,0cyclictest0-21swapper/720:41:397
2291937993534,0cyclictest0-21swapper/718:51:377
2291937993534,0cyclictest0-21swapper/717:35:387
2291937993534,0cyclictest0-21swapper/717:30:377
2291935993533,2cyclictest2788357-21kworker/u16:0+flush-8:020:22:516
2291935993533,2cyclictest2788357-21kworker/u16:0+events_unbound19:59:146
2291935993533,2cyclictest2291457-21kworker/u16:1+events_unbound15:24:266
2291930993533,2cyclictest2873240-21kworker/u16:3+flush-8:020:14:455
2291930993533,2cyclictest2395908-21kworker/u16:4+flush-8:016:40:065
2291926993532,2cyclictest2860717-21kworker/u16:1+events_unbound20:32:454
2291937993433,0cyclictest0-21swapper/719:54:397
2291935993432,2cyclictest2476894-21kworker/u16:2+events_unbound17:39:426
2291935993432,2cyclictest2261613-21kworker/u16:2+flush-8:015:57:386
2291930993432,2cyclictest2749386-21kworker/u16:5+flush-8:020:03:395
2291930993432,2cyclictest2749386-21kworker/u16:5+events_unbound19:22:225
2291930993432,2cyclictest2395908-21kworker/u16:4+flush-8:016:57:385
2291935993331,2cyclictest2688166-21kworker/u16:3+events_unbound19:01:376
2291930993331,2cyclictest2788357-21kworker/u16:0+flush-8:019:42:575
2291930993331,2cyclictest2788357-21kworker/u16:0+events_unbound19:36:405
2291930993331,2cyclictest2577830-21kworker/u16:0+events_unbound18:24:455
2291930993331,1cyclictest2588225-21kworker/u16:1+flush-8:017:57:425
2291937993231,0cyclictest0-21swapper/715:32:387
2291937993230,1cyclictest0-21swapper/718:00:537
2291935993230,2cyclictest2749386-21kworker/u16:5+events_unbound20:33:426
2291930993230,2cyclictest2476917-21kworker/u16:3+events_unbound17:36:405
2291930993230,2cyclictest2476894-21kworker/u16:2+flush-8:017:08:065
2291930993230,2cyclictest2281397-21kworker/u16:0+flush-8:015:49:465
2291930993230,2cyclictest2261613-21kworker/u16:2+events_unbound15:37:265
2291937993131,0cyclictest0-21swapper/718:54:377
2291937993130,0cyclictest0-21swapper/719:33:407
2291935993129,2cyclictest2920801-21kworker/u16:2+flush-8:020:31:366
2291935993129,2cyclictest2739716-21kworker/u16:1+flush-8:019:06:226
2291935993129,2cyclictest2688166-21kworker/u16:3+events_unbound19:14:456
2291935993129,2cyclictest2577830-21kworker/u16:0+events_unbound18:49:226
2291935993129,2cyclictest2546953-21kworker/u16:5+events_unbound17:54:456
2291935993129,2cyclictest2291457-21kworker/u16:1+events_unbound16:31:436
2291930993129,2cyclictest2577830-21kworker/u16:0+events_unbound18:30:335
2291930993129,2cyclictest2546953-21kworker/u16:5+events_unbound18:17:415
2291930993129,2cyclictest2546953-21kworker/u16:5+events_unbound17:44:295
2291930993129,2cyclictest2476917-21kworker/u16:3+events_unbound16:55:425
2291937993029,0cyclictest0-21swapper/719:46:407
2291937993029,0cyclictest0-21swapper/719:16:407
2291935993028,2cyclictest2657801-21kworker/u16:1+flush-8:018:31:456
2291935993028,2cyclictest2546953-21kworker/u16:5+flush-8:018:02:386
2291935993028,2cyclictest2546953-21kworker/u16:5+events_unbound18:14:416
2291935993028,2cyclictest2291457-21kworker/u16:1+events_unbound15:56:586
2291935993028,2cyclictest2291457-21kworker/u16:1+events_unbound15:56:586
2291935993027,2cyclictest2788357-21kworker/u16:0+events_unbound19:27:276
2291930993029,1cyclictest2395908-21kworker/u16:4+flush-8:016:28:505
2291930993028,2cyclictest2920801-21kworker/u16:2+flush-8:020:37:095
2291930993028,2cyclictest2873240-21kworker/u16:3+flush-8:020:20:255
2291930993028,2cyclictest2800067-21kworker/u16:2+events_unbound19:55:025
2291930993028,2cyclictest2800067-21kworker/u16:2+events_unbound19:51:295
2291930993028,2cyclictest2749386-21kworker/u16:5+events_unbound20:41:135
2291930993028,2cyclictest2710169-21kworker/u16:4+events_unbound18:58:375
2291930993028,2cyclictest2688166-21kworker/u16:3+events_unbound19:16:305
2291930993028,2cyclictest2395908-21kworker/u16:4+flush-8:016:14:345
2291930993028,2cyclictest2291457-21kworker/u16:1+flush-8:015:46:055
2291930993028,2cyclictest2261613-21kworker/u16:2+flush-8:015:58:335
2291937992928,0cyclictest0-21swapper/719:29:367
2291937992928,0cyclictest0-21swapper/717:07:187
2291937992923,5cyclictest589235-21systemd-journal15:49:257
2291937992923,5cyclictest2598275-21latency_hist17:52:287
2291935992927,2cyclictest2739716-21kworker/u16:1+events_unbound19:25:266
2291935992927,2cyclictest2597357-21kworker/u16:3+flush-8:017:49:426
2291935992927,2cyclictest2476894-21kworker/u16:2+events_unbound17:03:376
2291935992927,2cyclictest2395908-21kworker/u16:4+flush-8:017:07:546
2291935992927,2cyclictest2395908-21kworker/u16:4+events_unbound16:54:456
2291935992927,2cyclictest2346318-21kworker/u16:4+flush-8:015:48:346
2291935992926,2cyclictest2546953-21kworker/u16:5+flush-8:017:26:426
2291935992926,2cyclictest2546953-21kworker/u16:5+flush-8:017:26:426
2291930992927,2cyclictest2788357-21kworker/u16:0+flush-8:020:01:085
2291930992927,2cyclictest2710169-21kworker/u16:4+events_unbound18:52:065
2291930992927,2cyclictest2688166-21kworker/u16:3+events_unbound19:30:345
2291930992927,2cyclictest2688166-21kworker/u16:3+events_unbound18:35:415
2291930992927,2cyclictest2657801-21kworker/u16:1+events_unbound18:46:055
2291930992927,2cyclictest2577830-21kworker/u16:0+events_unbound17:55:345
2291930992927,2cyclictest2291457-21kworker/u16:1+events_unbound16:44:305
2291930992927,2cyclictest2291457-21kworker/u16:1+events_unbound15:26:115
2291937992828,0cyclictest0-21swapper/716:30:377
2291935992826,2cyclictest2800067-21kworker/u16:2+flush-8:019:56:306
2291935992826,2cyclictest2788357-21kworker/u16:0+events_unbound19:42:556
2291935992826,2cyclictest2749386-21kworker/u16:5+events_unbound19:11:336
2291935992826,2cyclictest2739716-21kworker/u16:1+flush-8:019:20:576
2291935992826,2cyclictest2710169-21kworker/u16:4+events_unbound18:55:396
2291935992826,2cyclictest2577830-21kworker/u16:0+flush-8:018:40:406
2291935992826,2cyclictest2546953-21kworker/u16:5+events_unbound18:25:496
2291935992826,2cyclictest2501348-21kworker/u16:1+flush-8:017:21:456
2291935992826,2cyclictest2476917-21kworker/u16:3+events_unbound17:27:416
2291935992826,2cyclictest2395908-21kworker/u16:4+events_unbound16:25:286
2291935992825,2cyclictest2788357-21kworker/u16:0+events_unbound20:07:426
2291935992825,2cyclictest2281397-21kworker/u16:0+flush-8:015:37:386
2291930992826,2cyclictest2860717-21kworker/u16:1+flush-8:020:46:225
2291930992826,2cyclictest2618567-21kworker/u16:2+events_unbound18:56:055
2291930992826,2cyclictest2546953-21kworker/u16:5+flush-8:017:39:585
2291930992826,2cyclictest2412457-21kworker/u16:0+events_unbound16:19:465
2291930992826,2cyclictest2395908-21kworker/u16:4+flush-8:017:02:495
2291930992826,2cyclictest2395908-21kworker/u16:4+events_unbound16:25:305
2291937992726,0cyclictest0-21swapper/716:55:307
2291937992726,0cyclictest0-21swapper/716:50:397
2291937992726,0cyclictest0-21swapper/715:24:387
229193799270,25cyclictest27304-21gsd-housekeepin18:37:007
2291935992725,2cyclictest2788357-21kworker/u16:0+flush-8:019:36:136
2291935992725,2cyclictest2688166-21kworker/u16:3+events_unbound19:41:296
2291935992725,2cyclictest2546953-21kworker/u16:5+flush-8:017:58:136
2291935992725,2cyclictest2291457-21kworker/u16:1+events_unbound16:45:466
2291930992725,2cyclictest2860717-21kworker/u16:1+events_unbound20:48:335
2291930992725,2cyclictest2618567-21kworker/u16:2+flush-8:018:40:465
2291930992725,2cyclictest2618567-21kworker/u16:2+events_unbound18:11:265
2291930992725,2cyclictest2546953-21kworker/u16:5+events_unbound17:31:225
2291930992725,2cyclictest2281397-21kworker/u16:0+events_unbound15:40:145
2291937992619,5cyclictest589235-21systemd-journal19:42:277
2291935992624,2cyclictest2873240-21kworker/u16:3+events_unbound20:20:096
2291935992624,2cyclictest2873240-21kworker/u16:3+events_unbound20:16:186
2291935992624,2cyclictest2546953-21kworker/u16:5+events_unbound18:21:416
2291935992624,2cyclictest2476894-21kworker/u16:2+events_unbound16:59:466
2291935992624,2cyclictest2412457-21kworker/u16:0+flush-8:016:20:186
2291935992624,2cyclictest2395908-21kworker/u16:4+flush-8:017:16:576
2291935992624,2cyclictest2281397-21kworker/u16:0+events_unbound16:05:226
2291935992624,2cyclictest2281397-21kworker/u16:0+events_unbound15:32:256
2291930992624,2cyclictest2788357-21kworker/u16:0+events_unbound20:28:455
2291930992624,2cyclictest2749386-21kworker/u16:5+events_unbound19:38:395
2291930992624,2cyclictest2546953-21kworker/u16:5+flush-8:018:12:385
2291930992624,2cyclictest2476894-21kworker/u16:2+flush-8:017:20:585
2291930992624,2cyclictest2395908-21kworker/u16:4+flush-8:017:14:575
2291930992624,2cyclictest2395908-21kworker/u16:4+flush-8:016:10:025
2291930992624,2cyclictest2291457-21kworker/u16:1+flush-8:015:54:465
2291930992624,2cyclictest2291457-21kworker/u16:1+flush-8:015:54:465
2291930992624,2cyclictest2291457-21kworker/u16:1+events_unbound15:28:545
2291930992624,2cyclictest2281397-21kworker/u16:0+events_unbound16:05:055
2291937992524,0cyclictest0-21swapper/720:22:507
2291937992524,0cyclictest0-21swapper/716:57:437
2291937992524,0cyclictest0-21swapper/715:42:387
2291935992523,2cyclictest2920801-21kworker/u16:2+flush-8:020:43:266
2291935992523,2cyclictest2920801-21kworker/u16:2+events_unbound20:41:276
2291935992523,2cyclictest2376748-21kworker/u16:3+flush-8:016:10:256
2291930992523,2cyclictest2476917-21kworker/u16:3+events_unbound16:50:295
2291935992422,2cyclictest2577830-21kworker/u16:0+flush-8:017:42:546
2291935992422,2cyclictest2546953-21kworker/u16:5+events_unbound18:11:026
2291930992422,2cyclictest2546953-21kworker/u16:5+events_unbound18:06:505
2291930992422,2cyclictest2476917-21kworker/u16:3+flush-8:017:27:145
2291930992422,2cyclictest2476917-21kworker/u16:3+flush-8:017:27:145
2291937992322,0cyclictest0-21swapper/716:20:297
2291935992321,2cyclictest2749386-21kworker/u16:5+events_unbound20:48:536
2291935992321,2cyclictest2749386-21kworker/u16:5+events_unbound20:02:376
2291935992321,2cyclictest2395908-21kworker/u16:4+flush-8:016:48:306
2291935992321,2cyclictest2395908-21kworker/u16:4+flush-8:016:33:586
2291935992321,2cyclictest2291457-21kworker/u16:1+events_unbound15:32:586
2291935992320,2cyclictest2800067-21kworker/u16:2+flush-8:019:47:326
2291930992321,2cyclictest2739716-21kworker/u16:1+events_unbound19:04:415
2291937992221,0cyclictest0-21swapper/718:04:297
2291937992221,0cyclictest0-21swapper/716:10:297
2291935992220,2cyclictest2546953-21kworker/u16:5+events_unbound17:34:416
2291935992220,2cyclictest2376748-21kworker/u16:3+events_unbound16:16:276
2291930992220,2cyclictest2412457-21kworker/u16:0+flush-8:016:33:155
2291937992120,0cyclictest0-21swapper/718:31:387
2291937992020,0cyclictest0-21swapper/720:48:497
2291937992015,4cyclictest2527710-21latency_hist17:17:277
2291935992018,2cyclictest2412457-21kworker/u16:0+flush-8:016:40:166
2291937991918,0cyclictest0-21swapper/718:13:137
2291937991917,1cyclictest0-21swapper/716:42:507
2291937991917,1cyclictest0-21swapper/715:39:337
2291937991913,5cyclictest589235-21systemd-journal17:24:377
2291937991913,5cyclictest589235-21systemd-journal17:24:377
23188802180,3sleep465-21ksoftirqd/415:32:454
2291937991817,0cyclictest0-21swapper/720:29:187
2291937991817,0cyclictest0-21swapper/720:01:297
2291937991817,0cyclictest0-21swapper/717:43:297
2291926991816,2cyclictest2546953-21kworker/u16:5+flush-8:017:47:274
2291937991717,0cyclictest0-21swapper/718:43:297
2291937991716,0cyclictest0-21swapper/719:03:307
2291937991714,2cyclictest0-21swapper/720:17:277
2291937991616,0cyclictest0-21swapper/719:26:387
2291937991615,0cyclictest0-21swapper/719:08:337
229193799160,9cyclictest984960-21gvfsd-wsdd15:57:447
229193799160,1cyclictest0-21swapper/716:22:517
229192699160,15cyclictest0-21swapper/418:37:434
2291937991514,0cyclictest0-21swapper/720:12:327
2291937991514,0cyclictest0-21swapper/716:06:337
2291926991514,1cyclictest2754686-21cut19:07:474
2291937991414,0cyclictest0-21swapper/718:21:107
229193799140,1cyclictest0-21swapper/720:32:557
229193799140,13cyclictest0-21swapper/718:37:537
229192699149,4cyclictest2716228-21cut18:47:494
2291926991413,1cyclictest2944464-21kthreadcore20:42:464
2291926991413,1cyclictest2889128-21kthreadcore20:12:494
2291926991413,1cyclictest2875738-21kthreadcore20:07:494
2291926991413,1cyclictest2864192-21kthreadcore20:02:464
2291926991413,1cyclictest2814901-21kthreadcore19:37:474
2291926991413,1cyclictest2549461-21irqcore17:27:464
2291926991413,1cyclictest2529651-21kthreadcore17:17:454
2291926991413,1cyclictest2522209-21kthreadcore17:12:494
2291926991413,1cyclictest2515345-21cut17:07:494
2291926991413,1cyclictest2492679-21tr16:57:494
2291926991413,1cyclictest2474733-21tr16:47:474
2291926991413,1cyclictest2415267-21kthreadcore16:17:504
2291926991413,1cyclictest2309673-21cut15:27:454
2291926991413,1cyclictest0-21swapper/416:12:514
2291926991412,1cyclictest2422916-21kthreadcore16:22:454
229192699140,14cyclictest0-21swapper/419:52:274
229193799136,6cyclictest27904-21gmain19:17:407
229193799136,6cyclictest27642-21gmain17:37:567
2291937991310,2cyclictest2366290-21munin-run15:57:277
2291937991310,2cyclictest2366290-21munin-run15:57:277
229193799130,1cyclictest0-21swapper/717:07:527
2291926991312,1cyclictest2915365-21kthreadcore20:27:464
2291926991312,1cyclictest2891524-21cstates20:17:434
2291926991312,1cyclictest2801193-21fschecks_time19:32:414
2291926991312,1cyclictest2771064-21hwlatdetect19:17:424
2291926991312,1cyclictest2627742-21proc_pri18:02:544
2291926991312,1cyclictest2563331-21kthreadcore17:32:484
2291926991312,1cyclictest2428920-21kthreadcore16:27:454
2291926991312,1cyclictest0-21swapper/418:32:464
2291926991312,1cyclictest0-21swapper/418:21:394
2291926991312,1cyclictest0-21swapper/418:07:454
2291926991311,1cyclictest0-21swapper/417:02:424
229193799129,2cyclictest4175659-21snmpd17:19:147
229193799129,2cyclictest27177-21gmain19:47:407
229193799125,6cyclictest27642-21gmain16:32:497
229193799125,6cyclictest27177-21gmain16:37:537
229193799120,1cyclictest0-21swapper/720:42:527
2291926991211,1cyclictest2261613-21kworker/u16:2-events_unbound15:52:464
2291926991211,1cyclictest2261613-21kworker/u16:2-events_unbound15:52:464
2291926991211,1cyclictest0-21swapper/420:22:444
2291926991211,1cyclictest0-21swapper/419:27:464
2291926991211,1cyclictest0-21swapper/418:57:504
2291926991211,1cyclictest0-21swapper/417:47:494
2291926991211,1cyclictest0-21swapper/416:42:484
2291926991211,1cyclictest0-21swapper/416:11:074
2291926991211,1cyclictest0-21swapper/415:49:504
2291926991210,2cyclictest2849524-21ldconfig19:52:534
229192699120,1cyclictest0-21swapper/419:03:254
229192699120,12cyclictest0-21swapper/418:00:124
229192699120,12cyclictest0-21swapper/417:53:164
229193799118,2cyclictest4175659-21snmpd18:59:027
229193799110,11cyclictest96-21ksoftirqd/720:02:527
229192699119,1cyclictest2340065-21kthreadcore15:42:464
229192699116,4cyclictest2377553-21cat16:02:444
2291926991110,1cyclictest2476894-21kworker/u16:2-events_unbound17:37:474
2291926991110,1cyclictest2299786-21kthreadcore15:22:494
2291926991110,1cyclictest0-21swapper/420:37:394
2291926991110,1cyclictest0-21swapper/419:57:464
2291926991110,1cyclictest0-21swapper/419:13:024
2291926991110,1cyclictest0-21swapper/418:53:014
2291926991110,1cyclictest0-21swapper/418:42:484
2291926991110,1cyclictest0-21swapper/418:22:514
2291926991110,1cyclictest0-21swapper/418:13:084
2291926991110,1cyclictest0-21swapper/417:27:064
2291926991110,1cyclictest0-21swapper/417:27:064
2291926991110,1cyclictest0-21swapper/416:37:464
2291926991110,1cyclictest0-21swapper/416:32:494
2291926991110,1cyclictest0-21swapper/415:39:354
229193799101,2cyclictest0-21swapper/718:07:517
229192699109,1cyclictest0-21swapper/420:47:424
229192699108,1cyclictest2688166-21kworker/u16:3-flush-8:019:22:324
229192699108,1cyclictest2367058-21cstates15:57:404
229192699101,5cyclictest65-21ksoftirqd/419:42:444
229192699100,4cyclictest2669538-21expr18:27:424
229192699100,3cyclictest2478543-21irqcore16:52:444
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional