You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 01:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sat Dec 20, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
360333525320,29sleep70-21swapper/719:05:567
360347524837,8sleep50-21swapper/519:07:555
360389699470,45cyclictest3626909-21latency_hist19:19:307
360389699420,40cyclictest3613442-21latency_hist19:14:307
360334324131,7sleep60-21swapper/619:06:036
360335923929,7sleep40-21swapper/419:06:174
3603896993731,5cyclictest4023537-21latency_hist22:44:297
3603887993432,2cyclictest3985239-21kworker/u16:0+events_unbound23:09:584
3603887993431,2cyclictest3985239-21kworker/u16:0+events_unbound00:04:314
3603887993431,2cyclictest3743323-21kworker/u16:2+flush-8:020:39:314
3603887993129,2cyclictest4100665-21kworker/u16:4+flush-8:023:54:534
3603887993128,2cyclictest3530709-21kworker/u16:1+flush-8:019:24:404
3603896993024,5cyclictest3810705-21latency_hist20:54:297
3603896992928,0cyclictest0-21swapper/720:59:477
3603887992927,2cyclictest4023536-21kworker/u16:1+events_unbound23:31:394
3603887992927,2cyclictest3665911-21kworker/u16:0+events_unbound19:58:404
3603887992927,2cyclictest3665911-21kworker/u16:0+events_unbound19:58:404
3603887992926,2cyclictest3937940-21kworker/u16:4+flush-8:022:34:294
3603887992926,2cyclictest3782015-21kworker/u16:0+flush-8:020:49:394
3603887992925,3cyclictest3530709-21kworker/u16:1+events_unbound20:29:394
3603887992826,2cyclictest4023536-21kworker/u16:1+flush-8:022:53:394
3603887992826,2cyclictest3974207-21kworker/u16:2+events_unbound22:36:404
3603887992826,2cyclictest3849261-21kworker/u16:2+events_unbound21:14:264
3603887992725,2cyclictest4023536-21kworker/u16:1+events_unbound22:47:394
3603887992725,2cyclictest3937940-21kworker/u16:4+flush-8:022:00:594
3603896992620,5cyclictest4004194-21latency_hist22:34:297
3603896992620,5cyclictest3878249-21latency_hist21:29:297
3603887992523,2cyclictest3985239-21kworker/u16:0+events_unbound23:00:314
3603887992523,2cyclictest3782015-21kworker/u16:0+events_unbound21:34:304
3603887992523,2cyclictest3782015-21kworker/u16:0+events_unbound21:15:504
3603887992522,2cyclictest3530709-21kworker/u16:1+events_unbound19:59:394
360389699240,22cyclictest650-21systemd-journal00:19:247
3603887992422,2cyclictest3849261-21kworker/u16:2+events_unbound21:25:404
3603896992322,0cyclictest0-21swapper/723:09:437
3603896992318,4cyclictest4168654-21latency_hist23:59:297
3603887992321,2cyclictest4169047-21kworker/u16:3+events_unbound00:01:394
3603887992321,2cyclictest4100665-21kworker/u16:4+events_unbound23:51:394
3603887992321,2cyclictest3985239-21kworker/u16:0+events_unbound23:18:474
3603887992321,2cyclictest3985239-21kworker/u16:0+events_unbound23:06:404
3603887992321,2cyclictest3985239-21kworker/u16:0+events_unbound22:43:394
3603887992321,2cyclictest3772115-21kworker/u16:3+events_unbound21:01:404
3603891992220,2cyclictest4100665-21kworker/u16:4+flush-8:023:49:546
3603887992220,2cyclictest3772115-21kworker/u16:3+events_unbound21:05:404
3603887992119,2cyclictest3530709-21kworker/u16:1+events_unbound19:11:404
3603887992018,2cyclictest4169047-21kworker/u16:3+events_unbound00:30:034
3603887992018,2cyclictest4100665-21kworker/u16:4+events_unbound23:44:394
3603887992018,2cyclictest4100665-21kworker/u16:4+events_unbound23:23:404
3603887992018,2cyclictest3917047-21kworker/u16:1+events_unbound21:52:424
3603887992018,2cyclictest3782015-21kworker/u16:0+events_unbound21:20:004
3603887992018,2cyclictest13946-21kworker/u16:1+events_unbound00:28:394
3603887991916,2cyclictest3772115-21kworker/u16:3+flush-8:020:54:344
3603896991812,5cyclictest3752613-21latency_hist20:24:307
360389699180,17cyclictest0-21swapper/723:19:527
360389699180,16cyclictest0-21swapper/723:49:527
360389699180,16cyclictest0-21swapper/721:14:557
3603887991816,2cyclictest3906927-21kworker/u16:3+events_unbound22:11:434
3603887991816,2cyclictest3849261-21kworker/u16:2+flush-8:021:44:454
3603887991816,2cyclictest3626949-21kworker/u16:2+events_unbound19:35:444
360388799180,2cyclictest4813-21diskstats00:14:424
360389699170,15cyclictest3897605-21latency_hist21:39:297
360389699170,15cyclictest3733303-21latency_hist20:14:307
360388799170,1cyclictest0-21swapper/423:40:064
360388799170,1cyclictest0-21swapper/423:36:004
360388799170,1cyclictest0-21swapper/422:59:124
360388799170,1cyclictest0-21swapper/422:19:164
360388799170,1cyclictest0-21swapper/422:06:594
360388799170,1cyclictest0-21swapper/421:56:454
360388799170,1cyclictest0-21swapper/421:44:274
360388799170,1cyclictest0-21swapper/421:34:134
360388799170,1cyclictest0-21swapper/420:36:524
360388799170,1cyclictest0-21swapper/420:23:424
360388799170,1cyclictest0-21swapper/420:18:394
360388799170,1cyclictest0-21swapper/420:11:334
360388799170,1cyclictest0-21swapper/419:51:044
360388799170,1cyclictest0-21swapper/419:44:564
360388799170,1cyclictest0-21swapper/419:42:534
360388799170,1cyclictest0-21swapper/419:30:354
360388799170,1cyclictest0-21swapper/419:20:214
360388799170,1cyclictest0-21swapper/400:35:114
360388799170,1cyclictest0-21swapper/400:19:494
360388799170,1cyclictest0-21swapper/400:11:384
3603896991612,3cyclictest1267-21snmpd19:29:237
360388799160,1cyclictest0-21swapper/423:24:444
360388799160,1cyclictest0-21swapper/422:27:284
360388799160,1cyclictest0-21swapper/422:21:194
360388799160,1cyclictest0-21swapper/422:21:194
360388799160,1cyclictest0-21swapper/420:45:044
360388799160,1cyclictest0-21swapper/420:24:394
360388799160,1cyclictest0-21swapper/420:06:264
360388799160,1cyclictest0-21swapper/419:15:144
360389699150,14cyclictest4120466-21turbostat23:34:297
360389699150,13cyclictest1267-21snmpd00:28:487
360389099159,5cyclictest3769379-21grep20:29:515
360389699148,5cyclictest3636553-21latency_hist19:24:307
360389699147,6cyclictest3801012-21latency_hist20:49:297
360389699145,8cyclictest5944-21gmain19:36:107
3603896991410,3cyclictest1267-21snmpd21:54:577
3603896991410,3cyclictest1267-21snmpd00:07:277
360389699140,1cyclictest0-21swapper/720:54:557
360389699140,12cyclictest3742975-21latency_hist20:19:307
3603891991413,1cyclictest0-21swapper/622:14:516
3603891991410,1cyclictest0-21swapper/622:33:086
3603891991410,1cyclictest0-21swapper/621:34:116
360389199140,1cyclictest0-21swapper/621:34:536
360389099140,1cyclictest0-21swapper/520:49:525
360389099140,14cyclictest0-21swapper/521:54:495
360389699139,3cyclictest96-21ksoftirqd/721:09:517
360389699139,3cyclictest1267-21snmpd22:58:207
360389699139,3cyclictest1267-21snmpd22:54:227
360389699139,3cyclictest1267-21snmpd21:46:457
360389699139,3cyclictest1267-21snmpd21:43:367
360389699137,5cyclictest4139746-21latency_hist23:44:287
3603896991310,2cyclictest0-21swapper/721:24:297
360389699130,2cyclictest3965869-21/usr/sbin/munin22:14:547
360389699130,2cyclictest0-21swapper/720:34:547
360389699130,1cyclictest0-21swapper/721:04:567
360389699130,11cyclictest1267-21snmpd20:00:217
360389099139,3cyclictest4121632-21cat23:34:445
360389099133,4cyclictest4110060-21cat23:24:585
3603890991312,1cyclictest0-21swapper/523:42:395
360389699129,2cyclictest1267-21snmpd22:34:587
360389699129,2cyclictest1267-21snmpd22:20:167
360389699129,2cyclictest1267-21snmpd22:20:167
360389699129,2cyclictest1267-21snmpd21:50:007
360389699129,2cyclictest1267-21snmpd19:50:007
360389699128,3cyclictest1267-21snmpd23:09:147
360389699128,3cyclictest1267-21snmpd00:19:307
360389699128,3cyclictest1267-21snmpd00:10:577
360389699127,4cyclictest1267-21snmpd23:04:177
360389699126,5cyclictest42891-21latency_hist00:34:287
360389699124,7cyclictest6184-21gvfs-afc-volume19:44:537
360389699121,2cyclictest3674243-21ntpq19:39:537
360389699120,2cyclictest0-21swapper/719:29:497
360389199129,2cyclictest3683870-21head19:44:526
360389199128,3cyclictest3705434-21cat19:59:456
3603891991211,1cyclictest0-21swapper/623:24:236
3603891991211,1cyclictest0-21swapper/623:04:406
3603891991211,1cyclictest0-21swapper/620:50:406
3603891991211,1cyclictest0-21swapper/619:34:596
360389199120,1cyclictest0-21swapper/622:56:476
360389199120,12cyclictest0-21swapper/621:20:186
360389199120,11cyclictest0-21swapper/620:34:356
360389099123,8cyclictest3703233-21uname19:54:525
360389099123,8cyclictest3703233-21uname19:54:525
360389099123,4cyclictest4031589-21kthreadcore22:44:505
360389099123,3cyclictest12988-21cat00:14:535
360389099122,4cyclictest3634500-21cut19:19:485
3603890991210,2cyclictest0-21swapper/522:39:075
360389699118,2cyclictest1267-21snmpd20:41:407
360389699118,2cyclictest1267-21snmpd20:05:037
360389699118,2cyclictest0-21swapper/723:14:557
360389699118,2cyclictest0-21swapper/722:04:527
360389699117,3cyclictest1267-21snmpd23:59:517
360389699117,3cyclictest1267-21snmpd23:34:387
360389699117,3cyclictest1267-21snmpd20:24:317
360389699116,4cyclictest6045-21gmain22:44:507
360389699114,6cyclictest6045-21gmain22:09:447
360389699110,3cyclictest4149707-21latency_hist23:49:297
360389199117,3cyclictest4082872-21cat23:14:476
360389199117,3cyclictest3666716-21cat19:39:446
3603891991110,1cyclictest0-21swapper/623:26:166
3603891991110,1cyclictest0-21swapper/620:30:576
3603891991110,1cyclictest0-21swapper/619:49:396
3603891991110,1cyclictest0-21swapper/619:14:116
360389199110,1cyclictest0-21swapper/622:52:516
360389199110,11cyclictest0-21swapper/623:46:086
360389199110,11cyclictest0-21swapper/623:00:446
360389199110,11cyclictest0-21swapper/622:48:546
360389199110,11cyclictest0-21swapper/621:55:096
360389199110,11cyclictest0-21swapper/600:25:236
360389099117,3cyclictest3956957-21cat22:09:455
360389099116,4cyclictest0-21swapper/522:24:505
360389099116,4cyclictest0-21swapper/519:34:515
360389099115,5cyclictest5747-21gnome-shell00:31:395
360389099114,6cyclictest3860634-21cut21:19:455
360389099114,6cyclictest3821953-21kthreadcore20:59:485
360389099113,7cyclictest4155665-21cut23:49:485
360389099113,7cyclictest3831172-21cat21:04:455
360389099113,7cyclictest3722960-21wc20:04:585
360389099113,4cyclictest3737217-21cut20:14:505
360389099113,3cyclictest4075047-21grep23:09:475
360389099113,3cyclictest4053768-21cat22:59:455
360389099113,3cyclictest4038423-21cut22:49:475
360389099113,3cyclictest3851748-21grep21:14:485
360389099113,3cyclictest3747674-21cut20:19:495
360389099113,3cyclictest3651390-21tr19:29:485
360389099112,4cyclictest4145915-21cut23:44:505
360389099112,4cyclictest4082334-21grep23:14:445
360389099112,4cyclictest4048882-21kthreadcore22:54:505
360389099112,4cyclictest4015107-21irqcore22:39:465
360389099112,4cyclictest3772416-21cat20:34:425
360389099112,4cyclictest3706831-21kthreadcore19:59:475
360389099112,4cyclictest3605840-21cut19:09:455
360389099112,3cyclictest3758327-21kthreadcore20:24:495
3603890991110,1cyclictest0-21swapper/523:33:495
3603890991110,1cyclictest0-21swapper/522:22:055
3603890991110,1cyclictest0-21swapper/522:22:055
3603890991110,1cyclictest0-21swapper/522:16:345
3603890991110,1cyclictest0-21swapper/520:09:495
3603890991110,1cyclictest0-21swapper/500:20:105
360389099110,1cyclictest0-21swapper/522:00:115
360389099110,1cyclictest0-21swapper/521:12:535
360389099110,1cyclictest0-21swapper/519:43:485
360389099110,11cyclictest0-21swapper/521:53:055
360389099110,11cyclictest0-21swapper/521:30:045
360389099110,11cyclictest0-21swapper/521:26:365
360389699107,2cyclictest0-21swapper/720:29:547
360389699106,3cyclictest6053-21gmain22:27:427
360389699104,5cyclictest6184-21gvfs-afc-volume21:29:497
360389699103,6cyclictest0-21swapper/721:59:447
360389699100,9cyclictest0-21swapper/723:24:557
360389699100,8cyclictest0-21swapper/719:54:457
360389699100,8cyclictest0-21swapper/719:54:457
360389699100,5cyclictest43280-21sshd-session00:34:407
360389199109,1cyclictest0-21swapper/623:59:046
360389199109,1cyclictest0-21swapper/622:27:376
360389199109,1cyclictest0-21swapper/622:11:136
360389199109,1cyclictest0-21swapper/621:53:256
360389199109,1cyclictest0-21swapper/620:13:466
360389199109,1cyclictest0-21swapper/619:58:196
360389199109,1cyclictest0-21swapper/619:58:196
360389199109,1cyclictest0-21swapper/619:28:326
360389199109,1cyclictest0-21swapper/619:24:166
360389199109,1cyclictest0-21swapper/600:09:566
360389199109,1cyclictest0-21swapper/600:01:076
360389199105,4cyclictest0-21swapper/600:14:466
360389199100,0cyclictest0-21swapper/621:03:366
360389099108,2cyclictest0-21swapper/500:04:345
360389099106,3cyclictest0-21swapper/522:29:485
360389099105,4cyclictest0-21swapper/523:54:425
360389099105,4cyclictest0-21swapper/523:19:435
360389099104,5cyclictest3902778-21kthreadcore21:39:485
360389099104,5cyclictest0-21swapper/519:24:445
360389099103,3cyclictest3617791-21wc19:14:435
360389099103,2cyclictest3889018-21fschecks_time21:34:455
360389099102,4cyclictest4171535-21kthreadcore23:59:495
360389099102,4cyclictest3908059-21cat21:44:425
360389099102,3cyclictest4071477-21timerwakeupswit23:04:575
360389099102,3cyclictest24569-21cut00:24:435
360389099101,4cyclictest3812088-21sed20:54:475
360389099101,2cyclictest43421-21cpuspeed_turbos00:34:415
360389099100,4cyclictest4189131-21fschecks_time00:09:435
360389099100,4cyclictest3948077-21cut22:04:455
360389099100,4cyclictest3792721-21ps20:44:455
360389099100,4cyclictest3782350-21cstates20:39:405
360389099100,4cyclictest3686046-21hwlatdetect19:49:445
360389099100,4cyclictest3676066-21cstates19:44:435
36038919998,1cyclictest0-21swapper/622:42:556
36038919998,1cyclictest0-21swapper/622:24:006
36038919998,1cyclictest0-21swapper/622:24:006
36038919998,1cyclictest0-21swapper/620:29:136
36038919998,1cyclictest0-21swapper/620:17:056
36038919998,1cyclictest0-21swapper/620:09:226
36038919998,1cyclictest0-21swapper/600:05:316
36038919997,1cyclictest0-21swapper/621:04:496
36038919995,3cyclictest3852807-21kthreadcore21:14:486
36038919990,8cyclictest15177-21sed00:19:476
36038919987,1cyclictest0-21swapper/623:41:436
36038919987,1cyclictest0-21swapper/622:38:586
36038919987,1cyclictest0-21swapper/622:02:146
36038919987,1cyclictest0-21swapper/619:30:356
36038919986,1cyclictest0-21swapper/623:29:416
36038919985,2cyclictest0-21swapper/623:34:506
36038919984,3cyclictest3952065-21kthreadcore22:04:486
36038919984,3cyclictest3912601-21cut21:44:496
36038919984,3cyclictest3623519-21cut19:14:516
36038919983,4cyclictest4076842-21cut23:09:486
36038919983,4cyclictest3870139-21sed21:24:466
36038919983,4cyclictest38144-21kthreadcore00:29:506
36038919973,3cyclictest3898418-21ls21:39:416
36038919973,3cyclictest3792479-21cat20:44:446
36038919973,3cyclictest3743887-21grep20:19:446
36038919972,4cyclictest45643-21grep00:34:466
36038919972,4cyclictest3841262-21sort21:09:466
36038919972,4cyclictest3811210-21cat20:54:436
36038919972,4cyclictest3785824-21cat20:39:466
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional