You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 15:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Sat Dec 20, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
209040326048,8sleep60-21swapper/607:07:046
208133225542,8sleep50-21swapper/507:04:385
209050925419,31sleep70-21swapper/707:08:337
209039224736,8sleep40-21swapper/407:06:544
2090879993731,4cyclictest2288249-21latency_hist08:49:277
2090879993529,5cyclictest2685654-21latency_hist12:14:277
2090876993128,2cyclictest1355985-21kworker/u16:5+flush-8:008:34:586
2090879992923,5cyclictest650-21systemd-journal11:44:277
2090876992927,2cyclictest2500386-21kworker/u16:3+flush-8:011:44:226
2090876992926,2cyclictest2423545-21kworker/u16:4+events_unbound10:39:426
2090871992825,2cyclictest2006655-21kworker/u16:3+flush-8:007:49:435
2090863992723,3cyclictest2626505-21kworker/u16:1+flush-8:011:49:584
2090876992624,2cyclictest2258279-21kworker/u16:1+flush-8:008:54:556
2090876992623,2cyclictest2142067-21kworker/u16:2+events_unbound07:39:416
2090876992421,2cyclictest1355985-21kworker/u16:5+flush-8:008:04:446
2090863992321,2cyclictest1355985-21kworker/u16:5+flush-8:007:44:544
2090879992213,8cyclictest650-21systemd-journal12:39:277
2090871992220,2cyclictest2414110-21kworker/u16:1+events_unbound10:09:425
2090876992119,2cyclictest2142067-21kworker/u16:2+events_unbound08:14:406
2090876992017,2cyclictest2345540-21kworker/u16:3+flush-8:009:29:536
2090879991913,5cyclictest2608038-21latency_hist11:34:277
2090876991917,2cyclictest2659413-21kworker/u16:0+flush-8:012:19:226
2090876991917,2cyclictest2659413-21kworker/u16:0+flush-8:012:19:226
2090876991917,2cyclictest2500386-21kworker/u16:3+flush-8:011:34:426
2090871991916,2cyclictest2006655-21kworker/u16:3+events_unbound07:09:435
2090871991915,3cyclictest2527092-21kworker/u16:2+flush-8:010:54:585
2090876991816,2cyclictest2695191-21kworker/u16:1+events_unbound12:19:446
2090876991816,2cyclictest2500386-21kworker/u16:3+events_unbound11:44:416
209087999177,2cyclictest6053-21gmain09:09:257
2090879991715,1cyclictest0-21swapper/707:39:527
2090879991711,5cyclictest2210860-21latency_hist08:09:277
2090876991715,2cyclictest2162790-21kworker/u16:1+events_unbound07:54:506
2090876991715,2cyclictest2142067-21kworker/u16:2+flush-8:008:19:586
2090876991714,2cyclictest2659413-21kworker/u16:0+flush-8:012:09:586
2090876991614,2cyclictest2527092-21kworker/u16:2+events_unbound10:49:566
2090876991613,2cyclictest2685434-21kworker/u16:2+flush-8:012:29:426
2090876991613,2cyclictest2511450-21kworker/u16:0+events_unbound10:44:416
2090863991613,2cyclictest2511450-21kworker/u16:0+flush-8:010:44:534
209087999159,5cyclictest2695342-21latency_hist12:19:277
209087999159,5cyclictest2695342-21latency_hist12:19:277
209087999159,5cyclictest2259217-21latency_hist08:34:287
209087999159,5cyclictest1267-21snmpd12:32:127
209087999159,5cyclictest1267-21snmpd10:30:067
209087999159,5cyclictest1267-21snmpd10:21:067
209087999152,6cyclictest5944-21gmain10:24:537
2090879991511,3cyclictest1267-21snmpd07:17:527
209087999150,9cyclictest0-21swapper/712:24:477
209087999150,1cyclictest0-21swapper/712:19:497
209087999150,13cyclictest0-21swapper/711:44:527
209087999150,13cyclictest0-21swapper/710:49:527
209087999150,13cyclictest0-21swapper/707:44:537
2090876991513,2cyclictest2626505-21kworker/u16:1+flush-8:012:09:216
2090876991513,2cyclictest2404244-21kworker/u16:3+flush-8:009:54:226
209087199150,14cyclictest0-21swapper/512:09:425
2090863991512,2cyclictest2403592-21ntpq09:44:524
209087999148,5cyclictest2540188-21latency_hist10:59:277
209087999146,7cyclictest2201171-21latency_hist08:04:277
209087999145,2cyclictest1342811-21gmain09:24:507
2090879991411,2cyclictest0-21swapper/708:34:287
209087999140,8cyclictest0-21swapper/708:14:557
209087999140,1cyclictest0-21swapper/711:19:527
209087999140,13cyclictest0-21swapper/707:19:527
2090876991412,2cyclictest2530137-21kworker/u16:4+flush-8:010:59:256
2090876991412,2cyclictest2467189-21kworker/u16:2+events_unbound10:24:516
2090876991412,2cyclictest2414110-21kworker/u16:1+flush-8:009:54:546
2090876991412,2cyclictest2249223-21kworker/u16:0+flush-8:008:34:286
209087699140,1cyclictest2142009-21strings07:29:526
209087699140,13cyclictest23464142sleep609:19:076
2090871991412,2cyclictest2296998-21kworker/u16:4+flush-8:009:09:555
2090871991410,3cyclictest2258279-21kworker/u16:1+flush-8:008:54:465
209087199140,14cyclictest0-21swapper/507:29:555
209086399140,14cyclictest0-21swapper/410:14:494
209087999139,3cyclictest2240252-21/usr/sbin/munin08:24:517
209087999139,3cyclictest1267-21snmpd11:24:467
209087999139,3cyclictest1267-21snmpd11:24:467
209087999139,3cyclictest1267-21snmpd10:05:567
209087999139,3cyclictest1267-21snmpd08:54:107
209087999137,5cyclictest1267-21snmpd12:02:117
209087999137,5cyclictest1267-21snmpd09:53:567
209087999137,5cyclictest1267-21snmpd07:11:077
209087999135,7cyclictest6344-21gmain09:39:497
209087999135,3cyclictest5944-21gmain11:05:497
209087999134,8cyclictest0-21swapper/707:29:147
209087999130,6cyclictest1551644-21dockerd12:04:437
209087999130,12cyclictest96-21ksoftirqd/707:49:427
209087999130,12cyclictest0-21swapper/709:14:567
209087999130,11cyclictest2655245-21kthreadcore11:54:507
2090876991312,1cyclictest0-21swapper/611:24:276
2090876991312,1cyclictest0-21swapper/611:24:276
2090876991311,2cyclictest2500386-21kworker/u16:3+flush-8:011:54:276
2090876991311,2cyclictest2414110-21kworker/u16:1+flush-8:011:09:276
2090876991311,2cyclictest2355825-21kworker/u16:1+events_unbound09:24:576
2090876991310,2cyclictest2540156-21kworker/u16:0+flush-8:010:59:386
209087699130,0cyclictest0-21swapper/608:09:456
209087699130,0cyclictest0-21swapper/608:09:456
209087199139,3cyclictest2414110-21kworker/u16:1+flush-8:011:24:585
209087199139,3cyclictest2414110-21kworker/u16:1+flush-8:011:24:585
2090863991312,1cyclictest0-21swapper/412:29:554
2090863991312,1cyclictest0-21swapper/409:29:534
2090863991312,1cyclictest0-21swapper/408:34:234
209086399130,13cyclictest0-21swapper/407:20:364
209087999129,2cyclictest1267-21snmpd08:14:037
209087999129,2cyclictest1267-21snmpd08:14:037
209087999128,3cyclictest1267-21snmpd11:15:347
209087999128,3cyclictest1267-21snmpd09:37:597
209087999128,3cyclictest1267-21snmpd08:19:457
209087999128,3cyclictest1267-21snmpd07:29:467
209087999127,4cyclictest1267-21snmpd10:45:517
209087999127,4cyclictest1267-21snmpd08:39:517
209087999126,5cyclictest6184-21gvfs-afc-volume09:09:477
209087999126,5cyclictest6045-21gmain11:49:497
209087999126,5cyclictest1267-21snmpd10:40:007
209087999126,5cyclictest1267-21snmpd09:20:017
209087999125,5cyclictest902-21dbus-daemon10:59:397
209087999124,7cyclictest2433459-21sshd-session10:02:387
209087999123,2cyclictest6045-21gmain10:09:457
209087999122,3cyclictest6053-21gmain09:29:417
209087999120,4cyclictest2454272-21irqcore10:14:457
209087699129,2cyclictest2278972-21kworker/u16:3+flush-8:008:44:546
209087699128,3cyclictest2394666-21kworker/u16:1+events_unbound09:44:416
2090876991210,2cyclictest2646542-21kworker/u16:2+flush-8:011:59:496
209087699120,1cyclictest0-21swapper/612:25:476
209087699120,1cyclictest0-21swapper/610:38:066
209087199128,3cyclictest2473531-21cat10:24:435
2090871991211,1cyclictest0-21swapper/507:24:525
2090863991211,1cyclictest0-21swapper/410:31:504
2090863991211,1cyclictest0-21swapper/410:08:314
2090863991211,1cyclictest0-21swapper/408:38:394
209086399120,1cyclictest0-21swapper/409:53:414
209087999118,2cyclictest1267-21snmpd09:47:087
209087999118,2cyclictest0-21swapper/708:59:507
209087999118,2cyclictest0-21swapper/708:59:507
209087999113,2cyclictest1238-21tuned-ppd08:54:497
209087999112,7cyclictest0-21swapper/707:34:307
209087999110,4cyclictest1060-21runrttasks11:09:417
209087999110,10cyclictest2500260-21missed_timers10:34:517
209087699119,2cyclictest2500386-21kworker/u16:3+events_unbound11:19:406
209087699119,2cyclictest2414110-21kworker/u16:1+events_unbound10:09:446
209087699119,2cyclictest1355985-21kworker/u16:5+events_unbound07:59:546
2090876991110,1cyclictest0-21swapper/611:11:416
2090876991110,1cyclictest0-21swapper/610:20:556
2090876991110,1cyclictest0-21swapper/610:16:406
2090876991110,1cyclictest0-21swapper/610:06:066
2090876991110,1cyclictest0-21swapper/609:10:376
209087699110,1cyclictest0-21swapper/607:37:176
209087699110,11cyclictest0-21swapper/612:39:026
209087699110,11cyclictest0-21swapper/609:04:186
209087699110,11cyclictest0-21swapper/609:04:186
209087699110,0cyclictest0-21swapper/607:20:066
209087199119,2cyclictest2730085-21kthreadcore12:34:495
209087199117,3cyclictest2648032-21cat11:54:435
209087199117,3cyclictest2415396-21cat09:54:435
2090871991110,1cyclictest0-21swapper/511:44:035
2090871991110,1cyclictest0-21swapper/510:39:345
2090871991110,1cyclictest0-21swapper/510:09:185
2090871991110,1cyclictest0-21swapper/509:14:455
2090871991110,1cyclictest0-21swapper/508:28:435
2090871991110,1cyclictest0-21swapper/508:19:445
2090871991110,1cyclictest0-21swapper/507:37:295
209087199110,11cyclictest0-21swapper/510:22:145
209087199110,11cyclictest0-21swapper/509:47:235
209087199110,11cyclictest0-21swapper/509:34:185
209087199110,11cyclictest0-21swapper/509:25:385
209087199110,11cyclictest0-21swapper/509:06:145
209087199110,11cyclictest0-21swapper/508:37:335
209087199110,11cyclictest0-21swapper/508:00:585
209086399116,4cyclictest2376708-21cat09:34:424
2090863991110,1cyclictest0-21swapper/411:24:304
2090863991110,1cyclictest0-21swapper/411:24:304
2090863991110,1cyclictest0-21swapper/410:52:494
2090863991110,1cyclictest0-21swapper/410:23:204
2090863991110,1cyclictest0-21swapper/409:17:164
2090863991110,1cyclictest0-21swapper/408:55:504
2090863991110,1cyclictest0-21swapper/407:35:454
209086399110,11cyclictest0-21swapper/411:41:134
209086399110,11cyclictest0-21swapper/411:30:484
209086399110,11cyclictest0-21swapper/411:01:104
209086399110,11cyclictest0-21swapper/410:10:334
209086399110,11cyclictest0-21swapper/408:51:344
209086399110,11cyclictest0-21swapper/407:40:004
209087999107,2cyclictest0-21swapper/711:34:507
209087999106,3cyclictest1267-21snmpd09:55:447
209087999102,7cyclictest5777-21gmain07:54:457
209087699109,1cyclictest0-21swapper/609:08:346
209087699109,1cyclictest0-21swapper/607:48:386
209087699108,2cyclictest2258279-21kworker/u16:1+flush-8:008:44:236
209087699106,3cyclictest2347564-21tune2fs09:19:426
209087699100,9cyclictest0-21swapper/607:24:476
209087199109,1cyclictest0-21swapper/512:22:415
209087199109,1cyclictest0-21swapper/512:07:325
209087199109,1cyclictest0-21swapper/511:52:345
209087199109,1cyclictest0-21swapper/511:46:065
209087199109,1cyclictest0-21swapper/509:36:215
209087199109,1cyclictest0-21swapper/508:15:195
209087199109,1cyclictest0-21swapper/508:13:075
209087199109,1cyclictest0-21swapper/508:13:075
209087199109,1cyclictest0-21swapper/508:08:135
209087199106,3cyclictest2580186-21cat11:19:425
209087199106,3cyclictest2500386-21kworker/u16:3+events_unbound11:04:555
209087199105,4cyclictest2182897-21tune2fs07:54:435
209087199105,4cyclictest2115130-21cat07:19:445
209087199100,10cyclictest0-21swapper/509:04:025
209087199100,10cyclictest0-21swapper/509:04:025
209087199100,0cyclictest0-21swapper/508:53:005
209086399109,1cyclictest0-21swapper/412:14:474
209086399109,1cyclictest0-21swapper/412:14:474
209086399109,1cyclictest0-21swapper/412:12:444
209086399109,1cyclictest0-21swapper/410:38:094
209086399109,1cyclictest0-21swapper/410:25:234
209086399109,1cyclictest0-21swapper/410:02:124
209086399109,1cyclictest0-21swapper/409:55:444
209086399109,1cyclictest0-21swapper/407:51:214
209086399105,4cyclictest2657730-21cat11:59:424
209086399105,4cyclictest2124861-21cat07:24:474
209086399100,10cyclictest0-21swapper/411:11:444
20908769998,1cyclictest0-21swapper/611:30:466
20908769997,2cyclictest1355985-21kworker/u16:5+events_unbound07:14:306
20908769995,3cyclictest2390611-21kthreadcore09:39:496
20908769995,3cyclictest2289425-21cat08:49:446
20908719998,1cyclictest0-21swapper/512:33:525
20908719998,1cyclictest0-21swapper/512:03:175
20908719998,1cyclictest0-21swapper/511:11:445
20908719998,1cyclictest0-21swapper/508:48:355
20908719998,1cyclictest0-21swapper/508:44:105
20908719997,2cyclictest2289167-21kworker/u16:0+events_unbound09:59:425
20908719996,2cyclictest0-21swapper/510:29:565
20908719995,3cyclictest2289167-21kworker/u16:0+flush-8:009:39:375
20908639998,1cyclictest0-21swapper/412:36:334
20908639998,1cyclictest0-21swapper/411:34:544
20908639998,1cyclictest0-21swapper/410:59:074
20908639998,1cyclictest0-21swapper/409:08:554
20908639996,2cyclictest0-21swapper/412:19:504
20908639995,3cyclictest2500386-21kworker/u16:3+flush-8:011:04:564
20908639995,3cyclictest2237556-21kthreadcore08:19:494
20908639995,3cyclictest2211824-21tune2fs08:09:434
20908639995,3cyclictest2211824-21tune2fs08:09:434
20908639994,4cyclictest2570473-21cat11:14:434
20908639994,4cyclictest2142422-21grep07:29:594
20908639993,2cyclictest201rcu_preempt08:18:244
20908639990,6cyclictest2197388-21kthreadcore07:59:494
20908639990,1cyclictest0-21swapper/409:29:224
20908769987,1cyclictest0-21swapper/608:25:126
20908769987,1cyclictest0-21swapper/607:50:506
20908769986,2cyclictest2500386-21kworker/u16:3+flush-8:011:14:436
20908769986,1cyclictest0-21swapper/609:59:406
20908769983,4cyclictest2488453-21cut10:29:486
20908719987,1cyclictest0-21swapper/511:37:355
20908719985,2cyclictest2153615-21df07:39:415
20908719985,2cyclictest2109001-21kthreadcore07:14:475
20908719985,2cyclictest0-21swapper/512:24:465
20908719984,4cyclictest0-21swapper/510:49:435
20908719983,4cyclictest2693167-21cut12:14:485
20908719983,4cyclictest2693167-21cut12:14:485
20908719983,4cyclictest2607418-21timerandwakeup11:29:555
20908719983,4cyclictest2350955-21grep09:19:475
20908639986,1cyclictest0-21swapper/408:39:484
20908639985,2cyclictest2099490-21ntpq07:09:534
20908639985,2cyclictest0-21swapper/410:39:514
20908639984,3cyclictest2241257-21irqcore08:24:454
20908639984,3cyclictest2202020-21cstates08:04:414
20908639984,3cyclictest2187978-21cut07:54:484
20908639983,4cyclictest2706754-21kthreadcore12:24:454
20908639983,4cyclictest2347412-21tune2fs09:19:424
20908639983,4cyclictest2331485-21cut09:09:474
20908639983,4cyclictest2103638-21cat07:14:314
20908769975,1cyclictest0-21swapper/609:34:396
20908769975,1cyclictest0-21swapper/607:09:456
20908769974,2cyclictest2647529-21cstates11:54:406
20908719975,1cyclictest0-21swapper/511:14:405
20908719974,2cyclictest2512019-21fschecks_count10:44:415
20908719974,2cyclictest2250453-21fschecks_count08:29:435
20908719974,2cyclictest2163620-21ip_192.168.115.07:44:455
20908719973,3cyclictest2492904-21cat10:34:435
20908719973,3cyclictest2453735-21expr10:14:415
20908719973,3cyclictest2404937-21cpu09:49:435
20908719972,4cyclictest6077-21gdbus10:59:295
20908639975,1cyclictest0-21swapper/411:54:414
20908639975,1cyclictest0-21swapper/409:39:494
20908639973,3cyclictest2666876-21expr12:04:384
20908639973,3cyclictest2310744-21kthreadcore08:59:454
20908639973,3cyclictest2310744-21kthreadcore08:59:454
20908639973,3cyclictest2279004-21cpu08:44:404
20908639972,4cyclictest2628174-21expr11:44:414
20908639972,4cyclictest2581709-21kthreadcore11:19:454
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional