You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 12:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Wed Dec 10, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
194457427546,7sleep40-21swapper/403:21:064
1944981995956,2cyclictest2119612-21kworker/u16:0+flush-8:005:17:214
1944981995956,2cyclictest2119612-21kworker/u16:0+flush-8:005:17:214
194462125646,7sleep60-21swapper/603:21:496
193578225419,29sleep70-21swapper/703:17:417
1944992995246,5cyclictest2603316-21latency_hist08:47:207
1944992995146,4cyclictest589235-21systemd-journal07:02:217
194446625040,7sleep50-21swapper/503:19:395
1944992994843,4cyclictest2059515-21latency_hist04:17:217
1944981994543,2cyclictest2270876-21kworker/u16:0+flush-8:006:22:214
1944992994237,4cyclictest2512561-21latency_hist08:02:217
1944992994237,4cyclictest2150123-21latency_hist05:02:217
1944992993932,5cyclictest589235-21systemd-journal08:14:027
1944981993937,2cyclictest1998946-21kworker/u16:2+flush-8:004:27:524
1944981993937,2cyclictest1998946-21kworker/u16:2+flush-8:004:27:524
1944981993836,2cyclictest2099635-21kworker/u16:3+events_unbound05:37:474
1944992993328,4cyclictest589235-21systemd-journal05:42:227
194499299320,30cyclictest2381720-21latency_hist06:57:217
1944981993230,2cyclictest2119612-21kworker/u16:0+events_unbound05:17:514
1944992993025,4cyclictest2401829-21latency_hist07:07:217
1944992993024,5cyclictest2119928-21latency_hist04:47:227
1944981993029,1cyclictest2583050-21kworker/u16:0+flush-8:008:52:204
1944981993028,2cyclictest2432434-21kworker/u16:4+events_unbound08:22:384
1944981993027,2cyclictest2059191-21kworker/u16:3+flush-8:004:22:434
1944981993026,3cyclictest2190504-21kworker/u16:1+events_unbound06:02:404
1944992992927,1cyclictest0-21swapper/704:00:287
1944992992923,5cyclictest2502508-21latency_hist07:57:217
194499299280,26cyclictest2210606-21latency_hist05:32:227
1944987992826,2cyclictest1998946-21kworker/u16:2+events_unbound04:27:415
1944987992826,2cyclictest1998946-21kworker/u16:2+events_unbound04:27:415
1944987992824,3cyclictest2170034-21kworker/u16:2+flush-8:005:24:225
194499299270,25cyclictest2281166-21latency_hist06:07:217
1944992992625,0cyclictest0-21swapper/708:47:377
1944987992624,2cyclictest2300955-21kworker/u16:3+events_unbound06:47:395
1944987992623,2cyclictest2099635-21kworker/u16:3+flush-8:005:32:365
1944981992623,2cyclictest2150511-21kworker/u16:1+events_unbound05:07:454
1944992992524,0cyclictest0-21swapper/707:25:197
1944992992524,0cyclictest0-21swapper/704:25:277
1944992992524,0cyclictest0-21swapper/703:24:227
1944992992520,4cyclictest2331471-21latency_hist06:32:217
194499299250,23cyclictest2140046-21latency_hist04:57:227
1944981992522,2cyclictest2472018-21kworker/u16:1+flush-8:007:57:424
1944992992423,0cyclictest0-21swapper/703:36:597
1944987992422,2cyclictest1944452-21kworker/u16:3+flush-8:003:42:365
1944981992422,2cyclictest2099635-21kworker/u16:3+flush-8:005:02:444
1944992992322,0cyclictest0-21swapper/705:15:197
1944992992322,0cyclictest0-21swapper/705:15:197
1944992992321,1cyclictest0-21swapper/707:47:477
1944992992321,1cyclictest0-21swapper/704:17:357
1944992992318,4cyclictest2049491-21cut04:12:227
1944990992321,2cyclictest2190504-21kworker/u16:1+flush-8:006:42:526
1944981992321,2cyclictest2431860-21kworker/u16:3+flush-8:008:02:434
1944981992321,2cyclictest2099635-21kworker/u16:3+events_unbound04:42:404
1944992992221,0cyclictest0-21swapper/706:10:557
1944992992220,1cyclictest0-21swapper/707:17:497
1944992992217,4cyclictest2522640-21latency_hist08:07:217
194499299220,20cyclictest589235-21systemd-journal04:48:027
1944987992220,2cyclictest1998946-21kworker/u16:2+flush-8:004:07:365
1944981992218,3cyclictest1878761-21kworker/u16:0+flush-8:003:49:324
1944992992120,0cyclictest0-21swapper/706:40:547
194499299210,19cyclictest1968927-21latency_hist03:32:217
1944987992115,6cyclictest2562730-21kworker/u16:1+flush-8:008:25:105
1944981992119,2cyclictest2432434-21kworker/u16:4+flush-8:007:22:504
1944981992119,2cyclictest2119612-21kworker/u16:0+flush-8:005:47:384
1944981992119,2cyclictest1998946-21kworker/u16:2+flush-8:004:47:504
1944981992118,2cyclictest2190504-21kworker/u16:1+flush-8:006:45:044
1944981992118,2cyclictest1998946-21kworker/u16:2+flush-8:004:17:494
20887642200,1chrt2088762-21ntpq04:27:517
20887642200,1chrt2088762-21ntpq04:27:517
1944992992014,5cyclictest2321392-21latency_hist06:27:227
1944987992018,2cyclictest2221378-21kworker/u16:4+flush-8:006:02:465
1944981992018,2cyclictest2391431-21kworker/u16:2+flush-8:007:12:524
1944981992017,2cyclictest2401657-21kworker/u16:0+flush-8:007:17:484
1944981992016,3cyclictest2432434-21kworker/u16:4+flush-8:007:32:484
1944992991918,0cyclictest0-21swapper/707:40:467
1944992991918,0cyclictest0-21swapper/707:07:387
1944992991918,0cyclictest0-21swapper/705:59:427
1944992991918,0cyclictest0-21swapper/705:02:387
1944990991915,3cyclictest1998946-21kworker/u16:2+flush-8:004:27:476
1944990991915,3cyclictest1998946-21kworker/u16:2+flush-8:004:27:476
1944987991917,2cyclictest2300955-21kworker/u16:3+flush-8:006:27:475
1944981991917,2cyclictest2432434-21kworker/u16:4+flush-8:008:40:034
1944981991917,2cyclictest2432434-21kworker/u16:4+flush-8:007:54:554
1944981991917,2cyclictest2270876-21kworker/u16:0+events_unbound06:57:434
1944981991917,2cyclictest1944452-21kworker/u16:3+events_unbound03:37:424
1944981991916,3cyclictest1998946-21kworker/u16:2+flush-8:004:09:334
1944981991916,2cyclictest2190504-21kworker/u16:1+flush-8:006:37:424
1944981991916,2cyclictest1998946-21kworker/u16:2+flush-8:004:33:334
1944992991817,0cyclictest0-21swapper/705:50:157
1944992991817,0cyclictest0-21swapper/705:37:047
1944992991817,0cyclictest0-21swapper/705:24:187
1944992991817,0cyclictest0-21swapper/703:52:597
1944992991816,1cyclictest0-21swapper/706:14:407
1944992991816,1cyclictest0-21swapper/705:07:537
1944987991815,2cyclictest2432434-21kworker/u16:4+flush-8:007:37:365
194498799180,4cyclictest0-21swapper/505:07:275
1944981991814,3cyclictest2522469-21kworker/u16:2+flush-8:008:10:044
1944992991716,0cyclictest0-21swapper/708:32:237
1944992991716,0cyclictest0-21swapper/707:28:117
1944992991716,0cyclictest0-21swapper/706:44:557
1944992991716,0cyclictest0-21swapper/705:18:447
1944992991716,0cyclictest0-21swapper/704:35:137
194499299170,15cyclictest2545694-21grep08:17:437
1944987991715,2cyclictest2522469-21kworker/u16:2+flush-8:008:07:205
1944981991715,2cyclictest2109511-21kworker/u16:4+flush-8:004:52:424
194498199170,1cyclictest0-21swapper/408:46:334
194498199170,1cyclictest0-21swapper/408:13:514
194498199170,1cyclictest0-21swapper/407:48:194
194498199170,1cyclictest0-21swapper/407:47:184
194498199170,1cyclictest0-21swapper/407:42:104
194498199170,1cyclictest0-21swapper/407:28:524
194498199170,1cyclictest0-21swapper/407:09:244
194498199170,1cyclictest0-21swapper/407:04:174
194498199170,1cyclictest0-21swapper/406:56:064
194498199170,1cyclictest0-21swapper/406:47:544
194498199170,1cyclictest0-21swapper/405:59:474
194498199170,1cyclictest0-21swapper/405:54:404
194498199170,1cyclictest0-21swapper/405:45:274
194498199170,1cyclictest0-21swapper/405:33:094
1944992991615,0cyclictest0-21swapper/708:11:457
1944992991615,0cyclictest0-21swapper/707:14:047
1944992991614,1cyclictest0-21swapper/706:34:277
1944992991610,5cyclictest2240881-21latency_hist05:47:217
1944987991614,2cyclictest2522469-21kworker/u16:2+flush-8:008:07:385
1944987991613,2cyclictest2099635-21kworker/u16:3+flush-8:004:42:355
194498799160,15cyclictest0-21swapper/507:12:385
1944981991614,2cyclictest2270876-21kworker/u16:0+flush-8:006:12:374
1944981991614,2cyclictest2099635-21kworker/u16:3+flush-8:004:41:034
1944981991613,3cyclictest1944452-21kworker/u16:3+flush-8:003:37:214
194498199160,1cyclictest0-21swapper/408:34:164
194498199160,1cyclictest0-21swapper/408:29:124
194498199160,1cyclictest0-21swapper/408:18:584
194498199160,1cyclictest0-21swapper/406:33:344
194498199160,1cyclictest0-21swapper/406:28:274
194498199160,1cyclictest0-21swapper/406:23:204
194498199160,1cyclictest0-21swapper/406:07:584
194498199160,15cyclictest2033682-21cut04:02:414
1944992991514,0cyclictest0-21swapper/708:22:387
1944992991514,0cyclictest0-21swapper/703:37:307
1944992991512,2cyclictest4175659-21snmpd03:50:517
194499299150,14cyclictest0-21swapper/706:17:487
194499099158,6cyclictest0-21swapper/607:27:376
194499099150,14cyclictest2386528-21kthreadcore06:57:406
1944987991513,2cyclictest1998946-21kworker/u16:2+flush-8:004:38:145
1944987991512,2cyclictest2190504-21kworker/u16:1+flush-8:005:57:495
1944987991511,3cyclictest2300955-21kworker/u16:3+flush-8:007:07:495
194498799150,13cyclictest0-21swapper/505:54:455
1944992991413,0cyclictest0-21swapper/708:38:277
1944992991413,0cyclictest0-21swapper/707:47:207
1944992991413,0cyclictest0-21swapper/704:40:067
1944992991413,0cyclictest0-21swapper/704:04:037
1944992991412,1cyclictest0-21swapper/708:27:457
194499099148,5cyclictest0-21swapper/607:52:396
194499099142,7cyclictest2021895-21kthreadcore03:57:406
194499099140,6cyclictest2132297-21grep04:52:406
1944987991413,1cyclictest0-21swapper/508:33:305
1944987991412,2cyclictest2221378-21kworker/u16:4+flush-8:005:42:375
1944987991412,2cyclictest2009150-21kworker/u16:1+flush-8:004:13:155
1944987991410,3cyclictest2532598-21kworker/u16:3+flush-8:008:12:445
1944992991313,0cyclictest0-21swapper/703:43:427
194499099138,4cyclictest0-21swapper/605:12:446
194499099138,4cyclictest0-21swapper/605:12:446
194499099130,9cyclictest23170781kthreadcore06:22:416
194499099130,7cyclictest2456249-21tr07:32:416
194499099130,13cyclictest0-21swapper/604:59:266
194499099130,13cyclictest0-21swapper/604:26:576
194499099130,13cyclictest0-21swapper/604:13:246
1944987991312,1cyclictest0-21swapper/508:30:495
1944987991312,1cyclictest0-21swapper/505:28:445
1944987991311,2cyclictest1967977-21kworker/u16:4+flush-8:003:57:215
194498799130,1cyclictest0-21swapper/505:06:405
194498799130,13cyclictest0-21swapper/505:50:585
194498199139,3cyclictest2099635-21kworker/u16:3+flush-8:005:01:304
1944981991311,2cyclictest1944428-21kworker/u16:2+flush-8:003:27:384
1944981991310,2cyclictest2170034-21kworker/u16:2+events_unbound05:22:254
1944981991310,2cyclictest2049090-21kworker/u16:0+flush-8:004:12:414
194499299129,2cyclictest4175659-21snmpd06:48:557
194499099126,5cyclictest2372861-21cat06:52:366
194499099125,6cyclictest2292410-21cat06:12:376
194499099122,9cyclictest2090843-21hostname04:32:376
1944990991211,1cyclictest0-21swapper/605:47:506
194499099120,6cyclictest1968233-21cat03:27:526
194499099120,2cyclictest0-21swapper/604:05:406
194499099120,1cyclictest0-21swapper/607:04:086
194499099120,11cyclictest0-21swapper/608:32:346
194499099120,10cyclictest2433016-21tune2fs07:22:376
194499099120,0cyclictest0-21swapper/607:20:416
194498799128,3cyclictest1944452-21kworker/u16:3+flush-8:003:23:275
194498799126,1cyclictest0-21swapper/507:22:365
194498799123,4cyclictest2124219-21cut04:47:395
194498799123,4cyclictest2094116-21cut04:32:415
1944987991211,1cyclictest0-21swapper/507:49:315
1944987991211,1cyclictest0-21swapper/504:02:315
1944987991210,2cyclictest2009150-21kworker/u16:1+flush-8:004:01:095
194498799120,1cyclictest0-21swapper/507:28:245
194498799120,12cyclictest0-21swapper/507:53:095
194498799120,12cyclictest0-21swapper/506:40:575
194499299114,6cyclictest0-21swapper/707:36:027
194499099119,2cyclictest0-21swapper/608:08:466
194499099117,3cyclictest0-21swapper/607:42:496
194499099116,4cyclictest0-21swapper/608:42:416
194499099116,4cyclictest0-21swapper/608:27:416
194499099116,4cyclictest0-21swapper/607:37:376
194499099116,4cyclictest0-21swapper/604:17:436
194499099116,4cyclictest0-21swapper/603:42:416
194499099114,6cyclictest2162061-21kthreadcore05:07:416
194499099113,7cyclictest2590448-21cut08:37:436
194499099113,7cyclictest2557668-21cut08:22:416
194499099113,7cyclictest2534859-21cat08:12:386
194499099113,7cyclictest2409381-21kthreadcore07:07:446
194499099113,7cyclictest2327084-21cut06:27:406
194499099113,7cyclictest2306099-21kthreadcore06:17:436
194499099113,7cyclictest2272560-21irqcore06:02:386
194499099113,7cyclictest2268110-21cut05:57:416
194499099113,7cyclictest2256312-21cut05:52:406
194499099113,7cyclictest2201744-21cat05:27:386
194499099113,7cyclictest2120602-21cat04:47:336
194499099113,7cyclictest1987621-21kthreadcore03:37:436
194499099112,8cyclictest2335721-21cut06:32:406
194499099112,8cyclictest2115881-21cut04:42:416
194499099112,8cyclictest1946692-21cut03:22:396
194499099111,9cyclictest2192052-21cut05:22:406
1944990991110,1cyclictest0-21swapper/606:50:156
1944990991110,1cyclictest0-21swapper/603:33:126
194499099110,9cyclictest2010355-21fw_packets03:52:356
194499099110,11cyclictest0-21swapper/606:10:036
194499099110,11cyclictest0-21swapper/605:03:036
194499099110,10cyclictest2234095-21grep05:42:406
194499099110,10cyclictest2230499-21chrt05:38:576
194499099110,10cyclictest2220594-21chrt05:36:176
194499099110,10cyclictest2009112-21chrt03:50:486
194498799119,2cyclictest0-21swapper/508:42:105
194498799119,2cyclictest0-21swapper/506:32:355
194498799118,3cyclictest0-21swapper/504:22:225
194498799115,2cyclictest0-21swapper/507:02:405
194498799115,1cyclictest0-21swapper/504:52:395
194498799114,2cyclictest1980630-21kthreadcore03:37:405
194498799114,2cyclictest0-21swapper/506:57:405
194498799113,4cyclictest2473530-21ip_192.168.114.07:42:375
194498799113,3cyclictest2595136-21cut08:42:385
194498799113,3cyclictest2360669-21ntp_kernel_pll_06:42:475
194498799113,3cyclictest2309059-21cut06:17:455
194498799113,3cyclictest2172050-21kthreadcore05:12:405
194498799113,3cyclictest2172050-21kthreadcore05:12:405
194498799113,3cyclictest2141656-21grep04:57:405
194498799113,3cyclictest1957742-21grep03:27:255
194498799112,4cyclictest2509655-21grep07:57:415
194498799112,3cyclictest2065132-21cut04:17:435
1944987991110,1cyclictest0-21swapper/505:39:375
194498799110,11cyclictest0-21swapper/506:54:025
1944981991110,1cyclictest0-21swapper/405:31:074
194499299100,2cyclictest0-21swapper/705:52:447
194499099109,1cyclictest0-21swapper/608:02:276
194499099106,3cyclictest0-21swapper/607:57:416
194499099104,5cyclictest2603843-21cpuspeed_turbos08:47:346
194499099102,7cyclictest2040964-21cut04:07:386
194499099100,9cyclictest2552892-21chrt08:22:036
194499099100,9cyclictest2486714-21cut07:47:416
194499099100,9cyclictest2100195-21grep04:37:366
194499099100,8cyclictest2412421-21cpuspeed_turbos07:12:346
194499099100,8cyclictest2342033-21cpuspeed06:37:356
194499099100,8cyclictest2180871-21cpuspeed05:17:346
194498799109,1cyclictest0-21swapper/503:35:435
194498799106,1cyclictest0-21swapper/505:20:335
194498799102,4cyclictest2612846-21cat08:47:505
194498799102,4cyclictest2456598-21cut07:32:415
194498799102,3cyclictest2422486-21cpuspeed_turbos07:17:345
194498799102,3cyclictest2312529-21cat06:22:365
194498199109,1cyclictest0-21swapper/404:00:574
194498199109,1cyclictest0-21swapper/403:55:444
19449879994,1cyclictest0-21swapper/506:07:405
19449819994,4cyclictest1946755-21kthreadcore03:22:394
19449879987,1cyclictest0-21swapper/503:50:225
19449879973,3cyclictest2291707-21cat06:12:345
19449819973,3cyclictest1990148-21tune2fs03:42:364
19449879950,4cyclictest2543264-21cpu08:17:375
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional