You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 12:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Mon Dec 22, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
171414025847,8sleep40-21swapper/419:09:004
171415125444,7sleep60-21swapper/619:09:106
171407525319,30sleep70-21swapper/719:08:077
171388324636,7sleep50-21swapper/519:05:245
1714482994539,5cyclictest2056870-21latency_hist22:04:217
171448299361,33cyclictest2279771-21date23:59:217
171448299340,32cyclictest2269922-21latency_hist23:54:217
1714478993331,2cyclictest1873063-21kworker/u16:2+flush-8:021:24:516
1714478993230,2cyclictest2278812-21kworker/u16:4+events_unbound00:35:316
1714476993230,2cyclictest1873063-21kworker/u16:2+events_unbound21:49:245
1714476993230,2cyclictest1873063-21kworker/u16:2+events_unbound21:49:245
1714478993129,2cyclictest2254816-21kworker/u16:2+events_unbound23:48:316
1714478993128,2cyclictest2124982-21kworker/u16:0+flush-8:000:24:236
171448299300,28cyclictest1853572-21latency_hist20:19:217
171448299300,28cyclictest1853572-21latency_hist20:19:217
1714478993027,2cyclictest2056606-21kworker/u16:5+events_unbound22:44:316
1714476993028,2cyclictest2056606-21kworker/u16:5+flush-8:023:25:515
1714478992927,2cyclictest1873064-21kworker/u16:4+flush-8:021:03:316
1714478992926,2cyclictest2047550-21kworker/u16:4+events_unbound22:34:236
1714476992927,2cyclictest2221581-21kworker/u16:3+events_unbound23:55:315
1714476992927,2cyclictest1988767-21kworker/u16:1+events_unbound21:26:275
1714478992826,2cyclictest2037390-21kworker/u16:0+flush-8:022:00:116
1714476992826,2cyclictest2318183-21kworker/u16:1+events_unbound00:26:515
1714476992826,2cyclictest2056606-21kworker/u16:5+flush-8:023:11:315
1714476992826,2cyclictest1873063-21kworker/u16:2+events_unbound21:39:195
1714476992826,2cyclictest1873063-21kworker/u16:2+events_unbound21:01:475
1714476992826,2cyclictest1815322-21kworker/u16:0+flush-8:020:17:475
1714476992826,2cyclictest1815322-21kworker/u16:0+flush-8:020:17:475
1714476992825,2cyclictest2124982-21kworker/u16:0+events_unbound00:19:305
171448299270,17cyclictest0-21swapper/721:44:447
1714476992725,2cyclictest2240824-21kworker/u16:1+events_unbound23:40:095
1714476992725,2cyclictest2047550-21kworker/u16:4+flush-8:022:07:315
1714476992725,2cyclictest1834296-21kworker/u16:1+events_unbound20:21:475
1714478992623,2cyclictest2337556-21kworker/u16:2+flush-8:000:29:306
1714476992624,2cyclictest2337556-21kworker/u16:2+flush-8:000:30:425
1714476992624,2cyclictest2095668-21kworker/u16:1+flush-8:022:38:555
1714476992624,2cyclictest2056606-21kworker/u16:5+events_unbound23:22:555
1714476992624,2cyclictest1834296-21kworker/u16:1+events_unbound20:58:125
1714482992519,5cyclictest2299062-21latency_hist00:09:217
1714478992523,2cyclictest2017884-21kworker/u16:1+events_unbound22:08:306
1714478992522,2cyclictest2047550-21kworker/u16:4+flush-8:022:29:226
1714476992523,2cyclictest2240824-21kworker/u16:1+flush-8:023:44:225
1714476992523,2cyclictest2124982-21kworker/u16:0+events_unbound23:00:545
1714476992523,2cyclictest2047550-21kworker/u16:4+events_unbound22:54:515
1714476992523,2cyclictest2037390-21kworker/u16:0+flush-8:021:55:345
1714476992523,2cyclictest1785909-21kworker/u16:2+events_unbound20:11:475
1714478992422,2cyclictest2278812-21kworker/u16:4+events_unbound00:05:516
1714476992422,2cyclictest240804-21kworker/u16:3+events_unbound19:54:185
1714476992422,2cyclictest1979090-21kworker/u16:0+events_unbound21:30:475
1714476992422,2cyclictest1815322-21kworker/u16:0+flush-8:020:25:115
1714476992421,2cyclictest240804-21kworker/u16:3+events_unbound19:09:255
1714473992422,2cyclictest2124982-21kworker/u16:0+events_unbound23:49:384
1714482992321,1cyclictest2308774-21idleruntime-cro00:14:207
1714482992317,5cyclictest650-21systemd-journal21:04:217
1714482992317,5cyclictest1766560-21latency_hist19:34:227
1714478992321,2cyclictest2221581-21kworker/u16:3+events_unbound23:49:496
1714478992321,2cyclictest2056606-21kworker/u16:5+events_unbound22:25:306
1714478992321,2cyclictest2047550-21kworker/u16:4+flush-8:023:04:216
1714478992321,2cyclictest1950730-21kworker/u16:3+events_unbound21:15:326
1714476992321,2cyclictest240804-21kworker/u16:3+flush-8:019:55:365
1714476992321,2cyclictest2278812-21kworker/u16:4+flush-8:000:34:545
1714476992321,2cyclictest2278812-21kworker/u16:4+flush-8:000:02:225
1714476992321,2cyclictest2221581-21kworker/u16:3+flush-8:000:14:195
1714476992321,2cyclictest2124982-21kworker/u16:0+flush-8:023:29:415
1714476992321,2cyclictest2124982-21kworker/u16:0+flush-8:023:29:415
1714476992321,2cyclictest2124982-21kworker/u16:0+flush-8:022:46:365
1714476992321,2cyclictest2124982-21kworker/u16:0+events_unbound23:52:065
1714476992321,2cyclictest2056606-21kworker/u16:5+flush-8:023:34:485
1714476992321,2cyclictest1873063-21kworker/u16:2+events_unbound20:50:515
1714476992321,2cyclictest1873063-21kworker/u16:2+events_unbound20:37:475
1714476992320,2cyclictest2124982-21kworker/u16:0+events_unbound00:04:235
1714473992320,2cyclictest1795228-21kworker/u16:4+flush-8:020:04:364
1714482992216,5cyclictest650-21systemd-journal19:44:227
1714478992220,2cyclictest1834296-21kworker/u16:1+events_unbound20:51:476
1714478992220,2cyclictest1834296-21kworker/u16:1+events_unbound20:36:156
1714476992220,2cyclictest240804-21kworker/u16:3+flush-8:019:18:445
1714476992220,2cyclictest240804-21kworker/u16:3+events_unbound19:42:405
1714476992220,2cyclictest2124982-21kworker/u16:0+flush-8:022:50:355
1714476992220,2cyclictest2056606-21kworker/u16:5+events_unbound22:29:205
1714476992220,2cyclictest2027604-21kworker/u16:3+events_unbound22:03:445
1714476992220,2cyclictest1950730-21kworker/u16:3+events_unbound21:17:475
1714476992220,2cyclictest1834296-21kworker/u16:1+flush-8:020:46:485
1714476992220,2cyclictest1685667-21kworker/u16:1+flush-8:019:26:555
1714476992220,2cyclictest1685667-21kworker/u16:1+flush-8:019:26:555
1714476992220,2cyclictest1685667-21kworker/u16:1+events_unbound19:35:195
1714476992220,2cyclictest1685667-21kworker/u16:1+events_unbound19:24:205
1714473992220,2cyclictest1873063-21kworker/u16:2+flush-8:021:39:524
20668082210,1chrt2066807-21sed22:09:227
1714478992119,2cyclictest2318183-21kworker/u16:1+flush-8:000:20:156
1714478992119,2cyclictest1944837-21kworker/u16:1+events_unbound21:06:236
1714478992119,2cyclictest1834296-21kworker/u16:1+events_unbound20:56:196
1714476992119,2cyclictest2047550-21kworker/u16:4+events_unbound22:15:515
1714476992119,2cyclictest1979090-21kworker/u16:0+events_unbound21:44:535
1714476992119,2cyclictest1873064-21kworker/u16:4+flush-8:020:43:335
1714476992119,2cyclictest1815322-21kworker/u16:0+events_unbound20:32:365
1714476992119,2cyclictest1795228-21kworker/u16:4+events_unbound20:02:445
1714476992119,2cyclictest1785909-21kworker/u16:2+events_unbound20:05:485
1714476992118,2cyclictest2047550-21kworker/u16:4+flush-8:022:19:225
1714473992119,2cyclictest2124982-21kworker/u16:0+flush-8:022:39:364
1714473992119,2cyclictest2124982-21kworker/u16:0+flush-8:022:39:364
1714473992119,2cyclictest1728990-21kworker/u16:0+flush-8:019:19:554
1714473992118,2cyclictest2221581-21kworker/u16:3+flush-8:023:59:394
1714478992018,2cyclictest2017884-21kworker/u16:1+flush-8:021:44:166
1714478992018,2cyclictest1944837-21kworker/u16:1+flush-8:021:14:166
1714478992018,2cyclictest1815322-21kworker/u16:0+flush-8:020:10:106
1714478992017,2cyclictest2095668-21kworker/u16:1+events_unbound22:39:246
1714478992017,2cyclictest2095668-21kworker/u16:1+events_unbound22:39:246
1714476992018,2cyclictest240804-21kworker/u16:3+flush-8:019:33:355
1714476992018,2cyclictest2047550-21kworker/u16:4+events_unbound22:31:315
1714476992018,2cyclictest1873064-21kworker/u16:4+flush-8:021:06:155
1714476992018,2cyclictest1873063-21kworker/u16:2+flush-8:021:42:365
1714476992018,2cyclictest1873063-21kworker/u16:2+events_unbound21:19:525
1714482991915,3cyclictest1267-21snmpd22:14:187
1714478991917,2cyclictest240804-21kworker/u16:3+events_unbound19:35:326
1714478991917,2cyclictest2124982-21kworker/u16:0+flush-8:023:40:316
1714478991917,2cyclictest2056606-21kworker/u16:5+flush-8:023:25:306
1714478991917,2cyclictest1815322-21kworker/u16:0+events_unbound20:24:516
1714478991917,2cyclictest1685667-21kworker/u16:1+flush-8:019:26:046
1714478991917,2cyclictest1685667-21kworker/u16:1+flush-8:019:26:046
1714478991916,2cyclictest1873063-21kworker/u16:2+flush-8:021:19:236
1714478991916,2cyclictest1834296-21kworker/u16:1+flush-8:020:19:386
1714476991917,2cyclictest240804-21kworker/u16:3+events_unbound19:46:045
1714476991917,2cyclictest2056606-21kworker/u16:5+flush-8:022:41:395
1714476991917,2cyclictest2056606-21kworker/u16:5+flush-8:022:41:395
1714476991917,2cyclictest2056606-21kworker/u16:5+flush-8:022:09:545
1714476991917,2cyclictest2056606-21kworker/u16:5+events_unbound23:15:595
1714476991917,2cyclictest1944837-21kworker/u16:1+events_unbound21:10:335
1714473991916,2cyclictest2337556-21kworker/u16:2+events_unbound00:29:344
1714473991916,2cyclictest2047550-21kworker/u16:4+flush-8:021:59:354
1714478991816,2cyclictest2066975-21kworker/u16:0+events_unbound22:18:556
1714482991714,2cyclictest2240924-21awk23:39:217
171448299170,15cyclictest1267-21snmpd00:03:117
1714478991715,2cyclictest2221581-21kworker/u16:3+events_unbound23:55:356
1714478991715,2cyclictest2124982-21kworker/u16:0+events_unbound00:16:306
1714478991715,2cyclictest2056606-21kworker/u16:5+events_unbound23:30:316
1714478991715,2cyclictest2056606-21kworker/u16:5+events_unbound23:30:316
1714478991714,2cyclictest2221581-21kworker/u16:3+flush-8:000:09:226
1714478991714,2cyclictest1815322-21kworker/u16:0+flush-8:020:04:226
1714476991715,2cyclictest2221581-21kworker/u16:3+events_unbound00:15:335
1714476991715,2cyclictest2056606-21kworker/u16:5+flush-8:023:08:375
1714482991612,3cyclictest1267-21snmpd21:26:507
1714482991612,3cyclictest1267-21snmpd21:24:147
1714478991614,2cyclictest240804-21kworker/u16:3+flush-8:019:48:366
1714478991614,2cyclictest240804-21kworker/u16:3+events_unbound19:16:336
1714478991614,2cyclictest1979090-21kworker/u16:0+events_unbound21:45:086
1714478991614,2cyclictest1795228-21kworker/u16:4+events_unbound19:59:356
1714478991614,2cyclictest1660413-21kworker/u16:4+flush-8:019:09:366
1714473991614,2cyclictest240804-21kworker/u16:3+flush-8:019:54:374
1714473991614,2cyclictest2056606-21kworker/u16:5+flush-8:023:24:464
1714473991613,2cyclictest2178849-21kthreadcore23:04:404
1714473991612,3cyclictest2202159-21kworker/u16:2+flush-8:023:19:464
171447399160,2cyclictest2115381-21cat22:34:344
1714482991511,3cyclictest1267-21snmpd23:03:377
171448299150,14cyclictest0-21swapper/719:09:477
1714478991513,2cyclictest2240824-21kworker/u16:1+flush-8:023:39:216
1714478991513,2cyclictest2124982-21kworker/u16:0+events_unbound23:15:306
1714478991513,2cyclictest1988767-21kworker/u16:1+events_unbound21:30:336
1714473991513,2cyclictest1873064-21kworker/u16:4+flush-8:020:39:374
171448299146,7cyclictest0-21swapper/721:32:317
1714482991412,1cyclictest0-21swapper/720:49:467
1714482991410,3cyclictest1267-21snmpd20:02:217
171448299140,1cyclictest0-21swapper/719:24:487
171448299140,1cyclictest0-21swapper/719:24:487
171448299140,13cyclictest0-21swapper/720:24:457
1714478991412,2cyclictest240804-21kworker/u16:3+flush-8:019:54:046
171448299139,3cyclictest1267-21snmpd23:16:047
171448299139,3cyclictest1267-21snmpd21:53:067
171448299139,3cyclictest1267-21snmpd21:53:067
171448299139,3cyclictest1267-21snmpd20:55:257
171448299139,3cyclictest1267-21snmpd20:30:587
171448299139,3cyclictest1267-21snmpd19:21:177
171448299139,3cyclictest1267-21snmpd00:33:487
1714482991312,0cyclictest0-21swapper/721:34:397
1714482991310,2cyclictest1267-21snmpd20:42:227
171448299130,11cyclictest0-21swapper/722:29:447
1714478991311,2cyclictest240804-21kworker/u16:3+flush-8:019:54:396
1714478991311,2cyclictest2037390-21kworker/u16:0+events_unbound21:56:236
1714473991311,2cyclictest2056606-21kworker/u16:5+flush-8:023:14:354
1714473991310,2cyclictest2017884-21kworker/u16:1+flush-8:021:54:484
171448299129,2cyclictest1267-21snmpd23:11:377
171448299129,2cyclictest1267-21snmpd21:43:517
171448299129,2cyclictest1267-21snmpd19:36:597
171448299129,2cyclictest1267-21snmpd00:18:297
171448299128,3cyclictest6344-21gmain22:19:427
171448299128,3cyclictest1267-21snmpd23:08:467
171448299128,3cyclictest1267-21snmpd21:11:597
171448299128,3cyclictest1267-21snmpd20:48:167
171448299128,3cyclictest1267-21snmpd20:19:427
171448299128,3cyclictest1267-21snmpd20:12:487
171448299128,3cyclictest1267-21snmpd20:04:577
171448299128,3cyclictest1267-21snmpd00:19:357
171448299127,4cyclictest6184-21gvfs-afc-volume22:49:437
171448299126,5cyclictest6184-21gvfs-afc-volume22:44:487
171448299126,5cyclictest1795535-21latency_hist19:49:227
171448299120,4cyclictest2158245-21kthreadcore22:54:427
171448299120,11cyclictest1267-21snmpd00:27:207
171448299120,10cyclictest0-21swapper/719:49:457
171447899129,2cyclictest2210805-21needreboot23:19:426
1714478991211,1cyclictest0-21swapper/623:09:486
1714478991211,1cyclictest0-21swapper/622:13:226
1714478991210,2cyclictest2124982-21kworker/u16:0+flush-8:022:51:226
1714478991210,2cyclictest2124982-21kworker/u16:0+events_unbound23:04:356
1714478991210,2cyclictest2056606-21kworker/u16:5+events_unbound22:19:526
1714478991210,2cyclictest1873064-21kworker/u16:4+flush-8:020:39:536
171447899120,1cyclictest0-21swapper/600:01:316
171447399129,2cyclictest240804-21kworker/u16:3+flush-8:019:39:274
171447399129,2cyclictest2056606-21kworker/u16:5+flush-8:023:34:314
1714473991210,2cyclictest1873064-21kworker/u16:4+flush-8:021:09:514
171447399120,1cyclictest0-21swapper/421:02:394
171447399120,1cyclictest0-21swapper/400:09:564
171447399120,11cyclictest0-21swapper/421:24:244
171447399120,11cyclictest0-21swapper/420:49:344
171448299118,2cyclictest1267-21snmpd23:21:497
171448299117,3cyclictest1883768-21taskset20:34:387
171448299117,3cyclictest1267-21snmpd23:26:587
171448299117,3cyclictest1267-21snmpd22:41:337
171448299117,3cyclictest1267-21snmpd22:41:337
171448299117,3cyclictest1267-21snmpd22:36:427
171448299117,3cyclictest1267-21snmpd21:06:527
171448299117,3cyclictest1267-21snmpd00:35:427
171448299116,4cyclictest5756-21JS21:50:157
171448299116,4cyclictest5756-21JS21:50:157
171448299116,4cyclictest1969492-21sshd-session21:15:317
171448299110,9cyclictest1267-21snmpd22:14:517
171448299110,9cyclictest0-21swapper/723:39:357
171448299110,2cyclictest0-21swapper/723:44:527
171448299110,10cyclictest1267-21snmpd19:14:567
171447899119,2cyclictest240804-21kworker/u16:3+flush-8:019:29:376
171447899119,2cyclictest1728990-21kworker/u16:0+events_unbound19:23:336
1714478991110,1cyclictest0-21swapper/622:56:436
171447899110,0cyclictest0-21swapper/621:34:256
171447399119,2cyclictest1795228-21kworker/u16:4+flush-8:019:59:474
171447399118,2cyclictest2124982-21kworker/u16:0+flush-8:000:24:474
171447399118,2cyclictest2047550-21kworker/u16:4+flush-8:022:29:384
171447399118,2cyclictest1911003-21/usr/sbin/munin20:44:504
1714473991110,1cyclictest0-21swapper/422:26:504
1714473991110,1cyclictest0-21swapper/421:46:574
1714473991110,1cyclictest0-21swapper/421:34:304
1714473991110,1cyclictest0-21swapper/421:04:324
1714473991110,1cyclictest0-21swapper/420:17:534
1714473991110,1cyclictest0-21swapper/420:17:534
1714473991110,1cyclictest0-21swapper/419:54:044
1714473991110,1cyclictest0-21swapper/419:14:204
171447399110,1cyclictest0-21swapper/419:28:414
171447399110,1cyclictest0-21swapper/419:28:414
171447399110,1cyclictest0-21swapper/400:08:034
171447399110,11cyclictest0-21swapper/423:46:464
171447399110,11cyclictest0-21swapper/423:33:224
171447399110,11cyclictest0-21swapper/423:33:224
171447399110,11cyclictest0-21swapper/422:59:094
171447399110,11cyclictest0-21swapper/422:17:234
171447399110,11cyclictest0-21swapper/420:33:384
171447399110,11cyclictest0-21swapper/419:49:114
171448299104,4cyclictest2102469-21cut22:24:427
171448299100,9cyclictest0-21swapper/721:54:477
171448299100,2cyclictest0-21swapper/719:54:377
171447899109,1cyclictest0-21swapper/620:33:436
171447899108,2cyclictest240804-21kworker/u16:3+flush-8:019:40:556
171447899108,2cyclictest1834296-21kworker/u16:1+events_unbound20:44:356
171447399109,1cyclictest0-21swapper/422:49:424
171447399109,1cyclictest0-21swapper/421:30:244
171447399108,2cyclictest1873064-21kworker/u16:4+events_unbound20:34:394
171447399106,3cyclictest2172611-21tail22:59:504
171447399106,3cyclictest2067754-21cat22:09:374
171447399100,1cyclictest0-21swapper/423:54:414
17144789997,2cyclictest2017884-21kworker/u16:1+flush-8:021:51:086
17144789997,2cyclictest2017884-21kworker/u16:1+flush-8:021:51:086
17144739998,1cyclictest0-21swapper/421:51:034
17144739998,1cyclictest0-21swapper/421:51:034
17144739998,1cyclictest0-21swapper/421:14:284
17144739998,1cyclictest0-21swapper/419:31:034
17144739997,2cyclictest240804-21kworker/u16:3+flush-8:019:14:274
17144739997,2cyclictest2124982-21kworker/u16:0+flush-8:023:09:464
17144789986,2cyclictest1785909-21kworker/u16:2+flush-8:020:14:226
17144789986,2cyclictest1785909-21kworker/u16:2+flush-8:020:14:226
17144739987,1cyclictest0-21swapper/420:24:394
17144739986,2cyclictest2056606-21kworker/u16:5+events_unbound22:04:394
17144739986,1cyclictest0-21swapper/422:44:424
17144739986,1cyclictest0-21swapper/400:19:384
17144739984,3cyclictest2348808-21irqcore00:34:384
17144739984,3cyclictest1922903-21irqstats20:54:404
17144739984,3cyclictest1767748-21cat19:34:374
17144739983,4cyclictest2315168-21cut00:14:434
17144739983,4cyclictest2090718-21grep22:19:414
17144739983,4cyclictest1972135-21tr21:19:374
17144739983,4cyclictest1854084-21cat20:19:344
17144739973,3cyclictest2241630-21expr23:39:354
17144739972,4cyclictest1836028-21kthreadcore20:09:434
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional