You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 23:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Dec 10, 2025 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1386526641,9sleep70-21swapper/706:51:237
1380725340,9sleep40-21swapper/406:50:324
310862510,1sleep5561ktimersoftd/509:29:275
1395524827,9sleep20-21swapper/206:52:302
251352470,0sleep60-21swapper/610:51:536
208592450,0sleep00-21swapper/010:36:170
40272420,0sleep40-21swapper/411:34:044
1384524229,9sleep50-21swapper/506:51:055
135242420,0sleep30-21swapper/311:44:283
128092420,0sleep30-21swapper/310:57:113
296682410,0sleep30-21swapper/309:23:003
295032410,0sleep00-21swapper/011:05:160
1404324122,15sleep10-21swapper/106:53:411
1396724130,8sleep30-21swapper/306:52:393
1381224129,8sleep00-21swapper/006:50:360
43252400,0sleep30-21swapper/309:36:303
35642400,0sleep70-21swapper/709:56:207
18782400,0sleep10-21swapper/109:32:591
169652400,0sleep70-21swapper/709:18:327
1372024027,9sleep60-21swapper/606:49:216
262882390,0sleep20-21swapper/211:20:322
70892380,2sleep21418399cyclictest11:09:112
221392360,0sleep70-21swapper/711:19:577
193432350,0sleep10-21swapper/109:22:021
186312350,0sleep50-21swapper/509:12:135
215132340,2sleep11417799cyclictest10:28:331
9142280,0sleep30-21swapper/311:21:133
1420499232,3cyclictest0-21swapper/707:27:057
1419699236,5cyclictest0-21swapper/508:52:165
14192992310,3cyclictest49-21ksoftirqd/411:14:014
1419299217,4cyclictest49-21ksoftirqd/409:07:554
1420499208,10cyclictest3228-21bash12:09:107
1419299205,3cyclictest49-21ksoftirqd/412:17:424
14186992017,1cyclictest41-21ksoftirqd/312:11:463
90312190,0sleep01417399cyclictest09:14:160
207752190,0sleep60-21swapper/612:04:416
1419699198,5cyclictest0-21swapper/512:08:505
1419699198,5cyclictest0-21swapper/511:14:545
1419699198,5cyclictest0-21swapper/509:14:265
1419699198,5cyclictest0-21swapper/507:15:435
1419699198,0cyclictest0-21swapper/510:50:145
1419699198,0cyclictest0-21swapper/510:16:465
1419299198,1cyclictest49-21ksoftirqd/411:55:014
101132190,0sleep00-21swapper/011:47:370
1420499182,15cyclictest13778-21bash09:11:427
1420499182,13cyclictest9128-21sshd09:04:147
1420499180,0cyclictest0-21swapper/708:50:407
1420499180,0cyclictest0-21swapper/708:23:067
1419699188,0cyclictest0-21swapper/511:36:465
1419699187,5cyclictest0-21swapper/511:54:345
1419699187,5cyclictest0-21swapper/511:53:425
1419699187,5cyclictest0-21swapper/510:09:465
1419699187,5cyclictest0-21swapper/509:04:345
1419699187,5cyclictest0-21swapper/508:06:015
1419699187,0cyclictest0-21swapper/507:36:435
1419699184,8cyclictest0-21swapper/507:47:435
1419699184,2cyclictest0-21swapper/506:55:555
1419299187,1cyclictest49-21ksoftirqd/409:39:254
1419299186,1cyclictest49-21ksoftirqd/409:29:264
14192991815,1cyclictest49-21ksoftirqd/410:25:304
14192991811,4cyclictest49-21ksoftirqd/411:52:114
1419299181,1cyclictest121rcu_preempt11:27:134
1418399180,16cyclictest4212-21sshd12:12:282
1417399180,15cyclictest99-21kswapd007:42:140
1420499170,16cyclictest26579-21cpuspeed_turbos10:08:547
1419699178,9cyclictest0-21swapper/510:33:045
1419699177,0cyclictest0-21swapper/508:30:005
1419699177,0cyclictest0-21swapper/507:05:195
1419699177,0cyclictest0-21swapper/507:01:535
1419699176,5cyclictest0-21swapper/511:32:565
1419699176,5cyclictest0-21swapper/511:21:585
1419699176,5cyclictest0-21swapper/510:43:545
1419699176,5cyclictest0-21swapper/510:43:545
1419699176,5cyclictest0-21swapper/509:01:305
1419699176,5cyclictest0-21swapper/508:35:125
1419699176,5cyclictest0-21swapper/508:21:215
1419699176,5cyclictest0-21swapper/507:10:335
1419699176,0cyclictest0-21swapper/512:14:385
1419699176,0cyclictest0-21swapper/510:24:385
1419699176,0cyclictest0-21swapper/510:19:145
1419699176,0cyclictest0-21swapper/507:23:595
1419699170,0cyclictest0-21swapper/507:39:595
1419299178,1cyclictest49-21ksoftirqd/409:50:134
1419299176,3cyclictest49-21ksoftirqd/412:06:444
14192991716,1cyclictest49-21ksoftirqd/410:56:304
14192991715,1cyclictest49-21ksoftirqd/409:37:354
14192991715,1cyclictest49-21ksoftirqd/409:21:444
14192991713,3cyclictest49-21ksoftirqd/410:38:284
14192991712,3cyclictest49-21ksoftirqd/410:11:434
14192991712,3cyclictest49-21ksoftirqd/410:01:154
14192991711,3cyclictest49-21ksoftirqd/408:59:314
14186991714,1cyclictest41-21ksoftirqd/312:00:273
1417399170,16cyclictest6021-21bash10:45:530
1417399170,16cyclictest6021-21bash10:45:530
302442160,0sleep60-21swapper/610:29:116
272072160,0sleep70-21swapper/710:22:317
18562160,0sleep00-21swapper/010:41:540
1420499165,0cyclictest0-21swapper/708:42:027
14204991611,5cyclictest0-21swapper/707:07:317
14204991611,0cyclictest0-21swapper/708:34:267
14204991611,0cyclictest0-21swapper/707:43:077
1420199161,3cyclictest131rcu_sched11:43:416
1419699167,8cyclictest0-21swapper/511:41:105
1419699165,0cyclictest0-21swapper/510:58:025
1419699165,0cyclictest0-21swapper/508:27:225
1419699164,11cyclictest1-21systemd09:34:325
1419299163,1cyclictest49-21ksoftirqd/410:48:554
14192991615,1cyclictest49-21ksoftirqd/411:06:254
14192991614,1cyclictest49-21ksoftirqd/411:43:364
14192991614,1cyclictest49-21ksoftirqd/409:25:174
14192991613,3cyclictest49-21ksoftirqd/411:18:464
14192991611,3cyclictest49-21ksoftirqd/411:59:514
1419299160,15cyclictest27855-21kworker/4:210:15:004
14204991510,0cyclictest0-21swapper/708:44:547
14204991510,0cyclictest0-21swapper/708:28:407
1420499151,2cyclictest0-21swapper/708:14:317
1420499151,2cyclictest0-21swapper/707:33:377
1420499150,3cyclictest0-21swapper/706:54:497
1420499150,13cyclictest26239-21sshd11:10:587
14201991513,2cyclictest65-21ksoftirqd/610:15:206
14201991513,1cyclictest65-21ksoftirqd/612:14:266
14201991513,1cyclictest65-21ksoftirqd/612:09:406
14201991513,1cyclictest65-21ksoftirqd/612:00:316
14201991513,1cyclictest65-21ksoftirqd/611:15:306
1420199150,14cyclictest27931-21kworker/6:511:47:466
1419699157,2cyclictest0-21swapper/510:34:425
1419699154,0cyclictest0-21swapper/510:04:105
1419699154,0cyclictest0-21swapper/507:29:235
1419299159,4cyclictest49-21ksoftirqd/412:19:434
1419299155,1cyclictest49-21ksoftirqd/411:10:104
1419299153,1cyclictest49-21ksoftirqd/411:01:384
14192991514,1cyclictest49-21ksoftirqd/411:29:514
14192991513,1cyclictest49-21ksoftirqd/410:30:154
14192991513,1cyclictest49-21ksoftirqd/410:18:554
14192991512,2cyclictest23953-21cp11:45:354
14192991512,1cyclictest49-21ksoftirqd/409:13:554
14192991510,1cyclictest49-21ksoftirqd/409:10:134
1419299150,14cyclictest1-21systemd12:09:284
14186991513,2cyclictest41-21ksoftirqd/310:40:143
14186991513,1cyclictest41-21ksoftirqd/310:53:433
14186991513,1cyclictest41-21ksoftirqd/309:33:433
1418399150,13cyclictest30540-21sshd09:19:592
1417799150,15cyclictest0-21swapper/109:06:421
1417799150,12cyclictest12235-21systemd-cgroups12:03:571
57442140,0sleep50-21swapper/510:42:235
56472140,0sleep00-21swapper/012:12:360
1420499142,0cyclictest0-21swapper/707:50:157
1420499142,0cyclictest0-21swapper/707:21:217
14204991412,1cyclictest20991-21sshd09:31:427
1420499140,13cyclictest7450-21sshd11:31:147
1420499140,13cyclictest4768-21sshd12:15:287
1420499140,13cyclictest30251-21sshd11:05:207
1420499140,13cyclictest22558-21sshd10:40:347
14201991413,1cyclictest65-21ksoftirqd/611:56:566
14201991413,1cyclictest65-21ksoftirqd/610:58:036
14201991413,1cyclictest65-21ksoftirqd/609:42:036
14201991412,2cyclictest65-21ksoftirqd/609:20:536
14201991412,1cyclictest65-21ksoftirqd/611:37:296
14201991412,1cyclictest65-21ksoftirqd/611:28:436
14201991412,1cyclictest65-21ksoftirqd/609:09:476
14201991411,1cyclictest65-21ksoftirqd/611:05:326
14201991410,3cyclictest65-21ksoftirqd/611:32:346
1419699143,5cyclictest0-21swapper/507:56:115
1419699143,0cyclictest0-21swapper/508:17:115
1419699142,11cyclictest2366-21sshd11:02:325
1419699142,0cyclictest0-21swapper/511:24:185
1419699142,0cyclictest0-21swapper/509:27:545
1419699140,9cyclictest23093-21sshd11:07:465
1419699140,8cyclictest0-21swapper/509:59:305
1419699140,8cyclictest0-21swapper/508:41:205
1419299149,3cyclictest49-21ksoftirqd/408:56:314
1419299145,2cyclictest49-21ksoftirqd/410:44:004
1419299145,2cyclictest49-21ksoftirqd/410:44:004
14192991412,1cyclictest49-21ksoftirqd/410:03:544
14192991412,1cyclictest49-21ksoftirqd/409:54:404
14192991411,0cyclictest49-21ksoftirqd/409:45:024
1418699148,5cyclictest41-21ksoftirqd/310:25:583
1418699148,3cyclictest41-21ksoftirqd/311:03:163
14186991413,1cyclictest41-21ksoftirqd/311:48:583
14186991413,1cyclictest41-21ksoftirqd/309:08:553
14186991413,1cyclictest23778-21kworker/3:509:53:143
14186991412,1cyclictest41-21ksoftirqd/309:04:043
14186991412,0cyclictest41-21ksoftirqd/309:28:323
14186991411,1cyclictest41-21ksoftirqd/312:04:353
1417799140,14cyclictest17579-21kworker/1:410:48:351
1417799140,14cyclictest17579-21kworker/1:410:48:351
22962130,0sleep20-21swapper/210:45:322
22962130,0sleep20-21swapper/210:45:322
1420499132,0cyclictest0-21swapper/708:04:237
1420499132,0cyclictest0-21swapper/707:45:597
14204991310,2cyclictest9242-21bash09:00:467
1420499130,7cyclictest0-21swapper/711:44:467
1420499130,7cyclictest0-21swapper/711:00:347
1420499130,7cyclictest0-21swapper/710:30:587
1420499130,7cyclictest0-21swapper/709:39:287
1420499130,7cyclictest0-21swapper/708:08:477
1420499130,7cyclictest0-21swapper/707:57:517
14201991312,1cyclictest65-21ksoftirqd/612:19:596
14201991312,1cyclictest65-21ksoftirqd/609:55:176
14201991312,1cyclictest65-21ksoftirqd/609:34:056
14201991311,1cyclictest65-21ksoftirqd/610:10:086
14201991311,1cyclictest65-21ksoftirqd/610:01:016
14201991311,1cyclictest65-21ksoftirqd/608:59:116
1419699138,5cyclictest0-21swapper/512:03:585
1419699138,5cyclictest0-21swapper/511:59:465
1419699138,5cyclictest0-21swapper/511:46:005
1419699138,5cyclictest0-21swapper/511:11:265
1419699138,5cyclictest0-21swapper/509:49:205
1419699138,5cyclictest0-21swapper/509:40:425
1419699138,5cyclictest0-21swapper/509:21:525
1419699138,5cyclictest0-21swapper/507:49:515
1419699134,9cyclictest0-21swapper/508:54:305
1419699132,5cyclictest0-21swapper/509:56:505
1419699131,0cyclictest0-21swapper/509:44:185
1419699130,2cyclictest0-21swapper/507:59:275
14192991311,1cyclictest49-21ksoftirqd/410:40:524
14192991311,1cyclictest49-21ksoftirqd/407:18:444
14186991312,1cyclictest41-21ksoftirqd/311:14:033
14186991311,1cyclictest41-21ksoftirqd/312:15:033
14186991311,1cyclictest41-21ksoftirqd/310:46:273
14186991311,1cyclictest41-21ksoftirqd/310:46:273
14186991311,1cyclictest41-21ksoftirqd/310:30:403
14186991311,1cyclictest41-21ksoftirqd/309:16:023
14186991310,3cyclictest41-21ksoftirqd/310:38:103
14186991310,2cyclictest41-21ksoftirqd/309:45:223
1418699131,1cyclictest131rcu_sched09:00:563
1418399139,2cyclictest668-21systemd-logind09:25:362
14177991311,1cyclictest25-21ksoftirqd/110:34:041
1417399130,11cyclictest2775-21sshd11:37:120
130692130,0sleep613064-21sshd09:08:306
324982120,0sleep20-21swapper/211:59:402
1420499124,2cyclictest0-21swapper/710:51:127
1420499124,2cyclictest0-21swapper/710:18:067
1420499124,1cyclictest859-21polkitd09:58:587
1420499123,8cyclictest7658-21sshd10:38:407
14204991210,1cyclictest73-21ksoftirqd/711:27:037
14204991210,1cyclictest73-21ksoftirqd/709:37:487
1420499121,0cyclictest0-21swapper/708:32:587
1420499120,6cyclictest0-21swapper/712:02:067
1420499120,6cyclictest0-21swapper/710:45:427
1420499120,6cyclictest0-21swapper/710:45:427
1420499120,6cyclictest0-21swapper/709:49:067
1420499120,6cyclictest0-21swapper/707:35:137
1420499120,0cyclictest0-21swapper/707:03:057
1420199129,2cyclictest65-21ksoftirqd/610:45:486
1420199129,2cyclictest65-21ksoftirqd/610:45:486
1420199128,2cyclictest65-21ksoftirqd/610:07:176
14201991211,1cyclictest65-21ksoftirqd/611:09:216
14201991211,1cyclictest65-21ksoftirqd/610:33:556
14201991211,1cyclictest65-21ksoftirqd/609:47:576
14201991210,2cyclictest65-21ksoftirqd/610:22:096
14201991210,1cyclictest65-21ksoftirqd/611:19:206
14201991210,1cyclictest65-21ksoftirqd/610:59:146
14201991210,1cyclictest65-21ksoftirqd/610:39:026
14201991210,1cyclictest65-21ksoftirqd/610:28:336
14201991210,1cyclictest65-21ksoftirqd/609:32:336
14201991210,1cyclictest65-21ksoftirqd/609:25:066
1420199120,3cyclictest0-21swapper/609:49:006
1419699127,5cyclictest0-21swapper/512:20:505
1419699127,5cyclictest0-21swapper/508:10:115
1419699127,0cyclictest0-21swapper/508:46:425
1419699127,0cyclictest0-21swapper/507:18:575
14192991211,1cyclictest49-21ksoftirqd/407:24:024
14186991211,1cyclictest41-21ksoftirqd/311:55:463
14186991211,1cyclictest41-21ksoftirqd/311:39:503
14186991211,1cyclictest41-21ksoftirqd/311:10:093
14186991211,1cyclictest41-21ksoftirqd/309:55:513
14186991210,1cyclictest41-21ksoftirqd/311:30:103
14186991210,1cyclictest41-21ksoftirqd/311:27:543
14186991210,1cyclictest41-21ksoftirqd/310:01:043
1418399129,2cyclictest14730-21grepconf.sh11:44:342
1418399126,2cyclictest668-21systemd-logind09:49:392
1418399121,5cyclictest0-21swapper/210:36:582
1418399120,4cyclictest16790-21sshd06:56:272
1418399120,11cyclictest0-21swapper/211:51:402
1417799126,3cyclictest0-21swapper/110:07:021
1417799125,6cyclictest14372-21sshd11:35:071
14177991210,1cyclictest25-21ksoftirqd/110:57:421
1417399122,4cyclictest9181-21sshd10:17:310
1417399122,4cyclictest31411-21sshd10:52:400
1417399122,4cyclictest1922-21sshd11:43:280
1417399122,4cyclictest10198-21sshd10:53:520
14173991211,1cyclictest9-21ksoftirqd/009:08:210
14173991210,1cyclictest711-21dbus-daemon10:04:150
1417399121,5cyclictest29358-21grep09:45:290
1417399120,9cyclictest23691-21sh11:48:570
1417399120,11cyclictest861-21gdbus10:20:480
1417399120,11cyclictest12148-21sshd11:09:400
1417399120,11cyclictest1-21systemd10:28:410
144782110,0sleep20-21swapper/209:11:462
1420499113,8cyclictest5396-21cp11:37:307
1420499113,2cyclictest0-21swapper/711:57:587
1420499113,2cyclictest0-21swapper/709:21:267
1420499112,5cyclictest0-21swapper/710:25:187
1420499110,5cyclictest0-21swapper/707:16:197
1420499110,11cyclictest0-21swapper/710:06:107
1420499110,0cyclictest0-21swapper/709:44:567
1420499110,0cyclictest0-21swapper/708:56:187
1420199119,1cyclictest65-21ksoftirqd/611:50:266
1420199119,1cyclictest65-21ksoftirqd/609:18:316
1420199119,1cyclictest65-21ksoftirqd/608:53:556
1419299119,1cyclictest49-21ksoftirqd/408:53:434
1419299119,1cyclictest49-21ksoftirqd/407:43:434
14192991110,1cyclictest49-21ksoftirqd/407:43:554
1418699119,1cyclictest41-21ksoftirqd/311:33:583
1418699119,1cyclictest41-21ksoftirqd/310:19:433
1418699119,1cyclictest41-21ksoftirqd/309:40:043
1418699119,1cyclictest41-21ksoftirqd/308:58:213
1418699118,1cyclictest41-21ksoftirqd/310:11:383
14186991110,1cyclictest41-21ksoftirqd/312:21:413
14186991110,1cyclictest41-21ksoftirqd/311:05:273
14186991110,1cyclictest41-21ksoftirqd/310:05:403
1418399119,1cyclictest8301-21sshd11:28:202
1418399118,3cyclictest33-21ksoftirqd/209:39:072
1418399112,3cyclictest25130-21sshd09:02:392
14183991110,1cyclictest33-21ksoftirqd/211:05:392
1418399110,1cyclictest0-21swapper/209:30:532
1417799119,1cyclictest25-21ksoftirqd/111:21:431
1417799119,1cyclictest25-21ksoftirqd/109:10:221
1417799110,1cyclictest29887-21bash11:39:491
1417399113,7cyclictest1-21systemd09:22:170
1417399112,4cyclictest16294-21sshd12:07:330
14173991110,1cyclictest99-21kswapd011:22:080
1417399111,4cyclictest4630-21sshd12:03:190
1417399110,10cyclictest0-21swapper/009:51:280
1420499109,1cyclictest73-21ksoftirqd/711:41:207
1420499106,2cyclictest73-21ksoftirqd/712:20:057
1420499105,5cyclictest0-21swapper/711:14:267
1420499105,5cyclictest0-21swapper/710:55:047
1420499105,5cyclictest0-21swapper/709:24:387
1420499104,6cyclictest0-21swapper/707:09:317
1420499104,5cyclictest0-21swapper/707:59:137
1420499102,0cyclictest0-21swapper/711:49:267
1420499100,4cyclictest0-21swapper/712:07:467
1419299109,1cyclictest49-21ksoftirqd/407:34:024
1419299108,1cyclictest49-21ksoftirqd/408:08:594
1419299108,1cyclictest49-21ksoftirqd/407:49:044
1418699104,3cyclictest0-21swapper/310:14:263
1418399109,1cyclictest22751-21sshd08:58:342
1418399108,1cyclictest711-21dbus-daemon09:58:472
1418399101,2cyclictest1404-21grepconf.sh10:48:562
1417799109,1cyclictest25-21ksoftirqd/110:14:111
1417799109,1cyclictest25-21ksoftirqd/110:01:381
1417799108,1cyclictest25-21ksoftirqd/111:14:251
1417799108,1cyclictest25-21ksoftirqd/110:30:051
1417799106,4cyclictest10405-21kworker/1:211:02:181
1417799105,4cyclictest25051-21cp09:52:021
1417799104,4cyclictest23482-21bash09:35:051
1417799104,3cyclictest30216-21sshd10:12:491
1417799100,8cyclictest12456-21kworker/1:612:22:051
1417399109,1cyclictest0-21swapper/012:21:430
1417399108,1cyclictest9-21ksoftirqd/008:58:340
1417399102,4cyclictest10794-21bash10:00:330
1417399100,4cyclictest13021-21sshd09:27:570
1417399100,4cyclictest0-21swapper/011:31:540
1417399100,10cyclictest0-21swapper/009:33:020
142019998,1cyclictest65-21ksoftirqd/607:43:596
141929998,1cyclictest49-21ksoftirqd/407:54:054
141929998,1cyclictest49-21ksoftirqd/407:29:024
141929997,1cyclictest49-21ksoftirqd/408:33:434
141929997,1cyclictest49-21ksoftirqd/407:19:074
141839999,0cyclictest0-21swapper/210:41:022
141839998,1cyclictest33-21ksoftirqd/210:12:092
141839998,1cyclictest33-21ksoftirqd/209:54:502
141839998,1cyclictest0-21swapper/209:05:112
141839997,1cyclictest33-21ksoftirqd/212:21:082
141839997,1cyclictest33-21ksoftirqd/211:41:272
141839997,1cyclictest33-21ksoftirqd/210:55:312
141839997,1cyclictest33-21ksoftirqd/207:41:442
141839994,1cyclictest0-21swapper/211:53:492
141839992,4cyclictest14605-21bash11:16:062
141839992,4cyclictest1257-21sshd12:18:142
141839991,6cyclictest18168-21grepconf.sh09:44:132
141839991,5cyclictest23776-21bash10:25:392
141839990,9cyclictest0-21swapper/210:14:052
141839990,9cyclictest0-21swapper/210:07:272
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional