You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 10:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon Dec 29, 2025 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
241042760,2sleep7392999cyclictest22:10:027
200932750,2sleep4392699cyclictest22:30:094
38912480,0sleep60-21swapper/600:24:406
346024825,8sleep20-21swapper/219:05:002
232302470,0sleep00-21swapper/021:29:110
225422470,0sleep70-21swapper/700:36:507
172462470,0sleep50-21swapper/521:31:485
78072460,1sleep665-21ksoftirqd/623:23:376
259212450,1sleep025920-21grepconf.sh23:45:570
304022430,0sleep70-21swapper/723:09:057
23172430,1sleep02159-21systemd23:29:480
131052420,0sleep70-21swapper/721:41:357
100952420,0sleep00-21swapper/023:54:380
372624129,8sleep50-21swapper/519:08:405
366324123,14sleep00-21swapper/019:07:470
198472410,0sleep10-21swapper/123:31:411
171462410,0sleep50-21swapper/521:35:085
137952410,0sleep50-21swapper/500:25:355
80132400,0sleep20-21swapper/223:09:562
5952400,0sleep30-21swapper/322:04:223
377324028,8sleep30-21swapper/319:09:183
354724028,9sleep40-21swapper/419:06:144
350124028,8sleep70-21swapper/719:05:377
348224028,9sleep60-21swapper/619:05:206
100672400,0sleep40-21swapper/421:24:264
352223928,8sleep10-21swapper/119:05:551
206672380,0sleep30-21swapper/319:34:473
89352370,0sleep20-21swapper/200:01:132
297512370,0sleep50-21swapper/522:31:145
268342370,0sleep40-21swapper/400:23:414
175942370,0sleep50-21swapper/523:00:465
196312300,0sleep3784-21runrttasks00:33:103
279672230,0sleep00-21swapper/021:39:440
392799200,5cyclictest8874-21cp21:14:075
392799181,3cyclictest57-21ksoftirqd/523:08:085
392799180,2cyclictest0-21swapper/522:11:545
3921991815,2cyclictest25-21ksoftirqd/123:27:321
3921991813,3cyclictest25-21ksoftirqd/123:35:561
392199181,2cyclictest131rcu_sched22:41:331
392799171,3cyclictest57-21ksoftirqd/523:24:505
392799170,1cyclictest0-21swapper/500:04:475
3921991715,1cyclictest25-21ksoftirqd/121:09:451
3921991714,3cyclictest25-21ksoftirqd/100:04:181
3921991712,3cyclictest25-21ksoftirqd/122:11:521
392199170,1cyclictest0-21swapper/123:48:291
392799161,3cyclictest57-21ksoftirqd/523:37:575
392799161,2cyclictest57-21ksoftirqd/521:53:465
392799161,2cyclictest19094-21bash00:29:405
392799160,3cyclictest0-21swapper/523:32:315
392799160,1cyclictest0-21swapper/521:42:435
392799160,1cyclictest0-21swapper/500:10:515
392799160,0cyclictest0-21swapper/521:25:255
3921991615,1cyclictest25-21ksoftirqd/122:56:111
3921991615,1cyclictest21448-21kworker/1:422:28:581
3921991614,1cyclictest25-21ksoftirqd/122:44:381
3921991614,1cyclictest25-21ksoftirqd/121:19:271
3921991614,1cyclictest25-21ksoftirqd/100:24:411
392799152,2cyclictest885-21polkitd21:45:025
392799151,3cyclictest57-21ksoftirqd/521:15:415
392799151,3cyclictest0-21swapper/500:37:195
392799151,1cyclictest0-21swapper/522:51:315
392799151,1cyclictest0-21swapper/522:51:315
392799150,3cyclictest0-21swapper/522:14:405
392799150,1cyclictest0-21swapper/523:16:405
392799150,1cyclictest0-21swapper/522:04:415
392799150,0cyclictest0-21swapper/522:20:235
3921991514,1cyclictest606-21kworker/1:023:59:051
3921991514,1cyclictest25-21ksoftirqd/123:39:271
3921991514,1cyclictest25-21ksoftirqd/100:34:461
3921991513,1cyclictest25-21ksoftirqd/123:17:421
3921991513,1cyclictest25-21ksoftirqd/123:09:301
3921991513,1cyclictest25-21ksoftirqd/122:23:371
3921991513,1cyclictest25-21ksoftirqd/122:00:011
3921991513,1cyclictest25-21ksoftirqd/121:44:021
3921991513,1cyclictest25-21ksoftirqd/121:36:591
3921991513,1cyclictest25-21ksoftirqd/121:28:151
3921991513,1cyclictest25-21ksoftirqd/100:19:141
3921991512,1cyclictest25-21ksoftirqd/123:04:161
3921991512,1cyclictest25-21ksoftirqd/121:29:281
392199151,2cyclictest121rcu_preempt21:46:401
392199150,3cyclictest121rcu_preempt00:30:141
392199150,2cyclictest121rcu_preempt21:52:011
392199150,1cyclictest131rcu_sched22:51:501
392199150,1cyclictest131rcu_sched22:51:501
392199150,1cyclictest131rcu_sched22:34:431
277782150,1sleep4471rcuc/423:46:094
104252150,1sleep449-21ksoftirqd/422:29:214
3928991412,1cyclictest65-21ksoftirqd/622:31:536
392799141,3cyclictest57-21ksoftirqd/522:41:045
392799141,3cyclictest0-21swapper/500:15:385
392799141,2cyclictest686-21dbus-daemon21:22:465
392799141,2cyclictest25112-21sshd23:52:465
392799141,2cyclictest0-21swapper/522:58:015
392799141,1cyclictest1009-21systemd-cgroups22:00:455
392799141,1cyclictest0-21swapper/522:25:125
392799140,5cyclictest24683-21systemd22:44:365
392799140,3cyclictest0-21swapper/523:48:115
392799140,2cyclictest57-21ksoftirqd/523:44:115
392799140,2cyclictest0-21swapper/522:35:595
392799140,1cyclictest0-21swapper/523:09:415
392799140,1cyclictest0-21swapper/521:56:355
392799140,1cyclictest0-21swapper/521:56:355
3921991413,1cyclictest25-21ksoftirqd/122:04:481
3921991413,1cyclictest25-21ksoftirqd/121:19:421
3921991413,1cyclictest25-21ksoftirqd/100:06:101
3921991412,1cyclictest25-21ksoftirqd/123:04:421
3921991412,1cyclictest25-21ksoftirqd/122:31:011
3921991412,1cyclictest25-21ksoftirqd/122:17:021
3921991412,1cyclictest25-21ksoftirqd/121:54:381
3921991412,1cyclictest25-21ksoftirqd/121:54:381
3921991411,3cyclictest25-21ksoftirqd/100:09:491
392199141,2cyclictest131rcu_sched23:19:421
192212140,0sleep60-21swapper/622:16:266
89842130,0sleep20-21swapper/222:25:352
60892130,0sleep70-21swapper/722:28:527
392999139,1cyclictest4642-21systemd21:16:597
392899132,5cyclictest6028-21sshd21:13:496
392799139,3cyclictest4512-21bash00:21:125
392799131,3cyclictest57-21ksoftirqd/523:54:415
392799130,1cyclictest0-21swapper/523:20:335
3926991310,3cyclictest49-21ksoftirqd/423:39:054
3923991311,1cyclictest41-21ksoftirqd/322:26:543
392199138,3cyclictest25-21ksoftirqd/123:50:201
3921991311,1cyclictest25-21ksoftirqd/100:19:411
284392130,0sleep7721ktimersoftd/700:23:537
240582130,0sleep20-21swapper/200:16:272
392999126,1cyclictest73-21ksoftirqd/722:31:577
392999120,2cyclictest29610-21bash21:50:017
392999120,2cyclictest0-21swapper/719:29:427
392999120,11cyclictest2129-21systemd-cgroups00:24:317
392899122,4cyclictest691-21systemd-logind23:58:466
392899122,4cyclictest1366-21systemd-cgroups00:10:416
3928991210,1cyclictest0-21swapper/622:00:266
392899120,12cyclictest12717-21kworker/6:123:49:066
392899120,11cyclictest31445-21kworker/6:221:21:126
3927991211,1cyclictest57-21ksoftirqd/520:04:395
3927991211,1cyclictest57-21ksoftirqd/520:04:395
392799121,3cyclictest0-21swapper/500:00:415
392799120,0cyclictest0-21swapper/520:58:205
3926991210,1cyclictest49-21ksoftirqd/423:28:004
3926991210,1cyclictest49-21ksoftirqd/422:07:174
3926991210,1cyclictest49-21ksoftirqd/400:06:214
3926991210,1cyclictest0-21swapper/421:46:594
392699120,11cyclictest9712-21sshd00:25:074
392699120,11cyclictest24750-21sshd23:01:344
392699120,1cyclictest0-21swapper/422:58:404
3922991210,2cyclictest33-21ksoftirqd/200:34:092
3921991211,1cyclictest4534-21kworker/1:220:49:401
314372120,0sleep70-21swapper/721:33:267
101962129,1sleep426688-21kworker/4:121:51:264
392999119,1cyclictest73-21ksoftirqd/722:53:027
392999119,1cyclictest73-21ksoftirqd/722:53:027
392999117,3cyclictest73-21ksoftirqd/700:11:397
392999114,6cyclictest885-21polkitd21:11:237
392899119,1cyclictest65-21ksoftirqd/621:26:126
392899119,1cyclictest21233-21kworker/6:623:02:446
392899111,4cyclictest691-21systemd-logind23:12:286
392899110,5cyclictest12278-21kill21:31:156
392899110,11cyclictest775-21gdbus21:44:506
392899110,11cyclictest3982-21kworker/6:323:40:316
392899110,11cyclictest27886-21kworker/6:022:46:146
392899110,11cyclictest26444-21kworker/6:322:39:366
392899110,11cyclictest24042-21kworker/6:522:19:556
392899110,11cyclictest2308-21bash00:04:026
392899110,11cyclictest21233-21kworker/6:622:57:526
392899110,11cyclictest16116-21kworker/6:322:14:266
392899110,11cyclictest1235-21kworker/6:121:38:376
392899110,11cyclictest0-21swapper/621:19:086
392799110,3cyclictest0-21swapper/521:09:045
392799110,2cyclictest0-21swapper/520:04:275
392699119,1cyclictest686-21dbus-daemon00:16:494
392699119,1cyclictest49-21ksoftirqd/421:28:034
392699119,1cyclictest22126-21irqstats23:04:434
392699118,2cyclictest19265-21grep00:36:284
392699112,5cyclictest1259-21systemd22:52:214
392699112,5cyclictest1259-21systemd22:52:214
3926991110,1cyclictest49-21ksoftirqd/423:10:464
3926991110,1cyclictest49-21ksoftirqd/421:14:464
392699110,10cyclictest30438-21systemd21:57:054
392699110,10cyclictest30438-21systemd21:57:054
392699110,10cyclictest27412-21sshd22:34:364
392699110,1cyclictest0-21swapper/423:32:294
392699110,1cyclictest0-21swapper/421:31:044
392399119,1cyclictest41-21ksoftirqd/323:45:463
392399112,6cyclictest885-21polkitd00:10:583
3923991110,1cyclictest0-21swapper/321:24:463
392399110,11cyclictest0-21swapper/323:09:413
392399110,10cyclictest30545-21sshd21:57:063
392399110,10cyclictest30545-21sshd21:57:063
392399110,10cyclictest0-21swapper/321:19:343
392299119,2cyclictest33-21ksoftirqd/200:06:592
392299119,1cyclictest33-21ksoftirqd/222:54:502
392299119,1cyclictest0-21swapper/222:41:012
392299118,2cyclictest686-21dbus-daemon22:46:412
392299111,4cyclictest27774-21systemd-cgroups23:53:032
392299110,11cyclictest8302-21kworker/2:121:17:542
392299110,11cyclictest14904-21kworker/2:200:37:342
392299110,10cyclictest492-21systemd-journal21:22:402
392099119,1cyclictest9-21ksoftirqd/000:03:530
392099116,1cyclictest9-21ksoftirqd/021:55:260
392099116,1cyclictest9-21ksoftirqd/021:55:260
392099111,9cyclictest4191-21sshd23:40:150
392099111,4cyclictest686-21dbus-daemon22:02:370
392099111,4cyclictest4407-21sshd23:06:130
392099111,4cyclictest405-21systemd-cgroups21:13:070
392099110,5cyclictest885-21polkitd22:44:490
392099110,11cyclictest30327-21kworker/0:022:05:180
276362112,1sleep773-21ksoftirqd/721:46:337
188702110,0sleep40-21swapper/421:42:124
92192100,0sleep40-21swapper/421:14:094
392999109,1cyclictest0-21swapper/723:29:587
392999108,1cyclictest73-21ksoftirqd/722:54:517
392999108,1cyclictest73-21ksoftirqd/721:38:137
392999107,2cyclictest15190-21grepconf.sh23:34:427
392999106,1cyclictest691-21systemd-logind00:03:117
392999105,3cyclictest13790-21grepconf.sh23:24:167
392999104,5cyclictest686-21dbus-daemon23:27:007
392999103,1cyclictest686-21dbus-daemon00:17:047
392899108,1cyclictest65-21ksoftirqd/623:05:326
392899103,1cyclictest691-21systemd-logind00:39:156
392899101,4cyclictest24708-21kworker/u16:500:06:146
392899100,4cyclictest17982-21systemd-cgroups21:52:176
392899100,4cyclictest0-21swapper/623:28:406
392899100,4cyclictest0-21swapper/600:16:136
392899100,10cyclictest0-21swapper/622:51:226
392899100,10cyclictest0-21swapper/622:51:226
392899100,10cyclictest0-21swapper/621:41:226
392799101,3cyclictest0-21swapper/519:34:395
392799100,3cyclictest0-21swapper/519:39:505
392799100,3cyclictest0-21swapper/519:39:505
392799100,1cyclictest0-21swapper/519:44:455
392699109,1cyclictest49-21ksoftirqd/423:56:594
392699109,1cyclictest49-21ksoftirqd/423:50:174
392699109,1cyclictest49-21ksoftirqd/422:24:244
392699109,1cyclictest15-21kswork23:40:514
392699108,1cyclictest49-21ksoftirqd/400:33:034
392699108,1cyclictest29128-21systemctl22:44:514
392699104,3cyclictest686-21dbus-daemon23:15:494
392699102,5cyclictest20411-21systemd21:35:314
392399109,1cyclictest41-21ksoftirqd/322:31:523
392399109,1cyclictest0-21swapper/300:24:393
392399109,1cyclictest0-21swapper/300:17:243
392399108,2cyclictest41-21ksoftirqd/300:36:453
392399103,4cyclictest26106-21systemd21:12:003
392399103,4cyclictest21653-21systemd23:42:103
392399102,5cyclictest29752-21kill23:36:103
392399102,1cyclictest22920-21sshd21:52:503
3923991010,0cyclictest0-21swapper/322:57:473
392399101,5cyclictest0-21swapper/321:36:523
392399100,10cyclictest0-21swapper/322:44:133
392299103,6cyclictest686-21dbus-daemon23:41:382
392299103,6cyclictest14047-21systemd-cgroups22:15:522
392299100,10cyclictest9752-21kworker/2:222:20:212
392299100,10cyclictest31054-21kworker/2:223:19:362
392299100,10cyclictest31054-21kworker/2:223:16:582
392299100,10cyclictest19714-21kworker/2:123:32:112
392299100,10cyclictest15422-21kworker/2:321:43:552
392299100,10cyclictest14904-21kworker/2:200:24:192
392299100,10cyclictest12581-21kworker/2:521:33:092
392299100,10cyclictest1205-21kworker/2:100:27:042
392199109,1cyclictest4534-21kworker/1:219:24:441
392199109,1cyclictest25-21ksoftirqd/120:49:271
392199108,1cyclictest25-21ksoftirqd/120:54:401
392099108,1cyclictest32589-21sshd22:31:370
392099104,5cyclictest31487-21systemd21:16:230
392099102,7cyclictest885-21polkitd00:24:270
392099102,7cyclictest10025-21sshd00:18:280
392099102,4cyclictest885-21polkitd22:29:210
392099101,3cyclictest0-21swapper/022:39:500
392099100,7cyclictest492-21systemd-journal23:21:210
392099100,10cyclictest0-21swapper/000:11:280
303902100,0sleep30-21swapper/321:29:463
9078290,0sleep31-21systemd22:11:583
39299999,0cyclictest0-21swapper/721:27:377
39299992,4cyclictest885-21polkitd23:58:327
39299992,4cyclictest7254-21cp23:03:127
39299992,4cyclictest691-21systemd-logind22:18:027
39299992,4cyclictest11717-21nscd21:19:347
39299992,4cyclictest10812-21users21:54:497
39299992,4cyclictest10812-21users21:54:497
39299992,1cyclictest31085-21sshd00:34:277
39299990,9cyclictest23663-21kworker/7:423:12:157
39299990,9cyclictest0-21swapper/723:48:247
39299990,9cyclictest0-21swapper/722:43:467
39299990,8cyclictest21415-21kworker/7:123:15:067
39289994,2cyclictest32247-21grep22:07:396
39289993,6cyclictest686-21dbus-daemon23:30:256
39289993,2cyclictest22179-21systemd23:38:566
39289993,1cyclictest0-21swapper/623:16:356
39289992,3cyclictest32392-21systemd-cgroups23:49:576
39289992,1cyclictest27234-21systemd-cgroups00:20:086
39289990,9cyclictest0-21swapper/622:26:276
39289990,3cyclictest0-21swapper/621:54:406
39289990,3cyclictest0-21swapper/621:54:406
39289990,3cyclictest0-21swapper/600:31:026
39279998,1cyclictest57-21ksoftirqd/520:09:465
39279998,1cyclictest57-21ksoftirqd/519:54:425
39279997,0cyclictest57-21ksoftirqd/520:49:565
39279991,4cyclictest0-21swapper/520:39:385
39279991,3cyclictest57-21ksoftirqd/519:09:435
39279991,1cyclictest57-21ksoftirqd/520:59:465
39279991,1cyclictest57-21ksoftirqd/520:30:275
39279991,1cyclictest57-21ksoftirqd/520:19:425
39279991,1cyclictest57-21ksoftirqd/520:14:455
39279991,1cyclictest57-21ksoftirqd/519:16:335
39279991,1cyclictest0-21swapper/519:50:445
39279991,1cyclictest0-21swapper/519:29:585
39279990,4cyclictest0-21swapper/519:19:465
39279990,2cyclictest0-21swapper/520:34:575
39279990,1cyclictest57-21ksoftirqd/520:48:465
39269998,1cyclictest49-21ksoftirqd/400:10:064
39269997,1cyclictest49-21ksoftirqd/422:10:294
39269994,2cyclictest10235-21bash22:15:264
39269992,4cyclictest13121-21sd-pam22:39:474
39269991,5cyclictest1-21systemd22:00:024
39269990,9cyclictest0-21swapper/420:09:434
39239999,0cyclictest0-21swapper/323:00:563
39239999,0cyclictest0-21swapper/321:47:193
39239997,1cyclictest41-21ksoftirqd/323:50:343
39239997,1cyclictest41-21ksoftirqd/300:21:173
39239997,1cyclictest15-21kswork22:49:533
39239997,1cyclictest15-21kswork22:49:533
39239997,1cyclictest0-21swapper/322:06:043
39239996,1cyclictest41-21ksoftirqd/300:07:373
39239993,5cyclictest763-21NetworkManager23:21:553
39239993,3cyclictest723-21in:imjournal22:44:273
39239993,3cyclictest686-21dbus-daemon21:15:483
39239993,3cyclictest4957-21idleruntime-cro21:04:273
39239993,3cyclictest4716-21sshd23:29:593
39239993,2cyclictest885-21polkitd23:56:563
39239993,2cyclictest835-21lldpd22:20:013
39239993,2cyclictest32573-21systemd22:34:583
39239992,4cyclictest1-21systemd00:00:513
39239992,4cyclictest0-21swapper/321:40:423
39239990,9cyclictest0-21swapper/323:08:213
39229998,1cyclictest22456-21sshd21:52:462
39229998,1cyclictest0-21swapper/200:14:022
39229997,1cyclictest33-21ksoftirqd/222:34:382
39229993,6cyclictest686-21dbus-daemon22:01:582
39229992,4cyclictest686-21dbus-daemon21:13:512
39229990,8cyclictest2705-21kworker/2:023:35:152
39229990,4cyclictest0-21swapper/222:29:272
39229990,4cyclictest0-21swapper/221:36:542
39229990,0cyclictest0-21swapper/223:09:142
39219999,0cyclictest4534-21kworker/1:219:59:441
39219999,0cyclictest4534-21kworker/1:219:37:121
39219998,1cyclictest25-21ksoftirqd/120:39:481
39219997,1cyclictest25-21ksoftirqd/121:09:271
39219990,9cyclictest0-21swapper/119:54:491
39209999,0cyclictest0-21swapper/021:19:370
39209997,1cyclictest9-21ksoftirqd/023:52:570
39209997,1cyclictest9-21ksoftirqd/023:34:290
39209997,1cyclictest9-21ksoftirqd/021:44:320
39209997,1cyclictest686-21dbus-daemon23:25:350
39209995,1cyclictest10149-21kworker/0:322:50:550
39209995,1cyclictest10149-21kworker/0:322:50:550
39209993,6cyclictest0-21swapper/023:11:510
39209993,3cyclictest686-21dbus-daemon00:37:180
39209993,1cyclictest0-21swapper/022:14:560
39209992,6cyclictest686-21dbus-daemon22:10:000
39209992,4cyclictest885-21polkitd00:05:250
39209992,1cyclictest885-21polkitd21:51:370
39209992,1cyclictest0-21swapper/023:01:530
39209991,3cyclictest0-21swapper/021:34:530
39209990,9cyclictest0-21swapper/022:35:560
39209990,4cyclictest691-21systemd-logind23:18:460
39209990,4cyclictest24170-21sshd00:30:030
39209990,4cyclictest13273-21sd-pam00:22:100
15245290,1sleep71-21systemd00:05:127
11264290,0sleep20-21swapper/222:12:132
39299987,1cyclictest73-21ksoftirqd/722:01:177
39299985,2cyclictest686-21dbus-daemon23:49:467
39299984,1cyclictest686-21dbus-daemon23:40:297
39299983,4cyclictest23835-21systemd22:44:307
39299982,3cyclictest691-21systemd-logind22:36:087
39299980,8cyclictest13398-21kworker/7:022:20:067
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional