You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 05:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon Dec 15, 2025 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
161092450,0sleep10-21swapper/122:54:391
282872440,0sleep00-21swapper/000:27:350
2054524432,9sleep40-21swapper/419:08:374
176962420,0sleep10-21swapper/122:18:431
294302410,0sleep10-21swapper/123:51:411
2053524124,13sleep30-21swapper/319:08:283
2051924130,8sleep20-21swapper/219:08:192
2054724027,9sleep60-21swapper/619:08:396
2052624028,8sleep70-21swapper/719:08:247
2063923927,8sleep00-21swapper/019:09:530
2053723926,9sleep50-21swapper/519:08:305
195372380,0sleep20-21swapper/200:07:432
1823223826,9sleep10-21swapper/119:05:531
144282380,0sleep60-21swapper/623:24:316
106372380,0sleep70-21swapper/721:11:467
71022330,2sleep52089599cyclictest22:40:575
20911991813,1cyclictest16769-21systemd21:06:507
2087199180,2cyclictest0-21swapper/223:21:262
20871991712,3cyclictest33-21ksoftirqd/200:18:102
2087199170,16cyclictest32014-21kworker/2:400:29:002
2087199169,4cyclictest492-21systemd-journal23:59:392
20871991614,1cyclictest33-21ksoftirqd/223:50:552
20871991612,4cyclictest33-21ksoftirqd/221:57:052
20871991612,4cyclictest33-21ksoftirqd/221:21:562
2087199159,4cyclictest33-21ksoftirqd/223:48:132
2087199159,3cyclictest33-21ksoftirqd/221:04:102
20871991514,1cyclictest33-21ksoftirqd/223:18:492
20871991514,1cyclictest33-21ksoftirqd/222:20:572
20871991514,0cyclictest13550irq/24-ahci[00021:18:382
20871991513,1cyclictest33-21ksoftirqd/200:30:242
20871991512,2cyclictest33-21ksoftirqd/221:46:512
2087199150,14cyclictest8291-21kworker/2:222:46:132
2087199150,1cyclictest121rcu_preempt23:34:582
142752150,0sleep60-21swapper/600:06:516
112292150,1sleep6631rcuc/600:36:466
20887991412,1cyclictest1-21systemd21:32:024
20871991413,1cyclictest33-21ksoftirqd/222:37:392
20871991413,1cyclictest33-21ksoftirqd/222:32:302
20871991413,1cyclictest33-21ksoftirqd/222:26:442
20871991413,1cyclictest33-21ksoftirqd/222:26:442
20871991412,2cyclictest33-21ksoftirqd/200:39:242
20871991412,1cyclictest492-21systemd-journal22:55:592
20871991412,1cyclictest33-21ksoftirqd/223:03:342
20871991410,2cyclictest33-21ksoftirqd/221:52:072
2087199140,14cyclictest11621-21kworker/2:221:10:192
2085299149,1cyclictest30979-21sshd23:27:250
2085299142,9cyclictest0-21swapper/020:16:230
177752140,0sleep417772-21systemd23:31:174
2091199138,1cyclictest10865-21systemd-cgroups00:06:227
2090399132,5cyclictest885-21polkitd21:42:036
20895991311,1cyclictest1-21systemd23:05:185
2089599130,12cyclictest6401-21sshd00:11:385
2088799134,8cyclictest25124-21systemd23:56:504
2088799130,12cyclictest20784-21sshd21:07:244
2087199139,4cyclictest33-21ksoftirqd/221:25:072
20871991312,1cyclictest33-21ksoftirqd/222:50:062
20871991312,1cyclictest33-21ksoftirqd/222:07:422
20871991312,1cyclictest33-21ksoftirqd/221:41:532
20871991312,1cyclictest33-21ksoftirqd/200:01:582
20871991311,1cyclictest33-21ksoftirqd/223:41:492
20871991311,1cyclictest33-21ksoftirqd/223:33:452
20871991311,1cyclictest33-21ksoftirqd/222:41:362
20871991311,1cyclictest33-21ksoftirqd/222:00:552
20871991311,1cyclictest33-21ksoftirqd/221:32:172
2087199130,12cyclictest2377-21kworker/2:022:13:592
2085299138,4cyclictest492-21systemd-journal00:30:330
2085299134,5cyclictest691-21systemd-logind23:11:490
2085299134,5cyclictest18111-21/usr/sbin/munin21:24:550
20852991311,1cyclictest0-21swapper/022:45:580
2085299131,9cyclictest0-21swapper/020:25:030
2085299131,9cyclictest0-21swapper/020:25:030
2085299131,3cyclictest492-21systemd-journal23:55:510
2085299131,2cyclictest2062-21systemd23:16:150
2085299130,5cyclictest0-21swapper/023:20:110
2085299130,12cyclictest17977-21bash22:54:570
2085299130,10cyclictest0-21swapper/020:13:290
20911991211,1cyclictest73-21ksoftirqd/721:27:587
20911991211,1cyclictest73-21ksoftirqd/700:21:357
20911991210,1cyclictest0-21swapper/723:21:527
2090399121,5cyclictest23971-21systemd22:26:036
2090399121,5cyclictest23971-21systemd22:26:036
20895991210,1cyclictest57-21ksoftirqd/521:50:285
20895991210,1cyclictest21365-21systemd23:19:485
2089599120,11cyclictest5241-21systemd00:35:365
2088799124,7cyclictest686-21dbus-daemon22:10:354
2088799124,7cyclictest686-21dbus-daemon21:45:044
2088799124,7cyclictest5186-21kill23:04:404
2088799124,7cyclictest4002-21grepconf.sh00:35:214
2088799124,7cyclictest28371-21grep00:15:394
2088799124,7cyclictest14187-21systemd00:25:074
2088799124,7cyclictest10409-21systemctl21:59:244
2088799124,7cyclictest1-21systemd00:01:294
2088799122,2cyclictest27265-21systemd22:44:394
20887991211,1cyclictest49-21ksoftirqd/400:30:154
2088799121,10cyclictest1-21systemd21:20:074
2088799120,2cyclictest3696-21bash00:23:004
2088799120,11cyclictest0-21swapper/423:08:074
2087999121,1cyclictest711-21nscd21:59:283
2087999120,11cyclictest11260-21sshd23:05:503
2087199128,1cyclictest33-21ksoftirqd/223:12:532
20871991211,1cyclictest33-21ksoftirqd/223:29:162
20871991211,1cyclictest33-21ksoftirqd/200:11:042
20871991210,2cyclictest33-21ksoftirqd/222:18:432
20871991210,1cyclictest33-21ksoftirqd/221:36:402
20871991210,1cyclictest33-21ksoftirqd/221:07:362
2087199121,1cyclictest121rcu_preempt00:22:432
2086099123,5cyclictest686-21dbus-daemon23:30:071
2086099120,11cyclictest1-21systemd21:41:081
2085299125,4cyclictest0-21swapper/019:13:330
2085299125,0cyclictest0-21swapper/021:33:090
2085299123,9cyclictest0-21swapper/019:59:030
20852991211,1cyclictest9-21ksoftirqd/023:44:570
2085299120,9cyclictest0-21swapper/020:30:150
2085299120,9cyclictest0-21swapper/019:48:190
2085299120,9cyclictest0-21swapper/019:39:590
2085299120,2cyclictest492-21systemd-journal23:33:190
2085299120,11cyclictest27302-21bash22:26:440
2085299120,11cyclictest27302-21bash22:26:440
102852120,0sleep00-21swapper/021:29:250
20911991110,1cyclictest73-21ksoftirqd/723:38:317
20911991110,1cyclictest73-21ksoftirqd/721:31:027
20911991110,1cyclictest73-21ksoftirqd/700:26:267
2091199110,10cyclictest686-21dbus-daemon00:39:167
20903991110,1cyclictest0-21swapper/621:37:316
2090399111,4cyclictest686-21dbus-daemon21:52:396
2090399111,4cyclictest0-21swapper/600:34:566
2090399110,4cyclictest0-21swapper/623:17:596
2090399110,11cyclictest29621-21kworker/6:200:14:226
2090399110,11cyclictest22253-21kworker/6:322:56:366
2090399110,11cyclictest18160-21kworker/6:100:15:236
2090399110,11cyclictest15530-21kworker/6:022:42:256
2090399110,11cyclictest0-21swapper/621:34:316
2090399110,10cyclictest1-21systemd22:22:276
2089599119,1cyclictest57-21ksoftirqd/522:32:375
2089599119,1cyclictest57-21ksoftirqd/521:58:575
2089599119,1cyclictest1-21systemd22:37:205
2089599119,1cyclictest1-21systemd22:21:325
2089599117,3cyclictest57-21ksoftirqd/523:25:305
2089599110,2cyclictest23965-21ystemctl00:08:385
2088799114,6cyclictest686-21dbus-daemon22:26:264
2088799114,6cyclictest686-21dbus-daemon22:26:264
2088799114,6cyclictest6732-21ystemctl23:22:564
2088799114,6cyclictest6495-21grepconf.sh23:47:014
2088799114,6cyclictest25909-21ystemctl22:50:264
2088799114,6cyclictest22227-21sshd23:19:554
2088799114,6cyclictest19580-21kill22:55:164
2088799114,6cyclictest16849-21bash23:24:564
2088799114,2cyclictest9790-21systemd22:47:134
2088799113,7cyclictest31104-21ystemctl22:21:244
2088799113,7cyclictest25922-21systemd21:50:174
2088799113,3cyclictest3844-21bash23:10:274
2088799113,3cyclictest11652-21sshd21:17:314
2088799113,2cyclictest686-21dbus-daemon21:10:194
2088799112,2cyclictest1-21systemd21:25:544
2088799112,1cyclictest686-21dbus-daemon21:39:584
2088799111,2cyclictest885-21polkitd22:04:304
2088799111,2cyclictest686-21dbus-daemon21:37:064
2088799110,5cyclictest686-21dbus-daemon00:13:164
2088799110,4cyclictest0-21swapper/422:35:224
2088799110,2cyclictest23751-21systemd-cgroups23:50:314
2087999114,6cyclictest887-21gdbus22:37:103
2087999112,4cyclictest691-21systemd-logind23:19:413
2087999111,4cyclictest686-21dbus-daemon23:32:403
2087999110,5cyclictest885-21polkitd23:36:143
2087999110,2cyclictest4885-21grepconf.sh23:22:333
2087999110,2cyclictest2865-21sshd23:40:313
2087999110,11cyclictest6210-21kworker/3:222:43:103
2087999110,11cyclictest6210-21kworker/3:222:28:333
2087999110,11cyclictest6210-21kworker/3:222:28:333
2087999110,11cyclictest24773-21kworker/3:023:28:383
2087999110,1cyclictest0-21swapper/320:56:523
2087199117,3cyclictest33-21ksoftirqd/223:05:072
20871991110,1cyclictest33-21ksoftirqd/220:51:562
2086099119,1cyclictest25-21ksoftirqd/123:25:221
2086099119,1cyclictest25-21ksoftirqd/122:08:311
2085299118,1cyclictest7279-21systemd23:35:170
2085299117,3cyclictest691-21systemd-logind22:33:250
2085299114,6cyclictest25814-21sshd22:50:250
2085299114,4cyclictest0-21swapper/020:51:110
2085299114,4cyclictest0-21swapper/020:40:050
2085299114,4cyclictest0-21swapper/019:24:310
2085299114,4cyclictest0-21swapper/019:19:310
20852991110,1cyclictest9-21ksoftirqd/021:09:040
20852991110,1cyclictest9-21ksoftirqd/000:36:230
2085299111,10cyclictest0-21swapper/023:05:190
2085299111,10cyclictest0-21swapper/000:23:230
2085299110,7cyclictest0-21swapper/021:50:230
2085299110,7cyclictest0-21swapper/019:38:130
2085299110,7cyclictest0-21swapper/019:38:130
2085299110,6cyclictest0-21swapper/023:40:110
2085299110,10cyclictest19034-21systemd-cgroups22:42:580
2085299110,1cyclictest1116-21nfsd20:46:530
2091199109,1cyclictest73-21ksoftirqd/723:28:237
2091199107,1cyclictest73-21ksoftirqd/721:20:277
2091199103,4cyclictest686-21dbus-daemon23:03:107
2091199102,5cyclictest691-21systemd-logind21:19:507
2091199100,10cyclictest0-21swapper/723:33:517
2091199100,10cyclictest0-21swapper/721:37:587
2091199100,1cyclictest0-21swapper/700:10:067
2090399109,1cyclictest65-21ksoftirqd/623:02:146
2090399109,1cyclictest65-21ksoftirqd/622:33:446
2090399108,1cyclictest65-21ksoftirqd/600:00:266
2090399103,6cyclictest691-21systemd-logind23:46:186
2090399103,6cyclictest686-21dbus-daemon23:43:196
2090399100,4cyclictest14181-21systemd22:48:076
2090399100,4cyclictest14065-21systemd-cgroups21:24:066
2090399100,10cyclictest25663-21kworker/6:421:59:416
2090399100,10cyclictest25440-21kworker/6:322:35:316
2090399100,10cyclictest2042-21kworker/6:223:12:476
2090399100,10cyclictest1363-21kworker/6:421:17:126
2089599109,1cyclictest57-21ksoftirqd/522:56:505
2089599109,1cyclictest57-21ksoftirqd/521:38:345
2089599108,1cyclictest57-21ksoftirqd/522:09:445
2089599108,1cyclictest1-21systemd21:45:585
2089599107,2cyclictest691-21systemd-logind21:05:385
2089599104,3cyclictest763-21NetworkManager00:01:265
2089599103,3cyclictest0-21swapper/521:16:345
2089599102,4cyclictest686-21dbus-daemon00:23:285
2089599100,10cyclictest0-21swapper/521:40:085
2088799104,5cyclictest4467-21kill00:05:024
2088799104,5cyclictest13200-21grepconf.sh22:29:574
2088799103,1cyclictest786-21snmpd19:30:354
2088799102,2cyclictest786-21snmpd20:37:314
2088799102,2cyclictest0-21swapper/419:14:254
2088799102,1cyclictest0-21swapper/423:35:144
2088799101,2cyclictest885-21polkitd22:15:104
2088799101,2cyclictest8370-21systemd22:05:004
2088799100,3cyclictest32651-21systemd23:40:004
2088799100,2cyclictest19934-21systemd21:01:424
2087999103,6cyclictest885-21polkitd23:00:323
2087999103,6cyclictest885-21polkitd21:18:203
2087999102,3cyclictest32376-21sshd22:33:283
2087999101,8cyclictest18004-21systemctl00:25:543
2087999100,10cyclictest4658-21kworker/3:022:58:003
2087999100,10cyclictest24100-21kworker/3:123:50:463
2087999100,10cyclictest21451-21kworker/3:421:09:073
2087999100,10cyclictest18088-21kworker/3:121:26:033
2087999100,10cyclictest16535-21kworker/3:300:15:083
2087999100,10cyclictest10051-21kworker/3:400:38:403
2087199109,1cyclictest33-21ksoftirqd/219:54:562
2086099109,1cyclictest0-21swapper/122:00:501
2086099109,1cyclictest0-21swapper/121:30:251
2086099103,4cyclictest691-21systemd-logind21:37:201
2086099100,1cyclictest691-21systemd-logind21:15:261
2085299104,3cyclictest0-21swapper/020:59:370
2085299101,9cyclictest0-21swapper/020:01:590
2085299100,6cyclictest0-21swapper/000:04:150
2085299100,10cyclictest0-21swapper/023:52:170
2085299100,10cyclictest0-21swapper/023:03:210
2085299100,10cyclictest0-21swapper/022:13:470
2085299100,10cyclictest0-21swapper/022:00:070
2085299100,10cyclictest0-21swapper/021:57:510
2085299100,10cyclictest0-21swapper/021:48:030
2085299100,10cyclictest0-21swapper/021:18:550
2085299100,10cyclictest0-21swapper/021:14:290
2085299100,10cyclictest0-21swapper/021:03:210
2085299100,10cyclictest0-21swapper/020:09:270
2085299100,10cyclictest0-21swapper/019:51:570
2085299100,10cyclictest0-21swapper/000:18:330
2085299100,10cyclictest0-21swapper/000:14:330
2085299100,10cyclictest0-21swapper/000:05:190
2085299100,0cyclictest101ktimersoftd/022:36:530
209119999,0cyclictest0-21swapper/700:30:177
209119997,1cyclictest73-21ksoftirqd/723:55:537
209119997,1cyclictest73-21ksoftirqd/723:10:137
209119997,1cyclictest73-21ksoftirqd/722:50:247
209119997,1cyclictest73-21ksoftirqd/722:10:387
209119997,1cyclictest73-21ksoftirqd/719:14:557
209119997,1cyclictest691-21systemd-logind22:32:377
209119996,1cyclictest721ktimersoftd/721:01:427
209119995,3cyclictest7103-21grep22:40:577
209119994,4cyclictest13445-21kworker/u16:000:19:497
209119994,1cyclictest0-21swapper/722:20:027
209119993,3cyclictest25703-21systemd21:50:147
209119993,3cyclictest2383-21systemd23:40:267
209119992,4cyclictest1-21systemd22:56:027
209119991,5cyclictest885-21polkitd21:49:057
209119990,9cyclictest0-21swapper/723:05:387
209119990,9cyclictest0-21swapper/722:49:237
209039999,0cyclictest0-21swapper/621:28:326
209039998,1cyclictest65-21ksoftirqd/622:15:406
209039993,6cyclictest0-21swapper/623:29:096
209039993,1cyclictest0-21swapper/600:22:286
209039992,6cyclictest885-21polkitd22:53:216
209039991,4cyclictest10557-21systemd-cgroups21:11:456
209039990,9cyclictest0-21swapper/623:52:306
209039990,9cyclictest0-21swapper/622:05:276
209039990,9cyclictest0-21swapper/622:02:286
209039990,9cyclictest0-21swapper/600:28:156
209039990,0cyclictest0-21swapper/623:55:186
209039990,0cyclictest0-21swapper/623:31:206
209039990,0cyclictest0-21swapper/622:10:286
209039990,0cyclictest0-21swapper/621:46:306
208959999,0cyclictest0-21swapper/522:04:065
208959999,0cyclictest0-21swapper/519:56:525
208959998,1cyclictest57-21ksoftirqd/500:25:435
208959998,1cyclictest27234-21kworker/u16:022:25:045
208959998,1cyclictest27234-21kworker/u16:022:25:045
208959998,1cyclictest0-21swapper/523:36:575
208959998,1cyclictest0-21swapper/523:04:005
208959998,1cyclictest0-21swapper/520:18:095
208959997,1cyclictest57-21ksoftirqd/523:55:405
208959997,1cyclictest57-21ksoftirqd/523:14:495
208959997,1cyclictest57-21ksoftirqd/500:31:155
208959997,1cyclictest0-21swapper/523:39:575
208959994,4cyclictest492-21systemd-journal23:20:555
208959993,3cyclictest7829-21systemd-cgroups21:11:125
208959991,4cyclictest18375-21systemd-cgroups22:12:455
208959990,8cyclictest2181-21sshd22:46:045
208959990,0cyclictest0-21swapper/521:34:085
208959990,0cyclictest0-21swapper/520:28:465
208959990,0cyclictest0-21swapper/520:28:465
208879993,2cyclictest786-21snmpd19:57:484
208879993,1cyclictest786-21snmpd20:29:434
208879993,1cyclictest786-21snmpd20:29:434
208879993,1cyclictest786-21snmpd20:22:574
208879993,1cyclictest786-21snmpd19:52:094
208879993,1cyclictest786-21snmpd19:40:264
208879993,1cyclictest786-21snmpd19:16:444
208879992,1cyclictest9776-21cat19:46:534
208879992,1cyclictest786-21snmpd20:09:064
208879992,1cyclictest16808-21expr20:56:474
208879991,2cyclictest3830-21grep20:31:554
208879991,2cyclictest32123-21latency_hist19:29:554
208879990,2cyclictest27553-21fschecks_time19:21:484
208799997,1cyclictest41-21ksoftirqd/322:11:523
208799997,1cyclictest11370-21iostat23:11:503
208799993,1cyclictest0-21swapper/322:01:573
208799992,6cyclictest885-21polkitd22:52:333
208799992,6cyclictest763-21NetworkManager21:53:403
208799992,6cyclictest691-21systemd-logind22:20:583
208799992,6cyclictest0-21swapper/300:20:223
208799992,6cyclictest0-21swapper/300:12:413
208799992,1cyclictest691-21systemd-logind21:12:203
208799990,9cyclictest21035-21sshd21:31:313
208799990,9cyclictest0-21swapper/323:49:303
208799990,9cyclictest0-21swapper/322:05:273
208799990,9cyclictest0-21swapper/300:31:273
208719998,1cyclictest33-21ksoftirqd/219:39:562
208719998,1cyclictest33-21ksoftirqd/219:39:562
208609998,1cyclictest25-21ksoftirqd/121:58:501
208609994,2cyclictest14431-21chrt22:30:121
208609992,4cyclictest492-21systemd-journal21:06:221
208609990,9cyclictest0-21swapper/122:59:571
208609990,9cyclictest0-21swapper/120:46:541
208609990,9cyclictest0-21swapper/100:00:201
208609990,0cyclictest0-21swapper/123:57:211
208609990,0cyclictest0-21swapper/122:26:321
208609990,0cyclictest0-21swapper/122:26:321
208609990,0cyclictest0-21swapper/121:24:251
208529997,1cyclictest11852-21cpuspeed_turbos21:41:480
208529995,4cyclictest9-21ksoftirqd/022:20:210
208529995,0cyclictest0-21swapper/019:28:470
208529993,3cyclictest1-21systemd22:15:460
208529993,3cyclictest0-21swapper/020:35:110
208529991,4cyclictest723-21in:imjournal22:07:330
208529990,8cyclictest17016-21kworker/0:121:35:020
208529990,6cyclictest0-21swapper/019:30:330
209119988,0cyclictest0-21swapper/719:21:087
209119987,1cyclictest73-21ksoftirqd/722:01:167
209119986,1cyclictest73-21ksoftirqd/723:50:297
209119986,1cyclictest73-21ksoftirqd/722:05:227
209119986,1cyclictest73-21ksoftirqd/720:29:567
209119986,1cyclictest73-21ksoftirqd/720:29:567
209119985,2cyclictest686-21dbus-daemon00:02:077
209119985,2cyclictest19902-21sd-pam21:55:097
209119983,3cyclictest15610-21sshd22:36:347
209119981,4cyclictest686-21dbus-daemon23:45:507
209119981,3cyclictest3019-21systemd21:40:017
209119981,3cyclictest28774-21sshd23:15:057
209119981,3cyclictest0-21swapper/722:15:327
209119980,8cyclictest22262-21kworker/7:322:26:457
209119980,8cyclictest22262-21kworker/7:322:26:457
209039982,6cyclictest0-21swapper/623:37:416
209039982,4cyclictest691-21systemd-logind21:02:006
209039981,3cyclictest885-21polkitd21:06:326
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional