You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-21 - 03:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun Dec 21, 2025 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9642750,0sleep0317799cyclictest23:32:530
234402560,0sleep10-21swapper/122:46:091
49162520,1sleep54920-21grepconf.sh21:31:415
273962510,1sleep427394-21grep23:01:414
262082510,0sleep626207-21systemd-cgroups23:32:116
300625027,8sleep60-21swapper/619:09:056
74882480,2sleep5322399cyclictest21:46:545
303224823,9sleep50-21swapper/519:09:285
289424825,8sleep20-21swapper/219:07:332
136882470,0sleep10-21swapper/122:08:531
273724634,8sleep30-21swapper/319:05:343
119902450,0sleep10-21swapper/100:23:071
108392450,0sleep70-21swapper/719:20:027
153502440,0sleep20-21swapper/200:04:582
144824423,17sleep00-21swapper/019:04:590
281224330,9sleep70-21swapper/719:06:347
129292430,0sleep212926-21systemd-cgroups00:20:042
325582420,0sleep20-21swapper/223:17:332
303124229,9sleep40-21swapper/419:09:274
35992410,0sleep60-21swapper/623:26:586
269712410,0sleep40-21swapper/423:38:254
172742410,0sleep50-21swapper/522:30:195
53292400,0sleep30-21swapper/322:41:223
46622400,1sleep04658-21sshd23:48:380
302824028,9sleep10-21swapper/119:09:241
152712400,2sleep1318399cyclictest21:41:381
229502390,0sleep70-21swapper/722:12:517
154302390,0sleep10-21swapper/121:17:431
282812380,0sleep40-21swapper/423:41:304
144002380,0sleep20-21swapper/223:58:502
121792380,0sleep50-21swapper/523:58:375
33172370,0sleep70-21swapper/722:41:107
105702370,0sleep50-21swapper/519:20:005
326422360,0sleep60-21swapper/623:48:126
177872360,0sleep00-21swapper/021:47:530
173402360,2sleep1318399cyclictest23:16:041
323099217,1cyclictest65-21ksoftirqd/622:53:076
3230992115,3cyclictest65-21ksoftirqd/623:10:456
323099195,1cyclictest65-21ksoftirqd/621:39:276
323099194,3cyclictest65-21ksoftirqd/622:46:326
323099194,3cyclictest65-21ksoftirqd/600:18:316
323099192,3cyclictest65-21ksoftirqd/621:44:376
3230991915,1cyclictest65-21ksoftirqd/623:58:086
132822190,0sleep60-21swapper/623:40:046
323099184,1cyclictest65-21ksoftirqd/623:17:086
3230991814,3cyclictest65-21ksoftirqd/600:39:326
3230991813,1cyclictest65-21ksoftirqd/623:24:426
3230991811,4cyclictest65-21ksoftirqd/622:34:456
323099178,1cyclictest65-21ksoftirqd/621:23:486
323099172,1cyclictest65-21ksoftirqd/621:30:226
3230991715,1cyclictest65-21ksoftirqd/623:59:446
3230991710,4cyclictest121rcu_preempt22:55:276
3230991710,4cyclictest121rcu_preempt22:55:276
323099171,1cyclictest65-21ksoftirqd/600:10:006
3211991715,1cyclictest15902-21sshd22:12:104
323099165,1cyclictest65-21ksoftirqd/621:49:556
323099162,1cyclictest65-21ksoftirqd/623:53:286
3230991615,1cyclictest65-21ksoftirqd/622:14:196
3230991614,1cyclictest65-21ksoftirqd/622:27:506
3230991614,1cyclictest65-21ksoftirqd/622:21:576
3230991614,1cyclictest65-21ksoftirqd/622:09:236
3230991614,1cyclictest65-21ksoftirqd/600:26:366
3230991614,1cyclictest1-21systemd21:15:096
3230991612,3cyclictest65-21ksoftirqd/621:45:436
3230991611,3cyclictest65-21ksoftirqd/622:39:546
317799160,16cyclictest0-21swapper/000:13:240
323099155,2cyclictest65-21ksoftirqd/621:09:596
323099153,2cyclictest65-21ksoftirqd/622:02:386
3230991514,1cyclictest65-21ksoftirqd/600:09:316
3230991513,1cyclictest65-21ksoftirqd/623:00:106
3230991513,1cyclictest65-21ksoftirqd/622:32:496
3230991513,1cyclictest65-21ksoftirqd/621:24:586
3230991512,3cyclictest65-21ksoftirqd/600:30:016
3230991512,1cyclictest65-21ksoftirqd/623:34:476
3230991512,1cyclictest65-21ksoftirqd/622:16:366
323099150,2cyclictest121rcu_preempt00:20:216
3223991514,1cyclictest57-21ksoftirqd/500:30:385
3223991513,1cyclictest492-21systemd-journal23:53:535
3204991514,1cyclictest41-21ksoftirqd/321:17:313
3183991513,1cyclictest25-21ksoftirqd/122:58:031
3183991513,1cyclictest25-21ksoftirqd/122:58:031
3183991513,1cyclictest25-21ksoftirqd/100:17:201
172512150,0sleep50-21swapper/500:02:055
3230991412,1cyclictest65-21ksoftirqd/623:06:246
3230991412,1cyclictest65-21ksoftirqd/621:54:506
3223991411,2cyclictest1-21systemd22:18:165
321199140,14cyclictest27357-21kworker/4:122:50:054
321199140,14cyclictest0-21swapper/423:50:314
3196991412,1cyclictest33-21ksoftirqd/222:55:052
3196991412,1cyclictest33-21ksoftirqd/222:55:052
3183991412,1cyclictest25-21ksoftirqd/122:37:271
3183991412,1cyclictest25-21ksoftirqd/121:55:241
3183991412,1cyclictest25-21ksoftirqd/100:39:151
3183991410,1cyclictest25-21ksoftirqd/121:28:151
168942140,1sleep21-21systemd21:41:472
140722140,2sleep1318399cyclictest22:51:211
322399139,3cyclictest15489-21systemd21:20:385
3223991311,1cyclictest57-21ksoftirqd/523:43:225
3211991312,1cyclictest49-21ksoftirqd/400:12:384
3204991312,1cyclictest41-21ksoftirqd/321:30:163
3204991312,1cyclictest41-21ksoftirqd/321:23:583
3183991312,1cyclictest25-21ksoftirqd/121:50:471
3183991311,1cyclictest25-21ksoftirqd/122:26:551
317799133,4cyclictest9544-21systemd-cgroups00:35:210
317799132,5cyclictest22257-21sshd23:22:420
3177991312,1cyclictest9-21ksoftirqd/022:10:590
315582130,0sleep20-21swapper/200:37:342
144052130,1sleep4686-21dbus-daemon00:29:354
77252120,1sleep341-21ksoftirqd/322:29:373
3237991210,1cyclictest73-21ksoftirqd/723:45:127
3237991210,1cyclictest1-21systemd23:58:517
3230991210,1cyclictest65-21ksoftirqd/619:44:436
322399128,3cyclictest57-21ksoftirqd/521:13:215
3223991210,1cyclictest57-21ksoftirqd/500:37:235
322399120,7cyclictest0-21swapper/522:40:385
321199122,4cyclictest763-21NetworkManager23:24:384
321199122,4cyclictest23961-21sshd21:27:274
320499125,3cyclictest41-21ksoftirqd/323:11:053
3204991211,1cyclictest41-21ksoftirqd/323:57:253
3204991211,1cyclictest41-21ksoftirqd/322:07:583
3204991211,1cyclictest41-21ksoftirqd/300:31:463
3204991210,1cyclictest41-21ksoftirqd/322:49:543
320499120,11cyclictest723-21in:imjournal22:03:323
319699129,2cyclictest21338-21systemd00:14:492
319699122,4cyclictest9284-21systemd-cgroups23:36:402
319699120,11cyclictest885-21polkitd21:15:532
318399124,5cyclictest696-21nscd23:46:521
3183991210,1cyclictest25-21ksoftirqd/123:25:031
3183991210,1cyclictest25-21ksoftirqd/123:11:071
3183991210,1cyclictest25-21ksoftirqd/123:05:501
3183991210,1cyclictest25-21ksoftirqd/122:12:191
3183991210,1cyclictest25-21ksoftirqd/121:30:231
3183991210,1cyclictest25-21ksoftirqd/100:05:121
317442120,0sleep00-21swapper/023:38:530
302092120,0sleep00-21swapper/021:52:020
202172120,0sleep10-21swapper/123:50:001
155172120,0sleep5561ktimersoftd/523:19:045
129432120,0sleep70-21swapper/723:00:167
111622120,0sleep40-21swapper/422:20:414
89382110,0sleep30-21swapper/323:45:533
50412110,2sleep588050irq/26-em1-tx-021:55:435
323799119,1cyclictest73-21ksoftirqd/721:42:507
323799119,1cyclictest73-21ksoftirqd/721:17:197
323799119,1cyclictest73-21ksoftirqd/700:35:387
323799115,3cyclictest23651-21grepconf.sh00:02:437
3237991110,1cyclictest73-21ksoftirqd/723:08:427
323799110,1cyclictest0-21swapper/721:34:087
322399119,2cyclictest723-21in:imjournal23:46:085
322399119,1cyclictest57-21ksoftirqd/523:21:015
322399119,1cyclictest3214-21ntp_states21:00:025
322399118,2cyclictest57-21ksoftirqd/500:17:265
322399110,10cyclictest31003-21systemd22:10:255
322399110,1cyclictest691-21systemd-logind23:04:585
321199116,1cyclictest27357-21kworker/4:122:41:274
3211991110,1cyclictest49-21ksoftirqd/423:45:464
321199111,4cyclictest686-21dbus-daemon21:12:564
321199111,4cyclictest28892-21sshd23:29:264
321199111,4cyclictest2570-21sshd22:32:044
321199111,4cyclictest16744-21sshd22:27:184
321199110,5cyclictest885-21polkitd21:22:384
321199110,11cyclictest30234-21kworker/4:422:57:134
321199110,11cyclictest30234-21kworker/4:422:57:134
321199110,11cyclictest18923-21systemd-cgroups22:03:174
321199110,11cyclictest0-21swapper/422:47:074
321199110,1cyclictest20315-21sshd21:33:104
320499119,1cyclictest41-21ksoftirqd/300:07:093
3204991110,1cyclictest41-21ksoftirqd/323:17:433
3204991110,1cyclictest41-21ksoftirqd/322:37:223
320499110,11cyclictest0-21swapper/322:47:223
319699119,1cyclictest1-21systemd23:33:592
3196991110,1cyclictest33-21ksoftirqd/222:45:512
319699111,4cyclictest686-21dbus-daemon21:35:052
319699111,4cyclictest686-21dbus-daemon00:25:432
319699110,11cyclictest6380-21kworker/2:222:14:282
319699110,11cyclictest6380-21kworker/2:221:50:472
319699110,11cyclictest13862-21kworker/2:223:43:552
319699110,10cyclictest691-21systemd-logind21:34:342
319699110,1cyclictest686-21dbus-daemon23:50:422
318399119,1cyclictest25-21ksoftirqd/123:23:351
318399119,1cyclictest25-21ksoftirqd/122:22:311
318399119,1cyclictest25-21ksoftirqd/122:00:031
318399119,1cyclictest25-21ksoftirqd/121:35:221
318399119,1cyclictest25-21ksoftirqd/100:33:421
318399119,1cyclictest0-21swapper/100:25:041
318399117,4cyclictest25-21ksoftirqd/122:18:081
318399117,3cyclictest25-21ksoftirqd/123:36:171
3183991110,1cyclictest25-21ksoftirqd/122:34:101
3183991110,1cyclictest25-21ksoftirqd/121:48:531
3183991110,1cyclictest25-21ksoftirqd/121:24:431
3183991110,1cyclictest25-21ksoftirqd/121:13:551
318399110,1cyclictest0-21swapper/123:33:501
317799114,6cyclictest686-21dbus-daemon21:39:100
317799112,4cyclictest1-21systemd22:53:050
3177991110,1cyclictest9-21ksoftirqd/022:33:360
3177991110,1cyclictest19967-21systemd22:48:590
317799111,4cyclictest5832-21systemd-cgroups21:28:510
317799110,2cyclictest28820-21bash21:42:560
317799110,11cyclictest14386-21kworker/0:122:57:480
317799110,11cyclictest14386-21kworker/0:122:57:480
317799110,10cyclictest11958-21sshd23:00:110
248372110,0sleep70-21swapper/700:18:177
323799109,1cyclictest0-21swapper/721:24:127
323799108,1cyclictest73-21ksoftirqd/723:31:437
323799108,1cyclictest73-21ksoftirqd/723:28:347
323799108,1cyclictest1-21systemd22:22:397
323799104,3cyclictest21462-21kworker/7:422:48:027
323799100,10cyclictest0-21swapper/723:23:047
323799100,10cyclictest0-21swapper/722:56:447
323799100,10cyclictest0-21swapper/722:56:447
323799100,10cyclictest0-21swapper/722:38:467
323799100,10cyclictest0-21swapper/722:26:387
323799100,10cyclictest0-21swapper/700:31:587
323799100,1cyclictest0-21swapper/722:53:537
322399109,1cyclictest57-21ksoftirqd/521:29:405
322399109,1cyclictest57-21ksoftirqd/521:19:435
322399107,2cyclictest57-21ksoftirqd/522:47:595
322399104,3cyclictest991-21kworker/u16:123:31:255
322399103,4cyclictest7628-21systemd00:22:425
322399102,5cyclictest15110-21sshd00:26:245
322399100,10cyclictest29641-21sshd21:51:585
322399100,10cyclictest0-21swapper/523:10:205
321199109,1cyclictest8602-21systemd23:55:044
321199104,1cyclictest49-21ksoftirqd/423:18:164
321199103,6cyclictest691-21systemd-logind00:39:134
321199103,6cyclictest0-21swapper/423:11:384
321199103,6cyclictest0-21swapper/400:20:044
321199103,4cyclictest6975-21kworker/4:221:36:454
321199103,1cyclictest0-21swapper/423:07:524
321199102,4cyclictest5011-21systemd23:30:054
321199102,4cyclictest11265-21systemd00:32:274
321199102,3cyclictest0-21swapper/421:53:004
321199101,4cyclictest585-21systemd00:03:394
321199101,4cyclictest0-21swapper/421:54:514
321199100,4cyclictest8934-21systemd-cgroups22:35:374
321199100,4cyclictest31619-21sshd21:16:104
321199100,10cyclictest28763-21kworker/4:022:06:354
321199100,10cyclictest18168-21kworker/4:000:08:224
320499109,1cyclictest41-21ksoftirqd/321:49:263
320499109,1cyclictest41-21ksoftirqd/321:42:233
320499103,4cyclictest1-21systemd23:30:133
320499101,3cyclictest29520-21systemd23:50:513
320499100,10cyclictest691-21systemd-logind23:23:563
320499100,10cyclictest22627-21sshd23:28:493
320499100,10cyclictest22165-21kworker/3:323:41:283
320499100,10cyclictest0-21swapper/322:14:443
320499100,0cyclictest0-21swapper/321:50:553
319699108,1cyclictest33-21ksoftirqd/223:49:372
319699107,2cyclictest6068-21sshd21:22:492
319699103,7cyclictest13550irq/24-ahci[00000:01:412
319699103,6cyclictest885-21polkitd22:02:222
319699103,6cyclictest0-21swapper/223:08:322
319699103,1cyclictest686-21dbus-daemon22:40:132
319699103,1cyclictest0-21swapper/222:21:112
319699101,9cyclictest0-21swapper/223:24:222
319699100,4cyclictest12144-21sshd21:56:262
319699100,4cyclictest11133-21systemd-cgroups22:35:492
319699100,10cyclictest6869-21kworker/2:121:14:322
319699100,10cyclictest23749-21kworker/2:300:30:132
319699100,10cyclictest20546-21kworker/2:022:54:062
319699100,10cyclictest19047-21kworker/2:321:45:122
318399108,1cyclictest25-21ksoftirqd/123:43:361
318399108,1cyclictest25-21ksoftirqd/123:00:071
318399108,1cyclictest25-21ksoftirqd/100:02:081
318399104,3cyclictest19125-21sshd23:59:171
317799108,1cyclictest11773-21sshd21:59:310
317799103,6cyclictest22172-21systemd22:15:410
317799103,6cyclictest0-21swapper/022:26:430
317799103,4cyclictest885-21polkitd22:06:280
317799103,4cyclictest691-21systemd-logind21:18:170
317799100,5cyclictest885-21polkitd22:22:140
317799100,4cyclictest27668-21sshd00:27:410
317799100,10cyclictest30445-21kworker/0:400:33:230
317799100,10cyclictest30439-21kworker/0:200:19:270
317799100,10cyclictest30439-21kworker/0:200:09:100
317799100,10cyclictest2831-21kworker/0:021:11:590
317799100,10cyclictest20757-21kworker/0:523:55:190
317799100,10cyclictest15799-21kworker/0:023:50:310
317799100,10cyclictest1314-21kworker/0:422:02:590
317799100,10cyclictest0-21swapper/023:10:540
273342100,0sleep31-21systemd21:24:503
32379999,0cyclictest0-21swapper/721:12:517
32379998,1cyclictest73-21ksoftirqd/723:10:207
32379998,1cyclictest73-21ksoftirqd/721:47:497
32379998,1cyclictest0-21swapper/721:27:407
32379997,1cyclictest73-21ksoftirqd/722:06:477
32379997,1cyclictest73-21ksoftirqd/721:54:577
32379997,1cyclictest73-21ksoftirqd/700:25:517
32379996,1cyclictest885-21polkitd00:21:567
32379995,3cyclictest691-21systemd-logind23:51:297
32379995,1cyclictest73-21ksoftirqd/700:13:537
32379994,1cyclictest691-21systemd-logind23:42:337
32379993,3cyclictest763-21NetworkManager21:35:207
32379992,5cyclictest17366-21systemd00:05:057
32379991,5cyclictest9413-21bash22:29:447
32379990,8cyclictest3297-21kworker/7:222:01:007
32379990,8cyclictest25594-21kworker/7:423:15:237
32379990,0cyclictest0-21swapper/722:16:517
32309998,1cyclictest65-21ksoftirqd/621:04:436
32309997,2cyclictest65-21ksoftirqd/620:55:046
32309997,1cyclictest65-21ksoftirqd/621:09:436
32309997,1cyclictest65-21ksoftirqd/621:09:436
32309997,1cyclictest65-21ksoftirqd/619:54:436
32239999,0cyclictest0-21swapper/523:00:055
32239997,1cyclictest6679-21expr22:05:035
32239997,1cyclictest57-21ksoftirqd/522:01:515
32239997,1cyclictest57-21ksoftirqd/521:43:565
32239993,3cyclictest691-21systemd-logind22:34:585
32239993,3cyclictest686-21dbus-daemon22:20:055
32239993,3cyclictest0-21swapper/522:54:465
32239993,3cyclictest0-21swapper/522:54:465
32239991,3cyclictest21906-21sshd22:24:505
32239990,9cyclictest0-21swapper/523:35:145
32239990,9cyclictest0-21swapper/523:25:285
32239990,9cyclictest0-21swapper/522:54:435
32239990,9cyclictest0-21swapper/500:08:115
32119993,6cyclictest0-21swapper/400:14:464
32119993,1cyclictest0-21swapper/421:46:094
32119992,3cyclictest0-21swapper/421:40:574
32119992,1cyclictest17353-21sshd22:15:124
32049998,1cyclictest41-21ksoftirqd/300:15:303
32049998,1cyclictest41-21ksoftirqd/300:00:093
32049997,2cyclictest41-21ksoftirqd/321:55:313
32049996,2cyclictest13978-21grepconf.sh00:20:093
32049992,3cyclictest12917-21sshd22:23:593
32049992,3cyclictest10220-21systemd-cgroups21:14:213
32049991,4cyclictest686-21dbus-daemon00:11:423
32049990,9cyclictest31354-21kworker/3:221:36:253
32049990,9cyclictest0-21swapper/322:58:333
32049990,9cyclictest0-21swapper/322:58:333
32049990,9cyclictest0-21swapper/322:19:373
32049990,5cyclictest15347-21systemd00:29:413
31969993,6cyclictest0-21swapper/223:26:102
31969993,1cyclictest1116-21nfsd23:03:382
31969992,6cyclictest691-21systemd-logind21:26:232
31969992,6cyclictest0-21swapper/222:31:402
31969990,9cyclictest0-21swapper/219:20:002
31969990,4cyclictest9953-21sshd22:05:192
31839998,1cyclictest25-21ksoftirqd/100:12:041
31839994,3cyclictest10814-21perf20:19:431
31839990,8cyclictest31875-21kworker/1:022:40:061
31779999,0cyclictest0-21swapper/023:05:320
31779996,2cyclictest4398-21systemd21:19:450
31779994,4cyclictest31820-21grepconf.sh22:34:530
31779993,1cyclictest19342-21nscd21:33:450
31779993,1cyclictest0-21swapper/022:41:000
31779990,9cyclictest9996-21kworker/0:423:25:520
31779990,9cyclictest0-21swapper/000:01:210
31779990,4cyclictest686-21dbus-daemon00:20:130
31779990,4cyclictest1-21systemd23:17:550
31779990,3cyclictest18385-21sshd23:43:460
32379988,0cyclictest0-21swapper/719:39:597
32379984,1cyclictest1-21systemd21:51:057
32379980,8cyclictest22812-21kworker/7:023:36:067
32309987,1cyclictest65-21ksoftirqd/620:24:436
32309987,1cyclictest65-21ksoftirqd/619:24:436
32309986,2cyclictest65-21ksoftirqd/620:44:586
32309986,2cyclictest65-21ksoftirqd/620:09:436
32309986,1cyclictest65-21ksoftirqd/620:25:016
32309986,1cyclictest65-21ksoftirqd/620:00:036
32309980,8cyclictest0-21swapper/619:10:056
32309980,5cyclictest121rcu_preempt20:51:276
32309980,2cyclictest121rcu_preempt19:39:016
32239988,0cyclictest0-21swapper/519:14:005
32239982,3cyclictest8249-21sshd00:10:205
32239980,5cyclictest5912-21systemd21:34:535
32119980,8cyclictest0-21swapper/420:05:024
32049987,0cyclictest0-21swapper/323:02:193
32049986,1cyclictest41-21ksoftirqd/320:39:433
32049984,3cyclictest885-21polkitd22:30:423
32049982,3cyclictest763-21NetworkManager23:05:473
32049982,3cyclictest492-21systemd-journal23:35:563
32049981,5cyclictest492-21systemd-journal00:35:043
32049980,8cyclictest0-21swapper/319:11:513
31969985,2cyclictest686-21dbus-daemon22:15:012
31969983,5cyclictest0-21swapper/200:12:072
31969982,1cyclictest0-21swapper/222:25:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional