You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-04 - 16:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun Jan 04, 2026 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
284732970,0sleep40-21swapper/410:12:554
275522570,1sleep527551-21systemd-cgroups11:40:255
407125227,9sleep70-21swapper/707:04:417
57652490,0sleep20-21swapper/211:55:122
251142490,1sleep225118-21sshd11:33:262
156362490,1sleep015638-21kworker/u16:011:35:400
429724825,8sleep30-21swapper/307:07:493
325852480,1sleep61-21systemd12:28:326
164612450,0sleep40-21swapper/411:29:114
309692440,0sleep40-21swapper/410:43:304
439124229,9sleep40-21swapper/407:09:024
189952420,0sleep50-21swapper/511:15:515
48612410,0sleep50-21swapper/511:34:335
421724124,13sleep10-21swapper/107:06:431
415624129,8sleep50-21swapper/507:05:515
412824129,8sleep60-21swapper/607:05:286
146492410,0sleep6641ktimersoftd/611:32:186
422724027,9sleep00-21swapper/007:06:500
413323928,8sleep20-21swapper/207:05:322
55102380,0sleep10-21swapper/110:20:291
258572380,1sleep625856-21bash10:15:536
201462370,0sleep40-21swapper/411:19:264
4552992014,4cyclictest41-21ksoftirqd/309:13:193
4552992014,4cyclictest41-21ksoftirqd/309:13:193
4552991915,1cyclictest41-21ksoftirqd/310:41:443
4552991913,3cyclictest41-21ksoftirqd/310:54:353
218192190,0sleep221818-21sshd10:12:132
84692180,1sleep341-21ksoftirqd/312:29:253
455299185,2cyclictest41-21ksoftirqd/311:31:523
455299184,2cyclictest41-21ksoftirqd/310:24:043
4530991812,2cyclictest18194-21systemd10:21:520
4567991713,1cyclictest1-21systemd12:02:585
4567991713,1cyclictest1-21systemd12:02:585
455299174,2cyclictest41-21ksoftirqd/312:08:523
4552991714,3cyclictest41-21ksoftirqd/311:18:163
4552991714,1cyclictest41-21ksoftirqd/309:18:543
4552991713,3cyclictest492-21systemd-journal11:49:233
4552991712,3cyclictest41-21ksoftirqd/311:35:093
455299170,17cyclictest3425-21kworker/3:410:32:113
149492170,0sleep20-21swapper/209:24:322
456799168,3cyclictest1-21systemd11:34:015
4567991610,5cyclictest1-21systemd12:05:485
455999160,15cyclictest11278-21bash12:16:054
455299164,1cyclictest41-21ksoftirqd/310:49:453
455299163,1cyclictest41-21ksoftirqd/312:15:093
4552991615,1cyclictest41-21ksoftirqd/309:47:573
4552991614,2cyclictest41-21ksoftirqd/311:28:123
4552991614,2cyclictest41-21ksoftirqd/309:41:543
4552991614,1cyclictest41-21ksoftirqd/312:36:123
4552991614,1cyclictest41-21ksoftirqd/312:25:533
4552991614,1cyclictest41-21ksoftirqd/312:03:213
4552991614,1cyclictest41-21ksoftirqd/312:03:213
4552991614,1cyclictest41-21ksoftirqd/310:35:033
4552991614,1cyclictest41-21ksoftirqd/310:16:233
4552991614,1cyclictest41-21ksoftirqd/309:23:493
4552991613,2cyclictest26555-21systemd09:52:403
4552991613,1cyclictest41-21ksoftirqd/310:06:483
4552991613,1cyclictest41-21ksoftirqd/310:06:483
455299161,2cyclictest131rcu_sched11:58:113
4530991613,1cyclictest4792-21kworker/u16:110:28:120
189722160,1sleep518964-21bash09:45:015
4578991513,1cyclictest65-21ksoftirqd/612:07:076
4567991510,4cyclictest1-21systemd10:19:175
4567991510,1cyclictest9760-21systemd11:21:415
455999150,1cyclictest0-21swapper/410:21:374
4552991513,1cyclictest41-21ksoftirqd/311:47:443
4552991513,1cyclictest41-21ksoftirqd/311:41:563
4552991513,1cyclictest41-21ksoftirqd/311:19:433
4552991513,1cyclictest41-21ksoftirqd/309:24:533
4552991512,2cyclictest492-21systemd-journal11:05:543
4552991512,2cyclictest492-21systemd-journal11:05:543
4552991512,1cyclictest41-21ksoftirqd/310:27:493
4552991511,3cyclictest41-21ksoftirqd/309:33:573
4552991510,3cyclictest41-21ksoftirqd/309:57:573
4552991510,2cyclictest41-21ksoftirqd/310:09:363
455299151,1cyclictest41-21ksoftirqd/312:21:583
4530991513,2cyclictest5392-21kworker/0:411:32:330
4530991512,3cyclictest1437-21kworker/u16:111:04:540
4530991512,3cyclictest1437-21kworker/u16:111:04:540
4530991512,2cyclictest13826-21kworker/u16:510:29:220
39282150,0sleep125-21ksoftirqd/111:04:181
39282150,0sleep125-21ksoftirqd/111:04:181
4578991412,1cyclictest65-21ksoftirqd/609:38:416
455299149,4cyclictest41-21ksoftirqd/312:12:143
4552991413,1cyclictest41-21ksoftirqd/311:09:233
4552991411,2cyclictest41-21ksoftirqd/311:00:113
4552991410,1cyclictest41-21ksoftirqd/309:34:363
455299141,1cyclictest41-21ksoftirqd/310:44:453
455299140,1cyclictest131rcu_sched10:01:463
4546991412,1cyclictest33-21ksoftirqd/212:06:112
4538991412,1cyclictest0-21swapper/109:13:511
4538991412,1cyclictest0-21swapper/109:13:511
453099149,4cyclictest30472-21kill11:27:110
453099149,3cyclictest21192-21kworker/u16:411:14:280
4530991412,2cyclictest8943-21kworker/u16:309:29:080
4530991412,2cyclictest3883-21kworker/u16:209:38:540
4530991412,1cyclictest4792-21kworker/u16:110:09:180
4530991412,1cyclictest1437-21kworker/u16:110:57:220
4530991412,1cyclictest1-21systemd12:38:450
4530991412,1cyclictest1-21systemd11:00:180
4530991412,0cyclictest21192-21kworker/u16:412:23:070
4530991411,1cyclictest2965-21kworker/u16:109:53:540
248552140,2sleep6457899cyclictest12:17:356
4586991311,1cyclictest73-21ksoftirqd/710:44:287
4586991311,1cyclictest73-21ksoftirqd/709:46:057
4578991312,1cyclictest65-21ksoftirqd/609:40:436
4567991311,1cyclictest57-21ksoftirqd/510:24:295
456799130,3cyclictest0-21swapper/508:28:455
456799130,10cyclictest0-21swapper/507:25:035
455999132,5cyclictest887-21gdbus11:52:294
4559991310,2cyclictest6519-21kill11:14:334
454699139,3cyclictest33-21ksoftirqd/211:34:372
454699138,4cyclictest33-21ksoftirqd/211:00:122
4546991311,0cyclictest30212-1kworker/2:2H11:11:092
4546991310,1cyclictest24763-1kworker/2:0H10:49:292
4530991312,0cyclictest3883-21kworker/u16:209:41:580
4530991312,0cyclictest1437-21kworker/u16:110:44:200
4530991311,2cyclictest4916-21kworker/u16:111:58:010
4530991311,2cyclictest31888-21kworker/u16:009:19:240
4530991311,2cyclictest21192-21kworker/u16:411:45:560
4530991311,2cyclictest18949-21kworker/u16:409:12:200
4530991311,2cyclictest18949-21kworker/u16:409:12:200
4530991311,1cyclictest8233-21kworker/0:310:38:020
4530991310,3cyclictest9205-21kworker/u16:312:06:490
4530991310,2cyclictest2637-21kworker/0:210:51:000
215482130,1sleep01-21systemd09:31:590
136082130,0sleep60-21swapper/611:56:046
84922120,1sleep1784-21runrttasks11:34:531
458699122,4cyclictest32580-21systemd-cgroups12:04:447
4586991210,2cyclictest73-21ksoftirqd/712:31:277
4586991210,1cyclictest73-21ksoftirqd/712:34:267
4586991210,1cyclictest73-21ksoftirqd/711:39:137
4586991210,1cyclictest73-21ksoftirqd/711:32:137
458699120,11cyclictest23614-21bash12:27:337
457899128,3cyclictest65-21ksoftirqd/611:17:336
4578991211,1cyclictest65-21ksoftirqd/612:13:416
4578991211,1cyclictest65-21ksoftirqd/611:04:276
4578991211,1cyclictest65-21ksoftirqd/611:04:276
4578991211,1cyclictest65-21ksoftirqd/609:13:316
4578991211,1cyclictest65-21ksoftirqd/609:13:316
4578991210,1cyclictest65-21ksoftirqd/609:48:436
456799129,2cyclictest57-21ksoftirqd/509:16:165
456799127,4cyclictest57-21ksoftirqd/510:34:375
456799127,1cyclictest7008-21systemd09:43:595
4567991211,1cyclictest57-21ksoftirqd/512:12:015
4567991211,1cyclictest57-21ksoftirqd/510:13:345
4567991211,1cyclictest57-21ksoftirqd/509:58:375
4567991210,1cyclictest723-21in:imjournal11:25:005
456799120,9cyclictest0-21swapper/508:51:115
456799120,6cyclictest0-21swapper/511:56:205
456799120,3cyclictest0-21swapper/508:35:155
456799120,3cyclictest0-21swapper/507:36:475
455999126,1cyclictest12883-21sshd10:44:484
4559991210,1cyclictest887-21gdbus09:13:514
4559991210,1cyclictest887-21gdbus09:13:514
4559991210,1cyclictest49-21ksoftirqd/410:59:324
4552991210,1cyclictest41-21ksoftirqd/307:54:143
4546991210,1cyclictest33-21ksoftirqd/211:08:282
4546991210,1cyclictest33-21ksoftirqd/211:08:282
4546991210,1cyclictest33-21ksoftirqd/209:59:022
4546991210,1cyclictest33-21ksoftirqd/209:37:192
4546991210,0cyclictest5528-1kworker/2:2H09:34:062
4538991210,1cyclictest25-21ksoftirqd/110:10:411
4530991211,1cyclictest21192-21kworker/u16:411:52:520
4530991211,1cyclictest1244-21kworker/u16:512:16:410
4530991210,2cyclictest6052-21kworker/0:110:02:480
4530991210,2cyclictest5410-21kworker/u16:409:58:460
4530991210,2cyclictest5238-21kworker/u16:410:17:040
4530991210,2cyclictest1244-21kworker/u16:512:12:210
165392120,1sleep116534-21bash10:14:521
458699119,1cyclictest73-21ksoftirqd/711:46:497
458699119,1cyclictest73-21ksoftirqd/709:39:207
458699119,1cyclictest73-21ksoftirqd/709:29:507
458699119,1cyclictest30242-21systemd10:16:237
458699118,2cyclictest0-21swapper/709:14:357
458699118,1cyclictest73-21ksoftirqd/710:06:327
458699118,1cyclictest73-21ksoftirqd/710:06:327
458699114,3cyclictest691-21systemd-logind10:33:287
458699110,10cyclictest20430-21sshd10:35:277
457899119,1cyclictest65-21ksoftirqd/612:21:426
457899119,1cyclictest65-21ksoftirqd/611:51:016
457899119,1cyclictest65-21ksoftirqd/610:25:456
457899119,1cyclictest65-21ksoftirqd/610:22:396
457899119,1cyclictest65-21ksoftirqd/610:13:356
457899119,1cyclictest65-21ksoftirqd/609:51:426
457899119,1cyclictest65-21ksoftirqd/609:30:146
457899119,1cyclictest65-21ksoftirqd/609:15:446
457899117,3cyclictest65-21ksoftirqd/610:35:316
457899115,3cyclictest0-21swapper/612:35:026
457899114,4cyclictest686-21dbus-daemon11:24:406
4578991110,1cyclictest65-21ksoftirqd/612:31:396
457899110,1cyclictest0-21swapper/610:30:486
456799119,1cyclictest57-21ksoftirqd/510:34:045
456799118,2cyclictest57-21ksoftirqd/511:54:145
456799115,3cyclictest696-21nscd12:38:505
456799110,6cyclictest0-21swapper/512:25:505
456799110,6cyclictest0-21swapper/512:23:345
456799110,2cyclictest4989-21cp12:32:215
456799110,11cyclictest0-21swapper/512:18:005
456799110,10cyclictest0-21swapper/510:14:245
455999119,1cyclictest49-21ksoftirqd/410:54:424
455999118,2cyclictest49-21ksoftirqd/410:05:084
455999118,2cyclictest49-21ksoftirqd/410:05:084
455999118,2cyclictest16080-21sshd12:33:334
455999112,4cyclictest22207-21systemd-cgroups10:32:234
4559991110,1cyclictest0-21swapper/409:30:324
455999110,4cyclictest23651-21grepconf.sh11:29:424
455999110,11cyclictest22000-21kworker/4:209:59:524
455999110,1cyclictest22038-21sshd09:21:524
455999110,1cyclictest0-21swapper/410:18:384
455299119,1cyclictest41-21ksoftirqd/308:39:143
454699119,2cyclictest33-21ksoftirqd/210:07:582
454699119,2cyclictest33-21ksoftirqd/210:07:582
454699119,1cyclictest33-21ksoftirqd/212:26:522
454699119,1cyclictest33-21ksoftirqd/210:48:262
454699115,3cyclictest691-21systemd-logind11:24:142
454699114,4cyclictest1-21systemd09:39:292
454699112,3cyclictest32621-21bash09:49:482
4546991110,1cyclictest33-21ksoftirqd/212:02:242
4546991110,1cyclictest33-21ksoftirqd/212:02:242
4546991110,1cyclictest33-21ksoftirqd/211:14:222
4546991110,1cyclictest33-21ksoftirqd/210:29:512
454699110,10cyclictest9425-21cstates12:19:252
453899119,1cyclictest25-21ksoftirqd/109:54:091
453899112,4cyclictest0-21swapper/112:02:051
453899112,4cyclictest0-21swapper/112:02:051
453899111,4cyclictest686-21dbus-daemon12:32:281
453899111,4cyclictest18955-21systemd-cgroups09:24:501
453899110,8cyclictest6905-21kworker/1:510:49:311
453099119,1cyclictest31322-21sshd11:13:560
453099118,1cyclictest23944-21kworker/0:410:43:040
453099115,3cyclictest0-21swapper/008:39:120
4530991110,1cyclictest9-21ksoftirqd/012:32:430
453099110,2cyclictest17122-21systemd11:39:270
453099110,10cyclictest0-21swapper/008:44:270
200262110,0sleep1231rcuc/109:58:421
188912110,0sleep10-21swapper/111:29:241
180392110,0sleep40-21swapper/410:28:414
458699109,1cyclictest73-21ksoftirqd/709:51:317
458699109,1cyclictest0-21swapper/710:22:227
458699108,1cyclictest73-21ksoftirqd/712:12:197
458699108,1cyclictest73-21ksoftirqd/711:21:367
458699108,1cyclictest73-21ksoftirqd/711:06:007
458699108,1cyclictest73-21ksoftirqd/711:06:007
458699108,1cyclictest73-21ksoftirqd/710:43:187
458699108,1cyclictest73-21ksoftirqd/710:25:297
458699108,1cyclictest73-21ksoftirqd/709:27:267
458699108,1cyclictest73-21ksoftirqd/709:13:447
458699108,1cyclictest73-21ksoftirqd/709:13:447
458699105,3cyclictest73-21ksoftirqd/711:54:117
458699100,10cyclictest0-21swapper/711:57:457
458699100,10cyclictest0-21swapper/709:39:017
458699100,1cyclictest0-21swapper/710:00:467
457899109,1cyclictest65-21ksoftirqd/611:34:176
457899108,1cyclictest65-21ksoftirqd/611:12:566
457899108,1cyclictest65-21ksoftirqd/611:04:006
457899108,1cyclictest65-21ksoftirqd/610:06:416
457899108,1cyclictest65-21ksoftirqd/610:06:416
457899108,1cyclictest65-21ksoftirqd/609:28:546
457899107,2cyclictest65-21ksoftirqd/609:59:086
457899104,4cyclictest492-21systemd-journal11:20:256
457899103,6cyclictest0-21swapper/610:42:356
457899100,10cyclictest0-21swapper/611:40:486
456799109,1cyclictest57-21ksoftirqd/510:39:555
456799109,1cyclictest57-21ksoftirqd/509:38:175
456799109,1cyclictest0-21swapper/511:07:135
456799109,1cyclictest0-21swapper/511:07:135
456799107,1cyclictest57-21ksoftirqd/509:28:235
456799106,2cyclictest57-21ksoftirqd/511:46:095
456799103,4cyclictest686-21dbus-daemon10:57:145
456799103,4cyclictest19966-21sshd11:09:185
456799103,2cyclictest0-21swapper/508:21:515
456799103,2cyclictest0-21swapper/508:17:075
456799100,10cyclictest0-21swapper/510:51:175
456799100,10cyclictest0-21swapper/510:44:475
456799100,10cyclictest0-21swapper/509:22:375
456799100,10cyclictest0-21swapper/509:06:215
456799100,10cyclictest0-21swapper/508:39:155
456799100,10cyclictest0-21swapper/508:32:335
456799100,10cyclictest0-21swapper/508:10:015
456799100,10cyclictest0-21swapper/508:01:295
456799100,10cyclictest0-21swapper/507:33:255
456799100,10cyclictest0-21swapper/507:13:575
455999109,1cyclictest0-21swapper/409:56:524
455999108,1cyclictest4451-21systemd-cgroups11:04:214
455999108,1cyclictest4451-21systemd-cgroups11:04:214
455999108,1cyclictest1-21systemd12:37:314
455999102,3cyclictest0-21swapper/411:12:304
455999101,4cyclictest0-21swapper/411:35:544
455999100,9cyclictest12535-21kworker/4:312:01:164
455999100,9cyclictest12535-21kworker/4:312:01:164
455999100,4cyclictest0-21swapper/411:43:094
455999100,10cyclictest0-21swapper/411:48:584
455299108,1cyclictest41-21ksoftirqd/307:59:143
454699109,1cyclictest33-21ksoftirqd/210:23:462
454699108,1cyclictest33-21ksoftirqd/211:46:012
454699107,1cyclictest33-21ksoftirqd/209:46:422
454699107,1cyclictest0-21swapper/209:22:032
454699105,2cyclictest686-21dbus-daemon12:33:512
454699104,3cyclictest10181-21sshd10:54:362
454699103,4cyclictest1-21systemd09:14:542
454699103,4cyclictest0-21swapper/211:25:002
454699102,5cyclictest0-21swapper/212:11:432
454699102,1cyclictest686-21dbus-daemon12:15:222
454699100,6cyclictest0-21swapper/211:43:232
454699100,1cyclictest16516-21systemd10:14:522
453899103,6cyclictest4562-21sshd10:47:271
453899103,6cyclictest3014-21sshd10:27:021
453899103,1cyclictest0-21swapper/111:15:371
453899101,4cyclictest0-21swapper/109:47:551
453899100,4cyclictest9019-21sshd11:48:561
453899100,4cyclictest686-21dbus-daemon12:25:481
453899100,4cyclictest14186-21systemd-cgroups10:55:031
453899100,10cyclictest0-21swapper/112:04:361
453099108,2cyclictest5410-21kworker/u16:409:46:540
453099108,1cyclictest9-21ksoftirqd/012:03:130
453099108,1cyclictest9-21ksoftirqd/012:03:130
453099108,1cyclictest6052-21kworker/0:110:04:160
453099108,1cyclictest6052-21kworker/0:110:04:160
453099100,10cyclictest0-21swapper/007:54:380
277042100,0sleep4471rcuc/408:44:304
253502108,1sleep125-21ksoftirqd/109:22:161
220142100,0sleep20-21swapper/210:39:122
11732100,0sleep60-21swapper/610:57:106
45869998,1cyclictest73-21ksoftirqd/711:25:137
45869997,1cyclictest73-21ksoftirqd/712:22:047
45869997,1cyclictest73-21ksoftirqd/712:15:027
45869997,1cyclictest73-21ksoftirqd/711:16:597
45869997,1cyclictest73-21ksoftirqd/711:09:167
45869997,1cyclictest73-21ksoftirqd/711:00:137
45869996,3cyclictest73-21ksoftirqd/709:57:267
45869996,2cyclictest11725-21httpd12:00:517
45869996,2cyclictest11725-21httpd12:00:517
45869993,3cyclictest29706-21sshd10:49:557
45869993,3cyclictest25812-21systemd-cgroups11:40:147
45869990,9cyclictest0-21swapper/709:22:097
45869990,0cyclictest0-21swapper/710:09:367
45789997,1cyclictest65-21ksoftirqd/611:59:316
45789997,1cyclictest65-21ksoftirqd/611:59:316
45789997,1cyclictest65-21ksoftirqd/610:48:596
45789994,4cyclictest32609-21iostat11:44:306
45789992,3cyclictest686-21dbus-daemon10:01:566
45789992,3cyclictest24246-21sshd10:49:286
45679997,1cyclictest57-21ksoftirqd/511:03:125
45679992,5cyclictest2869-21kill09:50:055
45679992,4cyclictest8813-21sshd09:30:355
45679990,9cyclictest8854-21kworker/5:309:12:525
45679990,9cyclictest8854-21kworker/5:309:12:525
45679990,9cyclictest0-21swapper/508:46:015
45679990,9cyclictest0-21swapper/507:40:215
45679990,8cyclictest12917-21kworker/5:110:06:485
45679990,8cyclictest12917-21kworker/5:110:06:485
45679990,3cyclictest0-21swapper/508:08:275
45599999,0cyclictest0-21swapper/409:14:184
45599997,1cyclictest49-21ksoftirqd/412:24:214
45599996,1cyclictest11978-21sshd12:06:024
45599993,3cyclictest885-21polkitd09:34:354
45599993,1cyclictest7553-21sshd09:54:074
45599992,1cyclictest0-21swapper/412:09:384
45599992,1cyclictest0-21swapper/409:42:414
45529999,0cyclictest0-21swapper/307:29:353
45529996,0cyclictest41-21ksoftirqd/308:24:143
45529990,9cyclictest0-21swapper/307:59:293
45469998,1cyclictest33-21ksoftirqd/210:24:492
45469996,1cyclictest21192-21kworker/u16:411:51:472
45469992,6cyclictest8942-21systemd-cgroups09:09:152
45469992,6cyclictest8942-21systemd-cgroups09:09:152
45469992,5cyclictest30945-21systemd09:59:392
45469991,4cyclictest686-21dbus-daemon10:39:552
45469990,9cyclictest0-21swapper/207:14:312
45469990,4cyclictest686-21dbus-daemon12:38:062
45389999,0cyclictest0-21swapper/111:01:511
45389997,1cyclictest25-21ksoftirqd/110:34:271
45389993,1cyclictest15475-21kworker/1:010:07:031
45389993,1cyclictest15475-21kworker/1:010:07:031
45389992,6cyclictest28819-21systemd-cgroups11:20:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional