You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 07:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon Apr 13, 2026 00:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
68359915687,34cyclictest49-21ksoftirqd/423:15:434
269012950,0sleep50-21swapper/522:27:175
269012950,0sleep50-21swapper/522:27:175
237702860,0sleep60-21swapper/600:04:426
152182790,2sleep3683499cyclictest21:21:313
683799720,0cyclictest0-21swapper/623:15:446
185522540,0sleep70-21swapper/723:13:337
139892540,1sleep213973-21sshd22:00:312
264282530,1sleep326432-21grep23:10:163
254222530,0sleep00-21swapper/023:34:320
276272520,0sleep50-21swapper/522:03:065
46972490,0sleep50-21swapper/522:52:085
158342470,0sleep20-21swapper/200:17:192
66872460,1sleep06689-21grep23:29:430
55112460,1sleep05510-21grepconf.sh00:29:580
202562460,1sleep120257-21grepconf.sh00:28:551
147602460,1sleep21-21systemd23:54:442
66652450,0sleep10-21swapper/123:26:001
98292440,1sleep39797-21sshd22:39:243
97342440,0sleep01-21systemd00:05:480
683499440,43cyclictest2334-21kworker/u16:323:15:443
39862430,0sleep70-21swapper/723:35:117
29322430,0sleep40-21swapper/421:15:244
102932430,1sleep410295-21bash21:37:584
296582420,1sleep429657-21bash22:03:134
268712420,0sleep0101ktimersoftd/022:34:490
211482420,0sleep00-21swapper/021:21:520
155412420,0sleep50-21swapper/522:32:145
26432410,0sleep10-21swapper/121:37:311
253502410,0sleep3391rcuc/323:57:103
239512410,0sleep10-21swapper/100:10:211
174522410,0sleep00-21swapper/021:55:080
6833994037,2cyclictest13550irq/24-ahci[00023:15:452
660824027,9sleep70-21swapper/719:04:357
422924028,8sleep40-21swapper/419:01:044
36922400,0sleep50-21swapper/523:05:145
300492400,0sleep40-21swapper/421:48:244
216012400,0sleep2321ktimersoftd/223:09:592
141282400,0sleep50-21swapper/521:17:495
6831993939,0cyclictest19455-21kworker/0:123:15:440
667723926,9sleep00-21swapper/019:05:330
662123927,8sleep20-21swapper/219:04:462
647723926,9sleep10-21swapper/119:02:451
637923927,8sleep50-21swapper/519:01:295
278312390,0sleep60-21swapper/622:42:166
202192390,1sleep7784-21runrttasks23:24:547
17662390,0sleep20-21swapper/222:29:382
17662390,0sleep20-21swapper/222:29:382
128252390,0sleep10-21swapper/100:13:261
86172380,0sleep5551rcuc/523:41:105
639823826,9sleep60-21swapper/619:01:466
384523825,8sleep30-21swapper/319:00:553
245252380,0sleep60-21swapper/622:55:136
683299360,35cyclictest0-21swapper/123:15:451
54192340,1sleep2683399cyclictest00:14:552
683699268,17cyclictest23239-21systemd-cgroups23:15:445
146952260,0sleep20-21swapper/221:43:492
146952260,0sleep20-21swapper/221:43:492
6833992518,5cyclictest33-21ksoftirqd/200:05:172
6833992210,1cyclictest33-21ksoftirqd/221:35:272
6831992216,3cyclictest9-21ksoftirqd/022:47:470
228662210,0sleep30-21swapper/300:17:443
6833992016,4cyclictest33-21ksoftirqd/221:07:022
6833992015,3cyclictest33-21ksoftirqd/222:47:012
6831992015,2cyclictest9-21ksoftirqd/023:03:590
683399194,1cyclictest33-21ksoftirqd/222:14:382
6833991915,3cyclictest33-21ksoftirqd/200:25:232
6833991913,4cyclictest33-21ksoftirqd/223:58:372
6831991918,1cyclictest9-21ksoftirqd/023:38:080
6831991917,1cyclictest9-21ksoftirqd/022:42:280
6831991917,1cyclictest9-21ksoftirqd/022:05:280
292182190,1sleep09-21ksoftirqd/000:21:500
6833991817,1cyclictest33-21ksoftirqd/222:18:182
6833991816,2cyclictest33-21ksoftirqd/222:55:372
6833991815,1cyclictest33-21ksoftirqd/223:49:082
6833991815,1cyclictest33-21ksoftirqd/222:31:552
6833991812,4cyclictest33-21ksoftirqd/223:21:532
6831991815,2cyclictest9-21ksoftirqd/023:49:580
6831991815,1cyclictest9-21ksoftirqd/023:22:120
6831991815,1cyclictest9-21ksoftirqd/021:42:540
6831991815,1cyclictest9-21ksoftirqd/021:42:540
6831991812,3cyclictest9-21ksoftirqd/000:32:020
683199180,1cyclictest9-21ksoftirqd/021:56:460
683199180,1cyclictest131rcu_sched22:20:240
143352180,0sleep30-21swapper/323:05:523
8002170,0sleep10-21swapper/123:33:051
72942170,1sleep4683599cyclictest22:13:064
6835991716,1cyclictest49-21ksoftirqd/422:21:524
6835991716,1cyclictest49-21ksoftirqd/422:21:524
6835991715,1cyclictest49-21ksoftirqd/422:57:374
6835991714,1cyclictest49-21ksoftirqd/421:10:014
6835991713,3cyclictest49-21ksoftirqd/422:47:404
6833991715,1cyclictest33-21ksoftirqd/221:51:072
6833991715,1cyclictest33-21ksoftirqd/221:50:002
6833991715,1cyclictest33-21ksoftirqd/221:17:112
6833991715,1cyclictest33-21ksoftirqd/200:26:262
6833991714,2cyclictest33-21ksoftirqd/221:11:552
6833991713,3cyclictest33-21ksoftirqd/223:04:082
6833991713,1cyclictest33-21ksoftirqd/222:59:262
6833991711,2cyclictest33-21ksoftirqd/200:31:422
683199175,1cyclictest121rcu_preempt00:06:320
6831991716,1cyclictest9-21ksoftirqd/021:15:270
6831991715,2cyclictest19840-21kworker/u16:223:00:180
6831991715,1cyclictest9-21ksoftirqd/023:41:300
6831991715,1cyclictest9-21ksoftirqd/021:34:340
6831991715,1cyclictest9-21ksoftirqd/000:16:100
6831991714,3cyclictest9-21ksoftirqd/023:56:020
6831991714,2cyclictest9-21ksoftirqd/023:54:550
6831991714,2cyclictest9-21ksoftirqd/022:21:230
6831991714,2cyclictest9-21ksoftirqd/022:21:230
6831991714,1cyclictest9-21ksoftirqd/021:07:180
6831991713,3cyclictest9-21ksoftirqd/023:08:090
6831991712,2cyclictest9-21ksoftirqd/021:20:440
6831991711,3cyclictest9-21ksoftirqd/022:07:380
683199170,1cyclictest131rcu_sched21:40:280
304392170,0sleep60-21swapper/623:02:586
253652170,1sleep425366-21grepconf.sh00:17:534
185202170,0sleep10-21swapper/121:14:251
126202170,0sleep50-21swapper/522:39:355
6837991614,1cyclictest65-21ksoftirqd/623:27:546
6835991614,1cyclictest49-21ksoftirqd/422:26:154
6835991614,1cyclictest49-21ksoftirqd/422:26:154
6835991614,1cyclictest49-21ksoftirqd/421:54:244
6835991614,1cyclictest49-21ksoftirqd/400:02:494
6835991613,1cyclictest49-21ksoftirqd/423:56:314
6835991612,4cyclictest49-21ksoftirqd/421:24:454
6835991611,3cyclictest49-21ksoftirqd/422:41:084
683599160,15cyclictest3730-21kworker/4:422:20:064
6833991615,1cyclictest33-21ksoftirqd/223:26:112
6833991615,1cyclictest33-21ksoftirqd/222:45:132
6833991615,1cyclictest33-21ksoftirqd/222:21:102
6833991615,1cyclictest33-21ksoftirqd/222:21:102
6833991615,1cyclictest33-21ksoftirqd/221:36:342
6833991614,1cyclictest33-21ksoftirqd/222:06:342
6833991613,2cyclictest33-21ksoftirqd/222:36:242
6833991612,4cyclictest33-21ksoftirqd/223:42:272
6833991612,1cyclictest33-21ksoftirqd/221:23:072
6833991610,3cyclictest33-21ksoftirqd/221:29:242
683399160,1cyclictest33-21ksoftirqd/222:01:122
6831991615,1cyclictest9-21ksoftirqd/022:36:540
6831991615,1cyclictest9-21ksoftirqd/022:13:410
6831991615,1cyclictest9-21ksoftirqd/000:11:560
6831991614,2cyclictest9-21ksoftirqd/021:26:050
6831991614,2cyclictest31730-21kworker/0:220:15:000
6831991614,2cyclictest31730-21kworker/0:219:45:540
6831991614,2cyclictest31730-21kworker/0:219:34:120
6831991614,1cyclictest9-21ksoftirqd/022:27:540
6831991614,1cyclictest9-21ksoftirqd/022:27:540
6831991612,4cyclictest9-21ksoftirqd/023:16:090
6831991612,3cyclictest9-21ksoftirqd/021:46:080
280672160,0sleep10-21swapper/121:44:361
280672160,0sleep10-21swapper/121:44:361
73592150,0sleep30-21swapper/322:11:133
6837991513,1cyclictest65-21ksoftirqd/622:06:286
6837991513,1cyclictest65-21ksoftirqd/621:11:016
6837991513,1cyclictest65-21ksoftirqd/621:10:406
6835991514,1cyclictest49-21ksoftirqd/423:05:244
6835991514,1cyclictest49-21ksoftirqd/400:27:054
6835991513,1cyclictest49-21ksoftirqd/423:16:064
6835991513,1cyclictest49-21ksoftirqd/423:10:494
6835991513,1cyclictest49-21ksoftirqd/422:31:304
6835991513,1cyclictest49-21ksoftirqd/421:27:174
6835991511,3cyclictest49-21ksoftirqd/422:07:064
6834991513,1cyclictest41-21ksoftirqd/323:48:593
6833991514,1cyclictest33-21ksoftirqd/223:31:092
6833991513,2cyclictest33-21ksoftirqd/223:19:222
683399151,2cyclictest131rcu_sched00:08:132
683399150,1cyclictest131rcu_sched23:36:532
6831991511,1cyclictest9-21ksoftirqd/022:52:030
683899144,7cyclictest29046-21grepconf.sh21:40:587
683899144,7cyclictest29046-21grepconf.sh21:40:587
6837991413,1cyclictest65-21ksoftirqd/621:38:366
6837991413,1cyclictest65-21ksoftirqd/621:31:386
6837991412,1cyclictest65-21ksoftirqd/622:28:216
6837991412,1cyclictest65-21ksoftirqd/622:28:216
6837991412,1cyclictest65-21ksoftirqd/622:13:406
6837991410,1cyclictest65-21ksoftirqd/622:57:326
683799140,14cyclictest18799-21kworker/6:022:36:106
6836991414,0cyclictest0-21swapper/521:31:385
6836991412,1cyclictest57-21ksoftirqd/522:46:155
6835991413,1cyclictest49-21ksoftirqd/421:56:534
6835991412,1cyclictest49-21ksoftirqd/423:41:124
6835991412,1cyclictest49-21ksoftirqd/423:28:054
6835991412,1cyclictest49-21ksoftirqd/421:20:354
6835991411,3cyclictest49-21ksoftirqd/400:15:454
6834991412,1cyclictest41-21ksoftirqd/323:29:293
6832991412,1cyclictest25-21ksoftirqd/122:56:531
6832991412,1cyclictest25-21ksoftirqd/121:56:051
683299140,13cyclictest25483-21sshd21:29:361
6831991412,2cyclictest31730-21kworker/0:221:01:060
6831991412,2cyclictest31730-21kworker/0:219:55:460
6831991412,1cyclictest786-21snmpd20:56:470
6831991412,1cyclictest31730-21kworker/0:220:05:000
6831991412,1cyclictest31730-21kworker/0:219:16:140
6831991410,0cyclictest31730-21kworker/0:220:05:540
258712140,0sleep5551rcuc/522:57:055
683899139,3cyclictest15354-21sshd23:00:177
683899134,8cyclictest4641-21sshd23:44:447
683899130,2cyclictest887-21gdbus21:49:257
683899130,2cyclictest23494-21sshd22:29:017
683899130,2cyclictest23494-21sshd22:29:017
683899130,2cyclictest17858-21bash00:00:377
683899130,2cyclictest17293-21sshd21:27:137
683899130,12cyclictest21524-21sshd23:06:117
683799139,3cyclictest65-21ksoftirqd/621:44:316
683799139,3cyclictest65-21ksoftirqd/621:44:316
6837991312,1cyclictest65-21ksoftirqd/623:47:046
6837991312,1cyclictest65-21ksoftirqd/622:49:266
6837991312,1cyclictest65-21ksoftirqd/621:20:116
6837991311,1cyclictest65-21ksoftirqd/600:27:256
6837991311,1cyclictest65-21ksoftirqd/600:21:356
6837991311,1cyclictest65-21ksoftirqd/600:13:226
6836991312,1cyclictest57-21ksoftirqd/522:20:145
6836991310,2cyclictest57-21ksoftirqd/522:43:035
683599139,1cyclictest15-21kswork21:41:074
683599139,1cyclictest15-21kswork21:41:074
6835991312,1cyclictest49-21ksoftirqd/421:33:164
6835991312,1cyclictest49-21ksoftirqd/400:07:364
6835991311,1cyclictest49-21ksoftirqd/423:52:214
6835991311,1cyclictest49-21ksoftirqd/423:46:494
6835991311,1cyclictest49-21ksoftirqd/423:36:254
6835991311,1cyclictest49-21ksoftirqd/423:33:114
6835991311,1cyclictest49-21ksoftirqd/400:22:164
6834991311,1cyclictest41-21ksoftirqd/321:16:273
683299138,1cyclictest25-21ksoftirqd/122:48:571
6832991311,1cyclictest25-21ksoftirqd/121:07:501
6831991312,1cyclictest31730-21kworker/0:219:27:160
6831991311,2cyclictest31730-21kworker/0:220:47:000
6831991311,2cyclictest31730-21kworker/0:220:42:120
6831991311,2cyclictest31730-21kworker/0:219:12:120
6831991311,1cyclictest31730-21kworker/0:220:51:140
4662130,0sleep50-21swapper/523:40:465
214352130,1sleep321436-21systemd-cgroups23:00:393
683899127,4cyclictest5712-21sshd00:31:477
683899124,7cyclictest686-21dbus-daemon23:53:437
683899124,7cyclictest686-21dbus-daemon23:37:367
683899124,7cyclictest686-21dbus-daemon00:05:547
683899124,7cyclictest537-21grepconf.sh22:05:197
683899124,7cyclictest5189-21httpd22:55:307
683899124,7cyclictest3477-21grep21:20:577
683899124,7cyclictest28873-21sshd00:21:487
683899124,7cyclictest28415-21grepconf.sh23:16:017
683899124,7cyclictest2495-21bash00:20:227
683899124,7cyclictest2127-21grepconf.sh00:10:587
683899124,7cyclictest1376-21bash00:29:437
683899124,7cyclictest13299-21bash21:56:407
683899123,2cyclictest8740-21id23:26:067
683899123,2cyclictest775-21gdbus22:18:497
683899122,2cyclictest691-21systemd-logind00:05:307
683899121,5cyclictest11226-21sshd22:09:417
683899121,2cyclictest691-21systemd-logind21:32:267
683899121,2cyclictest686-21dbus-daemon21:10:217
683899120,2cyclictest9721-21grepconf.sh22:31:537
683899120,2cyclictest8425-21systemctl22:15:057
683899120,2cyclictest489-21bash22:36:577
683899120,2cyclictest29170-21sshd23:02:537
683799128,3cyclictest65-21ksoftirqd/622:05:516
6837991211,1cyclictest65-21ksoftirqd/623:16:256
6837991211,1cyclictest65-21ksoftirqd/621:59:106
6837991211,1cyclictest65-21ksoftirqd/600:17:046
6837991210,1cyclictest65-21ksoftirqd/623:33:556
6837991210,1cyclictest65-21ksoftirqd/622:17:426
6837991210,1cyclictest65-21ksoftirqd/621:26:006
6837991210,1cyclictest65-21ksoftirqd/600:10:466
683699125,6cyclictest29618-21systemd-cgroups22:25:375
683699125,6cyclictest29618-21systemd-cgroups22:25:375
683699125,1cyclictest57-21ksoftirqd/521:07:065
683699122,4cyclictest686-21dbus-daemon23:22:425
683699122,4cyclictest28008-21systemd-cgroups00:18:025
683699122,4cyclictest24585-21systemd-cgroups21:49:585
683699120,11cyclictest18730-21bash21:58:535
683699120,11cyclictest0-21swapper/521:38:525
6835991211,1cyclictest49-21ksoftirqd/423:25:394
6835991210,1cyclictest49-21ksoftirqd/422:55:434
6835991210,1cyclictest49-21ksoftirqd/422:40:304
6835991210,1cyclictest49-21ksoftirqd/400:30:584
683499129,2cyclictest31710-21bash22:25:443
683499129,2cyclictest31710-21bash22:25:443
683499129,2cyclictest12338-21grepconf.sh00:32:113
683499122,4cyclictest25472-21systemd00:08:323
683499122,4cyclictest1-21systemd21:31:033
683499122,4cyclictest0-21swapper/322:51:303
683499122,4cyclictest0-21swapper/300:04:563
6834991211,1cyclictest41-21ksoftirqd/322:45:133
6834991210,1cyclictest41-21ksoftirqd/321:50:223
683499120,2cyclictest24238-21systemd22:29:033
683499120,2cyclictest24238-21systemd22:29:033
683299129,2cyclictest18198-21grepconf.sh21:49:361
683299125,5cyclictest8735-21systemd23:39:201
6832991211,1cyclictest25-21ksoftirqd/123:52:071
6832991211,1cyclictest25-21ksoftirqd/123:02:521
6832991210,1cyclictest25-21ksoftirqd/123:24:251
6832991210,1cyclictest25-21ksoftirqd/122:18:291
683299120,11cyclictest20639-21sshd21:21:511
683199123,4cyclictest9-21ksoftirqd/020:00:120
6831991211,0cyclictest31730-21kworker/0:220:34:120
6831991210,2cyclictest31730-21kworker/0:220:27:020
6831991210,2cyclictest31730-21kworker/0:220:20:540
6831991210,2cyclictest31730-21kworker/0:219:36:100
6831991210,2cyclictest31730-21kworker/0:219:09:500
64192120,0sleep10-21swapper/123:07:101
260072120,0sleep30-21swapper/321:11:063
187272120,0sleep30-21swapper/320:21:103
111512120,0sleep30-21swapper/321:41:423
111512120,0sleep30-21swapper/321:41:423
683899114,6cyclictest9289-21sshd21:36:067
683899114,6cyclictest5385-21grepconf.sh22:41:037
683899113,3cyclictest10670-21sshd21:51:037
683899113,2cyclictest686-21dbus-daemon23:46:107
683899113,2cyclictest686-21dbus-daemon21:10:547
683899112,2cyclictest691-21systemd-logind21:16:207
683899112,2cyclictest686-21dbus-daemon22:20:587
683899112,2cyclictest686-21dbus-daemon22:20:587
683899112,1cyclictest3760-21sshd22:46:287
683799119,1cyclictest65-21ksoftirqd/623:59:226
683799119,1cyclictest65-21ksoftirqd/623:52:586
683799119,1cyclictest65-21ksoftirqd/623:36:236
683799119,1cyclictest65-21ksoftirqd/623:25:106
683799119,1cyclictest65-21ksoftirqd/623:10:246
683799116,1cyclictest492-21systemd-journal21:22:476
6837991110,1cyclictest65-21ksoftirqd/623:42:486
6837991110,1cyclictest65-21ksoftirqd/622:31:046
6837991110,1cyclictest65-21ksoftirqd/621:51:156
6837991110,1cyclictest65-21ksoftirqd/621:46:086
6837991110,1cyclictest65-21ksoftirqd/600:31:336
683699119,1cyclictest887-21gdbus00:29:465
683699119,1cyclictest57-21ksoftirqd/522:11:205
683699112,4cyclictest0-21swapper/522:09:235
6836991110,1cyclictest57-21ksoftirqd/500:08:435
683699111,4cyclictest1-21systemd23:20:315
683699111,4cyclictest0-21swapper/523:10:475
683699111,4cyclictest0-21swapper/500:05:075
683699110,4cyclictest0-21swapper/523:32:345
683699110,11cyclictest14529-21kworker/5:400:30:555
683699110,10cyclictest27268-21kworker/5:123:48:315
683699110,1cyclictest2139-21grepconf.sh23:53:595
683499119,1cyclictest41-21ksoftirqd/323:25:283
683499119,1cyclictest41-21ksoftirqd/321:56:253
683499117,3cyclictest14725-21id00:21:053
683499112,4cyclictest27728-21sshd23:55:313
6834991110,1cyclictest41-21ksoftirqd/322:09:013
6834991110,1cyclictest41-21ksoftirqd/321:28:193
6834991110,1cyclictest0-21swapper/323:30:583
683499110,1cyclictest686-21dbus-daemon21:37:583
683299119,1cyclictest25-21ksoftirqd/123:59:141
683299119,1cyclictest25-21ksoftirqd/122:52:001
683299119,1cyclictest25-21ksoftirqd/122:37:571
683299119,1cyclictest25-21ksoftirqd/122:29:101
683299119,1cyclictest25-21ksoftirqd/122:29:101
683299119,1cyclictest25-21ksoftirqd/122:08:011
683299119,1cyclictest25-21ksoftirqd/122:03:031
683299119,1cyclictest25-21ksoftirqd/100:31:091
683299119,1cyclictest25-21ksoftirqd/100:01:301
683299118,3cyclictest25-21ksoftirqd/121:31:521
683299114,4cyclictest22815-21sd-pam23:43:541
6832991110,1cyclictest25-21ksoftirqd/121:54:481
6832991110,1cyclictest25-21ksoftirqd/100:21:071
6832991110,1cyclictest0-21swapper/123:16:181
683299110,11cyclictest8799-21kworker/1:423:49:121
683199119,0cyclictest31730-21kworker/0:220:37:260
6831991110,0cyclictest31730-21kworker/0:219:22:440
275992110,0sleep10-21swapper/122:12:231
683899103,6cyclictest0-21swapper/719:06:117
683899103,1cyclictest786-21snmpd19:16:057
683899103,1cyclictest784-21runrttasks19:12:237
683899102,1cyclictest0-21swapper/719:38:427
683799108,1cyclictest65-21ksoftirqd/622:21:346
683799108,1cyclictest65-21ksoftirqd/622:21:346
683699109,1cyclictest57-21ksoftirqd/523:27:195
683699103,6cyclictest20393-21sshd21:27:245
683699103,6cyclictest0-21swapper/521:41:445
683699103,6cyclictest0-21swapper/521:41:445
683699102,4cyclictest10079-21sshd21:25:025
683699100,4cyclictest27962-21sshd00:14:205
683699100,4cyclictest22730-21kill00:21:265
683699100,4cyclictest1-21systemd21:13:065
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional