You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 20:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sat Apr 18, 2026 12:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1614321000,0sleep30-21swapper/310:59:583
80692940,0sleep40-21swapper/412:21:134
21922780,1sleep7686-21dbus-daemon10:57:147
221892690,2sleep2587199cyclictest09:06:242
5877996653,8cyclictest65-21ksoftirqd/611:08:066
5883996032,0cyclictest0-21swapper/711:08:067
5865995756,1cyclictest25-21ksoftirqd/111:08:061
586499540,53cyclictest9397-21kworker/0:111:08:050
227732530,0sleep6641ktimersoftd/611:48:396
572825228,8sleep70-21swapper/707:05:317
558725227,9sleep00-21swapper/007:03:320
162592510,0sleep2311rcuc/211:05:342
14312510,0sleep70-21swapper/709:13:107
154022490,0sleep70-21swapper/711:05:317
567124725,8sleep60-21swapper/607:04:426
37802470,0sleep40-21swapper/412:13:364
294202460,1sleep2587199cyclictest09:57:262
203942460,0sleep50-21swapper/509:34:465
203942460,0sleep50-21swapper/509:34:465
189532460,2sleep4587599cyclictest09:55:044
557024524,8sleep30-21swapper/307:03:193
541924524,9sleep40-21swapper/407:01:114
43222450,2sleep2587199cyclictest09:46:452
194852450,0sleep419468-21sshd11:18:414
194852450,0sleep419468-21sshd11:18:414
33102440,0sleep50-21swapper/512:15:295
291262440,0sleep329119-21sshd12:26:083
178362440,0sleep60-21swapper/611:42:466
82652430,1sleep5587699cyclictest09:52:335
564824332,8sleep50-21swapper/507:04:255
44922430,0sleep2321ktimersoftd/209:24:342
320362430,1sleep332027-21bash10:34:513
276852430,0sleep10-21swapper/111:19:101
276852430,0sleep10-21swapper/111:19:101
211842430,0sleep50-21swapper/512:23:545
194542420,0sleep20-21swapper/210:56:212
144132420,0sleep60-21swapper/612:17:546
124252420,0sleep30-21swapper/311:18:163
124252420,0sleep30-21swapper/311:18:163
587699410,40cyclictest14171-21kworker/u16:211:08:065
34172410,2sleep0586499cyclictest11:40:080
237102410,0sleep70-21swapper/711:46:487
162442410,0sleep40-21swapper/411:51:574
158552410,0sleep70-21swapper/712:14:197
105752410,0sleep60-21swapper/609:37:526
6322400,0sleep30-21swapper/310:06:563
5871994039,1cyclictest22379-21kworker/2:011:08:062
256582400,2sleep4587599cyclictest11:13:294
160072400,0sleep50-21swapper/509:41:515
13812400,0sleep10-21swapper/110:47:551
547423917,8sleep10-21swapper/107:01:571
543523926,9sleep20-21swapper/207:01:252
293002390,0sleep20-21swapper/211:52:432
256912390,0sleep00-21swapper/010:17:420
219682390,1sleep449-21ksoftirqd/411:04:004
186512390,0sleep3391rcuc/311:13:043
160532390,1sleep016047-21systemd11:18:290
160532390,1sleep016047-21systemd11:18:290
152002360,0sleep00-21swapper/011:40:480
225982230,2sleep1586599cyclictest12:16:291
100392210,10sleep687950irq/25-em1-rx-012:00:566
100392210,10sleep687950irq/25-em1-rx-012:00:566
5874992018,2cyclictest786-21snmpd11:08:063
321882200,0sleep60-21swapper/612:13:226
175632190,0sleep00-21swapper/012:05:070
175632190,0sleep00-21swapper/012:05:070
5883991815,2cyclictest73-21ksoftirqd/712:27:267
5883991811,2cyclictest73-21ksoftirqd/711:13:417
73712170,0sleep30-21swapper/311:44:033
5883991716,1cyclictest73-21ksoftirqd/711:21:597
5883991715,1cyclictest73-21ksoftirqd/711:36:247
5883991715,1cyclictest73-21ksoftirqd/710:11:107
5883991714,2cyclictest73-21ksoftirqd/711:29:177
5876991715,1cyclictest57-21ksoftirqd/509:56:215
587599171,15cyclictest1-21systemd11:08:064
5865991715,1cyclictest25-21ksoftirqd/111:12:461
5865991715,1cyclictest25-21ksoftirqd/110:54:211
80862160,0sleep38082-21sshd10:37:083
5883991615,1cyclictest73-21ksoftirqd/712:06:017
5883991615,1cyclictest73-21ksoftirqd/712:06:017
5883991615,1cyclictest73-21ksoftirqd/710:06:047
5883991615,1cyclictest73-21ksoftirqd/709:06:427
5883991614,1cyclictest73-21ksoftirqd/712:21:407
5883991614,1cyclictest73-21ksoftirqd/710:36:067
5883991614,1cyclictest73-21ksoftirqd/710:30:037
5883991614,1cyclictest73-21ksoftirqd/709:56:347
5883991614,1cyclictest73-21ksoftirqd/709:26:547
5883991613,1cyclictest73-21ksoftirqd/712:17:597
5883991612,2cyclictest73-21ksoftirqd/712:31:007
588399160,2cyclictest131rcu_sched09:51:427
588399160,15cyclictest17380-21kworker/7:211:15:557
588399160,15cyclictest17380-21kworker/7:211:15:557
587599160,12cyclictest24348-21sshd09:29:254
5865991614,1cyclictest25-21ksoftirqd/110:40:221
116652160,0sleep40-21swapper/410:02:014
588399158,3cyclictest73-21ksoftirqd/709:47:577
5883991513,1cyclictest73-21ksoftirqd/711:55:557
5883991513,1cyclictest73-21ksoftirqd/710:47:497
5883991513,1cyclictest73-21ksoftirqd/710:44:047
5883991513,1cyclictest73-21ksoftirqd/710:32:337
5883991513,1cyclictest73-21ksoftirqd/710:18:017
5883991513,1cyclictest73-21ksoftirqd/709:35:587
5883991513,1cyclictest73-21ksoftirqd/709:30:597
5883991513,1cyclictest73-21ksoftirqd/709:30:597
5883991513,1cyclictest73-21ksoftirqd/709:22:447
5883991513,1cyclictest73-21ksoftirqd/709:18:447
5883991513,1cyclictest711rcuc/709:44:567
5883991511,3cyclictest73-21ksoftirqd/711:42:127
5883991511,1cyclictest73-21ksoftirqd/710:03:437
5876991514,1cyclictest57-21ksoftirqd/511:39:415
5876991514,1cyclictest57-21ksoftirqd/510:20:165
5876991514,1cyclictest57-21ksoftirqd/509:13:345
5874991512,2cyclictest1-21systemd09:45:433
5871991512,2cyclictest27836-21systemd10:51:142
5865991513,1cyclictest25-21ksoftirqd/111:53:031
5865991513,1cyclictest25-21ksoftirqd/111:30:591
5865991513,1cyclictest25-21ksoftirqd/110:05:231
5865991513,1cyclictest25-21ksoftirqd/109:45:281
317162158,3sleep449-21ksoftirqd/412:26:184
132032150,0sleep40-21swapper/412:19:454
87822140,0sleep5551rcuc/509:28:305
5883991413,1cyclictest73-21ksoftirqd/711:35:057
5883991412,1cyclictest73-21ksoftirqd/711:50:577
5883991412,1cyclictest73-21ksoftirqd/710:21:317
588399140,1cyclictest131rcu_sched10:52:327
5865991413,1cyclictest25-21ksoftirqd/112:25:451
5865991413,1cyclictest25-21ksoftirqd/112:24:411
5865991412,1cyclictest25-21ksoftirqd/112:33:221
279132140,0sleep40-21swapper/410:47:344
267562140,0sleep10-21swapper/110:10:231
194292140,0sleep60-21swapper/611:57:446
167262140,0sleep00-21swapper/011:53:530
157032140,1sleep315696-21sshd11:22:093
146842140,0sleep20-21swapper/209:28:512
59712130,0sleep30-21swapper/309:15:223
5883991311,1cyclictest73-21ksoftirqd/712:02:027
5883991311,1cyclictest73-21ksoftirqd/712:02:027
5877991311,1cyclictest65-21ksoftirqd/610:16:126
5876991312,1cyclictest57-21ksoftirqd/510:27:245
5876991311,1cyclictest57-21ksoftirqd/510:21:315
5876991311,1cyclictest57-21ksoftirqd/509:19:265
5876991311,1cyclictest32699-21systemd09:22:275
587599135,2cyclictest2440-21grep10:42:234
587599134,2cyclictest26925-21grepconf.sh10:15:564
587599134,2cyclictest16368-21kill09:23:224
587599133,3cyclictest9312-21grepconf.sh09:17:244
587599132,5cyclictest20048-21bash09:56:534
5874991312,1cyclictest41-21ksoftirqd/310:19:293
5874991311,1cyclictest41-21ksoftirqd/311:50:293
5874991311,1cyclictest41-21ksoftirqd/309:52:053
587499131,11cyclictest686-21dbus-daemon09:19:303
587499130,12cyclictest8610-21kworker/3:412:07:543
587499130,12cyclictest8610-21kworker/3:412:07:543
587199133,4cyclictest492-21systemd-journal10:24:022
587199132,5cyclictest8399-21sshd09:19:152
5871991312,1cyclictest33-21ksoftirqd/211:33:462
5865991312,1cyclictest25-21ksoftirqd/110:20:151
5865991312,1cyclictest25-21ksoftirqd/110:13:421
5865991311,1cyclictest25-21ksoftirqd/112:13:151
5865991311,1cyclictest25-21ksoftirqd/109:13:481
5865991311,1cyclictest25-21ksoftirqd/109:08:381
5865991311,1cyclictest25-21ksoftirqd/107:35:421
586499133,4cyclictest16016-21sshd09:28:550
586499132,5cyclictest3591-21sshd11:30:490
5864991312,1cyclictest9-21ksoftirqd/011:15:340
5864991311,1cyclictest9-21ksoftirqd/010:41:290
5864991310,2cyclictest20167-21cp12:20:090
5864991310,1cyclictest9-21ksoftirqd/012:32:360
39922130,1sleep2492-21systemd-journal12:11:422
252902130,0sleep40-21swapper/411:28:194
235922130,0sleep20-21swapper/209:36:442
222982130,0sleep50-21swapper/510:37:585
182672130,0sleep10-21swapper/109:23:291
126222130,0sleep10-21swapper/111:01:321
63632120,0sleep00-21swapper/009:54:200
587799128,2cyclictest65-21ksoftirqd/609:45:256
587799122,4cyclictest686-21dbus-daemon12:06:386
587799122,4cyclictest686-21dbus-daemon12:06:386
587799122,4cyclictest5685-21sshd11:40:166
587799122,4cyclictest3435-21sshd11:55:016
587799122,4cyclictest32671-21id10:31:046
587799122,4cyclictest29009-21sshd12:26:086
587799122,4cyclictest22840-21sshd11:04:036
587799122,4cyclictest20388-21sshd11:15:046
587799122,4cyclictest13390-21sshd10:04:016
587799122,4cyclictest0-21swapper/610:49:386
587799122,4cyclictest0-21swapper/610:08:286
587799122,4cyclictest0-21swapper/609:24:396
5877991211,1cyclictest65-21ksoftirqd/609:31:586
5877991211,1cyclictest65-21ksoftirqd/609:31:586
587799121,5cyclictest6414-21bash09:28:226
587799121,5cyclictest30735-21grep09:53:526
587799121,5cyclictest24211-21systemd10:43:406
587799121,5cyclictest1870-21id10:51:376
587799120,11cyclictest21888-21kworker/6:111:20:566
587799120,11cyclictest0-21swapper/612:30:556
587699128,3cyclictest57-21ksoftirqd/510:03:565
587699126,3cyclictest27305-21sshd10:12:115
587699125,4cyclictest23575-21rm09:40:325
587699123,5cyclictest1-21systemd10:09:055
5876991211,1cyclictest57-21ksoftirqd/509:10:255
5876991210,1cyclictest57-21ksoftirqd/512:31:005
5876991210,1cyclictest57-21ksoftirqd/512:00:235
5876991210,1cyclictest57-21ksoftirqd/511:49:075
5876991210,1cyclictest57-21ksoftirqd/511:43:455
5876991210,1cyclictest57-21ksoftirqd/510:54:055
587699120,11cyclictest12166-21kworker/5:212:26:245
587599125,2cyclictest686-21dbus-daemon11:46:524
587599124,2cyclictest885-21polkitd10:56:514
587599124,2cyclictest3724-21bash11:38:144
587599124,2cyclictest29806-21kill10:12:204
587599124,2cyclictest29787-21rm10:06:454
587599124,2cyclictest28676-21sshd11:41:294
587599124,2cyclictest2818-21grepconf.sh12:06:024
587599124,2cyclictest2818-21grepconf.sh12:06:024
587599124,2cyclictest25062-21grepconf.sh09:31:134
587599124,2cyclictest25062-21grepconf.sh09:31:134
587599124,2cyclictest17094-21grep10:50:444
587599124,2cyclictest16880-21nscd10:25:544
587599124,2cyclictest14565-21bash11:57:264
587599124,2cyclictest10538-21bash09:43:274
587599124,2cyclictest10380-21grep11:23:454
587599123,2cyclictest691-21systemd-logind10:31:354
587599123,2cyclictest17856-21bash12:01:194
587599123,2cyclictest17856-21bash12:01:194
587499129,3cyclictest41-21ksoftirqd/312:34:463
587499129,2cyclictest41-21ksoftirqd/311:28:113
5874991211,1cyclictest41-21ksoftirqd/312:23:273
5874991211,1cyclictest41-21ksoftirqd/309:21:373
5874991210,2cyclictest41-21ksoftirqd/312:18:113
5874991210,1cyclictest691-21systemd-logind10:05:323
5874991210,1cyclictest41-21ksoftirqd/311:36:523
5874991210,1cyclictest41-21ksoftirqd/310:41:223
5874991210,1cyclictest41-21ksoftirqd/309:50:223
5874991210,1cyclictest41-21ksoftirqd/309:09:173
586599129,1cyclictest25-21ksoftirqd/109:33:281
586599129,1cyclictest25-21ksoftirqd/109:33:281
5865991211,1cyclictest25-21ksoftirqd/111:29:291
5865991210,1cyclictest25-21ksoftirqd/111:39:201
5865991210,1cyclictest25-21ksoftirqd/110:34:551
5865991210,1cyclictest25-21ksoftirqd/109:55:331
5865991210,1cyclictest25-21ksoftirqd/109:30:121
5865991210,1cyclictest25-21ksoftirqd/107:25:421
586499125,6cyclictest23946-21bash12:25:550
586499122,5cyclictest12135-21bash11:46:060
586499122,4cyclictest797-21sshd10:58:180
586499122,4cyclictest28935-21systemd12:07:340
586499122,4cyclictest28935-21systemd12:07:340
586499122,4cyclictest27452-21sshd10:21:300
586499122,4cyclictest19797-21sshd09:43:590
586499122,4cyclictest1-21systemd09:37:270
586499121,5cyclictest1-21systemd10:14:200
586499120,2cyclictest4309-21sshd09:19:000
145032120,0sleep60-21swapper/610:28:146
587799112,4cyclictest7782-21sshd11:32:526
587799111,4cyclictest686-21dbus-daemon09:47:076
587799111,4cyclictest32638-21systemd-cgroups11:15:466
587799111,4cyclictest32638-21systemd-cgroups11:15:466
587799111,4cyclictest31383-21grepconf.sh11:26:456
587799111,4cyclictest3038-21bash10:59:126
587799111,4cyclictest28211-21systemd-cgroups10:38:186
587799111,4cyclictest21906-21sshd12:23:576
587799111,4cyclictest13575-21sshd09:11:596
587799111,4cyclictest0-21swapper/610:11:586
587799110,10cyclictest10159-21kworker/6:109:16:486
587799110,1cyclictest0-21swapper/610:21:296
587699119,1cyclictest57-21ksoftirqd/512:06:115
587699119,1cyclictest57-21ksoftirqd/512:06:115
587699119,1cyclictest57-21ksoftirqd/512:04:235
587699119,1cyclictest57-21ksoftirqd/512:04:235
587699119,1cyclictest57-21ksoftirqd/511:35:025
587699119,1cyclictest57-21ksoftirqd/511:19:365
587699119,1cyclictest57-21ksoftirqd/511:19:365
587699119,1cyclictest57-21ksoftirqd/511:03:575
587699119,1cyclictest57-21ksoftirqd/510:40:575
587699118,2cyclictest17276-21latency_hist07:25:425
587699118,1cyclictest57-21ksoftirqd/511:27:465
587699118,1cyclictest57-21ksoftirqd/510:47:075
5876991110,1cyclictest57-21ksoftirqd/510:56:365
587599119,1cyclictest49-21ksoftirqd/410:23:104
587599114,2cyclictest22171-21grepconf.sh09:06:244
587599114,2cyclictest19606-21sshd09:45:524
587599114,2cyclictest13718-21bash11:31:184
587599114,1cyclictest2573-21grep09:11:204
587599114,1cyclictest16828-21grep10:35:514
587599114,1cyclictest14624-21grep09:36:124
587599113,2cyclictest23596-21bash12:31:254
587599112,2cyclictest27790-21munin-run08:40:424
587499119,1cyclictest41-21ksoftirqd/311:30:533
587499119,1cyclictest41-21ksoftirqd/311:02:173
587499119,1cyclictest41-21ksoftirqd/310:27:343
587499119,1cyclictest41-21ksoftirqd/310:22:263
587499119,1cyclictest41-21ksoftirqd/310:10:503
587499119,1cyclictest1-21systemd09:40:303
5874991110,1cyclictest41-21ksoftirqd/311:52:573
587499110,10cyclictest29755-21sshd10:45:533
587199119,1cyclictest33-21ksoftirqd/211:37:142
5871991110,1cyclictest33-21ksoftirqd/210:09:132
587199111,4cyclictest16849-21cut11:40:532
587199111,4cyclictest0-21swapper/211:16:532
587199111,4cyclictest0-21swapper/211:16:532
587199110,5cyclictest6962-21sshd11:12:232
587199110,5cyclictest691-21systemd-logind12:03:462
587199110,5cyclictest691-21systemd-logind12:03:462
587199110,5cyclictest30352-21rm11:24:562
587199110,11cyclictest7593-21kworker/2:612:10:102
587199110,11cyclictest7593-21kworker/2:612:10:102
587199110,11cyclictest13150-21kworker/2:311:56:322
586599119,2cyclictest25-21ksoftirqd/110:24:471
586599119,1cyclictest25-21ksoftirqd/111:58:191
586599118,3cyclictest25-21ksoftirqd/110:56:521
5865991110,1cyclictest632-21kworker/1:011:45:431
5865991110,1cyclictest25-21ksoftirqd/112:10:111
5865991110,1cyclictest25-21ksoftirqd/112:10:111
5865991110,1cyclictest25-21ksoftirqd/111:23:581
5865991110,1cyclictest25-21ksoftirqd/109:59:431
5865991110,1cyclictest25-21ksoftirqd/109:47:201
5865991110,1cyclictest25-21ksoftirqd/109:39:261
5865991110,1cyclictest25-21ksoftirqd/109:18:451
5865991110,1cyclictest0-21swapper/110:44:161
586599110,10cyclictest0-21swapper/112:03:051
586599110,10cyclictest0-21swapper/112:03:051
586499117,1cyclictest9-21ksoftirqd/010:51:000
586499112,4cyclictest7526-21sshd09:48:510
586499111,4cyclictest30880-21sshd11:23:030
586499111,4cyclictest27627-21sshd12:22:220
586499110,11cyclictest2061-21kworker/0:212:12:070
586499110,11cyclictest0-21swapper/009:23:480
586499110,10cyclictest29856-21kworker/0:010:32:170
586499110,1cyclictest0-21swapper/010:26:560
586499110,1cyclictest0-21swapper/009:09:130
156342110,0sleep20-21swapper/210:35:462
587799102,3cyclictest885-21polkitd09:55:506
587799101,4cyclictest29906-21sshd09:09:136
587699109,1cyclictest57-21ksoftirqd/510:31:295
587699107,2cyclictest57-21ksoftirqd/512:17:035
587699106,3cyclictest686-21dbus-daemon11:21:205
587699100,2cyclictest12309-21bash11:53:385
587599101,2cyclictest0-21swapper/408:21:344
587599100,5cyclictest0-21swapper/408:40:584
587499109,1cyclictest41-21ksoftirqd/309:28:343
587499108,1cyclictest41-21ksoftirqd/312:11:183
587499108,1cyclictest41-21ksoftirqd/309:30:463
587499108,1cyclictest41-21ksoftirqd/309:30:463
587499106,1cyclictest41-21ksoftirqd/312:03:243
587499106,1cyclictest41-21ksoftirqd/312:03:243
587499100,10cyclictest0-21swapper/309:56:423
587199108,2cyclictest33-21ksoftirqd/210:11:512
587199108,1cyclictest33-21ksoftirqd/210:17:442
587199103,6cyclictest3167-21cp10:01:302
587199102,2cyclictest5796-21sshd12:22:592
587199101,5cyclictest0-21swapper/209:45:412
587199101,4cyclictest7190-21systemd-cgroups11:49:392
587199100,4cyclictest15532-21sshd12:34:462
587199100,4cyclictest1381-21sshd11:28:482
587199100,4cyclictest0-21swapper/210:33:142
587199100,10cyclictest30727-21kworker/2:310:47:452
587199100,10cyclictest23585-21kworker/2:210:45:412
587199100,10cyclictest19692-21kworker/2:410:25:452
587199100,1cyclictest22833-21sshd09:14:262
586599109,1cyclictest25-21ksoftirqd/110:25:541
586599108,1cyclictest25-21ksoftirqd/111:43:201
586499108,1cyclictest9-21ksoftirqd/011:26:240
586499103,6cyclictest24288-21sshd09:33:060
586499103,6cyclictest24288-21sshd09:33:060
586499103,3cyclictest30062-21sshd10:06:460
586499101,4cyclictest5826-21sshd11:01:080
586499101,4cyclictest30441-21sshd09:55:430
586499100,4cyclictest22516-21sshd09:14:250
586499100,4cyclictest11199-21grepconf.sh10:37:190
586499100,4cyclictest0-21swapper/010:01:300
586499100,10cyclictest24200-21kworker/0:310:46:440
58769998,1cyclictest57-21ksoftirqd/509:45:525
58769997,1cyclictest57-21ksoftirqd/511:10:435
58749998,1cyclictest41-21ksoftirqd/310:52:373
58749993,3cyclictest17294-21systemd11:55:493
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional