You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 15:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Mon Jul 20, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
272122970,1sleep7525099cyclictest12:04:077
258722850,2sleep5523599cyclictest09:38:445
10742720,1sleep665-21ksoftirqd/612:22:486
177162700,0sleep50-21swapper/510:17:525
60042540,0sleep665-21ksoftirqd/611:18:496
60042540,0sleep665-21ksoftirqd/611:18:496
128562540,0sleep60-21swapper/610:05:046
475525240,8sleep50-21swapper/507:02:305
485025026,8sleep60-21swapper/607:03:516
473025025,9sleep70-21swapper/707:02:087
291222500,0sleep229115-21sshd10:11:252
156812500,1sleep1519999cyclictest11:32:051
145892500,0sleep2321ktimersoftd/209:43:292
145892500,0sleep2321ktimersoftd/209:43:292
29872490,0sleep00-21swapper/010:45:590
67502480,0sleep20-21swapper/210:13:412
103202480,0sleep10-21swapper/110:58:571
76692470,0sleep40-21swapper/410:53:244
309102470,1sleep51-21systemd11:22:005
159392470,0sleep70-21swapper/711:50:377
96242460,0sleep40-21swapper/410:03:024
504324633,9sleep30-21swapper/307:06:283
237292450,0sleep20-21swapper/211:05:152
236102450,0sleep40-21swapper/412:20:304
291832440,0sleep30-21swapper/311:58:423
226522440,2sleep2520799cyclictest09:38:332
97712420,0sleep50-21swapper/510:22:495
56802420,0sleep00-21swapper/010:35:170
56802420,0sleep00-21swapper/010:35:170
500124230,9sleep10-21swapper/107:05:541
27692420,0sleep10-21swapper/110:42:151
249102420,0sleep20-21swapper/209:26:072
240882420,0sleep624068-21sshd11:32:346
220822420,0sleep00-21swapper/010:12:430
209892420,1sleep2721-21dbus-daemon11:23:172
196132420,0sleep00-21swapper/011:56:230
499624127,9sleep00-21swapper/007:05:530
271892410,0sleep30-21swapper/309:24:243
177302410,2sleep585250irq/26-em1-tx-010:30:345
130952410,0sleep40-21swapper/409:11:044
59122400,0sleep10-21swapper/109:37:361
500424028,9sleep40-21swapper/407:05:574
49582400,0sleep00-21swapper/009:33:580
260912400,0sleep30-21swapper/309:31:373
81002390,0sleep40-21swapper/409:53:574
480123927,9sleep20-21swapper/207:03:072
295632390,0sleep60-21swapper/609:55:116
284952390,0sleep00-21swapper/010:11:230
168072390,0sleep50-21swapper/507:26:395
65672380,0sleep10-21swapper/109:28:391
219072380,2sleep2520799cyclictest11:47:122
323032370,0sleep10-21swapper/110:54:491
65192360,0sleep1241ktimersoftd/110:02:511
178132360,1sleep517812-21systemd-cgroups10:08:555
50072350,0sleep50-21swapper/512:08:215
153662320,1sleep515363-21sshd11:50:355
524299221,3cyclictest721-21dbus-daemon11:53:546
5207992219,3cyclictest33-21ksoftirqd/211:33:492
524299210,7cyclictest30919-21grep12:04:206
524299210,5cyclictest1-21systemd11:31:036
524299210,2cyclictest0-21swapper/609:26:596
5207992117,1cyclictest33-21ksoftirqd/209:54:052
260662210,0sleep40-21swapper/410:40:024
524299202,1cyclictest7971-21sshd11:57:276
524299201,6cyclictest8649-21bash09:10:496
524299200,6cyclictest32280-21sshd10:31:236
524299200,3cyclictest859-21gdbus11:24:296
524299200,3cyclictest29818-21sshd09:26:246
520799207,1cyclictest33-21ksoftirqd/212:13:062
524299193,1cyclictest21733-21id10:25:226
524299190,6cyclictest6447-21grepconf.sh10:40:456
524299190,6cyclictest18544-21grepconf.sh09:58:066
524299190,6cyclictest18428-21sshd11:43:206
524299190,5cyclictest23386-21grep10:41:426
524299190,4cyclictest17090-21grep11:48:486
5207991915,1cyclictest33-21ksoftirqd/209:50:152
5207991915,1cyclictest33-21ksoftirqd/209:11:002
5207991913,3cyclictest33-21ksoftirqd/212:19:242
520799190,18cyclictest464-21systemd-journal12:28:062
3392190,0sleep60-21swapper/611:00:146
221062190,0sleep50-21swapper/512:03:495
116412190,0sleep00-21swapper/011:06:250
524299182,1cyclictest721-21dbus-daemon12:29:336
524299182,1cyclictest721-21dbus-daemon10:32:546
524299182,1cyclictest721-21dbus-daemon10:32:546
5242991815,1cyclictest65-21ksoftirqd/611:13:026
524299180,7cyclictest2083-21cp09:35:396
524299180,6cyclictest7497-21sshd12:17:406
524299180,6cyclictest721-21dbus-daemon12:36:026
524299180,6cyclictest1-21systemd11:02:416
524299180,5cyclictest721-21dbus-daemon09:16:466
524299180,5cyclictest12700-21sshd12:06:576
520799185,1cyclictest33-21ksoftirqd/211:53:472
5207991816,1cyclictest33-21ksoftirqd/210:38:312
5207991815,3cyclictest33-21ksoftirqd/209:27:412
5207991815,1cyclictest33-21ksoftirqd/212:02:372
5207991815,1cyclictest33-21ksoftirqd/211:11:162
5207991814,2cyclictest33-21ksoftirqd/209:32:452
5207991814,2cyclictest33-21ksoftirqd/209:15:352
5207991814,1cyclictest33-21ksoftirqd/210:55:012
27642180,1sleep12734-21sshd10:18:531
21132180,2sleep2520799cyclictest12:24:442
113612180,0sleep30-21swapper/311:44:493
525099171,10cyclictest24170-21nscd12:01:187
524299172,14cyclictest1-21systemd09:16:266
524299172,1cyclictest10595-21sshd12:12:196
524299170,6cyclictest721-21dbus-daemon10:54:386
524299170,6cyclictest709-21systemd-logind10:15:476
524299170,6cyclictest4917-21grepconf.sh09:48:206
524299170,5cyclictest21376-21bash10:46:576
524299170,5cyclictest20233-21ps09:41:596
524299170,5cyclictest20233-21ps09:41:596
524299170,5cyclictest17893-21bash11:37:446
520799175,1cyclictest33-21ksoftirqd/210:32:442
520799175,1cyclictest33-21ksoftirqd/210:32:442
5207991716,1cyclictest33-21ksoftirqd/209:01:152
5207991715,1cyclictest464-21systemd-journal09:18:012
5207991715,1cyclictest33-21ksoftirqd/212:33:582
5207991715,1cyclictest33-21ksoftirqd/212:11:222
5207991715,1cyclictest33-21ksoftirqd/211:57:472
5207991715,1cyclictest33-21ksoftirqd/211:30:322
5207991714,3cyclictest33-21ksoftirqd/211:37:312
5207991714,3cyclictest33-21ksoftirqd/210:46:542
5207991714,3cyclictest33-21ksoftirqd/210:03:272
5207991714,2cyclictest311rcuc/211:12:412
5207991713,3cyclictest33-21ksoftirqd/211:18:232
5207991713,3cyclictest33-21ksoftirqd/211:18:232
5207991713,1cyclictest33-21ksoftirqd/210:57:552
5207991713,1cyclictest33-21ksoftirqd/210:21:082
5207991712,4cyclictest33-21ksoftirqd/210:27:192
520799170,3cyclictest121rcu_preempt10:46:212
281612170,0sleep30-21swapper/310:52:433
175622170,1sleep30-21swapper/309:34:413
74152160,0sleep50-21swapper/509:48:295
524299163,1cyclictest1-21systemd10:07:126
524299160,7cyclictest1007-21sshd09:39:106
524299160,6cyclictest5621-21bash11:07:496
524299160,3cyclictest31072-21bash10:16:526
5207991614,1cyclictest33-21ksoftirqd/209:57:032
288042160,1sleep3758-21runrttasks09:20:563
218912160,1sleep721890-21bash11:06:567
5235991510,1cyclictest57-21ksoftirqd/509:30:245
5207991514,1cyclictest33-21ksoftirqd/211:42:012
5207991512,3cyclictest33-21ksoftirqd/210:21:422
5191991514,1cyclictest9-21ksoftirqd/011:09:450
88432140,0sleep40-21swapper/412:30:394
5235991412,1cyclictest15495-21sshd11:21:145
5235991412,1cyclictest15495-21sshd11:21:145
5228991413,1cyclictest0-21swapper/411:28:424
5216991413,1cyclictest41-21ksoftirqd/311:53:203
521699140,14cyclictest11625-21kworker/3:110:33:263
521699140,14cyclictest11625-21kworker/3:110:33:263
5207991412,1cyclictest33-21ksoftirqd/209:06:402
286082140,0sleep00-21swapper/011:21:550
255272140,0sleep00-21swapper/010:18:200
66652130,0sleep30-21swapper/309:59:163
523599137,5cyclictest4581-21sshd09:23:065
522899132,5cyclictest6722-21systemd11:02:194
522899132,5cyclictest18378-21bash10:14:214
522899130,12cyclictest859-21gdbus12:11:194
521699132,5cyclictest5958-21sshd11:31:403
5216991312,1cyclictest41-21ksoftirqd/311:03:333
5216991312,1cyclictest41-21ksoftirqd/309:54:173
521699130,2cyclictest721-21dbus-daemon11:19:043
521699130,2cyclictest721-21dbus-daemon11:19:043
519999138,3cyclictest25-21ksoftirqd/110:35:461
519999138,3cyclictest25-21ksoftirqd/110:35:461
5191991312,1cyclictest9-21ksoftirqd/011:50:430
307282130,1sleep530724-21systemd11:29:215
152702130,0sleep50-21swapper/509:54:225
525099122,4cyclictest5796-21id10:53:177
525099122,4cyclictest23981-21sshd11:45:337
525099122,4cyclictest1015-21sshd09:30:117
525099120,12cyclictest13413-21kworker/7:210:13:307
5235991210,1cyclictest57-21ksoftirqd/510:46:395
5235991210,1cyclictest57-21ksoftirqd/509:46:165
5235991210,1cyclictest57-21ksoftirqd/509:46:165
5235991210,1cyclictest29510-21bash09:56:565
5235991210,1cyclictest0-21swapper/510:39:375
523599120,0cyclictest0-21swapper/512:35:165
522899124,7cyclictest11573-21grep11:31:544
522899122,4cyclictest5017-21sshd10:44:144
522899122,4cyclictest3291-21systemd-cgroups11:00:244
522899122,4cyclictest32748-21grepconf.sh10:00:464
522899122,4cyclictest11813-21grepconf.sh11:22:454
5228991210,1cyclictest49-21ksoftirqd/412:15:534
5228991210,1cyclictest49-21ksoftirqd/411:15:154
522899121,5cyclictest1-21systemd11:10:194
522899120,12cyclictest4455-21kworker/4:109:27:534
522899120,12cyclictest30059-21sshd11:47:404
522899120,11cyclictest756-21sshd11:42:474
522899120,11cyclictest709-21systemd-logind10:07:154
522899120,11cyclictest19954-21systemd-cgroups09:20:264
521699122,4cyclictest7372-21systemd-cgroups09:12:273
521699122,4cyclictest26962-21systemd-cgroups11:21:513
521699122,4cyclictest17627-21sshd12:27:233
521699120,11cyclictest24146-21kworker/3:010:29:233
521699120,11cyclictest16655-21kworker/3:112:06:023
5199991210,1cyclictest25-21ksoftirqd/111:22:121
5199991210,1cyclictest25-21ksoftirqd/111:11:031
519199121,5cyclictest721-21dbus-daemon10:04:590
519199121,5cyclictest27232-21kill12:22:260
47572120,0sleep00-21swapper/012:34:030
40452120,1sleep74028-21bash09:41:107
280052120,0sleep10-21swapper/112:15:141
26392120,0sleep10-21swapper/109:42:481
26392120,0sleep10-21swapper/109:42:481
253492120,0sleep00-21swapper/007:41:400
113672120,0sleep00-21swapper/010:51:510
525099119,1cyclictest73-21ksoftirqd/710:26:297
525099119,1cyclictest24339-21systemd-cgroups09:22:237
525099114,6cyclictest8237-21sshd12:23:127
525099113,7cyclictest720-21irqbalance12:29:217
525099112,4cyclictest8305-21sshd12:19:377
525099112,4cyclictest21429-21bash09:45:447
525099112,4cyclictest21429-21bash09:45:447
5250991110,1cyclictest0-21swapper/711:33:527
525099110,11cyclictest9275-21kworker/7:411:52:347
525099110,11cyclictest6877-21kworker/7:409:59:427
525099110,11cyclictest25471-21kworker/7:210:50:167
525099110,11cyclictest21263-21kworker/7:312:12:207
525099110,11cyclictest17991-21kworker/7:409:17:307
525099110,10cyclictest9275-21kworker/7:411:41:107
525099110,1cyclictest29969-21sshd09:47:567
523599115,2cyclictest0-21swapper/508:31:225
523599114,7cyclictest0-21swapper/509:32:485
523599114,3cyclictest15582-21nscd11:02:595
523599114,3cyclictest0-21swapper/511:43:065
523599113,4cyclictest9907-21sshd10:12:015
523599113,2cyclictest0-21swapper/509:16:185
523599113,0cyclictest0-21swapper/511:37:265
523599112,5cyclictest17718-21sshd11:06:455
523599111,9cyclictest5452-21sshd10:53:165
523599111,7cyclictest721-21dbus-daemon12:17:185
523599111,4cyclictest0-21swapper/508:58:145
523599111,10cyclictest23384-21sshd10:05:405
523599110,2cyclictest32430-21sshd09:17:265
523599110,2cyclictest17145-21bash10:32:145
523599110,2cyclictest17145-21bash10:32:145
523599110,1cyclictest19037-21sshd09:11:245
523599110,1cyclictest0-21swapper/512:27:555
523599110,1cyclictest0-21swapper/511:34:385
522899119,1cyclictest9314-21kernelversion07:11:564
522899119,1cyclictest49-21ksoftirqd/410:50:344
522899113,2cyclictest8286-21systemd10:28:104
522899112,4cyclictest0-21swapper/412:04:594
522899112,4cyclictest0-21swapper/411:17:574
522899112,4cyclictest0-21swapper/411:17:574
5228991110,1cyclictest49-21ksoftirqd/409:41:504
5228991110,1cyclictest49-21ksoftirqd/409:41:504
522899111,4cyclictest6666-21sshd10:24:314
522899111,4cyclictest2037-21sshd09:37:224
522899111,4cyclictest17168-21sshd11:59:534
522899111,4cyclictest14533-21grepconf.sh11:54:114
522899110,5cyclictest721-21dbus-daemon09:48:294
522899110,5cyclictest1-21systemd11:36:464
522899110,11cyclictest4455-21kworker/4:110:17:054
522899110,11cyclictest4455-21kworker/4:109:33:124
522899110,11cyclictest4455-21kworker/4:109:12:564
522899110,11cyclictest23246-21kworker/4:012:35:054
522899110,1cyclictest0-21swapper/412:23:184
521699119,1cyclictest41-21ksoftirqd/310:22:383
521699112,3cyclictest19342-21sshd10:09:003
5216991110,1cyclictest41-21ksoftirqd/309:08:253
521699111,4cyclictest721-21dbus-daemon10:57:123
521699111,4cyclictest13536-21sshd10:12:143
521699110,5cyclictest8080-21bash12:08:323
521699110,5cyclictest25095-21systemd10:45:243
521699110,11cyclictest18549-21kworker/3:410:02:173
521699110,11cyclictest15449-21kworker/3:510:36:533
521699110,1cyclictest0-21swapper/311:35:183
5207991110,1cyclictest33-21ksoftirqd/207:56:402
5207991110,1cyclictest33-21ksoftirqd/207:36:402
5207991110,1cyclictest33-21ksoftirqd/207:21:482
519999119,1cyclictest25-21ksoftirqd/112:22:101
519999119,1cyclictest25-21ksoftirqd/110:40:461
519999119,1cyclictest25-21ksoftirqd/109:36:291
519199119,1cyclictest9-21ksoftirqd/009:40:540
519199119,1cyclictest721-21dbus-daemon09:50:050
519199118,2cyclictest1404-21bash11:16:470
519199118,2cyclictest1404-21bash11:16:470
519199114,4cyclictest3339-21/usr/sbin/munin08:56:400
519199114,4cyclictest3339-21/usr/sbin/munin08:56:400
519199112,4cyclictest464-21systemd-journal12:12:010
519199112,4cyclictest0-21swapper/011:59:400
5191991110,1cyclictest9-21ksoftirqd/012:27:030
5191991110,1cyclictest9-21ksoftirqd/011:00:150
519199111,4cyclictest0-21swapper/010:46:500
519199110,5cyclictest31938-21grep10:24:060
519199110,11cyclictest9099-21kworker/0:109:11:060
519199110,11cyclictest31998-21kworker/0:209:12:450
519199110,11cyclictest21535-21kworker/0:111:30:130
519199110,1cyclictest20778-21sshd11:37:550
34232110,1sleep73422-21bash09:15:557
33142110,1sleep3391rcuc/312:33:583
179462110,1sleep00-21swapper/010:39:350
64172100,0sleep10-21swapper/111:29:491
525099108,1cyclictest73-21ksoftirqd/711:29:127
525099108,1cyclictest73-21ksoftirqd/709:08:447
525099108,1cyclictest721-21dbus-daemon11:19:317
525099108,1cyclictest721-21dbus-daemon11:19:317
525099103,6cyclictest14923-21sshd11:12:007
525099103,1cyclictest4526-21sshd09:33:577
525099102,4cyclictest24013-21cp10:41:447
525099102,3cyclictest7976-21systemd-cgroups10:58:507
525099100,4cyclictest5738-21sshd10:17:117
525099100,4cyclictest0-21swapper/710:32:357
525099100,4cyclictest0-21swapper/710:32:357
524299109,1cyclictest65-21ksoftirqd/608:31:406
524299109,1cyclictest65-21ksoftirqd/607:36:536
524299109,1cyclictest65-21ksoftirqd/607:36:396
524299100,1cyclictest65-21ksoftirqd/608:51:406
523599108,1cyclictest57-21ksoftirqd/512:15:255
523599104,2cyclictest0-21swapper/508:01:065
523599104,2cyclictest0-21swapper/507:54:465
523599103,4cyclictest8306-21bash11:11:425
523599101,6cyclictest5048-21sshd11:57:175
523599100,6cyclictest31234-21sshd12:22:405
523599100,4cyclictest0-21swapper/508:34:185
523599100,1cyclictest0-21swapper/511:52:225
523599100,1cyclictest0-21swapper/510:47:305
522899100,4cyclictest721-21dbus-daemon10:34:424
522899100,4cyclictest721-21dbus-daemon10:34:424
522899100,10cyclictest0-21swapper/409:22:194
521699108,1cyclictest41-21ksoftirqd/311:08:033
521699108,1cyclictest41-21ksoftirqd/309:39:383
521699108,1cyclictest0-21swapper/311:37:113
521699105,4cyclictest22857-21systemd-cgroups11:47:153
521699103,6cyclictest903-21sshd10:49:263
521699103,6cyclictest1-21systemd12:11:533
521699100,4cyclictest857-21polkitd12:19:463
521699100,4cyclictest27422-21sshd11:14:343
521699100,4cyclictest19852-21bash09:49:113
521699100,4cyclictest0-21swapper/310:17:383
520799109,1cyclictest33-21ksoftirqd/207:36:532
519999109,1cyclictest25-21ksoftirqd/111:06:171
519999108,1cyclictest25-21ksoftirqd/111:51:561
519999108,1cyclictest25-21ksoftirqd/110:48:511
519999108,1cyclictest25-21ksoftirqd/109:53:341
519999108,1cyclictest25-21ksoftirqd/109:07:421
519999106,1cyclictest859-21gdbus10:00:211
519999104,3cyclictest27393-21id11:16:261
519999103,4cyclictest1-21systemd12:20:081
519999103,3cyclictest13273-21kworker/1:012:10:401
519999100,9cyclictest9757-21sshd10:24:411
519999100,9cyclictest6834-21sshd11:17:001
519999100,9cyclictest6834-21sshd11:17:001
519199108,1cyclictest9-21ksoftirqd/012:19:500
519199108,1cyclictest9-21ksoftirqd/009:57:470
519199108,1cyclictest9-21ksoftirqd/009:52:400
519199108,1cyclictest9-21ksoftirqd/009:45:380
519199108,1cyclictest9-21ksoftirqd/009:45:380
519199108,1cyclictest9-21ksoftirqd/009:22:210
519199108,1cyclictest9-21ksoftirqd/008:26:390
519199103,4cyclictest0-21swapper/008:06:400
519199101,4cyclictest23847-21sshd12:09:270
519199100,4cyclictest710-21systemd-cgroups12:02:350
519199100,4cyclictest709-21systemd-logind11:32:120
519199100,4cyclictest23481-21sshd09:27:460
519199100,4cyclictest15575-21systemd-cgroups11:43:100
519199100,4cyclictest1119-21sshd10:29:370
52509999,0cyclictest0-21swapper/708:41:527
52509997,1cyclictest73-21ksoftirqd/712:07:317
52509997,1cyclictest73-21ksoftirqd/710:07:427
52509997,1cyclictest73-21ksoftirqd/710:03:367
52509992,1cyclictest1-21systemd10:38:217
52509990,9cyclictest0-21swapper/707:12:017
52509990,8cyclictest4718-21kworker/u16:310:26:477
52509990,4cyclictest464-21systemd-journal11:24:317
52509990,4cyclictest0-21swapper/711:02:327
52429998,1cyclictest65-21ksoftirqd/609:01:536
52429991,3cyclictest65-21ksoftirqd/607:59:526
52429991,1cyclictest65-21ksoftirqd/608:04:016
52429991,1cyclictest0-21swapper/608:57:016
52429991,1cyclictest0-21swapper/608:21:506
52359997,1cyclictest57-21ksoftirqd/510:56:585
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional