You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 21:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Wed Apr 15, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2658321020,2sleep31765699cyclictest11:47:373
118632840,2sleep11764099cyclictest12:35:401
118632840,2sleep11764099cyclictest12:35:401
189462750,0sleep40-21swapper/409:56:214
16322750,0sleep10-21swapper/110:02:511
19612740,0sleep60-21swapper/610:46:056
37812720,0sleep00-21swapper/009:38:470
221972710,0sleep10-21swapper/111:04:101
30232680,1sleep7721ktimersoftd/709:51:437
303332610,0sleep60-21swapper/611:38:276
289342510,0sleep40-21swapper/409:30:584
127622510,0sleep00-21swapper/010:27:570
1746524925,8sleep30-21swapper/307:05:163
293882480,1sleep029382-21systemd12:06:320
170932480,0sleep70-21swapper/711:16:577
126672470,0sleep60-21swapper/610:44:526
69682460,2sleep31765699cyclictest10:27:353
288322460,0sleep40-21swapper/410:30:494
190462460,0sleep30-21swapper/309:48:593
183432450,0sleep70-21swapper/710:39:337
63752440,1sleep66373-21sshd09:42:376
305492440,0sleep30-21swapper/310:40:173
299012440,0sleep30-21swapper/308:21:063
94822430,0sleep40-21swapper/411:03:254
241852430,1sleep024186-21sshd11:41:490
138902430,0sleep2311rcuc/209:24:312
123342430,1sleep3784-21runrttasks12:31:503
123342430,1sleep3784-21runrttasks12:31:503
88712420,0sleep0686-21dbus-daemon12:14:490
299882420,1sleep629987-21grepconf.sh12:34:496
299882420,1sleep629987-21grepconf.sh12:34:496
67272410,0sleep10-21swapper/109:18:301
67272410,0sleep10-21swapper/109:18:301
266262410,0sleep4481ktimersoftd/411:06:134
231082410,0sleep5551rcuc/512:08:055
214682410,0sleep70-21swapper/711:13:297
206452410,0sleep020644-21systemd-cgroups11:02:080
186892410,0sleep50-21swapper/510:37:395
151422410,1sleep665-21ksoftirqd/609:09:466
58832400,0sleep30-21swapper/311:14:293
325912400,0sleep00-21swapper/009:42:150
299912400,0sleep20-21swapper/209:10:382
1749124028,8sleep00-21swapper/007:05:370
1719624028,9sleep70-21swapper/707:01:447
119272400,0sleep70-21swapper/710:12:507
119272400,0sleep70-21swapper/710:12:507
274392390,0sleep20-21swapper/209:38:172
1745023916,8sleep60-21swapper/607:05:036
1724323926,9sleep40-21swapper/407:02:214
1723023927,8sleep20-21swapper/207:02:112
1722023926,9sleep10-21swapper/107:02:021
165122390,1sleep216075-21sshd10:18:452
129592390,1sleep212941-21cp09:13:182
116092390,0sleep30-21swapper/311:54:173
101192390,0sleep00-21swapper/009:57:450
32822380,0sleep70-21swapper/710:02:577
285612380,0sleep30-21swapper/311:15:493
1716723826,8sleep50-21swapper/507:01:175
155852380,0sleep70-21swapper/710:22:277
227622370,0sleep10-21swapper/109:10:131
102812370,0sleep40-21swapper/409:42:514
75752360,0sleep70-21swapper/711:22:027
260472360,2sleep71768899cyclictest09:27:017
1768199225,3cyclictest65-21ksoftirqd/611:02:026
17681992216,3cyclictest65-21ksoftirqd/609:57:276
17681992117,3cyclictest65-21ksoftirqd/609:27:276
1768199206,2cyclictest65-21ksoftirqd/612:00:546
17681992012,5cyclictest65-21ksoftirqd/612:22:446
1768199199,4cyclictest65-21ksoftirqd/610:06:026
1768199195,3cyclictest65-21ksoftirqd/609:12:316
1768199194,2cyclictest26152-21cp09:25:156
17681991915,3cyclictest65-21ksoftirqd/611:12:036
17681991915,2cyclictest65-21ksoftirqd/610:10:496
17681991915,2cyclictest65-21ksoftirqd/610:10:496
17681991915,1cyclictest65-21ksoftirqd/609:18:476
17681991915,1cyclictest65-21ksoftirqd/609:18:476
1768199187,1cyclictest65-21ksoftirqd/611:31:036
1768199185,1cyclictest65-21ksoftirqd/611:41:406
1768199184,3cyclictest65-21ksoftirqd/609:38:596
17681991815,3cyclictest65-21ksoftirqd/611:28:026
17681991815,2cyclictest65-21ksoftirqd/612:17:396
17681991814,3cyclictest65-21ksoftirqd/611:24:016
17681991813,3cyclictest65-21ksoftirqd/609:51:036
1768199180,2cyclictest65-21ksoftirqd/612:09:356
1768199180,18cyclictest14847-21kworker/6:511:48:026
1768199177,1cyclictest65-21ksoftirqd/610:39:266
17681991716,1cyclictest65-21ksoftirqd/611:17:076
17681991715,1cyclictest65-21ksoftirqd/611:09:406
17681991715,1cyclictest65-21ksoftirqd/609:32:276
17681991714,3cyclictest65-21ksoftirqd/612:27:406
17681991714,1cyclictest65-21ksoftirqd/610:02:346
17681991713,3cyclictest65-21ksoftirqd/610:52:036
17681991713,3cyclictest65-21ksoftirqd/610:52:036
17681991713,1cyclictest65-21ksoftirqd/610:23:566
17633991715,1cyclictest9-21ksoftirqd/009:10:390
19152160,2sleep11764099cyclictest09:44:171
17681991614,1cyclictest65-21ksoftirqd/612:10:576
17681991614,1cyclictest65-21ksoftirqd/611:59:186
17681991614,1cyclictest65-21ksoftirqd/611:51:066
17681991614,1cyclictest65-21ksoftirqd/610:26:416
17681991614,1cyclictest65-21ksoftirqd/610:19:186
17681991611,3cyclictest65-21ksoftirqd/610:56:056
1768199160,2cyclictest65-21ksoftirqd/610:35:016
1768199160,1cyclictest131rcu_sched09:46:546
1767399160,11cyclictest1-21systemd09:21:235
1768899159,5cyclictest21150-21systemd12:02:187
17688991512,2cyclictest17724-21sshd11:26:237
17656991513,1cyclictest41-21ksoftirqd/312:18:373
17640991514,1cyclictest25-21ksoftirqd/110:32:581
17640991513,1cyclictest25-21ksoftirqd/110:41:021
17633991513,1cyclictest9-21ksoftirqd/011:40:070
17633991512,1cyclictest28899-21kworker/0:210:06:390
142402150,2sleep71768899cyclictest12:13:127
48252140,0sleep2784-21runrttasks09:31:202
47122140,0sleep24705-21sshd10:01:072
44152140,1sleep54414-21bash12:21:595
192672140,0sleep20-21swapper/210:35:512
17688991412,1cyclictest73-21ksoftirqd/712:24:127
17688991412,1cyclictest73-21ksoftirqd/710:45:597
1768899140,13cyclictest29224-21systemd09:12:217
17662991412,1cyclictest49-21ksoftirqd/411:42:374
1765699143,5cyclictest28283-21sshd12:25:213
1764899142,11cyclictest5024-21sshd09:42:332
17640991413,1cyclictest25-21ksoftirqd/111:20:581
17640991412,1cyclictest25-21ksoftirqd/110:18:281
17640991412,1cyclictest25-21ksoftirqd/110:14:101
17640991412,1cyclictest25-21ksoftirqd/110:14:101
17633991412,1cyclictest9-21ksoftirqd/011:08:530
17633991412,1cyclictest9-21ksoftirqd/010:56:290
17633991412,1cyclictest5827-21systemd-cgroups09:11:030
17633991411,2cyclictest11963-21systemd11:24:150
17633991410,2cyclictest28477-21kworker/0:012:34:110
17633991410,2cyclictest28477-21kworker/0:012:34:110
1763399140,1cyclictest0-21swapper/009:19:450
1763399140,1cyclictest0-21swapper/009:19:450
51162130,0sleep20-21swapper/210:06:442
326972130,0sleep40-21swapper/411:49:544
228502130,0sleep00-21swapper/009:54:490
17688991312,1cyclictest73-21ksoftirqd/709:56:127
17688991311,1cyclictest73-21ksoftirqd/710:55:107
17688991311,1cyclictest73-21ksoftirqd/710:55:107
1767399136,6cyclictest0-21swapper/509:19:205
1767399136,6cyclictest0-21swapper/509:19:205
1767399135,2cyclictest18425-21grepconf.sh11:54:425
1767399134,2cyclictest885-21polkitd09:46:415
1767399134,2cyclictest6194-21grep10:21:535
1767399134,2cyclictest4405-21rm11:21:505
1767399134,2cyclictest17780-21kill10:48:555
1767399134,1cyclictest3192-21grepconf.sh11:59:265
1767399133,2cyclictest686-21dbus-daemon12:17:535
1767399132,5cyclictest7625-21sshd10:10:425
1767399132,5cyclictest32704-21systemd11:31:035
1767399132,2cyclictest14141-21systemd09:15:165
17673991312,1cyclictest57-21ksoftirqd/512:04:215
17673991312,1cyclictest57-21ksoftirqd/509:55:055
17673991310,2cyclictest1-21systemd12:35:345
17673991310,2cyclictest1-21systemd12:35:345
1765699132,5cyclictest1-21systemd10:18:243
17656991310,1cyclictest41-21ksoftirqd/309:21:083
17648991312,1cyclictest33-21ksoftirqd/210:23:482
17648991311,2cyclictest33-21ksoftirqd/212:31:002
17648991311,2cyclictest33-21ksoftirqd/212:31:002
17648991311,2cyclictest33-21ksoftirqd/210:31:542
17640991312,1cyclictest25-21ksoftirqd/111:55:031
17640991312,1cyclictest25-21ksoftirqd/109:32:401
17640991311,1cyclictest25-21ksoftirqd/112:17:291
17640991311,1cyclictest25-21ksoftirqd/112:14:231
17640991311,1cyclictest25-21ksoftirqd/110:29:521
17640991310,2cyclictest21899-21iostat11:36:041
17640991310,2cyclictest1-21systemd11:34:391
17640991310,1cyclictest25-21ksoftirqd/109:26:001
1763399139,3cyclictest9-21ksoftirqd/009:24:260
1763399139,1cyclictest23269-21kworker/u16:412:24:590
17633991312,1cyclictest9-21ksoftirqd/010:36:440
17633991311,1cyclictest11645-21kworker/u16:010:44:070
17633991311,1cyclictest1-21systemd12:26:430
1763399130,12cyclictest10019-21grepconf.sh11:56:030
155332130,1sleep015534-21id10:14:590
155332130,1sleep015534-21id10:14:590
259912120,0sleep125983-21sshd11:26:521
198682120,0sleep00-21swapper/010:32:050
19012120,0sleep10-21swapper/112:06:491
1768899129,2cyclictest73-21ksoftirqd/709:39:337
17688991210,1cyclictest8185-21sshd09:16:417
17688991210,1cyclictest8185-21sshd09:16:417
17688991210,1cyclictest73-21ksoftirqd/710:27:577
17688991210,1cyclictest0-21swapper/710:59:197
1768899120,11cyclictest31472-21systemd09:44:077
1768899120,1cyclictest0-21swapper/711:59:507
17681991210,1cyclictest65-21ksoftirqd/608:12:096
1767399125,2cyclictest6477-21grepconf.sh09:37:035
1767399125,1cyclictest887-21gdbus11:05:555
1767399124,2cyclictest8199-21sshd11:12:425
1767399124,2cyclictest686-21dbus-daemon11:01:315
1767399124,2cyclictest3487-21bash09:57:215
1767399124,2cyclictest30576-21grep11:27:085
1767399124,2cyclictest27455-21kill10:56:545
1767399124,2cyclictest21077-21sshd10:13:245
1767399124,2cyclictest21077-21sshd10:13:245
1767399124,2cyclictest18188-21grepconf.sh09:32:085
1767399124,2cyclictest17455-21grepconf.sh11:41:255
1767399124,2cyclictest12682-21grepconf.sh10:16:365
1767399124,1cyclictest3700-21systemctl11:46:155
1767399123,8cyclictest4486-21sshd10:51:495
1767399123,8cyclictest4486-21sshd10:51:495
1767399123,2cyclictest6976-21sd-pam11:18:175
1767399123,2cyclictest686-21dbus-daemon10:43:395
1767399123,2cyclictest686-21dbus-daemon09:44:055
1767399123,2cyclictest686-21dbus-daemon09:26:385
1767399123,2cyclictest30382-21bash11:36:315
1767399123,2cyclictest2472-21grepconf.sh10:01:035
1767399123,2cyclictest15508-21grepconf.sh10:28:075
1767399123,2cyclictest11514-21systemd12:11:095
1767399123,2cyclictest1-21systemd12:28:165
1767399122,4cyclictest12792-21bash09:07:185
1766299122,4cyclictest26708-21grepconf.sh12:34:374
1766299122,4cyclictest26708-21grepconf.sh12:34:374
1766299122,4cyclictest2249-21sshd09:51:404
1766299122,4cyclictest0-21swapper/411:51:054
17662991210,1cyclictest49-21ksoftirqd/410:02:574
1766299120,11cyclictest21987-21kworker/4:309:09:154
1765699123,4cyclictest0-21swapper/311:32:483
1765699122,4cyclictest9372-21sshd11:24:053
1765699122,4cyclictest27042-21sshd09:14:083
1765699122,4cyclictest22104-21systemd-cgroups10:15:223
1765699122,4cyclictest22104-21systemd-cgroups10:15:223
1765699122,4cyclictest1123-21sshd09:42:193
1765699122,4cyclictest1-21systemd10:53:583
1765699122,4cyclictest1-21systemd10:53:583
1765699122,4cyclictest0-21swapper/309:36:083
17656991211,1cyclictest41-21ksoftirqd/312:06:333
17656991211,1cyclictest41-21ksoftirqd/311:07:223
1765699120,1cyclictest0-21swapper/309:31:573
1764899129,2cyclictest33-21ksoftirqd/211:12:212
1764899120,2cyclictest32295-21systemd12:18:002
1764099127,2cyclictest25-21ksoftirqd/110:23:521
17640991211,1cyclictest25-21ksoftirqd/111:18:051
17640991211,1cyclictest25-21ksoftirqd/109:54:081
17640991211,1cyclictest25-21ksoftirqd/109:47:481
17640991211,1cyclictest0-21swapper/111:06:011
17640991210,1cyclictest691-21systemd-logind11:45:321
17640991210,1cyclictest686-21dbus-daemon11:47:251
17640991210,1cyclictest1-21systemd10:49:051
17633991211,1cyclictest9-21ksoftirqd/011:15:250
17633991211,1cyclictest9-21ksoftirqd/009:35:340
17633991211,1cyclictest9-21ksoftirqd/009:26:090
17633991210,1cyclictest9-21ksoftirqd/011:52:050
17633991210,1cyclictest9-21ksoftirqd/010:49:110
17633991210,1cyclictest25679-21kworker/u16:411:18:590
17633991210,1cyclictest24253-21kworker/u16:110:05:290
17633991210,1cyclictest20898-21kworker/0:010:22:570
1763399120,11cyclictest23628-21systemd12:17:290
1768899119,1cyclictest73-21ksoftirqd/712:32:327
1768899119,1cyclictest73-21ksoftirqd/712:32:327
1768899119,1cyclictest73-21ksoftirqd/711:49:327
1768899119,1cyclictest73-21ksoftirqd/711:35:427
1768899119,1cyclictest73-21ksoftirqd/711:07:157
1768899119,1cyclictest73-21ksoftirqd/709:46:217
1768899119,1cyclictest73-21ksoftirqd/709:10:037
1768899119,1cyclictest0-21swapper/710:30:567
1768899118,1cyclictest73-21ksoftirqd/712:17:417
1768899118,1cyclictest73-21ksoftirqd/710:42:547
1768899117,3cyclictest73-21ksoftirqd/711:54:137
1768899116,4cyclictest11939-21grepconf.sh12:09:217
1768899114,4cyclictest13554-21bash10:07:147
1768899113,5cyclictest14090-21grep11:05:367
17688991110,1cyclictest73-21ksoftirqd/712:27:257
17688991110,1cyclictest73-21ksoftirqd/711:40:217
17688991110,1cyclictest73-21ksoftirqd/710:15:587
1768199119,1cyclictest65-21ksoftirqd/607:20:496
1767399113,2cyclictest13000-21grepconf.sh10:31:415
1767399113,2cyclictest0-21swapper/508:46:075
1766299119,1cyclictest49-21ksoftirqd/412:26:084
1766299119,1cyclictest49-21ksoftirqd/412:19:274
1766299119,1cyclictest49-21ksoftirqd/410:16:124
1766299112,4cyclictest8958-21sshd11:27:484
1766299112,4cyclictest26228-21sshd10:09:534
17662991110,1cyclictest49-21ksoftirqd/410:55:524
17662991110,1cyclictest0-21swapper/412:06:424
1766299111,4cyclictest6572-21bash10:48:154
1766299111,4cyclictest5500-21sshd11:23:514
1766299111,4cyclictest12975-21bash12:01:494
1766299111,4cyclictest0-21swapper/412:23:324
1766299111,4cyclictest0-21swapper/410:38:554
1766299110,5cyclictest26511-21sshd09:23:214
1766299110,11cyclictest24532-21kworker/4:112:12:474
1766299110,11cyclictest0-21swapper/409:19:364
1766299110,11cyclictest0-21swapper/409:19:364
1765699119,1cyclictest686-21dbus-daemon10:04:243
1765699119,1cyclictest41-21ksoftirqd/311:37:403
1765699119,1cyclictest41-21ksoftirqd/311:27:433
1765699119,1cyclictest41-21ksoftirqd/311:03:283
17656991110,1cyclictest41-21ksoftirqd/312:29:323
17656991110,1cyclictest41-21ksoftirqd/310:59:063
1765699111,4cyclictest6732-21sshd09:53:513
1765699110,5cyclictest23215-21grepconf.sh12:00:383
1765699110,11cyclictest19401-21kworker/3:209:26:073
1765699110,1cyclictest691-21systemd-logind10:46:483
1765699110,1cyclictest0-21swapper/312:02:103
1764899119,1cyclictest887-21gdbus11:56:342
1764899119,1cyclictest33-21ksoftirqd/211:35:282
1764899119,1cyclictest33-21ksoftirqd/210:51:182
1764899119,1cyclictest33-21ksoftirqd/210:51:182
1764899119,1cyclictest33-21ksoftirqd/210:50:292
1764899119,1cyclictest33-21ksoftirqd/210:40:562
1764899119,1cyclictest33-21ksoftirqd/209:47:422
1764899118,2cyclictest33-21ksoftirqd/212:22:032
1764899118,2cyclictest33-21ksoftirqd/211:00:072
1764899116,1cyclictest759-21rs:main2
1764899116,1cyclictest759-21rs:main2
17648991110,1cyclictest13550irq/24-ahci[00012:03:182
1764899111,4cyclictest18854-21systemd-cgroups11:45:212
1764899110,10cyclictest22856-21sshd11:30:332
1764899110,1cyclictest0-21swapper/212:06:302
1764899110,1cyclictest0-21swapper/210:29:132
1764099119,1cyclictest25-21ksoftirqd/111:58:551
1764099119,1cyclictest25-21ksoftirqd/110:36:011
1764099113,5cyclictest17414-21df_inode09:20:591
17640991110,1cyclictest25-21ksoftirqd/112:29:481
1764099111,5cyclictest3536-21bash10:51:461
1764099111,5cyclictest3536-21bash10:51:461
1764099110,10cyclictest1-21systemd09:36:531
1763399119,1cyclictest9-21ksoftirqd/012:04:290
1763399119,1cyclictest9-21ksoftirqd/011:47:320
1763399119,1cyclictest9-21ksoftirqd/011:31:050
1763399119,1cyclictest9-21ksoftirqd/010:16:550
1763399118,2cyclictest492-21systemd-journal11:26:070
17633991110,1cyclictest9-21ksoftirqd/010:51:110
17633991110,1cyclictest9-21ksoftirqd/010:51:110
1768899108,1cyclictest73-21ksoftirqd/709:32:497
1768899107,1cyclictest73-21ksoftirqd/711:41:497
1768899100,1cyclictest0-21swapper/709:23:187
1768199108,1cyclictest65-21ksoftirqd/608:21:106
1767399103,2cyclictest786-21snmpd08:33:455
1767399103,2cyclictest786-21snmpd07:11:265
1767399103,1cyclictest786-21snmpd08:54:135
1766299109,1cyclictest49-21ksoftirqd/411:13:034
1766299108,1cyclictest49-21ksoftirqd/411:31:524
1766299108,1cyclictest49-21ksoftirqd/410:53:424
1766299108,1cyclictest49-21ksoftirqd/410:53:424
1766299108,1cyclictest49-21ksoftirqd/409:11:564
1766299108,1cyclictest26003-21systemd-cgroups09:49:244
1766299103,6cyclictest686-21dbus-daemon11:36:374
1766299103,4cyclictest1-21systemd10:13:154
1766299103,4cyclictest1-21systemd10:13:154
1766299102,3cyclictest0-21swapper/411:17:404
1766299101,4cyclictest28319-21grepconf.sh11:57:054
1766299100,4cyclictest361-21sshd10:32:514
1766299100,4cyclictest0-21swapper/410:22:294
1765699108,1cyclictest41-21ksoftirqd/310:21:183
1765699108,1cyclictest41-21ksoftirqd/310:06:393
1765699103,7cyclictest19039-21sd-pam12:11:343
1765699103,6cyclictest691-21systemd-logind11:41:353
1765699102,5cyclictest4602-21sshd09:09:023
1765699102,4cyclictest3350-21bash10:31:083
1765699101,4cyclictest22182-21sshd10:00:233
1765699101,4cyclictest0-21swapper/309:17:033
1765699101,4cyclictest0-21swapper/309:17:033
1765699100,4cyclictest27498-21sshd10:43:503
1764899109,1cyclictest0-21swapper/211:19:212
1764899108,1cyclictest33-21ksoftirqd/212:13:512
1764899108,1cyclictest33-21ksoftirqd/209:59:502
1764899104,4cyclictest32636-21sshd11:47:582
1764899104,3cyclictest17683-21sshd11:22:382
1764899102,7cyclictest18309-21grepconf.sh10:11:112
1764899102,7cyclictest18309-21grepconf.sh10:11:112
1764899102,4cyclictest30131-21sshd11:36:302
1764899101,5cyclictest18950-21sshd11:54:442
1764899101,4cyclictest15721-21bash11:07:302
1764899100,4cyclictest25847-21sshd09:53:052
1764899100,10cyclictest22313-21kworker/2:309:26:062
1764099108,1cyclictest25-21ksoftirqd/112:21:111
1764099108,1cyclictest25-21ksoftirqd/112:01:311
1764099108,1cyclictest25-21ksoftirqd/111:11:471
1764099108,1cyclictest25-21ksoftirqd/110:57:571
1764099103,4cyclictest10121-21id09:11:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional