You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 04:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Sun Apr 26, 2026 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
123152790,2sleep71793099cyclictest21:46:567
287502550,1sleep328752-21sshd22:04:383
191122540,0sleep40-21swapper/422:50:284
1747925127,8sleep50-21swapper/519:06:475
301322490,0sleep30-21swapper/321:31:143
1762824925,9sleep30-21swapper/319:08:453
158272490,0sleep60-21swapper/621:35:576
156622490,1sleep415666-21grepconf.sh00:10:214
156622490,1sleep415666-21grepconf.sh00:10:214
148032490,0sleep10-21swapper/122:40:561
151172480,0sleep50-21swapper/523:49:565
98422470,1sleep39841-21grepconf.sh21:24:333
76942470,0sleep00-21swapper/021:41:040
232972470,0sleep70-21swapper/721:40:077
85102460,0sleep30-21swapper/300:37:593
221962460,1sleep31789999cyclictest22:41:223
216332460,0sleep70-21swapper/700:21:537
317592450,1sleep3756-21sshd00:22:303
316182450,2sleep51791499cyclictest22:04:485
65412440,0sleep70-21swapper/723:43:497
55072440,0sleep40-21swapper/422:12:324
145092440,0sleep00-21swapper/022:40:550
78622430,0sleep20-21swapper/221:35:292
47312430,0sleep30-21swapper/323:45:293
216092430,0sleep60-21swapper/622:00:246
19922420,0sleep60-21swapper/600:17:046
81442410,0sleep00-21swapper/021:39:200
5952410,0sleep30-21swapper/300:00:113
222122410,0sleep00-21swapper/022:00:260
19602410,0sleep70-21swapper/721:24:057
1758724128,9sleep00-21swapper/019:08:100
1754724128,9sleep70-21swapper/719:07:377
147492410,0sleep40-21swapper/422:57:414
312442400,0sleep60-21swapper/623:04:166
1765824028,9sleep40-21swapper/419:09:104
1738024027,9sleep20-21swapper/219:05:242
165632400,1sleep31789999cyclictest00:30:543
70362390,0sleep60-21swapper/600:04:226
275762390,0sleep20-21swapper/222:13:502
266802390,1sleep726644-21sshd22:10:027
181612390,0sleep60-21swapper/622:16:586
1751723927,8sleep60-21swapper/619:07:126
1636623925,9sleep10-21swapper/119:05:071
158732390,0sleep00-21swapper/023:44:220
110192390,1sleep211015-21systemd23:23:342
133782380,0sleep00-21swapper/023:16:110
87032370,0sleep40-21swapper/422:16:244
241912370,0sleep60-21swapper/619:20:006
306832340,0sleep50-21swapper/523:17:125
17875992216,4cyclictest9-21ksoftirqd/021:15:250
17891992117,3cyclictest33-21ksoftirqd/223:29:372
1788399204,7cyclictest3504-21bash00:35:471
1788399200,2cyclictest30530-21grep21:38:451
17875992010,1cyclictest9-21ksoftirqd/000:08:280
1787599192,1cyclictest131rcu_sched22:25:050
17875991915,4cyclictest9-21ksoftirqd/000:33:440
17891991814,1cyclictest33-21ksoftirqd/200:35:332
1787599187,1cyclictest9-21ksoftirqd/023:20:230
1787599187,1cyclictest131rcu_sched00:00:080
17875991816,2cyclictest9-21ksoftirqd/000:22:570
17875991816,1cyclictest9-21ksoftirqd/021:58:280
17875991815,3cyclictest9-21ksoftirqd/000:26:250
17875991815,1cyclictest9-21ksoftirqd/023:46:330
78362170,1sleep71793099cyclictest22:35:017
78362170,1sleep71793099cyclictest22:35:017
1787599176,2cyclictest9-21ksoftirqd/023:31:230
1787599173,1cyclictest9-21ksoftirqd/021:13:130
17875991715,1cyclictest9-21ksoftirqd/023:59:110
17875991715,1cyclictest9-21ksoftirqd/023:38:310
17875991715,1cyclictest9-21ksoftirqd/021:48:320
17875991715,1cyclictest9-21ksoftirqd/021:23:400
17875991714,3cyclictest9-21ksoftirqd/022:31:300
17875991714,2cyclictest9-21ksoftirqd/023:10:090
17875991714,2cyclictest464-21systemd-journal22:52:450
17875991713,1cyclictest9-21ksoftirqd/022:48:230
17875991713,1cyclictest9-21ksoftirqd/021:25:120
17875991710,1cyclictest9-21ksoftirqd/000:38:130
1787599170,2cyclictest131rcu_sched22:17:260
1787599170,1cyclictest0-21swapper/023:28:090
295672160,1sleep529568-21grepconf.sh00:29:525
17891991614,1cyclictest33-21ksoftirqd/221:45:392
17891991613,2cyclictest33-21ksoftirqd/223:49:482
17891991613,2cyclictest33-21ksoftirqd/223:11:222
17875991615,1cyclictest9-21ksoftirqd/022:36:180
17875991615,1cyclictest9-21ksoftirqd/022:36:180
17875991615,1cyclictest9-21ksoftirqd/021:51:200
17875991614,1cyclictest9-21ksoftirqd/023:05:150
17875991614,1cyclictest9-21ksoftirqd/023:00:120
17875991614,1cyclictest9-21ksoftirqd/022:57:110
17875991614,1cyclictest9-21ksoftirqd/022:20:050
17875991614,1cyclictest9-21ksoftirqd/022:04:550
17875991614,1cyclictest9-21ksoftirqd/021:32:080
17875991610,4cyclictest9-21ksoftirqd/023:53:210
1787599160,2cyclictest131rcu_sched22:12:390
17914991514,1cyclictest57-21ksoftirqd/523:09:185
1791499150,15cyclictest9655-21kworker/5:122:45:075
1791499150,15cyclictest24204-21kworker/5:022:08:495
1789199157,4cyclictest33-21ksoftirqd/221:18:012
17891991513,1cyclictest33-21ksoftirqd/221:27:122
17891991513,1cyclictest33-21ksoftirqd/200:23:142
17891991513,1cyclictest33-21ksoftirqd/200:10:222
17891991513,1cyclictest33-21ksoftirqd/200:10:222
1787599151,1cyclictest9-21ksoftirqd/000:11:050
1787599151,1cyclictest9-21ksoftirqd/000:11:050
1787599151,1cyclictest131rcu_sched00:15:510
157612150,0sleep2758-21runrttasks22:59:392
317332140,0sleep60-21swapper/600:33:466
245122140,0sleep70-21swapper/723:09:297
17930991413,1cyclictest73-21ksoftirqd/700:39:227
17930991412,1cyclictest73-21ksoftirqd/721:36:267
17922991410,3cyclictest65-21ksoftirqd/621:30:116
1791499149,1cyclictest9429-21sshd00:13:485
1791499149,1cyclictest9429-21sshd00:13:485
17914991413,1cyclictest57-21ksoftirqd/521:14:575
17914991412,1cyclictest57-21ksoftirqd/523:23:425
17914991412,1cyclictest57-21ksoftirqd/500:05:055
17914991411,1cyclictest30510-21sshd23:13:305
17914991410,3cyclictest57-21ksoftirqd/522:13:515
1790699140,1cyclictest0-21swapper/422:27:154
17899991412,1cyclictest41-21ksoftirqd/323:03:053
17891991413,1cyclictest33-21ksoftirqd/222:26:292
17891991413,1cyclictest33-21ksoftirqd/222:23:232
17891991411,3cyclictest33-21ksoftirqd/223:44:462
1788399143,5cyclictest857-21polkitd00:30:071
1788399143,5cyclictest721-21dbus-daemon00:17:161
116232140,1sleep557-21ksoftirqd/522:53:495
112922140,0sleep60-21swapper/621:28:206
67272130,0sleep70-21swapper/721:50:167
17922991311,1cyclictest65-21ksoftirqd/622:52:146
1792299130,2cyclictest18672-21sshd00:25:256
17914991311,2cyclictest19569-21sshd23:46:225
17914991311,1cyclictest57-21ksoftirqd/521:24:305
17914991311,1cyclictest57-21ksoftirqd/500:28:245
1790699132,5cyclictest709-21systemd-logind23:24:554
1789999139,1cyclictest41-21ksoftirqd/300:19:393
1789999134,5cyclictest15386-21bash23:16:183
17899991311,1cyclictest41-21ksoftirqd/322:54:113
1789199139,1cyclictest33-21ksoftirqd/223:39:092
1789199139,1cyclictest33-21ksoftirqd/200:06:422
17891991312,1cyclictest33-21ksoftirqd/221:55:272
17891991312,1cyclictest33-21ksoftirqd/221:34:312
17891991311,2cyclictest33-21ksoftirqd/221:20:132
17891991311,2cyclictest33-21ksoftirqd/200:16:282
17891991311,1cyclictest33-21ksoftirqd/223:55:592
17891991311,1cyclictest33-21ksoftirqd/222:17:162
17891991311,1cyclictest33-21ksoftirqd/221:40:022
17891991311,1cyclictest33-21ksoftirqd/221:12:022
17891991311,1cyclictest33-21ksoftirqd/200:31:012
17891991310,2cyclictest33-21ksoftirqd/222:42:022
1788399135,7cyclictest859-21gdbus22:20:511
1788399134,8cyclictest26667-21systemd23:33:471
1788399134,8cyclictest13200-21sshd21:56:141
1788399130,2cyclictest26098-21sshd22:26:431
1787599135,0cyclictest0-21swapper/019:59:400
1787599131,1cyclictest131rcu_sched21:09:500
109122130,1sleep110914-21bash23:40:151
65512120,0sleep40-21swapper/421:33:394
277122120,0sleep30-21swapper/323:22:393
258042120,0sleep10-21swapper/122:56:261
232722120,0sleep50-21swapper/520:15:005
1793099122,4cyclictest0-21swapper/723:25:297
1793099121,10cyclictest6151-21sshd23:45:347
1793099120,11cyclictest24098-21grepconf.sh23:29:567
1792299128,1cyclictest65-21ksoftirqd/621:22:326
1792299122,4cyclictest21813-21sshd22:33:586
17922991211,1cyclictest65-21ksoftirqd/623:43:316
17922991211,1cyclictest65-21ksoftirqd/621:17:166
17922991210,1cyclictest65-21ksoftirqd/623:29:336
1792299120,11cyclictest0-21swapper/621:40:106
1791499129,2cyclictest57-21ksoftirqd/522:54:595
1791499129,1cyclictest57-21ksoftirqd/522:30:595
1791499129,1cyclictest57-21ksoftirqd/521:38:295
1791499128,3cyclictest2452-21sshd22:23:325
1791499122,4cyclictest28146-21systemd-cgroups22:19:285
17914991211,1cyclictest57-21ksoftirqd/523:40:165
17914991210,1cyclictest57-21ksoftirqd/523:25:095
17914991210,1cyclictest57-21ksoftirqd/522:38:215
17914991210,1cyclictest57-21ksoftirqd/522:38:215
17914991210,1cyclictest57-21ksoftirqd/521:46:515
17914991210,1cyclictest57-21ksoftirqd/500:17:495
1790699122,5cyclictest0-21swapper/422:37:254
1790699122,5cyclictest0-21swapper/422:37:254
1790699122,4cyclictest721-21dbus-daemon22:05:364
1790699122,4cyclictest11797-21sshd00:30:374
1790699122,4cyclictest1-21systemd21:16:084
1790699122,4cyclictest0-21swapper/423:42:414
17906991210,1cyclictest721-21dbus-daemon00:23:334
1790699121,5cyclictest1714-21grepconf.sh00:02:094
1790699120,11cyclictest6375-21kworker/4:123:14:474
1790699120,11cyclictest31020-21bash23:24:444
1790699120,11cyclictest16837-21sshd22:20:354
1790699120,11cyclictest11686-21kworker/4:023:30:064
1789999122,4cyclictest23638-21sshd21:14:133
17899991210,1cyclictest41-21ksoftirqd/323:28:463
1789199129,1cyclictest33-21ksoftirqd/221:59:582
17891991211,1cyclictest33-21ksoftirqd/223:51:402
17891991211,1cyclictest33-21ksoftirqd/223:18:282
17891991211,1cyclictest33-21ksoftirqd/223:01:112
17891991211,1cyclictest33-21ksoftirqd/222:08:092
17891991210,1cyclictest33-21ksoftirqd/223:30:042
17891991210,1cyclictest33-21ksoftirqd/222:32:362
17891991210,1cyclictest33-21ksoftirqd/221:50:012
17891991210,1cyclictest21735-21sshd22:46:552
1789199121,10cyclictest31774-21kworker/2:200:01:012
1789199120,12cyclictest24344-21kworker/2:322:35:312
1789199120,12cyclictest24344-21kworker/2:322:35:312
1788399125,6cyclictest23199-21sshd22:35:511
1788399125,6cyclictest23199-21sshd22:35:511
1788399125,6cyclictest23143-21bash23:00:031
1788399125,6cyclictest15688-21bash21:17:251
1788399124,7cyclictest8069-21bash00:21:061
1788399124,7cyclictest28321-21grep23:17:041
1788399124,7cyclictest26386-21grep21:19:561
1788399124,7cyclictest24108-21sshd22:19:141
1788399124,7cyclictest20236-21rm21:40:001
1788399124,7cyclictest11435-21grepconf.sh23:21:411
1788399124,7cyclictest11363-21grepconf.sh21:30:091
1788399124,7cyclictest1097-21grep22:47:371
1788399124,3cyclictest14906-21systemd21:24:501
1788399124,2cyclictest857-21polkitd22:14:071
1788399124,2cyclictest7070-21sshd21:10:541
1788399124,2cyclictest6402-21sshd21:54:041
1788399124,2cyclictest4647-21grepconf.sh00:02:191
1788399124,2cyclictest29685-21grepconf.sh00:09:251
1788399124,2cyclictest25277-21grepconf.sh23:56:011
1788399124,2cyclictest22479-21grepconf.sh22:04:161
1788399124,2cyclictest21663-21grep00:10:431
1788399124,2cyclictest21663-21grep00:10:431
1788399124,2cyclictest18059-21grepconf.sh23:36:571
1788399124,2cyclictest17563-21grepconf.sh22:52:171
1788399124,2cyclictest11609-21rm23:12:241
1788399124,2cyclictest10443-21sshd23:47:451
1788399123,2cyclictest29336-21grepconf.sh23:50:391
1788399122,4cyclictest0-21swapper/123:06:461
1788399121,5cyclictest857-21polkitd00:24:491
1788399120,2cyclictest709-21systemd-logind22:31:591
1788399120,12cyclictest25623-21kworker/1:323:26:101
291022110,0sleep70-21swapper/723:39:337
27902110,0sleep40-21swapper/422:45:474
1793099119,1cyclictest73-21ksoftirqd/723:09:587
1793099119,1cyclictest73-21ksoftirqd/721:59:257
1793099115,3cyclictest709-21systemd-logind00:13:137
1793099115,3cyclictest709-21systemd-logind00:13:137
1793099110,10cyclictest11134-21bash23:19:507
1792299119,1cyclictest85150irq/25-em1-rx-023:38:346
1792299119,1cyclictest65-21ksoftirqd/621:55:066
1792299119,1cyclictest13602-21systemd-cgroups00:12:096
1792299119,1cyclictest13602-21systemd-cgroups00:12:096
1792299119,1cyclictest0-21swapper/623:32:256
1792299117,3cyclictest65-21ksoftirqd/623:45:096
1792299113,5cyclictest859-21gdbus00:20:246
1792299113,4cyclictest13266-21systemd-cgroups22:09:176
1792299111,5cyclictest509-21bash23:52:486
1792299110,2cyclictest22413-21bash00:36:546
1792299110,1cyclictest1-21systemd23:16:306
1791499119,1cyclictest57-21ksoftirqd/523:55:365
1791499119,1cyclictest57-21ksoftirqd/523:30:495
1791499119,1cyclictest57-21ksoftirqd/522:59:555
1791499119,1cyclictest57-21ksoftirqd/522:43:445
1791499119,1cyclictest57-21ksoftirqd/521:24:505
1791499119,1cyclictest57-21ksoftirqd/500:35:545
1791499119,1cyclictest0-21swapper/523:34:515
1791499118,3cyclictest18534-21sshd00:03:085
1791499117,3cyclictest57-21ksoftirqd/521:49:515
1791499117,1cyclictest57-21ksoftirqd/521:14:125
17914991110,1cyclictest57-21ksoftirqd/521:58:575
1791499110,5cyclictest22879-21grep21:43:525
1790699119,1cyclictest49-21ksoftirqd/423:18:194
1790699114,6cyclictest721-21dbus-daemon23:36:154
1790699112,4cyclictest24953-21sshd21:43:594
1790699111,4cyclictest721-21dbus-daemon21:34:564
1790699111,4cyclictest20340-21bash22:31:584
1790699111,4cyclictest16637-21bash23:57:264
1790699110,11cyclictest24831-21kworker/4:523:47:104
1790699110,10cyclictest5872-21grepconf.sh21:20:314
1789999119,1cyclictest41-21ksoftirqd/323:39:073
1789999119,1cyclictest41-21ksoftirqd/321:54:293
1789999118,1cyclictest41-21ksoftirqd/300:29:403
1789999117,1cyclictest41-21ksoftirqd/321:47:433
1789999114,6cyclictest17730-21sshd21:58:243
1789999112,6cyclictest30432-21sshd00:11:143
1789999112,6cyclictest30432-21sshd00:11:143
17899991110,1cyclictest41-21ksoftirqd/323:10:003
17899991110,1cyclictest41-21ksoftirqd/322:48:523
1789199119,1cyclictest33-21ksoftirqd/223:05:092
1789199119,1cyclictest33-21ksoftirqd/200:25:552
1788399113,7cyclictest0-21swapper/120:20:241
1788399113,2cyclictest5257-21grep22:05:051
1788399112,2cyclictest12242-21bash21:45:041
1787599119,2cyclictest0-21swapper/020:15:160
1787599113,0cyclictest0-21swapper/020:51:310
151052117,1sleep773-21ksoftirqd/700:27:077
304382100,1sleep665-21ksoftirqd/622:54:546
186242100,0sleep70-21swapper/721:13:567
1793099109,1cyclictest73-21ksoftirqd/723:58:277
1793099108,1cyclictest73-21ksoftirqd/722:59:507
1793099108,1cyclictest73-21ksoftirqd/722:05:437
1793099108,1cyclictest73-21ksoftirqd/700:16:367
1793099106,1cyclictest73-21ksoftirqd/722:33:557
1793099105,2cyclictest22505-21systemd-cgroups00:05:107
1793099104,3cyclictest3490-21systemd23:52:587
1793099102,5cyclictest9904-21sshd22:40:387
1793099102,4cyclictest709-21systemd-logind22:58:127
1793099102,4cyclictest11423-21grepconf.sh22:01:427
1793099102,4cyclictest10821-21grep22:25:487
1793099100,9cyclictest17525-21kworker/7:522:49:287
1793099100,9cyclictest0-21swapper/700:30:567
1793099100,10cyclictest30378-21sshd00:01:567
1793099100,10cyclictest0-21swapper/723:17:197
1792299109,1cyclictest65-21ksoftirqd/622:41:206
1792299108,1cyclictest65-21ksoftirqd/623:55:506
1792299108,1cyclictest65-21ksoftirqd/621:54:076
1792299104,5cyclictest24388-21sshd22:28:316
1792299104,3cyclictest721-21dbus-daemon22:14:176
1792299104,3cyclictest709-21systemd-logind21:10:206
1792299103,4cyclictest3837-21bash22:21:436
1792299103,3cyclictest20378-21sshd00:05:056
1792299102,3cyclictest25179-21sshd22:45:126
1792299101,5cyclictest20517-21grep22:37:366
1792299101,5cyclictest20517-21grep22:37:366
1792299100,9cyclictest25573-21kworker/6:423:09:156
1792299100,7cyclictest10240-21id23:12:186
1792299100,10cyclictest0-21swapper/623:20:076
1791499109,1cyclictest0-21swapper/522:29:165
1791499108,1cyclictest57-21ksoftirqd/521:30:385
1791499108,1cyclictest57-21ksoftirqd/500:24:005
1790699109,1cyclictest0-21swapper/422:40:554
1790699108,1cyclictest49-21ksoftirqd/421:55:024
1790699108,1cyclictest49-21ksoftirqd/400:36:064
1790699104,1cyclictest2905-21nscd21:45:164
1790699103,6cyclictest20368-21sshd00:27:254
1790699102,7cyclictest4716-21systemd22:01:194
1790699100,4cyclictest13231-21sshd00:06:314
1790699100,10cyclictest24831-21kworker/4:523:50:294
1790699100,1cyclictest0-21swapper/423:03:474
1790699100,1cyclictest0-21swapper/421:49:594
1789999108,1cyclictest41-21ksoftirqd/323:42:583
1789999108,1cyclictest41-21ksoftirqd/322:37:483
1789999108,1cyclictest41-21ksoftirqd/322:37:483
1789999108,1cyclictest41-21ksoftirqd/321:42:433
1789999108,1cyclictest41-21ksoftirqd/300:05:563
1789999104,4cyclictest756-21sshd22:31:083
1789999104,3cyclictest730-21NetworkManager22:20:053
1789999101,4cyclictest721-21dbus-daemon22:56:573
1789999101,4cyclictest2504-21sshd22:08:403
1789999100,9cyclictest1088-21kworker/3:221:17:423
1789999100,9cyclictest10426-21kworker/3:122:10:343
1789999100,8cyclictest14090-21kworker/3:623:57:313
1789999100,1cyclictest0-21swapper/322:25:263
1789999100,0cyclictest0-21swapper/322:17:043
1789199108,1cyclictest33-21ksoftirqd/222:50:512
1788399105,4cyclictest25-21ksoftirqd/119:54:591
1788399103,1cyclictest752-21snmpd19:53:021
1788399100,2cyclictest22249-21sshd21:09:501
1787599109,1cyclictest0-21swapper/020:59:490
1787599107,1cyclictest3334-21kworker/0:120:35:440
179309998,1cyclictest73-21ksoftirqd/722:16:577
179309997,1cyclictest73-21ksoftirqd/721:24:517
179309996,2cyclictest14548-21grep22:20:267
179309994,2cyclictest21199-21grepconf.sh21:15:507
179309990,8cyclictest11335-21kworker/7:421:30:507
179309990,4cyclictest6825-21grepconf.sh22:51:397
179229992,4cyclictest9049-21sshd21:44:566
179069992,4cyclictest857-21polkitd00:15:024
179069991,7cyclictest20181-21sshd21:25:054
179069990,8cyclictest19145-21kworker/4:223:06:444
179069990,4cyclictest0-21swapper/421:11:594
178999997,1cyclictest41-21ksoftirqd/323:33:303
178999994,1cyclictest464-21systemd-journal23:06:363
178999993,3cyclictest1-21systemd21:37:303
178999992,4cyclictest709-21systemd-logind23:51:053
178999990,0cyclictest0-21swapper/320:10:103
178999990,0cyclictest0-21swapper/319:50:083
178839993,6cyclictest0-21swapper/119:41:021
178839993,5cyclictest0-21swapper/119:15:011
178839993,1cyclictest752-21snmpd20:24:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional