You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 21:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack3slot0.osadl.org (updated Tue Apr 28, 2026 12:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
89022770,0sleep40-21swapper/410:26:384
46042520,0sleep00-21swapper/010:56:450
246862500,0sleep20-21swapper/209:29:092
79922490,0sleep57977-21sshd11:10:045
42002490,0sleep70-21swapper/710:28:177
254362490,0sleep625433-21sshd09:36:426
254362490,0sleep625433-21sshd09:36:426
50812480,0sleep15080-21systemd-cgroups09:52:311
316772480,0sleep0101ktimersoftd/009:48:210
214722480,0sleep321469-21systemd-cgroups12:24:583
214722480,0sleep321469-21systemd-cgroups12:24:583
126532480,0sleep70-21swapper/711:52:117
87972470,0sleep1721-21dbus-daemon11:14:001
323622470,3sleep732359-21grep09:25:467
303202460,0sleep40-21swapper/409:52:024
276862460,0sleep10-21swapper/112:08:141
111212460,0sleep50-21swapper/507:50:075
280282450,0sleep10-21swapper/110:27:471
99292440,0sleep0111rcuc/009:24:340
98082440,0sleep6641ktimersoftd/612:24:216
98082440,0sleep6641ktimersoftd/612:24:216
58752440,0sleep00-21swapper/010:03:590
43552440,0sleep30-21swapper/311:06:093
268382440,0sleep30-21swapper/310:10:433
129062440,0sleep10-21swapper/111:02:551
60332430,1sleep76034-21bash09:45:007
221672430,1sleep61828599cyclictest10:21:436
57922420,0sleep50-21swapper/511:55:295
45852420,0sleep70-21swapper/711:15:347
24132420,2sleep31826099cyclictest11:41:573
238962420,0sleep50-21swapper/512:29:095
238962420,0sleep50-21swapper/512:29:095
230592420,0sleep40-21swapper/409:11:494
75722410,0sleep50-21swapper/510:00:125
45172410,0sleep5561ktimersoftd/512:06:505
238572410,0sleep00-21swapper/011:14:550
18992410,0sleep10-21swapper/110:35:321
18992410,0sleep10-21swapper/110:35:321
1805424129,9sleep20-21swapper/207:09:052
1776524129,8sleep70-21swapper/707:05:097
1754824127,9sleep50-21swapper/507:05:075
266722400,0sleep00-21swapper/010:40:430
1809624027,9sleep40-21swapper/407:09:394
1808324029,8sleep00-21swapper/007:09:270
1793323926,9sleep10-21swapper/107:07:281
1791623926,9sleep60-21swapper/607:07:176
1563323926,9sleep30-21swapper/307:04:493
85342380,0sleep00-21swapper/011:21:280
248132380,0sleep60-21swapper/612:17:326
93502370,0sleep40-21swapper/410:04:114
110152370,2sleep41827199cyclictest11:04:424
107282370,2sleep61828599cyclictest10:28:406
18246992410,2cyclictest9-21ksoftirqd/012:38:550
26762230,1sleep5464-21systemd-journal12:23:565
26762230,1sleep5464-21systemd-journal12:23:565
18246992310,2cyclictest9-21ksoftirqd/010:22:290
1827799227,1cyclictest57-21ksoftirqd/510:49:135
18277992219,2cyclictest27112-21cp09:34:555
18277992219,2cyclictest27112-21cp09:34:555
1824699229,3cyclictest9-21ksoftirqd/011:30:070
1824699228,2cyclictest9-21ksoftirqd/010:11:500
1824699227,3cyclictest9-21ksoftirqd/011:53:460
18246992210,2cyclictest9-21ksoftirqd/011:11:040
110142220,1sleep665-21ksoftirqd/609:30:096
57492210,0sleep10-21swapper/109:12:501
18246992111,3cyclictest9-21ksoftirqd/010:46:500
18246992110,2cyclictest9-21ksoftirqd/012:05:230
1824699211,3cyclictest9-21ksoftirqd/010:26:120
46682200,0sleep40-21swapper/412:12:344
1827799207,3cyclictest57-21ksoftirqd/512:01:565
1827799206,3cyclictest57-21ksoftirqd/510:13:285
18277992015,2cyclictest121rcu_preempt11:54:135
1824699209,2cyclictest9-21ksoftirqd/009:25:080
1824699208,3cyclictest9-21ksoftirqd/011:40:340
1824699208,3cyclictest9-21ksoftirqd/009:38:050
1824699208,3cyclictest9-21ksoftirqd/009:38:050
1824699208,2cyclictest9-21ksoftirqd/012:27:060
1824699208,2cyclictest9-21ksoftirqd/012:27:060
1824699207,1cyclictest9-21ksoftirqd/009:40:520
1824699206,3cyclictest9-21ksoftirqd/012:31:290
1824699200,3cyclictest0-21swapper/011:36:360
1824699200,1cyclictest3073-21sshd12:10:330
185032190,1sleep318433-21sshd11:01:213
18277991916,2cyclictest57-21ksoftirqd/511:23:325
18277991915,3cyclictest57-21ksoftirqd/509:33:045
1824699199,2cyclictest9-21ksoftirqd/009:14:550
1824699199,1cyclictest9-21ksoftirqd/011:00:290
1824699199,1cyclictest9-21ksoftirqd/009:50:450
1824699198,3cyclictest9-21ksoftirqd/010:08:350
1824699198,1cyclictest9-21ksoftirqd/011:25:530
1824699198,1cyclictest9-21ksoftirqd/011:25:530
1824699197,1cyclictest9-21ksoftirqd/012:20:530
1824699197,1cyclictest9-21ksoftirqd/012:20:530
1824699197,1cyclictest9-21ksoftirqd/011:55:010
1824699195,3cyclictest9-21ksoftirqd/010:50:590
1824699195,3cyclictest9-21ksoftirqd/009:29:490
1824699195,1cyclictest9-21ksoftirqd/011:46:540
18246991910,3cyclictest9-21ksoftirqd/010:17:030
1824699191,4cyclictest9-21ksoftirqd/010:31:060
1824699190,1cyclictest0-21swapper/012:03:380
1827799188,3cyclictest57-21ksoftirqd/510:58:205
18277991816,1cyclictest464-21systemd-journal11:44:555
18277991815,1cyclictest57-21ksoftirqd/511:37:495
18277991814,3cyclictest57-21ksoftirqd/512:31:445
18277991814,3cyclictest57-21ksoftirqd/511:05:175
18277991814,3cyclictest57-21ksoftirqd/510:23:475
18277991811,4cyclictest57-21ksoftirqd/512:09:495
18277991811,4cyclictest57-21ksoftirqd/510:42:525
1824699184,1cyclictest9-21ksoftirqd/011:06:340
18246991810,3cyclictest9-21ksoftirqd/009:55:000
1824699181,3cyclictest25035-21sshd09:11:570
236652170,0sleep20-21swapper/211:31:472
1827799172,1cyclictest57-21ksoftirqd/509:15:045
18277991715,1cyclictest57-21ksoftirqd/512:17:455
18277991715,1cyclictest57-21ksoftirqd/511:41:115
18277991715,1cyclictest57-21ksoftirqd/510:51:185
18277991715,1cyclictest57-21ksoftirqd/509:51:135
18277991715,1cyclictest57-21ksoftirqd/509:44:445
18277991715,1cyclictest57-21ksoftirqd/509:21:425
18277991714,2cyclictest57-21ksoftirqd/511:31:365
18277991714,2cyclictest57-21ksoftirqd/510:28:035
18277991714,1cyclictest57-21ksoftirqd/509:58:105
18277991713,2cyclictest57-21ksoftirqd/511:27:505
18277991713,2cyclictest57-21ksoftirqd/511:27:505
18277991710,6cyclictest57-21ksoftirqd/510:30:255
18277991710,6cyclictest57-21ksoftirqd/510:16:555
18260991715,1cyclictest41-21ksoftirqd/310:55:193
1824699177,1cyclictest9-21ksoftirqd/010:37:080
1824699177,1cyclictest9-21ksoftirqd/010:37:080
1824699175,3cyclictest9-21ksoftirqd/012:15:540
84032160,0sleep30-21swapper/310:51:193
55382160,0sleep3391rcuc/311:27:003
55382160,0sleep3391rcuc/311:27:003
33682160,0sleep70-21swapper/710:03:507
309402160,0sleep10-21swapper/111:26:341
309402160,0sleep10-21swapper/111:26:341
18285991614,1cyclictest721-21dbus-daemon11:55:116
1828599160,15cyclictest721-21dbus-daemon10:06:426
18277991615,1cyclictest57-21ksoftirqd/510:35:395
18277991615,1cyclictest57-21ksoftirqd/510:35:395
18277991614,1cyclictest57-21ksoftirqd/509:49:115
18277991613,1cyclictest57-21ksoftirqd/509:24:495
18277991612,3cyclictest57-21ksoftirqd/510:05:415
18277991611,1cyclictest57-21ksoftirqd/512:34:535
18260991614,1cyclictest41-21ksoftirqd/311:50:073
24342150,0sleep60-21swapper/612:06:436
18289991512,1cyclictest73-21ksoftirqd/712:29:347
18289991512,1cyclictest73-21ksoftirqd/712:29:347
18277991514,1cyclictest57-21ksoftirqd/511:15:035
18277991514,1cyclictest57-21ksoftirqd/509:10:405
18277991514,0cyclictest561ktimersoftd/508:44:575
18277991513,1cyclictest57-21ksoftirqd/510:59:475
18271991513,2cyclictest49-21ksoftirqd/411:15:354
18260991514,1cyclictest41-21ksoftirqd/310:17:063
18260991514,1cyclictest41-21ksoftirqd/309:14:483
18260991512,1cyclictest41-21ksoftirqd/309:56:263
18260991511,3cyclictest41-21ksoftirqd/311:10:033
18260991511,1cyclictest41-21ksoftirqd/310:20:423
18260991511,1cyclictest41-21ksoftirqd/309:22:213
1824699150,0cyclictest23696-21kworker/0:107:11:060
1828999148,3cyclictest73-21ksoftirqd/712:39:397
18289991412,1cyclictest73-21ksoftirqd/711:06:147
18277991412,2cyclictest0-21swapper/508:39:355
18260991413,1cyclictest41-21ksoftirqd/312:30:323
18260991413,1cyclictest41-21ksoftirqd/310:46:313
18260991412,1cyclictest41-21ksoftirqd/312:20:033
18260991412,1cyclictest41-21ksoftirqd/312:20:033
18260991412,1cyclictest41-21ksoftirqd/311:46:513
18260991412,1cyclictest41-21ksoftirqd/310:31:493
18260991412,1cyclictest41-21ksoftirqd/309:52:393
18260991412,1cyclictest41-21ksoftirqd/309:44:383
18260991412,1cyclictest41-21ksoftirqd/309:10:413
18260991412,1cyclictest391rcuc/311:21:533
18260991412,1cyclictest1-21systemd11:35:303
18250991410,3cyclictest25-21ksoftirqd/112:34:381
1824699144,0cyclictest9-21ksoftirqd/009:04:060
1824699143,0cyclictest23696-21kworker/0:107:23:240
324002130,1sleep232399-21grepconf.sh10:22:192
277602130,0sleep70-21swapper/711:30:087
1828999139,3cyclictest30977-21systemd12:23:427
1828999139,3cyclictest30977-21systemd12:23:427
18289991310,3cyclictest73-21ksoftirqd/709:50:367
1828599133,4cyclictest1-21systemd09:21:046
1828599130,3cyclictest721-21dbus-daemon11:37:176
1828599130,13cyclictest26319-21kworker/6:309:45:096
18277991311,1cyclictest57-21ksoftirqd/507:56:155
18271991311,1cyclictest49-21ksoftirqd/410:37:574
18271991311,1cyclictest49-21ksoftirqd/410:37:574
18271991311,1cyclictest49-21ksoftirqd/410:07:144
1826099139,1cyclictest41-21ksoftirqd/309:27:313
1826099138,3cyclictest41-21ksoftirqd/312:14:523
1826099138,3cyclictest41-21ksoftirqd/310:07:203
18260991312,1cyclictest41-21ksoftirqd/311:29:573
18260991312,1cyclictest41-21ksoftirqd/310:37:133
18260991312,1cyclictest41-21ksoftirqd/310:37:133
18260991312,1cyclictest41-21ksoftirqd/309:59:453
18260991312,1cyclictest41-21ksoftirqd/309:32:023
18260991311,1cyclictest41-21ksoftirqd/312:11:343
18260991311,1cyclictest41-21ksoftirqd/312:00:163
18260991311,1cyclictest41-21ksoftirqd/311:18:583
18260991311,1cyclictest41-21ksoftirqd/310:42:013
18260991311,1cyclictest41-21ksoftirqd/310:26:243
18260991311,1cyclictest41-21ksoftirqd/309:47:443
18260991311,1cyclictest41-21ksoftirqd/309:38:403
18260991311,1cyclictest41-21ksoftirqd/309:38:403
18260991310,1cyclictest41-21ksoftirqd/312:35:023
18256991311,1cyclictest33-21ksoftirqd/210:33:072
18256991311,1cyclictest33-21ksoftirqd/209:46:332
1825099139,1cyclictest25-21ksoftirqd/112:37:421
1824699134,9cyclictest23696-21kworker/0:108:46:260
1824699130,0cyclictest0-21swapper/008:55:260
54032120,1sleep2721-21dbus-daemon10:11:222
300372120,0sleep60-21swapper/611:39:526
282932120,1sleep228292-21sshd10:56:152
1828999127,3cyclictest73-21ksoftirqd/712:15:257
18289991211,1cyclictest73-21ksoftirqd/711:37:527
18289991210,1cyclictest73-21ksoftirqd/711:21:347
18289991210,1cyclictest73-21ksoftirqd/711:00:227
18289991210,1cyclictest73-21ksoftirqd/710:23:387
1828599123,4cyclictest857-21polkitd10:17:566
1828599122,4cyclictest730-21NetworkManager10:33:586
1828599122,4cyclictest2971-21systemd-cgroups10:43:206
1828599122,4cyclictest1-21systemd11:49:456
1828599122,4cyclictest1-21systemd11:19:326
1828599121,5cyclictest29927-21id11:05:456
1828599121,10cyclictest0-21swapper/609:13:446
1828599120,11cyclictest25242-21kworker/6:412:11:306
1828599120,11cyclictest15793-21kworker/6:312:00:046
1827799129,3cyclictest28409-21kworker/5:008:28:515
1827199127,4cyclictest20899-21kworker/4:109:37:244
1827199127,4cyclictest20899-21kworker/4:109:37:244
1827199126,3cyclictest22473-21kworker/4:112:00:484
18271991210,1cyclictest49-21ksoftirqd/411:48:074
18271991210,1cyclictest49-21ksoftirqd/410:50:424
18271991210,1cyclictest0-21swapper/410:58:304
1827199120,2cyclictest26097-21bash09:48:024
1827199120,11cyclictest3541-21sshd12:31:414
18260991211,1cyclictest41-21ksoftirqd/312:05:323
18260991211,1cyclictest41-21ksoftirqd/311:56:163
1825699129,2cyclictest33-21ksoftirqd/210:39:362
1825699129,2cyclictest33-21ksoftirqd/210:39:362
1825699129,2cyclictest11635-21bash12:30:132
1825699122,4cyclictest0-21swapper/212:00:282
18256991210,2cyclictest33-21ksoftirqd/209:21:212
18256991210,1cyclictest33-21ksoftirqd/212:10:032
18256991210,1cyclictest33-21ksoftirqd/210:48:502
18256991210,1cyclictest0-21swapper/211:49:322
1825099128,1cyclictest25-21ksoftirqd/111:05:221
1825099128,1cyclictest25-21ksoftirqd/109:20:141
1825099126,5cyclictest20548-21sshd09:28:541
1825099126,1cyclictest25-21ksoftirqd/111:35:291
1825099123,5cyclictest21169-21sshd11:16:341
18250991211,1cyclictest25-21ksoftirqd/111:34:301
18250991210,1cyclictest25-21ksoftirqd/112:24:531
18250991210,1cyclictest25-21ksoftirqd/112:24:531
1825099120,11cyclictest0-21swapper/112:01:251
1824699128,2cyclictest23696-21kworker/0:109:07:440
1824699124,0cyclictest23696-21kworker/0:107:17:520
1828999119,1cyclictest73-21ksoftirqd/711:56:157
1828999119,1cyclictest73-21ksoftirqd/710:58:357
1828999119,1cyclictest73-21ksoftirqd/710:47:537
1828999119,1cyclictest73-21ksoftirqd/710:18:037
1828999119,1cyclictest73-21ksoftirqd/709:37:517
1828999119,1cyclictest73-21ksoftirqd/709:37:517
1828999119,1cyclictest26148-21sshd11:41:277
1828999118,1cyclictest73-21ksoftirqd/712:34:087
1828999118,1cyclictest73-21ksoftirqd/710:37:057
1828999118,1cyclictest73-21ksoftirqd/710:37:057
1828999117,1cyclictest73-21ksoftirqd/711:44:497
1828999116,3cyclictest73-21ksoftirqd/711:29:417
1828999116,3cyclictest73-21ksoftirqd/711:29:417
1828999113,4cyclictest16700-21sshd09:40:007
1828999112,4cyclictest0-21swapper/710:31:167
18289991110,1cyclictest73-21ksoftirqd/712:00:217
18289991110,1cyclictest73-21ksoftirqd/710:53:027
18289991110,1cyclictest73-21ksoftirqd/710:10:047
18289991110,1cyclictest0-21swapper/711:13:147
1828999111,4cyclictest0-21swapper/712:12:177
1828999110,10cyclictest0-21swapper/709:10:547
1828599119,1cyclictest65-21ksoftirqd/610:50:116
1828599119,1cyclictest6402-21df09:14:566
1828599112,4cyclictest721-21dbus-daemon11:21:096
1828599112,4cyclictest5251-21sd-pam11:09:586
1828599112,4cyclictest1-21systemd09:55:586
18285991110,1cyclictest0-21swapper/610:55:316
1828599111,4cyclictest19458-21sshd12:36:256
1828599110,5cyclictest29065-21bash11:49:286
1828599110,5cyclictest21466-21bash10:10:246
1828599110,5cyclictest18595-21sshd10:48:076
1828599110,11cyclictest26324-21kworker/6:112:25:346
1828599110,11cyclictest26324-21kworker/6:112:25:346
1828599110,11cyclictest1649-21kworker/6:311:26:366
1828599110,11cyclictest1649-21kworker/6:311:26:366
1828599110,10cyclictest22463-21systemd-cgroups09:25:116
1828599110,1cyclictest21387-21sshd09:51:306
1827799119,2cyclictest57-21ksoftirqd/507:16:235
1827799119,1cyclictest57-21ksoftirqd/508:59:445
1827199119,1cyclictest49-21ksoftirqd/411:53:394
1827199119,1cyclictest49-21ksoftirqd/411:40:054
1827199119,1cyclictest49-21ksoftirqd/411:27:104
1827199119,1cyclictest49-21ksoftirqd/411:27:104
1827199119,1cyclictest49-21ksoftirqd/410:41:084
1827199115,5cyclictest857-21polkitd10:33:514
1827199113,5cyclictest709-21systemd-logind12:07:384
1827199110,10cyclictest8426-21systemd-cgroups11:06:234
1827199110,10cyclictest1-21systemd09:42:504
1825699119,1cyclictest33-21ksoftirqd/211:38:352
1825699119,1cyclictest33-21ksoftirqd/209:15:132
1825699117,3cyclictest33-21ksoftirqd/209:59:552
1825699115,4cyclictest33-21ksoftirqd/212:39:112
1825699115,3cyclictest857-21polkitd11:20:232
1825699114,4cyclictest31507-21sshd09:55:572
1825699112,4cyclictest22264-21sshd10:52:122
1825699111,4cyclictest20658-21bash11:43:072
1825699111,4cyclictest12904-21bash11:12:192
1825699110,11cyclictest31719-21kworker/2:212:04:472
1825699110,10cyclictest0-21swapper/211:02:152
1825699110,10cyclictest0-21swapper/209:53:592
1825699110,1cyclictest0-21swapper/212:16:112
1825099119,1cyclictest25-21ksoftirqd/110:55:021
1825099119,1cyclictest25-21ksoftirqd/109:43:491
1825099118,2cyclictest25-21ksoftirqd/112:19:461
1825099118,2cyclictest25-21ksoftirqd/112:19:461
1825099118,1cyclictest25-21ksoftirqd/109:19:361
1825099113,5cyclictest21317-21grep12:09:501
18250991110,1cyclictest0-21swapper/111:47:251
1825099110,11cyclictest21137-21kworker/1:111:19:511
1825099110,10cyclictest29456-21kworker/1:410:41:541
1825099110,1cyclictest0-21swapper/110:33:001
1824699118,1cyclictest23696-21kworker/0:107:25:240
1824699114,7cyclictest9-21ksoftirqd/007:54:460
1824699114,1cyclictest9-21ksoftirqd/008:17:520
1824699113,1cyclictest9-21ksoftirqd/007:44:250
1824699113,0cyclictest23696-21kworker/0:108:42:480
18246991110,1cyclictest9-21ksoftirqd/008:24:430
1828999109,1cyclictest73-21ksoftirqd/709:31:417
1828999108,1cyclictest73-21ksoftirqd/709:15:087
1828999105,3cyclictest17418-21cp10:40:117
1828999102,5cyclictest709-21systemd-logind09:20:437
1828999102,5cyclictest2059-21sshd10:09:247
1828599105,1cyclictest85150irq/25-em1-rx-009:40:356
1828599103,6cyclictest24875-21sshd12:31:016
1828599100,4cyclictest859-21gdbus11:02:316
1828599100,4cyclictest7872-21systemd-cgroups11:30:526
1828599100,4cyclictest1-21systemd10:36:426
1828599100,4cyclictest1-21systemd10:36:426
1828599100,10cyclictest30607-21kworker/6:009:59:526
1827799108,2cyclictest0-21swapper/509:01:575
1827799108,2cyclictest0-21swapper/507:38:455
1827799108,2cyclictest0-21swapper/507:38:455
1827799108,0cyclictest0-21swapper/508:34:035
1827799106,4cyclictest57-21ksoftirqd/507:59:535
1827799105,3cyclictest57-21ksoftirqd/508:10:075
1827199108,1cyclictest49-21ksoftirqd/412:24:554
1827199108,1cyclictest49-21ksoftirqd/412:24:554
1827199108,1cyclictest49-21ksoftirqd/411:35:514
1827199108,1cyclictest49-21ksoftirqd/410:15:254
1827199103,4cyclictest30133-21rm12:23:394
1827199103,4cyclictest30133-21rm12:23:394
1827199103,4cyclictest29824-21sshd10:14:424
1827199103,4cyclictest11318-21bash11:55:494
1827199102,5cyclictest14538-21bash09:34:134
1827199102,4cyclictest27892-21bash10:20:094
1827199101,3cyclictest10943-21sshd12:14:514
1827199100,9cyclictest20051-21kworker/4:411:12:164
1827199100,9cyclictest16349-21kworker/4:110:46:174
1827199100,6cyclictest11609-21grepconf.sh09:17:014
1827199100,10cyclictest0-21swapper/412:38:184
1825699107,2cyclictest13883-21bash11:16:072
1825699106,3cyclictest4787-21grep11:55:252
1825699104,2cyclictest19570-21sshd12:21:042
1825699104,2cyclictest19570-21sshd12:21:042
1825699103,6cyclictest1814-21sshd09:10:232
1825699103,3cyclictest709-21systemd-logind09:30:242
1825699103,1cyclictest709-21systemd-logind10:42:252
1825699102,4cyclictest857-21polkitd10:15:352
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional