You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-29 - 15:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack2slot0.osadl.org (updated Sat Nov 29, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
178321070,0sleep01784-21sshd11:53:090
232212930,0sleep1231rcuc/111:03:041
209512910,0sleep10-21swapper/110:41:481
126142660,0sleep30-21swapper/311:57:243
58582630,11sleep375550irq/24-eno1-rx-10:33:143
231072600,1sleep30-21swapper/310:52:273
251372590,0sleep30-21swapper/312:24:593
13042580,0sleep30-21swapper/312:28:533
88342570,0sleep00-21swapper/010:57:540
64172550,0sleep20-21swapper/211:01:072
248122520,0sleep20-21swapper/212:24:582
233892520,0sleep00-21swapper/012:27:530
221782520,1sleep022172-21bash10:45:200
299132510,0sleep00-21swapper/009:40:110
298762510,0sleep20-21swapper/210:28:552
195892510,0sleep30-21swapper/310:06:583
90862500,1sleep22545099cyclictest10:23:112
61422490,0sleep20-21swapper/211:56:432
167312490,0sleep10-21swapper/112:27:151
100852490,0sleep00-21swapper/009:23:460
2498224736,6sleep20-21swapper/207:05:292
233122430,0sleep00-21swapper/012:14:590
164892410,0sleep20-21swapper/210:55:162
223982390,1sleep322310-21sshd11:13:353
157142340,0sleep20-21swapper/212:33:162
251582308,7sleep00-21swapper/007:07:450
251072309,6sleep30-21swapper/307:07:073
2499623016,9sleep10-21swapper/107:05:411
247082240,0sleep224707-21grep10:14:252
248092230,0sleep124815-21bash09:43:091
63732210,6sleep06368-21sshd10:43:430
74572170,0sleep20-21swapper/209:16:152
74572170,0sleep20-21swapper/209:16:142
327352170,0sleep20-21swapper/211:39:052
194502170,1sleep1231rcuc/110:38:161
81312160,0sleep30-21swapper/312:20:003
306692160,1sleep233-21ksoftirqd/210:46:142
256722160,0sleep2311rcuc/210:07:372
245142150,0sleep20-21swapper/212:28:002
242142150,1sleep00-21swapper/011:03:110
31262140,0sleep10-21swapper/108:50:181
2544499140,12cyclictest23392-21sshd09:57:031
25440991413,0cyclictest13022-21lspci11:23:050
237052140,0sleep30-21swapper/309:10:273
201902140,0sleep10-21swapper/110:34:481
18272140,1sleep21829-21bash12:15:582
95492130,0sleep39551-21bash11:22:443
35572130,0sleep00-21swapper/012:32:060
2545399130,1cyclictest13043-21sshd11:05:213
25444991311,1cyclictest646-21dbus-daemon12:12:531
25440991310,2cyclictest0-21swapper/009:18:270
25440991310,2cyclictest0-21swapper/009:18:260
2544099130,12cyclictest13322-21sshd10:09:470
25453991210,1cyclictest1868-21id11:00:303
2545399120,11cyclictest24302-21bash09:18:113
2545399120,11cyclictest24302-21bash09:18:103
2545099120,11cyclictest4906-21lspci10:54:022
2545099120,11cyclictest1011-21sshd11:30:322
2545099120,11cyclictest0-21swapper/212:11:022
25444991210,1cyclictest26803-21sshd11:52:231
25440991210,1cyclictest443-21systemd-journal09:11:070
2544099120,11cyclictest0-21swapper/011:46:360
2545399119,1cyclictest6094-21latency_hist09:00:013
25453991110,0cyclictest0-21swapper/312:34:303
25453991110,0cyclictest0-21swapper/311:41:003
25453991110,0cyclictest0-21swapper/310:46:113
25453991110,0cyclictest0-21swapper/309:39:103
25453991110,0cyclictest0-21swapper/309:21:203
25453991110,0cyclictest0-21swapper/308:30:013
2545399110,0cyclictest0-21swapper/310:00:003
25450991110,0cyclictest0-21swapper/210:41:122
25450991110,0cyclictest0-21swapper/209:32:232
2545099110,10cyclictest20834-21lspci12:39:522
2545099110,10cyclictest0-21swapper/209:28:332
2545099110,0cyclictest0-21swapper/208:55:222
25444991110,0cyclictest0-21swapper/112:24:031
25444991110,0cyclictest0-21swapper/109:36:121
2544499110,10cyclictest18422-21sshd11:30:321
2544499110,10cyclictest0-21swapper/109:24:431
2544499110,0cyclictest0-21swapper/111:38:131
2544499110,0cyclictest0-21swapper/111:21:521
2544099119,1cyclictest0-21swapper/010:00:160
25440991110,0cyclictest0-21swapper/011:38:570
25440991110,0cyclictest0-21swapper/011:07:260
2544099110,10cyclictest0-21swapper/011:15:570
2544099110,10cyclictest0-21swapper/009:48:570
2544099110,10cyclictest0-21swapper/009:33:470
2544099110,10cyclictest0-21swapper/009:09:460
210862110,0sleep2321ktimersoftd/209:14:232
28662100,1sleep32867-21bash10:36:253
2545399109,0cyclictest0-21swapper/310:28:203
2545399109,0cyclictest0-21swapper/310:19:313
2545399109,0cyclictest0-21swapper/308:14:203
2545399108,1cyclictest27841-21lspci09:32:513
2545399100,0cyclictest0-21swapper/310:14:303
2545399100,0cyclictest0-21swapper/308:06:213
2545099109,0cyclictest0-21swapper/209:58:532
2545099109,0cyclictest0-21swapper/209:24:422
2545099108,1cyclictest16972-21lspci11:23:332
2545099100,0cyclictest0-21swapper/211:45:132
2545099100,0cyclictest0-21swapper/211:29:232
2545099100,0cyclictest0-21swapper/211:11:332
2544499109,0cyclictest0-21swapper/112:39:231
2544499109,0cyclictest0-21swapper/110:22:131
2544499100,0cyclictest0-21swapper/112:31:441
2544099109,0cyclictest0-21swapper/011:14:070
2544099109,0cyclictest0-21swapper/009:36:560
2544099100,0cyclictest0-21swapper/007:12:150
254539998,0cyclictest0-21swapper/311:54:013
254539998,0cyclictest0-21swapper/309:48:003
254539997,1cyclictest29695-21bash09:54:213
254539996,2cyclictest681-21gdbus12:35:413
254509998,0cyclictest0-21swapper/210:37:222
254509990,1cyclictest13250-21sshd09:41:532
254449998,0cyclictest0-21swapper/110:45:431
254449997,1cyclictest616-17auditd11:47:021
254449996,2cyclictest649-21avahi-daemon10:06:161
254409998,0cyclictest0-21swapper/012:24:470
254409998,0cyclictest0-21swapper/012:15:570
254409998,0cyclictest0-21swapper/010:26:060
254409998,0cyclictest0-21swapper/009:52:060
254409998,0cyclictest0-21swapper/009:25:260
18162290,0sleep018130-21sshd09:56:300
254539987,0cyclictest0-21swapper/309:44:513
254539987,0cyclictest0-21swapper/309:00:403
254539986,1cyclictest979-21lspci11:25:153
254539986,1cyclictest31789-21lspci12:06:083
254539986,1cyclictest25073-21grep10:21:213
254539986,1cyclictest2112-21lspci09:58:143
254539984,3cyclictest649-21avahi-daemon12:04:223
254539980,7cyclictest23570-21sshd11:38:013
254509986,1cyclictest9505-21lspci10:16:132
254509986,1cyclictest32005-21lspci11:52:562
254509984,3cyclictest700-21gdbus12:00:262
254509984,3cyclictest2692-21sshd11:18:302
254449987,0cyclictest0-21swapper/111:09:421
254449987,0cyclictest0-21swapper/110:27:521
254449987,0cyclictest0-21swapper/110:11:331
254449987,0cyclictest0-21swapper/109:32:231
254449986,1cyclictest888-21lspci09:19:081
254449986,1cyclictest888-21lspci09:19:071
254449986,1cyclictest29646-21lspci12:02:421
254449985,2cyclictest649-21avahi-daemon12:15:131
254449985,2cyclictest22996-21sshd10:55:551
254409987,0cyclictest0-21swapper/010:36:170
254409987,0cyclictest0-21swapper/010:12:170
254409987,0cyclictest0-21swapper/008:47:170
254409986,1cyclictest443-21systemd-journal12:03:000
254409980,4cyclictest20040-21awk08:15:000
10707280,4sleep310710-21bash12:13:433
8234270,0sleep00-21swapper/010:30:030
6738270,1sleep36902-21sshd11:32:493
254539976,0cyclictest0-21swapper/307:50:213
254539975,1cyclictest26134-21perf08:29:593
254539975,1cyclictest13062-21sshd10:44:283
254539974,2cyclictest700-21gdbus11:46:533
254539974,2cyclictest648-21systemd-logind09:28:243
254539974,2cyclictest13658-21sshd11:16:013
254539970,6cyclictest0-21swapper/308:16:313
254509975,1cyclictest646-21dbus-daemon10:30:162
254509975,1cyclictest616-17auditd09:45:552
254509974,2cyclictest17699-21sshd11:40:492
254509974,1cyclictest13217-21sshd09:52:352
254509973,3cyclictest618-13audispd11:07:552
254509973,1cyclictest20086-21sshd10:00:092
254509972,2cyclictest20028-21sshd12:05:042
254509972,1cyclictest0-21swapper/209:35:152
254449976,0cyclictest0-21swapper/110:16:321
254449975,1cyclictest2712-21lspci12:09:441
254449974,2cyclictest700-21gdbus11:17:441
254449974,2cyclictest649-21avahi-daemon10:50:521
254449974,2cyclictest649-21avahi-daemon10:02:521
254449974,2cyclictest648-21systemd-logind09:48:061
254449974,2cyclictest648-21systemd-logind09:26:541
254449974,2cyclictest32132-21sshd11:42:301
254449974,2cyclictest30933-21sshd11:28:321
254449973,1cyclictest21439-21lspci11:55:061
254409976,0cyclictest24107-21lspci11:58:360
254409976,0cyclictest0-21swapper/011:40:070
254409976,0cyclictest0-21swapper/010:22:570
254409975,1cyclictest9-21ksoftirqd/012:38:050
254409975,1cyclictest9-21ksoftirqd/010:50:400
254409975,1cyclictest14305-21cstates11:30:120
254409974,2cyclictest649-21avahi-daemon10:17:330
254409974,2cyclictest17463-21sshd11:27:020
254409972,4cyclictest30207-21awk08:40:000
254409970,0cyclictest0-21swapper/008:04:560
254539965,0cyclictest0-21swapper/307:43:413
254539965,0cyclictest0-21swapper/307:11:003
254539964,1cyclictest21001-21sshd10:55:423
254539963,2cyclictest17299-21snmpd08:36:463
254539962,2cyclictest11556-21sshd09:06:533
254509963,2cyclictest17299-21snmpd08:38:072
254509962,3cyclictest649-21avahi-daemon09:07:032
254509962,3cyclictest29186-21wc07:15:182
254509962,1cyclictest0-21swapper/207:55:032
254509961,1cyclictest121rcu_preempt07:49:592
254449964,1cyclictest684-21polkitd09:10:061
254449964,1cyclictest649-21avahi-daemon11:10:281
254449964,1cyclictest10626-21sshd09:06:291
254449963,2cyclictest646-21dbus-daemon09:50:141
254449960,5cyclictest0-21swapper/108:42:221
254449960,5cyclictest0-21swapper/108:04:421
254409963,2cyclictest26769-21sshd12:05:390
254409961,4cyclictest11911-21perf07:54:590
254409960,5cyclictest0-21swapper/008:54:060
254409960,5cyclictest0-21swapper/008:18:060
254539953,1cyclictest32639-21gltestperf07:25:143
254539953,1cyclictest17299-21snmpd08:20:143
254539953,1cyclictest17299-21snmpd08:03:543
254539953,1cyclictest17299-21snmpd07:49:123
254539953,1cyclictest17299-21snmpd07:37:123
254539953,1cyclictest17299-21snmpd07:30:593
254539953,1cyclictest17299-21snmpd07:22:053
254539953,1cyclictest1268-21sort08:45:203
254539953,1cyclictest1053-21lldpd07:17:183
254539952,2cyclictest2835-21tail08:50:163
254509953,1cyclictest4688-21needreboot07:35:192
254509953,1cyclictest18229-21/usr/sbin/munin08:10:172
254509953,1cyclictest17299-21snmpd09:00:102
254509953,1cyclictest17299-21snmpd08:53:192
254509953,1cyclictest17299-21snmpd08:45:052
254509953,1cyclictest17299-21snmpd08:40:022
254509953,1cyclictest17299-21snmpd08:33:232
254509953,1cyclictest17299-21snmpd08:20:172
254509953,1cyclictest17299-21snmpd08:16:472
254509953,1cyclictest17299-21snmpd07:50:372
254509953,1cyclictest17299-21snmpd07:20:172
254509953,1cyclictest17299-21snmpd07:10:112
254509953,1cyclictest14581-21idleruntime08:00:142
254509952,2cyclictest7522-21taskset07:41:232
254509952,2cyclictest17299-21snmpd07:30:052
254509952,2cyclictest16326-21tr08:05:142
254509950,4cyclictest32285-21/usr/sbin/munin07:25:132
254449954,0cyclictest0-21swapper/108:26:321
254449954,0cyclictest0-21swapper/107:11:121
254449953,1cyclictest6521-21cat07:40:151
254449953,1cyclictest26851-21cat08:30:141
254449953,1cyclictest19239-21sshd08:10:191
254449953,1cyclictest17299-21snmpd08:56:291
254449953,1cyclictest17299-21snmpd08:48:231
254449953,1cyclictest17299-21snmpd08:23:051
254449953,1cyclictest17299-21snmpd08:16:161
254449953,1cyclictest17299-21snmpd08:05:281
254449953,1cyclictest17299-21snmpd07:45:541
254449953,1cyclictest17299-21snmpd07:38:261
254449953,1cyclictest17299-21snmpd07:27:571
254449953,1cyclictest17299-21snmpd07:20:591
254449953,1cyclictest17299-21snmpd07:16:091
254449953,1cyclictest12214-21cut07:55:121
254449952,2cyclictest2713-21cut07:30:151
254449951,3cyclictest616-13auditd08:35:131
254449950,0cyclictest0-21swapper/109:02:121
254409954,0cyclictest0-21swapper/008:27:260
254409953,1cyclictest5791-21sadc07:39:590
254409953,1cyclictest17299-21snmpd09:04:300
254409953,1cyclictest17299-21snmpd08:55:200
254409953,1cyclictest17299-21snmpd08:42:220
254409953,1cyclictest17299-21snmpd08:20:260
254409953,1cyclictest17299-21snmpd07:56:280
254409953,1cyclictest17299-21snmpd07:31:240
254409953,1cyclictest17299-21snmpd07:18:060
254409953,1cyclictest1058-21sendmail07:40:240
254409953,1cyclictest1053-21lldpd08:31:450
254409952,2cyclictest17299-21snmpd07:26:290
10079253,0sleep19239-21kworker/1:207:50:021
254539942,1cyclictest30683-21expr08:40:133
254539942,1cyclictest12140-21cpu07:55:113
254509942,1cyclictest0-21swapper/208:25:132
254409944,0cyclictest7161-21kworker/0:208:05:110
254409944,0cyclictest7161-21kworker/0:207:20:080
254409942,1cyclictest8549-21cat07:45:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional