You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 19:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Fri Nov 21, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
68712870,0sleep36872-21sshd12:33:343
16362850,0sleep00-21swapper/009:44:080
86122600,1sleep2646-21dbus-daemon09:44:542
42842600,5sleep375550irq/24-eno1-rx-10:40:143
16722600,0sleep20-21swapper/210:53:592
33022560,2sleep02926699cyclictest10:08:230
314432560,0sleep00-21swapper/011:47:090
296302550,0sleep10-21swapper/111:32:511
19712550,0sleep20-21swapper/210:22:192
85892540,1sleep2321ktimersoftd/212:39:492
196662530,0sleep20-21swapper/211:38:412
31802520,0sleep10-21swapper/110:11:531
230272520,0sleep00-21swapper/009:49:490
102022490,1sleep310196-21lspci09:58:493
211332480,0sleep20-21swapper/212:12:252
177572470,0sleep017755-21lspci12:31:300
63852460,0sleep16384-21bash12:20:341
179542440,0sleep10-21swapper/112:02:111
2912824331,7sleep00-21swapper/007:09:320
28512330,0sleep10-21swapper/110:04:561
19502330,1sleep3618-13audispd10:18:473
120582310,1sleep2321ktimersoftd/212:17:582
291542287,7sleep10-21swapper/107:09:531
230352230,0sleep00-21swapper/010:03:380
2880822210,7sleep20-21swapper/207:05:342
2737522210,7sleep30-21swapper/307:05:113
145162200,1sleep20-21swapper/210:41:252
323852190,0sleep20-21swapper/212:06:562
29266991816,1cyclictest32264-21kworker/0:010:41:370
244042180,2sleep32927899cyclictest11:07:423
130882180,0sleep1231rcuc/109:59:071
29266991715,1cyclictest18416-21kworker/0:211:24:580
216292170,0sleep10-21swapper/111:42:161
187012170,0sleep20-21swapper/209:14:022
97102160,0sleep10-21swapper/109:38:011
312892160,0sleep331288-21bash09:18:523
29266991614,1cyclictest32264-21kworker/0:010:31:030
121992160,1sleep312202-21bash12:04:533
90532150,0sleep30-21swapper/309:27:213
29266991515,0cyclictest30639-21kworker/0:109:34:010
29266991514,0cyclictest523-40kipmi009:28:000
29271991412,1cyclictest620-13audispd09:28:221
29266991414,0cyclictest3712-21kworker/0:110:46:490
29266991413,0cyclictest8540-21kworker/0:111:43:410
29266991413,0cyclictest8487-21kworker/0:009:59:510
2926699141,12cyclictest620-13audispd11:39:180
239262140,0sleep00-21swapper/010:52:490
231272140,0sleep10-21swapper/111:04:031
106222140,0sleep3391rcuc/309:13:113
71782130,0sleep10-21swapper/110:44:101
71632130,0sleep00-21swapper/011:51:160
29278991310,2cyclictest0-21swapper/312:29:493
29266991312,0cyclictest3712-21kworker/0:111:14:330
236372130,0sleep20-21swapper/211:59:352
29278991210,1cyclictest619-17sedispatch10:46:093
2927899120,1cyclictest8832-21lspci11:16:303
2927899120,1cyclictest5190-21sshd10:32:593
2927899120,0cyclictest0-21swapper/310:52:303
2927799120,11cyclictest0-21swapper/210:33:122
2927799120,11cyclictest0-21swapper/209:26:322
2927199120,1cyclictest5822-21sshd12:10:521
29266991211,0cyclictest16708-21lspci10:16:450
29266991210,1cyclictest7149-21sshd10:12:180
29266991210,1cyclictest17894-21sshd11:58:580
29266991210,1cyclictest16852-21kworker/0:012:04:590
29266991210,1cyclictest0-21swapper/010:24:080
2927899119,1cyclictest10734-21sshd11:30:393
29278991110,0cyclictest0-21swapper/311:02:393
29278991110,0cyclictest0-21swapper/309:42:393
29278991110,0cyclictest0-21swapper/309:32:093
2927899110,10cyclictest0-21swapper/312:14:593
2927899110,0cyclictest18178-21sshd10:20:293
2927799119,1cyclictest6110-21lspci11:30:142
2927799119,1cyclictest1095-21nfsd09:33:022
29277991110,0cyclictest15836-21sshd09:45:322
29277991110,0cyclictest0-21swapper/212:26:532
2927799110,10cyclictest23286-21lspci10:07:022
2927799110,10cyclictest0-21swapper/211:10:332
2927799110,0cyclictest0-21swapper/212:20:432
2927199119,1cyclictest0-21swapper/112:31:521
29271991110,0cyclictest0-21swapper/112:36:121
29271991110,0cyclictest0-21swapper/111:17:521
29271991110,0cyclictest0-21swapper/110:45:421
2927199110,10cyclictest0-21swapper/111:09:531
2927199110,10cyclictest0-21swapper/110:58:221
2927199110,10cyclictest0-21swapper/109:07:221
2927199110,10cyclictest0-21swapper/107:20:211
2927199110,0cyclictest0-21swapper/109:17:521
2926699119,1cyclictest14039-21grep09:16:580
29266991111,0cyclictest16852-21kworker/0:012:06:130
29266991110,0cyclictest3712-21kworker/0:110:58:470
29266991110,0cyclictest0-21swapper/012:29:480
29266991110,0cyclictest0-21swapper/010:26:380
2926699110,10cyclictest0-21swapper/009:09:480
2926699110,0cyclictest2863-21sshd11:15:480
36932100,2sleep32927899cyclictest11:44:153
2927899109,0cyclictest0-21swapper/311:37:293
2927899109,0cyclictest0-21swapper/311:26:193
2927899108,1cyclictest662-21sensors07:15:183
2927899108,1cyclictest32616-21sshd11:57:093
2927799104,1cyclictest646-21dbus-daemon12:30:552
2927199109,0cyclictest0-21swapper/112:27:321
2927199109,0cyclictest0-21swapper/110:35:021
2927199109,0cyclictest0-21swapper/108:52:221
2927199108,1cyclictest21110-21lspci12:18:521
2927199108,1cyclictest0-21swapper/112:06:321
2927199100,0cyclictest0-21swapper/110:17:321
2927199100,0cyclictest0-21swapper/107:56:211
2926699109,0cyclictest16979-21kworker/0:109:13:240
2926699108,1cyclictest978-21sshd11:01:180
2926699108,1cyclictest9-21ksoftirqd/011:10:000
292789998,0cyclictest0-21swapper/312:38:293
292789998,0cyclictest0-21swapper/311:51:393
292789995,1cyclictest616-13auditd09:22:463
292779998,0cyclictest0-21swapper/210:15:422
292719998,0cyclictest0-21swapper/110:26:521
292719998,0cyclictest0-21swapper/108:23:211
292719996,2cyclictest27804-21sshd11:36:061
292669998,0cyclictest0-21swapper/012:38:280
292669998,0cyclictest0-21swapper/011:25:380
292669998,0cyclictest0-21swapper/010:37:180
292669998,0cyclictest0-21swapper/009:53:080
292669998,0cyclictest0-21swapper/009:00:180
292669997,1cyclictest9-21ksoftirqd/012:20:340
292669997,1cyclictest9-21ksoftirqd/012:13:520
292669997,1cyclictest9-21ksoftirqd/011:31:050
439280,0sleep10-21swapper/110:50:171
292789987,0cyclictest15779-21sshd10:37:593
292789987,0cyclictest0-21swapper/312:21:093
292789987,0cyclictest0-21swapper/311:20:093
292789986,1cyclictest21478-21lspci10:27:533
292789986,1cyclictest13789-21lspci11:45:153
292789984,3cyclictest649-21avahi-daemon10:58:303
292779987,0cyclictest0-21swapper/211:41:232
292779987,0cyclictest0-21swapper/211:25:532
292779986,1cyclictest7589-21lspci11:23:132
292779986,1cyclictest21475-21lspci10:27:532
292779986,1cyclictest20710-21lspci11:49:312
292779986,1cyclictest0-21swapper/210:55:132
292779985,2cyclictest649-21avahi-daemon12:04:122
292779983,2cyclictest646-21dbus-daemon10:02:342
292779983,1cyclictest0-21swapper/209:51:402
292719987,0cyclictest0-21swapper/111:25:521
292719987,0cyclictest0-21swapper/110:05:421
292719986,1cyclictest14237-21lspci09:20:271
292719986,1cyclictest0-21swapper/110:21:521
292719985,2cyclictest649-21avahi-daemon09:51:581
292719985,2cyclictest649-21avahi-daemon09:33:321
292669987,0cyclictest9597-21kworker/0:008:45:190
292669986,1cyclictest9-21ksoftirqd/009:20:120
292669985,2cyclictest649-21avahi-daemon09:36:010
292669983,2cyclictest700-21gdbus12:15:200
292669980,4cyclictest9-21ksoftirqd/007:20:000
292789976,0cyclictest0-21swapper/310:12:593
292789975,1cyclictest700-21gdbus11:10:523
292789975,1cyclictest28453-21cut09:50:173
292789975,1cyclictest1316-21lspci10:01:143
292789974,2cyclictest649-21avahi-daemon10:06:553
292789974,2cyclictest649-21avahi-daemon09:36:413
292789974,2cyclictest23663-21sshd12:06:013
292789973,3cyclictest20525-21sshd09:46:053
292779976,1cyclictest22392-21lspci09:39:212
292779976,0cyclictest0-21swapper/211:06:042
292779976,0cyclictest0-21swapper/211:02:132
292779975,1cyclictest8658-21tty10:12:272
292779975,1cyclictest649-21avahi-daemon09:20:372
292779975,1cyclictest30945-21lspci09:57:322
292779974,2cyclictest646-21dbus-daemon11:53:052
292779974,2cyclictest1389-21sshd11:15:382
292779973,3cyclictest443-21systemd-journal09:19:232
292779972,4cyclictest646-21dbus-daemon10:36:242
292779972,2cyclictest21647-21sshd10:45:322
292719975,1cyclictest5113-21lspci09:40:541
292719975,1cyclictest23273-21lspci11:53:001
292719974,2cyclictest649-21avahi-daemon11:45:331
292719974,2cyclictest19193-21sshd11:10:281
292719974,2cyclictest1111-21sshd11:57:161
292669976,0cyclictest9597-21kworker/0:007:45:000
292669970,0cyclictest0-21swapper/008:40:580
292669970,0cyclictest0-21swapper/008:29:380
14722270,0sleep114726-21bash09:45:251
292789964,1cyclictest648-21systemd-logind09:07:033
292789964,1cyclictest19952-21sshd12:15:263
292779964,1cyclictest17299-21snmpd07:29:142
292779962,1cyclictest16362-21sshd09:08:042
292779960,5cyclictest31990-21perf08:35:002
292719965,0cyclictest0-21swapper/109:00:321
292719964,1cyclictest649-21avahi-daemon09:11:451
292719964,1cyclictest646-21dbus-daemon10:30:481
292719964,1cyclictest16051-21sshd11:20:371
292719963,2cyclictest17299-21snmpd07:36:541
292719960,5cyclictest0-21swapper/108:29:111
292719960,5cyclictest0-21swapper/107:40:511
292719960,5cyclictest0-21swapper/107:26:511
292719960,0cyclictest0-21swapper/108:17:311
292669966,0cyclictest9597-21kworker/0:008:59:210
292669966,0cyclictest9597-21kworker/0:008:21:130
292669966,0cyclictest9597-21kworker/0:008:17:350
292669966,0cyclictest9597-21kworker/0:008:10:290
292669966,0cyclictest3324-21kworker/0:207:23:410
292669965,0cyclictest0-21swapper/007:50:280
292669963,2cyclictest17299-21snmpd08:09:100
292669963,2cyclictest17299-21snmpd07:46:360
292789954,0cyclictest0-21swapper/307:35:183
292789953,1cyclictest8483-21cat08:55:143
292789953,1cyclictest31429-21ls08:30:203
292789953,1cyclictest29718-21sh07:10:143
292789953,1cyclictest28147-21cpu08:25:113
292789953,1cyclictest17299-21snmpd09:01:563
292789953,1cyclictest17299-21snmpd08:50:083
292789953,1cyclictest17299-21snmpd08:46:503
292789953,1cyclictest17299-21snmpd08:35:203
292789953,1cyclictest17299-21snmpd08:19:113
292789953,1cyclictest17299-21snmpd08:11:103
292789953,1cyclictest17299-21snmpd08:05:043
292789953,1cyclictest17299-21snmpd08:00:003
292789953,1cyclictest17299-21snmpd07:45:033
292789953,1cyclictest17299-21snmpd07:43:003
292789953,1cyclictest17299-21snmpd07:30:083
292789953,1cyclictest17299-21snmpd07:22:143
292789953,1cyclictest16433-21cat07:55:133
292789953,1cyclictest14370-21cat07:50:153
292789952,2cyclictest17299-21snmpd08:21:583
292779954,0cyclictest0-21swapper/208:10:422
292779953,1cyclictest649-21avahi-daemon07:15:122
292779953,1cyclictest6275-21cat07:30:122
292779953,1cyclictest4288-21gltestperf08:45:142
292779953,1cyclictest30369-21cut07:10:182
292779953,1cyclictest17299-21snmpd08:44:112
292779953,1cyclictest17299-21snmpd08:37:322
292779953,1cyclictest17299-21snmpd08:25:582
292779953,1cyclictest17299-21snmpd08:23:072
292779953,1cyclictest17299-21snmpd08:16:102
292779953,1cyclictest17299-21snmpd08:01:182
292779953,1cyclictest17299-21snmpd07:56:392
292779953,1cyclictest17299-21snmpd07:50:582
292779953,1cyclictest17299-21snmpd07:35:572
292779953,1cyclictest12368-21cat07:45:122
292779953,1cyclictest10674-21grep07:40:192
292779953,1cyclictest1058-21sendmail09:01:442
292779950,4cyclictest8815-21nfsd408:55:172
292779950,1cyclictest5966-21/usr/sbin/munin08:50:152
292719955,0cyclictest1739-21kworker/1:208:56:501
292719955,0cyclictest1739-21kworker/1:208:13:341
292719955,0cyclictest1739-21kworker/1:208:06:531
292719955,0cyclictest1739-21kworker/1:207:30:061
292719955,0cyclictest1739-21kworker/1:207:15:081
292719953,1cyclictest30792-21grep07:10:211
292719953,1cyclictest1739-21kworker/1:208:30:151
292719953,1cyclictest17299-21snmpd08:48:411
292719953,1cyclictest17299-21snmpd08:41:021
292719953,1cyclictest17299-21snmpd08:37:591
292719953,1cyclictest17299-21snmpd07:45:451
292719953,1cyclictest14802-21awk07:50:231
292719952,2cyclictest18301-21grep08:00:141
292669955,0cyclictest9597-21kworker/0:008:50:410
292669955,0cyclictest9597-21kworker/0:007:55:230
292669955,0cyclictest3324-21kworker/0:207:25:250
292669953,1cyclictest8308-21cat07:35:150
292669953,1cyclictest30678-21cat08:30:150
292669953,1cyclictest18467-21cat08:00:150
292669953,1cyclictest17299-21snmpd08:35:380
292669953,1cyclictest17299-21snmpd07:30:170
292669953,1cyclictest17299-21snmpd07:11:080
292789943,0cyclictest0-21swapper/307:25:083
292789942,1cyclictest0-21swapper/308:40:143
292779942,1cyclictest20504-21cat08:05:112
292779942,1cyclictest17299-21snmpd07:20:052
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional