You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 18:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Thu Nov 20, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2550821060,0sleep20-21swapper/211:56:592
241542930,1sleep224143-21sshd09:55:152
220242920,0sleep00-21swapper/010:50:520
91042790,3sleep233-21ksoftirqd/212:30:472
88992730,0sleep00-21swapper/010:17:570
289862690,0sleep20-21swapper/212:13:492
232712690,1sleep20-21swapper/211:36:202
232712690,1sleep20-21swapper/211:36:202
195972620,0sleep019598-21bash10:22:290
73602590,1sleep1231rcuc/111:20:451
301032580,1sleep030099-21bash11:30:010
23302580,1sleep1231rcuc/110:13:441
201332580,0sleep0111rcuc/009:19:450
175142580,0sleep10-21swapper/111:04:311
303502570,0sleep00-21swapper/012:32:500
145792570,0sleep114578-21grep12:37:231
139522570,0sleep20-21swapper/210:11:292
293782550,0sleep11164899cyclictest11:33:151
255842530,0sleep30-21swapper/312:29:243
311982520,0sleep20-21swapper/209:35:172
124542520,0sleep30-21swapper/310:00:493
307482510,0sleep10-21swapper/110:55:341
298482510,0sleep10-21swapper/112:32:461
200402510,1sleep320039-21sshd10:22:323
288002500,0sleep00-21swapper/010:02:420
1142224938,6sleep20-21swapper/207:08:382
234782480,0sleep00-21swapper/009:23:530
216632480,0sleep20-21swapper/210:43:572
15412480,1sleep21531-21sshd11:54:392
321662470,0sleep11164899cyclictest09:08:241
307202360,1sleep330719-21bash11:26:403
1124123624,7sleep30-21swapper/307:06:233
131642220,0sleep30-21swapper/311:14:183
97452219,7sleep00-21swapper/007:05:080
1122422110,7sleep10-21swapper/107:06:091
11648991917,1cyclictest27933-21lspci11:57:141
55672180,0sleep00-21swapper/011:37:540
55672180,0sleep00-21swapper/011:37:540
236962180,0sleep30-21swapper/312:00:043
140472180,0sleep10-21swapper/111:18:051
114212180,1sleep311426-21bash09:43:353
306392170,1sleep3401ktimersoftd/310:27:123
275252170,0sleep227524-21bash12:29:352
224012160,0sleep10-21swapper/111:46:321
148092160,0sleep00-21swapper/010:11:350
11648991615,0cyclictest31608-21lspci11:50:591
59662150,0sleep25968-21grepconf.sh10:31:402
270982150,1sleep3401ktimersoftd/311:33:013
266182150,1sleep1231rcuc/110:23:141
244712150,0sleep3391rcuc/310:30:053
169742150,1sleep21095-21nfsd10:57:352
143292150,0sleep3391rcuc/311:21:313
118232150,0sleep20-21swapper/209:18:502
11653991514,0cyclictest7890-21lspci12:18:082
11648991514,0cyclictest4693-21kworker/1:009:50:251
11648991514,0cyclictest20315-21lspci09:19:461
11648991514,0cyclictest15864-21lspci09:37:111
11648991513,1cyclictest25161-21lspci10:33:441
261312140,0sleep20-21swapper/209:24:112
237802140,0sleep00-21swapper/011:56:490
152762140,0sleep00-21swapper/009:33:420
11653991413,0cyclictest6937-21lspci10:28:122
11648991413,0cyclictest30561-21kworker/1:112:24:511
11648991413,0cyclictest30439-21lspci12:04:191
11648991412,1cyclictest24962-21kworker/1:209:59:151
11653991312,0cyclictest9088-21lspci09:10:362
11653991312,0cyclictest25142-21lspci11:26:032
11648991312,0cyclictest32743-21lspci12:17:241
11648991312,0cyclictest10278-21lspci11:10:261
11648991311,1cyclictest19157-21kworker/1:011:36:191
11648991311,1cyclictest19157-21kworker/1:011:36:191
1164899130,12cyclictest13906-21lspci12:12:191
11642991311,1cyclictest30852-21sshd11:16:180
1164299130,1cyclictest4794-21sshd10:06:580
1166399120,11cyclictest3362-21sshd12:36:193
1165399120,11cyclictest30269-21lspci10:20:112
11648991211,1cyclictest11403-21kworker/1:212:05:171
11648991211,0cyclictest33050irq/27-ahci[00010:51:141
11648991211,0cyclictest3006-21lspci10:27:441
11648991211,0cyclictest26081-21kworker/1:011:29:031
1164899120,1cyclictest8575-21sshd11:06:591
1164899120,0cyclictest0-21swapper/109:41:281
1164299120,1cyclictest9902-21sshd10:49:380
11663991110,0cyclictest0-21swapper/311:06:383
1166399110,0cyclictest0-21swapper/312:21:593
1165399119,1cyclictest33-21ksoftirqd/211:45:452
11653991110,0cyclictest0-21swapper/212:23:122
11653991110,0cyclictest0-21swapper/210:05:112
11653991110,0cyclictest0-21swapper/209:43:012
1165399110,10cyclictest0-21swapper/211:42:022
11648991110,1cyclictest18401-21kworker/1:109:10:141
11648991110,0cyclictest4215-21kworker/1:009:25:591
11648991110,0cyclictest33050irq/27-ahci[00012:26:271
11648991110,0cyclictest24962-21kworker/1:210:00:491
1164299119,1cyclictest28051-21bash12:29:380
1164299119,1cyclictest24356-21lspci12:00:080
11642991110,0cyclictest0-21swapper/011:07:080
11642991110,0cyclictest0-21swapper/010:32:380
1166399109,0cyclictest22457-21lspci11:43:073
1166399109,0cyclictest10859-21sshd10:46:083
1166399109,0cyclictest0-21swapper/311:47:193
1166399109,0cyclictest0-21swapper/311:15:493
1166399109,0cyclictest0-21swapper/309:31:483
1166399108,1cyclictest14089-21sshd12:15:293
1166399100,0cyclictest0-21swapper/312:14:193
1166399100,0cyclictest0-21swapper/310:55:383
1166399100,0cyclictest0-21swapper/309:48:383
1166399100,0cyclictest0-21swapper/309:12:583
1165399109,0cyclictest27546-21lspci10:19:562
1165399109,0cyclictest0-21swapper/211:13:312
1165399109,0cyclictest0-21swapper/209:28:312
1165399108,1cyclictest33-21ksoftirqd/210:00:172
1165399108,1cyclictest33-21ksoftirqd/209:34:352
1165399100,0cyclictest0-21swapper/210:47:212
1164899109,0cyclictest0-21swapper/110:15:291
11648991010,0cyclictest11251-21kworker/1:110:07:551
1164299109,0cyclictest0-21swapper/012:35:380
1164299109,0cyclictest0-21swapper/011:11:080
1164299109,0cyclictest0-21swapper/010:59:080
1164299109,0cyclictest0-21swapper/009:49:480
1164299109,0cyclictest0-21swapper/008:55:180
116639998,0cyclictest0-21swapper/311:36:093
116639998,0cyclictest0-21swapper/311:36:093
116639997,1cyclictest19083-21bash10:05:083
116539999,0cyclictest0-21swapper/210:52:412
116539998,0cyclictest646-21dbus-daemon09:46:162
116539998,0cyclictest13756-21lspci11:21:282
116539998,0cyclictest0-21swapper/211:19:512
116539997,1cyclictest33-21ksoftirqd/212:39:532
116539997,1cyclictest33-21ksoftirqd/212:05:552
116539997,1cyclictest33-21ksoftirqd/211:08:432
116539996,2cyclictest11056-21sshd12:02:162
116539994,2cyclictest14006-21sshd11:31:402
116489999,0cyclictest33050irq/27-ahci[00010:38:361
116489998,0cyclictest0-21swapper/110:46:291
116489998,0cyclictest0-21swapper/109:46:281
116489990,8cyclictest20434-21kworker/1:209:21:301
116429998,0cyclictest0-21swapper/012:20:080
116429998,0cyclictest0-21swapper/011:28:280
116429998,0cyclictest0-21swapper/011:00:180
116429998,0cyclictest0-21swapper/010:43:080
116429998,0cyclictest0-21swapper/010:25:080
116429998,0cyclictest0-21swapper/009:42:180
116429998,0cyclictest0-21swapper/009:39:480
116429998,0cyclictest0-21swapper/008:29:570
116429998,0cyclictest0-21swapper/008:20:270
116429990,0cyclictest0-21swapper/011:45:280
441280,0sleep3391rcuc/309:24:573
116639986,1cyclictest22329-21lspci10:54:353
116639986,1cyclictest2211-21lspci11:54:423
116639986,1cyclictest0-21swapper/309:28:283
116639985,2cyclictest649-21avahi-daemon10:35:223
116639985,2cyclictest649-21avahi-daemon10:14:483
116539987,0cyclictest0-21swapper/208:03:012
116539986,1cyclictest33-21ksoftirqd/211:00:062
116539984,3cyclictest646-21dbus-daemon09:51:402
116539980,6cyclictest11780-21kworker/2:110:36:002
116489987,0cyclictest2582-21lspci09:32:221
116489987,0cyclictest0-21swapper/108:15:181
116489986,1cyclictest25-21ksoftirqd/111:40:531
116489986,1cyclictest25-21ksoftirqd/110:40:011
116429987,0cyclictest0-21swapper/012:12:280
116429986,1cyclictest9-21ksoftirqd/009:28:170
116429985,2cyclictest684-21polkitd11:52:120
116429985,2cyclictest23610-21sshd12:16:280
8960270,1sleep39145-21sshd12:33:543
116639976,0cyclictest0-21swapper/309:15:383
116639976,0cyclictest0-21swapper/308:10:183
116639975,1cyclictest700-21gdbus11:00:223
116639975,1cyclictest649-21avahi-daemon10:16:003
116639975,1cyclictest32334-21sshd09:56:033
116639974,2cyclictest649-21avahi-daemon11:55:353
116639974,2cyclictest646-21dbus-daemon12:05:053
116429976,1cyclictest30518-21lspci09:13:390
116429975,1cyclictest9-21ksoftirqd/011:20:460
116429975,1cyclictest8741-21sshd12:05:170
116429975,1cyclictest649-21avahi-daemon11:40:140
116429975,1cyclictest30032-21lspci10:37:590
116429974,2cyclictest649-21avahi-daemon09:56:420
116639965,0cyclictest0-21swapper/309:00:083
116639964,1cyclictest7108-21sshd09:50:023
116639964,1cyclictest646-21dbus-daemon08:50:003
116639963,2cyclictest646-21dbus-daemon10:40:043
116639963,2cyclictest646-21dbus-daemon09:35:113
116639963,1cyclictest17299-21snmpd08:54:583
116639960,5cyclictest0-21swapper/308:01:083
116639960,5cyclictest0-21swapper/307:40:083
116539965,0cyclictest0-21swapper/209:00:112
116539964,1cyclictest33-21ksoftirqd/207:20:002
116539963,2cyclictest578-21id09:08:472
116539963,2cyclictest17299-21snmpd07:22:142
116539961,4cyclictest29486-21tr07:50:152
116539960,5cyclictest0-21swapper/208:49:512
116539960,5cyclictest0-21swapper/208:22:412
116539960,5cyclictest0-21swapper/207:56:512
116489964,1cyclictest25-21ksoftirqd/108:40:001
116429964,1cyclictest646-21dbus-daemon09:08:320
116429964,1cyclictest18249-21perf07:24:590
116429964,1cyclictest12298-21mii-tool07:10:140
116429963,2cyclictest649-21avahi-daemon09:50:020
116639953,1cyclictest700-21gdbus09:06:183
116639953,1cyclictest31151-21cat07:55:123
116639953,1cyclictest2860-21mii-tool08:05:133
116639953,1cyclictest23186-21mii-tool08:55:153
116639953,1cyclictest17299-21snmpd08:40:073
116639953,1cyclictest17299-21snmpd08:37:193
116639953,1cyclictest17299-21snmpd08:30:433
116639953,1cyclictest17299-21snmpd08:25:093
116639953,1cyclictest17299-21snmpd08:21:273
116639953,1cyclictest17299-21snmpd08:15:243
116639953,1cyclictest17299-21snmpd07:37:593
116639953,1cyclictest17299-21snmpd07:32:593
116639953,1cyclictest17299-21snmpd07:20:073
116639953,1cyclictest14708-21grep07:15:153
116639953,1cyclictest1053-21lldpd07:50:413
116639952,2cyclictest648-21systemd-logind07:30:003
116639952,2cyclictest26646-21cpu07:45:133
116639950,0cyclictest0-21swapper/307:11:083
116539954,0cyclictest0-21swapper/208:35:512
116539953,1cyclictest4916-21cat08:10:142
116539953,1cyclictest3205-21cut08:05:142
116539953,1cyclictest23026-21cat07:35:142
116539953,1cyclictest17299-21snmpd08:50:012
116539953,1cyclictest17299-21snmpd08:15:212
116539953,1cyclictest17299-21snmpd07:48:562
116539953,1cyclictest17299-21snmpd07:30:082
116539953,1cyclictest17299-21snmpd07:26:352
116539953,1cyclictest17299-21snmpd07:11:402
116539953,1cyclictest12882-21gltestperf08:30:112
116539950,2cyclictest17670-21sshd08:40:162
116539950,1cyclictest24571-21/usr/sbin/munin07:40:202
116489954,0cyclictest0-21swapper/108:50:481
116489953,1cyclictest30979-21gltestperf07:55:111
116489953,1cyclictest17299-21snmpd09:01:461
116489953,1cyclictest17299-21snmpd08:55:401
116489953,1cyclictest17299-21snmpd08:45:281
116489953,1cyclictest17299-21snmpd08:07:061
116489953,1cyclictest17299-21snmpd08:01:421
116489953,1cyclictest17299-21snmpd07:41:081
116489953,1cyclictest17299-21snmpd07:35:261
116489953,1cyclictest17299-21snmpd07:32:561
116489953,1cyclictest17299-21snmpd07:23:471
116489953,1cyclictest17299-21snmpd07:13:221
116489953,1cyclictest17104-21cat08:40:111
116489953,1cyclictest14901-21cat07:15:161
116489953,1cyclictest1053-21lldpd08:10:121
116489953,1cyclictest10076-21sshd08:22:361
116489952,2cyclictest646-21dbus-daemon07:30:001
116489952,2cyclictest28733-21tr07:50:111
116489952,2cyclictest27917-21tail07:45:211
116489952,1cyclictest3727-21kworker/1:008:30:131
116429954,0cyclictest0-21swapper/007:17:370
116429953,1cyclictest27077-21mii-tool07:45:150
116429953,1cyclictest25064-21cat07:40:150
116429953,1cyclictest24745-21/usr/sbin/munin09:00:180
116429953,1cyclictest17299-21snmpd08:45:170
116429953,1cyclictest17299-21snmpd08:40:370
116429953,1cyclictest17299-21snmpd08:34:250
116429953,1cyclictest17299-21snmpd08:08:000
116429953,1cyclictest17299-21snmpd07:58:390
116429953,1cyclictest17299-21snmpd07:38:140
116429953,1cyclictest17299-21snmpd07:32:410
116429953,1cyclictest17299-21snmpd07:28:290
116429953,1cyclictest15083-21cat08:35:170
116429953,1cyclictest1053-21lldpd08:15:520
116429953,1cyclictest1053-21lldpd08:02:510
116429950,4cyclictest30303-21sshd07:53:360
116429950,3cyclictest0-21swapper/008:14:550
116539942,1cyclictest104982chrt08:25:012
116539942,1cyclictest0-21swapper/208:55:132
116489942,1cyclictest11103-21sort08:25:121
116429942,1cyclictest0-21swapper/008:50:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional