You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 16:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Wed Nov 26, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3265521000,0sleep30-21swapper/311:31:293
129772990,0sleep20-21swapper/211:39:412
150102850,0sleep10-21swapper/110:44:151
214062620,0sleep20-21swapper/210:24:262
115972610,0sleep00-21swapper/009:13:350
110592570,0sleep20-21swapper/211:56:582
77392560,1sleep17737-21sshd11:49:441
304142560,0sleep10-21swapper/110:28:451
299022560,0sleep00-21swapper/011:48:390
11922560,0sleep31190-21id10:35:443
130912550,0sleep00-21swapper/009:21:040
147102540,0sleep30-21swapper/311:36:203
71122530,1sleep20-21swapper/209:53:512
264852530,0sleep30-21swapper/309:37:343
150272530,0sleep30-21swapper/309:13:593
97662520,0sleep30-21swapper/310:12:213
262792520,1sleep226232-21sshd10:48:572
237522520,0sleep30-21swapper/312:17:503
236532510,0sleep2311rcuc/209:29:442
113522510,0sleep20-21swapper/210:16:022
255192480,0sleep20-21swapper/212:05:072
118902470,0sleep10-21swapper/109:46:521
32242440,1sleep12419299cyclictest09:57:131
36192410,0sleep20-21swapper/211:21:142
11742400,1sleep21142-21sshd12:18:492
9322360,0sleep10-21swapper/112:02:391
214982350,0sleep10-21swapper/110:38:031
251792340,0sleep225164-21bash11:34:072
238242297,7sleep30-21swapper/307:06:543
238942287,7sleep00-21swapper/007:07:470
237632288,7sleep10-21swapper/107:06:081
59652250,0sleep10-21swapper/112:22:281
99162220,0sleep20-21swapper/212:36:082
2374422210,7sleep20-21swapper/207:05:532
92182200,0sleep10-21swapper/110:33:191
40162200,1sleep24018-21bash12:28:512
217782190,0sleep20-21swapper/210:41:292
130512170,1sleep113018-21sshd10:54:291
295582160,0sleep20-21swapper/211:03:032
24192991615,0cyclictest4538-21kworker/1:011:35:021
56002150,1sleep35594-21bash11:42:133
320032150,0sleep0111rcuc/010:46:040
281042150,0sleep20-21swapper/212:31:302
249722150,0sleep30-21swapper/310:21:143
176412150,1sleep317637-21lspci12:10:423
100472150,0sleep00-21swapper/011:14:590
43662140,0sleep00-21swapper/010:00:450
326502140,0sleep30-21swapper/309:23:233
256712140,0sleep20-21swapper/210:03:112
127992140,0sleep30-21swapper/312:00:273
109892140,0sleep00-21swapper/010:54:160
2420599138,4cyclictest15983-21wc12:40:013
2420599130,1cyclictest29236-21sshd10:42:183
2420599130,1cyclictest1436-21sshd12:25:183
2420599130,12cyclictest18624-21bash10:27:273
2420599130,10cyclictest0-21swapper/311:54:173
24198991311,1cyclictest19909-21lspci09:14:292
24192991311,1cyclictest17702-21kworker/1:111:00:411
2419299130,1cyclictest15469-21sshd09:14:011
24185991311,1cyclictest21015-21bash10:34:330
237372130,0sleep00-21swapper/012:14:460
154092130,0sleep2321ktimersoftd/211:26:022
6252120,0sleep00-21swapper/010:56:320
5502120,0sleep0548-21grep11:52:200
2420599129,2cyclictest0-21swapper/312:32:073
2420599129,2cyclictest0-21swapper/310:00:483
2420599128,3cyclictest0-21swapper/311:56:083
2420599128,3cyclictest0-21swapper/310:54:073
24205991210,1cyclictest22894-21grep11:05:483
24198991211,0cyclictest0-21swapper/210:10:092
24198991210,1cyclictest28079-21sshd10:28:292
2419899120,11cyclictest0-21swapper/209:39:092
24192991211,0cyclictest4538-21kworker/1:011:23:141
24192991211,0cyclictest0-21swapper/112:37:411
24192991210,1cyclictest7127-21lspci10:08:281
24192991210,1cyclictest22326-21lspci10:55:221
2419299120,1cyclictest10327-21grep12:16:321
2419299120,11cyclictest0-21swapper/111:51:111
2418599120,1cyclictest24073-21sshd10:24:430
2418599120,11cyclictest2688-21lspci09:42:130
2418599120,11cyclictest0-21swapper/009:15:030
36072110,2sleep12419299cyclictest09:38:391
2420599117,3cyclictest0-21swapper/309:43:073
2420599115,5cyclictest649-21avahi-daemon11:26:473
2420599115,5cyclictest649-21avahi-daemon09:57:183
2420599114,6cyclictest646-21dbus-daemon10:33:163
2420599114,6cyclictest1344-21sshd11:24:363
2420599114,2cyclictest649-21avahi-daemon11:11:353
2420599114,1cyclictest25826-21sshd09:52:213
2420599113,7cyclictest3955-21sshd10:46:313
24205991110,0cyclictest0-21swapper/312:20:173
2420599110,0cyclictest0-21swapper/309:34:573
2420599110,0cyclictest0-21swapper/309:29:583
24198991110,0cyclictest0-21swapper/211:41:502
24198991110,0cyclictest0-21swapper/211:06:502
24198991110,0cyclictest0-21swapper/207:20:202
2419899110,10cyclictest0-21swapper/212:21:202
2419899110,0cyclictest0-21swapper/209:15:092
2419299119,1cyclictest23045-21kworker/1:009:25:221
2419299119,1cyclictest23045-21kworker/1:009:19:501
24192991110,0cyclictest0-21swapper/111:18:011
24192991110,0cyclictest0-21swapper/110:47:521
24192991110,0cyclictest0-21swapper/110:18:021
2419299110,10cyclictest0-21swapper/112:14:011
2419299110,0cyclictest0-21swapper/109:31:111
2419299110,0cyclictest0-21swapper/108:55:211
2418599119,1cyclictest29929-21bash11:38:030
24185991110,0cyclictest12180-21lspci11:08:080
24185991110,0cyclictest0-21swapper/012:16:530
2418599110,10cyclictest0-21swapper/011:20:120
2418599110,10cyclictest0-21swapper/010:26:320
2418599110,10cyclictest0-21swapper/007:55:220
111672110,0sleep011171-21bash12:26:170
2420599104,5cyclictest646-21dbus-daemon09:46:433
2420599104,5cyclictest32348-21sshd09:19:353
2420599104,5cyclictest25517-21sshd12:08:233
2420599104,5cyclictest1742-21sshd10:15:033
2420599104,5cyclictest14076-21sshd11:04:583
2420599104,5cyclictest13620-21sshd11:15:163
2420599103,1cyclictest1-21systemd11:45:093
2420599102,2cyclictest443-21systemd-journal10:55:533
2419899109,0cyclictest0-21swapper/209:47:592
2419899109,0cyclictest0-21swapper/208:31:492
2419899100,0cyclictest0-21swapper/210:34:402
2419299109,0cyclictest0-21swapper/111:26:011
2419299109,0cyclictest0-21swapper/110:22:311
2419299100,0cyclictest0-21swapper/109:41:521
2419299100,0cyclictest0-21swapper/107:25:211
2419299100,0cyclictest0-21swapper/107:10:211
2418599109,0cyclictest0-21swapper/011:32:320
2418599109,0cyclictest0-21swapper/009:53:320
2418599109,0cyclictest0-21swapper/009:39:020
2418599108,1cyclictest0-21swapper/010:06:130
2418599107,2cyclictest32715-21sshd09:45:280
2418599100,1cyclictest21470-21ps09:55:180
2418599100,0cyclictest0-21swapper/012:31:120
242059993,1cyclictest8544-21sshd09:06:113
242059993,1cyclictest3410-21cat08:55:143
242059993,1cyclictest17299-21snmpd08:15:503
242059993,1cyclictest17299-21snmpd08:06:103
242059992,2cyclictest646-21dbus-daemon10:05:153
242059992,2cyclictest646-21dbus-daemon08:40:003
242059992,2cyclictest4554-21sleep07:40:013
241989998,0cyclictest0-21swapper/211:10:312
241989998,0cyclictest0-21swapper/210:06:202
241989998,0cyclictest0-21swapper/207:33:492
241929998,0cyclictest30788-21lspci09:23:101
241929998,0cyclictest22861-21kworker/1:111:14:341
241859998,0cyclictest0-21swapper/011:41:420
241859998,0cyclictest0-21swapper/011:28:130
241859998,0cyclictest0-21swapper/010:10:020
241859998,0cyclictest0-21swapper/007:30:220
241859997,1cyclictest6740-21grep12:03:130
1198290,2sleep2321ktimersoftd/212:12:212
242059983,1cyclictest17299-21snmpd08:45:393
242059983,1cyclictest17299-21snmpd08:33:033
242059983,1cyclictest17299-21snmpd08:29:093
242059983,1cyclictest17299-21snmpd08:29:083
242059983,1cyclictest17299-21snmpd07:15:123
242059983,1cyclictest17299-21snmpd07:14:343
242059982,2cyclictest8376-21taskset07:47:313
242059982,2cyclictest30189-21gzip08:40:203
242059982,1cyclictest4848-21grep07:40:113
242059982,1cyclictest17299-21snmpd08:12:183
242059982,1cyclictest17299-21snmpd07:25:123
242059982,1cyclictest11160-21grep07:55:133
242059982,1cyclictest1026-21expr07:30:133
242059982,1cyclictest10038-21sed07:50:203
241989987,0cyclictest0-21swapper/208:53:492
241989987,0cyclictest0-21swapper/207:52:492
241989987,0cyclictest0-21swapper/207:28:492
241989986,1cyclictest4723-21lspci11:45:312
241989986,1cyclictest12618-21lspci11:18:442
241989985,2cyclictest13070-21sshd12:00:302
241989983,1cyclictest48-21kauditd09:21:242
241929986,1cyclictest30613-21lspci12:25:031
241929986,1cyclictest25-21ksoftirqd/111:41:461
241929986,1cyclictest25-21ksoftirqd/111:31:041
241929986,1cyclictest25-21ksoftirqd/110:10:491
241929985,2cyclictest649-21avahi-daemon11:05:301
241929985,2cyclictest649-21avahi-daemon09:51:241
241859987,0cyclictest0-21swapper/010:43:120
241859985,2cyclictest649-21avahi-daemon12:22:010
241859985,2cyclictest649-21avahi-daemon11:56:040
241859985,2cyclictest649-21avahi-daemon09:27:410
241859983,4cyclictest26166-21munin-run07:15:010
16721280,1sleep016857-21id10:16:400
12695280,0sleep0101ktimersoftd/011:01:140
242059972,1cyclictest1936-21sensors08:50:173
242059972,1cyclictest17299-21snmpd08:01:203
242059970,1cyclictest21198-21cat08:20:133
241989976,0cyclictest0-21swapper/207:18:492
241989975,1cyclictest8750-21lspci10:50:232
241989975,1cyclictest649-21avahi-daemon10:55:212
241989975,1cyclictest26196-21lspci09:41:162
241989974,1cyclictest32093-21sshd10:35:352
241989974,1cyclictest17887-21sshd09:32:442
241989973,3cyclictest443-21systemd-journal11:50:122
241989972,2cyclictest19036-21sshd09:55:062
241929976,0cyclictest0-21swapper/112:32:411
241929975,1cyclictest25-21ksoftirqd/112:07:361
241929975,1cyclictest25-21ksoftirqd/110:01:051
241929974,2cyclictest649-21avahi-daemon11:55:171
241859975,1cyclictest9-21ksoftirqd/012:36:250
241859974,2cyclictest649-21avahi-daemon09:34:580
241859971,0cyclictest121rcu_preempt11:16:530
242059961,1cyclictest17299-21snmpd09:00:133
241989964,1cyclictest9601-21sshd09:06:372
241989963,2cyclictest17299-21snmpd08:17:022
241989960,0cyclictest0-21swapper/207:35:302
241929964,1cyclictest13237-21grep08:00:141
241929963,2cyclictest700-21gdbus09:07:581
241929963,2cyclictest17299-21snmpd08:11:171
241929960,5cyclictest0-21swapper/108:09:101
241859965,0cyclictest0-21swapper/007:52:530
241859964,1cyclictest646-21dbus-daemon10:35:000
241859964,1cyclictest646-21dbus-daemon09:06:310
241859963,2cyclictest649-21avahi-daemon12:05:200
241859960,5cyclictest0-21swapper/008:24:520
6177250,3sleep00-21swapper/007:40:220
242059950,2cyclictest648-21systemd-logind07:25:013
241989954,0cyclictest0-21swapper/208:44:592
241989953,1cyclictest682-21lsmd08:02:282
241989953,1cyclictest5422-21mii-tool09:00:132
241989953,1cyclictest17299-21snmpd08:26:272
241989953,1cyclictest17299-21snmpd08:26:262
241989953,1cyclictest17299-21snmpd08:23:322
241989953,1cyclictest17299-21snmpd08:12:112
241989953,1cyclictest17299-21snmpd07:56:462
241989953,1cyclictest17299-21snmpd07:47:232
241989953,1cyclictest1058-21sendmail08:05:342
241989951,1cyclictest0-21swapper/208:49:142
241989950,4cyclictest27136-21/usr/sbin/munin08:35:132
241989950,1cyclictest2916-21/usr/sbin/munin08:55:152
241929953,1cyclictest5438-21cat09:00:131
241929953,1cyclictest24691-21sshd08:27:581
241929953,1cyclictest24691-21sshd08:27:571
241929953,1cyclictest24122-21kworker/1:008:35:161
241929953,1cyclictest17299-21snmpd08:50:301
241929953,1cyclictest17299-21snmpd08:40:591
241929953,1cyclictest17299-21snmpd07:56:311
241929953,1cyclictest17299-21snmpd07:54:501
241929953,1cyclictest17299-21snmpd07:40:071
241929953,1cyclictest17299-21snmpd07:36:011
241929953,1cyclictest17299-21snmpd07:30:151
241929953,1cyclictest17299-21snmpd07:22:151
241929953,1cyclictest17299-21snmpd07:15:151
241929953,1cyclictest1058-21sendmail08:31:021
241929953,1cyclictest1049-21rpcbind08:21:301
241929952,2cyclictest19707-21cut08:15:161
241859953,1cyclictest682-21lsmd07:16:540
241859953,1cyclictest649-21avahi-daemon07:45:140
241859953,1cyclictest3370-21cat08:55:140
241859953,1cyclictest31557-21cut08:45:130
241859953,1cyclictest23556-21cat08:25:140
241859953,1cyclictest23556-21cat08:25:140
241859953,1cyclictest17299-21snmpd08:51:250
241859953,1cyclictest17299-21snmpd08:42:260
241859953,1cyclictest17299-21snmpd08:16:540
241859953,1cyclictest17299-21snmpd08:05:190
241859953,1cyclictest17299-21snmpd07:35:390
241859953,1cyclictest17299-21snmpd07:27:460
241859953,1cyclictest13389-21cat08:00:140
241859953,1cyclictest1109-21ntpd09:00:150
241859953,1cyclictest1053-21lldpd08:35:180
241859953,1cyclictest1053-21lldpd08:14:500
241859950,0cyclictest0-21swapper/007:20:520
241989942,1cyclictest24531-21cstates07:10:142
241989942,1cyclictest0-21swapper/207:40:122
241929942,1cyclictest6884-21tr07:45:121
241929942,1cyclictest0-21swapper/108:45:121
241859942,1cyclictest25257-21tr08:30:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional