You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 19:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Sun Nov 23, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1462021070,2sleep32079799cyclictest11:00:173
50102910,0sleep05011-21sshd11:10:000
51732710,0sleep00-21swapper/011:02:460
175422650,0sleep30-21swapper/312:39:223
323292620,1sleep332326-21bash10:48:153
223632620,0sleep10-21swapper/111:32:361
313012590,0sleep10-21swapper/110:13:531
158282570,0sleep20-21swapper/209:58:122
307002560,0sleep20-21swapper/211:40:132
199812560,0sleep20-21swapper/211:18:302
164832560,0sleep116481-21bash10:39:481
78292550,0sleep20-21swapper/212:38:202
193432550,0sleep20-21swapper/212:23:102
35172540,0sleep10-21swapper/110:31:271
116052540,0sleep20-21swapper/212:25:352
289232530,1sleep2311rcuc/209:23:122
134332530,0sleep10-21swapper/109:17:581
117552530,2sleep32079799cyclictest11:59:133
227252520,0sleep2311rcuc/209:26:122
88082510,0sleep10-21swapper/111:41:161
301272500,0sleep30-21swapper/310:55:043
248932500,0sleep10-21swapper/111:46:221
286672490,0sleep00-21swapper/010:13:360
285862490,0sleep10-21swapper/110:40:571
2046024937,7sleep20-21swapper/207:07:182
2046024937,7sleep20-21swapper/207:07:182
210512480,0sleep30-21swapper/310:02:093
63082470,2sleep02078499cyclictest10:25:010
158542460,0sleep00-21swapper/011:42:030
132042460,0sleep20-21swapper/211:00:122
295762430,1sleep129577-21sshd10:20:381
294322400,1sleep129423-21lspci10:06:441
180572360,2sleep12078999cyclictest12:06:361
180572360,2sleep12078999cyclictest12:06:351
204462298,7sleep30-21swapper/307:07:073
204462298,7sleep30-21swapper/307:07:073
205772286,7sleep10-21swapper/107:08:461
205772286,7sleep10-21swapper/107:08:451
203102267,7sleep00-21swapper/007:05:250
203102267,7sleep00-21swapper/007:05:240
185802200,1sleep318578-21lspci09:18:323
302752170,0sleep10-21swapper/111:54:061
27072170,0sleep10-21swapper/111:13:081
264322170,0sleep3401ktimersoftd/311:26:003
218092170,1sleep2311rcuc/212:33:092
296272160,0sleep229630-21bash10:58:272
162862160,0sleep20-21swapper/210:08:572
128752160,2sleep02078499cyclictest10:53:130
56212150,0sleep30-21swapper/312:18:363
238442150,0sleep00-21swapper/012:20:200
242362140,1sleep224147-21sshd12:13:532
21692140,0sleep0111rcuc/011:54:330
47072130,0sleep30-21swapper/311:06:213
2079799130,1cyclictest0-21swapper/311:41:233
265192120,0sleep326523-21sendmail_mailqu10:20:203
20797991210,1cyclictest9976-21sshd11:34:433
20797991210,1cyclictest1863-21lspci09:56:433
20797991210,1cyclictest14352-21cp12:25:533
2079799120,1cyclictest21693-21grep09:37:133
2079799120,11cyclictest23555-21grepconf.sh10:54:243
20796991210,1cyclictest14884-21sshd10:53:272
2079699120,1cyclictest8518-21grepconf.sh09:07:572
2079699120,1cyclictest12914-21bash10:25:372
2079699120,1cyclictest0-21swapper/211:49:232
2079699120,11cyclictest20041-21sshd10:46:562
2079699120,11cyclictest0-21swapper/209:36:562
20789991210,1cyclictest25314-21grepconf.sh12:14:001
20789991210,1cyclictest18559-21sshd09:58:291
20789991210,1cyclictest11115-21lspci11:27:501
2078499129,2cyclictest29281-21sshd10:06:430
2078499120,11cyclictest13186-21sshd11:28:030
20797991110,0cyclictest0-21swapper/310:29:433
2079799110,10cyclictest0-21swapper/312:21:433
2079799110,10cyclictest0-21swapper/312:06:533
2079799110,10cyclictest0-21swapper/312:06:533
2079799110,10cyclictest0-21swapper/311:46:433
2079799110,10cyclictest0-21swapper/310:15:333
2079799110,0cyclictest0-21swapper/311:38:433
2079799110,0cyclictest0-21swapper/309:44:133
2079699119,1cyclictest19302-21bash10:15:562
20796991110,0cyclictest0-21swapper/211:10:262
20796991110,0cyclictest0-21swapper/210:39:462
20796991110,0cyclictest0-21swapper/210:00:262
20796991110,0cyclictest0-21swapper/209:45:172
2079699110,0cyclictest0-21swapper/212:01:462
2079699110,0cyclictest0-21swapper/211:07:162
2079699110,0cyclictest0-21swapper/210:21:462
2078999119,1cyclictest646-21dbus-daemon10:00:301
20789991110,0cyclictest0-21swapper/110:29:301
2078499119,1cyclictest12563-21sshd10:39:230
20784991110,0cyclictest0-21swapper/011:22:540
20784991110,0cyclictest0-21swapper/010:17:340
2078499110,10cyclictest0-21swapper/009:28:330
2078499110,0cyclictest0-21swapper/010:47:130
2079799109,0cyclictest75550irq/24-eno1-rx-10:40:433
2079699109,0cyclictest0-21swapper/210:33:562
2079699109,0cyclictest0-21swapper/209:41:162
2079699109,0cyclictest0-21swapper/209:32:362
2079699100,0cyclictest0-21swapper/207:28:252
2078999109,0cyclictest0-21swapper/109:30:291
2078999109,0cyclictest0-21swapper/109:08:391
2078999108,1cyclictest0-21swapper/112:36:001
2078999100,9cyclictest555-21lspci10:48:201
2078999100,0cyclictest0-21swapper/112:27:001
2078999100,0cyclictest0-21swapper/110:56:401
2078499109,0cyclictest0-21swapper/012:12:130
2078499109,0cyclictest0-21swapper/011:11:230
2078499109,0cyclictest0-21swapper/010:24:330
2078499109,0cyclictest0-21swapper/009:35:430
2078499109,0cyclictest0-21swapper/009:00:130
2078499109,0cyclictest0-21swapper/007:25:020
2078499100,0cyclictest0-21swapper/012:30:430
2078499100,0cyclictest0-21swapper/009:53:230
164792100,1sleep116477-21sshd10:50:051
135562100,0sleep10-21swapper/109:47:181
207979998,0cyclictest0-21swapper/311:20:363
207979998,0cyclictest0-21swapper/311:12:033
207979998,0cyclictest0-21swapper/309:22:533
207979996,2cyclictest1491-21sshd09:45:523
207969998,0cyclictest0-21swapper/211:25:062
207899998,0cyclictest0-21swapper/111:18:501
207899998,0cyclictest0-21swapper/110:15:591
207899990,8cyclictest10759-21sshd12:32:011
207849997,1cyclictest1011-21sshd10:33:330
207849997,1cyclictest0-21swapper/009:33:330
207849995,3cyclictest2523-21kworker/0:012:16:580
9606280,1sleep3391rcuc/310:35:343
207979986,1cyclictest646-21dbus-daemon09:30:443
207979986,1cyclictest23484-21lspci09:26:173
207969987,0cyclictest0-21swapper/209:16:162
207969987,0cyclictest0-21swapper/208:28:362
207969986,1cyclictest3354-21bash11:58:052
207969985,2cyclictest649-21avahi-daemon10:10:562
207969984,3cyclictest649-21avahi-daemon12:18:452
207969984,3cyclictest649-21avahi-daemon09:13:232
207969984,3cyclictest646-21dbus-daemon11:31:032
207969983,2cyclictest13082-21sshd12:09:312
207969983,2cyclictest13082-21sshd12:09:312
207969982,3cyclictest17396-21sadc08:20:002
207969982,2cyclictest1034-21in:imjournal09:53:192
207899987,0cyclictest0-21swapper/112:15:201
207899987,0cyclictest0-21swapper/108:49:191
207899986,1cyclictest27820-21lspci09:23:031
207899986,1cyclictest27005-21lspci11:22:401
207899985,2cyclictest649-21avahi-daemon12:22:521
207899985,2cyclictest649-21avahi-daemon11:57:491
207899985,2cyclictest649-21avahi-daemon11:35:201
207899985,2cyclictest649-21avahi-daemon09:44:321
207899984,2cyclictest649-21avahi-daemon11:06:331
207849987,0cyclictest0-21swapper/010:56:130
207849987,0cyclictest0-21swapper/009:40:030
207849987,0cyclictest0-21swapper/009:10:130
207849987,0cyclictest0-21swapper/008:00:220
207849987,0cyclictest0-21swapper/007:35:220
207849986,1cyclictest6546-21sshd09:57:120
207849986,1cyclictest22071-21lspci11:39:210
207849985,2cyclictest649-21avahi-daemon12:28:200
207849985,2cyclictest649-21avahi-daemon11:49:420
207849985,2cyclictest649-21avahi-daemon09:18:240
207849985,2cyclictest16871-21sshd12:35:540
207849980,4cyclictest10857-21munin-run09:25:000
207979976,0cyclictest0-21swapper/309:09:343
207979975,1cyclictest700-21gdbus12:10:413
207979975,1cyclictest649-21avahi-daemon11:17:163
207979975,1cyclictest649-21avahi-daemon10:33:193
207979975,1cyclictest32532-21lspci12:01:233
207979975,1cyclictest12006-21lspci10:11:513
207979974,2cyclictest7598-21sshd12:31:413
207979974,2cyclictest5949-21sshd11:51:213
207979974,2cyclictest18980-21sshd10:05:343
207979974,2cyclictest13622-21sshd09:10:013
207979973,3cyclictest616-17auditd09:50:163
207969975,1cyclictest649-21avahi-daemon10:41:212
207969975,1cyclictest616-17auditd11:51:092
207969975,1cyclictest27028-21bash11:22:402
207969974,2cyclictest700-21gdbus11:35:182
207899976,0cyclictest0-21swapper/111:04:501
207899976,0cyclictest0-21swapper/109:25:291
207899975,1cyclictest25-21ksoftirqd/109:50:111
207899975,1cyclictest24471-21lspci09:11:291
207899974,2cyclictest20395-21sshd09:37:021
207849976,0cyclictest0-21swapper/008:35:220
207849975,2cyclictest21549-21kworker/0:112:01:460
207849975,1cyclictest3860-21bash12:08:300
207849975,1cyclictest3860-21bash12:08:300
207849975,1cyclictest11058-21lspci11:31:160
207849974,2cyclictest649-21avahi-daemon09:48:200
207849974,2cyclictest646-21dbus-daemon10:03:020
207849970,6cyclictest29420-21sshd11:15:570
207849970,6cyclictest15663-21sshd11:55:550
32184260,0sleep30-21swapper/307:35:153
24159260,4sleep10-21swapper/108:35:141
207979965,0cyclictest0-21swapper/308:40:133
207979965,0cyclictest0-21swapper/308:10:033
207979963,2cyclictest17299-21snmpd08:25:233
207969965,0cyclictest0-21swapper/208:54:562
207969965,0cyclictest0-21swapper/208:49:562
207969965,0cyclictest0-21swapper/208:04:162
207969964,1cyclictest646-21dbus-daemon08:14:592
207969964,1cyclictest18045-21grep08:20:152
207969960,5cyclictest0-21swapper/208:59:162
207899965,0cyclictest0-21swapper/107:48:491
207899964,1cyclictest700-21gdbus08:35:001
207899964,1cyclictest19326-21lspci12:00:011
207899960,5cyclictest0-21swapper/107:51:401
207899960,0cyclictest0-21swapper/108:02:591
207849965,0cyclictest0-21swapper/008:15:120
207849964,1cyclictest646-21dbus-daemon10:40:180
207849964,1cyclictest27084-21grep08:40:200
207849964,1cyclictest17299-21snmpd08:48:020
207849963,2cyclictest5582-21sshd09:06:370
207849963,2cyclictest22065-21gltestperf08:30:140
207849963,2cyclictest17299-21snmpd08:55:090
207849960,5cyclictest0-21swapper/007:21:220
207979954,0cyclictest0-21swapper/308:15:033
207979953,1cyclictest8300-21ntpq07:55:183
207979953,1cyclictest682-21lsmd08:55:023
207979953,1cyclictest30177-21gltestperf08:50:123
207979953,1cyclictest28109-21cat07:25:133
207979953,1cyclictest2047-21cat09:00:143
207979953,1cyclictest1865-21cat07:40:153
207979953,1cyclictest17299-21snmpd08:45:083
207979953,1cyclictest17299-21snmpd08:30:043
207979953,1cyclictest17299-21snmpd08:22:253
207979953,1cyclictest17299-21snmpd08:07:223
207979953,1cyclictest17299-21snmpd08:01:583
207979953,1cyclictest17299-21snmpd07:50:243
207979953,1cyclictest17299-21snmpd07:49:513
207979953,1cyclictest17299-21snmpd07:20:293
207979952,2cyclictest29987-21gltestperf07:30:123
207979950,2cyclictest23687-21cut07:15:123
207979950,1cyclictest24457-21nfsd408:35:153
207969953,1cyclictest23556-21/usr/sbin/munin07:15:132
207969953,1cyclictest17299-21snmpd08:40:562
207969953,1cyclictest17299-21snmpd07:51:072
207969953,1cyclictest17299-21snmpd07:40:332
207969953,1cyclictest17299-21snmpd07:20:562
207969953,1cyclictest17299-21snmpd07:10:362
207969953,1cyclictest1058-21sendmail07:46:432
207969952,2cyclictest1109-21ntpd07:35:152
207969952,2cyclictest0-21swapper/207:56:492
207969950,4cyclictest30536-21ntp_states07:30:262
207969950,1cyclictest1557-21/usr/sbin/munin09:00:182
207899954,0cyclictest0-21swapper/107:24:191
207899953,1cyclictest8311-21ntpdc07:55:181
207899953,1cyclictest30144-21cat07:30:131
207899953,1cyclictest20679-21kworker/1:108:10:131
207899953,1cyclictest17299-21snmpd09:00:051
207899953,1cyclictest17299-21snmpd08:51:261
207899953,1cyclictest17299-21snmpd08:41:341
207899953,1cyclictest17299-21snmpd08:25:461
207899953,1cyclictest17299-21snmpd08:23:101
207899953,1cyclictest17299-21snmpd08:06:461
207899953,1cyclictest17299-21snmpd07:37:301
207899953,1cyclictest17299-21snmpd07:25:181
207899953,1cyclictest17299-21snmpd07:17:291
207899953,1cyclictest1109-21ntpd07:40:181
207899952,2cyclictest17299-21snmpd08:16:501
207849953,1cyclictest17299-21snmpd08:26:400
207849953,1cyclictest17299-21snmpd08:20:340
207849953,1cyclictest17299-21snmpd08:10:190
207849953,1cyclictest17299-21snmpd07:55:180
207849953,1cyclictest17299-21snmpd07:54:150
207849953,1cyclictest17299-21snmpd07:46:480
207849953,1cyclictest17299-21snmpd07:42:160
207849953,1cyclictest17299-21snmpd07:31:090
207849953,1cyclictest17299-21snmpd07:15:080
207849953,1cyclictest17299-21snmpd07:13:500
207849952,2cyclictest12556-21gzip08:05:170
207849950,0cyclictest0-21swapper/008:50:530
207979942,1cyclictest21282-21gltestperf07:10:143
207969942,1cyclictest23855-21grep08:35:112
207969942,1cyclictest22322-21cat08:30:142
207969942,1cyclictest0-21swapper/208:05:112
207899942,1cyclictest31940-21cpuspeed_turbos08:55:131
207899942,1cyclictest0-21swapper/107:10:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional