You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 02:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Mon Nov 24, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1625721050,0sleep20-21swapper/222:33:332
205892980,0sleep00-21swapper/023:47:320
117662980,0sleep211767-21sshd21:19:362
117662980,0sleep211767-21sshd21:19:352
167492910,1sleep216744-21lspci21:39:212
196602830,2sleep02905099cyclictest00:03:260
143902780,1sleep014389-21bash22:20:340
198362610,1sleep319838-21bash00:29:283
5392600,1sleep1616-17auditd21:56:511
168442600,0sleep316841-21sshd21:48:563
106462590,0sleep10-21swapper/121:41:541
184402560,0sleep20-21swapper/200:29:192
298052550,0sleep20-21swapper/223:13:212
258812550,1sleep125883-21sshd23:25:421
272312540,0sleep20-21swapper/221:40:182
188082540,0sleep20-21swapper/221:23:272
35882530,1sleep0101ktimersoftd/022:25:490
282042530,0sleep30-21swapper/319:05:183
277282530,0sleep20-21swapper/221:27:322
248392530,0sleep00-21swapper/021:33:440
132102530,1sleep3121rcu_preempt00:35:213
232942520,1sleep1241ktimersoftd/123:38:131
218072520,2sleep32906999cyclictest22:40:223
152302520,2sleep32906999cyclictest22:04:463
46422510,0sleep14644-21bash23:10:491
272562500,0sleep30-21swapper/320:20:213
184042500,0sleep218396-21bash23:28:112
310032480,0sleep30-21swapper/322:47:433
22042480,0sleep30-21swapper/323:20:163
153132470,0sleep20-21swapper/221:32:442
263632460,0sleep00-21swapper/023:38:320
162012460,0sleep016193-21sshd21:16:440
162012460,0sleep016193-21sshd21:16:440
52532450,0sleep30-21swapper/323:52:233
85642360,0sleep20-21swapper/223:01:362
2860622716,7sleep10-21swapper/119:05:371
285772229,7sleep20-21swapper/219:05:222
154832220,0sleep10-21swapper/122:07:561
2892222110,7sleep00-21swapper/019:09:360
16312190,0sleep20-21swapper/200:24:162
230542170,0sleep20-21swapper/221:52:432
29062991615,0cyclictest21090-21lspci23:31:342
57242150,1sleep00-21swapper/023:14:130
52222150,1sleep25220-21lspci22:54:552
253702150,1sleep30-21swapper/323:41:353
253702150,1sleep30-21swapper/323:41:343
196612150,0sleep00-21swapper/021:20:170
156162150,0sleep015605-21sshd23:24:490
77342140,0sleep10-21swapper/100:05:231
46222140,0sleep00-21swapper/021:44:320
318342140,0sleep30-21swapper/322:06:183
29062991413,0cyclictest30643-21lspci22:09:292
29062991413,0cyclictest20782-21lspci00:16:172
161122140,0sleep0111rcuc/022:46:130
148602140,0sleep10-21swapper/122:17:251
67002130,0sleep10-21swapper/121:22:141
45622130,1sleep14558-21lspci23:45:531
317952130,0sleep00-21swapper/023:32:380
309062130,0sleep00-21swapper/021:47:040
2906999130,1cyclictest7618-21bash23:46:123
29062991312,0cyclictest29085-21lspci00:01:072
29057991311,1cyclictest32112-21lspci21:53:381
2905799130,1cyclictest1676-21sshd22:38:281
188432130,0sleep00-21swapper/022:01:500
29069991210,1cyclictest443-21systemd-journal23:16:123
2906999120,1cyclictest0-21swapper/322:56:233
2906299120,11cyclictest0-21swapper/221:58:092
29057991210,1cyclictest684-21polkitd00:03:081
29057991210,1cyclictest24443-21lspci22:11:581
29057991210,1cyclictest0-21swapper/122:20:591
2905799120,11cyclictest0-21swapper/122:00:481
29050991211,0cyclictest0-21swapper/000:05:020
29050991210,1cyclictest700-21gdbus22:31:320
2905099120,1cyclictest25629-21rm22:44:020
2905099120,1cyclictest11649-21sshd23:27:320
2905099120,11cyclictest16635-21sshd23:56:430
2906999119,1cyclictest21345-21lspci22:50:023
29069991110,0cyclictest0-21swapper/323:06:323
29069991110,0cyclictest0-21swapper/321:38:123
2906999110,10cyclictest0-21swapper/322:37:323
2906999110,0cyclictest0-21swapper/321:57:123
2906299118,1cyclictest33-21ksoftirqd/221:14:322
29062991110,0cyclictest23005-21lspci23:54:122
29062991110,0cyclictest0-21swapper/222:18:292
2906299110,0cyclictest0-21swapper/223:17:092
29057991110,0cyclictest0-21swapper/123:54:481
29057991110,0cyclictest0-21swapper/121:39:581
2905799110,10cyclictest0-21swapper/123:24:581
2905799110,10cyclictest0-21swapper/122:57:181
2905799110,10cyclictest0-21swapper/121:13:481
2905099119,1cyclictest619-17sedispatch23:52:120
29050991110,0cyclictest0-21swapper/022:17:120
29050991110,0cyclictest0-21swapper/021:12:220
29050991110,0cyclictest0-21swapper/019:45:210
2905099110,10cyclictest0-21swapper/022:39:020
123142110,1sleep112301-21sshd00:21:581
2906999109,0cyclictest0-21swapper/323:37:423
2906999109,0cyclictest0-21swapper/321:50:433
2906999109,0cyclictest0-21swapper/300:06:433
2906999100,0cyclictest0-21swapper/323:29:523
2906999100,0cyclictest0-21swapper/322:22:323
2906999100,0cyclictest0-21swapper/321:24:223
2906999100,0cyclictest0-21swapper/321:18:133
2906999100,0cyclictest0-21swapper/321:18:123
2906299109,0cyclictest0-21swapper/200:37:592
2906299109,0cyclictest0-21swapper/200:11:292
2906299108,1cyclictest33-21ksoftirqd/223:08:462
2906299108,1cyclictest33-21ksoftirqd/222:43:442
2906299108,1cyclictest21225-21lspci23:37:592
2906299107,1cyclictest33-21ksoftirqd/223:24:392
2906299100,0cyclictest0-21swapper/221:47:092
2906299100,0cyclictest0-21swapper/200:32:502
2905799109,0cyclictest0-21swapper/123:40:381
2905799109,0cyclictest0-21swapper/123:40:381
2905799109,0cyclictest0-21swapper/123:00:281
2905799109,0cyclictest0-21swapper/122:33:291
2905799109,0cyclictest0-21swapper/121:27:281
2905799109,0cyclictest0-21swapper/100:37:591
2905799108,1cyclictest26814-21grep23:32:081
2905799100,0cyclictest0-21swapper/100:17:191
2905099109,0cyclictest0-21swapper/023:43:520
2905099109,0cyclictest0-21swapper/023:43:520
2905099109,0cyclictest0-21swapper/021:35:420
3532290,1sleep03516-21sshd22:06:430
290699998,0cyclictest0-21swapper/321:29:523
290629998,0cyclictest29268-21bash23:58:002
290629998,0cyclictest19086-21lspci22:46:312
290629997,1cyclictest33-21ksoftirqd/223:47:522
290629997,1cyclictest33-21ksoftirqd/223:42:102
290629997,1cyclictest33-21ksoftirqd/223:42:092
290629997,1cyclictest33-21ksoftirqd/222:55:162
290629997,1cyclictest33-21ksoftirqd/222:20:032
290629997,1cyclictest33-21ksoftirqd/222:10:162
290629997,1cyclictest27566-21lspci22:37:492
290629990,1cyclictest33-21ksoftirqd/222:00:232
290579999,0cyclictest0-21swapper/119:19:591
290579998,0cyclictest0-21swapper/120:30:191
290579998,0cyclictest0-21swapper/120:15:181
290579998,0cyclictest0-21swapper/100:12:091
290579997,1cyclictest28567-21lspci00:26:591
290509998,0cyclictest1095-21nfsd00:25:020
290509998,0cyclictest0-21swapper/023:19:420
290509998,0cyclictest0-21swapper/000:30:520
1493290,0sleep10-21swapper/123:58:271
290699987,0cyclictest0-21swapper/323:02:423
290699987,0cyclictest0-21swapper/300:02:123
290699986,1cyclictest4573-21sshd23:55:283
290699986,1cyclictest4347-21lspci00:24:323
290699986,1cyclictest21989-21lspci22:34:073
290699986,1cyclictest18717-21sshd21:13:443
290629986,1cyclictest33-21ksoftirqd/222:25:052
290629985,2cyclictest649-21avahi-daemon00:06:162
290579987,0cyclictest0-21swapper/123:17:481
290579987,0cyclictest0-21swapper/121:32:191
290579987,0cyclictest0-21swapper/119:23:581
290579986,1cyclictest24315-21lspci22:40:381
290579986,1cyclictest13711-21kworker/1:221:15:171
290579986,1cyclictest13711-21kworker/1:221:15:171
290509987,0cyclictest0-21swapper/023:08:420
290509986,1cyclictest684-21polkitd21:54:300
290509986,1cyclictest29367-21lspci22:57:160
290509985,2cyclictest649-21avahi-daemon22:52:330
290509985,2cyclictest649-21avahi-daemon21:56:310
290509985,2cyclictest649-21avahi-daemon00:23:180
290699976,0cyclictest0-21swapper/321:06:433
290699976,0cyclictest0-21swapper/300:11:123
290699975,1cyclictest649-21avahi-daemon23:33:513
290699975,1cyclictest29141-21sshd22:15:353
290699975,1cyclictest15053-21bash00:32:163
290699975,1cyclictest1407-21sshd21:31:183
290699974,2cyclictest649-21avahi-daemon22:27:413
290699974,2cyclictest648-21systemd-logind21:44:283
290699973,3cyclictest649-21avahi-daemon22:10:573
290699972,4cyclictest370-21jbd2/sda1-800:17:563
290579976,0cyclictest0-21swapper/122:50:581
290579976,0cyclictest0-21swapper/120:59:591
290579976,0cyclictest0-21swapper/120:05:291
290579975,1cyclictest6711-21kworker/1:122:25:471
290579975,1cyclictest649-21avahi-daemon21:45:181
290579975,1cyclictest32229-21kworker/1:000:32:031
290579974,2cyclictest700-21gdbus22:45:331
290579974,2cyclictest11398-21sshd23:05:091
290509976,1cyclictest12357-21lspci00:35:180
290509975,1cyclictest684-21polkitd00:15:260
290509975,1cyclictest14949-21sshd21:26:140
290509974,2cyclictest684-21polkitd22:10:230
290509971,2cyclictest646-21dbus-daemon23:02:210
25910270,1sleep226116-21expr20:20:132
290699964,1cyclictest646-21dbus-daemon23:10:023
290699964,1cyclictest32391-21sed20:35:143
290699963,2cyclictest17299-21snmpd19:40:503
290699960,5cyclictest0-21swapper/320:15:533
290629965,1cyclictest33-21ksoftirqd/219:49:592
290629964,1cyclictest649-21avahi-daemon21:06:162
290629960,5cyclictest0-21swapper/220:09:182
290579965,0cyclictest0-21swapper/120:50:481
290579964,1cyclictest646-21dbus-daemon21:07:371
290579963,2cyclictest17299-21snmpd20:24:061
290579960,5cyclictest0-21swapper/120:28:481
290579960,5cyclictest0-21swapper/120:13:481
290509964,1cyclictest649-21avahi-daemon19:30:000
290509964,1cyclictest649-21avahi-daemon00:10:430
290509964,1cyclictest646-21dbus-daemon21:09:460
290509963,2cyclictest17299-21snmpd19:43:000
290509960,5cyclictest0-21swapper/021:04:510
290509960,5cyclictest0-21swapper/020:54:510
290699953,1cyclictest6237-21mii-tool20:50:143
290699953,1cyclictest2057-21gltestperf20:40:153
290699953,1cyclictest17299-21snmpd20:55:133
290699953,1cyclictest17299-21snmpd20:47:523
290699953,1cyclictest17299-21snmpd20:25:093
290699953,1cyclictest17299-21snmpd20:12:033
290699953,1cyclictest17299-21snmpd20:09:123
290699953,1cyclictest17299-21snmpd19:59:123
290699953,1cyclictest17299-21snmpd19:51:553
290699953,1cyclictest17299-21snmpd19:30:023
290699953,1cyclictest17299-21snmpd19:25:093
290699953,1cyclictest17299-21snmpd19:20:143
290699953,1cyclictest17299-21snmpd19:10:173
290699953,1cyclictest12166-21cat19:45:153
290699952,2cyclictest30656-21sed20:30:143
290699950,4cyclictest0-21swapper/320:01:223
290629954,0cyclictest0-21swapper/219:33:282
290629953,1cyclictest700-21gdbus20:40:002
290629953,1cyclictest684-21polkitd19:44:592
290629953,1cyclictest33-21ksoftirqd/220:55:002
290629953,1cyclictest17299-21snmpd20:54:342
290629953,1cyclictest17299-21snmpd20:46:372
290629953,1cyclictest17299-21snmpd20:41:172
290629953,1cyclictest17299-21snmpd20:30:332
290629953,1cyclictest17299-21snmpd20:25:032
290629953,1cyclictest17299-21snmpd20:16:582
290629953,1cyclictest17299-21snmpd20:10:512
290629953,1cyclictest17299-21snmpd19:56:032
290629953,1cyclictest17299-21snmpd19:51:582
290629953,1cyclictest17299-21snmpd19:36:202
290629953,1cyclictest17299-21snmpd19:25:302
290629953,1cyclictest17299-21snmpd19:12:112
290629953,1cyclictest10670-21ntp_kernel_pll_21:00:182
290579955,0cyclictest13711-21kworker/1:219:36:011
290579954,1cyclictest13711-21kworker/1:219:55:131
290579954,1cyclictest13711-21kworker/1:219:10:191
290579954,0cyclictest0-21swapper/120:46:181
290579953,1cyclictest9825-21/usr/sbin/munin21:00:221
290579953,1cyclictest32468-21cat20:35:151
290579953,1cyclictest17299-21snmpd20:04:211
290579953,1cyclictest17299-21snmpd19:51:361
290579953,1cyclictest17299-21snmpd19:48:151
290579953,1cyclictest17299-21snmpd19:43:211
290579953,1cyclictest17299-21snmpd19:30:051
290509953,1cyclictest31199-21munin-node20:20:130
290509953,1cyclictest20125-21grep20:05:140
290509953,1cyclictest17299-21snmpd20:55:220
290509953,1cyclictest17299-21snmpd20:18:210
290509953,1cyclictest17299-21snmpd20:10:030
290509953,1cyclictest17299-21snmpd19:56:360
290509953,1cyclictest17299-21snmpd19:21:050
290509953,1cyclictest17299-21snmpd19:15:270
290509953,1cyclictest14201-21cat19:50:140
290509953,1cyclictest1058-21sendmail20:40:180
290509953,1cyclictest1053-21lldpd20:35:140
290509953,1cyclictest1053-21lldpd20:30:020
290509953,1cyclictest0-21swapper/019:35:160
290509952,2cyclictest17299-21snmpd20:45:250
290509950,0cyclictest0-21swapper/019:11:310
11325250,0sleep30-21swapper/321:01:153
290699942,1cyclictest7743-21cpuspeed_turbos19:35:113
290699942,1cyclictest31349-21uptime19:15:013
290629942,1cyclictest2007-21cat19:20:142
290629942,1cyclictest0-21swapper/220:00:132
290629941,2cyclictest31301-21which19:15:002
290579942,1cyclictest3603-21sort19:25:131
290579942,1cyclictest1746-21cpuspeed_turbos20:40:121
290509942,1cyclictest6451-21ntpq19:30:170
290509942,1cyclictest279392sleep020:25:110
290509942,1cyclictest1017-21runrttasks20:00:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional