You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-16 - 06:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Thu Oct 16, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
48612960,0sleep00-21swapper/021:46:120
303842940,0sleep00-21swapper/022:23:290
291582940,0sleep20-21swapper/221:52:192
200522940,0sleep30-21swapper/322:46:473
294932910,0sleep029494-21sshd00:35:220
294932910,0sleep029494-21sshd00:35:220
274602650,0sleep20-21swapper/223:41:042
51762620,0sleep10-21swapper/123:08:521
24002620,0sleep30-21swapper/322:55:043
226802590,1sleep222662-21cp23:00:232
92062580,1sleep19171-21sshd23:45:571
79842580,1sleep30-21swapper/300:29:043
102382580,0sleep00-21swapper/022:00:370
97842560,0sleep00-21swapper/023:32:410
63852550,0sleep30-21swapper/321:32:403
316072550,0sleep20-21swapper/222:44:382
310372550,0sleep10-21swapper/123:25:021
286552550,0sleep30-21swapper/322:09:383
256842550,0sleep30-21swapper/323:34:213
67842540,1sleep16781-21grepconf.sh23:42:191
39892530,0sleep0111rcuc/021:39:220
324892530,0sleep20-21swapper/222:48:062
256362530,1sleep1241ktimersoftd/123:30:591
224312530,0sleep20-21swapper/200:19:182
203202530,1sleep320318-21lspci21:08:493
130492530,0sleep00-21swapper/023:56:320
286112520,0sleep20-21swapper/221:28:122
262542510,0sleep30-21swapper/321:14:233
143092500,1sleep114302-21sshd22:32:231
37902490,0sleep30-21swapper/323:59:003
326742490,1sleep132672-21lspci21:49:171
253542480,1sleep225349-21lspci21:41:342
130662470,0sleep30-21swapper/300:14:343
264022410,0sleep20-21swapper/200:35:082
264022410,0sleep20-21swapper/200:35:082
227522350,0sleep20-21swapper/223:27:272
3165823210,7sleep30-21swapper/319:06:033
319402298,7sleep20-21swapper/219:09:392
301132240,20sleep375550irq/24-eno1-rx-21:18:043
312542219,7sleep00-21swapper/019:05:190
310242218,7sleep10-21swapper/119:05:161
114722190,0sleep011416-21sshd21:29:500
36872180,0sleep10-21swapper/100:09:521
187422180,0sleep00-21swapper/022:18:510
32562160,0sleep10-21swapper/121:32:191
191252160,0sleep30-21swapper/323:27:033
148092160,1sleep09-21ksoftirqd/023:09:540
74772150,0sleep00-21swapper/023:29:130
32069991514,0cyclictest17299-21snmpd19:53:420
121202150,0sleep1231rcuc/122:18:091
58302140,0sleep10-21swapper/122:38:241
32082991412,1cyclictest648-21systemd-logind23:48:382
301472140,0sleep030143-21sshd22:13:120
156922140,0sleep215693-21sshd00:07:312
3208299130,1cyclictest27668-21lspci21:10:272
3207599130,1cyclictest684-21polkitd22:29:031
286452130,1sleep028640-21sshd22:06:070
3208699120,11cyclictest0-21swapper/323:37:023
3208699120,11cyclictest0-21swapper/322:33:423
32082991210,1cyclictest12800-21sshd22:04:272
3208299120,1cyclictest1517-21lspci21:18:272
3208299120,1cyclictest0-21swapper/222:15:372
3208299120,11cyclictest0-21swapper/221:36:072
3207599120,11cyclictest0-21swapper/121:53:241
3206999120,1cyclictest31027-21lspci22:44:320
3206999120,11cyclictest0-21swapper/021:52:430
251962120,0sleep2311rcuc/221:48:252
3208699119,1cyclictest75550irq/24-eno1-rx-21:36:213
3208699119,1cyclictest2361-21smart_sda19:15:003
32086991110,0cyclictest0-21swapper/323:10:423
3208699110,10cyclictest0-21swapper/322:41:123
3208699110,10cyclictest0-21swapper/322:27:223
3208699110,10cyclictest0-21swapper/319:55:113
3208699110,0cyclictest0-21swapper/323:42:413
3208699110,0cyclictest0-21swapper/321:59:223
3208299119,1cyclictest1226-21sshd23:38:282
32082991110,0cyclictest0-21swapper/223:06:272
32082991110,0cyclictest0-21swapper/222:55:272
3208299110,10cyclictest0-21swapper/223:59:582
3208299110,10cyclictest0-21swapper/223:51:282
3207599119,1cyclictest13370-21bash00:33:351
32075991110,0cyclictest0-21swapper/123:00:541
3207599110,10cyclictest0-21swapper/121:25:441
3207599110,10cyclictest0-21swapper/121:16:141
3207599110,10cyclictest0-21swapper/120:40:341
3206999119,1cyclictest0-21swapper/000:06:240
32069991110,0cyclictest0-21swapper/023:38:030
32069991110,0cyclictest0-21swapper/000:03:340
136132110,0sleep013580-21sshd22:56:090
3208699109,0cyclictest0-21swapper/300:09:213
3208699109,0cyclictest0-21swapper/300:02:323
3208699108,1cyclictest29502-21lspci00:35:223
3208699108,1cyclictest29502-21lspci00:35:223
3208699100,0cyclictest0-21swapper/322:21:023
3208299109,0cyclictest0-21swapper/222:39:462
3208299109,0cyclictest0-21swapper/222:25:562
3208299108,1cyclictest16305-21bash22:53:062
3208299108,1cyclictest0-21swapper/200:12:282
3208299100,0cyclictest0-21swapper/223:13:172
3208299100,0cyclictest0-21swapper/200:02:482
3207599109,0cyclictest0-21swapper/123:16:541
3207599109,0cyclictest0-21swapper/122:58:341
3207599109,0cyclictest0-21swapper/122:41:441
3207599109,0cyclictest0-21swapper/121:35:441
3207599109,0cyclictest0-21swapper/121:08:141
3207599109,0cyclictest0-21swapper/100:21:241
3207599109,0cyclictest0-21swapper/100:01:551
3207599108,1cyclictest8701-21sshd23:39:151
3207599100,0cyclictest0-21swapper/100:12:451
3206999109,0cyclictest0-21swapper/021:14:520
3206999109,0cyclictest0-21swapper/021:06:530
3206999109,0cyclictest0-21swapper/000:30:040
3206999108,1cyclictest9-21ksoftirqd/023:47:400
3206999108,1cyclictest9-21ksoftirqd/021:41:180
3206999108,1cyclictest19183-21sshd23:53:530
3206999100,0cyclictest0-21swapper/023:11:430
3206999100,0cyclictest0-21swapper/019:13:530
320869998,0cyclictest0-21swapper/323:21:323
320869998,0cyclictest0-21swapper/323:17:323
320869998,0cyclictest0-21swapper/323:00:213
320869998,0cyclictest0-21swapper/322:19:523
320869998,0cyclictest0-21swapper/321:48:413
320869998,0cyclictest0-21swapper/300:24:223
320869997,1cyclictest11736-21bash21:29:513
320829998,0cyclictest0-21swapper/222:32:172
320829998,0cyclictest0-21swapper/220:00:172
320829998,0cyclictest0-21swapper/200:21:082
320829997,1cyclictest21649-21bash21:30:472
320829997,1cyclictest11085-21bash00:33:172
320829997,1cyclictest0-21swapper/223:33:182
320759998,0cyclictest0-21swapper/123:20:551
320759998,0cyclictest0-21swapper/123:10:051
320759997,1cyclictest23684-21sshd21:10:041
320699998,0cyclictest0-21swapper/022:28:220
320699998,0cyclictest0-21swapper/020:44:130
320699998,0cyclictest0-21swapper/000:10:240
320699997,1cyclictest9-21ksoftirqd/023:17:230
320699997,1cyclictest9-21ksoftirqd/023:01:530
320699997,1cyclictest9-21ksoftirqd/000:18:140
320699996,1cyclictest9-21ksoftirqd/022:46:570
320699994,1cyclictest9-21ksoftirqd/022:51:190
320829987,0cyclictest0-21swapper/223:20:082
320829987,0cyclictest0-21swapper/222:08:372
320829984,1cyclictest700-21gdbus21:58:522
320829984,1cyclictest646-21dbus-daemon00:29:592
320759987,0cyclictest0-21swapper/121:03:141
320759986,1cyclictest31300-21lspci22:02:561
320759986,1cyclictest24843-21lspci23:54:281
320759986,1cyclictest18340-21lspci22:11:541
320759985,2cyclictest649-21avahi-daemon22:46:031
320759985,2cyclictest649-21avahi-daemon22:09:001
320699986,1cyclictest9-21ksoftirqd/023:43:140
320699986,1cyclictest9-21ksoftirqd/022:34:350
320699986,1cyclictest9-21ksoftirqd/021:55:340
320699986,1cyclictest9-21ksoftirqd/021:31:400
320699986,1cyclictest9-21ksoftirqd/021:23:070
320699986,1cyclictest9-21ksoftirqd/021:05:000
320699986,1cyclictest9-21ksoftirqd/000:27:370
320699986,1cyclictest16418-21lspci23:20:100
320699985,1cyclictest9-21ksoftirqd/000:22:130
2643280,0sleep30-21swapper/322:03:213
320869976,0cyclictest0-21swapper/320:10:213
320869975,1cyclictest684-21polkitd21:52:543
320869975,1cyclictest649-21avahi-daemon22:13:343
320869975,1cyclictest5571-21lspci21:42:563
320869975,1cyclictest41-21ksoftirqd/323:54:193
320869975,1cyclictest28391-21sshd23:07:513
320869975,1cyclictest26661-21sshd22:37:083
320869974,2cyclictest681-21gdbus22:52:493
320869973,2cyclictest4541-21sshd23:48:563
320869970,6cyclictest0-21swapper/320:50:413
320829976,0cyclictest0-21swapper/220:09:562
320829974,2cyclictest649-21avahi-daemon21:20:532
320829974,2cyclictest646-21dbus-daemon22:20:152
320829974,1cyclictest14334-21sshd22:11:262
320829972,2cyclictest5244-21sshd23:15:312
320759976,0cyclictest0-21swapper/123:55:041
320759975,1cyclictest2348-21sshd21:59:541
320759974,2cyclictest681-21gdbus00:19:121
320759974,2cyclictest649-21avahi-daemon22:50:021
320759974,2cyclictest649-21avahi-daemon21:42:431
320759974,2cyclictest649-21avahi-daemon00:25:011
320759974,2cyclictest646-21dbus-daemon21:23:401
320759973,3cyclictest681-21gdbus22:20:151
320699975,1cyclictest9-21ksoftirqd/021:15:150
320699974,2cyclictest2230-21kworker/0:022:35:200
320869964,1cyclictest700-21gdbus00:30:043
320869964,1cyclictest684-21polkitd00:15:533
320869964,1cyclictest18039-21sshd21:20:133
320869963,2cyclictest17299-21snmpd21:01:243
320869963,2cyclictest17299-21snmpd19:27:413
320869960,5cyclictest0-21swapper/320:28:413
320869960,5cyclictest0-21swapper/320:18:103
320869960,5cyclictest0-21swapper/319:41:103
320829965,0cyclictest0-21swapper/220:34:562
320829965,0cyclictest0-21swapper/219:39:572
320829964,1cyclictest649-21avahi-daemon21:06:482
320829960,0cyclictest0-21swapper/220:52:172
320829960,0cyclictest0-21swapper/220:35:372
320759964,1cyclictest25-21ksoftirqd/120:35:001
320759963,2cyclictest646-21dbus-daemon00:35:041
320759963,2cyclictest646-21dbus-daemon00:35:041
10913260,1sleep311038-21/usr/sbin/munin19:35:143
320869953,1cyclictest700-21gdbus20:44:593
320869953,1cyclictest4854-21gltestperf19:20:133
320869953,1cyclictest21367-21latency20:00:173
320869953,1cyclictest17299-21snmpd20:39:023
320869953,1cyclictest17299-21snmpd20:30:083
320869953,1cyclictest17299-21snmpd20:20:373
320869953,1cyclictest17299-21snmpd19:54:323
320869953,1cyclictest17299-21snmpd19:31:393
320869953,1cyclictest15371-21missed_timers19:45:153
320869953,1cyclictest1109-21ntpd20:55:183
320869952,2cyclictest7286-21uname20:45:143
320869952,2cyclictest17299-21snmpd20:05:043
320829954,0cyclictest0-21swapper/221:00:272
320829953,1cyclictest7052-21cat19:25:152
320829953,1cyclictest32711-21cat19:10:142
320829953,1cyclictest2948-21cat19:15:142
320829953,1cyclictest27767-21ntp_states20:15:182
320829953,1cyclictest24867-21sshd20:10:112
320829953,1cyclictest17299-21snmpd20:55:052
320829953,1cyclictest17299-21snmpd20:45:532
320829953,1cyclictest17299-21snmpd20:28:442
320829953,1cyclictest17299-21snmpd20:20:072
320829953,1cyclictest17299-21snmpd19:57:072
320829953,1cyclictest17299-21snmpd19:49:122
320829953,1cyclictest17299-21snmpd19:40:382
320829953,1cyclictest17299-21snmpd19:32:242
320829953,1cyclictest17299-21snmpd19:20:232
320829952,2cyclictest17451-21cut19:50:182
320829950,1cyclictest4722-21/usr/sbin/munin20:40:232
320759954,0cyclictest0-21swapper/120:16:141
320759954,0cyclictest0-21swapper/119:57:531
320759953,1cyclictest9935-21grep19:30:201
320759953,1cyclictest9273-21cat20:50:151
320759953,1cyclictest7893-21threads20:45:171
320759953,1cyclictest26655-21crond20:15:011
320759953,1cyclictest17299-21snmpd20:55:021
320759953,1cyclictest17299-21snmpd20:35:231
320759953,1cyclictest17299-21snmpd20:27:081
320759953,1cyclictest17299-21snmpd20:21:041
320759953,1cyclictest17299-21snmpd20:00:431
320759953,1cyclictest17299-21snmpd19:51:001
320759953,1cyclictest17299-21snmpd19:35:121
320759953,1cyclictest17299-21snmpd19:25:151
320759953,1cyclictest17299-21snmpd19:10:081
320759953,1cyclictest15315-21missed_timers19:45:141
320759953,1cyclictest14437-21kworker/1:220:07:401
320759953,1cyclictest0-21swapper/119:15:011
320759952,2cyclictest12800-21tr19:40:141
320699954,0cyclictest0-21swapper/020:25:030
320699953,1cyclictest9274-21cat20:50:150
320699953,1cyclictest8598-21/usr/sbin/munin19:30:180
320699953,1cyclictest24630-21sadc20:10:010
320699953,1cyclictest22082-21unixbench-2d20:00:220
320699953,1cyclictest19600-21ntpdc19:55:140
320699953,1cyclictest1857-21munin-node19:15:010
320699953,1cyclictest17299-21snmpd20:35:110
320699953,1cyclictest17299-21snmpd20:24:180
320699953,1cyclictest17299-21snmpd20:11:400
320699953,1cyclictest17299-21snmpd19:40:060
320699953,1cyclictest17299-21snmpd19:37:510
320699953,1cyclictest17299-21snmpd19:28:060
320699953,1cyclictest17299-21snmpd19:20:590
320699953,1cyclictest15699-21awk19:45:170
320699953,1cyclictest1124-21cat20:30:150
320699952,2cyclictest28319-21sshd20:15:270
320699950,4cyclictest0-21swapper/020:46:420
320869942,1cyclictest32378-21cpuspeed_turbos19:10:123
320759942,1cyclictest4538-21cpu19:20:121
320699942,1cyclictest9-21ksoftirqd/020:55:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional