You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-02-15 - 11:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Sat Feb 15, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
140282990,2sleep12633599cyclictest23:38:231
18852870,0sleep00-21swapper/000:21:230
320712590,0sleep00-21swapper/000:17:560
187612580,1sleep32634599cyclictest21:47:513
281242560,0sleep10-21swapper/123:30:251
100472550,0sleep30-21swapper/300:02:533
304992540,1sleep30-21swapper/322:38:043
220762540,0sleep10-21swapper/121:42:031
74062520,1sleep3646-21dbus-daemon22:48:193
23102500,0sleep20-21swapper/223:18:532
174372500,0sleep10-21swapper/121:35:271
260462490,0sleep3401ktimersoftd/323:42:293
237442490,0sleep00-21swapper/000:07:260
167642490,0sleep316760-21grepconf.sh00:29:433
94612480,2sleep32634599cyclictest23:19:343
263902480,0sleep20-21swapper/200:04:322
173182480,0sleep341-21ksoftirqd/321:53:433
136312480,0sleep10-21swapper/121:19:521
95552470,0sleep00-21swapper/022:14:270
119322470,0sleep3391rcuc/321:34:573
186362370,0sleep10-21swapper/122:30:381
210412350,0sleep10-21swapper/122:59:011
177002320,0sleep00-21swapper/023:54:200
259052299,7sleep10-21swapper/119:06:001
250982270,0sleep10-21swapper/121:23:581
2614422210,7sleep20-21swapper/219:09:012
2589722210,7sleep30-21swapper/319:05:533
2589422110,7sleep00-21swapper/019:05:510
281102200,0sleep10-21swapper/122:03:591
12062200,1sleep11201-21sshd22:50:521
65692190,0sleep00-21swapper/021:22:120
282702190,0sleep00-21swapper/000:38:340
61542180,0sleep30-21swapper/323:10:063
209102170,0sleep320912-21bash00:23:233
108552170,0sleep10-21swapper/100:22:211
66932160,0sleep00-21swapper/022:20:120
66932160,0sleep00-21swapper/022:20:110
26341991615,0cyclictest20085-21lspci22:52:422
113512160,0sleep30-21swapper/321:22:393
319672150,1sleep3391rcuc/321:58:123
2633199150,13cyclictest0-21swapper/023:09:170
134162150,0sleep10-21swapper/121:53:211
322242140,0sleep10-21swapper/119:20:201
26341991413,0cyclictest12255-21lspci22:45:392
2634199140,1cyclictest684-21polkitd22:27:002
26341991311,1cyclictest33-21ksoftirqd/221:19:132
26335991311,1cyclictest619-17sedispatch21:31:211
2633599130,2cyclictest646-21dbus-daemon21:09:321
2633599130,1cyclictest648-21systemd-logind00:33:121
210632130,0sleep20-21swapper/221:23:352
124052130,0sleep00-21swapper/000:25:530
78972120,0sleep0111rcuc/021:28:290
26345991210,1cyclictest0-21swapper/321:37:243
2634599120,1cyclictest31903-21sshd22:50:433
2634599120,1cyclictest1665-21sshd21:27:533
2634599120,11cyclictest29569-21sshd22:16:133
26341991211,0cyclictest22778-21lspci23:51:402
26341991211,0cyclictest22081-21lspci23:36:042
26341991210,1cyclictest648-21systemd-logind00:09:402
2634199120,11cyclictest12279-21sshd22:30:012
26335991210,1cyclictest646-21dbus-daemon23:11:421
26335991210,1cyclictest3033-21lspci23:15:521
2633599120,1cyclictest29642-21lspci00:38:431
2633599120,11cyclictest0-21swapper/122:42:511
2633599120,11cyclictest0-21swapper/121:25:411
2633199120,11cyclictest1-21systemd22:57:270
2634599119,1cyclictest646-21dbus-daemon22:43:443
26345991110,0cyclictest0-21swapper/323:01:543
26345991110,0cyclictest0-21swapper/322:21:343
26345991110,0cyclictest0-21swapper/322:21:343
2634599110,10cyclictest0-21swapper/323:26:333
2634599110,10cyclictest0-21swapper/321:41:533
2634599110,10cyclictest0-21swapper/319:15:233
2634599110,10cyclictest0-21swapper/300:31:043
2634199119,1cyclictest33-21ksoftirqd/223:14:332
2634199113,1cyclictest33-21ksoftirqd/223:25:442
2634199111,1cyclictest131rcu_sched00:33:262
26341991110,0cyclictest21065-21lspci00:13:312
26341991110,0cyclictest21065-21lspci00:13:302
26341991110,0cyclictest0-21swapper/223:43:102
26341991110,0cyclictest0-21swapper/221:54:402
26341991110,0cyclictest0-21swapper/221:45:112
2633599119,1cyclictest648-21systemd-logind21:48:021
2633599119,1cyclictest0-21swapper/121:14:321
26335991110,0cyclictest0-21swapper/123:50:031
26335991110,0cyclictest0-21swapper/123:07:311
2633199119,1cyclictest648-21systemd-logind21:54:170
2633199119,1cyclictest29609-21sshd23:36:480
2633199119,1cyclictest29028-21sshd23:42:480
26331991110,0cyclictest0-21swapper/023:32:370
26331991110,0cyclictest0-21swapper/022:39:180
2633199110,1cyclictest2898-21lspci21:18:460
2633199110,0cyclictest0-21swapper/000:11:080
2633199110,0cyclictest0-21swapper/000:11:070
129882110,0sleep30-21swapper/323:07:403
2634599109,0cyclictest0-21swapper/323:57:333
2634599100,0cyclictest0-21swapper/323:54:343
2634599100,0cyclictest0-21swapper/300:36:343
2634199109,0cyclictest30562-21lspci23:30:392
2634199108,1cyclictest33-21ksoftirqd/221:32:172
2634199108,1cyclictest33-21ksoftirqd/200:39:022
2634199108,1cyclictest33-21ksoftirqd/200:25:482
2634199108,1cyclictest28710-21bash23:49:112
2634199108,1cyclictest24996-21sshd21:36:112
2634199103,1cyclictest33-21ksoftirqd/223:58:082
2634199102,1cyclictest33-21ksoftirqd/222:39:112
2634199101,1cyclictest131rcu_sched22:04:552
2634199100,0cyclictest0-21swapper/222:59:012
2634199100,0cyclictest0-21swapper/220:36:002
2633599109,0cyclictest0-21swapper/123:02:121
2633599109,0cyclictest0-21swapper/122:21:521
2633599109,0cyclictest0-21swapper/122:21:511
2633599100,0cyclictest0-21swapper/123:41:031
2633199109,0cyclictest0-21swapper/022:32:360
2633199109,0cyclictest0-21swapper/019:30:170
203372100,0sleep00-21swapper/023:11:270
191332100,0sleep10-21swapper/122:49:291
27494290,1sleep127484-21sshd22:09:591
263459998,0cyclictest0-21swapper/322:33:343
263459997,1cyclictest620-13audispd22:01:343
263419998,0cyclictest2992-21lspci21:12:412
263419997,1cyclictest33-21ksoftirqd/222:41:192
263419997,1cyclictest33-21ksoftirqd/222:13:372
263419997,1cyclictest15301-21sshd22:21:012
263419997,1cyclictest15301-21sshd22:21:002
263419996,2cyclictest33-21ksoftirqd/222:15:342
263419996,1cyclictest33-21ksoftirqd/223:22:002
263419992,1cyclictest131rcu_sched21:25:502
263419991,2cyclictest131rcu_sched22:05:572
263359998,0cyclictest0-21swapper/100:03:531
263359997,1cyclictest25-21ksoftirqd/100:28:041
263359990,0cyclictest0-21swapper/119:19:221
263319998,0cyclictest0-21swapper/023:45:470
263319998,0cyclictest0-21swapper/021:14:270
263319998,0cyclictest0-21swapper/000:02:380
263319997,1cyclictest0-21swapper/021:34:260
263319990,5cyclictest646-21dbus-daemon20:20:000
263319990,0cyclictest0-21swapper/020:55:270
10832290,0sleep00-21swapper/021:09:500
28909281,5sleep3646-21dbus-daemon00:07:573
263459986,1cyclictest5042-21lspci00:15:053
263459986,1cyclictest469-21lspci22:28:513
263459986,1cyclictest25201-21sshd22:59:263
263459985,2cyclictest8149-21bash23:34:433
263459983,1cyclictest682-21lsmd23:21:333
263419987,0cyclictest0-21swapper/223:00:112
263419986,1cyclictest33-21ksoftirqd/221:40:012
263419986,1cyclictest33-21ksoftirqd/200:20:082
263419984,3cyclictest649-21avahi-daemon00:15:552
263419981,1cyclictest33-21ksoftirqd/221:59:182
263419980,0cyclictest131rcu_sched23:05:492
263359987,0cyclictest0-21swapper/123:22:111
263359987,0cyclictest0-21swapper/122:17:421
263359986,1cyclictest646-21dbus-daemon00:08:431
263359986,1cyclictest25-21ksoftirqd/123:46:361
263359986,1cyclictest2433-21grep22:29:031
263359986,1cyclictest19317-21lspci00:13:201
263359986,1cyclictest19317-21lspci00:13:191
263359985,2cyclictest684-21polkitd23:55:191
263359985,2cyclictest649-21avahi-daemon22:35:401
263359983,2cyclictest12100-21sshd00:19:131
263319987,0cyclictest0-21swapper/021:42:460
263319986,1cyclictest9-21ksoftirqd/022:08:340
263319986,1cyclictest8392-21lspci23:28:390
263319986,1cyclictest6572-21lspci22:48:140
263319986,1cyclictest5909-21lspci22:41:560
263319986,1cyclictest26594-21sshd23:18:080
263319986,1cyclictest25493-21lspci22:25:040
263319986,1cyclictest20665-21lspci22:03:170
263319986,1cyclictest1671-21lspci21:55:170
263319985,2cyclictest646-21dbus-daemon23:01:040
263319984,3cyclictest12941-21kworker/0:221:37:130
263459975,1cyclictest7264-21lspci22:05:033
263459975,1cyclictest700-21gdbus00:10:143
263459975,1cyclictest700-21gdbus00:10:143
263459975,1cyclictest646-21dbus-daemon23:35:093
263459974,2cyclictest649-21avahi-daemon21:17:103
263459974,2cyclictest649-21avahi-daemon21:10:563
263459974,2cyclictest26342-21sshd23:45:453
263459973,3cyclictest649-21avahi-daemon22:12:013
263419976,0cyclictest0-21swapper/219:23:102
263419975,1cyclictest33-21ksoftirqd/220:15:012
263419974,2cyclictest17299-21snmpd19:38:092
263359975,1cyclictest9182-21lspci21:56:001
263359972,2cyclictest646-21dbus-daemon23:29:351
263359970,0cyclictest0-21swapper/120:09:321
263319976,0cyclictest0-21swapper/021:04:570
263319976,0cyclictest0-21swapper/020:50:160
263319976,0cyclictest0-21swapper/019:24:560
263319975,1cyclictest649-21avahi-daemon23:57:020
263319975,1cyclictest3910-21lspci23:22:010
263319974,2cyclictest649-21avahi-daemon22:52:530
263319974,2cyclictest649-21avahi-daemon22:15:150
263319974,2cyclictest649-21avahi-daemon21:45:390
263319974,2cyclictest29623-21kworker/0:300:33:420
263459963,2cyclictest17299-21snmpd19:22:153
263459962,3cyclictest26314-21munin-plugin-st20:35:013
263459960,5cyclictest0-21swapper/320:10:033
263419964,1cyclictest17299-21snmpd20:49:182
263419963,2cyclictest684-21polkitd21:08:512
263419963,2cyclictest646-21dbus-daemon20:09:552
263419963,2cyclictest17299-21snmpd20:40:542
263419963,2cyclictest17299-21snmpd20:34:482
263359964,1cyclictest700-21gdbus19:14:541
263359964,1cyclictest25-21ksoftirqd/119:39:591
263359964,1cyclictest11210-21kworker/1:222:10:021
263359963,2cyclictest17299-21snmpd20:34:151
263319964,1cyclictest649-21avahi-daemon20:40:010
263319963,1cyclictest17299-21snmpd19:19:520
263319960,5cyclictest0-21swapper/020:33:370
263319960,5cyclictest0-21swapper/020:13:070
263319960,0cyclictest0-21swapper/020:46:270
263319960,0cyclictest0-21swapper/019:11:560
263459953,1cyclictest749-21cat20:50:173
263459953,1cyclictest4832-21cat21:00:133
263459953,1cyclictest17299-21snmpd21:05:523
263459953,1cyclictest17299-21snmpd20:57:403
263459953,1cyclictest17299-21snmpd20:37:413
263459953,1cyclictest17299-21snmpd20:28:483
263459953,1cyclictest17299-21snmpd20:21:143
263459953,1cyclictest17299-21snmpd20:16:503
263459953,1cyclictest17299-21snmpd20:05:443
263459953,1cyclictest17299-21snmpd20:00:473
263459953,1cyclictest17299-21snmpd19:52:233
263459953,1cyclictest17299-21snmpd19:48:313
263459953,1cyclictest17299-21snmpd19:10:483
263459952,2cyclictest700-21gdbus19:40:003
263459952,2cyclictest17299-21snmpd20:46:293
263459952,2cyclictest17299-21snmpd20:40:423
263459952,2cyclictest17299-21snmpd19:37:283
263459952,2cyclictest17299-21snmpd19:31:123
263459952,2cyclictest17299-21snmpd19:26:193
263419954,0cyclictest0-21swapper/219:14:012
263419953,1cyclictest684-21polkitd19:44:592
263419953,1cyclictest21948-21tr20:20:162
263419953,1cyclictest17299-21snmpd21:00:362
263419953,1cyclictest17299-21snmpd20:52:472
263419953,1cyclictest17299-21snmpd20:25:112
263419953,1cyclictest17299-21snmpd20:14:582
263419953,1cyclictest17299-21snmpd19:55:562
263419953,1cyclictest17299-21snmpd19:41:582
263419953,1cyclictest17299-21snmpd19:30:132
263419953,1cyclictest17299-21snmpd19:16:522
263419953,1cyclictest14138-21cat20:00:162
263419953,1cyclictest1058-21sendmail20:57:092
263419952,2cyclictest17299-21snmpd19:27:462
263419950,1cyclictest9605-21/usr/sbin/munin19:50:142
263359954,0cyclictest0-21swapper/120:27:011
263359954,0cyclictest0-21swapper/120:21:121
263359953,1cyclictest4650-21kworker/1:219:40:221
263359953,1cyclictest4380-21/usr/sbin/munin21:00:161
263359953,1cyclictest3351-21ps20:55:181
263359953,1cyclictest28900-21tail20:40:141
263359953,1cyclictest17299-21snmpd20:52:111
263359953,1cyclictest17299-21snmpd20:17:411
263359953,1cyclictest17299-21snmpd20:10:071
263359953,1cyclictest17299-21snmpd19:30:071
263359953,1cyclictest12140-21cat19:55:191
263359953,1cyclictest1058-21sendmail20:35:121
263359953,1cyclictest1053-21lldpd19:45:161
263359952,2cyclictest1109-21ntpd20:00:191
263319953,1cyclictest17299-21snmpd20:25:530
263319953,1cyclictest17299-21snmpd20:21:540
263319953,1cyclictest17299-21snmpd19:52:160
263319953,1cyclictest17299-21snmpd19:45:230
263319953,1cyclictest17299-21snmpd19:41:400
263319953,1cyclictest17299-21snmpd19:29:090
263319953,1cyclictest13976-21gltestperf20:00:150
263319953,1cyclictest1053-21lldpd19:35:180
263459942,1cyclictest11966-21tail19:55:173
263359944,0cyclictest28330-21kworker/1:120:45:141
263359942,1cyclictest0-21swapper/119:50:071
263359942,1cyclictest0-21swapper/119:25:171
263319943,0cyclictest0-21swapper/020:40:060
263319942,1cyclictest16956-21cat20:05:210
263319942,1cyclictest11670-21cpu19:55:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional