You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 12:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Thu Nov 13, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3123521050,0sleep13261799cyclictest23:30:441
225672780,1sleep125-21ksoftirqd/123:49:471
181102660,0sleep3391rcuc/300:26:043
67732610,1sleep16765-21lspci23:28:191
256092610,0sleep10-21swapper/121:36:321
20072590,0sleep10-21swapper/100:17:251
325212570,0sleep10-21swapper/100:34:351
270492550,0sleep10-21swapper/123:53:261
252022550,0sleep025198-21bash00:09:400
252022550,0sleep025198-21bash00:09:390
177342550,0sleep10-21swapper/122:08:411
138272540,1sleep213830-21bash21:38:392
42032530,1sleep30-21swapper/323:31:173
191112530,0sleep319095-21bash23:19:333
55302520,1sleep35535-21grepconf.sh22:07:223
43772510,0sleep10-21swapper/121:24:511
115142510,0sleep30-21swapper/300:18:273
39562500,1sleep00-21swapper/021:57:020
313722500,0sleep20-21swapper/200:10:142
228952500,0sleep1241ktimersoftd/100:23:101
283872490,0sleep30-21swapper/321:24:013
228672490,0sleep222864-21bash22:05:452
251632480,0sleep20-21swapper/222:43:112
44832470,0sleep10-21swapper/123:38:041
226302470,0sleep20-21swapper/222:15:512
207372470,1sleep120732-21sshd21:45:381
128042470,2sleep03261399cyclictest23:08:400
288832460,0sleep10-21swapper/122:53:311
138772450,0sleep10-21swapper/100:08:291
138772450,0sleep10-21swapper/100:08:281
180002430,0sleep00-21swapper/000:22:370
53862410,0sleep30-21swapper/323:38:103
189222380,0sleep00-21swapper/000:15:440
324152360,1sleep125-21ksoftirqd/100:38:011
324662308,7sleep30-21swapper/319:09:283
3241522211,7sleep20-21swapper/219:08:482
3238422210,7sleep00-21swapper/019:08:260
3231422210,7sleep10-21swapper/119:07:351
78562180,1sleep07829-21sshd23:11:280
186362180,0sleep00-21swapper/022:35:470
122892180,1sleep312291-21bash22:41:513
72672170,1sleep11233-1kworker/1:2H22:10:531
121322170,1sleep112136-21bash21:57:551
72442160,0sleep0111rcuc/021:21:490
297762160,0sleep229780-21bash22:30:162
289272160,0sleep228922-21lspci22:50:122
145802160,0sleep0111rcuc/021:00:200
55542150,1sleep1231rcuc/122:20:501
32613991514,0cyclictest23568-21lspci22:22:480
32613991514,0cyclictest22910-21lspci22:46:110
322262150,0sleep10-21swapper/122:00:041
174582150,1sleep2321ktimersoftd/223:09:102
284272140,0sleep10-21swapper/122:19:591
27132140,0sleep00-21swapper/021:11:080
266202140,0sleep20-21swapper/200:33:562
184812140,0sleep30-21swapper/321:55:133
50232130,0sleep01095-21nfsd21:37:440
32613991312,0cyclictest21094-21lspci21:29:440
3261399130,12cyclictest0-21swapper/022:43:490
162362130,0sleep20-21swapper/223:02:162
130662130,0sleep00-21swapper/023:28:580
54012120,0sleep30-21swapper/322:27:423
53722120,0sleep20-21swapper/222:04:022
3263099120,1cyclictest3424-21sshd00:31:243
3263099120,11cyclictest13500-21sshd23:08:443
3262399129,2cyclictest14135-21sshd23:45:322
32623991210,1cyclictest31347-21bash21:53:132
3262399120,1cyclictest8854-21bash00:01:232
3262399120,1cyclictest0-21swapper/223:33:532
3262399120,11cyclictest0-21swapper/221:56:122
3261799120,1cyclictest5687-21load19:20:151
3261799120,11cyclictest0-21swapper/121:44:361
32613991211,0cyclictest28671-21lspci00:30:370
32613991211,0cyclictest0-21swapper/021:42:090
3261399120,11cyclictest0-21swapper/023:16:480
12892120,0sleep00-21swapper/000:00:340
3263099119,1cyclictest19856-21bash21:42:233
3263099119,1cyclictest0-21swapper/321:39:243
3263099110,10cyclictest0-21swapper/300:10:553
3263099110,0cyclictest0-21swapper/322:21:333
3262399119,1cyclictest22448-21lspci23:43:132
32623991110,0cyclictest0-21swapper/223:22:122
3262399110,10cyclictest0-21swapper/222:10:022
3262399110,10cyclictest0-21swapper/220:54:412
3262399110,0cyclictest0-21swapper/223:25:422
3261799110,10cyclictest0-21swapper/123:55:571
3261799110,10cyclictest0-21swapper/123:55:561
3261399119,1cyclictest9-21ksoftirqd/023:41:390
3261399119,1cyclictest9-21ksoftirqd/022:10:160
3261399119,1cyclictest6880-21sshd23:24:590
32613991110,0cyclictest0-21swapper/023:35:290
3261399110,10cyclictest0-21swapper/022:58:290
3261399110,10cyclictest0-21swapper/022:33:490
226732110,1sleep11094-21nfsd23:40:001
223332110,0sleep20-21swapper/222:36:132
134562110,0sleep20-21swapper/200:18:422
3263099109,0cyclictest0-21swapper/323:02:143
3263099100,0cyclictest0-21swapper/322:52:153
3263099100,0cyclictest0-21swapper/322:38:453
3263099100,0cyclictest0-21swapper/322:10:043
3263099100,0cyclictest0-21swapper/322:02:143
3263099100,0cyclictest0-21swapper/321:53:133
3262399109,0cyclictest0-21swapper/223:13:222
3262399109,0cyclictest0-21swapper/222:59:122
3262399109,0cyclictest0-21swapper/221:15:212
3262399109,0cyclictest0-21swapper/219:29:412
3262399108,1cyclictest25441-21lspci22:26:232
3262399100,0cyclictest0-21swapper/219:31:422
3261799109,0cyclictest0-21swapper/123:11:261
3261799109,0cyclictest0-21swapper/123:04:561
3261799109,0cyclictest0-21swapper/122:56:061
3261799108,1cyclictest1956-21sshd21:27:471
3261799105,4cyclictest649-21avahi-daemon21:11:191
3261799100,0cyclictest0-21swapper/122:40:171
3261799100,0cyclictest0-21swapper/121:32:361
3261399109,0cyclictest15304-21lspci22:28:440
3261399109,0cyclictest0-21swapper/023:33:100
3261399109,0cyclictest0-21swapper/021:49:580
3261399109,0cyclictest0-21swapper/021:30:080
3261399109,0cyclictest0-21swapper/000:35:200
3261399108,1cyclictest9-21ksoftirqd/000:13:060
326309998,0cyclictest0-21swapper/323:52:043
326309998,0cyclictest0-21swapper/321:10:243
326309997,1cyclictest26440-21lspci22:19:433
326309990,8cyclictest27998-21sshd23:27:093
326239998,0cyclictest0-21swapper/221:08:312
326239998,0cyclictest0-21swapper/221:00:212
326239997,1cyclictest19516-21sshd21:42:212
326179998,0cyclictest0-21swapper/123:16:461
326179998,0cyclictest0-21swapper/120:10:161
326139997,1cyclictest9-21ksoftirqd/023:00:150
326139997,1cyclictest9-21ksoftirqd/022:03:030
326139997,1cyclictest9-21ksoftirqd/021:00:000
326139997,1cyclictest9-21ksoftirqd/000:25:410
326139990,8cyclictest5513-21kworker/0:123:59:510
326139990,8cyclictest5513-21kworker/0:123:59:500
326139990,1cyclictest9-21ksoftirqd/022:54:530
326309986,1cyclictest17696-21lspci00:05:283
326309986,1cyclictest17696-21lspci00:05:283
326309986,1cyclictest1-21systemd21:28:393
326309985,2cyclictest649-21avahi-daemon23:40:173
326309985,2cyclictest649-21avahi-daemon22:32:213
326239987,0cyclictest0-21swapper/221:45:212
326239987,0cyclictest0-21swapper/220:37:422
326239987,0cyclictest0-21swapper/220:14:412
326239986,1cyclictest21253-21lspci00:36:482
326239986,1cyclictest16342-21lspci22:22:012
326239986,1cyclictest11715-21lspci22:45:062
326239985,2cyclictest11226-21lspci23:15:152
326239984,3cyclictest646-21dbus-daemon00:09:012
326239984,3cyclictest646-21dbus-daemon00:09:012
326179987,0cyclictest0-21swapper/121:50:371
326179986,1cyclictest2186-21lspci00:04:011
326179985,2cyclictest649-21avahi-daemon22:45:231
326179985,2cyclictest649-21avahi-daemon22:38:351
326179985,2cyclictest646-21dbus-daemon22:25:181
326139987,0cyclictest0-21swapper/019:17:180
326139986,1cyclictest9-21ksoftirqd/023:51:280
326139986,1cyclictest9-21ksoftirqd/023:45:190
326139986,1cyclictest9-21ksoftirqd/022:16:300
326139986,1cyclictest9-21ksoftirqd/021:50:140
326139986,0cyclictest9-21ksoftirqd/021:15:030
326139980,7cyclictest20586-21kworker/0:322:05:040
326309976,0cyclictest0-21swapper/321:45:243
326309975,1cyclictest3583-21lspci00:00:493
326309975,1cyclictest27669-21sshd00:20:153
326309975,1cyclictest25486-21lspci22:46:293
326309975,1cyclictest2114-21sshd00:38:143
326309975,1cyclictest10274-21lspci23:21:553
326309974,2cyclictest8200-21sshd23:48:163
326309974,2cyclictest649-21avahi-daemon21:20:003
326309974,2cyclictest648-21systemd-logind23:55:153
326309974,2cyclictest648-21systemd-logind23:55:143
326309974,2cyclictest646-21dbus-daemon22:57:253
326309973,2cyclictest906-21idleruntime-cro20:29:593
326309973,1cyclictest646-21dbus-daemon21:30:223
326239976,1cyclictest25423-21lspci21:33:222
326239976,0cyclictest0-21swapper/221:27:222
326239975,1cyclictest649-21avahi-daemon23:53:452
326239975,1cyclictest10591-21lspci00:28:492
326239974,2cyclictest649-21avahi-daemon23:36:042
326239974,2cyclictest649-21avahi-daemon21:20:102
326239973,3cyclictest646-21dbus-daemon21:13:122
326179976,0cyclictest0-21swapper/121:15:461
326179975,1cyclictest2891-21lspci22:30:451
326179975,1cyclictest15488-21lspci00:25:471
326179974,2cyclictest1-21systemd23:05:121
326309965,0cyclictest0-21swapper/320:55:143
326309963,2cyclictest700-21gdbus23:10:023
326309962,2cyclictest14890-21sshd21:01:253
326239965,0cyclictest0-21swapper/219:55:422
326239964,1cyclictest26890-21sshd00:20:122
326239964,1cyclictest15002-21turbostat19:45:012
326239964,1cyclictest13473-21lspci23:55:182
326239964,1cyclictest13473-21lspci23:55:172
326239963,1cyclictest15230-21/usr/sbin/munin19:45:202
326179964,1cyclictest649-21avahi-daemon21:08:471
326179964,1cyclictest649-21avahi-daemon00:10:421
326179964,1cyclictest25585-21sshd23:20:121
326179964,1cyclictest17250-21kworker/1:120:04:111
326179963,2cyclictest646-21dbus-daemon20:44:591
326179963,2cyclictest646-21dbus-daemon20:29:591
326179963,2cyclictest17299-21snmpd19:13:521
326179960,5cyclictest0-21swapper/120:50:361
326139964,1cyclictest9-21ksoftirqd/019:45:000
326139960,5cyclictest0-21swapper/020:32:480
326309953,1cyclictest7593-21cat19:25:183
326309953,1cyclictest2986-21sort19:15:023
326309953,1cyclictest2493-21grep20:30:213
326309953,1cyclictest17752-21cat19:50:143
326309953,1cyclictest17299-21snmpd20:53:043
326309953,1cyclictest17299-21snmpd20:47:443
326309953,1cyclictest17299-21snmpd20:36:013
326309953,1cyclictest17299-21snmpd20:10:513
326309953,1cyclictest17299-21snmpd20:06:133
326309953,1cyclictest17299-21snmpd19:45:473
326309953,1cyclictest17299-21snmpd19:40:093
326309953,1cyclictest17299-21snmpd19:36:133
326309953,1cyclictest17299-21snmpd19:31:113
326309953,1cyclictest17299-21snmpd19:20:523
326309953,1cyclictest17299-21snmpd19:11:013
326309953,1cyclictest16276-21ntpq21:05:163
326309952,2cyclictest28879-21chrt20:15:493
326309952,2cyclictest17299-21snmpd19:55:483
326309950,4cyclictest0-21swapper/320:40:133
326309950,0cyclictest0-21swapper/320:01:533
326239953,1cyclictest7733-21cat20:45:142
326239953,1cyclictest5744-21cat20:40:142
326239953,1cyclictest22199-21awk20:00:172
326239953,1cyclictest17299-21snmpd20:58:132
326239953,1cyclictest17299-21snmpd20:16:242
326239953,1cyclictest17299-21snmpd19:50:502
326239953,1cyclictest17299-21snmpd19:39:562
326239953,1cyclictest17299-21snmpd19:15:052
326239953,1cyclictest17299-21snmpd19:10:582
326239953,1cyclictest1058-21sendmail20:30:022
326239950,4cyclictest23367-21/usr/sbin/munin20:05:212
326179954,0cyclictest0-21swapper/121:03:571
326179953,1cyclictest7254-21cpuspeed_turbos19:25:161
326179953,1cyclictest29228-21sadc20:19:591
326179953,1cyclictest17299-21snmpd20:45:321
326179953,1cyclictest17299-21snmpd20:35:351
326179953,1cyclictest17299-21snmpd20:32:151
326179953,1cyclictest17299-21snmpd20:20:311
326179953,1cyclictest17299-21snmpd20:07:121
326179953,1cyclictest17299-21snmpd19:57:151
326179953,1cyclictest17299-21snmpd19:52:021
326179953,1cyclictest17299-21snmpd19:31:561
326179953,1cyclictest17299-21snmpd19:15:551
326179953,1cyclictest14568-21unixbench_singl19:40:221
326179953,1cyclictest11800-21cat20:55:151
326179953,1cyclictest11656-21cat19:35:151
326139954,0cyclictest0-21swapper/020:07:280
326139953,1cyclictest9-21ksoftirqd/019:55:000
326139953,1cyclictest7594-21cat19:25:180
326139953,1cyclictest646-21dbus-daemon21:06:170
326139953,1cyclictest21816-21cat20:00:140
326139953,1cyclictest17299-21snmpd20:53:070
326139953,1cyclictest17299-21snmpd20:47:490
326139953,1cyclictest17299-21snmpd20:43:550
326139953,1cyclictest17299-21snmpd20:22:510
326139953,1cyclictest17299-21snmpd19:48:120
326139953,1cyclictest17299-21snmpd19:35:130
326139953,1cyclictest17299-21snmpd19:30:170
326139953,1cyclictest17299-21snmpd19:23:500
326139953,1cyclictest17299-21snmpd19:14:280
326139953,1cyclictest17010-21kworker/0:219:55:100
326139952,2cyclictest17299-21snmpd20:19:150
326139950,4cyclictest5027-21turbostat20:40:000
326309942,1cyclictest17299-21snmpd20:20:013
326239942,1cyclictest323732chrt20:25:212
326239942,1cyclictest17299-21snmpd20:20:042
326239942,1cyclictest17299-21snmpd19:20:042
326179942,1cyclictest0-21swapper/119:45:011
326139942,1cyclictest25480-21sort20:10:130
326139942,1cyclictest17299-21snmpd20:25:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional