You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 19:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Sun Nov 16, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44432980,1sleep04433-21sshd11:30:580
251992950,2sleep0406299cyclictest11:09:150
50242860,0sleep30-21swapper/311:41:343
8072740,1sleep1808-21grep12:34:071
165352640,0sleep016530-21sshd10:43:510
321172590,0sleep00-21swapper/010:38:180
105722560,0sleep30-21swapper/311:11:013
316522550,0sleep00-21swapper/012:24:530
304412550,0sleep00-21swapper/011:20:040
241982550,0sleep30-21swapper/312:21:023
234292550,0sleep30-21swapper/307:55:153
139172540,1sleep3391rcuc/312:17:023
206302530,0sleep20-21swapper/212:29:552
359025139,7sleep30-21swapper/307:05:273
254552510,0sleep20-21swapper/211:19:342
39732500,0sleep20-21swapper/211:54:472
246972500,0sleep30-21swapper/311:53:353
105582500,1sleep110555-21lspci09:36:441
75642490,1sleep233-21ksoftirqd/210:00:402
294482490,0sleep029441-21sshd11:54:040
18222490,0sleep10-21swapper/109:21:411
38382480,0sleep10-21swapper/111:03:271
134732470,0sleep113402-21sshd11:14:511
248072460,0sleep30-21swapper/310:27:083
130302460,0sleep10-21swapper/112:01:461
135362450,2sleep0406299cyclictest11:39:070
321752410,0sleep20-21swapper/212:18:502
364723422,7sleep10-21swapper/107:06:091
284772330,1sleep128473-21lspci11:47:211
284772330,1sleep128473-21lspci11:47:201
37862297,7sleep20-21swapper/207:07:542
39412287,7sleep00-21swapper/007:09:480
49922260,1sleep24987-21sshd09:11:062
44442240,0sleep30-21swapper/310:10:583
281362180,1sleep028139-21processes08:05:200
270842180,0sleep20-21swapper/211:09:292
72222170,1sleep17209-21sshd11:41:481
65062170,0sleep30-21swapper/309:46:433
51462170,1sleep35141-21lspci12:31:243
4062991715,1cyclictest19264-21kworker/0:109:21:130
27152170,0sleep20-21swapper/211:44:532
219222170,0sleep021923-21sshd12:33:020
4062991615,0cyclictest11954-21lspci09:43:560
4062991615,0cyclictest10180-21kworker/0:210:29:000
407599150,1cyclictest620-13audispd11:58:013
4062991514,0cyclictest4017-21kworker/0:011:29:390
4062991513,1cyclictest4018-21kworker/0:211:57:140
26742150,0sleep20-21swapper/211:57:462
247892150,1sleep2311rcuc/210:20:142
247152150,0sleep10-21swapper/109:48:411
235502150,0sleep30-21swapper/311:46:513
235502150,0sleep30-21swapper/311:46:503
175012150,0sleep00-21swapper/012:38:420
168662150,0sleep016861-21lspci11:18:400
131562150,0sleep00-21swapper/009:57:570
113792150,0sleep20-21swapper/211:35:152
113032150,0sleep00-21swapper/010:22:120
407599142,11cyclictest7950-21lspci09:29:223
4062991414,0cyclictest31065-21kworker/0:110:02:500
4062991413,0cyclictest3695-21kworker/0:110:52:560
4062991413,0cyclictest27140-21kworker/0:111:14:030
4062991413,0cyclictest11186-21kworker/0:211:46:400
4062991413,0cyclictest11186-21kworker/0:211:46:390
147372140,0sleep20-21swapper/207:35:002
105362140,1sleep11-21systemd09:26:061
4074991312,0cyclictest0-21swapper/212:34:182
406799130,12cyclictest28116-21bash12:39:431
406799130,12cyclictest13030-21sshd11:55:331
4062991312,0cyclictest7112-21kworker/0:011:40:040
4062991312,0cyclictest3695-21kworker/0:110:46:190
407599120,1cyclictest48-21kauditd11:16:323
407599120,1cyclictest14974-21sshd12:11:023
4074991211,0cyclictest0-21swapper/211:00:082
407499120,11cyclictest616-17auditd11:45:382
407499120,11cyclictest616-17auditd11:45:382
4067991211,0cyclictest0-21swapper/110:40:031
406799120,1cyclictest23325-21bash12:05:441
4062991212,0cyclictest25117-21kworker/0:010:16:520
4062991211,0cyclictest10180-21kworker/0:210:30:140
284242120,0sleep00-21swapper/010:59:090
280052120,0sleep30-21swapper/312:03:133
146812120,0sleep20-21swapper/210:19:102
407599110,10cyclictest0-21swapper/311:08:023
407599110,10cyclictest0-21swapper/309:56:323
407599110,10cyclictest0-21swapper/309:16:113
407499119,1cyclictest26274-21lspci12:12:072
407499119,1cyclictest20727-21lspci10:40:482
407499110,10cyclictest0-21swapper/211:24:282
407499110,10cyclictest0-21swapper/210:25:082
407499110,10cyclictest0-21swapper/209:32:572
407499110,10cyclictest0-21swapper/209:32:562
407499110,10cyclictest0-21swapper/209:22:462
406799119,1cyclictest4947-21sshd10:38:531
406799119,1cyclictest29496-21bash12:21:341
4067991110,0cyclictest0-21swapper/111:22:331
4067991110,0cyclictest0-21swapper/109:58:031
4067991110,0cyclictest0-21swapper/109:41:121
4067991110,0cyclictest0-21swapper/109:14:131
406799110,0cyclictest0-21swapper/111:19:431
406299119,1cyclictest9-21ksoftirqd/009:32:480
406299119,1cyclictest9-21ksoftirqd/009:32:470
406299119,1cyclictest9-21ksoftirqd/009:16:470
4062991111,0cyclictest523-40kipmi012:07:570
4062991111,0cyclictest13839-21kworker/0:209:09:160
4062991110,0cyclictest28343-21kworker/0:012:29:490
4062991110,0cyclictest22368-21lspci12:11:440
406299110,10cyclictest0-21swapper/011:04:200
406299110,10cyclictest0-21swapper/009:11:410
407599109,0cyclictest0-21swapper/310:51:123
407599109,0cyclictest0-21swapper/309:50:313
407599109,0cyclictest0-21swapper/309:35:223
407599109,0cyclictest0-21swapper/309:13:123
407499109,0cyclictest0-21swapper/211:14:472
407499109,0cyclictest0-21swapper/210:37:182
407499109,0cyclictest0-21swapper/210:10:482
407499109,0cyclictest0-21swapper/209:09:362
407499100,0cyclictest0-21swapper/210:50:382
406799109,0cyclictest0-21swapper/112:15:541
406799109,0cyclictest0-21swapper/112:10:131
406799109,0cyclictest0-21swapper/110:59:231
406799109,0cyclictest0-21swapper/110:24:221
406799109,0cyclictest0-21swapper/110:18:031
406799109,0cyclictest0-21swapper/110:08:521
406799109,0cyclictest0-21swapper/109:17:131
406799108,1cyclictest26053-21lspci10:34:131
406299109,0cyclictest28698-21kworker/0:012:00:420
406299109,0cyclictest0-21swapper/008:50:210
406299109,0cyclictest0-21swapper/008:24:410
406299108,1cyclictest9-21ksoftirqd/012:15:190
406299108,1cyclictest9-21ksoftirqd/010:05:210
406299108,1cyclictest25718-21sshd10:13:210
4062991010,0cyclictest23341-21kworker/0:009:28:100
40759998,0cyclictest0-21swapper/311:38:213
40759998,0cyclictest0-21swapper/310:20:323
40759997,1cyclictest25399-21sshd10:06:113
40749998,0cyclictest0-21swapper/212:09:182
40749998,0cyclictest0-21swapper/210:05:372
40749998,0cyclictest0-21swapper/209:55:572
40749998,0cyclictest0-21swapper/209:35:572
40749998,0cyclictest0-21swapper/208:17:062
40749998,0cyclictest0-21swapper/207:57:472
40749995,3cyclictest646-21dbus-daemon11:31:492
40679998,0cyclictest0-21swapper/109:08:121
40679996,2cyclictest646-21dbus-daemon10:25:291
40629998,0cyclictest31065-21kworker/0:109:50:420
40629998,0cyclictest13839-21kworker/0:207:35:200
40629997,1cyclictest9-21ksoftirqd/009:45:440
40629997,1cyclictest9-21ksoftirqd/009:35:360
40629990,5cyclictest18814-21awk07:44:590
40759987,0cyclictest0-21swapper/310:15:213
40759986,1cyclictest32250-21sshd10:34:543
40759986,1cyclictest18420-21sshd11:22:113
40759985,2cyclictest649-21avahi-daemon12:35:563
40759985,2cyclictest649-21avahi-daemon11:01:023
40759985,2cyclictest649-21avahi-daemon10:45:013
40749986,1cyclictest777-21lspci12:37:052
40749986,1cyclictest32471-21lspci10:48:592
40749986,1cyclictest19498-21sshd09:48:092
40749985,2cyclictest649-21avahi-daemon09:42:542
40749985,2cyclictest649-21avahi-daemon09:27:352
40749984,3cyclictest648-21systemd-logind10:32:072
40679987,0cyclictest0-21swapper/110:45:521
40679987,0cyclictest0-21swapper/110:00:531
40679987,0cyclictest0-21swapper/109:31:331
40679987,0cyclictest0-21swapper/109:31:331
40679987,0cyclictest0-21swapper/107:25:121
40679986,1cyclictest0-21swapper/109:51:331
40679985,2cyclictest648-21systemd-logind11:51:261
40629988,0cyclictest13839-21kworker/0:208:13:280
40629988,0cyclictest13839-21kworker/0:208:04:580
40629988,0cyclictest13839-21kworker/0:207:10:540
40629987,0cyclictest13839-21kworker/0:207:26:490
2842280,1sleep1231rcuc/110:10:481
40759976,0cyclictest0-21swapper/307:10:213
40759975,1cyclictest6398-21yum08:30:243
40759975,1cyclictest4317-21lspci12:25:183
40759975,1cyclictest3632-21lspci10:42:283
40759975,1cyclictest27765-21sshd12:06:103
40759975,1cyclictest21173-21lspci09:06:263
40759975,1cyclictest15201-21sshd09:44:183
40759974,2cyclictest700-21gdbus10:00:273
40759974,2cyclictest649-21avahi-daemon10:57:213
40759973,3cyclictest22528-21bash09:30:543
40759973,3cyclictest22528-21bash09:30:533
40759973,1cyclictest700-21gdbus09:21:153
40749975,1cyclictest649-21avahi-daemon10:55:042
40749975,1cyclictest20011-21sshd12:20:372
40749975,1cyclictest18938-21lspci11:29:062
40749974,2cyclictest649-21avahi-daemon09:15:212
40749973,3cyclictest646-21dbus-daemon12:00:262
40749972,2cyclictest9593-21sshd09:50:272
40749970,6cyclictest0-21swapper/208:50:072
40749970,6cyclictest0-21swapper/208:29:462
40679976,0cyclictest0-21swapper/111:08:231
40679975,1cyclictest684-21polkitd10:51:551
40679975,1cyclictest648-21systemd-logind11:30:551
40679975,1cyclictest21053-21sshd12:26:511
40629977,0cyclictest13839-21kworker/0:209:04:040
40629977,0cyclictest13839-21kworker/0:208:46:440
40629977,0cyclictest13839-21kworker/0:207:45:340
40629977,0cyclictest13839-21kworker/0:207:30:080
40629976,0cyclictest0-21swapper/008:35:210
40759964,1cyclictest646-21dbus-daemon11:25:013
40759964,1cyclictest443-21systemd-journal08:20:003
40759964,1cyclictest2733-21sshd10:35:133
40759963,2cyclictest27857-21lspci11:30:053
40759960,5cyclictest0-21swapper/308:12:523
40749965,0cyclictest0-21swapper/209:01:072
40749965,0cyclictest0-21swapper/208:00:262
40749964,1cyclictest16752-21crond07:39:592
40749960,5cyclictest0-21swapper/207:13:362
40679965,0cyclictest0-21swapper/108:35:231
40679964,1cyclictest649-21avahi-daemon11:35:421
40679964,1cyclictest649-21avahi-daemon08:59:591
40679964,1cyclictest646-21dbus-daemon11:25:021
40679964,1cyclictest588-21grep08:19:591
40629966,0cyclictest13839-21kworker/0:208:41:220
40629966,0cyclictest13839-21kworker/0:208:32:310
40629966,0cyclictest13839-21kworker/0:208:15:110
40629966,0cyclictest13839-21kworker/0:207:57:420
40629966,0cyclictest13839-21kworker/0:207:52:290
40629966,0cyclictest13839-21kworker/0:207:24:460
40629960,5cyclictest0-21swapper/008:28:410
3792260,1sleep3391rcuc/308:25:173
27167260,1sleep21095-21nfsd08:05:162
40759954,0cyclictest0-21swapper/307:27:323
40759953,1cyclictest7281-21df08:35:143
40759953,1cyclictest25620-21cat08:00:163
40759953,1cyclictest17672-21cat09:00:163
40759953,1cyclictest17490-21cat07:40:183
40759953,1cyclictest17299-21snmpd08:55:163
40759953,1cyclictest17299-21snmpd08:54:333
40759953,1cyclictest17299-21snmpd08:20:093
40759953,1cyclictest17299-21snmpd07:51:353
40759953,1cyclictest17299-21snmpd07:35:093
40759953,1cyclictest17299-21snmpd07:31:133
40759953,1cyclictest17299-21snmpd07:20:423
40759953,1cyclictest11568-21cat08:45:153
40759950,2cyclictest7094-21df07:15:153
40759950,0cyclictest0-21swapper/308:42:213
40749953,1cyclictest7016-21/usr/sbin/munin08:35:192
40749953,1cyclictest21532-21mii-tool07:50:132
40749953,1cyclictest17299-21snmpd08:45:252
40749953,1cyclictest17299-21snmpd08:44:032
40749953,1cyclictest17299-21snmpd08:32:092
40749953,1cyclictest17299-21snmpd08:23:512
40749953,1cyclictest17299-21snmpd07:40:312
40749953,1cyclictest17299-21snmpd07:22:132
40749953,1cyclictest11352-21cat07:25:142
40749953,1cyclictest1053-21lldpd07:46:012
40749952,2cyclictest7708-21ntp_states07:15:232
40749950,1cyclictest29197-21/usr/sbin/munin08:10:142
40679953,1cyclictest649-21avahi-daemon08:00:161
40679953,1cyclictest6110-21kworker/1:208:30:181
40679953,1cyclictest20819-21idleruntime-cro07:50:001
40679953,1cyclictest17299-21snmpd09:00:461
40679953,1cyclictest17299-21snmpd08:42:541
40679953,1cyclictest17299-21snmpd08:25:541
40679953,1cyclictest17299-21snmpd08:13:081
40679953,1cyclictest17299-21snmpd08:05:441
40679953,1cyclictest17299-21snmpd07:56:591
40679953,1cyclictest17299-21snmpd07:50:371
40679953,1cyclictest17299-21snmpd07:36:041
40679953,1cyclictest17299-21snmpd07:32:431
40679953,1cyclictest17299-21snmpd07:15:271
40679953,1cyclictest17299-21snmpd07:13:411
40679953,1cyclictest14452-21tail08:50:211
40679953,1cyclictest1390-21mii-tool08:20:151
40679953,1cyclictest12314-21timerwakeupswit08:45:201
40679950,4cyclictest0-21swapper/107:42:431
40629955,0cyclictest13839-21kworker/0:208:56:470
40629955,0cyclictest13839-21kworker/0:207:17:500
40759942,1cyclictest17299-21snmpd07:45:073
40759942,1cyclictest0-21swapper/308:05:153
40749940,3cyclictest0-21swapper/208:55:132
40679942,1cyclictest9312-21if_eno107:20:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional