You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-05 - 11:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Fri Dec 05, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2722421130,2sleep32148599cyclictest22:42:243
786621070,0sleep20-21swapper/222:40:222
186292990,1sleep318625-21bash22:25:013
137962990,1sleep02146599cyclictest00:36:160
116232970,2sleep02146599cyclictest21:42:210
87242960,0sleep10-21swapper/121:13:261
42512920,0sleep04250-21sshd22:13:250
189082900,2sleep12147299cyclictest00:14:541
310442840,0sleep30-21swapper/320:50:183
174622660,0sleep00-21swapper/000:25:340
115162650,1sleep011519-21unixbench_multi20:00:220
164592640,0sleep20-21swapper/222:51:122
122392640,2sleep02146599cyclictest21:13:490
76612630,0sleep20-21swapper/223:56:442
305942620,0sleep10-21swapper/100:19:301
213842620,0sleep00-21swapper/022:32:030
210642580,0sleep10-21swapper/123:01:441
74782570,0sleep30-21swapper/322:20:253
313432570,0sleep131298-21sshd23:22:551
291412570,1sleep329143-21bash00:19:203
286102560,2sleep02146599cyclictest23:22:380
284902560,0sleep228484-21sshd23:35:542
212802560,0sleep20-21swapper/222:25:172
24582550,0sleep00-21swapper/022:56:270
179642540,0sleep10-21swapper/122:44:501
326322530,1sleep032629-21sshd23:59:230
195152530,0sleep20-21swapper/222:18:282
264802520,0sleep10-21swapper/100:05:211
81952510,0sleep38185-21sshd23:27:103
69722500,0sleep20-21swapper/221:19:442
311462500,0sleep30-21swapper/322:49:293
205832500,0sleep00-21swapper/022:18:340
237252490,2sleep22147699cyclictest21:56:132
92762480,0sleep10-21swapper/122:07:281
178912470,0sleep30-21swapper/322:01:583
145102440,0sleep314508-21lspci23:04:233
262022420,2sleep02146599cyclictest00:01:580
258062400,1sleep32148599cyclictest21:24:463
161772380,2sleep12147299cyclictest23:47:501
255942360,0sleep025523-21sshd23:39:000
2135423110,6sleep00-21swapper/019:09:540
213012297,7sleep10-21swapper/119:09:141
64852230,0sleep30-21swapper/323:10:153
2107922311,7sleep30-21swapper/319:06:283
2114922211,6sleep20-21swapper/219:07:192
101262220,0sleep10-21swapper/100:24:511
272672180,1sleep127268-21grep23:19:111
95782170,1sleep2700-21gdbus21:51:402
246772170,1sleep3391rcuc/300:08:393
204432160,1sleep020438-21sshd22:41:410
118072160,0sleep20-21swapper/222:47:272
297262150,0sleep2311rcuc/223:45:512
274372150,1sleep027408-21sshd22:45:410
2146599150,1cyclictest5594-21lspci23:50:060
144442150,0sleep20-21swapper/223:10:582
277452140,0sleep10-21swapper/123:58:521
218992140,0sleep121890-21cp21:46:301
21465991413,0cyclictest15558-21lspci22:24:440
262442130,0sleep226249-21latency_hist20:39:592
260682130,0sleep00-21swapper/023:29:030
225052130,0sleep322499-21bash22:32:103
2148599130,1cyclictest32157-21lspci00:12:473
2148599130,11cyclictest1807-21sshd00:23:473
2147699130,1cyclictest818-21grep21:44:312
215912120,0sleep2321ktimersoftd/223:41:462
21485991210,1cyclictest0-21swapper/321:27:263
2148599120,11cyclictest623-21bash00:27:273
2148599120,11cyclictest0-21swapper/300:02:273
2147699120,1cyclictest27733-21lspci23:32:312
2147699120,11cyclictest14246-21sshd22:14:312
21472991211,0cyclictest0-21swapper/121:41:201
21472991210,1cyclictest7580-21sed23:40:201
21472991210,1cyclictest4304-21sshd23:13:201
21472991210,1cyclictest11484-21lspci23:07:201
2147299120,11cyclictest0-21swapper/121:30:101
21465991210,1cyclictest31015-21lspci00:09:210
200032120,0sleep10-21swapper/123:28:241
11822120,0sleep31177-21lspci21:15:533
21485991110,0cyclictest0-21swapper/323:43:063
21485991110,0cyclictest0-21swapper/323:35:163
21485991110,0cyclictest0-21swapper/322:18:263
21485991110,0cyclictest0-21swapper/321:33:363
2148599110,10cyclictest0-21swapper/321:52:463
2148599110,10cyclictest0-21swapper/321:45:263
2148599110,0cyclictest0-21swapper/323:57:373
2147699119,1cyclictest1917-21sshd00:35:012
2147699119,1cyclictest15657-21sshd00:00:512
21476991110,0cyclictest0-21swapper/221:10:112
2147699110,10cyclictest0-21swapper/223:00:112
2147699110,0cyclictest0-21swapper/221:39:312
2147299119,1cyclictest1205-21lspci22:26:301
2147299110,10cyclictest17961-21sshd00:29:301
2147299110,10cyclictest13951-21lspci22:47:401
2147299110,10cyclictest0-21swapper/121:17:191
2147299110,10cyclictest0-21swapper/120:30:291
2147299110,10cyclictest0-21swapper/100:02:401
2146599119,1cyclictest0-21swapper/023:07:260
21465991110,0cyclictest0-21swapper/023:45:160
21465991110,0cyclictest0-21swapper/021:58:260
21465991110,0cyclictest0-21swapper/021:50:450
2148599109,0cyclictest0-21swapper/321:40:263
2148599100,0cyclictest0-21swapper/322:56:563
2148599100,0cyclictest0-21swapper/319:27:263
2147699109,0cyclictest0-21swapper/223:23:312
2147699109,0cyclictest0-21swapper/222:05:312
2147699109,0cyclictest0-21swapper/221:22:512
2147699109,0cyclictest0-21swapper/220:41:412
2147699109,0cyclictest0-21swapper/200:05:412
2147699100,0cyclictest30888-21sshd23:29:312
2147699100,0cyclictest0-21swapper/222:24:112
2147699100,0cyclictest0-21swapper/200:33:112
2147299109,0cyclictest0-21swapper/122:22:201
2147299109,0cyclictest0-21swapper/120:54:291
2147299109,0cyclictest0-21swapper/100:31:201
2146599109,0cyclictest0-21swapper/021:46:250
2146599109,0cyclictest0-21swapper/021:15:350
2146599108,1cyclictest2048-21bash22:53:060
2146599100,0cyclictest0-21swapper/019:19:250
214859998,0cyclictest0-21swapper/322:35:363
214859998,0cyclictest0-21swapper/321:59:163
214859997,1cyclictest32372-21bash00:31:073
214859997,1cyclictest31144-21bash21:37:563
214859997,1cyclictest0-21swapper/321:09:163
214769997,1cyclictest33-21ksoftirqd/221:48:002
214769997,1cyclictest10043-21lspci21:32:412
214769997,1cyclictest0-21swapper/223:07:212
214729998,0cyclictest0-21swapper/121:57:101
214729997,1cyclictest27446-21bash23:32:301
214729996,2cyclictest649-21avahi-daemon00:39:511
214659998,0cyclictest9-21ksoftirqd/023:04:020
214659998,0cyclictest0-21swapper/023:19:260
214659998,0cyclictest0-21swapper/019:10:150
214659997,1cyclictest9459-21bash23:10:250
214659997,1cyclictest9-21ksoftirqd/022:09:180
214659997,1cyclictest9-21ksoftirqd/022:01:460
214659997,1cyclictest8709-21sshd21:38:550
214659996,2cyclictest649-21avahi-daemon23:31:380
7429280,1sleep3391rcuc/300:35:303
31626285,1sleep131813-21lspci23:36:141
214859987,0cyclictest0-21swapper/323:23:163
214859987,0cyclictest0-21swapper/322:10:363
214859986,1cyclictest16143-21lspci23:51:043
214859985,2cyclictest649-21avahi-daemon23:48:163
214859985,2cyclictest649-21avahi-daemon22:05:083
214769984,3cyclictest443-21systemd-journal23:50:072
214729987,0cyclictest0-21swapper/122:53:001
214729987,0cyclictest0-21swapper/121:38:501
214729986,1cyclictest7181-21lspci22:56:551
214729986,1cyclictest4514-21lspci22:00:371
214729985,2cyclictest649-21avahi-daemon22:39:561
214729985,2cyclictest649-21avahi-daemon21:54:051
214729985,2cyclictest649-21avahi-daemon21:24:461
214729980,7cyclictest27028-21sshd22:19:161
214659987,0cyclictest0-21swapper/023:40:260
214659987,0cyclictest0-21swapper/000:14:560
214659986,1cyclictest618-13audispd21:20:550
214659985,2cyclictest700-21gdbus21:27:060
214659985,2cyclictest649-21avahi-daemon21:30:160
214859976,0cyclictest0-21swapper/319:50:163
214859976,0cyclictest0-21swapper/319:22:263
214859975,1cyclictest31790-21lspci23:06:033
214859975,1cyclictest1780-21sshd21:12:313
214859975,1cyclictest12312-21sshd22:54:113
214859974,2cyclictest649-21avahi-daemon23:31:563
214769976,0cyclictest0-21swapper/222:57:102
214769976,0cyclictest0-21swapper/221:26:312
214769975,1cyclictest26869-21sshd00:12:132
214769974,2cyclictest700-21gdbus22:30:042
214769974,2cyclictest648-21systemd-logind00:21:442
214769973,3cyclictest649-21avahi-daemon00:15:342
214769973,3cyclictest646-21dbus-daemon22:00:422
214769973,1cyclictest646-21dbus-daemon23:16:202
214769973,1cyclictest646-21dbus-daemon21:09:512
214729976,0cyclictest0-21swapper/122:31:101
214729975,1cyclictest649-21avahi-daemon22:11:131
214729975,1cyclictest618-13audispd23:50:431
214729975,1cyclictest2411-21sshd21:28:481
214729970,6cyclictest0-21swapper/120:09:591
214659976,0cyclictest9-21ksoftirqd/000:16:120
214659975,1cyclictest9-21ksoftirqd/000:32:460
214659975,1cyclictest3435-21lspci00:20:050
214659975,1cyclictest26343-21lspci22:35:460
214659974,2cyclictest649-21avahi-daemon22:26:420
214859965,0cyclictest0-21swapper/319:32:263
214859964,1cyclictest17299-21snmpd20:22:013
214859963,2cyclictest646-21dbus-daemon23:15:023
214859963,2cyclictest17299-21snmpd19:37:363
214859960,5cyclictest0-21swapper/320:36:463
214769965,0cyclictest0-21swapper/220:17:012
214769964,1cyclictest443-21systemd-journal00:25:052
214769964,1cyclictest0-21swapper/219:45:182
214769961,2cyclictest19909-21sshd22:35:132
214769960,5cyclictest0-21swapper/221:01:102
214769960,0cyclictest0-21swapper/219:30:312
214729964,1cyclictest646-21dbus-daemon21:07:401
214729960,5cyclictest0-21swapper/119:40:591
214729960,5cyclictest0-21swapper/119:40:591
214729960,5cyclictest0-21swapper/119:28:391
214659965,0cyclictest0-21swapper/019:40:150
214659965,0cyclictest0-21swapper/019:40:150
214659965,0cyclictest0-21swapper/019:32:150
214659962,3cyclictest0-21swapper/020:25:010
214659960,5cyclictest0-21swapper/020:11:550
971250,0sleep20-21swapper/219:35:182
214859953,1cyclictest682-21lsmd19:10:253
214859953,1cyclictest597-21cat20:55:163
214859953,1cyclictest2695-21cat21:00:193
214859953,1cyclictest17299-21snmpd20:34:133
214859953,1cyclictest17299-21snmpd20:15:133
214859953,1cyclictest17299-21snmpd20:10:213
214859953,1cyclictest17299-21snmpd19:46:333
214859953,1cyclictest17299-21snmpd19:15:433
214859953,1cyclictest10311-21cpuspeed_turbos20:00:143
214859952,2cyclictest8865-21nfsd419:55:173
214859952,2cyclictest8865-21nfsd419:55:173
214769953,1cyclictest28791-21cat19:25:132
214769953,1cyclictest26758-21cat19:20:132
214769953,1cyclictest2437-21hddtemp_smartct19:40:132
214769953,1cyclictest2437-21hddtemp_smartct19:40:132
214769953,1cyclictest22887-21cat20:30:212
214769953,1cyclictest17299-21snmpd20:57:352
214769953,1cyclictest17299-21snmpd20:54:082
214769953,1cyclictest17299-21snmpd20:49:382
214769953,1cyclictest17299-21snmpd20:28:552
214769953,1cyclictest17299-21snmpd20:20:342
214769953,1cyclictest17299-21snmpd20:06:452
214769953,1cyclictest17299-21snmpd20:02:242
214769953,1cyclictest17299-21snmpd19:55:422
214769953,1cyclictest17299-21snmpd19:55:422
214769953,1cyclictest17299-21snmpd19:50:122
214769953,1cyclictest17299-21snmpd19:16:532
214769952,2cyclictest0-21swapper/220:10:022
214769950,4cyclictest22514-21ntp_states19:10:162
214729954,0cyclictest0-21swapper/120:45:191
214729953,1cyclictest24014-21munin-node19:15:011
214729953,1cyclictest17299-21snmpd21:02:441
214729953,1cyclictest17299-21snmpd20:58:381
214729953,1cyclictest17299-21snmpd20:42:551
214729953,1cyclictest17299-21snmpd20:38:491
214729953,1cyclictest17299-21snmpd20:27:371
214729953,1cyclictest17299-21snmpd20:16:101
214729953,1cyclictest17299-21snmpd19:52:081
214729953,1cyclictest17299-21snmpd19:45:391
214729953,1cyclictest17299-21snmpd19:35:171
214729953,1cyclictest17299-21snmpd19:10:381
214729953,1cyclictest0-21swapper/119:30:191
214729952,2cyclictest17299-21snmpd20:01:271
214729950,0cyclictest0-21swapper/119:23:391
214659954,0cyclictest0-21swapper/020:37:550
214659953,1cyclictest8509-21gltestperf19:55:150
214659953,1cyclictest8509-21gltestperf19:55:150
214659953,1cyclictest5422-21unixbench_multi19:45:220
214659953,1cyclictest5331-21sensors_temp21:05:220
214659953,1cyclictest27297-21ntpq20:40:180
214659953,1cyclictest18081-21sadc20:20:010
214659953,1cyclictest17299-21snmpd20:55:350
214659953,1cyclictest17299-21snmpd20:50:040
214659953,1cyclictest17299-21snmpd20:26:340
214659953,1cyclictest17299-21snmpd19:51:180
214659953,1cyclictest17299-21snmpd19:38:300
214659953,1cyclictest17299-21snmpd19:28:200
214659953,1cyclictest17299-21snmpd19:20:380
214659950,0cyclictest0-21swapper/021:02:250
214659950,0cyclictest0-21swapper/020:06:050
214859942,1cyclictest28935-21cat20:45:143
214859942,1cyclictest20553-21expr20:25:133
214859942,1cyclictest17299-21snmpd20:05:063
214859942,1cyclictest0-21swapper/319:40:113
214859942,1cyclictest0-21swapper/319:40:103
214859940,1cyclictest26852-21hostname20:40:153
214729942,1cyclictest8131-21seq19:55:011
214729942,1cyclictest8131-21seq19:55:011
214729942,1cyclictest18404-21cut20:20:121
214729942,1cyclictest14711-21cat20:10:161
214659944,0cyclictest14003-21kworker/0:220:30:170
214659942,1cyclictest48-21kauditd20:45:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional