You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 03:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Tue Jul 01, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
131852940,0sleep30-21swapper/322:59:293
173032750,0sleep10-21swapper/121:34:401
79822740,0sleep20-21swapper/222:11:422
5832620,1sleep3580-21lspci21:26:363
163562590,2sleep3565099cyclictest00:30:483
225492580,1sleep222544-21bash21:19:182
202652580,0sleep30-21swapper/322:09:463
68722560,0sleep36865-21bash21:46:153
92752550,1sleep39274-21sshd00:08:013
282782540,1sleep09-21ksoftirqd/023:35:220
262582540,0sleep10-21swapper/122:13:291
78322530,0sleep10-21swapper/123:08:241
285502530,0sleep10-21swapper/123:10:201
150012520,0sleep10-21swapper/121:21:421
171472510,0sleep20-21swapper/222:28:202
161782510,0sleep00-21swapper/021:21:490
138082500,0sleep00-21swapper/023:40:190
55812490,2sleep3565099cyclictest23:58:173
256832490,0sleep00-21swapper/022:19:450
201172490,1sleep20-21swapper/222:44:262
59472480,0sleep00-21swapper/023:33:180
310372480,0sleep30-21swapper/321:35:543
235962480,0sleep00-21swapper/023:13:030
265752470,0sleep20-21swapper/223:35:172
293482410,2sleep2564199cyclictest00:19:222
233212400,0sleep00-21swapper/023:53:490
121252400,0sleep30-21swapper/300:14:393
183672390,1sleep018365-21sshd21:50:330
138892390,0sleep00-21swapper/022:12:160
315182360,1sleep341-21ksoftirqd/322:04:303
10422350,0sleep30-21swapper/321:42:313
549323110,7sleep10-21swapper/119:09:421
313222300,0sleep00-21swapper/000:25:410
523522311,7sleep30-21swapper/319:06:313
517222311,7sleep20-21swapper/219:05:422
517022210,7sleep00-21swapper/019:05:400
73722200,0sleep00-21swapper/022:21:000
64182170,0sleep16414-21lspci22:20:541
57772170,1sleep25771-21sshd00:01:202
57772170,1sleep25771-21sshd00:01:202
149952170,1sleep1231rcuc/123:37:191
118342170,2sleep2564199cyclictest21:53:102
251212160,0sleep10-21swapper/100:03:151
251212160,0sleep10-21swapper/100:03:141
564199153,2cyclictest33-21ksoftirqd/222:35:002
563099155,2cyclictest9-21ksoftirqd/000:06:010
41272150,0sleep10-21swapper/121:55:351
33252150,0sleep30-21swapper/300:23:043
241032150,0sleep20-21swapper/223:44:382
563099146,2cyclictest9-21ksoftirqd/021:33:370
322192140,0sleep3391rcuc/323:23:203
216302140,0sleep10-21swapper/122:50:421
101522140,0sleep30-21swapper/322:52:483
5637991311,1cyclictest0-21swapper/100:32:221
563799130,1cyclictest648-21systemd-logind21:47:211
563799130,12cyclictest0-21swapper/121:54:521
563099136,2cyclictest9-21ksoftirqd/021:28:330
563099135,1cyclictest9-21ksoftirqd/023:16:500
563099135,1cyclictest9-21ksoftirqd/022:52:370
563099135,1cyclictest9-21ksoftirqd/022:07:230
563099134,2cyclictest9-21ksoftirqd/023:25:040
563099134,2cyclictest9-21ksoftirqd/023:08:240
563099134,2cyclictest9-21ksoftirqd/022:27:250
563099134,1cyclictest9-21ksoftirqd/022:01:460
563099133,2cyclictest9-21ksoftirqd/021:56:260
563099133,1cyclictest9-21ksoftirqd/000:32:280
563099132,2cyclictest9-21ksoftirqd/000:23:220
563099130,1cyclictest101ktimersoftd/023:55:150
267802130,2sleep2564199cyclictest23:04:002
170692130,0sleep117068-21sshd23:25:021
5650991210,1cyclictest0-21swapper/322:33:413
565099120,1cyclictest1446-21grep23:32:513
565099120,1cyclictest0-21swapper/322:14:113
565099120,11cyclictest29654-21sshd23:26:113
564199121,1cyclictest33-21ksoftirqd/221:30:082
564199120,11cyclictest936-21bash00:35:522
564199120,11cyclictest0-21swapper/223:17:022
563799120,11cyclictest18361-21lspci22:19:021
563799120,11cyclictest11075-21sshd00:14:321
563099126,1cyclictest9-21ksoftirqd/021:12:250
563099125,2cyclictest9-21ksoftirqd/022:46:490
563099125,1cyclictest9-21ksoftirqd/023:03:170
563099125,1cyclictest9-21ksoftirqd/022:41:480
563099125,1cyclictest9-21ksoftirqd/021:49:530
563099125,1cyclictest9-21ksoftirqd/021:36:480
563099124,3cyclictest9-21ksoftirqd/021:41:120
563099124,2cyclictest9-21ksoftirqd/023:20:210
563099124,2cyclictest9-21ksoftirqd/000:35:320
563099124,1cyclictest9-21ksoftirqd/022:59:250
563099123,1cyclictest9-21ksoftirqd/000:15:440
563099121,1cyclictest9-21ksoftirqd/000:03:420
563099121,1cyclictest9-21ksoftirqd/000:03:410
563099121,1cyclictest101ktimersoftd/021:18:030
563099120,11cyclictest0-21swapper/023:48:410
325222120,0sleep20-21swapper/200:07:082
5650991110,0cyclictest0-21swapper/322:27:013
565099110,10cyclictest0-21swapper/323:09:003
565099110,10cyclictest0-21swapper/322:37:013
564199116,1cyclictest33-21ksoftirqd/222:35:112
564199115,1cyclictest33-21ksoftirqd/200:11:032
564199111,3cyclictest33-21ksoftirqd/223:13:402
564199111,2cyclictest33-21ksoftirqd/221:39:022
564199110,3cyclictest33-21ksoftirqd/222:09:472
564199110,0cyclictest13408-21lspci23:30:522
564199110,0cyclictest0-21swapper/222:21:422
564199110,0cyclictest0-21swapper/221:27:312
5637991110,0cyclictest0-21swapper/100:39:221
563799110,10cyclictest0-21swapper/123:17:421
563099115,2cyclictest9-21ksoftirqd/022:36:530
563099114,3cyclictest9-21ksoftirqd/022:30:050
565099109,0cyclictest0-21swapper/323:35:413
565099109,0cyclictest0-21swapper/322:44:103
565099109,0cyclictest0-21swapper/322:23:413
565099109,0cyclictest0-21swapper/321:58:313
565099108,1cyclictest0-21swapper/321:15:213
565099100,0cyclictest0-21swapper/323:44:413
564199109,0cyclictest0-21swapper/223:56:222
564199109,0cyclictest0-21swapper/223:20:212
564199109,0cyclictest0-21swapper/200:31:122
564199103,1cyclictest33-21ksoftirqd/221:23:022
564199103,0cyclictest131rcu_sched23:07:542
564199101,8cyclictest75650irq/25-eno1-tx-23:45:212
564199101,3cyclictest33-21ksoftirqd/222:58:422
564199101,1cyclictest33-21ksoftirqd/222:50:182
564199101,1cyclictest33-21ksoftirqd/222:02:122
564199101,1cyclictest33-21ksoftirqd/221:46:372
564199101,1cyclictest33-21ksoftirqd/200:25:422
564199101,1cyclictest121rcu_preempt23:27:252
564199100,1cyclictest131rcu_sched00:23:222
564199100,1cyclictest10809-21sshd22:46:342
564199100,1cyclictest0-21swapper/222:15:432
564199100,0cyclictest0-21swapper/221:14:222
563799109,0cyclictest0-21swapper/122:56:411
563799109,0cyclictest0-21swapper/122:35:121
563799109,0cyclictest0-21swapper/100:20:111
563799109,0cyclictest0-21swapper/100:17:221
563099102,2cyclictest9-21ksoftirqd/000:10:080
563099100,9cyclictest0-21swapper/021:02:200
56509998,0cyclictest0-21swapper/323:47:303
56509998,0cyclictest0-21swapper/323:15:413
56509998,0cyclictest0-21swapper/321:53:203
56509998,0cyclictest0-21swapper/321:31:213
56509998,0cyclictest0-21swapper/321:23:313
56419998,0cyclictest0-21swapper/220:10:222
56419997,1cyclictest33-21ksoftirqd/223:52:112
56419991,1cyclictest131rcu_sched21:41:292
56419990,1cyclictest121rcu_preempt21:56:172
56379998,0cyclictest0-21swapper/123:57:321
56379998,0cyclictest0-21swapper/123:43:221
56379998,0cyclictest0-21swapper/123:34:221
56379998,0cyclictest0-21swapper/123:21:011
56379998,0cyclictest0-21swapper/122:45:421
56379998,0cyclictest0-21swapper/121:42:101
56379997,1cyclictest32225-21bash23:54:421
56379997,1cyclictest21130-21sshd22:31:511
56309998,0cyclictest101ktimersoftd/020:49:400
56309992,3cyclictest9-21ksoftirqd/021:09:170
56309990,5cyclictest648-21systemd-logind19:20:000
56309990,0cyclictest0-21swapper/019:44:500
56509987,0cyclictest0-21swapper/323:50:213
56509987,0cyclictest0-21swapper/300:04:013
56509987,0cyclictest0-21swapper/300:04:013
56509986,1cyclictest5924-21lspci00:36:233
56509986,1cyclictest23139-21lspci00:15:353
56509985,2cyclictest649-21avahi-daemon22:46:583
56509985,2cyclictest649-21avahi-daemon22:15:323
56509985,2cyclictest646-21dbus-daemon23:03:453
56419987,0cyclictest0-21swapper/221:08:022
56379986,1cyclictest684-21polkitd23:46:121
56379986,1cyclictest6302-21lspci00:26:281
56379986,1cyclictest21312-21lspci21:16:011
56379986,1cyclictest1870-21lspci22:07:531
56379985,2cyclictest649-21avahi-daemon23:00:571
56379985,2cyclictest649-21avahi-daemon22:42:461
56379985,2cyclictest649-21avahi-daemon00:07:171
56309987,0cyclictest0-21swapper/020:20:400
56309987,0cyclictest0-21swapper/019:25:190
56509975,1cyclictest649-21avahi-daemon23:10:373
56509974,2cyclictest26855-21sshd00:25:173
56509973,1cyclictest646-21dbus-daemon21:10:333
56419976,0cyclictest0-21swapper/219:30:212
56379975,1cyclictest8002-21lspci21:27:211
56379975,1cyclictest30806-21sshd21:35:531
56379974,2cyclictest649-21avahi-daemon22:25:181
56379974,2cyclictest649-21avahi-daemon21:14:441
56379973,3cyclictest700-21gdbus22:00:401
56309973,1cyclictest9-21ksoftirqd/019:35:000
56309971,3cyclictest9-21ksoftirqd/019:59:550
56309971,1cyclictest9-21ksoftirqd/020:05:000
56309970,6cyclictest0-21swapper/019:51:590
56309970,3cyclictest9-21ksoftirqd/020:44:540
56509963,2cyclictest646-21dbus-daemon21:00:013
56509963,2cyclictest17299-21snmpd20:22:083
56509960,5cyclictest0-21swapper/319:22:403
56419964,1cyclictest33-21ksoftirqd/220:10:002
56419963,2cyclictest17299-21snmpd20:00:422
56419960,5cyclictest0-21swapper/220:36:322
56419960,1cyclictest131rcu_sched20:40:012
56379963,2cyclictest17299-21snmpd21:06:181
56379963,2cyclictest17299-21snmpd21:03:241
56379963,2cyclictest17299-21snmpd19:51:491
56309963,2cyclictest17299-21snmpd20:58:270
56309962,1cyclictest9-21ksoftirqd/020:50:170
56309961,1cyclictest9-21ksoftirqd/020:35:000
56309961,1cyclictest9-21ksoftirqd/020:25:180
56309961,1cyclictest9-21ksoftirqd/019:50:000
56309961,1cyclictest9-21ksoftirqd/019:39:590
56309960,0cyclictest0-21swapper/020:14:100
56509954,0cyclictest0-21swapper/319:11:413
56509953,1cyclictest75550irq/24-eno1-rx-19:55:143
56509953,1cyclictest649-21avahi-daemon20:44:553
56509953,1cyclictest648-21systemd-logind19:25:003
56509953,1cyclictest646-21dbus-daemon19:15:003
56509953,1cyclictest5057-21cat20:25:163
56509953,1cyclictest22275-21vmstat21:05:243
56509953,1cyclictest17299-21snmpd20:52:423
56509953,1cyclictest17299-21snmpd20:45:333
56509953,1cyclictest17299-21snmpd20:32:323
56509953,1cyclictest17299-21snmpd20:17:593
56509953,1cyclictest17299-21snmpd20:00:043
56509953,1cyclictest17299-21snmpd19:50:343
56509953,1cyclictest17299-21snmpd19:41:463
56509953,1cyclictest17299-21snmpd19:37:193
56509953,1cyclictest17299-21snmpd19:30:553
56509953,1cyclictest1109-21ntpd20:10:173
56509953,1cyclictest1053-21lldpd19:45:543
56509953,1cyclictest0-21swapper/321:00:173
56509952,2cyclictest17299-21snmpd20:39:503
56509950,0cyclictest0-21swapper/320:05:113
56419953,1cyclictest9263-21ntp_states19:15:152
56419953,1cyclictest692-21NetworkManager19:54:552
56419953,1cyclictest684-21polkitd20:55:012
56419953,1cyclictest684-21polkitd20:30:012
56419953,1cyclictest17299-21snmpd20:46:062
56419953,1cyclictest17299-21snmpd20:25:102
56419953,1cyclictest17299-21snmpd20:20:052
56419953,1cyclictest17299-21snmpd20:16:112
56419953,1cyclictest17299-21snmpd19:57:102
56419953,1cyclictest17299-21snmpd19:46:372
56419953,1cyclictest17299-21snmpd19:35:032
56419953,1cyclictest17299-21snmpd19:27:542
56419953,1cyclictest17299-21snmpd19:21:082
56419953,1cyclictest17299-21snmpd19:11:112
56419953,1cyclictest16143-21users20:50:192
56419951,1cyclictest18689-21grep19:40:172
56419951,1cyclictest0-21swapper/221:01:342
56379954,0cyclictest0-21swapper/119:31:311
56379953,1cyclictest9639-21grep19:15:181
56379953,1cyclictest646-21dbus-daemon20:10:001
56379953,1cyclictest17613-21smart_sda19:35:241
56379953,1cyclictest17299-21snmpd20:56:511
56379953,1cyclictest17299-21snmpd20:38:451
56379953,1cyclictest17299-21snmpd20:30:321
56379953,1cyclictest17299-21snmpd20:26:281
56379953,1cyclictest17299-21snmpd20:24:081
56379953,1cyclictest17299-21snmpd20:15:141
56379953,1cyclictest17299-21snmpd20:09:471
56379953,1cyclictest17299-21snmpd19:45:101
56379953,1cyclictest17299-21snmpd19:40:041
56379953,1cyclictest17299-21snmpd19:25:571
56379953,1cyclictest15243-21cat20:50:131
56379953,1cyclictest11173-21cat20:40:151
56379953,1cyclictest1109-21ntpd20:00:171
56379952,2cyclictest646-21dbus-daemon19:55:001
56379950,4cyclictest14087-21grep20:45:211
56379950,4cyclictest0-21swapper/119:14:001
56309951,2cyclictest9-21ksoftirqd/020:35:160
56309951,2cyclictest9-21ksoftirqd/019:10:560
56309951,0cyclictest0-21swapper/020:05:000
56309950,3cyclictest9-21ksoftirqd/020:15:100
56309950,1cyclictest9-21ksoftirqd/019:20:260
56379942,1cyclictest11028-21cat19:20:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional