You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-02 - 22:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack2slot0.osadl.org (updated Sun Nov 02, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
264072950,2sleep2749199cyclictest09:31:162
141032890,0sleep214102-21tty10:59:132
172362880,0sleep20-21swapper/209:26:492
198122790,0sleep30-21swapper/312:25:373
297442610,0sleep00-21swapper/011:01:020
304892590,1sleep330488-21bash10:28:223
41552580,0sleep00-21swapper/009:49:570
94752570,0sleep20-21swapper/210:47:542
256422570,0sleep30-21swapper/310:46:073
22392570,0sleep10-21swapper/109:21:381
235982550,0sleep30-21swapper/309:44:593
107802550,0sleep20-21swapper/209:11:312
288112540,0sleep20-21swapper/211:25:472
315482530,0sleep20-21swapper/210:43:142
294482530,0sleep129444-21bash10:53:421
127832530,0sleep10-21swapper/110:01:041
66602520,0sleep30-21swapper/309:15:033
127332510,0sleep20-21swapper/212:30:592
59552500,0sleep10-21swapper/109:56:591
97502490,0sleep30-21swapper/311:16:433
51982490,0sleep05192-21sshd12:05:460
247342490,0sleep00-21swapper/012:20:080
129392490,0sleep212942-21grep11:06:252
65892480,0sleep20-21swapper/211:51:302
192692470,1sleep119271-21bash11:32:071
38692420,0sleep00-21swapper/012:01:540
162942390,0sleep20-21swapper/211:03:082
72472298,7sleep00-21swapper/007:08:200
701522912,12sleep30-21swapper/307:05:273
78702230,1sleep27871-21bash10:22:112
715322311,7sleep20-21swapper/207:07:102
97362210,0sleep00-21swapper/009:33:030
70082219,7sleep10-21swapper/107:05:211
38842190,0sleep20-21swapper/211:23:082
233162180,4sleep023313-21sshd12:35:060
183642170,1sleep20-21swapper/212:13:302
39802160,0sleep30-21swapper/311:05:263
33922160,0sleep20-21swapper/209:53:202
24222160,1sleep02424-21bash12:30:050
7492991515,0cyclictest401ktimersoftd/311:04:403
23182150,2sleep1748499cyclictest11:08:491
182402150,1sleep118237-21sshd12:22:291
168832150,0sleep016880-21sshd09:58:100
747999140,0cyclictest0-21swapper/012:15:130
211762140,0sleep20-21swapper/212:22:462
209682140,0sleep10-21swapper/112:13:441
749299130,2cyclictest648-21systemd-logind12:10:233
7491991310,2cyclictest0-21swapper/210:25:552
7479991311,1cyclictest0-21swapper/010:14:520
186382130,0sleep10-21swapper/112:28:351
7492991210,1cyclictest41-21ksoftirqd/311:29:383
7492991210,1cyclictest0-21swapper/310:52:023
7492991210,1cyclictest0-21swapper/309:24:223
749299120,1cyclictest2619-21id11:12:223
7491991210,1cyclictest26904-21sshd10:39:042
749199120,11cyclictest0-21swapper/211:30:452
7484991210,1cyclictest29413-21lspci09:31:371
748499120,11cyclictest0-21swapper/110:42:381
7479991210,1cyclictest6108-21sshd09:22:020
7479991210,1cyclictest16736-21sshd10:45:130
747999120,11cyclictest22752-21lspci12:25:530
747999120,11cyclictest0-21swapper/011:55:120
747999120,11cyclictest0-21swapper/011:14:130
747999120,11cyclictest0-21swapper/009:44:030
749299119,1cyclictest41-21ksoftirqd/311:20:043
7492991110,0cyclictest0-21swapper/311:46:533
7492991110,0cyclictest0-21swapper/310:09:413
749299110,10cyclictest0-21swapper/312:34:023
749299110,10cyclictest0-21swapper/309:28:213
7491991110,0cyclictest0-21swapper/211:46:352
7491991110,0cyclictest0-21swapper/210:02:452
749199110,0cyclictest0-21swapper/212:29:352
749199110,0cyclictest0-21swapper/210:13:242
748499119,1cyclictest22595-21sshd10:31:081
748499119,1cyclictest19133-21lspci12:19:381
748499110,10cyclictest0-21swapper/110:07:181
747999119,1cyclictest0-21swapper/010:05:530
7479991110,0cyclictest0-21swapper/011:42:520
7479991110,0cyclictest0-21swapper/010:17:430
747999110,10cyclictest0-21swapper/011:25:520
747999110,10cyclictest0-21swapper/011:21:130
747999110,10cyclictest0-21swapper/011:18:520
747999110,10cyclictest0-21swapper/010:55:030
747999110,10cyclictest0-21swapper/010:33:430
747999110,10cyclictest0-21swapper/009:10:030
62402110,0sleep10-21swapper/112:39:311
84402100,2sleep1748499cyclictest11:02:151
749299109,0cyclictest0-21swapper/310:37:013
749299109,0cyclictest0-21swapper/310:03:323
749299109,0cyclictest0-21swapper/308:42:423
749299109,0cyclictest0-21swapper/307:29:423
749299108,1cyclictest9677-21lspci11:31:033
749299108,1cyclictest8130-21lspci09:39:523
749299108,1cyclictest41-21ksoftirqd/312:00:163
749299108,1cyclictest41-21ksoftirqd/311:35:543
749299108,1cyclictest41-21ksoftirqd/310:43:373
749299108,1cyclictest41-21ksoftirqd/309:59:163
749299106,3cyclictest41-21ksoftirqd/312:17:543
749299101,0cyclictest121rcu_preempt11:55:123
749299100,1cyclictest41-21ksoftirqd/310:15:353
749199109,0cyclictest0-21swapper/210:33:542
749199109,0cyclictest0-21swapper/209:39:052
748499109,0cyclictest0-21swapper/111:49:381
748499109,0cyclictest0-21swapper/110:16:181
748499109,0cyclictest0-21swapper/109:37:581
748499109,0cyclictest0-21swapper/107:20:161
747999103,3cyclictest8191-21munin-run08:30:000
74929998,0cyclictest0-21swapper/310:23:513
74929998,0cyclictest0-21swapper/309:13:323
74929998,0cyclictest0-21swapper/308:54:413
74929997,1cyclictest41-21ksoftirqd/312:08:083
74929997,1cyclictest41-21ksoftirqd/311:51:303
74929997,1cyclictest41-21ksoftirqd/310:31:583
74929997,1cyclictest41-21ksoftirqd/310:14:253
74929997,1cyclictest41-21ksoftirqd/309:50:493
74929997,1cyclictest41-21ksoftirqd/309:45:193
74929996,2cyclictest41-21ksoftirqd/312:39:003
74929991,0cyclictest121rcu_preempt10:56:163
74929991,0cyclictest121rcu_preempt09:30:363
74929990,8cyclictest75550irq/24-eno1-rx-12:20:453
74929990,0cyclictest0-21swapper/308:21:413
74919998,0cyclictest0-21swapper/212:39:052
74919998,0cyclictest0-21swapper/212:01:152
74919990,0cyclictest0-21swapper/208:03:232
74849998,0cyclictest0-21swapper/112:33:171
74849997,1cyclictest9022-21bash09:18:471
74799998,0cyclictest0-21swapper/010:53:520
74799998,0cyclictest0-21swapper/010:28:320
74799998,0cyclictest0-21swapper/010:24:320
74799998,0cyclictest0-21swapper/009:25:030
25033290,0sleep10-21swapper/109:13:341
74929987,0cyclictest0-21swapper/307:48:213
74929987,0cyclictest0-21swapper/307:10:023
74929986,1cyclictest41-21ksoftirqd/311:40:153
74919987,0cyclictest0-21swapper/210:54:052
74919986,1cyclictest1077-21lspci09:21:312
74919984,3cyclictest3933-21sshd11:58:232
74919983,4cyclictest700-21gdbus09:19:162
74849987,0cyclictest0-21swapper/112:01:581
74849987,0cyclictest0-21swapper/110:48:571
74849987,0cyclictest0-21swapper/109:26:281
74849986,1cyclictest1559-21lspci10:57:521
74849985,2cyclictest649-21avahi-daemon11:16:421
74849985,2cyclictest649-21avahi-daemon10:37:091
74849985,2cyclictest649-21avahi-daemon09:54:531
74799987,0cyclictest0-21swapper/011:09:320
74799987,0cyclictest0-21swapper/009:19:430
22337280,0sleep10-21swapper/111:10:571
74929976,0cyclictest0-21swapper/308:04:413
74929976,0cyclictest0-21swapper/307:55:313
74929975,1cyclictest41-21ksoftirqd/307:40:003
74919976,1cyclictest30837-21lspci10:06:262
74919975,1cyclictest649-21avahi-daemon12:05:132
74919975,1cyclictest24600-21sshd09:41:362
74919975,1cyclictest21280-21lspci11:35:482
74919975,1cyclictest0-21swapper/210:15:052
74919974,2cyclictest646-21dbus-daemon11:40:062
74919974,1cyclictest519-21sshd11:15:352
74919974,1cyclictest15224-21sshd09:57:592
74919973,3cyclictest443-21systemd-journal09:47:342
74919972,2cyclictest31898-21sshd11:12:012
74919970,6cyclictest2378-21sshd12:15:022
74849976,0cyclictest0-21swapper/111:50:471
74849976,0cyclictest0-21swapper/111:36:081
74849975,1cyclictest7003-21sshd10:22:051
74849975,1cyclictest646-21dbus-daemon11:41:271
74849975,1cyclictest618-13audispd11:21:561
74849975,1cyclictest32510-21sshd12:05:151
74849974,2cyclictest14415-21sshd10:26:371
74849973,3cyclictest648-21systemd-logind09:07:151
74849970,6cyclictest32123-21sshd10:14:031
74849970,6cyclictest22216-21sshd09:02:411
74799976,0cyclictest0-21swapper/008:54:420
74799975,1cyclictest9-21ksoftirqd/011:31:170
74799975,1cyclictest8991-21lspci11:51:480
74799975,1cyclictest649-21avahi-daemon12:10:190
74799974,2cyclictest649-21avahi-daemon11:38:400
74799974,2cyclictest649-21avahi-daemon10:41:160
74799974,2cyclictest4595-21sshd09:36:000
74799974,2cyclictest18288-21sshd11:45:540
74799970,6cyclictest1873-21sshd10:39:540
23740270,0sleep00-21swapper/009:52:020
74929965,0cyclictest0-21swapper/307:20:213
74929964,1cyclictest41-21ksoftirqd/309:00:013
74929964,1cyclictest41-21ksoftirqd/308:40:003
74929964,1cyclictest41-21ksoftirqd/308:15:003
74929964,1cyclictest0-21swapper/308:50:013
74929963,2cyclictest681-21gdbus09:07:413
74919963,2cyclictest684-21polkitd09:06:292
74919963,2cyclictest646-21dbus-daemon07:55:002
74849965,0cyclictest0-21swapper/107:16:071
74849964,1cyclictest684-21polkitd11:25:031
74849964,1cyclictest649-21avahi-daemon09:45:061
74849964,1cyclictest11180-21sshd09:40:111
74849963,2cyclictest17299-21snmpd07:38:251
74849962,2cyclictest5361-21sshd11:55:011
74799964,1cyclictest5721-21sshd10:00:190
74799962,3cyclictest370-21jbd2/sda1-809:06:280
74929954,0cyclictest41-21ksoftirqd/308:10:013
74929953,1cyclictest6682-21tail08:25:123
74929953,1cyclictest41-21ksoftirqd/308:35:013
74929953,1cyclictest21063-21cat09:00:133
74929953,1cyclictest17299-21snmpd08:18:243
74929953,1cyclictest17299-21snmpd07:43:023
74929953,1cyclictest17299-21snmpd07:30:493
74929953,1cyclictest17299-21snmpd07:15:063
74919954,0cyclictest0-21swapper/207:40:142
74919953,1cyclictest22945-21cat07:45:122
74919953,1cyclictest17299-21snmpd09:02:402
74919953,1cyclictest17299-21snmpd08:55:442
74919953,1cyclictest17299-21snmpd08:40:482
74919953,1cyclictest17299-21snmpd08:37:392
74919953,1cyclictest17299-21snmpd08:30:042
74919953,1cyclictest17299-21snmpd08:25:292
74919953,1cyclictest17299-21snmpd08:21:302
74919953,1cyclictest17299-21snmpd08:15:542
74919953,1cyclictest17299-21snmpd08:13:052
74919953,1cyclictest17299-21snmpd08:09:152
74919953,1cyclictest17299-21snmpd07:56:072
74919953,1cyclictest17299-21snmpd07:36:372
74919953,1cyclictest17299-21snmpd07:30:072
74919953,1cyclictest17299-21snmpd07:26:412
74919953,1cyclictest17299-21snmpd07:24:132
74919953,1cyclictest17299-21snmpd07:15:222
74919953,1cyclictest14987-21mii-tool08:45:172
74919952,2cyclictest17711-21sed08:50:182
74919950,1cyclictest7672-21/usr/sbin/munin07:10:172
74849954,0cyclictest0-21swapper/107:11:561
74849953,1cyclictest684-21polkitd08:01:001
74849953,1cyclictest4419-21cpuspeed_turbos08:20:141
74849953,1cyclictest22909-21cat07:45:121
74849953,1cyclictest20903-21mii-tool07:40:171
74849953,1cyclictest17299-21snmpd08:58:251
74849953,1cyclictest17299-21snmpd08:40:001
74849953,1cyclictest17299-21snmpd08:31:341
74849953,1cyclictest17299-21snmpd08:15:501
74849953,1cyclictest17299-21snmpd08:05:091
74849953,1cyclictest17299-21snmpd07:57:081
74849953,1cyclictest17299-21snmpd07:51:171
74849953,1cyclictest14815-21cat07:25:141
74849953,1cyclictest10902-21cat08:35:141
74849952,2cyclictest17299-21snmpd08:14:111
74849952,2cyclictest0-21swapper/108:25:121
74849950,4cyclictest16105-21sshd08:47:411
74799954,0cyclictest0-21swapper/009:00:130
74799953,1cyclictest9540-21kworker/0:007:20:120
74799953,1cyclictest9468-21latency_hist07:15:000
74799953,1cyclictest4685-21grep08:20:150
74799953,1cyclictest29009-21cat08:00:130
74799953,1cyclictest23599-21xargs07:45:180
74799953,1cyclictest18880-21cat07:35:140
74799953,1cyclictest17299-21snmpd08:48:580
74799953,1cyclictest17299-21snmpd08:44:510
74799953,1cyclictest17299-21snmpd08:35:130
74799953,1cyclictest17299-21snmpd08:32:040
74799953,1cyclictest17299-21snmpd08:15:320
74799953,1cyclictest17299-21snmpd08:12:270
74799953,1cyclictest17299-21snmpd08:07:060
74799953,1cyclictest17299-21snmpd07:56:260
74799953,1cyclictest17299-21snmpd07:51:100
74799953,1cyclictest17299-21snmpd07:40:260
74799953,1cyclictest17299-21snmpd07:34:590
74799952,2cyclictest7778-21tr07:10:110
74799950,4cyclictest0-21swapper/008:56:320
74929942,1cyclictest0-21swapper/307:50:143
74849942,1cyclictest16897-21grep08:50:121
74849942,1cyclictest0-21swapper/107:30:171
74799942,1cyclictest0-21swapper/007:25:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional