You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-29 - 01:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack2slot0.osadl.org (updated Sat Jun 28, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
712921050,1sleep0880499cyclictest11:24:420
3209921000,0sleep00-21swapper/011:33:580
1060221000,0sleep00-21swapper/010:25:050
309632990,2sleep3882199cyclictest12:02:053
43632900,0sleep34236-21sshd11:27:453
246932770,1sleep3401ktimersoftd/311:33:103
269652760,0sleep30-21swapper/311:20:163
237882660,0sleep10-21swapper/109:59:151
294752610,0sleep10-21swapper/109:53:071
172692600,0sleep20-21swapper/211:19:192
70202560,1sleep27018-21sshd11:51:152
228072550,0sleep00-21swapper/012:29:510
60082540,0sleep10-21swapper/109:47:301
68092530,1sleep11-21systemd11:37:521
139952520,0sleep10-21swapper/110:59:111
44332510,0sleep00-21swapper/010:58:070
250732510,0sleep20-21swapper/212:38:342
232542510,1sleep21-21systemd12:07:052
231922510,0sleep10-21swapper/110:36:241
86132500,0sleep0111rcuc/009:38:030
104462500,1sleep30-21swapper/312:11:383
230332490,0sleep00-21swapper/009:19:450
72142480,0sleep20-21swapper/210:00:492
39502480,1sleep09-21ksoftirqd/009:40:440
169782480,0sleep30-21swapper/312:15:073
148232480,0sleep30-21swapper/310:52:163
43882470,0sleep30-21swapper/310:17:193
164582470,0sleep0111rcuc/011:09:190
7472460,0sleep10-21swapper/109:24:111
104302460,0sleep10-21swapper/111:44:571
316292430,2sleep3882199cyclictest12:07:503
843324130,7sleep00-21swapper/007:06:330
17962400,0sleep20-21swapper/210:27:242
193162350,0sleep00-21swapper/012:32:180
84082308,7sleep30-21swapper/307:06:153
860722615,6sleep20-21swapper/207:08:422
26362240,0sleep32637-21tty11:53:563
839622210,7sleep10-21swapper/107:06:051
158532220,1sleep115851-21lspci12:00:431
274912190,1sleep3401ktimersoftd/310:33:263
125482170,3sleep10-21swapper/111:05:281
8816991614,1cyclictest7009-21lspci09:31:172
229722160,0sleep10-21swapper/110:02:281
148822160,1sleep114880-21lspci12:14:581
95092150,0sleep39507-21bash12:25:443
4682150,0sleep3466-21lspci09:50:163
23802150,0sleep20-21swapper/212:13:512
229862150,0sleep30-21swapper/312:38:223
8816991413,0cyclictest9242-21lspci11:05:162
8816991413,0cyclictest12600-21lspci11:02:172
226862140,0sleep20-21swapper/211:39:292
217982140,0sleep00-21swapper/011:26:090
175552140,0sleep20-21swapper/212:15:102
98702130,1sleep0101ktimersoftd/011:54:370
8821991311,1cyclictest646-21dbus-daemon10:36:213
8821991311,1cyclictest0-21swapper/310:09:113
882199130,1cyclictest1-21systemd09:28:213
8816991312,0cyclictest321ktimersoftd/211:32:062
880999130,1cyclictest648-21systemd-logind11:10:441
880999130,1cyclictest0-21swapper/110:43:551
880499130,1cyclictest619-17sedispatch09:21:050
880499130,12cyclictest1-21systemd12:16:450
103862130,0sleep20-21swapper/211:11:542
8821991210,1cyclictest646-21dbus-daemon12:21:123
882199120,1cyclictest9033-21bash10:14:313
881699120,11cyclictest12012-21sshd12:03:172
881699120,11cyclictest10324-21lspci11:57:272
881699120,11cyclictest0-21swapper/211:23:172
8809991210,1cyclictest7125-21sshd10:10:541
880499120,11cyclictest0-21swapper/010:20:450
77372120,1sleep09-21ksoftirqd/011:01:460
205362120,0sleep10-21swapper/112:35:161
133952120,0sleep00-21swapper/009:45:040
882199119,1cyclictest2441-21sshd11:01:113
8821991110,0cyclictest9112-21sshd11:57:223
8821991110,0cyclictest0-21swapper/310:42:113
882199110,10cyclictest0-21swapper/311:37:513
882199110,10cyclictest0-21swapper/310:25:123
882199110,10cyclictest0-21swapper/309:56:113
882199110,10cyclictest0-21swapper/308:00:003
882199110,0cyclictest0-21swapper/309:45:413
882199110,0cyclictest0-21swapper/309:20:413
881699119,1cyclictest33-21ksoftirqd/210:31:332
881699119,1cyclictest33-21ksoftirqd/209:59:592
881699114,1cyclictest33-21ksoftirqd/211:40:572
8816991110,0cyclictest5557-21lspci10:44:542
8816991110,0cyclictest24668-21lspci09:26:332
881699110,1cyclictest33-21ksoftirqd/209:39:332
881699110,10cyclictest0-21swapper/212:21:172
881699110,10cyclictest0-21swapper/210:54:272
881699110,10cyclictest0-21swapper/210:19:582
881699110,10cyclictest0-21swapper/208:44:572
8809991110,0cyclictest0-21swapper/111:02:541
880999110,10cyclictest0-21swapper/110:16:151
880999110,0cyclictest0-21swapper/112:27:441
880999110,0cyclictest0-21swapper/110:26:541
880499119,1cyclictest1011-21sshd11:38:450
8804991110,0cyclictest0-21swapper/012:04:360
8804991110,0cyclictest0-21swapper/010:00:550
8804991110,0cyclictest0-21swapper/009:52:460
880499110,10cyclictest0-21swapper/010:05:150
880499110,0cyclictest0-21swapper/010:15:250
882199109,0cyclictest0-21swapper/312:33:413
882199109,0cyclictest0-21swapper/311:08:323
882199108,1cyclictest0-21swapper/310:00:023
882199108,1cyclictest0-21swapper/309:38:113
881699109,0cyclictest0-21swapper/209:45:472
881699108,1cyclictest33-21ksoftirqd/210:56:022
881699108,1cyclictest33-21ksoftirqd/210:45:232
881699108,1cyclictest33-21ksoftirqd/210:05:192
881699105,2cyclictest33-21ksoftirqd/210:10:082
881699105,1cyclictest33-21ksoftirqd/209:14:192
881699102,1cyclictest33-21ksoftirqd/212:25:552
881699101,1cyclictest33-21ksoftirqd/209:51:272
881699101,1cyclictest131rcu_sched09:21:072
881699100,9cyclictest0-21swapper/208:52:572
881699100,1cyclictest0-21swapper/209:42:452
880999109,0cyclictest0-21swapper/112:34:241
880999109,0cyclictest0-21swapper/111:24:551
880999109,0cyclictest0-21swapper/110:32:141
880999108,1cyclictest25-21ksoftirqd/111:57:191
880999100,0cyclictest0-21swapper/111:32:141
880999100,0cyclictest0-21swapper/110:49:441
880999100,0cyclictest0-21swapper/110:21:341
880999100,0cyclictest0-21swapper/109:44:041
880999100,0cyclictest0-21swapper/109:29:341
880499109,0cyclictest0-21swapper/011:16:150
880499109,0cyclictest0-21swapper/010:31:260
880499109,0cyclictest0-21swapper/009:07:450
880499109,0cyclictest0-21swapper/007:30:140
880499108,1cyclictest648-21systemd-logind09:31:350
880499100,0cyclictest0-21swapper/010:48:550
136212100,1sleep2681-21gdbus11:48:342
88219998,0cyclictest0-21swapper/311:15:513
88219998,0cyclictest0-21swapper/308:59:413
88219998,0cyclictest0-21swapper/308:35:003
88219998,0cyclictest0-21swapper/307:30:303
88219990,8cyclictest5504-21sshd10:21:073
88169997,1cyclictest33-21ksoftirqd/212:30:052
88169997,1cyclictest33-21ksoftirqd/211:27:142
88169990,1cyclictest131rcu_sched10:39:422
88169990,1cyclictest121rcu_preempt09:16:352
88099998,0cyclictest0-21swapper/112:22:241
88099998,0cyclictest0-21swapper/111:17:341
88099991,1cyclictest131rcu_sched11:50:081
88049998,0cyclictest0-21swapper/012:22:350
88049998,0cyclictest0-21swapper/012:10:250
88049998,0cyclictest0-21swapper/011:46:050
88049998,0cyclictest0-21swapper/010:42:350
88049998,0cyclictest0-21swapper/010:10:050
88049998,0cyclictest0-21swapper/009:28:160
88049997,1cyclictest9-21ksoftirqd/010:51:120
88049997,1cyclictest1064-21lspci11:40:270
88219987,0cyclictest0-21swapper/309:33:313
88219987,0cyclictest0-21swapper/309:10:413
88219985,2cyclictest649-21avahi-daemon11:41:083
88219985,2cyclictest646-21dbus-daemon10:55:313
88219985,2cyclictest18224-21sshd10:49:283
88169986,1cyclictest33-21ksoftirqd/210:20:042
88099987,0cyclictest0-21swapper/108:10:431
88099986,1cyclictest700-21gdbus09:18:031
88099986,1cyclictest25-21ksoftirqd/111:48:261
88099986,1cyclictest25-21ksoftirqd/110:09:521
88099986,1cyclictest25-21ksoftirqd/109:32:241
88099986,1cyclictest25-21ksoftirqd/109:13:501
88099986,1cyclictest18575-21lspci09:35:491
88099985,2cyclictest646-21dbus-daemon10:51:451
88099982,1cyclictest131rcu_sched11:29:581
88099980,1cyclictest0-21swapper/112:06:121
88049987,0cyclictest0-21swapper/010:36:450
88049986,2cyclictest26745-21kworker/0:411:10:520
88049986,1cyclictest28163-21lspci12:38:490
88049986,1cyclictest26835-21lspci12:07:250
88049986,1cyclictest25831-21lspci11:58:510
28046280,1sleep328049-21bash11:10:223
88219976,0cyclictest0-21swapper/309:40:313
88219976,0cyclictest0-21swapper/308:20:503
88219973,3cyclictest646-21dbus-daemon09:08:213
88219973,2cyclictest649-21avahi-daemon11:45:573
88219970,6cyclictest11853-21sshd09:15:153
88169976,0cyclictest0-21swapper/207:10:172
88169972,1cyclictest21544-21munin-run07:40:002
88169970,1cyclictest33-21ksoftirqd/209:09:052
88099976,0cyclictest0-21swapper/109:00:231
88099975,1cyclictest25-21ksoftirqd/112:15:241
88049976,0cyclictest0-21swapper/009:56:350
88049975,1cyclictest8179-21sshd09:10:590
88219965,0cyclictest0-21swapper/307:51:003
88219965,0cyclictest0-21swapper/307:38:403
88219965,0cyclictest0-21swapper/307:15:413
88219963,2cyclictest17299-21snmpd08:48:133
88219963,2cyclictest17299-21snmpd07:58:423
88219962,3cyclictest646-21dbus-daemon08:45:003
88219960,5cyclictest0-21swapper/309:03:303
88219960,5cyclictest0-21swapper/308:27:103
88219960,5cyclictest0-21swapper/307:42:313
88169964,1cyclictest649-21avahi-daemon07:49:592
88169964,1cyclictest33-21ksoftirqd/208:10:002
88169964,1cyclictest1-21systemd08:40:002
88169962,1cyclictest0-21swapper/208:02:402
88099965,0cyclictest0-21swapper/108:00:331
88099965,0cyclictest0-21swapper/107:20:331
88099964,1cyclictest684-21polkitd09:07:581
88099963,2cyclictest646-21dbus-daemon08:50:011
88099963,2cyclictest17299-21snmpd07:19:231
88049966,0cyclictest9583-21kworker/0:008:45:000
88049966,0cyclictest9583-21kworker/0:008:36:070
88049966,0cyclictest9583-21kworker/0:008:32:140
88049966,0cyclictest450-21kworker/0:107:16:580
88049962,3cyclictest31729-21munin-run08:05:000
88219953,1cyclictest649-21avahi-daemon08:30:583
88219953,1cyclictest17299-21snmpd08:50:253
88219953,1cyclictest17299-21snmpd08:15:033
88219953,1cyclictest17299-21snmpd08:12:393
88219953,1cyclictest17299-21snmpd08:09:433
88219953,1cyclictest17299-21snmpd07:45:353
88219953,1cyclictest17299-21snmpd07:26:383
88219953,1cyclictest10329-21unixbench_multi07:10:253
88219950,0cyclictest0-21swapper/307:22:503
88169954,0cyclictest33-21ksoftirqd/209:00:002
88169953,1cyclictest8240-21cat08:25:172
88169953,1cyclictest700-21gdbus07:54:542
88169953,1cyclictest6177-21cat08:20:182
88169953,1cyclictest4714-21runrttasks08:15:222
88169953,1cyclictest33-21ksoftirqd/207:40:012
88169953,1cyclictest18159-21cat07:30:152
88169953,1cyclictest17299-21snmpd09:01:322
88169953,1cyclictest17299-21snmpd08:45:052
88169953,1cyclictest17299-21snmpd08:13:542
88169953,1cyclictest17299-21snmpd07:58:042
88169953,1cyclictest17299-21snmpd07:25:082
88169953,1cyclictest17299-21snmpd07:18:592
88169953,1cyclictest10290-21cat08:30:162
88169950,4cyclictest0-21swapper/207:22:272
88099953,1cyclictest9501-21cat07:10:191
88099953,1cyclictest7508-21crond08:25:001
88099953,1cyclictest26325-21mii-tool07:50:201
88099953,1cyclictest22265-21cat07:40:151
88099953,1cyclictest18195-21cat07:30:161
88099953,1cyclictest17299-21snmpd08:20:071
88099953,1cyclictest17299-21snmpd08:17:301
88099953,1cyclictest17299-21snmpd08:06:121
88099953,1cyclictest17299-21snmpd07:56:491
88099953,1cyclictest17299-21snmpd07:49:121
88099953,1cyclictest17299-21snmpd07:27:321
88099953,1cyclictest14359-21cat08:40:161
88099953,1cyclictest10961-21sed08:30:221
88099952,2cyclictest17299-21snmpd08:55:291
88049953,1cyclictest6213-21cat08:20:170
88049953,1cyclictest32450-21cat08:05:170
88049953,1cyclictest1954-21grep08:10:150
88049953,1cyclictest17299-21snmpd08:55:470
88049953,1cyclictest17299-21snmpd08:17:090
88049953,1cyclictest17299-21snmpd07:55:030
88049953,1cyclictest17299-21snmpd07:43:200
88049953,1cyclictest17299-21snmpd07:27:440
88049953,1cyclictest17299-21snmpd07:24:320
88049953,1cyclictest10890-21which07:15:000
88049953,1cyclictest1058-21sendmail09:00:070
88049953,1cyclictest1053-21lldpd08:52:310
88049952,2cyclictest646-21dbus-daemon08:29:550
88049952,2cyclictest24833-21grep07:45:210
88049952,2cyclictest20948-21wc07:35:220
88049952,2cyclictest17299-21snmpd07:50:030
18811250,0sleep10-21swapper/108:50:201
88099942,1cyclictest20192-21if_eno107:35:161
88099942,1cyclictest11950-21cpuspeed_turbos08:35:171
88049942,1cyclictest14691-21nfsd408:40:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional