You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 02:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Sun Nov 16, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
267462950,0sleep10-21swapper/122:51:271
90912610,0sleep00-21swapper/000:07:560
73652610,0sleep30-21swapper/322:46:163
296782600,0sleep30-21swapper/322:25:483
178002580,0sleep00-21swapper/021:16:320
145772580,0sleep20-21swapper/200:37:482
199012570,0sleep10-21swapper/121:43:051
317492560,0sleep00-21swapper/000:03:340
304302560,0sleep20-21swapper/222:55:072
263672560,0sleep20-21swapper/222:54:442
270002550,0sleep20-21swapper/221:56:412
290062540,0sleep00-21swapper/000:10:150
26572540,1sleep32653-21bash23:05:133
186192540,1sleep218621-21bash23:10:062
121812540,0sleep30-21swapper/322:43:353
114642540,0sleep20-21swapper/223:18:592
271672520,0sleep00-21swapper/020:15:140
308502510,0sleep10-21swapper/122:35:371
27512510,0sleep20-21swapper/221:38:022
198402510,0sleep00-21swapper/023:13:240
56412500,2sleep23218799cyclictest00:04:132
110472500,0sleep10-21swapper/122:33:431
52552490,1sleep341-21ksoftirqd/321:57:463
253512490,0sleep00-21swapper/023:04:190
69622480,0sleep30-21swapper/321:45:043
72472440,2sleep33218899cyclictest00:25:253
311442410,0sleep30-21swapper/322:03:303
327262380,1sleep032722-21sshd23:08:160
320602319,7sleep00-21swapper/019:09:450
318882319,7sleep20-21swapper/219:07:382
179462310,13sleep375550irq/24-eno1-rx-23:32:453
3176023018,7sleep10-21swapper/119:06:061
320332298,7sleep30-21swapper/319:09:233
269942230,0sleep10-21swapper/121:53:311
182952200,1sleep3391rcuc/321:29:493
9832170,0sleep30-21swapper/322:19:523
46702170,0sleep10-21swapper/123:02:121
266432170,2sleep03218399cyclictest21:56:380
238482170,0sleep10-21swapper/121:46:421
216372160,1sleep321628-21sshd23:39:353
142742160,0sleep10-21swapper/100:15:381
63732150,1sleep36364-21sshd23:57:443
301552150,0sleep130158-21bash23:33:591
294532150,0sleep00-21swapper/021:24:260
275162150,1sleep027513-21lspci00:24:100
108992150,0sleep30-21swapper/322:07:553
106322150,0sleep2321ktimersoftd/222:33:402
78912140,0sleep00-21swapper/023:18:370
322912140,0sleep00-21swapper/021:14:490
32183991412,1cyclictest9-21ksoftirqd/022:00:350
254262140,1sleep325429-21bash22:12:363
199732140,0sleep30-21swapper/300:23:163
171712140,0sleep00-21swapper/021:46:010
121402140,0sleep012137-21sshd21:25:510
57702130,0sleep2321ktimersoftd/220:40:192
32187991311,1cyclictest0-21swapper/222:35:032
3218799130,1cyclictest0-21swapper/223:05:122
3218799130,12cyclictest8805-21bash23:21:522
32183991311,1cyclictest0-21swapper/021:37:330
284812130,0sleep20-21swapper/223:27:122
32188991210,1cyclictest31262-21sshd00:32:003
3218899120,11cyclictest0-21swapper/321:21:413
3218899120,11cyclictest0-21swapper/300:18:513
3218899120,11cyclictest0-21swapper/300:09:403
32187991211,0cyclictest14107-21lspci00:08:312
32187991210,1cyclictest33-21ksoftirqd/222:25:162
3218799120,1cyclictest11555-21sshd21:42:122
3218799120,1cyclictest10791-21sshd22:14:232
32186991211,0cyclictest0-21swapper/100:10:061
3218699120,1cyclictest3361-21tty23:54:071
3218699120,1cyclictest15043-21lspci21:55:261
3218699120,11cyclictest0-21swapper/121:09:571
3218399124,4cyclictest10720-21munin-run20:55:000
32183991210,1cyclictest0-21swapper/023:44:140
3218399120,1cyclictest16292-21sshd23:35:430
3218399120,11cyclictest0-21swapper/022:16:240
3218399120,11cyclictest0-21swapper/021:50:130
286302120,0sleep10-21swapper/122:25:431
154032120,0sleep20-21swapper/200:19:192
3218899110,10cyclictest0-21swapper/323:11:313
3218899110,10cyclictest0-21swapper/321:16:203
3218899110,0cyclictest0-21swapper/300:01:413
3218799119,1cyclictest8119-21lspci21:54:522
3218799119,1cyclictest33-21ksoftirqd/223:35:552
3218799119,1cyclictest33-21ksoftirqd/223:00:132
3218799119,1cyclictest33-21ksoftirqd/200:20:142
3218799119,1cyclictest29896-21sshd22:06:322
32187991110,0cyclictest0-21swapper/222:49:332
32187991110,0cyclictest0-21swapper/221:46:032
3218799110,10cyclictest0-21swapper/223:40:232
3218799110,10cyclictest0-21swapper/222:04:532
3218799110,10cyclictest0-21swapper/200:10:022
3218799110,0cyclictest0-21swapper/223:47:122
3218799110,0cyclictest0-21swapper/221:28:022
3218699119,1cyclictest0-21swapper/100:32:271
32186991110,0cyclictest0-21swapper/100:28:271
3218699110,10cyclictest0-21swapper/123:21:561
3218699110,0cyclictest0-21swapper/122:05:261
3218399119,1cyclictest6992-21lspci23:51:040
3218399119,1cyclictest3240-21sshd21:31:320
3218399113,4cyclictest10514-21munin-run19:35:000
3218399110,0cyclictest0-21swapper/021:43:020
3218899109,0cyclictest0-21swapper/323:53:413
3218899109,0cyclictest0-21swapper/323:04:513
3218899109,0cyclictest0-21swapper/322:39:413
3218899109,0cyclictest0-21swapper/321:53:203
3218899109,0cyclictest0-21swapper/321:35:113
3218899109,0cyclictest0-21swapper/321:09:313
3218899108,1cyclictest3589-21bash23:18:103
3218899100,0cyclictest0-21swapper/323:44:003
3218899100,0cyclictest0-21swapper/319:30:503
3218799109,0cyclictest29819-21sshd21:14:332
3218799109,0cyclictest0-21swapper/223:50:032
3218799109,0cyclictest0-21swapper/222:22:132
3218799108,1cyclictest33-21ksoftirqd/222:40:282
3218799108,1cyclictest33-21ksoftirqd/221:34:382
3218799100,1cyclictest33-21ksoftirqd/223:55:262
3218699109,0cyclictest0-21swapper/123:43:171
3218699109,0cyclictest0-21swapper/121:17:161
3218699100,0cyclictest0-21swapper/122:41:461
3218699100,0cyclictest0-21swapper/121:24:471
3218699100,0cyclictest0-21swapper/121:13:571
3218399109,0cyclictest10366-21sshd00:33:240
3218399109,0cyclictest0-21swapper/022:10:140
3218399108,1cyclictest8176-21sshd00:15:040
3218399108,1cyclictest28582-21lspci22:22:330
3218399100,0cyclictest0-21swapper/023:21:430
169112100,2sleep23218799cyclictest21:23:082
321889998,0cyclictest0-21swapper/323:27:413
321889998,0cyclictest0-21swapper/320:50:013
321889998,0cyclictest0-21swapper/300:36:013
321879998,0cyclictest0-21swapper/221:18:222
321879997,1cyclictest33-21ksoftirqd/223:30:162
321879997,1cyclictest33-21ksoftirqd/222:15:122
321879997,1cyclictest33-21ksoftirqd/200:30:592
321879996,1cyclictest33-21ksoftirqd/200:26:402
321869998,0cyclictest0-21swapper/122:45:071
321869998,0cyclictest0-21swapper/122:21:071
321869997,1cyclictest0-21swapper/120:20:171
321839998,0cyclictest0-21swapper/022:58:530
321839998,0cyclictest0-21swapper/022:52:440
321839998,0cyclictest0-21swapper/022:44:540
321839998,0cyclictest0-21swapper/000:37:230
321839997,1cyclictest9-21ksoftirqd/023:46:270
14491290,0sleep10-21swapper/122:14:461
321889987,0cyclictest0-21swapper/323:46:513
321889987,0cyclictest0-21swapper/322:57:013
321889986,1cyclictest5954-21lspci23:24:573
321889986,1cyclictest23662-21lspci21:30:193
321889986,1cyclictest11058-21cp21:12:213
321889985,2cyclictest649-21avahi-daemon22:31:513
321879986,1cyclictest33-21ksoftirqd/221:10:012
321869987,0cyclictest0-21swapper/123:56:561
321869987,0cyclictest0-21swapper/121:37:471
321869987,0cyclictest0-21swapper/100:36:261
321869986,1cyclictest8747-21lspci00:01:131
321869986,1cyclictest6770-21lspci22:01:031
321869986,1cyclictest11598-21lspci23:45:031
321869985,2cyclictest649-21avahi-daemon23:05:151
321869985,2cyclictest649-21avahi-daemon22:55:151
321869985,2cyclictest649-21avahi-daemon21:30:071
321869984,3cyclictest32595-21sshd00:21:051
321869984,3cyclictest19070-21sshd22:15:121
321839986,1cyclictest7445-21lspci22:36:320
321839986,1cyclictest3181-21lspci23:57:250
321839985,2cyclictest649-21avahi-daemon23:29:070
321839980,0cyclictest121rcu_preempt23:34:560
26492280,1sleep126488-21lspci23:17:141
2636280,0sleep00-21swapper/022:26:220
13641280,0sleep30-21swapper/322:50:123
11099280,1sleep2321ktimersoftd/220:55:172
321889976,0cyclictest0-21swapper/320:00:313
321889975,1cyclictest3426-21lspci22:23:173
321889975,1cyclictest14503-21sshd00:12:083
321889974,2cyclictest31618-21sshd21:44:183
321879976,0cyclictest0-21swapper/220:50:222
321879976,0cyclictest0-21swapper/219:52:132
321879975,1cyclictest33-21ksoftirqd/219:30:002
321879974,2cyclictest649-21avahi-daemon20:00:002
321869976,0cyclictest0-21swapper/120:45:171
321869975,1cyclictest649-21avahi-daemon23:10:241
321869975,1cyclictest10817-21sshd21:25:431
321869974,2cyclictest646-21dbus-daemon23:26:091
321869974,2cyclictest28687-21sshd00:06:281
321869974,2cyclictest19036-21sshd23:36:011
321869970,6cyclictest0-21swapper/119:52:271
321839976,0cyclictest0-21swapper/021:08:320
321839975,1cyclictest9-21ksoftirqd/022:46:370
321839975,1cyclictest9-21ksoftirqd/022:05:200
321839975,1cyclictest9-21ksoftirqd/000:26:550
321839974,2cyclictest646-21dbus-daemon22:32:210
321889965,0cyclictest0-21swapper/320:54:013
321889965,0cyclictest0-21swapper/319:49:503
321889963,2cyclictest17299-21snmpd19:25:373
321889960,5cyclictest0-21swapper/319:19:103
321889960,0cyclictest0-21swapper/320:28:013
321889960,0cyclictest0-21swapper/319:24:203
321879964,1cyclictest33-21ksoftirqd/220:35:012
321879964,1cyclictest33-21ksoftirqd/220:14:592
321879964,1cyclictest33-21ksoftirqd/219:35:002
321879963,2cyclictest17299-21snmpd20:49:302
321869965,0cyclictest0-21swapper/120:10:261
321869960,5cyclictest0-21swapper/120:56:071
321869960,5cyclictest0-21swapper/119:26:271
321839960,5cyclictest0-21swapper/020:25:020
321889953,1cyclictest5191-21grep20:40:153
321889953,1cyclictest3975-21ls20:35:223
321889953,1cyclictest395-21mii-tool19:10:173
321889953,1cyclictest29510-21cat20:20:163
321889953,1cyclictest25303-21tail20:10:153
321889953,1cyclictest17299-21snmpd20:55:333
321889953,1cyclictest17299-21snmpd20:30:483
321889953,1cyclictest17299-21snmpd20:19:443
321889953,1cyclictest17299-21snmpd19:57:013
321889953,1cyclictest17299-21snmpd19:53:263
321889953,1cyclictest17299-21snmpd19:36:263
321889952,2cyclictest13404-21basename21:00:133
321889952,2cyclictest13257-21if_err_eno119:40:173
321889950,4cyclictest23388-21cat20:05:153
321879953,1cyclictest682-21lsmd19:43:252
321879953,1cyclictest682-21lsmd19:10:082
321879953,1cyclictest31544-21cat20:25:152
321879953,1cyclictest17299-21snmpd20:35:322
321879953,1cyclictest17299-21snmpd20:22:052
321879953,1cyclictest17299-21snmpd20:17:442
321879953,1cyclictest17299-21snmpd20:00:432
321879953,1cyclictest17299-21snmpd19:45:342
321879953,1cyclictest17299-21snmpd19:36:492
321879953,1cyclictest17299-21snmpd19:20:452
321879953,1cyclictest17299-21snmpd19:15:042
321879952,2cyclictest0-21swapper/221:00:062
321879951,1cyclictest0-21swapper/220:05:482
321869954,0cyclictest0-21swapper/120:36:471
321869953,1cyclictest32672-21gltestperf19:10:151
321869953,1cyclictest31581-21cat20:25:151
321869953,1cyclictest21833-21pmu-power20:00:151
321869953,1cyclictest1920-21munin-node19:15:011
321869953,1cyclictest17299-21snmpd21:00:421
321869953,1cyclictest17299-21snmpd20:50:111
321869953,1cyclictest17299-21snmpd20:43:571
321869953,1cyclictest17299-21snmpd20:30:361
321869953,1cyclictest17299-21snmpd20:19:171
321869953,1cyclictest17299-21snmpd19:40:381
321869953,1cyclictest17299-21snmpd19:35:461
321869953,1cyclictest17299-21snmpd19:33:221
321869953,1cyclictest17299-21snmpd19:23:031
321869953,1cyclictest15301-21cat19:45:161
321869952,2cyclictest19214-21grep19:55:171
321839953,1cyclictest7100-21idleruntime19:25:180
321839953,1cyclictest19332-21cat19:55:170
321839953,1cyclictest17299-21snmpd21:03:120
321839953,1cyclictest17299-21snmpd20:55:450
321839953,1cyclictest17299-21snmpd20:46:570
321839953,1cyclictest17299-21snmpd20:30:120
321839953,1cyclictest17299-21snmpd20:20:470
321839953,1cyclictest17299-21snmpd20:06:080
321839953,1cyclictest17299-21snmpd20:00:340
321839953,1cyclictest17299-21snmpd19:39:100
321839953,1cyclictest17299-21snmpd19:18:190
321839953,1cyclictest1053-21lldpd20:40:400
321839953,1cyclictest1034-21in:imjournal20:15:000
321839953,1cyclictest0-21swapper/020:37:220
321839952,2cyclictest17689-21ntpdc19:50:170
321839952,2cyclictest16367-21sshd19:47:110
321839952,2cyclictest1479-21taskset19:10:560
321869942,1cyclictest229402chrt20:05:031
321839942,1cyclictest5135-21cat19:20:140
321839942,1cyclictest12910-21cut19:40:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional