You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 02:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Mon Nov 24, 2025 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1618521600,3sleep0458299cyclictest00:16:000
754921470,1sleep10-21swapper/122:59:121
942721360,2sleep20-21swapper/223:50:562
1474321310,0sleep014742-21sshd23:33:100
1411921310,1sleep114118-21bash21:11:471
2442821280,5sleep2458499cyclictest22:45:222
2701121120,0sleep00-21swapper/022:45:360
2688221110,2sleep126881-21sshd23:07:071
1837721030,1sleep018373-21sshd22:08:570
116152970,3sleep0458299cyclictest23:08:460
56132910,1sleep04581-21cyclictest23:29:220
425429026,44sleep30-21swapper/319:09:063
192702900,1sleep10-21swapper/121:21:181
131232900,3sleep1458399cyclictest22:41:211
119182890,1sleep10-21swapper/121:29:381
89822880,0sleep18979-21sshd22:10:591
80442870,1sleep08033-21sshd22:37:560
232402870,2sleep10-21swapper/123:03:461
414928533,43sleep10-21swapper/119:07:481
222442850,4sleep236-21rcuop/223:06:392
257462840,1sleep025743-21sshd22:00:360
153392840,1sleep30-21swapper/322:47:363
55252820,0sleep00-21swapper/000:27:370
289302820,0sleep00-21swapper/023:01:070
179912820,2sleep20-21swapper/200:19:172
264742810,2sleep2321ktimersoftd/223:31:132
170842810,2sleep20-21swapper/222:23:472
165202810,2sleep30-21swapper/323:27:213
170292800,3sleep217005-21sshd23:24:262
40712780,1sleep24070-21sshd21:14:002
33032780,0sleep00-21swapper/023:23:090
26222770,2sleep30-21swapper/300:08:453
255802770,1sleep01848-21nfsd19:55:140
216472770,2sleep31847-21nfsd22:33:143
108962770,2sleep30-21swapper/300:37:513
100052760,2sleep29993-21sshd22:17:062
64052750,1sleep10-21swapper/100:27:431
93262720,2sleep30-21swapper/323:20:353
160472700,4sleep2458499cyclictest22:53:522
121262690,3sleep0458299cyclictest21:44:330
316442620,1sleep1458399cyclictest22:16:031
425126137,13sleep00-21swapper/019:09:030
421925633,11sleep20-21swapper/219:08:422
7842520,3sleep2786-21sshd23:56:172
4585994435,7cyclictest0-21swapper/323:34:103
4583994428,14cyclictest417-21jbd2/dm-0-823:34:111
13182370,0sleep11319-21sshd21:19:441
317862330,0sleep331785-21sshd22:19:113
218162320,2sleep121814-21bash22:51:151
40062300,2sleep30-21swapper/300:24:203
4584992811,1cyclictest33-21ksoftirqd/223:19:022
159682280,26sleep2135650irq/27-eth000:06:572
4584992715,3cyclictest33-21ksoftirqd/200:38:442
4584992713,4cyclictest23392-21sshd23:00:362
4584992710,16cyclictest33-21ksoftirqd/223:40:562
458499270,20cyclictest33-21ksoftirqd/200:33:262
89612260,2sleep18941-21sshd21:35:171
194582260,2sleep30-21swapper/322:57:153
458499251,18cyclictest33-21ksoftirqd/223:14:542
458499250,5cyclictest5436-21sshd21:55:452
4582992515,8cyclictest17513-21sshd00:13:080
299462250,3sleep20-21swapper/222:42:592
60922240,21sleep2135650irq/27-eth000:02:592
4584992412,3cyclictest0-21swapper/223:27:432
4584992411,4cyclictest33-21ksoftirqd/222:56:202
458499240,15cyclictest33-21ksoftirqd/200:27:002
458299245,10cyclictest1847-21nfsd22:50:090
458299240,14cyclictest30569-21sshd22:55:150
201052240,2sleep20-21swapper/222:30:032
197552240,2sleep119754-21sshd00:10:191
13212240,22sleep2135650irq/27-eth021:37:342
4584992314,4cyclictest30596-21sshd00:23:452
458299230,22cyclictest0-21swapper/000:37:300
294112230,2sleep30-21swapper/321:55:063
169062230,1sleep04581-21cyclictest22:26:410
154972230,2sleep115491-21sshd21:50:441
4584992218,2cyclictest1959-21sshd00:12:332
4584992213,3cyclictest17003-21id23:45:322
458499220,19cyclictest33-21ksoftirqd/223:35:542
270832220,0sleep00-21swapper/021:28:020
190942222,18sleep2135650irq/27-eth020:50:212
46262210,2sleep24625-21sshd21:20:012
4583992115,4cyclictest2609-21sshd00:36:581
4583992114,2cyclictest10950irq/23-ehci_hcd00:31:321
4582992117,3cyclictest0-21swapper/000:09:470
4582992111,2cyclictest0-21swapper/023:36:110
458299210,9cyclictest0-21swapper/022:41:360
458299210,17cyclictest25845-21sshd22:12:350
458299210,12cyclictest0-21swapper/000:31:520
4585992011,6cyclictest4212-21sshd23:50:253
458399204,3cyclictest10950irq/23-ehci_hcd22:49:381
4583992010,2cyclictest1848-21nfsd00:21:261
4582992013,1cyclictest3420-21sshd23:53:310
458299200,17cyclictest32455-21sshd23:40:530
4585991915,3cyclictest1848-21nfsd23:07:533
4585991912,5cyclictest15697-21sshd22:41:353
458399198,5cyclictest10950irq/23-ehci_hcd23:24:101
4583991913,2cyclictest10950irq/23-ehci_hcd00:18:261
458299193,4cyclictest1117-21sshd23:10:440
458299191,9cyclictest0-21swapper/000:20:140
4582991912,3cyclictest15128-21sshd21:50:410
458299191,12cyclictest0-21swapper/023:55:360
458299191,11cyclictest0-21swapper/023:48:160
4585991810,6cyclictest0-21swapper/300:15:393
4584991812,4cyclictest15917-21sshd22:29:412
458399182,1cyclictest27771-21sshd22:33:481
458399181,9cyclictest23975-21bash23:52:221
4583991812,3cyclictest13548-21sshd23:36:021
4583991812,1cyclictest9340-21sshd00:09:231
458399180,7cyclictest0-21swapper/122:20:161
458299189,4cyclictest30918-21sshd22:19:060
4582991810,4cyclictest23892-21sshd22:21:210
458299180,16cyclictest0-21swapper/023:19:350
26642180,3sleep32641-21sshd00:02:403
4585991711,4cyclictest2604-21sshd23:59:383
4585991711,4cyclictest0-21swapper/323:13:333
458599171,14cyclictest0-21swapper/321:47:553
458599170,15cyclictest3715-21latency_hist23:05:003
458599170,13cyclictest0-21swapper/322:36:033
458499178,5cyclictest135650irq/27-eth021:33:082
458499175,3cyclictest30052-21sshd22:01:012
4584991712,1cyclictest10950irq/23-ehci_hcd21:45:152
4584991710,5cyclictest1927-21snmpd22:13:372
458499170,13cyclictest12493-21sshd22:05:222
458399179,1cyclictest1848-21nfsd23:41:331
458399177,4cyclictest135650irq/27-eth023:59:241
458399172,13cyclictest26156-21bash23:10:081
458299170,6cyclictest16110-21sshd22:32:420
458299170,4cyclictest17310-21sshd21:47:570
458299170,3cyclictest19674-21sshd00:04:180
458299170,12cyclictest3984-21sshd21:58:430
458599169,3cyclictest1847-21nfsd23:18:403
458599169,3cyclictest10950irq/23-ehci_hcd22:13:553
458599169,2cyclictest10950irq/23-ehci_hcd23:41:473
458599168,6cyclictest1959-21sshd21:12:283
458599166,6cyclictest6329-21sshd00:30:503
458599163,4cyclictest32052-21bash21:28:303
458599163,11cyclictest1848-21nfsd21:40:133
458599162,11cyclictest26950irq/26-ahci[00021:50:023
458599161,14cyclictest0-21swapper/322:22:543
4585991611,3cyclictest11166-21bash23:45:073
4585991610,4cyclictest1959-21sshd23:36:293
458599160,14cyclictest27002-21latency_hist21:10:003
458499160,14cyclictest0-21swapper/221:25:042
458499160,12cyclictest0-21swapper/221:17:232
458499160,11cyclictest15704-21sshd22:35:342
4583991612,3cyclictest5136-21id21:40:501
4583991611,1cyclictest11052-21sshd22:29:131
458399161,0cyclictest0-21swapper/123:25:571
4583991610,1cyclictest16867-21sshd23:48:411
458399160,9cyclictest0-21swapper/119:27:481
458399160,14cyclictest0-21swapper/123:16:221
458399160,0cyclictest417-21jbd2/dm-0-800:00:531
458299169,5cyclictest0-21swapper/019:22:080
458299168,4cyclictest0-21swapper/020:30:200
4582991612,1cyclictest135650irq/27-eth021:13:430
4582991610,5cyclictest0-21swapper/021:30:440
458299160,4cyclictest16441-21sshd21:21:010
458299160,13cyclictest0-21swapper/021:17:260
128292160,14sleep2135650irq/27-eth021:53:332
458599159,4cyclictest0-21swapper/322:50:153
458599153,3cyclictest16006-21sshd21:20:583
458599151,12cyclictest7574-21munin-node21:35:233
4585991510,4cyclictest0-21swapper/300:10:133
458599150,6cyclictest22689-21cp00:26:043
458599150,13cyclictest9256-21munin-node22:05:143
458599150,13cyclictest29904-21id22:01:003
458599150,13cyclictest15900-21sshd21:30:013
458599150,13cyclictest0-21swapper/322:25:283
458499153,11cyclictest10950irq/23-ehci_hcd19:23:362
4584991511,3cyclictest787-21bash21:40:252
458499151,12cyclictest22836-21munin-node19:50:222
458499150,13cyclictest0-21swapper/219:15:142
458399154,7cyclictest12579-21sshd22:05:221
458399153,11cyclictest26950irq/26-ahci[00021:55:361
4583991511,1cyclictest6724-21sshd21:32:041
458399150,9cyclictest29684-21sshd21:46:031
458299157,5cyclictest0-21swapper/019:33:000
458299157,4cyclictest3-21ksoftirqd/021:35:510
458599148,5cyclictest0-21swapper/319:54:383
458599148,2cyclictest135650irq/27-eth020:35:133
458599143,3cyclictest10950irq/23-ehci_hcd20:12:093
458599141,11cyclictest0-21swapper/319:55:133
458599141,11cyclictest0-21swapper/319:20:213
458599140,13cyclictest0-21swapper/320:40:453
458599140,12cyclictest15804-21sshd21:15:083
458599140,12cyclictest13719-21munin-node19:30:153
4584991410,3cyclictest10950irq/23-ehci_hcd20:56:082
458499140,2cyclictest0-21swapper/219:48:302
458499140,13cyclictest0-21swapper/220:19:582
458499140,10cyclictest0-21swapper/220:10:152
458399148,5cyclictest2405-21runrttasks20:29:161
458399146,7cyclictest0-21swapper/120:23:291
458399143,6cyclictest0-21swapper/120:10:191
458399143,10cyclictest10950irq/23-ehci_hcd20:53:381
458399140,13cyclictest18223-21sshd22:35:481
458399140,12cyclictest23652-21timerandwakeup22:00:241
458299147,5cyclictest0-21swapper/020:05:210
458299140,6cyclictest0-21swapper/019:50:120
458299140,1cyclictest0-21swapper/020:20:240
458299140,12cyclictest0-21swapper/020:04:480
458599137,5cyclictest1848-21nfsd20:01:463
458599132,3cyclictest10950irq/23-ehci_hcd21:02:243
458599131,4cyclictest0-21swapper/320:30:123
458599131,10cyclictest0-21swapper/320:05:143
458599130,4cyclictest2405-21runrttasks20:15:003
458599130,12cyclictest0-21swapper/320:53:323
458599130,12cyclictest0-21swapper/320:45:463
458599130,12cyclictest0-21swapper/319:43:383
458599130,12cyclictest0-21swapper/319:35:233
458599130,12cyclictest0-21swapper/319:15:183
458599130,12cyclictest0-21swapper/319:10:233
458599130,11cyclictest4915-21iostat20:20:173
458599130,11cyclictest2405-21runrttasks20:25:103
458599130,11cyclictest21231-21hddtemp_smartct19:45:163
458499139,3cyclictest10950irq/23-ehci_hcd19:37:252
458499138,4cyclictest1848-21nfsd21:00:252
458499138,4cyclictest0-21swapper/220:21:222
458499137,5cyclictest0-21swapper/219:10:162
458499132,3cyclictest135650irq/27-eth019:25:142
458499131,1cyclictest0-21swapper/220:33:532
4584991311,1cyclictest0-21swapper/220:40:372
4584991311,1cyclictest0-21swapper/219:40:152
458499131,10cyclictest26518-21munin-node19:55:222
458499130,9cyclictest10950irq/23-ehci_hcd21:05:172
458499130,4cyclictest13719-21munin-node19:30:182
458499130,12cyclictest1848-21nfsd20:48:302
458499130,12cyclictest135650irq/27-eth020:25:242
458499130,12cyclictest0-21swapper/220:37:142
458499130,12cyclictest0-21swapper/220:03:262
458499130,10cyclictest135650irq/27-eth020:07:232
458399137,5cyclictest0-21swapper/120:15:221
458399136,4cyclictest0-21swapper/119:52:231
458399134,8cyclictest0-21swapper/119:45:411
458399132,7cyclictest28769-21threads20:00:211
458399131,11cyclictest144550irq/28-eth1-rx-21:06:031
4583991311,1cyclictest0-21swapper/120:59:491
458399130,12cyclictest1848-21nfsd20:05:191
458399130,12cyclictest0-21swapper/121:00:531
458399130,12cyclictest0-21swapper/120:36:221
458399130,12cyclictest0-21swapper/120:30:511
458399130,12cyclictest0-21swapper/119:41:051
458399130,12cyclictest0-21swapper/119:39:291
458399130,12cyclictest0-21swapper/119:16:091
458399130,12cyclictest0-21swapper/119:14:381
458299138,3cyclictest0-21swapper/020:55:010
458299137,5cyclictest0-21swapper/020:10:080
458299130,1cyclictest0-21swapper/019:47:400
458299130,1cyclictest0-21swapper/019:25:130
458299130,13cyclictest0-21swapper/020:51:060
458299130,10cyclictest0-21swapper/020:45:310
458299130,10cyclictest0-21swapper/020:35:000
458299130,10cyclictest0-21swapper/020:25:090
458599120,4cyclictest135650irq/27-eth019:25:063
458599120,10cyclictest0-21swapper/320:55:123
458399128,3cyclictest1848-21nfsd20:45:211
458399125,3cyclictest10950irq/23-ehci_hcd19:55:171
458399121,10cyclictest1848-21nfsd20:41:521
458399120,11cyclictest0-21swapper/119:30:221
458399120,11cyclictest0-21swapper/119:20:071
458299124,4cyclictest0-21swapper/019:35:170
458299123,2cyclictest4846-21tr19:10:140
4582991210,1cyclictest13792-21fschecks_time20:40:140
458299120,2cyclictest0-21swapper/021:02:330
458299120,2cyclictest0-21swapper/019:40:020
458299120,11cyclictest0-21swapper/021:05:020
458299120,11cyclictest0-21swapper/020:18:590
458299120,11cyclictest0-21swapper/019:15:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional