You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 07:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sun Nov 16, 2025 00:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1934121440,0sleep119340-21sshd00:10:151
538221310,1sleep12405-21runrttasks21:58:521
314521310,2sleep01907699cyclictest21:43:240
422621290,1sleep20-21swapper/222:14:002
2808021280,3sleep21907899cyclictest23:36:102
2446321250,2sleep30-21swapper/300:38:273
1731421220,4sleep21907899cyclictest22:45:432
859121160,1sleep08589-21sshd23:43:410
2070821130,2sleep20-21swapper/223:23:022
3041121080,0sleep00-21swapper/021:52:020
1452621030,1sleep30-21swapper/323:50:253
39532970,2sleep30-21swapper/321:18:503
100652970,2sleep210064-21bash21:53:122
267422950,2sleep126745-21sshd21:42:331
240702930,4sleep21907899cyclictest22:28:002
74632910,2sleep30-21swapper/300:15:343
47872900,2sleep247-21rcuop/323:49:362
316262900,2sleep131624-21sshd21:15:151
150122880,2sleep20-21swapper/200:23:032
60052870,2sleep26004-21sshd22:05:032
1711528732,50sleep30-21swapper/319:05:173
33972850,3sleep11907799cyclictest22:25:581
24422850,4sleep31907999cyclictest23:49:213
119532850,1sleep00-21swapper/021:22:390
247492820,2sleep324746-21sshd22:43:283
21812820,2sleep32178-21sshd22:10:403
326912800,2sleep132687-21cp00:18:121
1858728033,43sleep10-21swapper/119:07:121
185602800,2sleep218548-21sshd00:06:352
50932790,1sleep15075-21sshd22:07:591
214082780,1sleep00-21swapper/022:09:330
193262780,1sleep10-21swapper/100:20:121
176822780,4sleep11907799cyclictest23:22:451
51432770,3sleep01907699cyclictest00:28:570
141332770,2sleep20-21swapper/200:16:182
123372770,3sleep21907899cyclictest23:44:022
107262770,0sleep010728-21sshd23:53:190
150452750,0sleep00-21swapper/021:29:060
107842750,1sleep30-21swapper/323:25:163
23062740,4sleep21907899cyclictest23:09:082
185482710,2sleep20-21swapper/221:10:482
128432710,0sleep00-21swapper/000:09:340
33902690,1sleep03388-21sshd22:04:480
275302690,0sleep00-21swapper/022:59:120
232452690,2sleep123247-21sshd21:39:081
228652690,1sleep322862-21sshd21:26:443
11942690,1sleep00-21swapper/023:49:140
125082640,2sleep312506-21sshd23:44:043
157322600,2sleep10-21swapper/122:48:431
1880525928,9sleep20-21swapper/219:09:492
203902580,1sleep31907999cyclictest21:32:413
1678625532,11sleep00-21swapper/019:05:140
45772540,1sleep10-21swapper/123:00:041
1907699395,22cyclictest25439-21sshd23:11:140
1907699379,16cyclictest32084-21bash23:33:340
1907699363,19cyclictest3-21ksoftirqd/000:14:250
226572350,2sleep322656-21bash21:23:433
1907699349,1cyclictest1848-21nfsd23:02:430
1907699346,10cyclictest1847-21nfsd22:48:490
1907699341,29cyclictest0-21swapper/022:53:080
19076993322,7cyclictest21957-21sshd21:35:480
1907699330,31cyclictest1845-21nfsd22:44:080
270862320,2sleep127077-21sshd22:59:081
1907699320,1cyclictest135650irq/27-eth000:24:390
1907699317,22cyclictest20797-21sshd22:27:400
1907699314,25cyclictest31782-21sshd00:04:510
19076993110,10cyclictest7850-21sshd21:16:010
79132300,2sleep37890-21sshd22:35:343
6952301,27sleep126950irq/26-ahci[00023:49:111
266542300,4sleep31907999cyclictest23:08:203
235762300,3sleep10-21swapper/100:27:271
1907699302,8cyclictest1847-21nfsd22:37:520
1907699302,25cyclictest5343-21sshd22:17:060
19076993015,5cyclictest3062-21sshd23:24:300
19076993015,4cyclictest3-21ksoftirqd/000:15:190
19076993013,16cyclictest3-21ksoftirqd/021:34:030
1907699294,8cyclictest18828-21sshd23:35:180
1907699292,8cyclictest1959-21sshd23:29:260
1907799280,17cyclictest22-21ksoftirqd/100:06:441
1907699283,10cyclictest32040-21sshd21:12:100
1907699282,19cyclictest21260-21sshd22:21:360
1907699282,15cyclictest26470-21sshd22:13:020
1907899270,5cyclictest25905-21sshd23:26:402
19077992715,3cyclictest0-21swapper/121:53:511
1907699274,4cyclictest5360-21sshd00:36:040
1907699274,17cyclictest26950irq/26-ahci[00021:58:180
19076992711,15cyclictest30637-21sshd23:08:430
182692270,3sleep10-21swapper/123:16:411
273352260,1sleep027331-21sshd21:48:460
230632260,3sleep223058-21bash23:14:092
19079992616,4cyclictest23652-21rm21:48:253
19079992612,4cyclictest0-21swapper/321:52:583
1907799263,20cyclictest22-21ksoftirqd/123:41:361
19077992616,7cyclictest30188-21sshd21:30:271
19077992616,4cyclictest0-21swapper/100:04:281
1907799260,23cyclictest22-21ksoftirqd/122:04:531
1907799260,17cyclictest22-21ksoftirqd/123:05:041
1907799260,17cyclictest22-21ksoftirqd/122:20:301
1907699269,9cyclictest14826-21sshd22:33:150
19076992612,4cyclictest3-21ksoftirqd/023:59:370
153202261,23sleep3135650irq/27-eth000:06:183
19079992512,10cyclictest1847-21nfsd00:26:593
19077992515,7cyclictest7869-21bash21:25:191
19077992515,3cyclictest20147-21sshd22:12:261
19077992514,4cyclictest11930-21sshd22:42:111
1907799250,21cyclictest22-21ksoftirqd/123:35:261
1907799250,16cyclictest22-21ksoftirqd/122:19:511
125612250,2sleep10-21swapper/120:05:161
273382240,2sleep327329-21sshd22:55:583
247482240,2sleep10-21swapper/123:32:521
19079992420,2cyclictest0-21swapper/322:09:333
1907999240,22cyclictest44-21ksoftirqd/321:40:053
19077992414,7cyclictest9420-21sshd00:33:021
19077992413,7cyclictest8471-21sshd22:38:481
19077992413,6cyclictest1847-21nfsd22:50:061
19077992412,7cyclictest29664-21sshd21:24:241
19077992411,11cyclictest14030-21sshd22:30:081
1907799240,21cyclictest22-21ksoftirqd/123:59:591
298362230,3sleep329830-21sshd22:53:093
19077992314,6cyclictest135650irq/27-eth023:50:431
1907799230,20cyclictest22-21ksoftirqd/123:25:161
1907699234,9cyclictest1846-21nfsd23:16:310
1907699234,15cyclictest17760-21hwlatdetect00:30:170
142512230,2sleep12405-21runrttasks00:37:131
1907999225,7cyclictest144550irq/28-eth1-rx-23:10:233
19079992210,4cyclictest1847-21nfsd23:16:523
1907999220,19cyclictest44-21ksoftirqd/323:55:143
19078992216,4cyclictest27784-21sshd22:22:142
1907799229,5cyclictest1959-21sshd21:10:551
19077992214,5cyclictest24269-21sshd21:45:221
1907999218,5cyclictest10950irq/23-ehci_hcd22:23:343
19078992116,3cyclictest28052-21bash22:34:332
19078992115,4cyclictest13060-21sshd22:17:492
1907799212,16cyclictest22-21ksoftirqd/123:10:521
103952210,19sleep3135650irq/27-eth022:17:363
84522202,16sleep3135650irq/27-eth021:59:123
61372200,18sleep3135650irq/27-eth023:37:113
1907999209,2cyclictest21651-21cp22:33:563
19079992018,1cyclictest0-21swapper/320:11:533
19079992014,4cyclictest1959-21sshd23:31:393
19078992016,2cyclictest4597-21sshd23:18:282
19078992016,2cyclictest26949-21sshd21:45:332
19078992015,3cyclictest31757-21id00:11:252
19078992014,4cyclictest2604-21id21:15:302
19078992013,4cyclictest29297-21bash21:55:042
19078992013,2cyclictest135650irq/27-eth021:35:362
19078992012,5cyclictest4540-21sshd21:21:552
1907699207,12cyclictest0-21swapper/021:07:440
51482190,16sleep2135650irq/27-eth000:32:342
1907999197,3cyclictest3850-21sshd21:12:353
1907999195,5cyclictest30346-21sshd23:20:503
19079991914,3cyclictest0-21swapper/321:36:553
19079991911,5cyclictest12472-21sshd00:33:223
19079991911,3cyclictest10824-21bash00:22:363
1907999190,16cyclictest44-21ksoftirqd/300:13:343
1907899196,7cyclictest0-21swapper/222:39:222
115102190,16sleep2135650irq/27-eth022:57:382
1907999181,8cyclictest4316-21sshd22:47:363
1907899189,2cyclictest8014-21bash21:43:522
1907899185,9cyclictest20341-21sshd22:03:192
1907899185,10cyclictest3259-21bash23:30:422
19078991814,3cyclictest1847-21nfsd00:26:112
19078991813,4cyclictest1848-21nfsd00:39:472
19078991813,3cyclictest14013-21sshd23:00:522
19078991812,5cyclictest0-21swapper/200:03:212
125192180,12sleep2135650irq/27-eth021:25:432
80692170,1sleep10-21swapper/121:05:211
1907999174,12cyclictest0-21swapper/300:03:463
19079991712,3cyclictest1847-21nfsd23:01:403
19078991713,3cyclictest1848-21nfsd23:58:292
19078991713,3cyclictest1848-21nfsd22:50:052
19078991713,2cyclictest0-21swapper/223:51:432
19078991712,3cyclictest135650irq/27-eth021:31:212
19078991711,5cyclictest1848-21nfsd22:40:312
292492160,2sleep129250-21nfsd419:30:181
1907999160,4cyclictest5090-21bash22:26:073
1907999160,14cyclictest23695-21id22:00:293
1907999153,11cyclictest10950irq/23-ehci_hcd20:26:153
1907999150,13cyclictest0-21swapper/320:52:473
19078991511,3cyclictest1847-21nfsd20:35:212
19078991511,3cyclictest10950irq/23-ehci_hcd21:05:062
1907899150,13cyclictest0-21swapper/220:32:212
1907799158,3cyclictest10950irq/23-ehci_hcd20:20:161
19077991512,2cyclictest10950irq/23-ehci_hcd19:20:151
1907999142,11cyclictest135650irq/27-eth021:06:093
1907999141,8cyclictest0-21swapper/319:30:203
19079991412,1cyclictest0-21swapper/320:48:423
19079991412,1cyclictest0-21swapper/320:48:413
19079991412,1cyclictest0-21swapper/319:49:013
19079991410,3cyclictest10950irq/23-ehci_hcd19:19:383
1907999140,11cyclictest731-21fschecks_count19:40:173
1907899145,4cyclictest10950irq/23-ehci_hcd19:45:182
1907899143,10cyclictest10950irq/23-ehci_hcd20:46:132
1907899143,10cyclictest10950irq/23-ehci_hcd20:46:122
1907899142,2cyclictest22883-21ls19:15:252
1907899141,1cyclictest0-21swapper/219:44:512
19078991411,2cyclictest10950irq/23-ehci_hcd21:03:032
1907899141,11cyclictest0-21swapper/220:28:402
1907899140,13cyclictest10950irq/23-ehci_hcd20:40:502
1907899140,11cyclictest0-21swapper/219:30:362
1907799142,10cyclictest0-21swapper/119:48:591
1907799141,12cyclictest10950irq/23-ehci_hcd20:55:061
1907799140,5cyclictest0-21swapper/120:15:131
1907999137,1cyclictest26590-21perl19:25:183
19079991311,1cyclictest0-21swapper/320:55:353
19079991311,1cyclictest0-21swapper/320:15:563
19079991311,1cyclictest0-21swapper/319:56:483
1907999130,5cyclictest0-21swapper/319:54:083
1907999130,12cyclictest2405-21runrttasks20:43:063
1907999130,12cyclictest0-21swapper/321:01:363
1907999130,12cyclictest0-21swapper/320:35:443
1907999130,12cyclictest0-21swapper/320:34:323
1907999130,12cyclictest0-21swapper/320:20:073
1907999130,12cyclictest0-21swapper/320:06:263
1907999130,12cyclictest0-21swapper/320:02:183
1907999130,12cyclictest0-21swapper/319:36:243
1907999130,11cyclictest23977-21diskstats19:20:133
1907899132,0cyclictest0-21swapper/219:20:192
1907899131,9cyclictest28078-21kworker/u8:019:10:052
1907899131,11cyclictest135650irq/27-eth020:55:002
1907899131,11cyclictest135650irq/27-eth019:50:252
1907899130,5cyclictest0-21swapper/220:12:482
1907899130,12cyclictest0-21swapper/220:20:422
1907899130,12cyclictest0-21swapper/220:00:502
1907899130,12cyclictest0-21swapper/219:38:342
1907899130,12cyclictest0-21swapper/219:26:202
1907899130,11cyclictest7228-21taskset19:55:022
1907899130,11cyclictest16369-21munin-node20:15:262
1907899130,10cyclictest135650irq/27-eth020:53:552
1907799138,4cyclictest10950irq/23-ehci_hcd19:29:391
1907799132,10cyclictest135650irq/27-eth019:36:371
1907799130,4cyclictest2405-21runrttasks21:03:171
1907799130,4cyclictest19425-21diskstats19:10:151
1907799130,12cyclictest0-21swapper/120:47:171
1907799130,12cyclictest0-21swapper/120:47:171
1907799130,12cyclictest0-21swapper/120:33:491
1907799130,12cyclictest0-21swapper/120:25:031
1907799130,12cyclictest0-21swapper/119:15:371
1907799130,11cyclictest7993-21chrt19:55:181
1907799130,11cyclictest308-21munin-node19:40:141
1907799130,11cyclictest29061-21smart_sda20:40:231
1907799130,11cyclictest0-21swapper/120:10:261
1907699137,5cyclictest0-21swapper/020:26:310
1907699137,5cyclictest0-21swapper/019:51:250
1907699134,8cyclictest0-21swapper/020:06:550
1907699134,4cyclictest682-21grep19:40:160
1907699134,4cyclictest0-21swapper/019:10:230
1907699133,9cyclictest0-21swapper/021:01:200
19076991311,1cyclictest3-21ksoftirqd/020:46:380
19076991311,1cyclictest3-21ksoftirqd/020:46:370
19076991311,1cyclictest0-21swapper/020:20:060
1907699130,9cyclictest0-21swapper/019:45:200
1907699130,5cyclictest0-21swapper/019:56:350
1907699130,1cyclictest0-21swapper/020:10:580
1907699130,12cyclictest0-21swapper/020:59:200
1907699130,12cyclictest0-21swapper/020:54:200
1907699130,12cyclictest0-21swapper/020:43:430
1907699130,12cyclictest0-21swapper/020:30:140
1907699130,12cyclictest0-21swapper/020:19:180
1907699130,12cyclictest0-21swapper/019:30:270
1907699130,12cyclictest0-21swapper/019:17:060
1907699130,10cyclictest0-21swapper/019:25:510
1907899120,11cyclictest12944-21ntpq20:05:202
1907799120,3cyclictest32594-21df20:50:131
1907799120,11cyclictest0-21swapper/120:35:161
1907799120,11cyclictest0-21swapper/120:00:091
1907799120,11cyclictest0-21swapper/119:50:071
1907699127,4cyclictest0-21swapper/019:22:340
19076991210,1cyclictest0-21swapper/020:01:100
1907699120,1cyclictest135650irq/27-eth019:35:210
1907699120,1cyclictest0-21swapper/020:37:570
1907999110,10cyclictest0-21swapper/319:10:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional