You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 14:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Fri Nov 21, 2025 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2359921610,1sleep00-21swapper/010:47:570
2359921610,1sleep00-21swapper/010:47:560
1128521590,5sleep21301699cyclictest12:33:152
3074221370,4sleep31301799cyclictest09:12:563
3134921290,1sleep20-21swapper/209:49:262
2347221290,2sleep20-21swapper/211:21:212
1055221280,2sleep210539-21cp10:10:102
1699121270,1sleep00-21swapper/011:56:460
2690221230,1sleep20-21swapper/209:15:392
1651321210,2sleep31301799cyclictest09:51:033
252721170,1sleep02518-21sshd11:35:490
1143321150,1sleep311430-21cp11:07:033
2980421140,1sleep10-21swapper/109:29:371
1278221120,2sleep01301499cyclictest09:34:330
318321090,3sleep00-21swapper/011:25:470
1451721070,1sleep010-21rcuc/011:14:050
1953821040,2sleep319537-21sshd10:30:433
1640021040,2sleep31301799cyclictest10:50:233
1110721020,2sleep30-21swapper/311:56:123
55322980,1sleep3417-21jbd2/dm-0-811:36:083
314512960,1sleep10-21swapper/110:38:471
24462960,0sleep12445-21awk11:55:231
99562930,1sleep09948-21sshd11:53:050
161842900,1sleep10-21swapper/110:43:521
52702890,0sleep00-21swapper/012:11:080
1246428929,56sleep10-21swapper/107:06:341
206062880,1sleep20-21swapper/209:58:082
229062870,2sleep30-21swapper/312:06:343
294212860,2sleep20-21swapper/209:42:452
233362860,0sleep123335-21bash10:11:251
201922860,2sleep31301799cyclictest12:03:153
273482840,2sleep127343-21sshd09:39:151
1260028432,48sleep30-21swapper/307:08:193
293352830,2sleep30-21swapper/309:55:403
196262830,2sleep20-21swapper/210:57:282
156712830,1sleep10-21swapper/112:02:481
134792820,3sleep20-21swapper/211:17:082
132162810,2sleep313202-21iostat11:50:153
202952790,3sleep20-21swapper/209:35:152
133722790,1sleep00-21swapper/010:36:510
195672780,1sleep10-21swapper/112:12:351
287912770,1sleep10-21swapper/109:58:591
195282770,1sleep20-21swapper/210:07:462
190482770,2sleep20-21swapper/212:00:082
198762760,2sleep119874-21sshd12:34:021
273552750,5sleep11301599cyclictest11:54:461
254642750,0sleep00-21swapper/010:18:140
137882750,1sleep20-21swapper/212:15:072
117322740,2sleep111725-21sshd11:36:471
27662730,1sleep30-21swapper/310:49:083
27662730,1sleep30-21swapper/310:49:073
146612730,1sleep214653-21sshd10:30:182
142232730,2sleep10-21swapper/109:11:011
80192720,2sleep38020-21sshd10:09:553
1271627232,10sleep20-21swapper/207:09:282
120392710,2sleep21301699cyclictest11:43:292
98912700,2sleep01847-21nfsd12:02:160
121702700,2sleep31301799cyclictest12:27:193
259792640,0sleep00-21swapper/011:08:360
271542530,3sleep10-21swapper/111:01:521
57192510,2sleep10-21swapper/111:06:281
74742480,0sleep00-21swapper/011:49:490
1301499488,30cyclictest14368-21sshd12:36:210
1301499473,39cyclictest0-21swapper/010:23:260
13014994510,25cyclictest0-21swapper/011:19:330
1269524437,4sleep00-21swapper/007:09:140
13014994214,22cyclictest1572-21sshd12:07:430
13014994214,20cyclictest13573-21sshd10:40:140
13014994213,5cyclictest10743-21sshd11:20:100
190862410,3sleep10-21swapper/110:24:161
1301499411,8cyclictest13900-21sshd09:17:410
13014994110,5cyclictest31652-21sshd09:26:150
1301499398,6cyclictest1847-21nfsd09:51:130
13014993813,18cyclictest1959-21sshd10:00:070
13014993810,6cyclictest135650irq/27-eth010:51:150
13014993810,6cyclictest13267-21sshd12:33:270
56392372,33sleep1135650irq/27-eth012:17:241
13014993712,19cyclictest30034-21sshd11:41:510
17152360,2sleep31710-21bash09:30:033
1301699354,5cyclictest18188-21sshd11:10:562
1301499352,4cyclictest5433-21sshd09:37:000
1301499351,18cyclictest32142sleep010:55:420
52712340,1sleep05268-21bash11:03:080
1301499349,8cyclictest11536-21bash10:30:030
13014993420,12cyclictest0-21swapper/009:13:480
13014993411,15cyclictest0-21swapper/010:27:410
13014993311,4cyclictest0-21swapper/012:22:300
1301499327,23cyclictest11361-21sshd10:10:120
1301499325,24cyclictest26313-21sshd12:25:310
13014993215,15cyclictest1848-21nfsd11:30:590
99572310,2sleep11847-21nfsd11:43:131
21962311,27sleep110950irq/23-ehci_hcd11:49:181
1301499317,5cyclictest24476-21cp12:16:030
13014993118,10cyclictest26848-21sshd09:55:240
1301799300,26cyclictest3471-21perf09:20:003
1301499306,9cyclictest16968-21sshd09:41:240
299772290,27sleep1135650irq/27-eth007:45:171
1301499297,3cyclictest135650irq/27-eth010:08:010
288332280,3sleep30-21swapper/309:49:113
97932270,5sleep21301699cyclictest09:30:502
27122270,2sleep11847-21nfsd11:25:451
13014992710,4cyclictest12122-21sshd09:20:450
123642270,5sleep236-21rcuop/211:56:192
13015992614,3cyclictest22-21ksoftirqd/112:36:201
1301499261,4cyclictest28720-21bash09:45:510
126562260,2sleep312654-21bash09:44:223
22852250,2sleep10-21swapper/109:49:451
13017992514,6cyclictest2080-21bash09:36:373
13015992519,4cyclictest22-21ksoftirqd/110:53:501
13015992511,12cyclictest22-21ksoftirqd/111:33:551
118272250,1sleep30-21swapper/311:00:103
97792240,2sleep20-21swapper/209:50:222
143322241,21sleep2135650irq/27-eth010:40:182
13017992411,4cyclictest10950irq/23-ehci_hcd11:28:363
13016992413,3cyclictest33-21ksoftirqd/212:28:352
1301599249,4cyclictest22-21ksoftirqd/111:17:211
13015992415,4cyclictest1844-21nfsd11:12:061
13015992412,9cyclictest22-21ksoftirqd/110:25:301
1301599240,3cyclictest16937-21bash10:04:181
91562230,21sleep3135650irq/27-eth012:38:503
13015992316,5cyclictest31500-21sshd10:31:591
13015992314,7cyclictest0-21swapper/109:30:251
13015992313,6cyclictest607-21sshd10:05:471
13015992311,4cyclictest0-21swapper/109:52:211
1301599230,20cyclictest22-21ksoftirqd/110:47:381
1301599230,20cyclictest22-21ksoftirqd/110:47:371
107982230,2sleep30-21swapper/310:20:103
58402220,1sleep30-21swapper/308:05:093
1301799228,10cyclictest3471-21sshd11:32:423
1301799224,10cyclictest10950irq/23-ehci_hcd11:49:203
13017992215,4cyclictest17498-21id10:00:593
13017992213,6cyclictest20951-21sshd11:24:283
13017992212,6cyclictest28200-21sshd11:18:393
13016992216,4cyclictest25955-21cp11:01:422
13016992213,5cyclictest26969-21bash09:25:452
13015992217,3cyclictest26923-21sshd10:58:171
13015992216,4cyclictest25053-21sshd09:18:511
13015992213,5cyclictest21090-21bash09:21:421
67332211,18sleep210950irq/23-ehci_hcd12:23:432
314812211,18sleep3135650irq/27-eth012:10:323
274232210,2sleep327421-21sshd10:11:523
13502210,1sleep30-21swapper/310:28:593
1301799212,12cyclictest0-21swapper/310:39:183
1301799212,11cyclictest0-21swapper/310:41:523
13017992116,3cyclictest26836-21sshd12:19:273
13017992113,7cyclictest10950irq/23-ehci_hcd12:23:373
13016992116,3cyclictest4704-21cp11:09:452
13016992116,3cyclictest10329-21bash10:23:212
13016992115,5cyclictest135650irq/27-eth010:04:282
1301599214,16cyclictest22-21ksoftirqd/111:24:281
13015992116,3cyclictest10281-21sshd09:40:421
13015992113,3cyclictest1846-21nfsd12:28:391
1301599211,1cyclictest1341-21sshd12:20:051
13015992111,7cyclictest0-21swapper/112:05:491
13017992011,2cyclictest26413-21sshd10:15:053
1301799200,15cyclictest44-21ksoftirqd/311:41:013
1301799200,12cyclictest21910-21sshd12:31:163
13016992017,2cyclictest0-21swapper/209:14:562
13016992015,3cyclictest3568-21id11:35:572
13016992015,3cyclictest19609-21bash11:34:212
13016992013,5cyclictest950-21bash12:10:432
13016992013,4cyclictest12385-21sshd10:26:492
13017991914,2cyclictest135650irq/27-eth011:10:433
13017991912,2cyclictest1847-21nfsd09:26:403
1301699199,2cyclictest22200-21sshd12:09:472
13016991916,2cyclictest135650irq/27-eth010:46:312
13016991916,2cyclictest135650irq/27-eth010:46:312
13016991914,3cyclictest6022-21sshd10:16:102
13016991911,6cyclictest135650irq/27-eth009:20:072
13015991913,3cyclictest0-21swapper/110:16:111
13014991917,1cyclictest0-21swapper/008:29:230
1301799180,12cyclictest1845-21nfsd10:56:183
13016991813,3cyclictest6757-21bash10:36:012
13016991813,3cyclictest22566-21sshd11:51:052
13016991813,3cyclictest20733-21sshd11:27:482
13016991813,3cyclictest19143-21bash10:50:402
13016991811,6cyclictest15479-21sshd12:39:242
1301499180,14cyclictest0-21swapper/008:15:170
214652170,2sleep20-21swapper/211:47:542
13017991714,2cyclictest1848-21nfsd09:20:193
13017991713,3cyclictest10950irq/23-ehci_hcd08:02:313
1301699161,13cyclictest0-21swapper/207:55:142
1301599160,14cyclictest0-21swapper/108:12:341
1301799154,10cyclictest10950irq/23-ehci_hcd07:56:583
1301799150,13cyclictest0-21swapper/308:17:533
1301799150,11cyclictest0-21swapper/307:40:453
1301799150,10cyclictest0-21swapper/308:47:003
1301699158,6cyclictest135650irq/27-eth007:16:142
1301599157,4cyclictest0-21swapper/108:40:131
1301499150,12cyclictest0-21swapper/009:07:380
13017991410,3cyclictest135650irq/27-eth007:25:203
13017991410,3cyclictest10950irq/23-ehci_hcd09:04:283
13017991410,3cyclictest10950irq/23-ehci_hcd09:04:283
1301699149,4cyclictest135650irq/27-eth008:17:372
1301699148,5cyclictest26950irq/26-ahci[00009:00:112
1301699148,5cyclictest26950irq/26-ahci[00009:00:112
1301699148,5cyclictest0-21swapper/207:30:442
1301699143,10cyclictest10950irq/23-ehci_hcd08:49:372
1301699142,11cyclictest0-21swapper/207:48:032
1301699140,13cyclictest0-21swapper/208:52:002
1301599149,4cyclictest19903-21fschecks_time08:35:131
1301599142,11cyclictest0-21swapper/108:32:531
1301599141,5cyclictest2289-21ntp_kernel_pll_07:55:171
13015991410,3cyclictest10950irq/23-ehci_hcd09:03:051
13015991410,3cyclictest10950irq/23-ehci_hcd09:03:051
1301599140,3cyclictest0-21swapper/108:59:001
1301599140,13cyclictest0-21swapper/108:49:001
1301499148,5cyclictest0-21swapper/008:49:190
13014991412,1cyclictest3-21ksoftirqd/008:55:170
1301499140,3cyclictest0-21swapper/007:49:260
1301499140,12cyclictest0-21swapper/008:30:500
1301799132,11cyclictest10950irq/23-ehci_hcd07:32:163
13017991311,1cyclictest0-21swapper/308:43:013
13017991311,1cyclictest0-21swapper/308:21:283
13017991311,1cyclictest0-21swapper/307:13:273
1301799130,5cyclictest0-21swapper/307:35:103
1301799130,12cyclictest0-21swapper/308:59:013
1301799130,12cyclictest0-21swapper/308:30:113
1301799130,12cyclictest0-21swapper/308:26:293
1301799130,12cyclictest0-21swapper/307:18:393
1301799130,11cyclictest18809-21ps07:20:183
1301799130,10cyclictest0-21swapper/307:50:283
1301699137,5cyclictest0-21swapper/209:09:042
1301699133,9cyclictest0-21swapper/208:55:522
1301699131,4cyclictest0-21swapper/208:30:212
1301699131,3cyclictest0-21swapper/208:10:172
1301699131,11cyclictest10950irq/23-ehci_hcd07:36:392
13016991311,1cyclictest0-21swapper/208:36:322
13016991311,1cyclictest0-21swapper/207:28:242
1301699130,5cyclictest0-21swapper/207:42:422
1301699130,12cyclictest19435-21taskset07:22:532
1301699130,12cyclictest1848-21nfsd08:06:252
1301699130,12cyclictest0-21swapper/208:43:212
1301699130,12cyclictest0-21swapper/208:20:082
1301699130,12cyclictest0-21swapper/208:00:142
1301699130,12cyclictest0-21swapper/207:52:122
1301599139,3cyclictest135650irq/27-eth008:07:181
1301599131,11cyclictest0-21swapper/109:08:071
13015991311,1cyclictest0-21swapper/107:43:371
1301599130,5cyclictest4228-21irqstats08:00:161
1301599130,4cyclictest20180-21df_inode07:25:101
1301599130,4cyclictest11558-21rt-features08:15:211
1301599130,12cyclictest0-21swapper/108:51:011
1301599130,12cyclictest0-21swapper/108:20:181
1301599130,12cyclictest0-21swapper/107:50:101
1301599130,12cyclictest0-21swapper/107:31:381
1301599130,11cyclictest24749-21df_inode07:35:131
1301599130,11cyclictest1927-21snmpd07:20:091
1301599130,11cyclictest16522-21munin-node07:15:191
1301599130,11cyclictest135650irq/27-eth008:25:221
1301599130,11cyclictest0-21swapper/107:10:141
1301499131,11cyclictest3-21ksoftirqd/007:35:560
13014991311,1cyclictest0-21swapper/007:43:290
13014991310,2cyclictest0-21swapper/007:25:510
1301499130,1cyclictest0-21swapper/009:01:450
1301499130,1cyclictest0-21swapper/009:01:450
1301499130,1cyclictest0-21swapper/007:22:320
1301499130,12cyclictest0-21swapper/008:42:430
1301499130,12cyclictest0-21swapper/008:08:200
1301499130,12cyclictest0-21swapper/007:18:290
1301499130,12cyclictest0-21swapper/007:14:330
1301799120,8cyclictest31046-21munin-run07:50:003
1301799120,11cyclictest0-21swapper/308:50:083
1301799120,11cyclictest0-21swapper/308:10:023
1301799120,10cyclictest0-21swapper/308:35:133
1301699128,3cyclictest0-21swapper/208:25:132
1301699120,11cyclictest0-21swapper/207:11:252
1301499127,4cyclictest0-21swapper/007:50:470
1301499127,4cyclictest0-21swapper/007:30:020
1301499127,2cyclictest0-21swapper/008:10:560
1301499120,1cyclictest0-21swapper/008:23:310
1301499120,11cyclictest0-21swapper/008:50:110
1301499120,11cyclictest0-21swapper/008:35:140
1301499120,11cyclictest0-21swapper/008:00:410
1301499120,11cyclictest0-21swapper/007:55:210
1301799113,0cyclictest0-21swapper/309:05:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional