You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-18 - 21:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot0.osadl.org (updated Sun May 18, 2025 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2577521400,1sleep31414599cyclictest10:42:503
2535121330,0sleep00-21swapper/012:14:280
2910421320,3sleep01414299cyclictest09:36:010
13752210633,44sleep10-21swapper/107:08:211
3154821030,2sleep331452-21sshd12:37:533
2005821020,4sleep11414399cyclictest09:15:011
2452621010,1sleep024522-21sshd11:08:470
1962321000,2sleep219624-21sshd11:45:202
109052940,3sleep30-21swapper/312:10:183
71762920,1sleep07088-21sshd11:47:080
57512920,1sleep041ktimersoftd/010:20:250
5712920,1sleep31414599cyclictest11:49:273
29832880,2sleep12982-21sshd09:33:261
156092880,2sleep31848-21nfsd10:48:223
139552880,0sleep00-21swapper/011:16:250
180082870,2sleep10-21swapper/111:08:091
136292870,1sleep10-21swapper/111:53:251
37732860,0sleep03771-21bash11:03:380
1357528639,43sleep30-21swapper/307:06:063
227692850,2sleep122771-21sshd11:31:241
262612830,1sleep30-21swapper/311:17:333
188902820,0sleep00-21swapper/011:22:340
140682810,2sleep10-21swapper/111:56:141
310762790,2sleep10-21swapper/111:17:581
128562790,1sleep20-21swapper/211:24:572
91792780,2sleep19176-21bash10:57:381
48762780,0sleep04874-21sshd10:06:440
321932780,3sleep00-21swapper/009:56:210
317372780,3sleep30-21swapper/311:35:073
242342780,2sleep324233-21bash12:02:543
241402780,1sleep10-21swapper/112:17:111
107662780,2sleep20-21swapper/212:01:402
320232760,1sleep30-21swapper/311:23:453
138502760,2sleep31414599cyclictest10:17:563
23302750,3sleep20-21swapper/209:13:102
222422750,2sleep12405-21runrttasks12:37:021
203602740,1sleep20-21swapper/211:02:052
301922710,2sleep20-21swapper/212:17:432
245192560,1sleep30-21swapper/310:55:483
1186925633,10sleep20-21swapper/207:05:132
1370625437,4sleep00-21swapper/007:07:430
248232500,0sleep124822-21id10:42:431
14142994335,4cyclictest6386-21bash12:27:030
14142994335,4cyclictest6386-21bash12:27:030
128912380,0sleep00-21swapper/010:11:030
14143993633,2cyclictest13353-21bash10:48:081
31522350,2sleep30-21swapper/310:36:563
227852350,2sleep20-21swapper/211:37:082
14145993417,15cyclictest14468-21sshd10:14:453
1414299312,14cyclictest0-21swapper/009:51:570
140062310,29sleep2135650irq/27-eth012:27:472
140062310,29sleep2135650irq/27-eth012:27:462
131562310,1sleep013147-21sshd10:48:070
51512300,2sleep15147-21bash12:32:411
307532290,0sleep230752-21sshd11:43:322
195712290,22sleep2135650irq/27-eth012:39:452
14142992915,3cyclictest0-21swapper/009:15:540
1414299290,11cyclictest1846-21nfsd09:11:060
135222290,2sleep20-21swapper/211:30:332
71932280,1sleep27196-21sshd10:40:512
1414299277,8cyclictest21741-21sshd10:28:440
14142992714,6cyclictest3-21ksoftirqd/009:27:120
1414299270,19cyclictest5104-21bash11:29:570
99132260,1sleep39909-21bash09:40:443
65322260,1sleep10-21swapper/109:27:081
14145992612,6cyclictest10950irq/23-ehci_hcd11:44:083
14142992624,1cyclictest11407-21sshd10:51:080
1414299260,1cyclictest0-21swapper/009:47:470
1414599256,1cyclictest1848-21nfsd12:34:233
1414599254,18cyclictest44-21ksoftirqd/309:32:013
14145992512,11cyclictest0-21swapper/312:23:213
1414499259,6cyclictest10950irq/23-ehci_hcd11:16:192
1414399257,16cyclictest22-21ksoftirqd/109:45:361
1414399256,18cyclictest22-21ksoftirqd/109:37:131
1414399253,20cyclictest22-21ksoftirqd/111:38:351
14143992516,7cyclictest492-21sshd10:26:301
14143992516,2cyclictest26950irq/26-ahci[00010:12:391
14142992523,1cyclictest0-21swapper/009:43:470
317612240,1sleep20-21swapper/210:59:552
301592240,2sleep31848-21nfsd11:51:593
14145992413,2cyclictest3323-21sshd09:19:553
1414399247,1cyclictest10950irq/23-ehci_hcd11:12:281
1414399245,18cyclictest22-21ksoftirqd/112:03:081
14143992419,3cyclictest8871-21sshd12:27:181
14143992419,3cyclictest8871-21sshd12:27:171
279132230,21sleep226950irq/26-ahci[00011:11:592
254192230,0sleep00-21swapper/010:02:180
1414599239,6cyclictest44-21ksoftirqd/310:07:203
1414599232,3cyclictest0-21swapper/309:55:393
14145992318,3cyclictest20761-21sshd10:52:103
14145992318,3cyclictest1848-21nfsd11:12:393
14145992315,5cyclictest7977-21sshd09:47:183
1414599230,19cyclictest0-21swapper/309:36:493
14144992319,3cyclictest13247-21bash11:50:272
14144992310,6cyclictest10950irq/23-ehci_hcd10:35:192
1414399239,6cyclictest10950irq/23-ehci_hcd09:54:441
1414399232,19cyclictest22-21ksoftirqd/109:56:191
14143992316,4cyclictest24198-21sshd09:22:081
1414399231,3cyclictest0-21swapper/112:21:161
14143992313,9cyclictest22-21ksoftirqd/110:02:081
1414399230,21cyclictest22-21ksoftirqd/112:10:181
1414399230,21cyclictest22-21ksoftirqd/109:11:111
14142992314,4cyclictest3-21ksoftirqd/012:21:290
1414299230,10cyclictest0-21swapper/011:31:120
281682221,19sleep2135650irq/27-eth010:26:012
1414599223,16cyclictest44-21ksoftirqd/311:31:513
1414599222,17cyclictest0-21swapper/312:09:353
14145992217,3cyclictest20220-21sshd09:21:333
14145992214,5cyclictest11487-21sshd10:00:473
1414599220,3cyclictest6290-21sshd10:30:233
1414599220,15cyclictest0-21swapper/311:27:233
1414399229,5cyclictest10950irq/23-ehci_hcd10:53:571
14143992216,5cyclictest22-21ksoftirqd/110:21:201
14143992210,3cyclictest4638-21sshd10:16:571
1414399220,20cyclictest22-21ksoftirqd/111:48:251
14142992216,4cyclictest15010-21bash11:59:150
14142992212,2cyclictest11724-21sshd12:33:180
1414299221,11cyclictest16491-21sshd10:55:070
1414299220,13cyclictest0-21swapper/012:08:440
1414599216,13cyclictest25997-21sshd11:02:373
14145992117,2cyclictest1848-21nfsd10:24:133
14145992116,3cyclictest10571-21sshd12:15:563
1414599211,17cyclictest44-21ksoftirqd/309:27:353
1414599210,19cyclictest44-21ksoftirqd/312:25:473
1414599210,19cyclictest44-21ksoftirqd/312:25:473
1414499217,8cyclictest135650irq/27-eth011:09:522
1414499217,2cyclictest16887-21sshd09:58:112
14144992118,2cyclictest1571-21sshd10:13:142
14144992110,4cyclictest8956-21sshd10:24:112
1414499210,2cyclictest27323-21sshd11:26:062
1414399215,14cyclictest22-21ksoftirqd/110:05:181
14143992113,6cyclictest22-21ksoftirqd/111:21:461
1414399211,18cyclictest22-21ksoftirqd/111:03:591
1414399210,20cyclictest22-21ksoftirqd/111:43:311
1414299212,9cyclictest2405-21runrttasks12:39:240
14142992119,1cyclictest0-21swapper/012:03:530
1414299210,4cyclictest4305-21id12:15:240
1414299210,13cyclictest20085-21sshd11:54:000
1414299210,12cyclictest21623-21sshd11:11:240
27272200,18sleep2135650irq/27-eth009:19:522
14145992015,3cyclictest8237-21sshd09:10:243
14145992015,3cyclictest25007-21sshd10:25:413
1414599200,18cyclictest44-21ksoftirqd/311:57:073
1414499208,5cyclictest25590-21sshd12:23:042
14144992012,6cyclictest10950irq/23-ehci_hcd10:03:492
14144992010,3cyclictest11930-21sshd09:20:402
1414399202,17cyclictest22-21ksoftirqd/109:40:151
14143992017,2cyclictest1848-21nfsd10:35:541
14143992015,3cyclictest26513-21sshd12:08:501
1414399200,18cyclictest22-21ksoftirqd/110:30:001
1414299209,2cyclictest0-21swapper/010:44:230
1414299201,12cyclictest2405-21runrttasks10:30:450
1414299201,11cyclictest0-21swapper/010:35:400
1414299200,2cyclictest0-21swapper/010:16:550
1414299200,10cyclictest7816-21sshd11:35:450
1414299200,10cyclictest0-21swapper/009:22:210
14145991914,3cyclictest1314-21sshd11:06:273
14145991912,5cyclictest5316-21sshd09:50:243
1414499198,3cyclictest8514-21sshd09:27:212
1414499197,6cyclictest10950irq/23-ehci_hcd12:12:542
1414499197,3cyclictest135650irq/27-eth012:09:122
1414499192,1cyclictest27909-21bash10:46:202
14144991913,2cyclictest10950irq/23-ehci_hcd09:42:082
1414499191,0cyclictest0-21swapper/209:35:492
14144991910,3cyclictest4729-21rm09:50:202
14143991915,2cyclictest0-21swapper/111:26:501
1414299191,2cyclictest13171-21sshd11:41:570
1414499188,0cyclictest10950irq/23-ehci_hcd10:31:142
1414499182,5cyclictest25-21rcuop/110:06:532
1414499181,7cyclictest135650irq/27-eth011:55:232
14144991813,3cyclictest30445-21sshd09:49:442
1414499180,15cyclictest135650irq/27-eth009:30:522
1414299188,2cyclictest0-21swapper/009:31:090
1414499176,3cyclictest0-21swapper/212:30:332
14144991712,3cyclictest13014-21sshd10:54:452
1414299170,15cyclictest0-21swapper/007:26:320
1414599164,11cyclictest10950irq/23-ehci_hcd09:01:413
1414599161,3cyclictest0-21swapper/307:30:223
14144991612,3cyclictest10950irq/23-ehci_hcd10:17:022
1414399167,2cyclictest1848-21nfsd07:37:341
1414399164,4cyclictest0-21swapper/108:10:221
1414599151,13cyclictest2405-21runrttasks08:37:333
14145991511,3cyclictest13142-21munin-run08:20:003
14143991511,3cyclictest10950irq/23-ehci_hcd07:19:491
1414299150,4cyclictest0-21swapper/008:27:360
1414299150,12cyclictest0-21swapper/008:57:030
1414599149,4cyclictest0-21swapper/307:15:213
1414599142,11cyclictest10950irq/23-ehci_hcd08:49:373
14145991411,2cyclictest0-21swapper/308:23:013
14145991410,3cyclictest0-21swapper/308:05:173
1414599140,13cyclictest0-21swapper/308:30:263
1414599140,13cyclictest0-21swapper/308:26:083
1414599140,12cyclictest0-21swapper/308:11:043
1414499149,2cyclictest0-21swapper/207:30:382
1414499146,4cyclictest10950irq/23-ehci_hcd07:20:172
1414499144,9cyclictest144550irq/28-eth1-rx-08:36:472
1414499143,10cyclictest10950irq/23-ehci_hcd08:16:322
1414499141,8cyclictest0-21swapper/208:31:032
1414499140,13cyclictest0-21swapper/209:01:202
1414499140,13cyclictest0-21swapper/208:24:542
1414399143,3cyclictest10950irq/23-ehci_hcd08:51:061
14143991410,3cyclictest3409-21sshd09:10:001
14143991410,3cyclictest18664-21munin-node07:20:181
1414399140,6cyclictest0-21swapper/107:56:541
1414399140,2cyclictest135650irq/27-eth008:06:331
1414299149,1cyclictest0-21swapper/007:45:030
1414299147,4cyclictest0-21swapper/008:07:000
14142991411,1cyclictest0-21swapper/007:15:180
1414299140,13cyclictest0-21swapper/008:15:080
1414299140,12cyclictest0-21swapper/008:52:530
1414299140,10cyclictest0-21swapper/007:41:520
1414599137,5cyclictest0-21swapper/307:56:143
1414599131,11cyclictest36-21rcuop/207:45:243
14145991311,1cyclictest0-21swapper/307:40:563
14145991311,1cyclictest0-21swapper/307:26:453
1414599131,10cyclictest0-21swapper/308:50:173
1414599130,5cyclictest1848-21nfsd07:35:133
1414599130,4cyclictest14643-21sort07:10:123
1414599130,12cyclictest1848-21nfsd09:05:043
1414599130,12cyclictest0-21swapper/308:55:263
1414599130,11cyclictest5873-21munin-node08:00:213
1414599130,11cyclictest23277-21memory08:40:193
1414499137,5cyclictest0-21swapper/209:06:102
1414499136,2cyclictest10950irq/23-ehci_hcd08:25:242
1414499135,5cyclictest10950irq/23-ehci_hcd07:50:302
1414499133,2cyclictest0-21swapper/207:48:322
1414499132,10cyclictest135650irq/27-eth008:51:232
1414499131,11cyclictest135650irq/27-eth008:11:012
1414499130,7cyclictest0-21swapper/207:59:032
1414499130,12cyclictest0-21swapper/208:57:042
1414499130,12cyclictest0-21swapper/208:42:062
1414499130,12cyclictest0-21swapper/207:19:082
1414499130,12cyclictest0-21swapper/207:13:222
1414499130,10cyclictest25326-21smartctl08:45:152
1414399130,5cyclictest0-21swapper/108:23:211
1414399130,4cyclictest2405-21runrttasks08:59:481
1414399130,4cyclictest2405-21runrttasks07:51:391
1414399130,12cyclictest1848-21nfsd09:00:311
1414399130,12cyclictest0-21swapper/108:45:281
1414399130,12cyclictest0-21swapper/108:41:591
1414399130,12cyclictest0-21swapper/108:35:251
1414399130,12cyclictest0-21swapper/108:31:561
1414399130,12cyclictest0-21swapper/107:41:141
1414299134,4cyclictest0-21swapper/007:21:520
1414299131,1cyclictest5032-21munin-node08:00:130
1414299130,5cyclictest0-21swapper/008:13:170
1414299130,1cyclictest0-21swapper/008:45:070
1414299130,1cyclictest0-21swapper/008:37:480
1414299130,1cyclictest0-21swapper/008:30:250
1414299130,12cyclictest0-21swapper/009:05:340
1414299130,12cyclictest0-21swapper/009:00:020
1414299130,12cyclictest0-21swapper/008:20:590
1414299130,12cyclictest0-21swapper/007:31:540
1414599120,3cyclictest18992-21diskstats07:20:143
1414599120,11cyclictest44-21ksoftirqd/307:50:113
1414499126,3cyclictest10950irq/23-ehci_hcd07:25:222
14144991210,1cyclictest0-21swapper/208:01:302
1414499120,11cyclictest8312-21runrttasks08:06:112
1414499120,11cyclictest26183-21munin-node07:35:162
1414499120,11cyclictest144550irq/28-eth1-rx-07:40:192
1414399120,4cyclictest4438-21atenall_r5power08:00:101
1414399120,11cyclictest14281-21atenall_r5power07:10:101
1414399120,11cyclictest0-21swapper/108:25:301
1414399120,11cyclictest0-21swapper/108:15:221
1414399120,11cyclictest0-21swapper/107:45:261
1414399120,11cyclictest0-21swapper/107:26:521
1414399120,10cyclictest23177-21munin-node07:30:221
1414299128,3cyclictest0-21swapper/007:36:160
1414299128,3cyclictest0-21swapper/007:10:200
1414299126,4cyclictest0-21swapper/007:50:220
1414299120,8cyclictest0-21swapper/008:40:160
1414299120,11cyclictest0-21swapper/007:55:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional