You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 23:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack5slot0.osadl.org (updated Sat Apr 27, 2024 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2320021340,2sleep323196-21bash11:33:493
2405021240,2sleep324051-21bash12:11:533
32246210435,41sleep30-21swapper/307:06:103
625621030,0sleep00-21swapper/009:45:580
3244229835,42sleep10-21swapper/107:08:401
273212980,2sleep21877-21nfsd12:23:452
163392980,4sleep10-21swapper/111:02:331
45402910,3sleep10-21swapper/111:27:461
67632870,3sleep30-21swapper/309:38:283
143922870,2sleep10-21swapper/108:50:211
296542860,2sleep21877-21nfsd11:57:202
296542860,2sleep21877-21nfsd11:57:202
180722860,0sleep00-21swapper/009:13:160
122952860,2sleep20-21swapper/212:06:382
89392840,3sleep38807-21sshd10:05:253
80572840,2sleep28047-21sshd11:28:112
88432830,2sleep20-21swapper/210:46:272
6952830,3sleep20-21swapper/211:54:002
57722830,2sleep10-21swapper/111:16:281
219232830,1sleep30-21swapper/309:32:343
190572820,2sleep20-21swapper/209:47:322
283682800,2sleep20-21swapper/212:00:532
263792790,3sleep226375-21bash09:21:432
255852780,2sleep325576-21sshd12:38:453
17352780,2sleep21724-21sshd12:16:532
142902780,0sleep10-21swapper/112:25:571
262832770,0sleep00-21swapper/012:08:200
250292760,1sleep10-21swapper/109:29:121
3322740,0sleep00-21swapper/012:16:420
267802740,0sleep026783-21sshd10:19:080
25672740,1sleep30-21swapper/311:27:323
184722720,1sleep33274399cyclictest10:47:363
194682710,4sleep33274399cyclictest10:36:383
193842700,1sleep019375-21sshd10:29:220
294912670,0sleep00-21swapper/011:26:530
235862660,2sleep30-21swapper/309:48:053
3234926334,16sleep20-21swapper/207:07:282
3251925934,13sleep00-21swapper/007:09:350
97582430,2sleep20-21swapper/211:20:422
207782370,3sleep20-21swapper/210:25:432
11912350,2sleep00-21swapper/009:30:110
306512330,2sleep30-21swapper/311:23:153
138842320,3sleep30-21swapper/310:50:493
277242271,24sleep3138550irq/27-eth011:11:263
42442260,2sleep30-21swapper/312:28:393
7872250,2sleep23274299cyclictest11:04:352
274752250,23sleep1138550irq/27-eth012:39:011
256972250,2sleep10-21swapper/111:34:071
156952252,21sleep328750irq/26-ahci[00010:13:593
154512250,2sleep10-21swapper/111:13:511
185902240,2sleep218593-21fschecks_time10:40:142
158632245,17sleep110950irq/23-ehci_hcd12:30:031
259862237,14sleep1138550irq/27-eth010:22:441
194872230,2sleep219485-21bash11:44:502
194872230,2sleep219485-21bash11:44:502
187952230,0sleep041ktimersoftd/010:59:080
3274099221,20cyclictest0-21swapper/012:25:150
219462220,3sleep32121-21runrttasks07:55:263
3274199211,3cyclictest12619-21sshd11:36:181
3274199210,5cyclictest0-21swapper/110:04:491
198322210,19sleep3138550irq/27-eth010:29:263
3274199201,4cyclictest29826-21sshd10:26:481
32741992011,3cyclictest1921-21nscd09:17:271
3274199201,12cyclictest18041-21sshd10:14:151
3274199201,11cyclictest0-21swapper/112:00:151
3274199200,6cyclictest0-21swapper/112:19:421
3274199200,10cyclictest0-21swapper/111:54:401
3274099201,10cyclictest0-21swapper/012:01:390
234172200,18sleep3138550irq/27-eth011:41:243
234172200,18sleep3138550irq/27-eth011:41:233
3274399194,1cyclictest44-21ksoftirqd/312:30:493
32743991912,4cyclictest19585-21sshd12:22:493
3274199195,2cyclictest10950irq/23-ehci_hcd09:20:301
3274199191,5cyclictest1106-21rm12:05:211
3274199191,13cyclictest0-21swapper/109:40:151
3274199191,10cyclictest0-21swapper/110:05:361
3274199190,3cyclictest29902-21sshd09:52:411
3274199190,2cyclictest0-21swapper/110:17:251
3274099191,9cyclictest1987-21sshd10:11:340
32740991913,5cyclictest0-21swapper/011:54:150
3274099191,18cyclictest1876-21nfsd10:48:440
3274099191,17cyclictest17062-21sshd11:10:150
3274099191,17cyclictest0-21swapper/010:07:190
3274099191,17cyclictest0-21swapper/009:42:190
3274099190,18cyclictest0-21swapper/010:35:120
308122190,1sleep030813-21id09:25:580
294862190,2sleep30-21swapper/311:04:083
202332192,15sleep310950irq/23-ehci_hcd11:18:153
3274399186,3cyclictest0-21swapper/309:28:203
3274399186,2cyclictest0-21swapper/311:58:433
3274399186,2cyclictest0-21swapper/311:58:433
32742991814,3cyclictest18100-21sshd09:51:132
3274199188,2cyclictest0-21swapper/111:43:381
3274199188,2cyclictest0-21swapper/111:43:381
3274199185,9cyclictest22-21ksoftirqd/109:10:301
3274199181,2cyclictest0-21swapper/112:22:011
3274199181,12cyclictest29820-21sshd11:57:221
3274199181,12cyclictest29820-21sshd11:57:221
3274199180,4cyclictest22113-21sshd09:32:361
3274199180,3cyclictest9496-21bash10:31:521
3274199180,3cyclictest30783-21sshd09:37:261
3274199180,3cyclictest0-21swapper/112:12:351
3274199180,2cyclictest0-21swapper/110:59:071
3274199180,12cyclictest0-21swapper/110:43:221
3274199180,11cyclictest138550irq/27-eth011:45:151
3274199180,10cyclictest138550irq/27-eth009:56:421
3274099189,8cyclictest0-21swapper/010:34:510
3274099187,10cyclictest16211-21sshd11:55:430
3274099187,10cyclictest16211-21sshd11:55:420
3274099184,13cyclictest14817-21sshd12:10:450
3274099182,15cyclictest0-21swapper/011:23:510
32740991815,2cyclictest0-21swapper/011:06:070
3274099181,16cyclictest29935-21sshd11:49:520
3274099181,16cyclictest0-21swapper/012:38:020
3274099181,16cyclictest0-21swapper/011:15:410
3274099181,16cyclictest0-21swapper/011:04:580
3274099181,16cyclictest0-21swapper/009:58:400
3274099181,16cyclictest0-21swapper/009:37:290
3274099181,16cyclictest0-21swapper/009:15:590
3274099181,16cyclictest0-21swapper/007:42:250
3274099180,17cyclictest0-21swapper/011:37:320
3274099180,17cyclictest0-21swapper/011:32:460
3274099180,17cyclictest0-21swapper/010:51:190
197662180,1sleep31876-21nfsd11:37:103
3274399177,5cyclictest36-21rcuop/210:18:043
3274399175,10cyclictest0-21swapper/310:41:543
3274399174,1cyclictest336-21latency_hist09:15:003
3274399171,4cyclictest0-21swapper/310:55:503
32742991710,6cyclictest27484-21irqstats10:15:212
3274199172,3cyclictest5175-21sshd10:35:071
3274199171,4cyclictest30710-21sshd09:45:111
3274199171,3cyclictest4740-21bash11:05:001
3274199170,4cyclictest12978-21bash10:50:421
3274199170,3cyclictest5675-21sshd10:46:031
3274199170,11cyclictest1987-21sshd11:22:481
3274099177,9cyclictest0-21swapper/010:04:280
3274099173,13cyclictest27672-21cp10:41:120
32740991713,3cyclictest3-21ksoftirqd/009:51:130
3274099171,15cyclictest29454-21sshd11:42:080
3274099171,15cyclictest29454-21sshd11:42:070
3274099171,15cyclictest21612-21sshd09:21:090
3274099171,15cyclictest0-21swapper/012:34:070
3274099171,15cyclictest0-21swapper/010:20:090
3274099171,15cyclictest0-21swapper/007:25:140
3274099171,15cyclictest0-21swapper/007:22:400
3274099170,16cyclictest0-21swapper/012:21:050
3274099170,12cyclictest0-21swapper/008:27:300
3274399169,4cyclictest138550irq/27-eth009:55:203
3274399168,6cyclictest0-21swapper/312:06:113
3274399166,5cyclictest0-21swapper/310:32:313
32743991612,3cyclictest0-21swapper/309:51:123
32743991611,4cyclictest22561-21sshd09:21:163
3274399160,5cyclictest0-21swapper/308:51:053
3274399160,14cyclictest0-21swapper/309:40:173
3274299165,2cyclictest0-21swapper/212:10:442
3274299165,10cyclictest1877-21nfsd10:35:452
32742991612,2cyclictest31710-21sshd10:56:472
32742991611,4cyclictest16754-21sshd09:31:562
3274099168,7cyclictest0-21swapper/007:35:100
3274099168,5cyclictest0-21swapper/008:21:590
3274099161,14cyclictest0-21swapper/008:55:250
3274099161,14cyclictest0-21swapper/008:35:020
3274099161,14cyclictest0-21swapper/007:53:200
3274099161,14cyclictest0-21swapper/007:45:150
3274099161,14cyclictest0-21swapper/007:30:130
3274099160,15cyclictest245982sleep008:00:360
3274099160,15cyclictest0-21swapper/008:42:510
3274099160,15cyclictest0-21swapper/008:14:470
3274099160,15cyclictest0-21swapper/007:14:100
203512160,3sleep20-21swapper/210:51:362
130892160,13sleep213265-21sshd10:25:002
3274399158,5cyclictest0-21swapper/307:44:083
3274399155,9cyclictest44-21ksoftirqd/310:21:113
32743991511,3cyclictest10950irq/23-ehci_hcd07:20:473
32743991510,3cyclictest7257-21atenall_r5power07:25:113
32743991510,2cyclictest10950irq/23-ehci_hcd11:47:523
3274399150,6cyclictest0-21swapper/308:55:233
3274399150,14cyclictest44-21ksoftirqd/309:00:303
3274399150,13cyclictest1987-21sshd11:05:093
3274399150,10cyclictest20811-21sshd11:52:323
32742991513,1cyclictest0-21swapper/209:17:272
32742991511,3cyclictest6766-21bash09:11:542
32742991511,3cyclictest25226-21sshd09:44:312
32742991511,2cyclictest7108-21sshd09:27:022
32742991510,4cyclictest8914-21bash11:35:502
32742991510,4cyclictest22266-21sshd11:45:112
3274299150,6cyclictest24156-21sshd09:36:392
3274299150,14cyclictest28435-21sshd11:34:272
3274299150,14cyclictest0-21swapper/210:34:172
3274299150,13cyclictest2121-21runrttasks08:43:052
3274199158,6cyclictest0-21swapper/108:12:571
3274199151,3cyclictest138550irq/27-eth007:25:271
3274199151,13cyclictest1163-21jbd2/dm-2-807:20:111
32741991511,3cyclictest0-21swapper/107:13:391
3274199151,11cyclictest138550irq/27-eth007:55:041
3274199150,10cyclictest138550irq/27-eth008:47:081
3274199150,10cyclictest138550irq/27-eth008:31:511
3274199150,10cyclictest138550irq/27-eth007:45:011
3274099158,6cyclictest0-21swapper/008:50:150
3274099158,6cyclictest0-21swapper/008:16:080
3274099158,6cyclictest0-21swapper/007:19:080
3274099156,8cyclictest0-21swapper/008:31:530
3274099151,13cyclictest0-21swapper/007:55:010
3274099150,14cyclictest0-21swapper/009:06:240
3274099150,14cyclictest0-21swapper/009:03:150
3274099150,14cyclictest0-21swapper/008:47:070
3274399149,3cyclictest25071-21latency_hist08:05:003
3274399148,2cyclictest138550irq/27-eth010:00:043
3274399142,11cyclictest138550irq/27-eth012:01:033
32743991411,2cyclictest10950irq/23-ehci_hcd07:47:213
32743991410,3cyclictest10950irq/23-ehci_hcd07:36:143
3274399140,3cyclictest0-21swapper/308:07:583
3274399140,1cyclictest44-21ksoftirqd/309:16:083
3274399140,13cyclictest0-21swapper/308:18:003
3274399140,12cyclictest44-21ksoftirqd/312:15:133
3274399140,12cyclictest10922-21atenall_r5power08:45:143
3274399140,11cyclictest0-21swapper/308:10:293
3274299149,4cyclictest20896-21sshd10:10:382
3274299148,5cyclictest1876-21nfsd07:36:522
3274299148,5cyclictest0-21swapper/207:21:112
3274299143,10cyclictest28908-21bash11:07:482
3274299142,5cyclictest138550irq/27-eth012:30:252
3274299142,11cyclictest28326-21sshd11:15:202
3274299140,1cyclictest1877-21nfsd07:26:222
3274299140,13cyclictest0-21swapper/207:11:492
3274299140,12cyclictest571-21sshd09:56:512
3274199149,4cyclictest138550irq/27-eth007:42:531
3274199146,2cyclictest0-21swapper/108:05:051
3274199143,1cyclictest10950irq/23-ehci_hcd08:28:221
3274199141,4cyclictest10598-21ntpq07:30:221
3274199141,3cyclictest0-21swapper/108:24:591
3274199141,12cyclictest0-21swapper/107:16:591
3274199140,4cyclictest138550irq/27-eth008:15:281
3274199140,3cyclictest0-21swapper/108:00:241
3274199140,2cyclictest138550irq/27-eth008:41:371
3274199140,13cyclictest218292sleep109:09:571
3274099141,12cyclictest0-21swapper/008:05:130
32743991311,1cyclictest0-21swapper/307:31:483
3274399130,12cyclictest138550irq/27-eth008:25:273
3274399130,12cyclictest0-21swapper/308:41:293
3274399130,12cyclictest0-21swapper/308:35:063
3274399130,12cyclictest0-21swapper/308:32:063
3274399130,12cyclictest0-21swapper/308:23:153
3274399130,11cyclictest3458-21iostat_ios07:15:173
3274399130,11cyclictest20580-21irqstats09:05:163
3274299138,4cyclictest147450irq/28-eth1-rx-09:09:182
3274299138,3cyclictest6984-21munin-node08:35:162
3274299138,3cyclictest30032-21diskstats08:15:152
3274299138,3cyclictest17643-21sshd11:10:172
3274299138,3cyclictest14867-21bash12:26:012
3274299137,5cyclictest0-21swapper/208:21:332
3274299137,5cyclictest0-21swapper/207:46:392
3274299136,6cyclictest28578-21sshd12:35:162
3274299131,3cyclictest21937-21sshd10:07:002
32742991311,1cyclictest0-21swapper/208:55:042
3274299130,12cyclictest29501-21sshd10:00:152
3274299130,12cyclictest0-21swapper/208:45:492
3274299130,12cyclictest0-21swapper/207:56:432
3274299130,12cyclictest0-21swapper/207:16:472
3274299130,11cyclictest4344-21df08:30:122
3274299130,11cyclictest26480-21smart_sda08:05:222
3274299130,11cyclictest18726-21df07:50:122
3274299130,11cyclictest14294-21munin-node07:40:142
3274299130,11cyclictest13719-21hddtemp_smartct08:50:122
3274199137,5cyclictest0-21swapper/109:00:151
3274199131,4cyclictest0-21swapper/108:35:001
3274199131,11cyclictest0-21swapper/108:55:031
3274199130,11cyclictest20088-21taskset07:50:281
3274399120,11cyclictest10950irq/23-ehci_hcd07:50:013
3274399120,11cyclictest0-21swapper/307:11:063
3274299128,3cyclictest23273-21df_inode08:00:132
3274299120,3cyclictest28115-21hwlatdetect08:10:142
3274299120,11cyclictest2540-21if_err_eth008:25:182
3274299120,11cyclictest0-21swapper/209:00:112
3274299120,11cyclictest0-21swapper/207:30:112
3274199125,2cyclictest138550irq/27-eth007:35:051
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional