You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-16 - 06:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Wed Jan 15, 2025 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3091921420,0sleep130920-21sshd10:25:091
2636221340,2sleep30-21swapper/311:09:113
329521220,2sleep23281-21sshd12:29:382
171721220,4sleep11092599cyclictest09:32:561
35122980,2sleep11848-21nfsd11:58:511
98862960,2sleep29889-21tr09:50:072
29592910,1sleep30-21swapper/309:49:283
239442910,0sleep00-21swapper/011:57:410
73402880,2sleep11847-21nfsd11:28:411
210262870,0sleep00-21swapper/009:28:250
52812860,2sleep32405-21runrttasks09:59:313
277482860,3sleep10-21swapper/111:33:381
862328536,45sleep30-21swapper/307:05:093
214012850,2sleep221403-21id12:03:362
1050328433,47sleep10-21swapper/107:07:551
114622830,3sleep30-21swapper/311:32:033
7072820,2sleep20-21swapper/209:26:222
183422820,2sleep21847-21nfsd10:36:532
5702810,1sleep20-21swapper/211:37:072
42802810,2sleep30-21swapper/310:48:473
178282810,2sleep21848-21nfsd11:29:422
161302810,1sleep03-21ksoftirqd/011:29:330
128712810,1sleep20-21swapper/209:11:072
124682780,1sleep312465-21sshd11:01:423
26092760,2sleep32611-21id09:29:523
199152760,1sleep30-21swapper/311:23:393
115752760,1sleep30-21swapper/310:42:463
263232740,2sleep326322-21sshd12:31:433
232742730,1sleep20-21swapper/211:48:332
218492730,2sleep10-21swapper/109:57:471
305642690,3sleep31092799cyclictest10:25:063
24942640,2sleep12482-21sshd10:09:101
235762610,2sleep20-21swapper/209:15:242
862026032,4sleep00-21swapper/007:05:060
1045825632,12sleep20-21swapper/207:07:322
159782530,0sleep115979-21bash11:47:521
133292390,3sleep113174-21sshd10:10:101
108752350,0sleep310876-21bash10:19:533
9692340,1sleep20-21swapper/210:02:142
287952340,3sleep041ktimersoftd/009:12:460
259662320,0sleep00-21swapper/009:32:050
174262310,3sleep117407-21sshd10:50:051
174262310,3sleep117407-21sshd10:50:051
30972290,0sleep23090-21sshd10:45:132
93532280,2sleep30-21swapper/311:16:323
50202280,4sleep30-21swapper/312:20:253
236262280,3sleep10-21swapper/109:12:161
169752280,26sleep3135650irq/27-eth009:44:163
75592270,2sleep17558-21bash12:30:011
37362270,2sleep30-21swapper/309:39:433
313952270,0sleep00-21swapper/009:19:400
218442270,25sleep1135650irq/27-eth011:08:461
161672270,1sleep20-21swapper/211:23:172
208032260,0sleep041ktimersoftd/011:42:070
164632260,3sleep30-21swapper/310:53:013
164632260,3sleep30-21swapper/310:53:003
123582260,1sleep00-21swapper/011:38:170
135932250,5sleep10-21swapper/111:14:031
241082240,0sleep31847-21nfsd10:34:133
12692240,2sleep21268-21sshd12:10:512
271062230,21sleep1135650irq/27-eth012:28:491
90012222,18sleep3135650irq/27-eth011:13:373
8962220,0sleep00-21swapper/009:35:590
80722220,3sleep00-21swapper/010:12:540
70052220,0sleep10-21swapper/110:58:121
48202220,6sleep03-21ksoftirqd/009:56:030
4132220,1sleep10-21swapper/111:37:071
269772220,0sleep00-21swapper/009:51:490
152842220,2sleep315283-21bash10:36:333
82452210,0sleep18240-21rm12:23:511
71302210,19sleep1135650irq/27-eth009:27:021
59942212,16sleep3135650irq/27-eth012:17:253
33352212,17sleep3135650irq/27-eth011:25:123
237362210,2sleep223735-21bash12:37:432
148032210,4sleep21092699cyclictest09:40:412
1092699214,8cyclictest10915-21sshd09:33:512
1092699212,14cyclictest0-21swapper/209:55:502
108672210,3sleep30-21swapper/310:13:173
78592200,18sleep3135650irq/27-eth009:10:373
1092699203,11cyclictest23087-21sshd12:19:112
1092499200,16cyclictest0-21swapper/011:00:190
243262190,1sleep10-21swapper/112:19:191
156142190,0sleep00-21swapper/010:49:570
1092799191,10cyclictest0-21swapper/311:44:083
1092799190,12cyclictest0-21swapper/310:55:103
10926991913,5cyclictest1848-21nfsd11:05:072
10926991912,3cyclictest31026-21sshd11:15:312
10924991913,5cyclictest0-21swapper/011:19:440
1092499190,15cyclictest6257-21rm12:08:230
105902190,17sleep3135650irq/27-eth009:53:293
203902180,16sleep1135650irq/27-eth011:17:401
1092799185,4cyclictest0-21swapper/310:04:523
1092799183,11cyclictest0-21swapper/310:21:313
1092699183,8cyclictest1893-21nscd10:29:472
1092699182,7cyclictest26894-21sshd11:12:122
1092699182,13cyclictest12475-21kworker/2:210:44:252
1092699181,12cyclictest33-21ksoftirqd/210:32:252
1092699181,11cyclictest574-21kworker/2:010:14:092
1092499180,17cyclictest0-21swapper/012:00:420
1092499180,17cyclictest0-21swapper/010:23:180
1092499180,16cyclictest0-21swapper/012:39:270
1092499180,15cyclictest24305-21sshd11:11:560
96262170,15sleep3135650irq/27-eth009:30:253
69752170,2sleep10-21swapper/110:32:301
292272170,15sleep1135650irq/27-eth009:22:421
1092799177,5cyclictest7299-21runrttasks11:56:053
10927991713,2cyclictest29441-21sshd10:05:183
1092699173,8cyclictest5072-21sshd12:20:252
1092699173,11cyclictest469-21sshd12:32:222
1092699172,11cyclictest135650irq/27-eth009:35:182
1092599178,4cyclictest5005-21sshd12:08:151
1092599178,4cyclictest27677-21unixbench_singl09:35:221
1092599177,5cyclictest5537-21bash10:42:091
10925991713,3cyclictest7079-21sshd09:40:021
10925991711,3cyclictest0-21swapper/111:24:551
1092599170,4cyclictest15477-21sshd09:50:341
1092599170,15cyclictest19693-21sshd11:54:191
1092599170,12cyclictest29427-21sshd09:45:311
1092599170,11cyclictest0-21swapper/110:03:231
1092499178,8cyclictest0-21swapper/012:20:510
1092499177,9cyclictest0-21swapper/010:09:280
10924991713,3cyclictest3-21ksoftirqd/011:47:380
1092499170,5cyclictest0-21swapper/012:34:060
1092499170,4cyclictest0-21swapper/011:51:290
1092499170,3cyclictest0-21swapper/010:35:190
1092499170,16cyclictest5810-21kworker/0:010:59:290
1092499170,16cyclictest14635-21sshd12:15:120
88462160,0sleep00-21swapper/008:15:160
52102160,14sleep3135650irq/27-eth011:46:523
1092799167,4cyclictest21717-21sshd11:36:003
1092799164,4cyclictest4806-21bash09:23:293
1092799164,4cyclictest16087-21sshd12:06:143
1092799163,12cyclictest0-21swapper/312:00:393
1092799161,6cyclictest0-21swapper/309:17:473
10927991610,1cyclictest27308-21sshd12:25:423
1092799160,4cyclictest25-21rcuop/112:37:153
1092799160,14cyclictest27032-21nfsd412:10:153
1092699163,10cyclictest0-21swapper/207:38:382
1092699162,12cyclictest31248-21sshd11:30:512
1092699162,11cyclictest30575-21bash11:03:252
10926991611,3cyclictest9197-21rm09:20:342
1092699161,13cyclictest7636-21sshd10:06:232
1092699161,13cyclictest1915-21snmpd07:15:462
1092699161,12cyclictest22427-21sshd11:51:282
10926991611,1cyclictest15530-21sshd10:55:512
1092699160,8cyclictest1959-21sshd12:10:002
1092599169,5cyclictest28994-21id10:15:091
1092599168,6cyclictest0-21swapper/111:00:261
1092599168,3cyclictest1000-21sshd12:35:251
1092599168,3cyclictest0-21swapper/112:10:011
1092599168,2cyclictest0-21swapper/110:49:261
1092599160,11cyclictest10225-21munin-plugin-st08:20:011
1092499160,8cyclictest3218-21sshd12:26:280
1092499160,3cyclictest0-21swapper/011:33:490
1092499160,15cyclictest32180-21sshd10:15:210
1092499160,15cyclictest13128-21sshd10:33:070
1092499160,15cyclictest0-21swapper/008:55:190
1092499160,12cyclictest32598-21sshd10:44:530
1092499160,12cyclictest16287-21sshd11:05:080
1092799150,5cyclictest6224-21sshd11:53:013
1092699154,10cyclictest33-21ksoftirqd/209:46:232
1092699154,10cyclictest0-21swapper/211:55:372
1092699153,11cyclictest6280-21sshd11:40:412
1092699153,11cyclictest0-21swapper/207:34:052
1092699152,8cyclictest135650irq/27-eth008:01:242
1092699150,13cyclictest21664-21sshd10:50:222
1092699150,13cyclictest21664-21sshd10:50:212
1092699150,13cyclictest0-21swapper/210:15:112
1092699150,10cyclictest18969-21sshd10:20:332
1092599157,6cyclictest2405-21runrttasks09:05:121
1092599153,11cyclictest135650irq/27-eth010:20:571
1092599152,4cyclictest0-21swapper/111:40:021
1092599150,3cyclictest0-21swapper/112:01:201
1092599150,13cyclictest20986-21fschecks_count09:15:141
1092599150,13cyclictest0-21swapper/107:55:501
1092599150,10cyclictest0-21swapper/110:38:001
1092499157,7cyclictest12556-21sshd10:00:110
1092499157,7cyclictest0-21swapper/008:25:210
1092499153,8cyclictest0-21swapper/012:11:420
1092499152,9cyclictest0-21swapper/010:27:390
10924991512,2cyclictest0-21swapper/009:24:200
1092499150,14cyclictest0-21swapper/011:20:100
1092499150,14cyclictest0-21swapper/009:43:560
1092799147,5cyclictest0-21swapper/308:10:223
10927991410,3cyclictest135650irq/27-eth008:29:513
1092799140,12cyclictest19456-21chrt07:25:513
1092799140,11cyclictest0-21swapper/308:40:443
1092699148,4cyclictest11283-21grep07:10:142
1092699140,2cyclictest0-21swapper/208:31:322
1092599140,4cyclictest11831-21find08:20:231
1092599140,3cyclictest135650irq/27-eth007:28:151
1092599140,13cyclictest135650irq/27-eth007:30:491
1092599140,12cyclictest2405-21runrttasks08:09:491
1092499140,9cyclictest0-21swapper/009:46:480
1092499140,8cyclictest0-21swapper/010:53:310
1092499140,8cyclictest0-21swapper/010:53:300
1092499140,1cyclictest0-21swapper/007:40:150
1092499140,10cyclictest0-21swapper/009:05:120
1092499140,10cyclictest0-21swapper/009:00:340
1092799139,3cyclictest135650irq/27-eth008:56:263
1092799138,4cyclictest0-21swapper/308:15:253
1092799138,4cyclictest0-21swapper/307:35:013
1092799137,5cyclictest0-21swapper/307:45:513
1092799137,5cyclictest0-21swapper/307:40:403
1092799134,7cyclictest0-21swapper/307:55:123
10927991311,1cyclictest0-21swapper/307:31:413
1092799130,6cyclictest5699-21sed08:10:003
1092799130,4cyclictest22800-21munin-node08:45:163
1092799130,3cyclictest144550irq/28-eth1-rx-09:00:033
1092799130,12cyclictest514-21turbostat.cron09:09:553
1092799130,12cyclictest0-21swapper/308:35:033
1092799130,12cyclictest0-21swapper/308:24:413
1092799130,12cyclictest0-21swapper/308:00:593
1092799130,12cyclictest0-21swapper/307:20:433
1092799130,12cyclictest0-21swapper/307:17:153
1092799130,12cyclictest0-21swapper/307:14:533
1092699139,2cyclictest27097-21munin-node08:55:152
1092699138,4cyclictest0-21swapper/208:20:002
1092699138,3cyclictest4719-21munin-node08:05:162
1092699133,8cyclictest19003-21processes07:25:182
1092699133,7cyclictest417-21jbd2/dm-0-807:55:572
1092699133,1cyclictest0-21swapper/208:10:182
1092699132,10cyclictest135650irq/27-eth008:15:002
1092699131,11cyclictest135650irq/27-eth009:00:522
1092699131,10cyclictest31269-21diskstats09:05:132
1092699130,5cyclictest135650irq/27-eth008:51:152
1092699130,5cyclictest0-21swapper/208:26:502
1092699130,4cyclictest25740-21sh07:40:182
1092699130,12cyclictest1848-21nfsd08:36:252
1092699130,12cyclictest1846-21nfsd07:50:552
1092699130,11cyclictest15492-21munin-node07:20:122
1092599138,4cyclictest17966-21munin-node08:35:131
1092599137,5cyclictest0-21swapper/108:30:131
10925991311,1cyclictest0-21swapper/108:55:121
1092599130,4cyclictest2405-21runrttasks07:15:581
1092599130,12cyclictest0-21swapper/109:00:111
1092599130,12cyclictest0-21swapper/108:51:261
1092599130,12cyclictest0-21swapper/108:40:551
1092599130,12cyclictest0-21swapper/108:03:391
1092599130,12cyclictest0-21swapper/107:43:021
1092599130,12cyclictest0-21swapper/107:22:141
1092599130,11cyclictest6065-21cpuspeed_turbos08:10:161
10924991311,1cyclictest0-21swapper/007:18:130
1092499130,9cyclictest0-21swapper/007:35:190
1092499130,3cyclictest0-21swapper/008:45:000
1092499130,2cyclictest0-21swapper/007:50:380
1092499130,12cyclictest21188-21ntpq07:30:190
1092499130,12cyclictest0-21swapper/008:42:170
1092499130,11cyclictest0-21swapper/007:45:400
1092499130,10cyclictest0-21swapper/008:00:540
1092799127,4cyclictest24696-21fschecks_time08:50:173
10927991210,1cyclictest0-21swapper/307:50:253
1092799120,11cyclictest0-21swapper/308:30:243
1092699128,3cyclictest22089-21df08:45:102
1092699120,10cyclictest27645-21irqstats07:45:162
1092699120,10cyclictest19877-21diskstats08:40:142
1092599122,9cyclictest0-21swapper/107:36:331
1092599120,11cyclictest0-21swapper/107:45:041
1092599120,10cyclictest11266-21munin-node07:10:131
1092599120,10cyclictest0-21swapper/108:45:101
1092599120,10cyclictest0-21swapper/108:25:131
1092599120,10cyclictest0-21swapper/107:50:141
1092499126,2cyclictest0-21swapper/008:50:550
1092499126,2cyclictest0-21swapper/008:05:400
1092499120,1cyclictest0-21swapper/008:30:230
1092499120,1cyclictest0-21swapper/008:20:500
1092499120,11cyclictest0-21swapper/008:35:240
1092499120,11cyclictest0-21swapper/008:11:150
1092499120,11cyclictest0-21swapper/007:20:210
1092499120,11cyclictest0-21swapper/007:12:230
1092499117,3cyclictest0-21swapper/007:25:010
1092499110,5cyclictest0-21swapper/007:55:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional