You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-25 - 14:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sun Feb 25, 2024 12:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2759221310,4sleep31283199cyclictest10:00:553
1487121280,0sleep214870-21sshd10:19:412
1346321260,1sleep313464-21sshd11:18:133
1346321260,1sleep313464-21sshd11:18:133
1576521210,3sleep21283099cyclictest09:47:392
1248829935,43sleep10-21swapper/107:07:321
1240129849,44sleep30-21swapper/307:06:263
12432950,2sleep21242-21bash12:22:482
80772930,2sleep30-21swapper/311:09:533
213382930,1sleep30-21swapper/309:52:173
114892930,0sleep2321ktimersoftd/212:08:422
102562910,2sleep20-21swapper/210:38:572
278922900,2sleep10-21swapper/109:17:001
278922900,2sleep10-21swapper/109:17:001
54022880,1sleep35399-21bash10:30:203
122382880,0sleep00-21swapper/011:10:210
85512870,2sleep12121-21runrttasks11:37:071
57582870,2sleep041ktimersoftd/011:40:390
112202860,1sleep10-21swapper/109:50:591
244662840,2sleep224372-21sshd12:25:292
256012810,1sleep10-21swapper/111:31:181
256012810,1sleep10-21swapper/111:31:181
181622810,1sleep10-21swapper/109:43:581
128962790,0sleep312898-21id11:21:583
128962790,0sleep312898-21id11:21:583
184412780,0sleep00-21swapper/012:28:350
136222780,1sleep01282899cyclictest09:15:190
136222780,1sleep01282899cyclictest09:15:190
54412770,2sleep10-21swapper/109:22:091
309722770,3sleep00-21swapper/010:17:390
258572770,2sleep10-21swapper/110:36:471
140372760,1sleep20-21swapper/208:25:012
105272760,1sleep00-21swapper/012:20:100
62862750,2sleep20-21swapper/209:14:212
148642750,2sleep214860-21idleruntime08:25:242
180902720,2sleep118081-21sshd12:39:541
1251927243,12sleep20-21swapper/207:07:562
249812710,2sleep324974-21sshd11:58:453
45432700,1sleep30-21swapper/309:58:103
175672680,4sleep11282999cyclictest11:03:161
270542670,3sleep01282899cyclictest10:44:520
40712610,3sleep21283099cyclictest10:10:112
1256726035,4sleep00-21swapper/007:08:310
157302360,3sleep30-21swapper/312:24:343
278022342,30sleep3138550irq/27-eth010:25:163
121482320,4sleep31283199cyclictest10:15:213
277322301,26sleep3138550irq/27-eth012:33:283
192502300,1sleep019251-21sshd12:09:400
237482290,3sleep10-21swapper/112:29:121
22832280,3sleep31283199cyclictest11:48:073
160152280,3sleep10-21swapper/111:45:481
48282270,4sleep11282999cyclictest10:10:181
320142260,2sleep30-21swapper/309:37:303
297832260,1sleep010-21rcuc/010:25:240
199762260,4sleep20-21swapper/212:36:162
134122260,3sleep213414-21cpuspeed_turbos09:55:212
73432250,2sleep30-21swapper/312:08:103
292622250,23sleep1138550irq/27-eth010:52:551
289742250,3sleep10-21swapper/111:20:091
289742250,3sleep10-21swapper/111:20:081
142182250,1sleep30-21swapper/311:37:493
1283199250,23cyclictest12059-21sshd11:14:123
39162240,0sleep03913-21sshd12:30:330
30492240,2sleep13050-21sshd09:37:561
102752240,4sleep11282999cyclictest12:23:551
210262230,20sleep3138550irq/27-eth009:16:073
210262230,20sleep3138550irq/27-eth009:16:073
184572230,3sleep118452-21sshd11:54:031
300842220,2sleep10-21swapper/110:56:511
150492220,4sleep10-21swapper/109:27:261
1283099223,11cyclictest0-21swapper/210:55:412
1283099221,10cyclictest0-21swapper/209:35:572
10692220,2sleep21068-21sshd10:41:412
254252212,17sleep2138550irq/27-eth009:40:432
225102212,17sleep1138550irq/27-eth009:32:201
287992200,0sleep00-21swapper/012:10:400
27342192,15sleep3138550irq/27-eth012:38:053
1283099192,9cyclictest0-21swapper/207:57:452
1282999190,17cyclictest23276-21ipmi_temp10:40:281
273332180,3sleep10-21swapper/110:48:461
1283099183,6cyclictest32636-21bash09:21:292
1283099183,6cyclictest20935-21sshd11:15:172
1283099183,6cyclictest20935-21sshd11:15:172
1283099183,6cyclictest0-21swapper/210:02:452
1283099182,8cyclictest0-21swapper/210:51:052
1283099182,11cyclictest2780-21sshd10:05:472
12830991816,1cyclictest0-21swapper/209:03:032
12830991812,5cyclictest6448-21sshd11:48:402
195062170,1sleep019477-21sshd11:30:330
195062170,1sleep019477-21sshd11:30:330
1283099173,9cyclictest0-21swapper/208:30:412
1283099173,5cyclictest0-21swapper/207:50:162
1283099172,7cyclictest0-21swapper/208:16:132
1283099172,6cyclictest2684-21kworker/u8:208:00:532
1283099172,13cyclictest0-21swapper/208:14:532
1283099172,10cyclictest386-21sshd11:08:552
1283099172,10cyclictest1987-21sshd12:00:112
1283099172,10cyclictest0-21swapper/207:49:052
1283099170,10cyclictest0-21swapper/208:51:172
12829991712,3cyclictest7357-21bash12:34:541
1282999170,12cyclictest16601-21sshd11:10:461
111612170,15sleep310950irq/23-ehci_hcd10:50:373
14772160,2sleep10-21swapper/109:57:481
1283199169,3cyclictest1930-21nscd12:27:273
1283199168,3cyclictest14744-21sshd11:26:073
1283199167,5cyclictest8177-21sshd09:10:363
12831991614,1cyclictest0-21swapper/310:07:273
1283199160,14cyclictest23745-21sshd09:40:303
1283199160,14cyclictest0-21swapper/309:25:213
1283099162,5cyclictest0-21swapper/208:07:572
1283099162,12cyclictest36-21rcuop/211:11:242
1283099162,10cyclictest3433-21sshd09:30:032
1283099162,10cyclictest0-21swapper/211:22:042
1283099162,10cyclictest0-21swapper/211:22:032
1283099161,4cyclictest138550irq/27-eth010:28:292
12830991611,4cyclictest24965-21sshd11:43:042
1283099161,12cyclictest0-21swapper/211:35:392
1283099160,7cyclictest0-21swapper/210:31:252
1282999169,3cyclictest1921-21nscd10:15:041
1282999161,7cyclictest0-21swapper/111:15:381
1282999161,7cyclictest0-21swapper/111:15:371
12829991613,2cyclictest1629-21sshd11:05:171
1282999160,3cyclictest147450irq/28-eth1-rx-08:30:471
1282999160,14cyclictest0-21swapper/109:48:181
1282999160,11cyclictest138550irq/27-eth010:26:181
1282899168,4cyclictest22283-21sshd09:12:200
1282899160,15cyclictest0-21swapper/011:53:230
1282899160,15cyclictest0-21swapper/011:48:300
1282899160,11cyclictest0-21swapper/010:49:420
1283199156,2cyclictest8009-21sshd12:19:523
1283199154,6cyclictest21177-21bash10:24:273
1283199154,6cyclictest138550irq/27-eth011:52:303
1283199152,12cyclictest147450irq/28-eth1-rx-08:05:383
12831991512,2cyclictest16779-21sshd10:55:193
12831991510,3cyclictest23103-21sshd10:40:273
1283199150,14cyclictest1987-21sshd11:04:113
1283199150,13cyclictest1455-21sshd09:45:513
1283199150,13cyclictest0-21swapper/307:50:283
1283199150,10cyclictest0-21swapper/311:30:233
1283199150,10cyclictest0-21swapper/311:30:233
1283099159,5cyclictest2799-21sadc12:00:002
1283099153,9cyclictest10738-21sshd11:29:362
1283099153,6cyclictest0-21swapper/207:27:352
1283099152,8cyclictest0-21swapper/207:35:392
1283099152,10cyclictest4859-21sshd10:22:212
12830991510,3cyclictest27546-21sshd12:10:332
12830991510,3cyclictest1708-21users10:45:332
1283099150,13cyclictest16577-21sshd11:30:192
1283099150,13cyclictest16577-21sshd11:30:192
1283099150,13cyclictest0-21swapper/209:50:312
1282999154,5cyclictest25335-21sshd11:58:471
12829991513,1cyclictest0-21swapper/109:14:551
12829991511,3cyclictest11899-21sshd12:04:561
12829991511,3cyclictest10950irq/23-ehci_hcd07:54:161
1282999150,3cyclictest22345-21sshd12:06:021
1282999150,14cyclictest1877-21nfsd10:00:271
1282999150,14cyclictest0-21swapper/110:20:311
1282999150,13cyclictest12654-21sshd11:41:301
1282999150,11cyclictest138550irq/27-eth007:40:401
1282999150,10cyclictest12630-21cp11:25:501
1282899156,8cyclictest0-21swapper/011:55:400
1282899153,7cyclictest0-21swapper/009:30:400
1282899152,12cyclictest28309-21sshd11:20:020
1282899152,12cyclictest28309-21sshd11:20:020
12828991510,4cyclictest5762-21kworker/0:208:37:180
1282899150,14cyclictest0-21swapper/009:29:170
1282899150,13cyclictest6074-21munin-node08:05:250
1282899150,13cyclictest32084-21cp09:37:310
1282899150,13cyclictest18285-21nfsd410:55:250
1282899150,10cyclictest15135-21sshd09:23:230
1283199148,5cyclictest7243-21sshd12:00:263
1283199148,4cyclictest17621-21proc_pri08:30:313
1283199148,4cyclictest17041-21sshd10:35:393
1283199141,1cyclictest22516-21vmstat08:40:333
1283199141,11cyclictest7888-21sshd09:30:303
1283199140,3cyclictest2707-21iostat11:40:233
1283199140,13cyclictest1885-21bash09:21:413
1283199140,13cyclictest15901-21sshd10:11:343
1283199140,13cyclictest0-21swapper/312:12:173
1283099143,7cyclictest138550irq/27-eth008:55:032
1283099142,2cyclictest0-21swapper/207:17:252
1283099142,2cyclictest0-21swapper/207:17:242
1283099141,9cyclictest11795-21sshd09:15:032
1283099141,9cyclictest11795-21sshd09:15:022
12830991411,2cyclictest16527-21bash12:16:562
1283099140,2cyclictest0-21swapper/211:00:542
1283099140,13cyclictest0-21swapper/209:29:352
1283099140,12cyclictest22660-21nfsd411:50:302
1282999146,6cyclictest0-21swapper/107:55:271
1282999146,4cyclictest10950irq/23-ehci_hcd08:15:231
1282999142,8cyclictest6889-21sshd10:06:191
12829991410,3cyclictest0-21swapper/107:35:351
1282999140,9cyclictest22-21ksoftirqd/112:16:161
1282999140,5cyclictest13015-21sshd10:31:141
1282999140,5cyclictest0-21swapper/108:52:221
1282999140,1cyclictest36-21rcuop/208:22:131
1282999140,13cyclictest0-21swapper/108:40:531
1282999140,13cyclictest0-21swapper/108:36:121
1282999140,12cyclictest24632-21df12:10:181
1282899148,3cyclictest0-21swapper/012:17:220
1282899148,3cyclictest0-21swapper/011:00:290
1282899148,3cyclictest0-21swapper/007:12:390
1282899147,6cyclictest0-21swapper/009:43:350
1282899144,5cyclictest7201-21sshd12:38:360
1282899143,1cyclictest22884-21sshd10:36:250
12828991411,2cyclictest1099-21sshd10:13:490
1282899140,9cyclictest29766-21sshd11:27:590
1282899140,8cyclictest0-21swapper/009:49:380
1282899140,1cyclictest3247-21sshd11:36:270
1282899140,1cyclictest0-21swapper/010:51:090
1282899140,1cyclictest0-21swapper/010:00:390
1282899140,1cyclictest0-21swapper/007:50:310
1282899140,13cyclictest26335-21sshd10:20:570
1282899140,13cyclictest25092-21bash10:08:380
1282899140,13cyclictest0-21swapper/012:01:470
1282899140,13cyclictest0-21swapper/009:51:300
1282899140,13cyclictest0-21swapper/007:44:340
1282899140,13cyclictest0-21swapper/007:22:520
1282899140,10cyclictest0-21swapper/009:55:390
1283199139,3cyclictest10950irq/23-ehci_hcd09:00:063
1283199130,5cyclictest25080-21missed_timers07:35:293
1283199130,5cyclictest0-21swapper/307:30:243
1283199130,4cyclictest2727-21turbostat08:04:553
1283199130,4cyclictest2121-21runrttasks08:25:023
1283199130,4cyclictest15948-21iostat_ios07:15:253
1283199130,4cyclictest15948-21iostat_ios07:15:243
1283199130,12cyclictest13310-21forks07:10:243
1283199130,12cyclictest0-21swapper/309:07:583
1283199130,12cyclictest0-21swapper/308:46:313
1283199130,12cyclictest0-21swapper/307:42:203
1283199130,12cyclictest0-21swapper/307:20:583
1283199130,11cyclictest29214-21sshd10:45:063
1283199130,11cyclictest19943-21df07:25:203
1283199130,11cyclictest18965-21df_inode08:35:193
1283199130,11cyclictest10432-21iostat_ios08:15:223
1283099138,4cyclictest27076-21munin-node07:40:242
1283099138,4cyclictest1921-21nscd12:30:292
1283099132,8cyclictest0-21swapper/208:45:052
1283099132,2cyclictest0-21swapper/209:05:172
1283099132,10cyclictest10950irq/23-ehci_hcd08:40:162
1283099131,9cyclictest0-21swapper/208:36:032
1283099130,2cyclictest0-21swapper/207:34:532
1283099130,12cyclictest0-21swapper/207:21:072
1283099130,11cyclictest13461-21fschecks_time07:10:242
1282999137,5cyclictest22576-21hddtemp_smartct07:30:241
1282999137,5cyclictest0-21swapper/108:05:071
1282999136,2cyclictest10950irq/23-ehci_hcd08:30:001
12829991311,1cyclictest0-21swapper/107:25:211
1282999130,4cyclictest3708-21iostat08:00:241
1282999130,12cyclictest0-21swapper/109:05:321
1282999130,12cyclictest0-21swapper/108:57:321
1282999130,12cyclictest0-21swapper/108:10:251
1282999130,12cyclictest0-21swapper/107:14:441
1282999130,11cyclictest30183-21sort09:00:261
1282999130,11cyclictest28735-21grep07:45:241
1282999130,11cyclictest24692-21unixbench_singl08:45:321
1282899138,4cyclictest0-21swapper/008:41:080
1282899137,5cyclictest0-21swapper/008:50:050
1282899137,5cyclictest0-21swapper/008:15:080
1282899137,3cyclictest0-21swapper/009:01:410
1282899136,3cyclictest0-21swapper/008:55:350
1282899135,4cyclictest0-21swapper/011:05:190
1282899133,8cyclictest8177-21sshd10:30:350
1282899130,2cyclictest0-21swapper/011:15:240
1282899130,2cyclictest0-21swapper/011:15:230
1282899130,12cyclictest0-21swapper/009:09:570
1282899130,12cyclictest0-21swapper/008:31:200
1282899130,12cyclictest0-21swapper/008:26:120
1282899130,12cyclictest0-21swapper/008:21:200
1282899130,12cyclictest0-21swapper/008:10:510
1282899130,12cyclictest0-21swapper/007:16:310
1282899130,12cyclictest0-21swapper/007:16:300
1282899130,10cyclictest0-21swapper/008:45:160
1282899130,10cyclictest0-21swapper/008:00:310
1282899130,10cyclictest0-21swapper/007:59:280
1283199126,5cyclictest0-21swapper/307:45:493
1283199120,3cyclictest27916-21df_inode08:55:233
1283199120,11cyclictest0-21swapper/308:10:063
1283199120,10cyclictest830-21cpuspeed_turbos07:55:233
1283199120,10cyclictest25337-21taskset08:50:033
1283199120,10cyclictest0-21swapper/308:20:233
1282999120,11cyclictest15872-21hwlatdetect07:15:241
1282999120,11cyclictest15872-21hwlatdetect07:15:241
1282999120,11cyclictest0-21swapper/107:20:371
1282899127,4cyclictest0-21swapper/007:35:560
1282899127,1cyclictest0-21swapper/007:26:250
1282899120,1cyclictest23540-21munin-node07:30:340
1282899120,11cyclictest0-21swapper/007:45:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional