You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-03-03 - 16:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sun Mar 03, 2024 12:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2642321500,2sleep226421-21sshd11:23:232
1748621500,2sleep117485-21bash12:27:251
2453121310,4sleep0748299cyclictest11:07:220
2806821040,4sleep20-21swapper/209:40:552
720629749,44sleep30-21swapper/307:08:473
727129527,40sleep10-21swapper/107:09:221
312492950,2sleep30-21swapper/309:49:113
240492920,1sleep024048-21seq11:46:060
171352870,3sleep10-21swapper/112:08:111
171352870,3sleep10-21swapper/112:08:111
138392870,2sleep20-21swapper/211:25:402
28932860,0sleep00-21swapper/009:26:100
263232860,0sleep041ktimersoftd/011:15:230
263232860,0sleep041ktimersoftd/011:15:230
196872850,2sleep10-21swapper/109:32:131
107292850,1sleep1748699cyclictest11:09:391
46022840,2sleep24601-21sshd10:28:522
65372830,2sleep041ktimersoftd/010:05:300
307142830,1sleep20-21swapper/212:36:412
31232810,4sleep3749599cyclictest11:28:283
61342790,1sleep36135-21bash11:59:193
61432780,2sleep20-21swapper/210:05:282
316702770,6sleep0748299cyclictest10:48:140
180682760,0sleep00-21swapper/010:18:410
211742750,2sleep32121-21runrttasks07:40:213
164462750,1sleep00-21swapper/011:02:210
150962750,1sleep10-21swapper/112:15:321
130502750,3sleep21876-21nfsd11:09:562
323202730,1sleep232319-21bash10:04:492
326642700,2sleep20-21swapper/211:54:492
28672680,1sleep30-21swapper/310:48:413
323502660,2sleep31929-21nscd12:25:243
701026046,9sleep20-21swapper/207:06:192
701325833,13sleep00-21swapper/007:06:200
146482580,0sleep00-21swapper/011:52:390
78752310,29sleep3138550irq/27-eth012:03:213
58272270,5sleep3749599cyclictest10:29:023
255812270,4sleep3749599cyclictest10:19:353
214992270,2sleep221501-21id11:30:322
199062270,25sleep3138550irq/27-eth012:23:573
93772250,3sleep29369-21sshd12:22:372
748299253,18cyclictest4898-21sshd09:53:440
748299250,24cyclictest14889-21sshd10:30:080
748299250,21cyclictest17956-21id11:56:480
748299241,16cyclictest0-21swapper/007:50:240
291262240,2sleep129124-21bash11:42:571
147112240,0sleep00-21swapper/011:37:280
291882230,21sleep2138550irq/27-eth011:04:002
189242230,1sleep00-21swapper/009:35:570
7486992219,2cyclictest14886-21sshd10:30:071
748299221,19cyclictest0-21swapper/011:26:450
103752220,19sleep1138550irq/27-eth012:11:081
7491992113,4cyclictest9517-21sshd10:57:302
749199210,18cyclictest33-21ksoftirqd/210:11:302
748299213,16cyclictest26592-21sshd12:24:450
748299211,3cyclictest20741-21sshd11:41:580
230232210,0sleep00-21swapper/007:44:170
7482992011,5cyclictest27002-21sshd12:32:240
748299200,9cyclictest0-21swapper/010:54:580
241872200,0sleep024171-21sshd09:17:090
135812200,3sleep30-21swapper/311:48:453
114492200,2sleep111444-21sshd11:52:151
7491991915,3cyclictest10049-21sshd09:58:122
7491991915,2cyclictest25691-21sshd12:32:152
748299193,9cyclictest1877-21nfsd10:41:030
748299191,1cyclictest0-21swapper/009:56:060
748299191,13cyclictest0-21swapper/009:47:170
44172191,16sleep3138550irq/27-eth009:42:023
293222190,16sleep1138550irq/27-eth011:15:411
293222190,16sleep1138550irq/27-eth011:15:411
293192190,3sleep30-21swapper/312:32:413
142332190,4sleep20-21swapper/211:41:102
75482180,2sleep30-21swapper/311:32:493
7495991812,4cyclictest31045-21bash10:20:153
749599180,7cyclictest28750irq/26-ahci[00011:05:423
749199180,16cyclictest33-21ksoftirqd/209:49:142
7486991812,4cyclictest27347-21sshd10:19:481
748299181,6cyclictest0-21swapper/012:06:560
748299181,6cyclictest0-21swapper/012:06:560
748299181,1cyclictest7476-21cyclictest07:25:260
748299181,16cyclictest0-21swapper/011:20:060
748299180,9cyclictest0-21swapper/008:55:240
748299180,2cyclictest18834-21cpuspeed_turbos09:20:240
748299180,2cyclictest0-21swapper/009:30:340
748299180,1cyclictest0-21swapper/012:36:410
748299180,16cyclictest17352-21irqstats07:30:220
748299180,15cyclictest0-21swapper/010:00:280
748299180,14cyclictest12569-21sshd10:21:540
748299180,12cyclictest0-21swapper/008:01:360
39602180,1sleep03956-21sshd12:25:450
262862180,16sleep1138550irq/27-eth011:23:231
7495991712,3cyclictest19279-21grep12:35:223
749199172,12cyclictest0-21swapper/212:26:162
749199172,10cyclictest14417-21sshd10:30:032
749199172,10cyclictest0-21swapper/209:10:332
749199171,9cyclictest0-21swapper/207:32:212
7491991712,3cyclictest26951-21id12:09:212
7491991712,3cyclictest26951-21id12:09:212
7491991711,5cyclictest32509-21sshd11:35:392
749199171,11cyclictest0-21swapper/207:50:322
748699175,4cyclictest14740-21sshd10:10:241
748699171,7cyclictest0-21swapper/108:15:281
748699171,15cyclictest0-21swapper/109:55:481
748699171,0cyclictest0-21swapper/108:48:481
748299176,6cyclictest0-21swapper/011:11:580
748299176,5cyclictest0-21swapper/009:11:270
748299176,10cyclictest0-21swapper/007:35:220
748299174,11cyclictest21141-21id09:40:140
7482991710,6cyclictest0-21swapper/012:02:350
748299170,6cyclictest0-21swapper/010:14:450
748299170,16cyclictest0-21swapper/012:16:080
748299170,16cyclictest0-21swapper/010:56:310
748299170,16cyclictest0-21swapper/009:02:340
748299170,16cyclictest0-21swapper/008:14:240
748299170,15cyclictest23404-21sshd10:35:130
748299170,13cyclictest0-21swapper/012:11:500
748299170,13cyclictest0-21swapper/008:27:180
749599162,5cyclictest26271-21sshd11:54:033
749599162,12cyclictest26486-21sshd10:07:573
7495991611,4cyclictest0-21swapper/308:55:233
7495991611,1cyclictest28167-21sshd10:31:433
749599160,15cyclictest0-21swapper/309:58:093
749599160,14cyclictest31771-21unixbench_multi11:35:343
749599160,14cyclictest0-21swapper/308:00:193
749599160,11cyclictest29857-21munin-run07:59:593
749199163,11cyclictest13947-21sshd09:15:532
7491991614,1cyclictest0-21swapper/210:43:492
7491991614,1cyclictest0-21swapper/209:05:252
7491991613,2cyclictest26709-21sshd10:15:402
7491991613,2cyclictest1987-21sshd09:29:182
7491991613,2cyclictest15201-21sshd09:35:302
7491991612,3cyclictest30070-21sshd12:13:302
7491991612,3cyclictest22045-21sshd09:20:402
7491991612,3cyclictest19683-21sshd12:00:492
7491991611,4cyclictest25874-21sshd10:35:272
749199161,12cyclictest0-21swapper/207:10:472
749199160,15cyclictest9302-21sshd11:55:442
749199160,14cyclictest33-21ksoftirqd/210:45:362
748699169,6cyclictest13386-21bash09:54:461
748699161,13cyclictest0-21swapper/109:35:081
748699161,11cyclictest0-21swapper/110:26:021
748299160,15cyclictest0-21swapper/008:49:230
748299160,15cyclictest0-21swapper/008:21:500
748299160,14cyclictest19553-21ipmi_temp11:30:220
748299160,14cyclictest0-21swapper/010:27:480
748299160,12cyclictest0-21swapper/007:46:270
209722160,14sleep3138550irq/27-eth011:42:013
749599158,2cyclictest23831-21sshd10:11:273
7495991511,3cyclictest1306-21bash10:44:293
7495991511,3cyclictest10950irq/23-ehci_hcd07:39:503
749599150,4cyclictest138550irq/27-eth009:22:233
749599150,3cyclictest30590-21sshd11:15:503
749599150,3cyclictest30590-21sshd11:15:493
749599150,14cyclictest0-21swapper/311:22:433
749599150,13cyclictest32314-21sshd10:56:173
749599150,13cyclictest28150-21sshd10:00:243
749599150,13cyclictest0-21swapper/312:10:313
749599150,13cyclictest0-21swapper/310:51:493
749599150,13cyclictest0-21swapper/309:10:413
749199155,9cyclictest19068-21bash11:18:362
749199155,9cyclictest19068-21bash11:18:362
749199154,3cyclictest1877-21nfsd08:41:232
749199153,8cyclictest0-21swapper/207:19:572
749199152,12cyclictest0-21swapper/208:49:522
7491991512,2cyclictest16913-21sshd12:15:432
7491991512,2cyclictest0-21swapper/211:46:002
7491991512,2cyclictest0-21swapper/208:56:032
7491991511,3cyclictest36-21rcuop/210:50:382
7491991511,2cyclictest1223-21sshd09:30:012
749199150,6cyclictest10926-21sshd09:50:312
748699154,4cyclictest10950irq/23-ehci_hcd10:45:551
748699154,3cyclictest138550irq/27-eth010:41:451
748699152,6cyclictest14288-21id11:48:491
748699151,5cyclictest7271-21sshd12:33:551
748699151,5cyclictest10240-21sshd09:42:451
748699151,5cyclictest0-21swapper/112:23:431
748699151,13cyclictest0-21swapper/109:46:201
748699151,13cyclictest0-21swapper/109:27:111
7486991510,3cyclictest9539-21sshd10:01:591
748299150,9cyclictest0-21swapper/009:05:360
748299150,1cyclictest0-21swapper/008:40:130
748299150,1cyclictest0-21swapper/007:20:560
748299150,14cyclictest0-21swapper/008:15:500
748299150,14cyclictest0-21swapper/008:09:230
748299150,12cyclictest0-21swapper/007:15:240
748299150,10cyclictest0-21swapper/008:50:230
42592150,2sleep34242-21sshd09:18:403
4222150,13sleep3138550irq/27-eth011:12:153
181432150,13sleep1138550irq/27-eth012:35:171
749599147,6cyclictest1006-21sshd12:06:143
749599147,6cyclictest1006-21sshd12:06:143
749599142,11cyclictest138550irq/27-eth008:45:283
7495991412,1cyclictest0-21swapper/307:24:233
749599140,4cyclictest7436-21sshd10:37:113
749599140,3cyclictest23122-21sshd12:16:313
749599140,3cyclictest17973-21sshd09:35:493
749599140,13cyclictest4827-21sshd09:53:453
749599140,13cyclictest31860-21bash11:00:193
749599140,12cyclictest1987-21sshd09:29:453
749199149,4cyclictest138550irq/27-eth008:24:122
749199143,2cyclictest0-21swapper/207:35:162
749199142,8cyclictest0-21swapper/207:27:412
749199142,11cyclictest0-21swapper/207:57:212
749199141,8cyclictest0-21swapper/209:02:532
749199140,13cyclictest33-21ksoftirqd/208:00:522
749199140,13cyclictest0-21swapper/208:14:092
749199140,12cyclictest0-21swapper/208:50:032
748699149,3cyclictest30874-21sshd11:00:121
748699148,5cyclictest1987-21sshd11:27:131
748699148,4cyclictest29152-21munin-node07:55:321
748699145,4cyclictest6133-21sshd09:22:441
748699144,3cyclictest17290-21sshd10:58:301
748699143,4cyclictest1876-21nfsd11:36:551
748699143,4cyclictest0-21swapper/109:13:261
748699143,3cyclictest0-21swapper/110:35:251
748699143,2cyclictest0-21swapper/109:15:201
748699142,11cyclictest22875-21sshd12:01:111
748699141,5cyclictest0-21swapper/111:59:211
748699141,12cyclictest0-21swapper/110:20:341
748699141,12cyclictest0-21swapper/109:00:041
748699141,12cyclictest0-21swapper/108:55:401
748699141,12cyclictest0-21swapper/107:51:041
748699141,12cyclictest0-21swapper/107:48:541
748699141,12cyclictest0-21swapper/107:37:561
748699141,12cyclictest0-21swapper/107:20:511
748699141,12cyclictest0-21swapper/107:12:481
748699141,11cyclictest2963-21iostat_ios08:10:241
748699141,11cyclictest0-21swapper/111:10:181
748299147,4cyclictest0-21swapper/007:55:590
748299142,11cyclictest0-21swapper/008:31:560
748299140,8cyclictest0-21swapper/008:35:200
748299140,13cyclictest0-21swapper/007:11:200
749599138,4cyclictest0-21swapper/308:09:073
749599137,5cyclictest0-21swapper/308:35:433
749599137,4cyclictest16376-21hwlatdetect08:40:203
7495991311,1cyclictest0-21swapper/307:15:253
749599130,1cyclictest1877-21nfsd09:00:303
749599130,12cyclictest0-21swapper/308:52:013
749599130,12cyclictest0-21swapper/308:27:023
749599130,12cyclictest0-21swapper/308:21:453
749599130,12cyclictest0-21swapper/308:15:193
749599130,12cyclictest0-21swapper/307:34:393
749599130,12cyclictest0-21swapper/307:25:243
749599130,11cyclictest8463-21memory07:10:243
749599130,11cyclictest3323-21sshd09:30:183
749599130,11cyclictest27234-21df09:05:193
749599130,11cyclictest23658-21df_inode07:45:213
749599130,11cyclictest11985-21irqstats08:30:273
749199139,3cyclictest0-21swapper/208:39:492
749199138,4cyclictest1877-21nfsd07:40:202
749199137,3cyclictest6028-21unixbench_multi08:15:322
749199132,10cyclictest25-21rcuop/111:10:212
749199132,10cyclictest139972sleep207:23:562
7491991311,1cyclictest0-21swapper/210:20:472
749199130,12cyclictest1877-21nfsd08:30:162
749199130,12cyclictest0-21swapper/208:26:592
748699138,4cyclictest0-21swapper/111:30:371
748699138,4cyclictest0-21swapper/109:06:341
748699134,1cyclictest10194-21fschecks_count07:15:211
748699131,3cyclictest26207-21sshd10:51:331
748699131,3cyclictest14122-21hddtemp_smartct08:35:211
748699131,11cyclictest0-21swapper/110:05:211
7486991311,1cyclictest0-21swapper/108:31:241
748699131,11cyclictest0-21swapper/107:40:341
7486991311,1cyclictest0-21swapper/107:30:221
748699131,11cyclictest0-21swapper/107:25:121
748699131,10cyclictest9302-21diskstats08:25:221
748699131,10cyclictest8016-21munin-node08:20:311
748699131,10cyclictest615-21iostat08:05:221
748699131,10cyclictest30351-21df08:00:201
748699131,10cyclictest0-21swapper/108:50:231
749599128,1cyclictest1877-21nfsd07:51:003
749599120,11cyclictest0-21swapper/308:10:313
749199120,3cyclictest538-21hddtemp_smartct08:05:212
749199120,11cyclictest23338-21munin-node07:45:332
748699128,2cyclictest157052sleep108:40:071
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional