You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-13 - 21:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot0.osadl.org (updated Sun Oct 13, 2024 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
377421310,0sleep03750-21sshd11:13:230
2525721280,1sleep00-21swapper/012:21:370
798721130,0sleep17979-21sshd12:11:241
14275210432,43sleep10-21swapper/107:06:391
1454529433,48sleep30-21swapper/307:09:523
323792900,1sleep20-21swapper/210:15:072
249172900,0sleep00-21swapper/009:53:360
78892880,1sleep07856-21sshd11:51:070
285892880,1sleep028586-21sshd09:18:060
135212880,1sleep30-21swapper/311:45:493
207332870,2sleep10-21swapper/110:02:071
246762860,2sleep10-21swapper/111:52:401
248402850,2sleep124839-21bash12:04:191
230582850,2sleep21848-21nfsd09:14:392
219462850,2sleep21848-21nfsd11:20:392
186932840,4sleep11481199cyclictest11:17:341
110472840,4sleep11481199cyclictest12:08:511
70052820,2sleep20-21swapper/211:13:422
320192810,0sleep00-21swapper/011:04:260
20862810,1sleep02082-21sshd09:48:310
88852800,0sleep00-21swapper/008:05:220
197832800,2sleep30-21swapper/309:17:163
99402790,3sleep10-21swapper/109:22:191
310082790,3sleep121474-21nscd09:42:111
154602770,2sleep315461-21sshd10:07:383
280432760,2sleep228041-21sshd12:33:302
280432760,2sleep228041-21sshd12:33:292
236592760,3sleep21481299cyclictest11:29:332
228122760,2sleep122811-21sshd10:43:151
153832760,0sleep215379-21sshd10:30:542
153832760,0sleep215379-21sshd10:30:542
66702740,2sleep30-21swapper/311:07:543
178702740,2sleep20-21swapper/209:44:002
284362730,2sleep228423-21sshd11:18:272
161102730,1sleep30-21swapper/310:16:283
222782680,3sleep21481299cyclictest10:08:172
40412660,5sleep21481299cyclictest11:42:072
125522620,2sleep01480799cyclictest09:31:270
154852600,4sleep31481399cyclictest11:11:303
1446725634,9sleep20-21swapper/207:09:002
1440325328,22sleep00-21swapper/007:08:170
57072490,1sleep20-21swapper/210:35:512
210482420,1sleep321049-21sshd12:38:393
11342400,1sleep31127-21sshd12:10:463
205552390,2sleep320548-21sshd12:06:453
139202390,1sleep20-21swapper/210:48:172
106722390,2sleep310674-21id12:26:053
272992350,2sleep30-21swapper/310:29:103
231512350,1sleep023138-21sshd12:27:140
67692330,2sleep16766-21sshd10:21:271
266622320,2sleep126664-21sshd09:59:431
91272300,2sleep31847-21nfsd12:17:193
96002290,1sleep20-21swapper/212:11:332
315902270,3sleep30-21swapper/312:30:513
315902270,3sleep30-21swapper/312:30:503
155862270,1sleep20-21swapper/210:25:132
141142270,25sleep2135650irq/27-eth012:26:252
98392260,2sleep32405-21runrttasks11:57:073
104162260,0sleep00-21swapper/009:10:230
218232250,22sleep3135650irq/27-eth010:02:143
174562250,2sleep11847-21nfsd10:25:201
168502252,21sleep2135650irq/27-eth010:51:272
1480799250,19cyclictest15629-21sshd12:12:060
41132240,2sleep14107-21sshd11:33:331
26832240,22sleep1135650irq/27-eth011:36:141
236432240,1sleep014800-21cyclictest11:18:010
1481199240,4cyclictest25800-21sshd11:03:521
126282240,2sleep312627-21bash10:39:283
125302240,2sleep20-21swapper/209:16:352
98402230,2sleep3431ktimersoftd/309:55:123
209712230,2sleep30-21swapper/312:24:123
161892230,2sleep216188-21sshd11:03:002
101522230,2sleep20-21swapper/211:08:132
96102220,1sleep09599-21sshd12:37:360
4872220,2sleep2484-21sshd10:03:152
264482220,2sleep30-21swapper/310:31:553
264482220,2sleep30-21swapper/310:31:543
17672220,20sleep1135650irq/27-eth012:36:541
1480799220,20cyclictest14639-21sshd10:01:320
108932220,1sleep310891-21sshd11:54:233
267632210,19sleep2135650irq/27-eth011:50:022
246852210,19sleep2135650irq/27-eth009:50:312
1481299211,18cyclictest14781-21sshd12:23:382
1480799210,1cyclictest0-21swapper/010:42:530
1480799210,17cyclictest0-21swapper/009:20:190
14422210,19sleep3135650irq/27-eth010:41:183
53902201,17sleep2135650irq/27-eth009:27:552
45052200,18sleep2135650irq/27-eth009:36:442
37732200,1sleep33776-21id09:51:353
35842200,1sleep041ktimersoftd/011:30:310
178802200,2sleep117881-21sshd11:14:411
14812992014,4cyclictest32211-21sadc09:00:012
1480799204,13cyclictest15037-21sshd11:05:410
1480799201,4cyclictest0-21swapper/011:45:190
14807992012,7cyclictest27634-21sshd12:04:340
1480799200,9cyclictest28685-21sshd10:23:280
1480799200,16cyclictest27060-21memory07:35:160
1480799200,15cyclictest26867-21sshd10:31:570
1480799200,15cyclictest26867-21sshd10:31:560
28752190,2sleep12874-21sshd10:32:451
28752190,2sleep12874-21sshd10:32:451
257132190,3sleep30-21swapper/311:41:083
1480799198,6cyclictest1848-21nfsd09:41:260
1480799198,10cyclictest0-21swapper/011:39:090
1480799191,14cyclictest0-21swapper/012:34:450
1480799191,14cyclictest0-21swapper/012:34:450
1480799190,9cyclictest13098-21sshd12:06:030
1480799190,6cyclictest0-21swapper/010:12:200
1480799190,2cyclictest32323-21sshd10:29:380
1480799190,18cyclictest0-21swapper/010:39:200
1480799190,14cyclictest0-21swapper/010:45:480
1480799190,13cyclictest8195-21sshd09:57:590
292712180,16sleep2135650irq/27-eth009:48:022
1481399180,5cyclictest21321-21sshd10:22:473
1480799188,9cyclictest4041-21sshd12:16:510
1480799180,9cyclictest0-21swapper/008:36:280
1480799180,14cyclictest0-21swapper/010:59:040
1480799180,13cyclictest21467-21sshd10:19:580
87192170,15sleep3135650irq/27-eth012:00:013
69952170,15sleep1135650irq/27-eth009:19:081
58422170,15sleep3135650irq/27-eth010:12:403
14813991713,3cyclictest1188-21sshd10:55:493
1481399170,4cyclictest135650irq/27-eth011:02:003
1481399170,12cyclictest32576-21sshd09:48:213
1481299175,10cyclictest5410-21sshd10:41:392
1481299174,2cyclictest0-21swapper/210:10:532
1481299173,8cyclictest0-21swapper/209:07:102
1481299172,11cyclictest1893-21nscd09:23:242
1481299171,4cyclictest16946-21sshd10:57:162
1481299171,3cyclictest10996-21sshd11:39:572
1481299170,16cyclictest33-21ksoftirqd/212:17:552
1481199172,6cyclictest0-21swapper/111:58:031
1481199172,3cyclictest24610-21sshd11:20:541
14811991715,1cyclictest0-21swapper/111:08:061
1481199171,11cyclictest5567-21bash10:50:241
1481199170,15cyclictest0-21swapper/109:28:511
1480799172,1cyclictest0-21swapper/011:40:140
14807991713,3cyclictest15419-21sshd11:23:020
1480799171,15cyclictest0-21swapper/009:35:130
1480799170,16cyclictest0-21swapper/010:51:250
1480799170,16cyclictest0-21swapper/009:26:030
1480799170,12cyclictest30528-21sshd11:27:120
1480799170,12cyclictest0-21swapper/007:30:580
300392160,14sleep226950irq/26-ahci[00010:20:362
294192160,2sleep11481199cyclictest10:17:421
179902160,14sleep3135650irq/27-eth011:29:033
1481399167,4cyclictest27989-21sshd11:35:343
1481399164,10cyclictest0-21swapper/309:29:393
1481399161,11cyclictest135650irq/27-eth010:48:323
1481399160,2cyclictest0-21swapper/309:21:213
1481399160,14cyclictest13136-21sshd09:13:423
1481399160,14cyclictest0-21swapper/311:23:293
1481399160,13cyclictest4951-21munin-run08:00:003
1481399160,11cyclictest18301-21sshd11:31:533
1481299163,8cyclictest1848-21nfsd07:48:392
1481299162,11cyclictest23992-21bash11:55:252
14812991613,2cyclictest17158-21id12:35:212
1481299161,13cyclictest22888-21bash09:56:182
1481299161,13cyclictest17150-21bash11:31:462
14812991611,3cyclictest10833-21sshd12:05:502
1481299160,14cyclictest0-21swapper/209:31:582
1481299160,12cyclictest17556-21sshd11:49:112
1481199169,5cyclictest25817-21sshd09:11:531
1481199166,3cyclictest9286-21nscd09:34:081
1481199161,14cyclictest23800-21sshd11:26:351
1481199161,14cyclictest0-21swapper/112:20:561
1481199161,13cyclictest25055-21rm10:08:321
1481199161,10cyclictest0-21swapper/112:25:311
1480799168,4cyclictest13814-21kworker/0:008:18:170
14807991613,2cyclictest0-21swapper/011:56:240
1480799160,1cyclictest0-21swapper/009:06:000
1480799160,1cyclictest0-21swapper/008:52:030
1480799160,15cyclictest23480-21sshd10:05:190
1480799160,15cyclictest1095-21ntp_kernel_err09:00:190
1480799160,12cyclictest0-21swapper/008:29:170
1481399159,5cyclictest29574-21taskset08:50:373
14813991512,2cyclictest27153-21sshd09:41:503
1481399151,10cyclictest24510-21sshd09:38:403
1481399150,3cyclictest23613-21sshd10:52:033
1481399150,3cyclictest1401-21sshd09:30:253
1481399150,13cyclictest31162-21munin-node08:55:183
1481399150,11cyclictest1959-21sshd11:18:143
1481299159,5cyclictest135650irq/27-eth009:00:422
1481299152,8cyclictest24014-21perl08:40:132
1481299151,4cyclictest0-21swapper/208:05:522
1481299150,6cyclictest11728-21sshd12:00:142
1481299150,13cyclictest0-21swapper/208:20:362
1481299150,13cyclictest0-21swapper/207:52:022
1481199159,5cyclictest23415-21sshd11:43:541
1481199158,5cyclictest25079-21sshd12:30:181
1481199158,5cyclictest25079-21sshd12:30:181
1481199151,12cyclictest4710-21sshd09:51:411
1481199150,6cyclictest0-21swapper/109:05:091
1481199150,14cyclictest0-21swapper/112:17:141
1481199150,14cyclictest0-21swapper/110:47:531
1481199150,13cyclictest30942-21sshd09:45:121
1481199150,13cyclictest28027-21sshd10:35:041
1481199150,13cyclictest23874-21cp10:11:201
1481199150,10cyclictest21151-21sshd09:38:211
1480799157,4cyclictest0-21swapper/007:51:310
1480799150,1cyclictest20776-21munin-node07:20:210
1480799150,1cyclictest0-21swapper/008:02:210
1480799150,14cyclictest0-21swapper/008:31:210
1480799150,14cyclictest0-21swapper/007:47:080
1480799150,13cyclictest0-21swapper/007:15:130
1481399147,4cyclictest0-21swapper/307:15:353
1481399142,11cyclictest0-21swapper/308:18:013
1481399142,11cyclictest0-21swapper/308:01:283
1481399140,3cyclictest135650irq/27-eth008:35:273
1481399140,12cyclictest0-21swapper/308:40:123
1481299142,11cyclictest135650irq/27-eth008:00:572
1481299141,8cyclictest0-21swapper/208:47:222
1481299141,8cyclictest0-21swapper/208:47:212
1481299141,10cyclictest144550irq/28-eth1-rx-07:17:452
1481199142,11cyclictest12689-21munin-node08:15:131
1481199141,7cyclictest15658-21sshd11:46:011
1481199141,12cyclictest28127-21sshd10:55:201
1481199140,5cyclictest1259-21munin-node09:00:211
1480799148,5cyclictest0-21swapper/008:55:020
1480799148,5cyclictest0-21swapper/008:12:420
1480799145,5cyclictest13814-21kworker/0:007:25:170
1480799145,5cyclictest13814-21kworker/0:007:13:460
1480799141,1cyclictest0-21swapper/008:20:020
1480799140,2cyclictest0-21swapper/008:40:150
1480799140,1cyclictest0-21swapper/007:56:320
1480799140,1cyclictest0-21swapper/007:40:010
1480799140,13cyclictest0-21swapper/008:45:070
1480799140,13cyclictest0-21swapper/008:45:070
1481399139,3cyclictest1848-21nfsd08:20:253
14813991311,1cyclictest0-21swapper/307:20:083
1481399130,12cyclictest28459-21munin-node07:40:153
1481399130,12cyclictest135650irq/27-eth009:00:063
1481399130,12cyclictest0-21swapper/309:07:273
1481399130,12cyclictest0-21swapper/308:30:453
1481399130,12cyclictest0-21swapper/308:26:293
1481399130,12cyclictest0-21swapper/308:10:353
1481399130,12cyclictest0-21swapper/308:07:083
1481399130,12cyclictest0-21swapper/307:37:053
1481399130,12cyclictest0-21swapper/307:30:433
1481399130,11cyclictest26620-21munin-node08:45:193
1481399130,11cyclictest26620-21munin-node08:45:193
1481399130,11cyclictest23594-21chrt07:29:063
1481399130,11cyclictest1718-21ntp_states07:50:193
1481299138,3cyclictest29215-21iostat07:40:142
1481299138,3cyclictest24242-21diskstats07:30:122
1481299134,7cyclictest144550irq/28-eth1-rx-07:11:362
1481299131,3cyclictest26941-21iostat07:35:142
1481299131,11cyclictest144550irq/28-eth1-rx-07:26:502
1481299130,5cyclictest0-21swapper/208:38:382
1481299130,12cyclictest0-21swapper/208:50:142
1481299130,12cyclictest0-21swapper/208:30:552
1481299130,12cyclictest0-21swapper/208:15:022
1481299130,12cyclictest0-21swapper/207:57:022
1481299130,11cyclictest16540-21munin-node08:25:092
1481199139,3cyclictest0-21swapper/107:31:241
1481199138,4cyclictest0-21swapper/108:37:571
1481199137,5cyclictest0-21swapper/108:40:481
1481199137,4cyclictest26181-21munin-node07:35:161
1481199131,4cyclictest0-21swapper/108:10:521
1481199131,11cyclictest30898-21taskset08:55:151
14811991311,1cyclictest0-21swapper/108:46:571
14811991311,1cyclictest0-21swapper/108:46:561
14811991311,1cyclictest0-21swapper/108:05:311
14811991311,1cyclictest0-21swapper/107:21:421
1481199130,4cyclictest6754-21munin-node08:00:221
1481199130,4cyclictest1341-21kernelversion07:50:151
1481199130,2cyclictest135650irq/27-eth007:16:141
1481199130,12cyclictest0-21swapper/108:51:261
1481199130,12cyclictest0-21swapper/108:33:321
1481199130,12cyclictest0-21swapper/108:27:061
1481399127,4cyclictest0-21swapper/307:45:023
1481399120,3cyclictest0-21swapper/307:10:143
1481299128,3cyclictest10048-21df_inode08:10:122
1481299120,10cyclictest19637-21df07:20:122
1481199120,3cyclictest31000-21df07:45:121
1481199120,3cyclictest22400-21iostat_ios07:25:151
1481199120,11cyclictest15605-21irqstats07:10:171
1481199120,11cyclictest0-21swapper/108:20:061
1481199120,11cyclictest0-21swapper/107:55:051
1481199120,11cyclictest0-21swapper/107:42:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional