You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-23 - 15:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack5slot0.osadl.org (updated Sat Sep 23, 2023 12:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1766721390,4sleep11105399cyclictest10:51:561
2259121350,1sleep122595-21id10:15:251
711921320,4sleep31106099cyclictest12:12:503
663421290,2sleep12021-21lldpd10:09:561
663421290,2sleep12021-21lldpd10:09:561
1139721280,2sleep011392-21sshd11:06:010
2527721070,2sleep30-21swapper/311:22:373
236372990,2sleep323636-21sshd12:33:313
301482970,4sleep21105599cyclictest11:52:582
214862950,3sleep01104999cyclictest11:51:560
288512920,2sleep328845-21sshd09:31:453
5782910,2sleep2563-21sshd09:35:542
5782910,2sleep2563-21sshd09:35:532
316612900,2sleep20-21swapper/211:04:442
20652890,1sleep02021-21lldpd09:50:590
283822880,2sleep32021-21lldpd09:50:213
139792880,2sleep10-21swapper/109:18:571
57222860,2sleep35721-21fschecks_time09:25:233
303782850,1sleep30-21swapper/310:45:573
271872850,2sleep127181-21sshd10:49:231
203652850,2sleep30-21swapper/311:44:253
161452840,2sleep216141-21sshd10:51:442
107712840,2sleep10-21swapper/112:16:581
289482830,1sleep11943-21snmpd11:11:471
277042830,2sleep12021-21lldpd09:35:201
277042830,2sleep12021-21lldpd09:35:191
212642830,2sleep11943-21snmpd09:45:431
80262820,1sleep02021-21lldpd12:39:130
296762820,2sleep30-21swapper/312:00:233
263332810,2sleep126324-21sshd09:27:471
218482810,2sleep21943-21snmpd10:15:212
204432810,2sleep20-21swapper/209:56:412
91832800,3sleep21105599cyclictest10:02:472
84362800,2sleep30-21swapper/312:39:163
19992800,1sleep01997-21bash11:16:070
307972790,2sleep230799-21id11:08:212
224372790,3sleep01104999cyclictest12:18:210
99022770,2sleep19896-21bash10:32:311
32612770,2sleep11943-21snmpd09:21:211
115132760,1sleep311515-21id10:10:263
29172740,2sleep32906-21sshd09:17:383
142172740,1sleep31943-21snmpd11:02:403
182022720,2sleep01104999cyclictest12:21:330
148772700,1sleep20-21swapper/211:13:582
221932670,1sleep20-21swapper/210:26:272
264522660,3sleep21105599cyclictest12:15:062
111212660,4sleep31106099cyclictest10:21:283
93532500,0sleep19354-21grep11:35:361
189822500,1sleep018984-21unixbench-2d09:30:340
21792460,2sleep20-21swapper/210:42:472
100362440,0sleep010035-21sshd11:20:450
285702431,40sleep1138550irq/27-eth011:41:351
105272431,38sleep10-21swapper/107:06:111
91692411,37sleep30-21swapper/307:05:163
38752410,7sleep01104999cyclictest12:27:270
319402380,2sleep231935-21bash11:56:542
113502380,0sleep311351-21sshd09:59:233
223312370,9sleep02021-21lldpd11:03:380
135632370,0sleep213564-21sshd09:41:062
255552340,31sleep1138550irq/27-eth011:22:391
321672330,30sleep1138550irq/27-eth010:20:181
114722320,29sleep3138550irq/27-eth011:35:523
59022300,2sleep20-21swapper/212:12:422
87512290,1sleep08-21rcu_preempt10:47:140
300882280,1sleep00-21swapper/011:41:440
218002280,24sleep1138550irq/27-eth011:25:511
9002270,3sleep01104999cyclictest11:12:190
293752270,1sleep00-21swapper/007:50:190
170932270,1sleep02021-21lldpd09:41:330
99362260,1sleep00-21swapper/011:58:090
265502260,4sleep11105399cyclictest11:00:221
59122240,2sleep12021-21lldpd10:58:001
261242240,2sleep20-21swapper/211:15:182
189042240,2sleep318903-21bash09:38:033
189042240,2sleep318903-21bash09:38:023
105692240,2sleep210571-21bash10:32:372
66122220,19sleep1138550irq/27-eth010:28:281
1105599225,4cyclictest2021-21lldpd09:17:222
1105599224,8cyclictest1987-21sshd12:36:592
81152210,1sleep08111-21sshd10:17:270
190802210,2sleep219068-21sshd12:06:412
1105599211,7cyclictest0-21swapper/210:36:472
11053992113,3cyclictest2021-21lldpd12:20:081
1105599204,3cyclictest0-21swapper/209:29:472
1105599201,7cyclictest0-21swapper/210:11:422
1105599201,3cyclictest0-21swapper/209:52:572
11053992018,1cyclictest0-21swapper/111:47:501
11053992018,1cyclictest0-21swapper/111:47:491
1105399200,9cyclictest1875-21nfsd12:36:341
1104999200,8cyclictest1943-21snmpd11:38:010
1064122012,5sleep20-21swapper/207:07:352
72962190,17sleep1138550irq/27-eth010:35:541
276322190,17sleep3138550irq/27-eth012:07:433
218872192,15sleep328750irq/26-ahci[00011:29:433
150862192,15sleep1138550irq/27-eth011:55:021
1106099190,12cyclictest10178-21sshd10:02:523
1105599192,16cyclictest33-21ksoftirqd/209:11:162
1105599190,4cyclictest20524-21bash09:34:352
1105399198,5cyclictest28805-21sshd12:34:081
1105399190,12cyclictest2021-21lldpd11:06:501
11049991916,2cyclictest0-21swapper/009:15:070
1104999190,5cyclictest0-21swapper/010:32:160
211442180,16sleep1138550irq/27-eth009:53:121
17352180,2sleep30-21swapper/309:47:163
1106099188,5cyclictest12500-21sshd10:43:593
1106099181,5cyclictest0-21swapper/311:12:203
1106099181,4cyclictest138550irq/27-eth011:30:483
11060991812,1cyclictest2021-21lldpd12:26:083
11060991811,6cyclictest19917-21sshd11:48:033
11060991811,6cyclictest19917-21sshd11:48:033
1106099180,13cyclictest2021-21lldpd11:55:393
1106099180,13cyclictest13014-21sshd10:32:533
1106099180,0cyclictest0-21swapper/311:06:453
1105599188,8cyclictest33-21ksoftirqd/210:55:252
1105599181,8cyclictest33-21ksoftirqd/209:24:052
1105599181,4cyclictest28940-21sshd09:46:382
1105599181,16cyclictest33-21ksoftirqd/210:45:502
1105599181,15cyclictest0-21swapper/211:31:262
1105599180,16cyclictest33-21ksoftirqd/211:20:522
1105599180,14cyclictest0-21swapper/212:21:472
11053991813,4cyclictest28720-21sshd11:34:151
1105399180,6cyclictest2021-21lldpd11:17:071
1105399180,16cyclictest138550irq/27-eth012:12:451
1104999188,9cyclictest0-21swapper/009:14:060
1104999180,17cyclictest0-21swapper/010:28:400
209202171,14sleep3138550irq/27-eth008:41:123
1106099178,4cyclictest23182-21sshd10:52:353
1106099177,5cyclictest27142-21sshd12:15:133
11060991710,5cyclictest1943-21snmpd12:23:333
1106099170,4cyclictest20439-21bash09:41:573
1106099170,16cyclictest445-21jbd2/dm-0-809:20:443
1106099170,15cyclictest0-21swapper/311:15:043
1106099170,15cyclictest0-21swapper/310:06:203
1106099170,15cyclictest0-21swapper/310:06:193
1106099170,12cyclictest2021-21lldpd09:11:243
1105599177,4cyclictest9560-21sshd11:46:492
1105599177,4cyclictest9560-21sshd11:46:482
1105599173,8cyclictest1943-21snmpd07:12:082
1105599172,0cyclictest0-21swapper/211:35:092
1105599171,14cyclictest1943-21snmpd11:25:542
1105599171,11cyclictest1943-21snmpd07:16:432
1105599171,11cyclictest10192-21sshd12:31:542
1105599170,3cyclictest26082-21cp10:08:252
1105599170,3cyclictest26082-21cp10:08:242
1105599170,16cyclictest33-21ksoftirqd/210:20:432
1105599170,15cyclictest33-21ksoftirqd/208:25:342
1105599170,13cyclictest2021-21lldpd07:52:042
1105399178,4cyclictest27061-21sshd10:01:031
1105399178,4cyclictest2021-21lldpd10:10:021
1105399171,7cyclictest0-21swapper/108:48:081
1105399171,4cyclictest971-21sshd10:42:391
11053991712,3cyclictest2212-21cp12:27:141
1105399171,11cyclictest12258-21ntp_states07:10:281
1105399170,5cyclictest16751-21taskset12:06:231
1105399170,4cyclictest1987-21sshd09:55:481
1105399170,3cyclictest0-21swapper/112:01:051
1105399170,15cyclictest0-21swapper/108:26:131
1105399170,12cyclictest2571-21sshd09:10:161
1104999178,4cyclictest18688-21bash12:32:540
1104999174,11cyclictest2021-21lldpd12:12:240
244922160,1sleep02021-21lldpd11:48:350
244922160,1sleep02021-21lldpd11:48:350
1106099168,6cyclictest1943-21snmpd10:37:103
1106099168,3cyclictest7166-21sed08:10:333
1106099165,4cyclictest2021-21lldpd10:15:353
1106099161,14cyclictest24371-21latency_hist07:40:003
1106099160,7cyclictest0-21swapper/308:20:313
1106099160,4cyclictest20207-21sshd10:26:133
1106099160,15cyclictest0-21swapper/308:30:393
1106099160,11cyclictest27990-21dump-pmu-power09:00:003
1106099160,11cyclictest2021-21lldpd10:55:023
1105599163,11cyclictest2021-21lldpd08:46:372
1105599162,13cyclictest1943-21snmpd08:15:562
11055991610,4cyclictest17323-21sshd12:02:442
1105599160,8cyclictest33-21ksoftirqd/212:26:122
1105599160,12cyclictest33-21ksoftirqd/211:42:052
1105399164,3cyclictest2021-21lldpd09:30:591
1105399162,10cyclictest0-21swapper/108:09:081
11053991610,5cyclictest138550irq/27-eth008:54:551
1105399160,7cyclictest0-21swapper/108:24:261
1105399160,14cyclictest0-21swapper/108:34:221
1105399160,11cyclictest2021-21lldpd09:40:531
1104999162,12cyclictest14310-21id09:45:010
1104999160,15cyclictest0-21swapper/008:22:020
1104999160,12cyclictest0-21swapper/009:25:300
42642150,2sleep02021-21lldpd09:21:300
294352151,12sleep1138550irq/27-eth007:50:221
1106099158,3cyclictest2021-21lldpd08:02:273
1106099157,3cyclictest0-21swapper/311:53:273
1106099152,12cyclictest2021-21lldpd08:50:243
11060991511,2cyclictest0-21swapper/307:20:303
1106099150,13cyclictest22874-21sed08:45:343
1106099150,13cyclictest2021-21lldpd09:00:263
1106099150,13cyclictest0-21swapper/309:05:093
1106099150,13cyclictest0-21swapper/307:41:173
1106099150,13cyclictest0-21swapper/307:18:343
1106099150,11cyclictest2021-21lldpd07:28:283
1105599158,5cyclictest1955-21snmpd08:05:232
1105599153,7cyclictest1943-21snmpd07:36:532
1105599152,8cyclictest1943-21snmpd08:39:072
1105599151,13cyclictest2021-21lldpd08:52:202
1105599151,13cyclictest1943-21snmpd08:56:382
11055991511,3cyclictest1943-21snmpd08:30:112
11055991511,3cyclictest1943-21snmpd07:44:242
1105599151,12cyclictest1943-21snmpd08:20:122
1105599151,11cyclictest1943-21snmpd09:00:262
1105399158,3cyclictest2021-21lldpd08:17:371
1105399158,3cyclictest0-21swapper/107:21:491
1105399157,7cyclictest138550irq/27-eth008:55:211
1105399151,13cyclictest1943-21snmpd08:10:341
1105399151,12cyclictest1943-21snmpd11:50:091
1105399150,6cyclictest0-21swapper/109:01:011
1105399150,14cyclictest0-21swapper/108:03:011
1105399150,13cyclictest0-21swapper/108:40:181
1105399150,13cyclictest0-21swapper/108:35:111
1105399150,11cyclictest2021-21lldpd09:07:581
1105399150,10cyclictest0-21swapper/107:16:021
1104999157,4cyclictest13324-21sshd11:28:420
1104999157,4cyclictest0-21swapper/007:31:310
1104999152,12cyclictest1943-21snmpd09:58:560
11049991512,2cyclictest1943-21snmpd12:04:550
1104999151,13cyclictest0-21swapper/010:10:450
1104999150,14cyclictest0-21swapper/010:08:170
1104999150,14cyclictest0-21swapper/010:08:160
1104999150,14cyclictest0-21swapper/008:51:550
1104999150,14cyclictest0-21swapper/007:21:120
1104999150,11cyclictest2021-21lldpd09:35:190
1104999150,11cyclictest2021-21lldpd09:35:190
1104999150,11cyclictest0-21swapper/010:41:450
107782158,1sleep02021-21lldpd07:09:210
1106099149,4cyclictest2021-21lldpd08:25:173
1106099148,5cyclictest2021-21lldpd07:50:013
1106099148,4cyclictest2021-21lldpd08:15:213
1106099140,5cyclictest0-21swapper/307:46:153
1106099140,13cyclictest2021-21lldpd07:13:293
1106099140,13cyclictest1876-21nfsd08:05:053
1106099140,13cyclictest0-21swapper/307:34:153
1106099140,12cyclictest2021-21lldpd07:55:053
1106099140,12cyclictest18608-21users08:35:333
1105599149,4cyclictest1877-21nfsd08:42:342
1105599149,3cyclictest6264-21perl08:10:212
1105599148,5cyclictest0-21swapper/209:06:502
1105599148,5cyclictest0-21swapper/207:28:372
1105599147,5cyclictest1955-21snmpd07:20:232
1105599142,11cyclictest1943-21snmpd07:45:242
1105599141,5cyclictest0-21swapper/207:32:392
1105599141,11cyclictest31974-21perl07:55:242
1105599140,12cyclictest1809-21fschecks_time08:00:202
1105399147,5cyclictest2021-21lldpd07:55:221
1105399146,7cyclictest0-21swapper/107:37:081
1105399140,5cyclictest2021-21lldpd07:25:411
1105399140,1cyclictest2021-21lldpd07:30:041
1105399140,13cyclictest0-21swapper/107:45:021
1105399140,13cyclictest0-21swapper/107:40:411
1104999149,4cyclictest1943-21snmpd10:02:370
1104999148,5cyclictest0-21swapper/011:32:210
1104999148,5cyclictest0-21swapper/010:36:180
1104999142,5cyclictest0-21swapper/010:22:090
1104999142,11cyclictest0-21swapper/008:39:130
11049991412,1cyclictest1943-21snmpd08:30:240
11049991411,2cyclictest2021-21lldpd12:05:210
11049991410,3cyclictest10832-21kworker/0:107:18:190
1104999140,13cyclictest0-21swapper/010:59:290
1104999140,13cyclictest0-21swapper/010:52:250
1104999140,13cyclictest0-21swapper/009:05:120
1104999140,12cyclictest0-21swapper/008:45:140
1104999138,4cyclictest0-21swapper/008:14:100
1104999138,4cyclictest0-21swapper/007:27:360
1104999138,4cyclictest0-21swapper/007:11:460
1104999133,9cyclictest0-21swapper/008:18:040
1104999132,2cyclictest0-21swapper/009:00:240
11049991311,1cyclictest0-21swapper/008:42:390
1104999130,12cyclictest0-21swapper/008:56:070
1104999130,12cyclictest0-21swapper/008:01:270
1104999130,12cyclictest0-21swapper/007:40:030
1104999129,2cyclictest1943-21snmpd08:05:370
1104999129,2cyclictest1943-21snmpd07:57:500
11049991210,1cyclictest0-21swapper/008:28:080
1104999120,4cyclictest0-21swapper/007:45:470
1104999120,11cyclictest1943-21snmpd07:35:580
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional