You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 09:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack5slot0.osadl.org (updated Sat Apr 27, 2024 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3115721300,2sleep11365599cyclictest00:26:211
863021290,4sleep31365799cyclictest21:36:063
1583221220,0sleep015827-21sshd23:05:170
2426821140,3sleep31365799cyclictest21:52:383
1003221090,0sleep00-21swapper/021:14:280
197522970,3sleep219722-21strings21:15:302
92402920,2sleep30-21swapper/322:46:043
217892900,1sleep00-21swapper/023:42:560
1323328942,43sleep10-21swapper/119:07:011
129732880,1sleep00-21swapper/000:32:090
209342870,2sleep10-21swapper/100:21:041
248382840,2sleep30-21swapper/323:58:093
208562830,2sleep12121-21runrttasks22:06:591
196972830,1sleep30-21swapper/323:02:033
1335328324,47sleep30-21swapper/319:08:303
212162820,1sleep021213-21sshd21:19:250
193072820,2sleep20-21swapper/221:33:452
194522810,1sleep10-21swapper/121:40:581
149472810,1sleep014943-21sshd22:43:040
149472810,1sleep014943-21sshd22:43:040
74182800,3sleep31365799cyclictest22:01:443
295102790,2sleep20-21swapper/200:14:152
65022780,3sleep21365699cyclictest23:19:012
211822770,1sleep30-21swapper/300:21:063
37092760,4sleep31365799cyclictest22:56:303
34882760,4sleep21365699cyclictest22:34:292
274592750,1sleep30-21swapper/300:14:003
92232740,1sleep10-21swapper/122:42:251
92232740,1sleep10-21swapper/122:42:251
247572740,2sleep30-21swapper/321:56:193
171032740,1sleep20-21swapper/222:39:422
119652730,0sleep00-21swapper/022:53:500
305092710,1sleep330507-21sshd00:06:323
263302680,1sleep20-21swapper/222:51:442
80122650,2sleep28009-21sshd23:41:172
1310226236,14sleep00-21swapper/019:05:310
1310925843,10sleep20-21swapper/219:05:382
68702430,0sleep36871-21bash23:30:083
138722420,4sleep10-21swapper/122:54:031
228252360,33sleep3138550irq/27-eth021:12:113
261402350,2sleep326137-21sshd21:27:133
101022340,2sleep10-21swapper/122:38:531
219212330,4sleep20-21swapper/221:48:442
162492320,3sleep01365499cyclictest23:31:050
207222310,2sleep220720-21sshd00:37:082
123582310,3sleep20-21swapper/223:23:222
229412290,1sleep21365699cyclictest21:56:062
208332280,26sleep3138550irq/27-eth022:10:343
11552280,3sleep01365499cyclictest23:22:040
84502270,3sleep01365499cyclictest22:12:550
323752270,3sleep30-21swapper/323:25:313
236612270,25sleep1138550irq/27-eth023:13:361
313652260,3sleep10-21swapper/121:16:491
24962260,3sleep20-21swapper/223:00:102
224942260,5sleep20-21swapper/223:28:112
196652260,4sleep11365599cyclictest23:24:131
190712262,22sleep3138550irq/27-eth023:20:233
23092251,22sleep1138550irq/27-eth021:57:301
308662242,20sleep128750irq/26-ahci[00021:53:251
285212240,2sleep20-21swapper/200:02:252
139082240,3sleep20-21swapper/200:20:172
311372236,15sleep110950irq/23-ehci_hcd23:44:031
306832230,3sleep30-21swapper/321:49:453
28122230,3sleep20-21swapper/221:53:532
95212220,20sleep1138550irq/27-eth021:10:371
67802220,2sleep20-21swapper/223:59:532
1365599220,20cyclictest29354-21sshd21:45:471
96312210,2sleep20-21swapper/223:34:082
8852210,2sleep00-21swapper/022:56:110
68842210,19sleep1138550irq/27-eth000:35:241
266012210,2sleep10-21swapper/122:59:121
159372210,19sleep3138550irq/27-eth000:00:513
1365699215,8cyclictest0-21swapper/221:44:282
1365699213,9cyclictest7059-21sshd22:01:412
13654992116,3cyclictest3-21ksoftirqd/022:01:080
1365499210,20cyclictest0-21swapper/020:22:380
1365699205,8cyclictest0-21swapper/223:08:452
1365699203,9cyclictest138550irq/27-eth022:29:192
1365699202,11cyclictest0-21swapper/223:50:412
1365699194,3cyclictest0-21swapper/222:21:172
1365699194,3cyclictest0-21swapper/222:21:172
1365699194,2cyclictest0-21swapper/221:23:082
156582180,16sleep1138550irq/27-eth022:21:021
156582180,16sleep1138550irq/27-eth022:21:021
151262181,15sleep1138550irq/27-eth000:08:381
1365799180,16cyclictest21400-21sshd00:17:123
1365699183,2cyclictest0-21swapper/220:57:012
1365699183,2cyclictest0-21swapper/220:11:482
1365699183,11cyclictest28750irq/26-ahci[00023:45:512
1365699182,8cyclictest0-21swapper/221:11:092
1365699182,7cyclictest21021-21sshd21:26:372
105582180,15sleep1138550irq/27-eth022:46:151
91742170,0sleep00-21swapper/021:21:370
13657991712,1cyclictest22920-21sshd23:17:093
1365799170,15cyclictest0-21swapper/300:39:273
1365699173,9cyclictest6878-21sshd22:42:092
1365699173,9cyclictest6878-21sshd22:42:092
1365699173,7cyclictest445-21jbd2/dm-0-820:36:012
1365699173,6cyclictest1877-21nfsd22:58:292
1365699172,9cyclictest36-21rcuop/223:38:262
1365699172,11cyclictest0-21swapper/220:20:112
13656991713,3cyclictest4047-21sshd21:39:192
13655991713,3cyclictest30243-21sshd23:29:051
1365499174,11cyclictest3-21ksoftirqd/000:27:020
13654991710,3cyclictest0-21swapper/022:36:550
1365499170,16cyclictest0-21swapper/023:04:170
1365499170,14cyclictest0-21swapper/019:52:470
150932160,14sleep110950irq/23-ehci_hcd23:34:481
13657991611,3cyclictest15569-21bash21:44:203
1365799160,4cyclictest20166-21sshd23:53:513
1365799160,14cyclictest0-21swapper/321:15:333
1365699164,7cyclictest8087-21sshd22:16:312
1365699164,2cyclictest0-21swapper/222:13:212
1365699163,9cyclictest15253-21sshd22:06:192
1365699163,8cyclictest0-21swapper/220:25:512
1365699163,7cyclictest17417-21bash00:28:452
1365699163,3cyclictest0-21swapper/219:37:212
1365699163,2cyclictest0-21swapper/219:56:092
1365699162,2cyclictest0-21swapper/220:16:292
1365699162,2cyclictest0-21swapper/220:00:092
1365699161,2cyclictest0-21swapper/219:42:252
1365699161,14cyclictest147450irq/28-eth1-rx-19:18:152
1365699160,8cyclictest1875-21nfsd00:18:452
1365699160,3cyclictest0-21swapper/220:34:412
1365599164,11cyclictest10950irq/23-ehci_hcd21:01:121
13655991614,1cyclictest0-21swapper/123:09:221
13655991613,2cyclictest0-21swapper/122:10:131
13655991612,3cyclictest14684-21sshd21:33:131
13655991611,3cyclictest4849-21sshd23:00:211
13655991611,3cyclictest10773-21bash23:56:271
1365599160,14cyclictest0-21swapper/120:15:201
1365499168,6cyclictest3-21ksoftirqd/000:21:580
1365499165,2cyclictest0-21swapper/023:35:110
1365499164,8cyclictest0-21swapper/000:17:200
1365499160,15cyclictest0-21swapper/023:48:330
1365499160,15cyclictest0-21swapper/021:33:380
1365499160,11cyclictest0-21swapper/023:25:370
15022150,13sleep3138550irq/27-eth023:40:313
1365799159,5cyclictest138550irq/27-eth023:11:583
1365799155,7cyclictest0-21swapper/323:47:483
1365799153,3cyclictest0-21swapper/322:31:003
1365799152,7cyclictest31222-21switchtime21:20:263
1365799150,14cyclictest8829-21sshd22:27:403
1365799150,13cyclictest0-21swapper/322:39:323
1365799150,13cyclictest0-21swapper/321:05:243
1365799150,13cyclictest0-21swapper/300:28:343
1365699156,4cyclictest0-21swapper/219:13:432
1365699154,2cyclictest0-21swapper/219:21:272
1365699153,8cyclictest0-21swapper/220:08:472
1365699153,5cyclictest12352-21sshd22:46:272
13656991511,3cyclictest27093-21iostat_ios20:50:162
13656991511,3cyclictest25407-21id23:10:062
1365699150,6cyclictest20486-21munin-node19:25:142
1365599157,6cyclictest0-21swapper/100:31:181
1365599157,3cyclictest11455-21bash23:19:361
1365599157,3cyclictest0-21swapper/123:51:531
1365599154,5cyclictest0-21swapper/121:20:031
1365599152,9cyclictest16621-21sshd21:26:051
13655991511,3cyclictest8093-21sshd00:11:371
1365599150,3cyclictest0-21swapper/122:30:281
1365599150,13cyclictest20459-21sshd22:25:181
1365599150,11cyclictest29997-21sshd22:15:191
1365499158,6cyclictest0-21swapper/022:29:480
1365499157,5cyclictest0-21swapper/019:16:000
1365499155,8cyclictest0-21swapper/023:15:320
1365499154,6cyclictest5851-21bash22:23:410
1365499154,6cyclictest5851-21bash22:23:410
13654991513,1cyclictest5193-21sshd23:55:460
13654991511,1cyclictest0-21swapper/000:10:020
1365499150,14cyclictest7539-21sshd21:43:230
1365499150,14cyclictest0-21swapper/023:53:120
1365499150,14cyclictest0-21swapper/021:48:240
1365499150,14cyclictest0-21swapper/019:59:170
1365499150,14cyclictest0-21swapper/000:36:140
1365499150,11cyclictest0-21swapper/022:16:110
1365799148,4cyclictest28171-21bash22:15:103
1365799147,3cyclictest138550irq/27-eth022:20:493
1365799147,3cyclictest138550irq/27-eth022:20:483
1365799145,7cyclictest29480-21id00:34:153
1365799140,5cyclictest15465-21idleruntime23:05:143
1365799140,4cyclictest0-21swapper/319:39:003
1365799140,3cyclictest0-21swapper/322:05:483
1365799140,12cyclictest20799-21sshd23:35:213
1365799140,12cyclictest20681-21sshd21:30:143
1365699144,9cyclictest147450irq/28-eth1-rx-19:47:532
1365699142,10cyclictest2994-21sshd00:30:522
1365699142,0cyclictest0-21swapper/219:53:122
1365699141,8cyclictest26594-21sshd00:06:012
1365699141,8cyclictest0-21swapper/220:43:112
1365699141,12cyclictest0-21swapper/220:46:442
1365599149,4cyclictest138550irq/27-eth023:48:111
1365599143,10cyclictest0-21swapper/120:42:161
1365599142,11cyclictest18559-21cp21:37:161
1365599140,5cyclictest0-21swapper/122:01:301
1365599140,3cyclictest138550irq/27-eth019:55:361
1365599140,12cyclictest8491-21sshd00:15:311
1365599140,12cyclictest19346-21fschecks_time23:35:131
1365599140,12cyclictest14498-21cp00:00:401
1365499148,2cyclictest0-21swapper/022:06:270
13654991411,2cyclictest3-21ksoftirqd/022:45:510
13654991411,2cyclictest25175-21id23:13:460
1365499141,12cyclictest0-21swapper/021:39:000
1365499140,9cyclictest27237-21id21:27:210
1365499140,7cyclictest0-21swapper/022:34:460
1365499140,7cyclictest0-21swapper/021:50:470
1365499140,13cyclictest0-21swapper/000:00:590
1365499140,11cyclictest0-21swapper/020:31:310
1365499140,10cyclictest28711-21bash21:56:460
1365799138,3cyclictest21539-21tr22:40:113
1365799138,3cyclictest21539-21tr22:40:113
1365799137,5cyclictest2121-21runrttasks22:50:403
1365799137,5cyclictest0-21swapper/321:04:023
1365799137,5cyclictest0-21swapper/320:27:343
1365799133,9cyclictest0-21swapper/319:56:263
1365799132,10cyclictest138550irq/27-eth020:05:043
13657991310,1cyclictest0-21swapper/320:40:183
1365799130,4cyclictest27870-21munin-node19:40:153
1365799130,4cyclictest13748-21munin-node19:10:143
1365799130,12cyclictest30428-21taskset20:57:443
1365799130,12cyclictest0-21swapper/320:35:223
1365799130,12cyclictest0-21swapper/320:14:003
1365799130,12cyclictest0-21swapper/320:01:123
1365799130,12cyclictest0-21swapper/319:30:423
1365799130,12cyclictest0-21swapper/319:27:413
1365799130,12cyclictest0-21swapper/319:20:503
1365799130,11cyclictest12859-21munin-node20:20:123
1365699138,4cyclictest23464-21munin-node19:30:132
1365699132,9cyclictest0-21swapper/221:01:152
1365599137,5cyclictest0-21swapper/120:25:191
1365599135,4cyclictest0-21swapper/120:11:071
13655991311,1cyclictest0-21swapper/120:23:031
13655991310,2cyclictest138550irq/27-eth020:37:271
1365599130,5cyclictest0-21swapper/120:34:271
1365599130,4cyclictest2121-21runrttasks20:46:471
1365599130,12cyclictest0-21swapper/120:07:131
1365599130,12cyclictest0-21swapper/120:00:201
1365599130,12cyclictest0-21swapper/119:41:001
1365599130,12cyclictest0-21swapper/119:32:231
1365599130,12cyclictest0-21swapper/119:20:541
1365599130,12cyclictest0-21swapper/119:17:101
1365599130,11cyclictest32465-21iostat_ios19:50:141
1365599130,11cyclictest30218-21iostat_ios19:45:151
1365599130,11cyclictest27089-21iostat20:50:141
1365599130,11cyclictest20486-21munin-node19:25:201
1365499137,5cyclictest0-21swapper/020:50:050
1365499137,5cyclictest0-21swapper/020:28:410
1365499133,9cyclictest0-21swapper/021:06:180
1365499131,10cyclictest0-21swapper/020:45:160
1365499130,8cyclictest0-21swapper/020:37:560
1365499130,12cyclictest0-21swapper/021:01:540
1365499130,12cyclictest0-21swapper/020:44:170
1365499130,12cyclictest0-21swapper/019:45:000
1365499130,12cyclictest0-21swapper/019:38:180
1365499130,12cyclictest0-21swapper/019:30:440
1365499130,12cyclictest0-21swapper/019:11:210
1365499130,10cyclictest0-21swapper/000:05:280
1365799121,10cyclictest138550irq/27-eth020:16:243
1365799120,9cyclictest0-21swapper/319:46:533
1365799120,3cyclictest381-21ntp_states19:50:183
1365799120,11cyclictest26445-21atenall_r5power20:50:113
1365799120,11cyclictest24757-21sh20:45:143
1365799120,11cyclictest1877-21nfsd20:30:113
1365799120,10cyclictest16312-21df_inode19:15:113
1365699128,3cyclictest1864-21pmu-power21:05:262
1365599127,3cyclictest1396-21iostat21:05:181
1365599120,3cyclictest25717-21iostat_ios19:35:141
1365599120,11cyclictest2121-21runrttasks20:55:081
1365599120,11cyclictest0-21swapper/119:10:131
1365499127,4cyclictest0-21swapper/019:40:220
13654991210,1cyclictest0-21swapper/019:22:180
1365499120,11cyclictest0-21swapper/020:55:270
1365499120,11cyclictest0-21swapper/020:15:010
1365499120,11cyclictest0-21swapper/020:05:080
1365499120,11cyclictest0-21swapper/020:00:470
1365499110,10cyclictest0-21swapper/020:10:290
1365499110,10cyclictest0-21swapper/019:25:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional