You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 23:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackaslot0.osadl.org (updated Sat Apr 27, 2024 12:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2949921140,0sleep029500-21sshd10:24:420
802121060,0sleep18022-21sshd12:03:551
18492890,2sleep22779799cyclictest11:34:392
305142820,2sleep32779899cyclictest09:21:103
167202680,1sleep116719-21sshd09:35:541
137552620,1sleep113753-21bash11:27:411
275292610,0sleep20-21swapper/210:11:332
25512610,0sleep31543-21nfsd12:27:133
234052590,0sleep02779599cyclictest10:19:200
247482580,0sleep00-21swapper/009:31:160
112812580,0sleep20-21swapper/211:16:562
8242570,1sleep228-21rcuc/211:45:052
182712560,1sleep21632-21sshd10:48:312
175282560,1sleep117525-21bash11:12:101
175282560,1sleep117525-21bash11:12:101
167412560,1sleep116734-21bash09:14:551
131732560,1sleep213153-21sshd12:22:472
253882550,0sleep30-21swapper/312:18:313
238402540,1sleep21784-21runrttasks10:08:372
147722540,0sleep114771-21bash12:33:281
114372540,1sleep311436-21sshd10:47:563
76202530,0sleep30-21swapper/312:03:533
295072530,0sleep10-21swapper/112:10:521
2744125331,18sleep20-21swapper/207:08:572
2681325327,21sleep10-21swapper/107:05:271
224272530,1sleep339-21ksoftirqd/311:17:533
21692530,1sleep00-21swapper/012:37:390
103442530,0sleep10-21swapper/110:58:281
223822520,1sleep022379-21sshd11:38:540
149972520,1sleep214977-21sshd12:33:282
2721825129,18sleep30-21swapper/307:06:053
203152510,0sleep20-21swapper/212:07:322
177162510,1sleep11784-21runrttasks10:38:291
254272500,0sleep10-21swapper/110:31:391
17982500,1sleep21796-21sshd09:53:262
168782500,0sleep10-21swapper/111:38:271
2721524924,8sleep00-21swapper/007:06:010
129902490,1sleep20-21swapper/209:59:442
117852490,1sleep111786-21bash10:50:351
81312480,0sleep21544-21nfsd10:42:382
307192480,0sleep3381ktimersoftd/310:17:153
189102480,0sleep00-21swapper/009:17:340
163632480,1sleep21784-21runrttasks11:04:142
161962480,2sleep02779599cyclictest12:01:530
186172460,0sleep118615-21sshd09:15:031
47252450,1sleep30-21swapper/312:32:383
183492450,0sleep337-21rcuc/310:51:093
169552450,0sleep016954-21sshd12:30:580
78672440,0sleep30-21swapper/310:25:243
312772440,1sleep331268-21sshd12:21:353
299092430,0sleep10-21swapper/110:46:471
6782400,0sleep0659-21sshd12:16:270
47912360,1sleep14773-21sshd09:45:361
254062260,8sleep03-21ksoftirqd/010:00:370
74082220,0sleep00-21swapper/011:14:020
74082220,0sleep00-21swapper/011:14:020
27798992220,1cyclictest0-21swapper/310:24:593
2779899220,21cyclictest0-21swapper/311:12:453
2779899220,21cyclictest0-21swapper/311:12:453
2779699220,21cyclictest28515-21bash11:23:381
2779599220,21cyclictest9699-21bash11:22:040
27798992119,1cyclictest0-21swapper/311:47:373
81662200,1sleep08143-21sshd10:25:250
2779599200,1cyclictest26199-21sshd09:44:490
27795991918,1cyclictest5885-21sshd11:42:480
2779899180,1cyclictest19344-21bash10:40:593
27797991816,2cyclictest5914-21sshd09:19:142
27797991816,1cyclictest7819-21sshd12:25:042
27797991816,1cyclictest28-21rcuc/210:35:282
27796991817,1cyclictest14105-21bash12:25:301
27796991816,1cyclictest32126-21sshd10:09:191
27795991816,1cyclictest5972-21sshd10:07:060
2779799170,13cyclictest0-21swapper/210:01:482
27796991716,1cyclictest10599-21sshd11:56:121
27796991715,1cyclictest13211-21sshd10:25:481
122022170,0sleep20-21swapper/211:43:202
27798991614,1cyclictest0-21swapper/310:59:333
2779799160,15cyclictest17287-21sshd11:12:092
2779799160,15cyclictest17287-21sshd11:12:092
27796991614,1cyclictest27648-21bash12:08:091
2779599169,3cyclictest16132-21sshd09:46:360
27795991615,1cyclictest0-21swapper/011:17:000
2779599160,1cyclictest12256-21bash09:38:170
2779599160,13cyclictest0-21swapper/011:31:390
44652150,1sleep34456-21sshd10:01:363
2779899159,2cyclictest27742-21sshd09:44:563
27798991512,1cyclictest11456-21cp11:27:293
27796991514,1cyclictest31921-21sshd10:01:121
27796991513,2cyclictest19236-21sshd11:30:391
27796991513,2cyclictest18816-21sshd10:23:521
27796991513,2cyclictest10197-21sshd11:08:581
27796991513,1cyclictest26691-21sshd10:16:541
2779699150,14cyclictest0-21swapper/111:53:201
27795991514,1cyclictest18254-21sshd11:09:380
2779599150,1cyclictest25852-21cp11:57:280
2779599150,14cyclictest0-21swapper/009:10:110
250912150,0sleep230-21ksoftirqd/210:26:442
112702150,1sleep10-21swapper/112:17:211
312642140,1sleep00-21swapper/011:00:110
2779899142,9cyclictest120050irq/25-eth009:58:063
27798991412,1cyclictest25862-21sshd11:23:253
2779899141,10cyclictest0-21swapper/312:39:353
2779899140,13cyclictest1632-21sshd09:50:243
2779899140,13cyclictest1083-21bash09:32:003
2779899140,13cyclictest0-21swapper/310:06:073
2779899140,13cyclictest0-21swapper/309:46:193
2779799148,1cyclictest0-21swapper/210:56:022
2779799143,10cyclictest9397-21sshd12:35:332
27797991412,1cyclictest30-21ksoftirqd/211:58:132
2779799140,1cyclictest18213-21bash11:25:242
2779799140,13cyclictest16702-21sshd10:21:122
27796991412,2cyclictest6070-21bash09:32:261
27796991412,2cyclictest23212-21sshd12:36:441
27796991412,1cyclictest20603-21sshd11:01:531
27796991411,2cyclictest17108-21bash09:52:001
2779699140,13cyclictest0-21swapper/110:43:161
2779599148,5cyclictest0-21swapper/009:56:290
2779599148,3cyclictest25892-21sshd11:54:550
2779599140,7cyclictest0-21swapper/009:29:550
2779599140,3cyclictest24304-21sshd10:38:590
2779599140,3cyclictest0-21swapper/010:51:430
2779599140,13cyclictest21996-21bash12:10:180
2779599140,13cyclictest0-21swapper/012:25:310
2779599140,12cyclictest0-21swapper/012:08:400
2779599140,11cyclictest7447-21sshd09:53:550
2779599140,11cyclictest0-21swapper/010:14:430
14892140,0sleep10-21swapper/111:45:081
123942140,1sleep30-21swapper/311:38:053
2779899139,1cyclictest0-21swapper/310:10:403
2779899138,4cyclictest21849-21sshd10:36:163
2779899138,4cyclictest0-21swapper/311:30:503
2779899138,4cyclictest0-21swapper/309:25:023
2779899138,2cyclictest0-21swapper/311:05:193
27798991312,1cyclictest0-21swapper/309:10:493
2779899131,1cyclictest25146-21sshd12:10:303
27798991311,1cyclictest12764-21bash09:38:193
2779899131,10cyclictest0-21swapper/311:55:343
2779899130,12cyclictest8401-21sshd11:03:353
2779899130,12cyclictest120050irq/25-eth011:40:473
2779799138,4cyclictest12041-21bash11:09:072
2779799138,1cyclictest20255-21sshd09:38:572
2779799133,9cyclictest13714-21sshd12:14:572
2779799132,1cyclictest1632-21sshd10:33:152
27797991311,1cyclictest12716-21id09:46:162
27797991311,1cyclictest10947-21bash09:43:292
2779799130,9cyclictest120050irq/25-eth012:18:122
2779799130,4cyclictest0-21swapper/212:03:352
2779799130,4cyclictest0-21swapper/210:51:082
2779799130,2cyclictest28-21rcuc/211:21:472
2779799130,1cyclictest0-21swapper/210:16:042
2779799130,12cyclictest21592-21bash11:36:092
2779799130,12cyclictest0-21swapper/211:50:072
2779699133,1cyclictest18810-21snmpd09:40:441
27796991311,1cyclictest20216-21sshd09:25:351
27796991310,2cyclictest17790-21sshd09:22:491
2779699130,12cyclictest0-21swapper/111:18:341
2779699130,12cyclictest0-21swapper/110:14:201
2779599132,10cyclictest0-21swapper/011:25:080
27795991311,1cyclictest25000-21bash10:46:210
2779599130,4cyclictest0-21swapper/009:24:370
2779599130,3cyclictest3072-21bash11:45:140
2779599130,12cyclictest0-21swapper/010:56:350
2779599130,10cyclictest26343-21sshd10:31:440
228732130,0sleep022847-21sshd10:41:160
2779899129,2cyclictest0-21swapper/310:30:593
2779899129,2cyclictest0-21swapper/309:16:113
2779899128,1cyclictest0-21swapper/311:51:103
27798991211,1cyclictest0-21swapper/312:05:173
2779899120,11cyclictest0-21swapper/308:30:123
2779799129,2cyclictest0-21swapper/209:21:232
2779799129,2cyclictest0-21swapper/209:11:022
2779799128,4cyclictest0-21swapper/209:29:152
2779799120,11cyclictest27970-21sshd09:31:332
2779699129,2cyclictest0-21swapper/107:15:031
27796991210,1cyclictest25223-21bash12:21:051
2779699120,1cyclictest0-21swapper/111:40:191
2779699120,1cyclictest0-21swapper/109:55:161
2779599128,2cyclictest11953-21sshd12:20:060
2779599127,2cyclictest0-21swapper/007:15:010
2779899110,2cyclictest0-21swapper/307:15:013
2779899110,1cyclictest0-21swapper/309:02:223
2779899110,10cyclictest12338-21taskset07:43:303
2779799118,3cyclictest0-21swapper/207:56:392
2779799118,2cyclictest0-21swapper/207:15:022
2779799110,10cyclictest0-21swapper/209:09:212
2779699110,1cyclictest0-21swapper/107:55:171
2779599116,2cyclictest0-21swapper/008:45:190
2779899109,1cyclictest0-21swapper/308:54:553
2779899109,1cyclictest0-21swapper/308:45:173
2779899109,1cyclictest0-21swapper/307:45:003
2779899109,1cyclictest0-21swapper/307:11:043
2779899100,1cyclictest0-21swapper/308:55:023
2779899100,10cyclictest0-21swapper/307:20:433
2779799100,1cyclictest0-21swapper/209:00:592
2779699109,1cyclictest0-21swapper/108:19:461
2779699102,5cyclictest0-21swapper/108:55:241
2779699100,10cyclictest0-21swapper/108:39:591
2779699100,10cyclictest0-21swapper/108:20:001
2779699100,10cyclictest0-21swapper/107:29:161
277989998,1cyclictest0-21swapper/308:16:003
277979998,1cyclictest0-21swapper/208:52:442
277979998,1cyclictest0-21swapper/208:18:352
277979990,9cyclictest0-21swapper/208:36:572
277979990,9cyclictest0-21swapper/207:28:102
277979990,6cyclictest0-21swapper/207:30:132
277969998,1cyclictest0-21swapper/108:54:241
277969990,9cyclictest0-21swapper/107:12:251
277969990,7cyclictest0-21swapper/109:07:111
277969990,7cyclictest0-21swapper/108:00:081
277969990,6cyclictest0-21swapper/108:30:591
277959990,8cyclictest0-21swapper/008:20:260
277959990,7cyclictest0-21swapper/008:40:200
277989981,6cyclictest0-21swapper/308:25:163
277989981,6cyclictest0-21swapper/307:30:153
277979981,6cyclictest0-21swapper/207:45:142
277979981,6cyclictest0-21swapper/207:10:112
277969983,5cyclictest0-21swapper/109:00:511
277969983,5cyclictest0-21swapper/108:46:001
277969983,5cyclictest0-21swapper/108:44:481
277969983,5cyclictest0-21swapper/108:07:101
277969983,5cyclictest0-21swapper/107:41:331
277969983,2cyclictest0-21swapper/107:20:061
277969981,6cyclictest0-21swapper/108:25:141
277969981,6cyclictest0-21swapper/108:10:281
277969981,6cyclictest0-21swapper/107:35:091
277969980,8cyclictest0-21swapper/107:52:151
277959985,2cyclictest0-21swapper/007:55:290
277959981,6cyclictest0-21swapper/008:10:140
277959981,6cyclictest0-21swapper/008:05:150
277959980,7cyclictest0-21swapper/009:04:500
277959980,6cyclictest0-21swapper/007:25:120
277959980,5cyclictest0-21swapper/008:25:140
277959980,5cyclictest0-21swapper/007:45:090
277959980,1cyclictest0-21swapper/007:42:290
277989975,1cyclictest3800-21grep07:25:153
277989975,1cyclictest18309-21munin-node09:05:133
277989971,6cyclictest0-21swapper/308:20:313
277989971,5cyclictest0-21swapper/308:10:133
277989970,6cyclictest0-21swapper/308:35:163
277989970,6cyclictest0-21swapper/308:05:223
277989970,6cyclictest0-21swapper/307:55:153
277989970,6cyclictest0-21swapper/307:35:293
277979976,1cyclictest9816-21kworker/2:008:00:152
277979971,2cyclictest0-21swapper/208:30:182
277979970,7cyclictest0-21swapper/208:46:132
277979970,6cyclictest0-21swapper/208:40:122
277979970,6cyclictest0-21swapper/208:05:102
277979970,6cyclictest0-21swapper/207:50:102
277979970,6cyclictest0-21swapper/207:40:132
277979970,6cyclictest0-21swapper/207:35:212
277979970,3cyclictest0-21swapper/208:55:192
277969970,6cyclictest0-21swapper/107:45:131
277969970,6cyclictest0-21swapper/107:30:151
277959974,3cyclictest0-21swapper/008:15:220
277959974,2cyclictest0-21swapper/007:50:100
277959974,1cyclictest0-21swapper/008:50:430
277959972,2cyclictest0-21swapper/008:55:200
277959970,6cyclictest0-21swapper/008:35:150
277959970,6cyclictest0-21swapper/008:00:160
277959970,6cyclictest0-21swapper/007:20:180
277959970,6cyclictest0-21swapper/007:10:060
277959970,5cyclictest0-21swapper/009:06:110
277959970,5cyclictest0-21swapper/008:30:100
277959970,5cyclictest0-21swapper/007:30:150
277959970,4cyclictest0-21swapper/007:35:200
277989965,1cyclictest7168-21tune2fs08:40:163
277989965,1cyclictest16899-21kworker/3:208:00:033
277989960,5cyclictest0-21swapper/307:50:133
277979962,2cyclictest0-21swapper/208:20:232
277979961,5cyclictest0-21swapper/207:24:512
277979960,5cyclictest0-21swapper/208:25:132
277979960,5cyclictest0-21swapper/208:10:122
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional