You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 15:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackaslot0.osadl.org (updated Sat Apr 20, 2024 12:44:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1212421070,0sleep112125-21dump-pmu-power10:29:551
75322660,1sleep10-21swapper/109:10:141
258322660,1sleep31547-21nfsd10:05:333
43782620,1sleep24363-21sshd11:54:492
327562620,0sleep10-21swapper/109:40:471
265862620,0sleep126579-21bash10:02:551
267382590,0sleep10-21swapper/110:31:041
101502590,0sleep30-21swapper/312:21:363
277692580,1sleep03907-21diskmemload11:16:140
15552580,1sleep01554-21sshd10:40:320
245952570,1sleep124584-21sshd09:59:581
129862570,1sleep10-21swapper/110:35:321
195182560,0sleep30-21swapper/312:01:203
68372550,1sleep06838-21sshd12:24:000
57932550,0sleep00-21swapper/012:37:110
322912550,1sleep332292-21sshd11:54:273
279642550,0sleep30-21swapper/310:45:243
1231925526,25sleep30-21swapper/307:05:493
321412530,1sleep332122-21sshd09:35:163
318592530,1sleep031845-21sshd09:40:420
285422530,0sleep10-21swapper/112:28:231
215282530,1sleep021530-21sshd09:59:410
141852530,1sleep30-21swapper/312:35:133
138292530,1sleep213828-21sshd11:42:042
1263725330,19sleep00-21swapper/007:09:460
197302520,2sleep119725-21bash10:24:591
1254125230,18sleep20-21swapper/207:08:372
113422520,0sleep30-21swapper/310:21:243
45622510,0sleep34540-21sshd10:03:493
34102510,0sleep30-21swapper/310:29:093
306422510,1sleep10-21swapper/110:08:521
196942510,1sleep319650-21sshd11:07:233
164912510,1sleep228-21rcuc/211:04:142
1258925129,19sleep10-21swapper/107:09:111
188212500,0sleep00-21swapper/011:29:040
49192490,0sleep00-21swapper/009:18:220
25422490,0sleep20-21swapper/211:30:222
229682490,0sleep30-21swapper/309:54:153
229682490,0sleep30-21swapper/309:54:153
228672490,0sleep20-21swapper/211:13:112
211662490,0sleep221138-21sshd11:21:052
126392490,0sleep20-21swapper/209:41:532
279562480,0sleep10-21swapper/109:23:241
19752480,0sleep10-21swapper/112:36:521
326042470,0sleep30-21swapper/311:46:183
321622470,2sleep31292099cyclictest09:46:223
223162470,1sleep222315-21id10:19:152
150322470,0sleep10-21swapper/109:53:251
150322470,0sleep10-21swapper/109:53:251
57792460,0sleep30-21swapper/311:11:443
310992450,0sleep10-21swapper/111:40:471
15482450,0sleep00-21swapper/010:37:400
315572440,1sleep131552-21sshd11:35:261
253182440,0sleep00-21swapper/009:20:230
219722440,1sleep010-21rcuc/010:25:100
135662440,0sleep00-21swapper/010:52:260
290522370,0sleep129051-21sshd12:33:481
1291799220,21cyclictest0-21swapper/009:11:330
12919992120,1cyclictest0-21swapper/210:58:422
1291999210,20cyclictest0-21swapper/210:01:152
75042200,1sleep37501-21sshd10:41:033
1292099200,11cyclictest14306-21sshd11:04:023
1292099198,2cyclictest0-21swapper/312:08:273
1292099192,1cyclictest0-21swapper/309:21:073
12918991917,1cyclictest13928-21sshd10:18:301
12918991917,1cyclictest0-21swapper/110:47:531
44322180,1sleep30-21swapper/309:32:403
165772180,0sleep00-21swapper/010:58:310
12920991814,3cyclictest11275-21sshd11:25:373
1292099180,3cyclictest25900-21sshd10:11:093
1291999180,0cyclictest0-21swapper/211:49:342
1291799183,12cyclictest18670-21sshd12:17:020
1291799180,1cyclictest18080-21sshd11:07:140
218342170,1sleep10-21swapper/111:31:581
13742170,1sleep21344-21sshd12:36:492
1292099178,3cyclictest13909-21sshd12:27:093
1292099178,1cyclictest0-21swapper/310:18:563
12920991711,2cyclictest21963-21sshd10:30:383
57782160,1sleep25777-21bash12:15:582
28102160,0sleep2291ktimersoftd/211:35:432
279072160,1sleep10-21swapper/110:40:091
1292099162,1cyclictest20822-21sshd09:25:283
1292099160,3cyclictest3907-21diskmemload11:41:353
1291799169,4cyclictest0-21swapper/011:22:190
1291799160,13cyclictest0-21swapper/011:52:500
28802150,0sleep00-21swapper/010:20:370
281802150,1sleep028176-21bash10:45:250
1292099159,3cyclictest0-21swapper/311:57:393
1292099157,3cyclictest22175-21sshd09:14:193
1292099153,2cyclictest23883-21sshd09:17:123
1292099153,1cyclictest11326-21cp11:39:143
1292099152,1cyclictest5868-21sshd09:58:173
1292099152,1cyclictest0-21swapper/312:18:363
1292099151,1cyclictest3307-21sshd10:57:193
1292099150,3cyclictest24065-21sshd09:42:513
1292099150,3cyclictest21494-21sshd12:33:093
1291999155,9cyclictest30-21ksoftirqd/209:35:382
1291999154,10cyclictest30-21ksoftirqd/209:14:212
12919991513,1cyclictest30-21ksoftirqd/209:28:212
12918991513,1cyclictest566-21sshd11:59:541
1291899150,2cyclictest1700-21sshd12:18:201
1291899150,1cyclictest0-21swapper/110:52:241
1291899150,14cyclictest9473-21sshd11:14:491
1291799159,5cyclictest0-21swapper/009:35:480
1291799159,3cyclictest0-21swapper/009:30:160
1291799151,13cyclictest0-21swapper/011:04:340
12917991511,2cyclictest0-21swapper/010:00:570
1291799150,14cyclictest0-21swapper/009:50:200
1291799150,14cyclictest0-21swapper/009:50:200
1291799150,13cyclictest0-21swapper/012:05:130
1291799150,12cyclictest0-21swapper/012:30:140
125422150,0sleep2291ktimersoftd/210:21:312
240802140,0sleep20-21swapper/212:01:442
164072140,0sleep10-21swapper/109:19:241
1292099142,3cyclictest0-21swapper/312:13:373
1292099142,1cyclictest0-21swapper/311:17:543
1292099141,3cyclictest3907-21diskmemload11:20:243
1292099141,2cyclictest0-21swapper/310:53:293
1292099140,3cyclictest25387-21cp10:36:403
1291999144,9cyclictest12582-21bash10:44:132
1291999143,10cyclictest28855-21sshd10:34:132
1291999142,11cyclictest0-21swapper/210:06:432
1291999141,9cyclictest120050irq/25-eth011:56:122
12919991413,1cyclictest30-21ksoftirqd/211:15:192
12919991412,1cyclictest7035-21sshd09:30:102
12919991412,1cyclictest30-21ksoftirqd/210:11:382
1291999141,12cyclictest0-21swapper/209:16:182
1291999140,1cyclictest120050irq/25-eth010:51:172
1291999140,13cyclictest4607-21sshd12:23:502
1291899140,13cyclictest23257-21sshd11:24:021
1291899140,13cyclictest0-21swapper/109:36:571
1291899140,11cyclictest0-21swapper/110:13:501
1291799149,4cyclictest0-21swapper/011:58:070
1291799149,4cyclictest0-21swapper/011:12:450
1291799148,3cyclictest0-21swapper/010:15:590
1291799141,12cyclictest0-21swapper/011:38:140
1291799140,3cyclictest25134-21cp11:32:150
1291799140,1cyclictest31211-21sshd11:40:480
1291799140,13cyclictest17275-21bash12:27:260
1291799140,13cyclictest10309-21sshd10:32:340
1291799140,13cyclictest0-21swapper/011:47:030
1291799140,13cyclictest0-21swapper/010:07:160
1291799140,12cyclictest0-21swapper/010:11:110
1291799140,12cyclictest0-21swapper/009:26:220
1291799140,12cyclictest0-21swapper/008:42:520
22632130,0sleep22262-21sshd12:05:162
170482130,0sleep20-21swapper/209:45:092
151192130,0sleep03907-21diskmemload12:11:300
1292099130,3cyclictest0-21swapper/311:30:343
1291999134,1cyclictest30-21ksoftirqd/210:27:442
1291999132,10cyclictest9116-21sshd09:58:342
12919991311,1cyclictest0-21swapper/212:12:052
1291999130,4cyclictest3628-21sshd12:26:192
1291999130,12cyclictest562-21bash10:48:352
1291999130,12cyclictest0-21swapper/209:22:512
1291899138,4cyclictest0-21swapper/109:49:361
12918991312,0cyclictest0-21swapper/111:00:211
1291899131,1cyclictest120050irq/25-eth010:56:171
1291899131,11cyclictest0-21swapper/111:06:521
1291899130,12cyclictest0-21swapper/112:22:051
1291899130,12cyclictest0-21swapper/111:25:561
1291899130,12cyclictest0-21swapper/111:17:511
1291799130,12cyclictest0-21swapper/009:45:180
1291799130,12cyclictest0-21swapper/008:20:150
1291799130,10cyclictest0-21swapper/012:03:330
1292099129,2cyclictest0-21swapper/307:55:093
1292099129,2cyclictest0-21swapper/307:45:113
1292099129,2cyclictest0-21swapper/307:15:013
1291999129,2cyclictest0-21swapper/212:30:332
1291999129,2cyclictest0-21swapper/208:40:112
1291999123,9cyclictest30-21ksoftirqd/211:25:082
1291999121,2cyclictest0-21swapper/209:50:222
1291999121,2cyclictest0-21swapper/209:50:222
1291999121,2cyclictest0-21swapper/207:15:012
12919991211,1cyclictest30-21ksoftirqd/211:06:272
1291999120,11cyclictest16135-21sshd10:35:502
1291899129,2cyclictest0-21swapper/112:05:111
1291899129,2cyclictest0-21swapper/112:00:281
1291899129,1cyclictest120050irq/25-eth012:11:041
1291899127,4cyclictest0-21swapper/111:50:121
1291899121,10cyclictest0-21swapper/109:00:141
12918991210,1cyclictest0-21swapper/109:32:241
1291899120,1cyclictest29529-21sshd11:46:031
1291899120,11cyclictest0-21swapper/109:28:561
1291899120,11cyclictest0-21swapper/107:40:111
1291799129,2cyclictest0-21swapper/008:15:150
1291799122,9cyclictest0-21swapper/008:39:560
1291799120,12cyclictest0-21swapper/007:58:520
1291799120,10cyclictest0-21swapper/008:46:380
1292099119,1cyclictest0-21swapper/308:10:193
1292099118,3cyclictest0-21swapper/307:25:133
1292099118,2cyclictest0-21swapper/308:30:143
1292099111,1cyclictest0-21swapper/308:25:183
1292099110,2cyclictest0-21swapper/308:00:163
1292099110,10cyclictest11019-21tune2fs08:15:163
1292099110,10cyclictest0-21swapper/308:05:113
1291999118,2cyclictest0-21swapper/207:55:092
1291999118,2cyclictest0-21swapper/207:45:162
12919991110,1cyclictest30-21ksoftirqd/207:25:122
1291999110,2cyclictest0-21swapper/208:35:102
1291999110,2cyclictest0-21swapper/208:15:112
1291999110,2cyclictest0-21swapper/208:00:122
1291999110,10cyclictest0-21swapper/207:30:142
1291899118,2cyclictest0-21swapper/107:55:161
1291899110,7cyclictest0-21swapper/108:38:081
1291899110,2cyclictest0-21swapper/108:30:161
1291899110,1cyclictest0-21swapper/108:52:391
1291899110,11cyclictest0-21swapper/108:49:251
1291899110,10cyclictest30253-21apache_volume07:45:121
1291899110,10cyclictest0-21swapper/108:25:241
1291899110,10cyclictest0-21swapper/108:15:211
1291899110,10cyclictest0-21swapper/107:35:151
1291799118,2cyclictest0-21swapper/009:05:130
1291799110,10cyclictest0-21swapper/008:10:280
1291799110,10cyclictest0-21swapper/007:20:100
1292099109,1cyclictest0-21swapper/308:41:463
1292099108,1cyclictest13522-21fw_forwarded_lo08:20:173
1292099100,1cyclictest28272-21ntp_states08:50:263
1292099100,1cyclictest23583-21diskstats07:30:143
1292099100,1cyclictest2094-21df09:05:133
1292099100,10cyclictest0-21swapper/307:40:123
1291999108,1cyclictest0-21swapper/208:50:262
1291999107,2cyclictest0-21swapper/208:10:182
1291999100,9cyclictest28574-21fschecks_time07:40:222
1291999100,9cyclictest0-21swapper/208:45:282
1291999100,1cyclictest3402-21sed09:05:252
1291999100,1cyclictest25887-21df07:35:122
1291899109,1cyclictest0-21swapper/108:00:021
1291899109,1cyclictest0-21swapper/107:17:521
1291899109,1cyclictest0-21swapper/107:12:101
1291899108,1cyclictest29354-21apache_processe08:55:121
1291899103,5cyclictest0-21swapper/107:29:321
1291899100,9cyclictest0-21swapper/108:10:181
1291899100,1cyclictest6285-21perl08:05:151
1291899100,1cyclictest3297-21ls09:05:251
1291899100,1cyclictest0-21swapper/108:40:121
1291899100,1cyclictest0-21swapper/107:30:151
1291899100,10cyclictest0-21swapper/108:20:491
1291799100,9cyclictest3237-21apache_volume08:00:130
1291799100,9cyclictest0-21swapper/009:00:150
1291799100,9cyclictest0-21swapper/007:15:160
1291799100,1cyclictest6387-21perl08:05:150
1291799100,1cyclictest0-21swapper/007:54:400
1291799100,10cyclictest0-21swapper/007:34:450
129209999,0cyclictest0-21swapper/308:55:143
129209998,1cyclictest0-21swapper/308:38:383
129209997,1cyclictest0-21swapper/309:00:163
129209991,3cyclictest0-21swapper/307:55:003
129209990,9cyclictest0-21swapper/308:45:233
129209990,9cyclictest0-21swapper/307:20:153
129199998,1cyclictest0-21swapper/208:55:152
129199998,1cyclictest0-21swapper/208:30:152
129199997,1cyclictest0-21swapper/208:25:192
129199990,9cyclictest0-21swapper/208:05:152
129199990,9cyclictest0-21swapper/207:20:142
129189990,1cyclictest0-21swapper/107:20:101
129179998,1cyclictest0-21swapper/007:45:170
129179998,1cyclictest0-21swapper/007:40:100
129179992,1cyclictest18250-21perl08:30:180
129179990,9cyclictest0-21swapper/008:25:230
129179990,9cyclictest0-21swapper/007:25:370
129179990,1cyclictest0-21swapper/008:50:210
129209987,1cyclictest0-21swapper/307:10:143
129199987,1cyclictest0-21swapper/207:50:192
129189980,8cyclictest0-21swapper/107:50:391
129179987,1cyclictest26305-21smartctl07:35:150
129179987,1cyclictest0-21swapper/008:55:130
129179980,7cyclictest0-21swapper/007:10:200
129209971,5cyclictest25512-21apache_volume07:35:103
129199975,1cyclictest32028-21ls09:00:132
129199971,6cyclictest0-21swapper/207:10:112
129199964,1cyclictest13170-21runrttasks08:20:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional