You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-30 - 08:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack5slot0.osadl.org (updated Sat Sep 30, 2023 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3080721250,3sleep23021699cyclictest21:49:042
30025210933,48sleep10-21swapper/119:09:491
101082910,1sleep20-21swapper/200:21:052
231982900,2sleep30-21swapper/300:10:513
310612890,2sleep30-21swapper/300:39:333
250892890,2sleep325091-21sshd00:19:063
215042880,2sleep20-21swapper/222:25:392
232712870,3sleep10-21swapper/122:07:111
273012860,0sleep00-21swapper/021:33:270
16672850,1sleep20-21swapper/222:30:532
9902830,2sleep30-21swapper/321:41:433
9902830,2sleep30-21swapper/321:41:433
87182830,4sleep03020799cyclictest21:57:510
2975728331,48sleep30-21swapper/319:06:383
25752830,3sleep30-21swapper/300:00:353
23082830,2sleep22309-21sshd22:16:012
218652830,0sleep041ktimersoftd/022:22:040
188712830,2sleep10-21swapper/100:22:121
168092830,0sleep00-21swapper/021:39:520
168092830,0sleep00-21swapper/021:39:520
146852830,1sleep30-21swapper/322:43:403
53992820,2sleep25392-21sshd00:36:202
32672820,2sleep10-21swapper/123:15:471
254962820,2sleep30-21swapper/323:10:573
186732820,3sleep30-21swapper/323:28:523
145792810,0sleep00-21swapper/021:54:470
134172810,3sleep213415-21bash00:09:512
34202800,1sleep33416-21sshd22:27:243
97012790,2sleep10-21swapper/121:23:501
62182790,1sleep00-21swapper/000:05:030
233642780,3sleep13021299cyclictest00:14:591
110262750,2sleep10-21swapper/100:33:061
81942720,2sleep28192-21sshd21:54:012
165972720,3sleep33021799cyclictest22:47:363
127082700,2sleep212676-21sshd22:35:492
172502670,2sleep217248-21sshd23:10:072
183992650,3sleep13021299cyclictest23:28:501
2992825632,21sleep00-21swapper/019:08:350
2983425532,11sleep20-21swapper/219:07:242
274202450,7sleep20-21swapper/223:41:012
104562400,2sleep20-21swapper/222:54:322
25282370,1sleep00-21swapper/021:26:420
129262360,1sleep012910-21sshd21:46:530
133282300,27sleep1138550irq/27-eth023:35:411
101342290,27sleep3138550irq/27-eth023:05:323
86412280,2sleep30-21swapper/321:35:063
86412280,2sleep30-21swapper/321:35:063
282792280,1sleep028276-21bash23:18:470
316662270,1sleep031647-21sshd23:22:510
36622260,2sleep33663-21sshd00:20:213
3020799261,10cyclictest0-21swapper/023:07:580
294662260,1sleep00-21swapper/000:23:310
267512240,1sleep026747-21bash23:11:060
177282240,2sleep317727-21sshd00:33:573
302942230,2sleep20-21swapper/223:04:152
3020799236,10cyclictest20980-21cp23:03:080
252332230,1sleep025230-21bash00:19:070
271552220,2sleep127152-21sshd21:10:431
183222220,20sleep3138550irq/27-eth023:51:093
30207992114,5cyclictest3-21ksoftirqd/000:28:280
3020799211,18cyclictest0-21swapper/023:53:400
3020799211,15cyclictest0-21swapper/020:50:230
248232210,2sleep10-21swapper/121:36:561
248232210,2sleep10-21swapper/121:36:561
194412210,1sleep33021799cyclictest23:43:543
81912201,17sleep3138550irq/27-eth000:09:123
65522200,2sleep26550-21bash23:35:002
3021699202,3cyclictest9489-21sshd22:46:462
3020799208,11cyclictest3-21ksoftirqd/000:38:090
3020799202,9cyclictest22499-21sshd21:21:270
293822200,18sleep1138550irq/27-eth021:29:561
3021699194,3cyclictest15013-21sshd00:10:012
3021699194,3cyclictest14065-21cp21:28:062
3021699192,3cyclictest0-21swapper/221:10:452
3021699191,7cyclictest11174-21sshd21:16:212
3020799197,11cyclictest0-21swapper/022:40:280
3020799195,12cyclictest9594-21bash23:35:200
30207991913,5cyclictest3-21ksoftirqd/022:09:040
3020799190,18cyclictest23269-21bash23:25:340
273812190,1sleep10-21swapper/123:55:561
122692190,17sleep3138550irq/27-eth023:16:543
3021799180,12cyclictest138550irq/27-eth022:35:583
3021699182,11cyclictest28182-21sshd23:56:012
3020799187,2cyclictest3561-21sshd21:42:010
3020799187,2cyclictest3561-21sshd21:42:010
3020799182,13cyclictest22789-21kworker/0:022:32:510
3020799181,15cyclictest11000-21bash22:28:190
3020799181,15cyclictest0-21swapper/022:56:510
3020799181,15cyclictest0-21swapper/021:15:240
3020799180,9cyclictest0-21swapper/019:22:310
3020799180,2cyclictest0-21swapper/023:58:330
3020799180,14cyclictest0-21swapper/000:10:230
3020799180,12cyclictest0-21swapper/022:45:410
251272180,2sleep30-21swapper/323:37:053
3021699173,7cyclictest21997-21sshd22:14:412
3021699173,11cyclictest26746-21sshd22:41:132
3021699173,11cyclictest0-21swapper/220:58:472
3021699172,12cyclictest0-21swapper/219:30:322
3021699171,8cyclictest16356-21sshd00:18:012
30216991714,2cyclictest12081-21bash00:25:202
30216991713,3cyclictest19802-21users19:55:302
3021699170,5cyclictest21003-21fschecks_time21:40:192
3021699170,5cyclictest21003-21fschecks_time21:40:192
3021699170,15cyclictest0-21swapper/221:05:172
3021299178,2cyclictest22-21ksoftirqd/123:34:321
3021299177,2cyclictest22-21ksoftirqd/123:42:151
3021299175,4cyclictest32760-21awk20:25:271
3021299174,5cyclictest29544-21sshd22:45:211
3021299174,3cyclictest0-21swapper/123:08:311
30212991712,3cyclictest0-21swapper/100:28:291
3021299171,14cyclictest2721-21sshd22:53:381
3020799176,10cyclictest3-21ksoftirqd/022:37:490
3020799174,7cyclictest20415-21sshd22:14:310
3020799172,9cyclictest12292-21sshd23:46:460
3020799171,8cyclictest0-21swapper/000:01:060
30207991714,2cyclictest3-21ksoftirqd/023:30:160
3020799170,1cyclictest0-21swapper/023:41:330
3020799170,1cyclictest0-21swapper/022:16:170
3020799170,16cyclictest3-21ksoftirqd/000:31:080
3020799170,14cyclictest0-21swapper/019:58:120
3020799170,13cyclictest0-21swapper/019:26:560
251562170,15sleep1138550irq/27-eth021:33:131
307862160,0sleep230787-21bash21:30:042
3021799168,3cyclictest0-21swapper/322:23:563
3021799160,4cyclictest30594-21sshd22:56:493
3021799160,15cyclictest0-21swapper/322:53:443
3021799160,14cyclictest0-21swapper/320:40:263
3021699163,1cyclictest12630-21users23:35:332
3021699161,6cyclictest31143-21sshd23:15:222
3021699161,1cyclictest0-21swapper/220:15:332
3021699161,14cyclictest138550irq/27-eth021:35:172
3021699161,14cyclictest138550irq/27-eth021:35:172
3021699161,13cyclictest28766-21sshd23:26:112
3021299166,2cyclictest22-21ksoftirqd/100:05:311
3021299165,3cyclictest22-21ksoftirqd/123:46:141
3021299161,4cyclictest138550irq/27-eth022:13:151
30212991612,3cyclictest30199-21cyclictest22:28:181
3021299161,11cyclictest4452-21sshd22:16:161
3021299161,11cyclictest0-21swapper/122:55:371
30212991610,4cyclictest20516-21sshd23:03:061
3021299160,15cyclictest22-21ksoftirqd/123:13:531
3021299160,14cyclictest26633-21sshd00:03:361
3020799165,7cyclictest3-21ksoftirqd/019:40:000
3020799164,8cyclictest0-21swapper/020:25:200
3020799160,1cyclictest0-21swapper/020:55:220
3020799160,1cyclictest0-21swapper/019:53:220
3020799160,15cyclictest0-21swapper/020:21:500
3020799160,13cyclictest0-21swapper/022:02:100
3020799160,11cyclictest22023-21munin-node21:10:210
3020799160,11cyclictest0-21swapper/022:51:240
223342160,3sleep10-21swapper/121:40:261
223342160,3sleep10-21swapper/121:40:261
33072150,13sleep1138550irq/27-eth020:31:531
3021799153,11cyclictest0-21swapper/320:39:013
30217991512,2cyclictest3073-21bash21:19:163
30217991511,3cyclictest15127-21sshd00:25:363
30217991510,4cyclictest19026-21sshd23:32:363
30217991510,4cyclictest0-21swapper/323:20:153
3021799150,3cyclictest30573-21cp23:45:123
3021799150,10cyclictest10338-21munin-plugin-st20:50:003
3021699159,5cyclictest1987-21sshd21:55:032
3021699158,5cyclictest11399-21processes23:20:292
3021699158,4cyclictest1805-40kipmi020:50:242
3021699152,10cyclictest0-21swapper/220:02:172
3021699151,7cyclictest8584-21df20:45:212
30216991513,1cyclictest0-21swapper/222:00:222
3021699151,13cyclictest31357-21sshd23:49:032
3021699151,13cyclictest22611-21kworker/dying00:32:052
30216991511,3cyclictest11256-21bash23:09:262
3021699151,13cyclictest0-21swapper/223:50:062
3021699150,6cyclictest1921-21nscd22:56:132
3021699150,3cyclictest24254-21sshd22:22:212
3021699150,13cyclictest0-21swapper/220:40:262
3021699150,13cyclictest0-21swapper/220:05:172
3021699150,10cyclictest1875-21nfsd22:05:582
3021299159,1cyclictest0-21swapper/121:19:341
3021299156,3cyclictest138550irq/27-eth000:35:421
3021299156,2cyclictest22-21ksoftirqd/122:40:381
3021299153,2cyclictest26840-21sshd22:00:041
3021299152,1cyclictest0-21swapper/122:20:241
3021299151,7cyclictest20904-21sshd21:59:211
30212991510,4cyclictest30199-21cyclictest22:37:011
3021299150,8cyclictest0-21swapper/121:52:471
3021299150,7cyclictest0-21swapper/100:17:591
3021299150,6cyclictest0-21swapper/123:50:541
3021299150,13cyclictest31796-21sshd22:30:351
3020799158,6cyclictest0-21swapper/020:00:300
3020799150,2cyclictest0-21swapper/020:10:230
3020799150,1cyclictest0-21swapper/021:07:180
3020799150,1cyclictest0-21swapper/020:30:200
3020799150,14cyclictest0-21swapper/020:35:090
3020799150,14cyclictest0-21swapper/020:05:180
3020799150,12cyclictest0-21swapper/020:46:070
3020799150,12cyclictest0-21swapper/020:15:330
3021799148,5cyclictest3957-21sshd21:30:353
3021799148,2cyclictest0-21swapper/320:25:223
3021799147,6cyclictest0-21swapper/319:30:373
3021799147,3cyclictest0-21swapper/321:56:073
3021799142,11cyclictest138550irq/27-eth023:55:383
30217991411,2cyclictest0-21swapper/321:10:023
30217991410,3cyclictest30733-21sshd21:26:113
3021799140,5cyclictest0-21swapper/320:58:483
3021799140,2cyclictest0-21swapper/321:20:023
3021799140,13cyclictest3645-21sshd21:53:293
3021799140,13cyclictest19074-21sshd23:02:553
3021799140,13cyclictest0-21swapper/320:50:243
3021799140,12cyclictest3117-21sshd22:31:033
3021699148,4cyclictest12048-21bash21:20:182
3021699148,3cyclictest0-21swapper/219:49:312
3021699141,12cyclictest2121-21runrttasks20:32:062
3021699140,12cyclictest32411-21sshd00:00:202
3021299146,2cyclictest138550irq/27-eth023:20:181
3021299143,10cyclictest22-21ksoftirqd/121:49:181
3020799144,8cyclictest1400-21smicount19:15:310
3020799140,1cyclictest0-21swapper/019:47:150
3020799140,13cyclictest0-21swapper/021:00:400
3020799140,13cyclictest0-21swapper/020:40:320
3020799140,13cyclictest0-21swapper/019:12:030
3020799140,10cyclictest0-21swapper/019:40:200
3020799140,10cyclictest0-21swapper/019:40:200
3020799140,10cyclictest0-21swapper/019:30:320
3021799137,5cyclictest2614-21sshd22:16:033
3021799137,5cyclictest0-21swapper/319:51:403
30217991312,0cyclictest0-21swapper/319:14:473
30217991311,1cyclictest0-21swapper/321:45:103
30217991311,1cyclictest0-21swapper/320:01:363
3021799130,5cyclictest0-21swapper/320:10:043
3021799130,4cyclictest22197-21sshd22:10:473
3021799130,3cyclictest138550irq/27-eth021:01:263
3021799130,12cyclictest30331-21sshd22:08:013
3021799130,12cyclictest0-21swapper/320:30:193
3021799130,12cyclictest0-21swapper/320:21:513
3021799130,12cyclictest0-21swapper/320:06:253
3021799130,12cyclictest0-21swapper/319:47:093
3021799130,12cyclictest0-21swapper/319:40:163
3021799130,12cyclictest0-21swapper/319:40:163
3021799130,12cyclictest0-21swapper/319:36:363
3021799130,12cyclictest0-21swapper/319:25:103
3021799130,12cyclictest0-21swapper/319:15:313
3021799130,11cyclictest32049-21bash22:00:333
3021799130,10cyclictest138550irq/27-eth021:05:323
3021799130,10cyclictest138550irq/27-eth019:20:403
3021699138,4cyclictest15065-21munin-node21:00:222
3021699138,3cyclictest5435-21iostat_ios19:25:242
3021699131,4cyclictest138550irq/27-eth019:44:312
3021699131,4cyclictest138550irq/27-eth019:44:312
3021699131,11cyclictest428-21munin-node19:15:222
3021699130,12cyclictest0-21swapper/220:25:172
3021699130,12cyclictest0-21swapper/220:21:272
3021699130,12cyclictest0-21swapper/219:39:272
3021699130,12cyclictest0-21swapper/219:21:312
3021699130,11cyclictest4573-21irqstats20:35:252
3021299139,3cyclictest0-21swapper/119:43:411
3021299139,3cyclictest0-21swapper/119:43:411
3021299138,4cyclictest0-21swapper/119:20:451
3021299137,5cyclictest27533-21grep20:15:211
3021299137,5cyclictest0-21swapper/119:47:151
3021299137,5cyclictest0-21swapper/119:30:491
3021299135,6cyclictest0-21swapper/119:50:131
3021299134,2cyclictest18291-21nfsd421:05:231
3021299132,10cyclictest138550irq/27-eth020:21:431
3021299132,10cyclictest138550irq/27-eth020:11:141
3021299131,9cyclictest11227-21idleruntime-cro19:40:001
3021299130,8cyclictest24721-21perf20:10:001
3021299130,6cyclictest20694-21tr20:00:181
3021299130,6cyclictest0-21swapper/119:55:191
3021299130,11cyclictest0-21swapper/120:47:061
3021299130,10cyclictest14826-21munin-run21:00:001
3021799120,11cyclictest18840-21sh19:55:213
3021799120,11cyclictest0-21swapper/320:15:123
3021699120,3cyclictest30652-21diskstats19:10:212
3021699120,11cyclictest0-21swapper/220:10:232
3021699120,11cyclictest0-21swapper/219:50:032
3021299129,2cyclictest0-21swapper/119:15:071
3021299122,0cyclictest0-21swapper/120:35:221
3021299121,10cyclictest0-21swapper/120:50:041
30212991210,1cyclictest0-21swapper/121:00:231
3021299120,11cyclictest1877-21nfsd19:11:561
3021299117,3cyclictest1877-21nfsd20:40:041
3021299111,9cyclictest0-21swapper/119:26:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional