You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-10 - 02:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack7slot0.osadl.org (updated Sat Dec 09, 2023 12:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117950650,0irq/26-eth1-rx-0-21swapper/107:06:581
117950600,0irq/26-eth1-rx-0-21swapper/307:07:503
110050570,0irq/25-eth00-21swapper/007:05:260
110050560,0irq/25-eth00-21swapper/207:08:112
41190,0ktimersoftd/011633-21sshd11:10:570
1107999190,0cyclictest24908-21bash09:35:463
1107899190,0cyclictest11564-21sed09:30:262
1107699182,0cyclictest0-21swapper/011:22:470
11079991712,0cyclictest0-21swapper/311:59:073
1107999170,0cyclictest19002-21sshd12:21:393
11079991612,0cyclictest20796-21sshd10:54:313
1107999160,0cyclictest32357-21sshd11:27:163
1107999160,0cyclictest0-21swapper/309:53:393
1107999150,0cyclictest0-21swapper/312:14:413
1107999150,0cyclictest0-21swapper/310:55:263
1107899150,0cyclictest0-21swapper/210:21:572
1107799150,0cyclictest21811-21sshd11:36:571
1107799150,0cyclictest0-21swapper/110:09:161
11076991514,0cyclictest14643-21awk12:10:000
11079991413,0cyclictest0-21swapper/310:21:383
11079991410,0cyclictest4267-21bash09:10:123
1107999140,0cyclictest27788-21sshd12:34:043
1107999140,0cyclictest0-21swapper/311:54:143
1107999140,0cyclictest0-21swapper/311:43:333
1107999140,0cyclictest0-21swapper/310:31:083
1107799140,0cyclictest3130-21bash11:20:321
11076991413,0cyclictest0-21swapper/011:51:370
110050140,0irq/25-eth0890-21sshd10:23:270
11079991313,0cyclictest0-21swapper/311:08:003
11079991313,0cyclictest0-21swapper/311:07:593
11079991313,0cyclictest0-21swapper/310:46:513
11079991312,0cyclictest0-21swapper/312:35:353
11079991312,0cyclictest0-21swapper/310:17:213
11079991311,0cyclictest16495-21cp11:22:033
1107999130,0cyclictest19938-21sshd10:06:053
11078991312,0cyclictest0-21swapper/210:36:422
11078991312,0cyclictest0-21swapper/209:49:052
1107899130,0cyclictest0-21swapper/211:20:112
1107899130,0cyclictest0-21swapper/209:16:112
11077991313,0cyclictest8892-21sshd11:31:441
11077991312,0cyclictest14103-21sshd11:51:011
11077991311,0cyclictest2686-21diskmemload10:39:561
11077991311,0cyclictest0-21swapper/109:35:001
11076991312,0cyclictest28902-21sshd10:07:180
11076991312,0cyclictest25298-21sshd09:43:360
11076991312,0cyclictest0-21swapper/012:36:400
11076991312,0cyclictest0-21swapper/010:55:290
1107699130,0cyclictest22364-21sshd12:29:430
110050130,0irq/25-eth031848-21sshd12:30:402
110050130,0irq/25-eth00-21swapper/111:14:471
9950120,0irq/24-0000:00:2686-21diskmemload11:32:550
41120,0ktimersoftd/00-21swapper/009:39:320
191120,0ktimersoftd/128871-21bash12:19:081
11079991211,0cyclictest17819-21sshd10:13:523
11079991211,0cyclictest0-21swapper/311:31:353
11079991211,0cyclictest0-21swapper/309:25:323
11079991210,0cyclictest0-21swapper/311:13:483
11079991210,0cyclictest0-21swapper/309:41:483
11079991210,0cyclictest0-21swapper/307:40:103
1107999120,0cyclictest10275-21sshd12:05:333
1107999120,0cyclictest0-21swapper/311:19:373
1107999120,0cyclictest0-21swapper/309:45:443
1107999120,0cyclictest0-21swapper/309:30:383
1107999120,0cyclictest0-21swapper/309:21:573
1107999120,0cyclictest0-21swapper/308:57:533
1107999120,0cyclictest0-21swapper/308:32:143
1107999120,0cyclictest0-21swapper/307:31:423
1107999120,0cyclictest0-21swapper/307:17:393
11078991211,0cyclictest0-21swapper/209:41:112
11078991210,0cyclictest0-21swapper/211:40:502
11078991210,0cyclictest0-21swapper/210:10:552
1107899120,0cyclictest0-21swapper/212:10:272
1107899120,0cyclictest0-21swapper/211:06:482
1107899120,0cyclictest0-21swapper/211:06:482
1107899120,0cyclictest0-21swapper/211:03:252
1107899120,0cyclictest0-21swapper/210:48:062
1107899120,0cyclictest0-21swapper/210:02:262
11077991211,0cyclictest3596-21sshd10:27:371
11077991211,0cyclictest2686-21diskmemload09:58:191
11077991211,0cyclictest0-21swapper/112:31:131
11077991211,0cyclictest0-21swapper/112:01:421
11077991211,0cyclictest0-21swapper/111:26:311
11077991211,0cyclictest0-21swapper/111:07:141
11077991211,0cyclictest0-21swapper/111:07:131
11077991211,0cyclictest0-21swapper/110:49:271
11077991210,0cyclictest0-21swapper/111:48:351
11077991210,0cyclictest0-21swapper/109:41:011
1107799120,0cyclictest22084-21smartctl08:40:241
1107799120,0cyclictest0-21swapper/110:33:451
1107799120,0cyclictest0-21swapper/110:16:351
11076991211,0cyclictest7008-21sshd11:39:040
11076991211,0cyclictest4037-21sshd12:31:130
11076991211,0cyclictest0-21swapper/009:24:540
11076991210,0cyclictest0-21swapper/009:31:310
1107699120,0cyclictest0-21swapper/012:16:200
1107699120,0cyclictest0-21swapper/011:27:190
1107699120,0cyclictest0-21swapper/011:09:550
1107699120,0cyclictest0-21swapper/011:09:550
1107699120,0cyclictest0-21swapper/010:46:550
1107699120,0cyclictest0-21swapper/009:49:580
110050120,0irq/25-eth06732-21consoletype10:04:371
110050120,0irq/25-eth00-21swapper/111:57:521
110050120,0irq/25-eth00-21swapper/010:16:230
110050120,0irq/25-eth00-21swapper/009:50:230
11079991111,0cyclictest0-21swapper/310:41:383
11079991111,0cyclictest0-21swapper/308:45:213
11079991110,0cyclictest0-21swapper/311:04:383
11079991110,0cyclictest0-21swapper/310:00:373
1107999110,0cyclictest0-21swapper/309:06:463
1107999110,0cyclictest0-21swapper/307:35:383
11078991111,0cyclictest0-21swapper/211:18:252
11078991111,0cyclictest0-21swapper/210:51:282
11078991110,0cyclictest0-21swapper/211:58:362
11078991110,0cyclictest0-21swapper/211:53:572
11078991110,0cyclictest0-21swapper/210:16:442
1107899110,0cyclictest29002-21fschecks_time12:15:202
1107899110,0cyclictest0-21swapper/211:49:052
1107899110,0cyclictest0-21swapper/211:36:322
11077991111,0cyclictest0-21swapper/109:14:331
11077991110,0cyclictest2686-21diskmemload09:19:401
11077991110,0cyclictest24034-21sshd12:14:491
11077991110,0cyclictest0-21swapper/111:16:241
11077991110,0cyclictest0-21swapper/110:12:171
11077991110,0cyclictest0-21swapper/109:29:531
11077991110,0cyclictest0-21swapper/108:19:071
1107799110,0cyclictest14637-21bash11:43:421
1107799110,0cyclictest0-21swapper/108:25:461
1107799110,0cyclictest0-21swapper/107:32:051
11076991111,0cyclictest0-21swapper/011:19:050
11076991110,0cyclictest0-21swapper/011:59:520
11076991110,0cyclictest0-21swapper/008:57:430
110050110,0irq/25-eth00-21swapper/012:02:300
41100,0ktimersoftd/02686-21diskmemload10:36:560
1107999109,0cyclictest14400-21sshd09:15:193
1107999108,0cyclictest0-21swapper/308:14:133
1107999107,0cyclictest10001-21bash10:28:233
11079991010,0cyclictest0-21swapper/312:28:373
11079991010,0cyclictest0-21swapper/308:03:593
11079991010,0cyclictest0-21swapper/307:23:273
1107999100,0cyclictest9136-21bash11:35:293
1107999100,0cyclictest0-21swapper/312:01:083
1107899109,0cyclictest20920-21sshd09:58:292
1107899109,0cyclictest14769-21bash12:36:142
1107899109,0cyclictest1453-21nfsd10:59:082
1107899109,0cyclictest0-21swapper/212:29:162
1107899109,0cyclictest0-21swapper/211:30:212
1107899108,0cyclictest117950irq/26-eth1-rx-08:11:302
11078991010,0cyclictest0-21swapper/212:02:122
11078991010,0cyclictest0-21swapper/211:25:092
11078991010,0cyclictest0-21swapper/209:20:342
11078991010,0cyclictest0-21swapper/209:14:422
11078991010,0cyclictest0-21swapper/209:05:382
11078991010,0cyclictest0-21swapper/208:43:052
11078991010,0cyclictest0-21swapper/208:19:032
11078991010,0cyclictest0-21swapper/207:49:252
1107899100,0cyclictest0-21swapper/208:57:292
1107899100,0cyclictest0-21swapper/208:28:062
1107899100,0cyclictest0-21swapper/208:22:042
1107899100,0cyclictest0-21swapper/208:06:582
1107899100,0cyclictest0-21swapper/207:17:212
1107799109,0cyclictest13138-21bash10:57:071
1107799109,0cyclictest0-21swapper/107:54:091
1107799109,0cyclictest0-21swapper/107:37:321
1107799109,0cyclictest0-21swapper/107:26:171
11077991010,0cyclictest0-21swapper/110:24:151
11077991010,0cyclictest0-21swapper/108:34:061
11077991010,0cyclictest0-21swapper/108:07:241
11077991010,0cyclictest0-21swapper/107:40:341
1107799100,0cyclictest0-21swapper/112:25:341
1107799100,0cyclictest0-21swapper/111:00:211
1107799100,0cyclictest0-21swapper/107:17:061
1107699109,0cyclictest0-21swapper/009:10:080
1107699108,0cyclictest0-21swapper/007:48:080
1107699107,0cyclictest0-21swapper/010:50:170
1107699107,0cyclictest0-21swapper/009:28:290
11076991010,0cyclictest0-21swapper/012:21:490
11076991010,0cyclictest0-21swapper/011:03:100
11076991010,0cyclictest0-21swapper/010:03:200
11076991010,0cyclictest0-21swapper/008:36:540
110050100,0irq/25-eth020-21ksoftirqd/112:08:341
110050100,0irq/25-eth00-21swapper/109:51:221
110050100,0irq/25-eth00-21swapper/109:23:361
4190,0ktimersoftd/029312-21sshd10:11:150
4190,0ktimersoftd/00-21swapper/009:06:460
11795090,0irq/26-eth1-rx-4887-21bash09:45:041
110799999,0cyclictest0-21swapper/312:16:113
110799999,0cyclictest0-21swapper/308:43:163
110799999,0cyclictest0-21swapper/308:19:193
110799999,0cyclictest0-21swapper/308:09:063
110799999,0cyclictest0-21swapper/307:52:163
110799999,0cyclictest0-21swapper/307:25:533
110799999,0cyclictest0-21swapper/307:14:173
110799997,0cyclictest0-21swapper/307:47:443
110799990,0cyclictest4821-21sshd10:35:143
110799990,0cyclictest3143-21sshd11:45:593
110799990,0cyclictest0-21swapper/309:55:053
110789999,0cyclictest0-21swapper/212:22:182
110789999,0cyclictest0-21swapper/210:41:562
110789999,0cyclictest0-21swapper/210:25:182
110789998,0cyclictest18134-21sshd11:11:392
110789998,0cyclictest0-21swapper/209:38:442
110789990,0cyclictest0-21swapper/208:50:182
110779999,0cyclictest0-21swapper/112:20:171
110779999,0cyclictest0-21swapper/109:07:551
110779999,0cyclictest0-21swapper/108:24:151
110779998,0cyclictest12625-21bash12:39:541
110779990,0cyclictest0-21swapper/108:59:131
110779990,0cyclictest0-21swapper/108:45:211
110779990,0cyclictest0-21swapper/108:38:181
110769999,0cyclictest0-21swapper/010:40:450
110769999,0cyclictest0-21swapper/008:45:030
110769998,0cyclictest28195-21bash09:55:270
110769998,0cyclictest0-21swapper/011:45:480
110769998,0cyclictest0-21swapper/010:30:530
110769997,0cyclictest0-21swapper/007:14:410
110769990,0cyclictest0-21swapper/008:31:480
11005090,0irq/25-eth020-21ksoftirqd/110:40:201
11005090,0irq/25-eth020-21ksoftirqd/109:38:111
11005090,0irq/25-eth00-21swapper/011:40:490
11005090,0irq/25-eth00-21swapper/010:26:180
11005090,0irq/25-eth00-21swapper/009:18:500
4180,0ktimersoftd/00-21swapper/007:40:410
11795080,0irq/26-eth1-rx-0-21swapper/007:15:220
110799981,0cyclictest2423-21sadc08:00:013
110799980,0cyclictest19004-21munin-node08:35:173
110799980,0cyclictest0-21swapper/308:20:253
110789988,0cyclictest0-21swapper/208:35:542
110789988,0cyclictest0-21swapper/207:43:592
110789980,0cyclictest0-21swapper/209:50:232
110779988,0cyclictest0-21swapper/108:12:301
110769988,0cyclictest0-21swapper/008:09:240
110769988,0cyclictest0-21swapper/008:03:550
110769988,0cyclictest0-21swapper/007:25:280
110769980,0cyclictest0-21swapper/012:10:220
110769980,0cyclictest0-21swapper/008:15:200
11005080,0irq/25-eth02686-21diskmemload12:06:422
11005080,0irq/25-eth020-21ksoftirqd/110:51:461
11005080,0irq/25-eth013534-21sshd09:26:502
995070,0irq/24-0000:00:0-21swapper/210:05:202
179970,0migration/14764-21turbostat08:05:011
110799970,0cyclictest26192-21tr08:50:203
110799970,0cyclictest14414-21munin-node08:25:223
110799970,0cyclictest0-21swapper/309:00:213
110789977,0cyclictest0-21swapper/207:31:112
110789970,0cyclictest0-21swapper/209:04:072
110779977,0cyclictest0-21swapper/109:04:541
110779977,0cyclictest0-21swapper/107:13:441
110769977,0cyclictest0-21swapper/008:42:020
110769974,0cyclictest0-21swapper/007:20:230
110769973,0cyclictest0-21swapper/008:25:320
110769970,0cyclictest0-21swapper/009:00:270
110769970,0cyclictest0-21swapper/008:50:250
11005070,0irq/25-eth09095-21sshd10:32:022
110789966,0cyclictest0-21swapper/208:48:482
110789966,0cyclictest0-21swapper/208:30:122
110789965,0cyclictest12937-21chrt07:11:552
110789962,0cyclictest0-21swapper/208:00:262
110789962,0cyclictest0-21swapper/207:55:322
110789962,0cyclictest0-21swapper/207:50:222
110789962,0cyclictest0-21swapper/207:35:262
110789962,0cyclictest0-21swapper/207:25:242
110789962,0cyclictest0-21swapper/207:20:262
110779965,0cyclictest32732-21aten_r7power_fr07:55:211
110779962,0cyclictest0-21swapper/107:45:251
110779962,0cyclictest0-21swapper/107:20:241
110769966,0cyclictest0-21swapper/008:20:180
110769966,0cyclictest0-21swapper/007:31:390
110769960,0cyclictest0-21swapper/007:55:310
110769960,0cyclictest0-21swapper/007:35:550
11005060,0irq/25-eth00-21swapper/007:50:180
110779950,0cyclictest0-21swapper/108:50:031
110769950,0cyclictest74372sleep008:10:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional