You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-09-30 - 17:27
/usr/bin/Xorg /usr/bin/Xorg

x86 Intel Xeon E3-1220L V2 @2300 MHz, Linux 4.4.39-rt50+ (Profile)

Latency plot of system in rack #7, slot #0
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack7slot0.osadl.org (updated Fri Sep 30, 2022 12:45:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110050650,0irq/25-eth00-21swapper/307:06:113
117950640,0irq/26-eth1-rx-0-21swapper/107:05:251
110050590,0irq/25-eth00-21swapper/207:07:102
110050480,0irq/25-eth00-21swapper/007:05:530
110050300,0irq/25-eth00-21swapper/107:10:001
6347992114,0cyclictest30380-21diskmemload11:30:090
6347991812,0cyclictest1452-21nfsd10:49:020
6350991716,0cyclictest0-21swapper/310:42:393
634799169,0cyclictest21349-21sshd09:55:550
634799169,0cyclictest21349-21sshd09:55:540
635099150,0cyclictest0-21swapper/311:38:113
634799157,0cyclictest0-21swapper/011:39:150
634799152,0cyclictest1789-21sshd09:10:180
6347991514,0cyclictest0-21swapper/012:30:470
6350991413,0cyclictest0-21swapper/311:12:443
6350991413,0cyclictest0-21swapper/309:53:453
635099140,0cyclictest0-21swapper/311:34:213
635099140,0cyclictest0-21swapper/309:00:243
6349991413,0cyclictest7569-21sshd09:27:402
6349991413,0cyclictest0-21swapper/210:53:522
6349991411,0cyclictest0-21swapper/211:39:592
6348991414,0cyclictest29290-21sshd09:56:451
6348991414,0cyclictest29290-21sshd09:56:451
634799144,0cyclictest8071-21cp11:59:350
634799144,0cyclictest1102-21sshd11:04:480
6347991413,0cyclictest17697-21sshd11:53:510
634799140,0cyclictest0-21swapper/012:15:180
6350991312,0cyclictest18006-21id12:30:553
6350991312,0cyclictest17147-21cp09:25:173
6350991312,0cyclictest0-21swapper/309:43:113
6349991312,0cyclictest28-21ksoftirqd/211:10:082
6349991312,0cyclictest24021-21sshd11:24:042
6349991312,0cyclictest0-21swapper/211:43:502
634999130,0cyclictest0-21swapper/212:02:592
634999130,0cyclictest0-21swapper/210:16:002
634999130,0cyclictest0-21swapper/209:24:242
6348991312,0cyclictest0-21swapper/112:11:361
6348991312,0cyclictest0-21swapper/111:21:041
6348991311,0cyclictest27390-21bash09:29:461
6348991311,0cyclictest0-21swapper/110:33:261
6348991311,0cyclictest0-21swapper/108:15:121
634799139,0cyclictest0-21swapper/010:51:280
634799138,0cyclictest30380-21diskmemload11:45:150
634799136,0cyclictest9941-21hwlatdetect10:35:150
634799134,0cyclictest19597-21sshd12:00:400
634799134,0cyclictest0-21swapper/010:10:300
634799133,0cyclictest8126-21sshd11:22:220
634799132,0cyclictest23994-21sshd09:39:290
634799132,0cyclictest1512-21sshd09:49:430
6347991312,0cyclictest0-21swapper/010:09:250
6347991311,0cyclictest0-21swapper/012:20:480
634799131,0cyclictest0-21swapper/012:05:230
634799131,0cyclictest0-21swapper/009:28:590
634799130,0cyclictest8367-21id11:05:230
634799130,0cyclictest0-21swapper/012:35:130
634799130,0cyclictest0-21swapper/011:26:540
634799130,0cyclictest0-21swapper/011:10:210
634799130,0cyclictest0-21swapper/010:00:270
634799130,0cyclictest0-21swapper/009:50:450
351130,0ktimersoftd/3478-21jbd2/dm-0-811:21:553
110050130,0irq/25-eth016498-21sshd09:48:453
6350991211,0cyclictest23981-21sshd12:14:473
6350991211,0cyclictest13671-21sshd12:20:213
6350991211,0cyclictest1129-21sshd10:34:243
6350991210,0cyclictest26179-21sshd09:32:573
6350991210,0cyclictest10832-21sshd09:24:423
6350991210,0cyclictest0-21swapper/310:47:183
6350991210,0cyclictest0-21swapper/310:35:483
635099120,0cyclictest0-21swapper/312:25:203
635099120,0cyclictest0-21swapper/312:06:103
635099120,0cyclictest0-21swapper/311:58:513
635099120,0cyclictest0-21swapper/311:17:093
635099120,0cyclictest0-21swapper/311:08:193
635099120,0cyclictest0-21swapper/311:04:023
6349991212,0cyclictest0-21swapper/209:32:052
6349991211,0cyclictest26-21rcuc/212:10:252
6349991211,0cyclictest13655-21sshd09:55:122
6349991211,0cyclictest13655-21sshd09:55:122
6349991211,0cyclictest0-21swapper/212:36:332
6349991211,0cyclictest0-21swapper/212:20:592
6349991211,0cyclictest0-21swapper/210:39:212
6349991210,0cyclictest0-21swapper/211:05:432
6349991210,0cyclictest0-21swapper/209:07:352
634999120,0cyclictest24222-21bash09:52:532
634999120,0cyclictest0-21swapper/212:26:002
634999120,0cyclictest0-21swapper/211:55:402
6348991211,0cyclictest1453-21nfsd11:07:421
6348991211,0cyclictest10774-21sshd09:17:561
6348991211,0cyclictest0-21swapper/111:16:321
6348991211,0cyclictest0-21swapper/110:40:311
6348991211,0cyclictest0-21swapper/109:13:591
6348991210,0cyclictest9950irq/24-0000:00:12:00:551
6348991210,0cyclictest0-21swapper/109:45:001
634799129,0cyclictest0-21swapper/009:33:180
634799125,0cyclictest774-21sshd09:20:150
634799123,0cyclictest32278-21sshd10:24:080
6347991211,0cyclictest17987-21bash09:15:170
6347991211,0cyclictest0-21swapper/008:10:130
6347991211,0cyclictest0-21swapper/007:45:160
6347991210,0cyclictest0-21swapper/012:25:480
6347991210,0cyclictest0-21swapper/010:25:130
6347991210,0cyclictest0-21swapper/007:18:320
634799120,0cyclictest18685-21cp10:32:480
634799120,0cyclictest0-21swapper/012:10:160
634799120,0cyclictest0-21swapper/010:56:050
634799120,0cyclictest0-21swapper/010:19:290
634799120,0cyclictest0-21swapper/008:33:350
110050120,0irq/25-eth012090-21sshd11:26:073
110050120,0irq/25-eth00-21swapper/311:50:093
110050120,0irq/25-eth00-21swapper/310:08:303
6350991111,0cyclictest0-21swapper/312:36:293
6350991110,0cyclictest0-21swapper/310:28:363
6349991111,0cyclictest0-21swapper/209:17:342
6349991111,0cyclictest0-21swapper/208:05:122
6349991110,0cyclictest7100-21bash11:49:232
6349991110,0cyclictest23517-21bash12:07:542
6349991110,0cyclictest20110-21sshd10:32:572
6349991110,0cyclictest14009-21sshd09:41:442
6349991110,0cyclictest0-21swapper/211:18:472
6349991110,0cyclictest0-21swapper/211:02:002
6349991110,0cyclictest0-21swapper/210:57:352
6349991110,0cyclictest0-21swapper/208:46:122
6349991110,0cyclictest0-21swapper/207:21:032
634999110,0cyclictest0-21swapper/209:39:342
634999110,0cyclictest0-21swapper/208:42:432
634999110,0cyclictest0-21swapper/208:16:342
634999110,0cyclictest0-21swapper/208:00:472
6348991111,0cyclictest30380-21diskmemload10:49:351
6348991111,0cyclictest0-21swapper/112:16:351
6348991111,0cyclictest0-21swapper/111:35:141
6348991110,0cyclictest30774-21sshd12:22:101
6348991110,0cyclictest0-21swapper/112:38:541
6348991110,0cyclictest0-21swapper/112:05:191
6348991110,0cyclictest0-21swapper/111:03:581
634899110,0cyclictest0-21swapper/111:27:271
634899110,0cyclictest0-21swapper/109:03:181
634899110,0cyclictest0-21swapper/107:51:311
634799118,0cyclictest0-21swapper/009:00:390
6347991111,0cyclictest0-21swapper/010:40:330
634799111,0cyclictest0-21swapper/011:40:590
634799110,0cyclictest0-21swapper/011:16:030
634799110,0cyclictest0-21swapper/008:15:000
634799110,0cyclictest0-21swapper/007:20:230
41110,0ktimersoftd/00-21swapper/007:50:210
351110,0ktimersoftd/30-21swapper/309:13:403
271110,0ktimersoftd/20-21swapper/211:50:272
271110,0ktimersoftd/20-21swapper/209:13:402
110050110,0irq/25-eth00-21swapper/309:58:173
110050110,0irq/25-eth00-21swapper/309:58:173
635099109,0cyclictest0-21swapper/311:42:363
635099109,0cyclictest0-21swapper/310:50:293
635099109,0cyclictest0-21swapper/309:17:513
6350991010,0cyclictest0-21swapper/312:01:463
6350991010,0cyclictest0-21swapper/307:40:313
635099100,0cyclictest0-21swapper/310:12:403
634999109,0cyclictest29733-21sshd10:40:372
634999109,0cyclictest0-21swapper/212:16:002
6349991010,0cyclictest0-21swapper/212:31:332
6349991010,0cyclictest0-21swapper/211:28:222
6349991010,0cyclictest0-21swapper/208:25:522
6349991010,0cyclictest0-21swapper/207:43:282
634999100,0cyclictest0-21swapper/210:48:102
634999100,0cyclictest0-21swapper/210:28:322
634899109,0cyclictest22423-21sshd11:10:191
634899109,0cyclictest0-21swapper/110:55:391
634899109,0cyclictest0-21swapper/108:00:481
6348991010,0cyclictest0-21swapper/112:33:201
6348991010,0cyclictest0-21swapper/110:24:021
634899100,0cyclictest0-21swapper/111:49:341
634899100,0cyclictest0-21swapper/111:30:491
634899100,0cyclictest0-21swapper/110:54:231
634899100,0cyclictest0-21swapper/108:23:411
634799100,0cyclictest0-21swapper/009:40:190
634799100,0cyclictest0-21swapper/008:25:190
634799100,0cyclictest0-21swapper/008:09:390
634799100,0cyclictest0-21swapper/007:43:100
634799100,0cyclictest0-21swapper/007:35:220
271100,0ktimersoftd/20-21swapper/209:00:232
63509999,0cyclictest0-21swapper/307:38:453
63509998,0cyclictest30624-21open_files12:15:213
63509998,0cyclictest13478-21sshd10:55:503
63509990,0cyclictest0-21swapper/310:01:283
63509990,0cyclictest0-21swapper/307:18:123
63499999,0cyclictest0-21swapper/207:58:422
63499999,0cyclictest0-21swapper/207:15:572
63499998,0cyclictest28-21ksoftirqd/211:30:042
63499998,0cyclictest28-21ksoftirqd/210:13:512
63499998,0cyclictest11690-21bash09:48:152
63499998,0cyclictest1104-21bash10:20:492
63499998,0cyclictest0-21swapper/208:56:052
63489999,0cyclictest5374-21sshd09:34:121
63489999,0cyclictest19355-21sshd12:27:451
63489999,0cyclictest0-21swapper/110:28:131
63489999,0cyclictest0-21swapper/110:15:321
63489999,0cyclictest0-21swapper/108:47:371
63489999,0cyclictest0-21swapper/108:25:261
63489998,0cyclictest18970-21bash09:38:571
63489998,0cyclictest17514-21bash10:02:161
63489998,0cyclictest12263-21sshd10:35:251
63489998,0cyclictest0-21swapper/111:43:291
63489995,0cyclictest0-21swapper/111:50:171
63489993,0cyclictest0-21swapper/108:40:421
63489990,0cyclictest0-21swapper/108:37:581
63489990,0cyclictest0-21swapper/107:26:191
63479999,0cyclictest0-21swapper/008:35:200
63479999,0cyclictest0-21swapper/007:14:010
63479992,0cyclictest0-21swapper/008:50:180
63479992,0cyclictest0-21swapper/008:45:190
63479992,0cyclictest0-21swapper/008:20:180
63479992,0cyclictest0-21swapper/008:00:150
63479992,0cyclictest0-21swapper/007:55:170
63479992,0cyclictest0-21swapper/007:30:180
4190,0ktimersoftd/016596-21munin-node08:40:200
35190,0ktimersoftd/30-21swapper/310:20:163
11795090,0irq/26-eth1-rx-0-21swapper/111:55:311
11005090,0irq/25-eth01598-21ntp_states11:45:193
63509988,0cyclictest0-21swapper/307:47:293
63509987,0cyclictest0-21swapper/308:55:403
63509987,0cyclictest0-21swapper/307:22:093
63509980,0cyclictest0-21swapper/308:09:193
63499988,0cyclictest0-21swapper/208:24:082
63499987,0cyclictest28-21ksoftirqd/210:05:132
63499987,0cyclictest28-21ksoftirqd/210:01:512
63489988,0cyclictest0-21swapper/107:55:061
63489988,0cyclictest0-21swapper/107:44:181
63489988,0cyclictest0-21swapper/107:31:251
4180,0ktimersoftd/00-21swapper/009:06:390
35180,0ktimersoftd/30-21swapper/309:06:393
19180,0ktimersoftd/10-21swapper/109:06:401
11005080,0irq/25-eth030218-21missed_timers10:10:211
11005080,0irq/25-eth021840-21sshd10:16:123
11005080,0irq/25-eth021440-21sshd09:45:491
11005080,0irq/25-eth017989-21sed09:35:223
63509977,0cyclictest0-21swapper/308:43:563
63509977,0cyclictest0-21swapper/308:38:223
63509977,0cyclictest0-21swapper/307:58:383
63499976,0cyclictest28-21ksoftirqd/208:50:212
63499976,0cyclictest28-21ksoftirqd/207:45:202
63489972,0cyclictest0-21swapper/109:51:471
63479976,0cyclictest0-21swapper/008:59:280
11005070,0irq/25-eth020-21ksoftirqd/109:20:301
11005070,0irq/25-eth00-21swapper/110:06:121
63509966,0cyclictest0-21swapper/308:00:093
63509962,0cyclictest0-21swapper/308:45:193
63509962,0cyclictest0-21swapper/308:30:173
63509962,0cyclictest0-21swapper/307:50:163
63509962,0cyclictest0-21swapper/307:30:183
63509962,0cyclictest0-21swapper/307:10:183
63499965,0cyclictest28-21ksoftirqd/207:25:182
63499962,0cyclictest0-21swapper/208:35:152
63499962,0cyclictest0-21swapper/208:10:172
63499962,0cyclictest0-21swapper/207:50:162
63499962,0cyclictest0-21swapper/207:35:172
63499962,0cyclictest0-21swapper/207:30:172
63499962,0cyclictest0-21swapper/207:10:182
63489966,0cyclictest0-21swapper/107:46:231
63489966,0cyclictest0-21swapper/107:35:011
63489965,0cyclictest21702-21entropy08:50:141
63489962,0cyclictest0-21swapper/108:30:161
63489962,0cyclictest0-21swapper/108:05:151
63489962,0cyclictest0-21swapper/107:15:171
63479965,0cyclictest1620-21runrttasks07:29:250
11005060,0irq/25-eth00-21swapper/308:12:263
63509950,0cyclictest0-21swapper/308:50:183
63509950,0cyclictest0-21swapper/308:25:163
63509950,0cyclictest0-21swapper/307:25:193
63499951,0cyclictest0-21swapper/208:30:172
63489953,0cyclictest0-21swapper/108:55:051
63489953,0cyclictest0-21swapper/108:10:091
63489953,0cyclictest0-21swapper/107:20:281
11795050,0irq/26-eth1-rx-18432-21kworker/3:008:20:123
11795050,0irq/26-eth1-rx-18432-21kworker/3:008:15:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional