You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-10-22 - 02:02

Intel(R) Core(TM) i5 CPU 750 @ 2.67GHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #8, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack8slot3.osadl.org (updated Thu Oct 21, 2021 12:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
185142180162,14sleep10-21swapper/107:09:201
181892179108,66sleep30-21swapper/307:05:363
184182170154,12sleep20-21swapper/207:08:132
182832170108,58sleep00-21swapper/007:06:410
2374621180,4sleep30-21swapper/308:40:153
174132930,6sleep30-21swapper/308:25:133
280142910,6sleep30-21swapper/309:35:183
124482870,4sleep30-21swapper/309:19:043
1881899314,16cyclictest0-21swapper/211:39:262
1881899306,23cyclictest0-21swapper/211:21:492
1881899305,24cyclictest0-21swapper/212:30:592
1881899305,24cyclictest0-21swapper/211:07:392
1881899304,25cyclictest0-21swapper/212:14:402
1881799304,25cyclictest0-21swapper/109:38:141
1881799303,26cyclictest0-21swapper/108:48:301
1881799293,25cyclictest0-21swapper/112:18:431
1881799293,25cyclictest0-21swapper/112:10:211
1881799293,25cyclictest0-21swapper/110:12:161
1881799293,25cyclictest0-21swapper/108:33:031
1881799293,25cyclictest0-21swapper/107:50:381
1881899288,19cyclictest0-21swapper/210:29:402
18818992814,13cyclictest0-21swapper/211:31:532
18818992811,16cyclictest0-21swapper/208:30:262
1881799284,23cyclictest0-21swapper/109:48:161
3232522715,10sleep30-21swapper/311:20:123
1881899277,19cyclictest0-21swapper/212:03:012
1881899275,21cyclictest0-21swapper/211:59:432
1881899275,21cyclictest0-21swapper/210:13:462
1881899272,24cyclictest0-21swapper/210:31:142
18818992714,11cyclictest0-21swapper/212:05:292
18818992712,14cyclictest0-21swapper/211:02:372
1881799274,22cyclictest0-21swapper/112:02:471
1881799274,22cyclictest0-21swapper/111:58:391
1881799274,22cyclictest0-21swapper/110:15:281
1881799274,22cyclictest0-21swapper/108:23:001
1881799274,22cyclictest0-21swapper/107:10:321
1881799273,23cyclictest0-21swapper/112:28:451
1881799273,23cyclictest0-21swapper/111:51:241
1881799273,23cyclictest0-21swapper/111:08:201
1881799273,23cyclictest0-21swapper/110:26:391
1881799273,23cyclictest0-21swapper/109:25:341
1881799273,23cyclictest0-21swapper/109:18:111
1881799273,23cyclictest0-21swapper/109:05:281
1881899269,17cyclictest0-21swapper/209:12:202
1881899268,17cyclictest0-21swapper/209:28:582
1881899267,19cyclictest0-21swapper/209:50:112
1881899265,20cyclictest0-21swapper/212:24:182
1881899265,20cyclictest0-21swapper/212:17:162
1881899265,20cyclictest0-21swapper/211:46:152
1881899264,21cyclictest0-21swapper/210:01:442
18818992617,8cyclictest0-21swapper/209:03:392
18818992615,10cyclictest0-21swapper/212:27:152
18818992615,10cyclictest0-21swapper/211:40:332
18818992615,10cyclictest0-21swapper/210:05:422
18818992615,10cyclictest0-21swapper/209:55:412
18818992615,10cyclictest0-21swapper/209:45:222
18818992615,10cyclictest0-21swapper/209:35:362
18818992615,10cyclictest0-21swapper/208:09:332
18818992615,10cyclictest0-21swapper/208:03:542
18818992615,10cyclictest0-21swapper/207:57:522
1881799267,18cyclictest0-21swapper/109:40:381
1881799266,19cyclictest0-21swapper/111:13:311
1881799266,19cyclictest0-21swapper/110:40:261
1881799265,21cyclictest0-21swapper/107:32:061
1881799264,21cyclictest0-21swapper/112:38:221
1881799262,23cyclictest0-21swapper/112:08:411
1881799262,23cyclictest0-21swapper/111:21:051
1881799262,23cyclictest0-21swapper/108:05:251
2243622515,8sleep30-21swapper/309:29:343
2065522515,9sleep30-21swapper/307:14:593
1881899256,18cyclictest0-21swapper/209:40:292
1881899255,19cyclictest0-21swapper/211:25:072
1881899255,19cyclictest0-21swapper/211:16:302
1881899252,22cyclictest0-21swapper/209:33:562
18818992515,9cyclictest0-21swapper/212:35:292
18818992515,9cyclictest0-21swapper/211:51:382
18818992515,9cyclictest0-21swapper/211:10:282
18818992515,9cyclictest0-21swapper/210:50:152
18818992515,9cyclictest0-21swapper/210:45:582
18818992515,9cyclictest0-21swapper/210:44:012
18818992515,9cyclictest0-21swapper/210:22:292
18818992515,9cyclictest0-21swapper/210:15:252
18818992515,9cyclictest0-21swapper/209:15:242
18818992515,9cyclictest0-21swapper/208:55:192
18818992515,9cyclictest0-21swapper/208:45:482
18818992515,9cyclictest0-21swapper/207:25:262
18818992515,10cyclictest0-21swapper/207:15:222
18818992514,10cyclictest0-21swapper/208:35:312
18818992513,11cyclictest0-21swapper/210:37:272
18818992512,12cyclictest0-21swapper/210:57:342
1881799257,17cyclictest0-21swapper/110:38:251
1881799256,18cyclictest0-21swapper/110:03:271
1881799252,22cyclictest0-21swapper/109:53:511
1881799252,22cyclictest0-21swapper/108:35:191
18817992512,12cyclictest0-21swapper/108:15:171
18819992415,8cyclictest3328-21sleep09:14:553
18819992415,8cyclictest299432sleep312:24:493
18819992415,8cyclictest148562sleep311:00:503
18819992413,9cyclictest19176-21taskset09:59:373
1881899244,19cyclictest0-21swapper/209:20:032
18818992416,7cyclictest0-21swapper/208:15:172
18818992415,9cyclictest0-21swapper/208:25:252
18818992414,9cyclictest0-21swapper/207:45:132
18818992414,9cyclictest0-21swapper/207:40:242
18818992413,10cyclictest0-21swapper/207:35:162
18818992413,10cyclictest0-21swapper/207:10:232
1881799245,18cyclictest0-21swapper/111:02:071
1881799244,19cyclictest0-21swapper/112:31:141
1881799244,19cyclictest0-21swapper/110:55:361
18817992415,8cyclictest0-21swapper/111:48:351
18817992415,8cyclictest0-21swapper/111:37:441
18817992415,8cyclictest0-21swapper/110:45:121
18817992415,8cyclictest0-21swapper/110:30:161
18817992415,8cyclictest0-21swapper/109:55:311
18817992415,8cyclictest0-21swapper/109:30:131
1410722415,7sleep30-21swapper/312:07:383
128122416,6sleep30-21swapper/312:28:123
1881999239,13cyclictest0-21swapper/310:30:143
1881999237,15cyclictest0-21swapper/312:02:593
1881999236,16cyclictest0-21swapper/311:08:333
1881999235,17cyclictest0-21swapper/312:34:453
1881999235,17cyclictest0-21swapper/310:26:423
1881999234,18cyclictest0-21swapper/311:17:013
18819992315,7cyclictest89712sleep310:21:253
18819992315,7cyclictest45712sleep309:44:283
18819992315,7cyclictest3552sleep307:43:053
18819992315,7cyclictest248242sleep309:30:473
18819992315,7cyclictest245432sleep310:38:113
18819992315,7cyclictest197382sleep310:00:103
18819992315,7cyclictest0-21swapper/311:53:593
18819992315,7cyclictest0-21swapper/311:40:293
18819992315,7cyclictest0-21swapper/310:56:003
18819992315,7cyclictest0-21swapper/310:48:103
18819992315,7cyclictest0-21swapper/310:10:443
18819992315,7cyclictest0-21swapper/308:12:433
18819992314,8cyclictest299252sleep310:44:033
18819992314,8cyclictest263942sleep311:13:473
18819992314,8cyclictest24992sleep311:55:293
18818992315,7cyclictest0-21swapper/209:05:362
18818992315,7cyclictest0-21swapper/208:40:212
18818992315,7cyclictest0-21swapper/208:20:142
18818992315,7cyclictest0-21swapper/208:10:142
18818992315,7cyclictest0-21swapper/207:50:142
18818992315,7cyclictest0-21swapper/207:30:212
18818992315,7cyclictest0-21swapper/207:20:152
18818992313,9cyclictest0-21swapper/208:50:272
1881799235,17cyclictest0-21swapper/110:50:201
1881799235,17cyclictest0-21swapper/107:47:031
18817992315,8cyclictest0-21swapper/112:20:151
18817992315,8cyclictest0-21swapper/111:30:151
18817992315,8cyclictest0-21swapper/109:21:441
18817992315,8cyclictest0-21swapper/108:40:461
18817992315,8cyclictest0-21swapper/108:00:281
18817992315,8cyclictest0-21swapper/107:55:261
18817992315,8cyclictest0-21swapper/107:25:241
18817992314,8cyclictest0-21swapper/111:25:211
18817992314,8cyclictest0-21swapper/111:16:331
18817992314,8cyclictest0-21swapper/110:23:001
18817992314,8cyclictest0-21swapper/109:10:211
1654422314,7sleep30-21swapper/311:36:143
1212022315,6sleep30-21swapper/309:51:133
3131722214,7sleep30-21swapper/308:57:153
1881999225,16cyclictest0-21swapper/311:30:133
1881999225,16cyclictest0-21swapper/311:26:003
1881999225,16cyclictest0-21swapper/309:24:483
1881999225,16cyclictest0-21swapper/307:20:253
1881999224,17cyclictest0-21swapper/312:12:203
1881999223,18cyclictest0-21swapper/310:51:163
18819992214,7cyclictest286102sleep307:32:003
18819992214,7cyclictest223862sleep307:16:153
18819992214,7cyclictest147302sleep308:15:413
18819992214,7cyclictest110872sleep312:38:093
18819992214,7cyclictest0-21swapper/311:46:453
18819992214,7cyclictest0-21swapper/310:15:463
18819992210,11cyclictest0-21swapper/312:16:243
1881799224,17cyclictest0-21swapper/108:55:231
1881799224,17cyclictest0-21swapper/107:17:471
18817992215,6cyclictest0-21swapper/108:14:581
18817992213,8cyclictest0-21swapper/111:40:261
18817992213,8cyclictest0-21swapper/110:05:061
18817992213,8cyclictest0-21swapper/108:50:351
1711622214,7sleep30-21swapper/308:24:273
1015622214,7sleep30-21swapper/308:05:243
2724922114,6sleep30-21swapper/308:47:503
2462722115,4sleep30-21swapper/310:05:163
245722113,7sleep30-21swapper/307:48:153
1945722115,5sleep30-21swapper/308:30:083
1881999214,16cyclictest0-21swapper/309:46:563
1881999214,16cyclictest0-21swapper/308:38:203
1881999213,17cyclictest0-21swapper/307:59:033
18819992113,7cyclictest8012sleep309:00:543
18819992113,7cyclictest45542sleep307:51:543
18819992113,7cyclictest29992sleep309:06:403
1881799213,17cyclictest0-21swapper/107:40:261
1881799213,17cyclictest0-21swapper/107:35:231
1881799212,18cyclictest0-21swapper/109:00:171
18817992114,6cyclictest0-21swapper/107:20:291
18817992113,8cyclictest0-21swapper/108:25:211
18816992115,5cyclictest0-21swapper/010:39:550
2920422015,4sleep30-21swapper/308:51:373
2646622015,4sleep30-21swapper/307:26:003
1881999203,16cyclictest0-21swapper/308:01:013
18819992012,7cyclictest306502sleep307:36:533
18816992014,5cyclictest21034-21sleep08:33:040
1881699199,8cyclictest24024-21kworker/0:110:52:170
1881699194,14cyclictest24024-21kworker/0:111:30:240
1881699193,15cyclictest0-21swapper/012:10:110
1881699193,14cyclictest24024-21kworker/0:110:00:110
18816991915,3cyclictest3325-21diskmemload10:14:570
18816991915,3cyclictest2948-21crond11:17:000
18816991915,3cyclictest2858-21lldpd11:37:580
18816991912,7cyclictest0-21swapper/009:37:280
1881699182,15cyclictest0-21swapper/011:11:360
1881699182,14cyclictest24024-21kworker/0:109:11:400
18816991816,2cyclictest0-21swapper/012:05:300
18816991815,2cyclictest99632sleep010:55:420
18816991815,2cyclictest79092sleep011:27:460
18816991815,2cyclictest2948-21crond11:07:000
18816991815,2cyclictest2948-21crond08:12:000
18816991815,2cyclictest274652sleep012:20:570
18816991815,2cyclictest246952sleep007:24:090
18816991815,2cyclictest232812sleep012:16:560
18816991815,2cyclictest19342sleep011:21:130
18816991815,2cyclictest163172sleep009:22:350
18816991815,2cyclictest134362sleep010:25:540
18816991814,3cyclictest3325-21diskmemload11:45:420
18816991814,3cyclictest23194-21cpuspeed_turbos09:30:110
18816991814,3cyclictest103602sleep012:37:020
1881699178,8cyclictest19055-21kworker/0:212:01:190
1881699176,10cyclictest0-21swapper/010:08:050
1881699172,13cyclictest19055-21kworker/0:212:30:570
18816991715,2cyclictest0-21swapper/012:27:560
18816991715,2cyclictest0-21swapper/011:57:170
18816991715,2cyclictest0-21swapper/011:50:430
18816991715,2cyclictest0-21swapper/010:31:020
18816991715,2cyclictest0-21swapper/009:27:140
18816991715,2cyclictest0-21swapper/009:15:440
18816991715,2cyclictest0-21swapper/009:09:070
18816991715,2cyclictest0-21swapper/008:55:070
18816991715,2cyclictest0-21swapper/008:44:360
18816991714,2cyclictest2948-21crond10:45:000
18816991714,2cyclictest23572sleep009:41:160
18816991714,2cyclictest190522sleep008:28:030
18816991714,2cyclictest114752sleep009:50:380
18816991713,3cyclictest9031-21latency_hist08:05:000
18816991713,3cyclictest3325-21diskmemload10:16:210
18816991713,3cyclictest2948-21crond07:57:000
18816991712,4cyclictest0-21swapper/007:35:170
1881699171,14cyclictest24024-21kworker/0:111:00:360
1881699171,14cyclictest24024-21kworker/0:109:55:230
18816991710,6cyclictest223652sleep007:16:040
1881699169,6cyclictest24024-21kworker/0:110:45:020
1881699168,7cyclictest24024-21kworker/0:110:20:570
1881699164,10cyclictest24024-21kworker/0:111:40:170
1881699162,12cyclictest24024-21kworker/0:109:45:040
18816991614,2cyclictest0-21swapper/009:00:420
18816991614,2cyclictest0-21swapper/008:08:480
18816991614,2cyclictest0-21swapper/007:28:200
18816991614,2cyclictest0-21swapper/007:12:180
18816991613,2cyclictest46432sleep007:52:550
18816991613,2cyclictest3772sleep007:43:220
18816991613,2cyclictest272362sleep008:47:390
18816991613,2cyclictest24732sleep007:48:240
18816991612,3cyclictest270492sleep007:30:040
18816991612,3cyclictest2569-21hald-addon-acpi08:36:550
1881699152,12cyclictest0-21swapper/008:50:580
18816991513,2cyclictest0-21swapper/008:18:090
1679721511,3sleep00-21swapper/008:20:480
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional