You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2022-01-17 - 01:37

Intel(R) Core(TM) i5 CPU 750 @ 2.67GHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #8, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the alll highest latencies:
System rack8slot3.osadl.org (updated Sun Jan 16, 2022 12:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
248452230212,14sleep20-21swapper/207:09:582
245072186105,77sleep00-21swapper/007:06:070
230162185105,75sleep30-21swapper/307:05:103
246872177159,14sleep10-21swapper/107:08:141
1025321120,3sleep12509499cyclictest09:46:021
128542890,1sleep00-21swapper/011:40:290
2509499434,38cyclictest0-21swapper/111:10:201
2509499422,39cyclictest0-21swapper/108:35:241
2509499405,34cyclictest0-21swapper/109:05:231
2509499397,31cyclictest0-21swapper/109:30:241
2509499396,32cyclictest0-21swapper/111:25:241
2509499396,32cyclictest0-21swapper/111:25:241
2509499393,35cyclictest0-21swapper/111:40:211
2509499388,30cyclictest0-21swapper/108:20:301
2509499382,35cyclictest0-21swapper/107:35:241
2509499373,33cyclictest0-21swapper/110:30:221
2509499365,30cyclictest0-21swapper/110:05:231
2509599355,29cyclictest0-21swapper/211:28:422
2509599355,29cyclictest0-21swapper/211:28:422
2509499354,30cyclictest0-21swapper/111:23:511
2509499353,32cyclictest0-21swapper/111:55:251
2509499353,31cyclictest0-21swapper/107:55:271
2509499352,32cyclictest0-21swapper/109:35:221
2509499352,32cyclictest0-21swapper/109:15:271
2509599349,24cyclictest0-21swapper/211:20:092
2509599346,27cyclictest0-21swapper/212:35:212
2509599346,27cyclictest0-21swapper/212:10:212
25094993415,18cyclictest0-21swapper/111:07:071
2509599337,25cyclictest0-21swapper/211:58:242
2509599335,27cyclictest0-21swapper/211:51:522
2509599335,27cyclictest0-21swapper/208:20:302
2509599334,28cyclictest0-21swapper/210:20:232
2509499338,25cyclictest0-21swapper/111:15:431
2509499335,27cyclictest0-21swapper/110:50:111
2509499333,29cyclictest0-21swapper/108:58:071
2509499332,30cyclictest0-21swapper/112:35:441
2509499332,30cyclictest0-21swapper/110:20:221
25094993318,14cyclictest0-21swapper/111:53:021
2509599327,24cyclictest0-21swapper/211:35:462
2509599325,26cyclictest0-21swapper/212:24:402
2509599323,28cyclictest0-21swapper/209:15:552
2509499329,22cyclictest0-21swapper/112:19:451
2509499323,28cyclictest0-21swapper/110:36:461
2509499323,28cyclictest0-21swapper/109:12:551
2509499322,29cyclictest0-21swapper/112:27:411
2509499322,29cyclictest0-21swapper/112:04:151
2813623117,12sleep30-21swapper/311:21:033
2509599319,20cyclictest0-21swapper/210:49:532
2509599317,23cyclictest0-21swapper/211:10:462
2509599315,25cyclictest0-21swapper/212:30:032
2509599315,25cyclictest0-21swapper/209:22:392
2509599315,24cyclictest0-21swapper/210:15:302
2509599314,26cyclictest0-21swapper/210:55:242
2509599314,26cyclictest0-21swapper/208:30:242
2509599313,27cyclictest0-21swapper/210:37:112
2509599313,27cyclictest0-21swapper/209:43:102
2509599313,27cyclictest0-21swapper/208:35:242
2509499318,23cyclictest0-21swapper/112:24:441
2509499316,24cyclictest0-21swapper/112:05:591
2509499316,24cyclictest0-21swapper/111:00:511
2509499315,25cyclictest0-21swapper/110:48:051
2509499315,25cyclictest0-21swapper/110:44:451
2509499315,25cyclictest0-21swapper/108:45:201
2509499314,26cyclictest0-21swapper/111:36:541
2509499314,26cyclictest0-21swapper/111:31:491
2509499314,26cyclictest0-21swapper/110:28:261
2509499313,27cyclictest0-21swapper/112:11:381
2509499313,27cyclictest0-21swapper/110:18:161
2509699307,22cyclictest0-21swapper/309:46:293
2509599309,21cyclictest0-21swapper/212:00:182
2509599307,23cyclictest0-21swapper/210:06:342
2509599307,22cyclictest0-21swapper/209:55:132
2509599306,23cyclictest0-21swapper/211:06:212
2509599306,23cyclictest0-21swapper/210:54:582
2509599306,23cyclictest0-21swapper/210:26:052
2509599305,24cyclictest0-21swapper/212:27:002
2509599305,24cyclictest0-21swapper/211:16:122
2509599305,24cyclictest0-21swapper/209:54:412
2509599305,24cyclictest0-21swapper/209:28:062
2509599305,23cyclictest0-21swapper/211:49:562
2509599304,25cyclictest0-21swapper/211:43:132
2509599304,25cyclictest0-21swapper/207:35:242
2509599303,26cyclictest0-21swapper/208:45:202
25095993013,16cyclictest0-21swapper/211:03:552
25095993011,18cyclictest0-21swapper/210:40:112
2509499307,22cyclictest0-21swapper/111:47:511
2509499305,24cyclictest0-21swapper/112:32:161
2509499305,24cyclictest0-21swapper/109:53:311
2509499305,24cyclictest0-21swapper/109:27:451
2509499304,25cyclictest0-21swapper/109:44:351
2509499302,27cyclictest0-21swapper/110:13:341
2509499302,27cyclictest0-21swapper/108:30:241
420722916,12sleep30-21swapper/312:09:043
2509699296,22cyclictest0-21swapper/309:34:483
2509599298,20cyclictest0-21swapper/212:06:422
2509599296,22cyclictest0-21swapper/209:36:022
2509599295,23cyclictest0-21swapper/210:31:542
2509599294,24cyclictest0-21swapper/210:11:562
2509599294,24cyclictest0-21swapper/209:12:052
2509599293,25cyclictest0-21swapper/209:30:362
2509599293,25cyclictest0-21swapper/209:05:232
25095992912,16cyclictest0-21swapper/211:32:552
25095992910,19cyclictest0-21swapper/212:16:082
2509499296,22cyclictest0-21swapper/110:00:091
2509499295,23cyclictest0-21swapper/110:58:441
2509499293,25cyclictest0-21swapper/109:55:011
2509499292,26cyclictest0-21swapper/107:30:251
299362280,7sleep30-21swapper/310:45:403
2509699281,26cyclictest0-21swapper/309:15:563
2509599288,19cyclictest0-21swapper/210:00:372
2509599287,20cyclictest0-21swapper/209:47:052
2509599284,23cyclictest0-21swapper/208:55:252
2509599283,23cyclictest0-21swapper/207:45:362
2509499286,21cyclictest0-21swapper/109:24:391
2509699279,17cyclictest0-21swapper/311:37:323
2509699278,18cyclictest0-21swapper/311:27:163
2509699278,18cyclictest0-21swapper/311:27:163
25096992717,9cyclictest190692sleep308:11:153
25096992716,10cyclictest97052sleep309:08:543
25096992715,11cyclictest245152sleep312:31:313
25096992715,11cyclictest208852sleep309:59:363
25096992715,11cyclictest149922sleep311:44:293
2509599274,22cyclictest0-21swapper/208:00:242
2509599273,23cyclictest0-21swapper/209:00:272
25095992715,11cyclictest0-21swapper/208:50:142
25095992715,11cyclictest0-21swapper/207:40:222
25095992713,13cyclictest0-21swapper/207:55:202
2509499272,24cyclictest0-21swapper/108:05:301
2509699268,17cyclictest0-21swapper/311:34:003
2509699268,17cyclictest0-21swapper/310:43:113
2509699266,19cyclictest0-21swapper/311:51:523
2509699263,22cyclictest0-21swapper/309:43:113
2509699262,23cyclictest0-21swapper/312:13:283
2509699262,23cyclictest0-21swapper/310:10:283
25096992616,9cyclictest317322sleep308:44:433
25096992616,9cyclictest141722sleep311:05:213
25096992616,9cyclictest109242sleep307:52:283
25096992616,9cyclictest107172sleep311:00:473
25096992616,9cyclictest0-21swapper/310:21:153
25096992616,9cyclictest0-21swapper/309:20:523
25096992615,10cyclictest76962sleep309:04:253
25096992615,10cyclictest46442sleep307:36:183
25096992615,10cyclictest41922sleep310:16:183
25096992615,10cyclictest288912sleep310:08:173
25096992615,10cyclictest275002sleep308:33:253
25096992615,10cyclictest173932sleep310:31:363
25096992615,10cyclictest171442sleep308:07:503
25096992615,10cyclictest132042sleep307:59:573
25096992615,10cyclictest11732sleep309:35:403
25096992615,10cyclictest0-21swapper/310:03:083
25096992614,11cyclictest275862sleep311:58:473
25096992611,14cyclictest0-21swapper/311:49:563
25096992611,14cyclictest0-21swapper/310:59:133
2509599269,16cyclictest0-21swapper/207:16:102
2509599264,21cyclictest0-21swapper/207:33:172
2509599263,22cyclictest0-21swapper/208:17:022
2509599262,14cyclictest0-21swapper/208:10:222
25095992615,10cyclictest0-21swapper/208:05:272
2509499263,22cyclictest0-21swapper/107:25:301
25094992617,8cyclictest0-21swapper/107:50:281
2509699252,22cyclictest0-21swapper/308:25:323
25096992516,8cyclictest309392sleep307:23:423
25096992516,8cyclictest0-21swapper/310:35:123
25096992515,9cyclictest214332sleep308:19:483
25096992515,9cyclictest160602sleep309:53:393
25096992515,9cyclictest0-21swapper/312:03:563
25096992515,9cyclictest0-21swapper/309:13:383
25096992514,10cyclictest37752sleep310:54:063
25096992514,10cyclictest297262sleep312:38:123
25096992513,11cyclictest87152sleep307:45:493
25096992513,11cyclictest294812sleep308:37:343
25096992513,11cyclictest204222sleep312:26:583
25096992513,11cyclictest124632sleep310:25:343
25096992512,12cyclictest11062sleep308:46:593
25096992510,13cyclictest21944-21taskset11:15:083
2509599253,21cyclictest0-21swapper/207:25:232
2509599252,22cyclictest0-21swapper/208:40:222
25095992513,11cyclictest0-21swapper/207:50:202
25095992511,13cyclictest0-21swapper/207:20:262
25094992518,6cyclictest0-21swapper/108:25:221
25094992516,8cyclictest0-21swapper/108:50:131
25094992516,8cyclictest0-21swapper/108:15:251
25094992516,8cyclictest0-21swapper/107:40:261
25094992516,8cyclictest0-21swapper/107:20:191
25094992516,8cyclictest0-21swapper/107:10:261
25094992515,9cyclictest0-21swapper/108:01:521
2509699246,17cyclictest0-21swapper/311:10:293
25096992415,8cyclictest0-21swapper/309:28:133
25096992414,9cyclictest268482sleep307:13:573
25096992414,9cyclictest0-21swapper/308:00:143
25096992414,9cyclictest0-21swapper/307:15:183
25096992413,10cyclictest232712sleep308:22:123
25096992412,11cyclictest162432sleep312:22:183
25096992412,11cyclictest0-21swapper/312:15:193
25095992411,12cyclictest0-21swapper/208:25:202
25094992417,6cyclictest0-21swapper/107:45:521
25094992417,6cyclictest0-21swapper/107:15:161
25094992415,8cyclictest0-21swapper/108:40:221
25094992415,8cyclictest0-21swapper/108:10:241
25094992413,10cyclictest0-21swapper/109:00:001
25093992415,2cyclictest0-21swapper/008:04:350
2509699239,13cyclictest68162sleep307:42:353
25096992316,6cyclictest0-21swapper/308:55:433
25096992315,7cyclictest0-21swapper/307:25:313
25096992312,10cyclictest32702sleep308:52:163
25096992311,11cyclictest0-21swapper/307:30:043
25095992313,10cyclictest0-21swapper/207:10:102
25093992315,7cyclictest0-21swapper/010:28:130
25093992215,6cyclictest0-21swapper/009:51:020
25093992215,6cyclictest0-21swapper/009:09:590
25093992215,4cyclictest0-21swapper/012:35:560
25093992117,3cyclictest18286-21sh11:10:140
25093992116,3cyclictest16509-21sh12:22:470
25093992114,6cyclictest0-21swapper/012:16:300
25093992016,3cyclictest25426-21sh09:26:340
25093992015,4cyclictest8402-21sh10:59:280
25093992015,4cyclictest27891-21ssh10:44:520
25093992015,4cyclictest0-21swapper/012:14:520
25093992015,4cyclictest0-21swapper/011:48:560
25093992015,4cyclictest0-21swapper/011:26:250
25093992015,4cyclictest0-21swapper/011:26:250
25093992015,4cyclictest0-21swapper/010:22:180
25093992015,4cyclictest0-21swapper/010:19:580
25093992015,4cyclictest0-21swapper/009:47:360
25093992015,4cyclictest0-21swapper/009:41:190
25093992015,4cyclictest0-21swapper/009:36:450
25093992015,4cyclictest0-21swapper/009:18:560
25093992015,4cyclictest0-21swapper/007:43:300
25093992015,3cyclictest2904-21qpidd07:48:070
25093992015,3cyclictest28271-21smartctl09:30:190
25093992014,5cyclictest0-21swapper/009:55:240
25093992014,5cyclictest0-21swapper/009:10:580
25093992014,5cyclictest0-21swapper/008:18:160
25093992013,6cyclictest5182sleep010:12:500
25093991916,3cyclictest25092-21cyclictest11:32:280
25093991915,3cyclictest4449-21smartctl08:55:200
25093991915,3cyclictest4278-21rm12:09:120
25093991915,3cyclictest32593-21smartctl08:45:150
25093991915,3cyclictest3245-21libvirtd07:31:030
25093991915,3cyclictest30116-21uptime12:00:290
25093991915,3cyclictest289632sleep007:19:410
25093991915,3cyclictest28215-21tune2fs08:35:180
25093991915,3cyclictest27522-21sshd08:33:390
25093991915,3cyclictest24200-21ssh10:02:460
25093991915,3cyclictest24020-21sh11:16:220
25093991915,3cyclictest21809-21ssh10:36:460
25093991915,3cyclictest21498-21diskmemload11:50:340
25093991915,3cyclictest18793-21sh09:20:040
25093991915,3cyclictest17983-21ssh12:25:030
25093991915,3cyclictest12086-21irqstats07:55:230
25093991915,3cyclictest10018-21iostat07:50:220
25093991915,3cyclictest0-21swapper/012:30:490
25093991915,3cyclictest0-21swapper/011:55:170
25093991915,3cyclictest0-21swapper/011:36:370
25093991915,3cyclictest0-21swapper/011:21:470
25093991915,3cyclictest0-21swapper/011:05:140
25093991915,3cyclictest0-21swapper/011:00:560
25093991915,3cyclictest0-21swapper/010:51:140
25093991915,3cyclictest0-21swapper/010:45:100
25093991915,3cyclictest0-21swapper/010:30:130
25093991915,3cyclictest0-21swapper/010:05:180
25093991915,3cyclictest0-21swapper/009:00:260
25093991915,3cyclictest0-21swapper/007:36:540
25093991915,3cyclictest0-21swapper/007:25:010
25093991915,3cyclictest0-21swapper/007:10:250
25093991815,2cyclictest0-21swapper/008:05:210
25093991815,2cyclictest0-21swapper/007:28:090
25093991814,3cyclictest30914-21nscd08:50:190
25093991814,3cyclictest30615-21munin-node08:40:190
25093991814,3cyclictest25395-21pgrep08:27:530
25093991814,3cyclictest23175-21runrttasks08:21:050
25093991814,3cyclictest18422-21ls08:10:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional