You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-12-07 - 06:04

(undisclosed), Linux 4.9.20-rt16 (Profile)

Latency plot of system in rack #7, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the alll highest latencies:
System rack7slot1.osadl.org (updated Tue Dec 07, 2021 00:45:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
207121400,1sleep216769-21stress00:10:212
25691212459,59sleep30-21swapper/319:07:203
25787211250,57sleep00-21swapper/019:08:300
25761211051,20sleep20-21swapper/219:08:122
25719210845,58sleep10-21swapper/119:07:381
196322840,2sleep216768-21stress22:25:302
2603099476,25cyclictest16767-21stress00:35:430
2603099476,22cyclictest0-21swapper/021:45:450
2603099473,28cyclictest16767-21stress00:11:320
2603099463,33cyclictest14723-21apt-get21:05:130
2603099463,32cyclictest16769-21stress21:43:430
2603099463,29cyclictest8471-21cut19:40:130
26030994617,20cyclictest0-21swapper/000:15:200
26030994617,20cyclictest0-21swapper/000:15:200
2603099453,32cyclictest16769-21stress23:05:240
2603099453,32cyclictest16769-21stress23:05:240
2603099453,27cyclictest16769-21stress21:57:010
2603099452,32cyclictest16767-21stress22:05:200
2603099452,29cyclictest16769-21stress23:28:320
281072440,1sleep216769-21stress21:34:262
2603099443,27cyclictest9405-21irqstats00:25:230
2603099443,27cyclictest9405-21irqstats00:25:220
2603099443,27cyclictest2534-21tail20:35:250
2603099443,26cyclictest16767-21stress22:15:150
2603099443,25cyclictest16769-21stress21:20:150
2603099443,25cyclictest16767-21stress21:32:210
2603099442,32cyclictest16767-21stress21:38:530
2603099442,32cyclictest16767-21stress21:38:520
2603099442,26cyclictest16769-21stress00:32:180
26030994420,21cyclictest0-21swapper/022:45:390
2603099433,32cyclictest23339-21apt-get22:35:190
2603099433,30cyclictest16767-21stress22:50:270
2603099433,27cyclictest14284-21runrttasks21:03:170
2603099433,25cyclictest16767-21stress23:15:220
2603099433,25cyclictest16767-21stress22:31:180
2603099433,25cyclictest16767-21stress22:31:180
2603099432,38cyclictest16767-21stress23:40:180
2603099432,31cyclictest16767-21stress23:36:170
2603099432,31cyclictest16767-21stress23:36:170
2603099432,26cyclictest16767-21stress22:55:160
2603099423,37cyclictest16769-21stress00:06:010
2603099423,35cyclictest24307-21apt-get20:15:170
2603099423,34cyclictest22009-21apt-get20:10:110
2603099423,25cyclictest16769-21stress21:15:420
2603099423,25cyclictest16769-21stress21:15:410
2603099423,25cyclictest16768-21stress21:10:470
2603099423,25cyclictest13483-21sort23:25:010
2603099423,24cyclictest6986-21aten2_r7power_v23:10:180
2603099423,24cyclictest16769-21stress23:01:280
2603099423,24cyclictest16769-21stress23:01:280
2603099423,24cyclictest16767-21stress23:30:440
2603099423,24cyclictest16767-21stress00:02:340
2603099422,25cyclictest16769-21stress23:56:240
2603099422,25cyclictest16769-21stress22:40:240
2603099422,24cyclictest16767-21stress21:25:210
26031994112,26cyclictest0-21swapper/100:35:191
2603099416,23cyclictest16769-21stress00:20:350
2603099415,25cyclictest0-21swapper/020:20:250
2603099415,25cyclictest0-21swapper/019:10:130
2603099415,24cyclictest0-21swapper/019:30:180
2603099414,24cyclictest19444-21modprobe20:05:000
2603099413,36cyclictest16767-21stress22:03:250
2603099413,35cyclictest10641-21sendmail19:45:130
2603099413,34cyclictest31659-21apt-get19:20:110
2603099413,24cyclictest16992-21tune2fs22:20:230
2603099412,24cyclictest16767-21stress23:45:450
2603099405,23cyclictest0-21swapper/020:25:130
2603099405,23cyclictest0-21swapper/020:25:130
2603099404,31cyclictest31193-21apt-get20:30:160
2603099403,33cyclictest15196-21apt-get19:55:120
2603099402,21cyclictest16769-21stress21:50:270
2603099402,21cyclictest16769-21stress21:50:270
265912395,14sleep20-21swapper/220:20:052
2603099395,26cyclictest0-21swapper/020:05:170
2603099395,23cyclictest0-21swapper/019:50:220
2603099393,33cyclictest16769-21stress22:10:360
166802395,14sleep20-21swapper/221:09:592
310442385,11sleep30-21swapper/319:16:193
2603099385,22cyclictest0-21swapper/019:15:120
2603099384,29cyclictest10173-21apt-get20:55:120
2603099383,31cyclictest7918-21apt-get20:50:120
193922385,13sleep20-21swapper/220:04:342
95872375,14sleep30-21swapper/320:51:393
55912375,13sleep20-21swapper/219:32:342
55582375,11sleep10-21swapper/119:32:081
323952370,1sleep116767-21stress21:41:401
280962375,11sleep30-21swapper/319:12:383
26033993712,23cyclictest0-21swapper/320:55:233
2603199376,21cyclictest0-21swapper/100:30:011
2603199376,21cyclictest0-21swapper/100:30:001
2603099374,30cyclictest16769-21stress23:51:150
2603099373,31cyclictest6097-21apt-get19:35:120
2603099373,30cyclictest1528-21apt-get19:25:120
2603099373,29cyclictest5632-21apt-get20:45:100
2603099373,29cyclictest3326-21apt-get20:40:110
145582375,14sleep10-21swapper/119:50:541
78342365,11sleep10-21swapper/119:37:011
6552365,13sleep10-21swapper/120:34:201
26031993613,20cyclictest0-21swapper/121:20:271
2603099363,30cyclictest19992-21python22:25:390
126182365,13sleep10-21swapper/119:49:421
121322365,11sleep20-21swapper/220:59:312
54232355,14sleep30-21swapper/319:30:423
26033993515,17cyclictest0-21swapper/322:10:343
26032993517,16cyclictest0-21swapper/200:19:372
26032993517,16cyclictest0-21swapper/200:19:372
26032993516,16cyclictest0-21swapper/200:22:082
26032993510,23cyclictest0-21swapper/220:15:192
77632345,13sleep30-21swapper/319:36:153
28152344,14sleep30-21swapper/320:37:183
2603399348,24cyclictest0-21swapper/320:00:413
26033993413,19cyclictest0-21swapper/323:25:253
2603299349,22cyclictest0-21swapper/222:24:072
26032993416,15cyclictest0-21swapper/221:50:062
26032993416,15cyclictest0-21swapper/221:50:062
26032993416,15cyclictest0-21swapper/200:25:052
26032993416,15cyclictest0-21swapper/200:25:042
26032993415,17cyclictest0-21swapper/223:15:412
26032993411,19cyclictest0-21swapper/222:31:122
26032993411,19cyclictest0-21swapper/222:31:112
2603199348,20cyclictest0-21swapper/120:16:321
239662344,13sleep30-21swapper/320:14:373
140492345,11sleep20-21swapper/221:00:322
100692345,12sleep20-21swapper/219:41:442
9462335,14sleep10-21swapper/119:22:111
74322335,14sleep10-21swapper/120:47:481
6082334,14sleep30-21swapper/320:33:463
49992335,13sleep20-21swapper/220:41:152
33912335,13sleep20-21swapper/219:28:452
307982335,13sleep10-21swapper/120:29:031
307982335,13sleep10-21swapper/120:29:031
2603399339,21cyclictest0-21swapper/321:46:073
2603399338,22cyclictest0-21swapper/323:58:283
26033993315,16cyclictest0-21swapper/323:34:063
26033993315,16cyclictest0-21swapper/322:25:173
26033993313,18cyclictest0-21swapper/323:41:533
26033993310,21cyclictest0-21swapper/319:56:563
26032993317,13cyclictest0-21swapper/223:43:532
26032993317,13cyclictest0-21swapper/222:15:322
26032993317,13cyclictest0-21swapper/200:30:182
26032993316,15cyclictest0-21swapper/223:23:052
26032993316,14cyclictest0-21swapper/220:35:212
26032993315,16cyclictest0-21swapper/221:13:462
2603199333,20cyclictest0-21swapper/123:35:291
2603199333,20cyclictest0-21swapper/123:35:291
26031993311,19cyclictest0-21swapper/121:30:391
259032334,14sleep30-21swapper/320:15:463
169672335,11sleep20-21swapper/219:57:402
307002325,13sleep20-21swapper/220:27:472
307002325,13sleep20-21swapper/220:27:472
26033993211,18cyclictest0-21swapper/321:15:113
26033993211,18cyclictest0-21swapper/321:15:113
26032993216,13cyclictest0-21swapper/221:45:082
26032993215,15cyclictest0-21swapper/200:06:162
26032993214,15cyclictest0-21swapper/223:00:312
26032993214,15cyclictest0-21swapper/223:00:312
26032993214,15cyclictest0-21swapper/221:20:282
26032993210,19cyclictest0-21swapper/223:45:292
2603199329,20cyclictest0-21swapper/121:35:091
2603199329,20cyclictest0-21swapper/121:35:091
2603199329,16cyclictest0-21swapper/119:29:341
2603199327,15cyclictest0-21swapper/123:07:041
2603199327,15cyclictest0-21swapper/123:07:031
2603199326,23cyclictest0-21swapper/123:55:201
2603199324,15cyclictest0-21swapper/122:07:551
26031993211,18cyclictest0-21swapper/123:50:201
166062325,13sleep10-21swapper/121:09:041
101892325,14sleep10-21swapper/119:43:151
52522314,14sleep30-21swapper/320:44:053
2603399317,22cyclictest0-21swapper/319:47:433
2603399315,24cyclictest0-21swapper/320:05:473
2603399315,24cyclictest0-21swapper/319:53:183
2603399315,24cyclictest0-21swapper/319:26:473
26033993116,13cyclictest0-21swapper/323:50:053
26033993115,13cyclictest0-21swapper/323:46:313
26033993114,15cyclictest0-21swapper/323:00:223
26033993114,15cyclictest0-21swapper/323:00:223
26033993114,15cyclictest0-21swapper/321:35:363
26033993114,15cyclictest0-21swapper/321:35:363
26033993114,14cyclictest0-21swapper/323:15:303
26033993114,14cyclictest0-21swapper/322:50:263
26033993114,14cyclictest0-21swapper/300:00:203
26033993112,17cyclictest0-21swapper/321:25:373
26033993111,18cyclictest0-21swapper/322:39:403
26033993110,19cyclictest0-21swapper/320:45:163
2603299319,19cyclictest0-21swapper/222:55:272
2603299317,21cyclictest0-21swapper/221:40:192
2603299315,24cyclictest0-21swapper/222:13:202
2603299315,24cyclictest0-21swapper/219:45:572
2603299315,24cyclictest0-21swapper/219:12:382
26032993117,12cyclictest0-21swapper/223:55:142
26032993116,14cyclictest0-21swapper/219:20:172
26032993116,13cyclictest0-21swapper/200:00:272
26032993116,12cyclictest0-21swapper/222:45:212
26032993116,12cyclictest0-21swapper/200:35:122
26032993113,15cyclictest0-21swapper/222:37:322
26032993113,15cyclictest0-21swapper/221:56:252
26032993113,15cyclictest0-21swapper/221:39:552
26032993113,15cyclictest0-21swapper/221:39:552
26032993113,15cyclictest0-21swapper/221:15:342
26032993113,15cyclictest0-21swapper/221:15:342
26032993110,19cyclictest0-21swapper/220:46:372
2603199319,17cyclictest0-21swapper/119:15:481
2603199319,17cyclictest0-21swapper/119:13:321
2603199317,21cyclictest0-21swapper/123:42:401
2603199316,22cyclictest0-21swapper/100:15:321
2603199316,22cyclictest0-21swapper/100:15:321
2603199316,18cyclictest0-21swapper/120:20:501
2603199315,24cyclictest0-21swapper/120:08:271
2603199315,14cyclictest0-21swapper/120:56:331
26031993115,14cyclictest0-21swapper/122:45:411
26031993115,14cyclictest0-21swapper/122:20:411
26031993115,14cyclictest0-21swapper/121:15:001
26031993114,15cyclictest0-21swapper/100:02:041
26031993113,15cyclictest0-21swapper/121:17:511
26031993113,15cyclictest0-21swapper/121:17:511
26031993110,15cyclictest0-21swapper/120:10:061
2603399308,19cyclictest0-21swapper/300:15:033
2603399308,19cyclictest0-21swapper/300:15:033
2603399306,22cyclictest0-21swapper/319:20:213
26033993015,12cyclictest0-21swapper/321:55:153
26033993014,14cyclictest0-21swapper/323:05:323
26033993014,14cyclictest0-21swapper/323:05:313
26033993013,15cyclictest0-21swapper/322:30:183
26033993013,15cyclictest0-21swapper/322:30:173
26033993010,18cyclictest0-21swapper/321:10:053
2603299308,19cyclictest0-21swapper/223:30:242
2603299305,23cyclictest0-21swapper/220:31:482
2603299305,23cyclictest0-21swapper/220:10:182
26032993015,13cyclictest0-21swapper/222:05:182
26032993013,15cyclictest0-21swapper/222:00:212
2603199309,15cyclictest0-21swapper/120:40:511
2603199309,12cyclictest16769-21stress21:55:201
2603199307,20cyclictest0-21swapper/123:46:041
2603199306,22cyclictest0-21swapper/100:30:271
2603199305,23cyclictest0-21swapper/121:01:301
2603199305,22cyclictest0-21swapper/121:45:361
2603199305,15cyclictest0-21swapper/120:35:231
26031993014,14cyclictest0-21swapper/122:43:311
26031993014,13cyclictest0-21swapper/122:51:591
26031993010,18cyclictest0-21swapper/122:35:051
191202305,12sleep10-21swapper/120:01:201
165632304,11sleep30-21swapper/321:08:303
146992305,14sleep20-21swapper/219:52:342
2603399299,17cyclictest0-21swapper/322:00:253
26033992915,13cyclictest0-21swapper/319:40:073
26033992915,12cyclictest0-21swapper/321:53:263
26033992915,12cyclictest0-21swapper/321:53:253
26033992915,12cyclictest0-21swapper/300:35:043
26033992915,12cyclictest0-21swapper/300:25:223
26033992915,12cyclictest0-21swapper/300:25:223
26033992914,13cyclictest0-21swapper/323:10:383
26033992914,12cyclictest0-21swapper/321:20:413
26033992914,12cyclictest0-21swapper/300:30:253
26033992913,14cyclictest0-21swapper/323:20:303
26033992913,14cyclictest0-21swapper/322:55:343
26033992911,15cyclictest0-21swapper/322:40:123
2603299295,22cyclictest0-21swapper/220:06:382
26032992913,13cyclictest0-21swapper/223:53:452
2603199295,22cyclictest0-21swapper/120:52:501
26031992913,14cyclictest0-21swapper/123:00:301
26031992913,14cyclictest0-21swapper/123:00:301
26031992913,14cyclictest0-21swapper/122:10:111
26031992913,14cyclictest0-21swapper/100:10:231
26031992910,17cyclictest0-21swapper/123:30:431
26031992910,16cyclictest0-21swapper/122:15:171
2603399288,17cyclictest0-21swapper/321:40:043
2603399285,21cyclictest0-21swapper/321:00:373
2603399285,21cyclictest0-21swapper/320:21:083
26033992815,11cyclictest0-21swapper/322:15:033
2603299286,20cyclictest0-21swapper/221:25:382
2603299285,21cyclictest0-21swapper/219:35:182
2603299285,21cyclictest0-21swapper/219:15:372
2603199288,12cyclictest0-21swapper/119:55:061
26031992813,12cyclictest0-21swapper/123:24:551
26031992812,14cyclictest0-21swapper/100:05:151
26031992810,15cyclictest0-21swapper/122:25:181
2603399279,16cyclictest0-21swapper/300:10:263
2603399278,18cyclictest0-21swapper/320:27:313
2603399278,18cyclictest0-21swapper/320:27:313
2603299277,18cyclictest0-21swapper/222:50:392
2603299276,18cyclictest0-21swapper/223:10:402
2603299275,20cyclictest0-21swapper/220:50:272
26032992712,13cyclictest0-21swapper/222:40:202
2603199277,18cyclictest0-21swapper/123:10:191
2603199276,19cyclictest0-21swapper/122:30:251
2603199276,19cyclictest0-21swapper/122:30:251
2603199276,19cyclictest0-21swapper/121:50:121
2603199276,19cyclictest0-21swapper/121:50:111
26031992713,12cyclictest0-21swapper/121:25:201
26031992711,13cyclictest0-21swapper/100:23:491
2603399266,17cyclictest0-21swapper/322:05:113
26033992612,11cyclictest0-21swapper/323:35:073
26033992612,11cyclictest0-21swapper/323:35:073
272812253,2sleep316766-21stress21:30:393
2603399258,15cyclictest0-21swapper/300:20:253
2603299259,13cyclictest0-21swapper/223:25:322
26032992512,10cyclictest0-21swapper/223:05:172
26032992512,10cyclictest0-21swapper/223:05:162
2603199256,16cyclictest0-21swapper/122:00:281
26031992416,6cyclictest16766-21stress23:16:481
26031992411,11cyclictest0-21swapper/122:55:151
2603299236,15cyclictest0-21swapper/223:35:352
2603299236,15cyclictest0-21swapper/223:35:352
2603399226,13cyclictest0-21swapper/300:05:173
2603399216,13cyclictest0-21swapper/322:45:183
2603399215,14cyclictest0-21swapper/322:20:303
2603199215,15cyclictest0-21swapper/123:25:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional