You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-07-29 - 17:17

Intel(R) Core(TM) i5 CPU 750 @ 2.67GHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #8, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack8slot3.osadl.org (updated Thu Jul 29, 2021 12:45:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
44332225154,66sleep30-21swapper/307:05:053
61822191165,22sleep10-21swapper/107:09:041
60712179159,16sleep20-21swapper/207:07:452
59502179105,69sleep00-21swapper/007:06:260
94872880,1sleep00-21swapper/010:00:500
163542840,5sleep30-21swapper/310:09:023
59102820,0sleep1241ktimersoftd/111:37:441
626524634,9sleep10-21swapper/107:10:001
651299363,32cyclictest0-21swapper/112:01:101
651299345,26cyclictest0-21swapper/108:40:261
651299338,24cyclictest0-21swapper/111:15:251
651299338,24cyclictest0-21swapper/110:55:471
651299329,22cyclictest0-21swapper/112:26:341
651299329,22cyclictest0-21swapper/112:24:051
651299329,22cyclictest0-21swapper/112:14:111
651299329,22cyclictest0-21swapper/111:58:231
651299329,22cyclictest0-21swapper/111:40:551
651299329,22cyclictest0-21swapper/111:09:071
651299329,22cyclictest0-21swapper/110:50:161
651299328,23cyclictest0-21swapper/111:02:551
651299328,23cyclictest0-21swapper/110:38:271
651299328,23cyclictest0-21swapper/109:35:111
651299326,25cyclictest0-21swapper/109:52:071
651299324,27cyclictest0-21swapper/111:47:571
651499317,23cyclictest0-21swapper/312:23:123
651299319,21cyclictest0-21swapper/111:12:311
651299319,21cyclictest0-21swapper/110:01:251
651299318,22cyclictest0-21swapper/112:19:021
651299318,22cyclictest0-21swapper/110:24:301
651299318,22cyclictest0-21swapper/110:19:061
651299318,22cyclictest0-21swapper/110:12:331
651299318,22cyclictest0-21swapper/110:09:081
651299318,22cyclictest0-21swapper/109:11:111
651299317,23cyclictest0-21swapper/110:31:271
651299316,24cyclictest0-21swapper/110:44:201
651299314,26cyclictest0-21swapper/111:27:381
651499305,24cyclictest0-21swapper/312:08:043
651399308,21cyclictest0-21swapper/210:36:372
651299309,20cyclictest0-21swapper/111:31:421
651299308,22cyclictest0-21swapper/111:50:401
651299308,22cyclictest0-21swapper/109:46:111
651299308,21cyclictest0-21swapper/109:24:341
651299308,21cyclictest0-21swapper/109:15:521
651299305,24cyclictest0-21swapper/112:31:121
651299305,24cyclictest0-21swapper/109:55:471
651299304,25cyclictest0-21swapper/109:32:021
6511993017,12cyclictest0-21swapper/010:22:000
651499296,22cyclictest0-21swapper/311:27:473
651499296,22cyclictest0-21swapper/308:31:363
651499294,24cyclictest0-21swapper/312:10:223
651499293,25cyclictest0-21swapper/311:30:183
651399296,22cyclictest0-21swapper/210:07:462
651299298,21cyclictest0-21swapper/112:37:561
651299298,21cyclictest0-21swapper/111:21:441
651299298,20cyclictest0-21swapper/112:05:271
651299295,23cyclictest0-21swapper/110:26:491
651299295,23cyclictest0-21swapper/109:27:001
651299293,25cyclictest0-21swapper/110:48:421
651499287,20cyclictest0-21swapper/311:48:003
651499287,20cyclictest0-21swapper/309:50:283
651499286,21cyclictest0-21swapper/310:27:453
651499286,21cyclictest0-21swapper/308:02:463
651499286,21cyclictest0-21swapper/308:02:463
651499285,22cyclictest0-21swapper/310:17:423
30552280,5sleep30-21swapper/311:35:223
651499276,20cyclictest0-21swapper/310:57:493
651499276,20cyclictest0-21swapper/308:05:223
651499276,20cyclictest0-21swapper/308:05:223
651499275,21cyclictest0-21swapper/311:56:263
651499275,21cyclictest0-21swapper/308:10:263
651399277,19cyclictest0-21swapper/212:13:262
651399275,21cyclictest0-21swapper/212:18:092
651399274,22cyclictest0-21swapper/210:25:252
651399273,22cyclictest0-21swapper/211:17:532
6513992710,16cyclictest0-21swapper/209:55:122
651299275,22cyclictest0-21swapper/109:40:281
651299274,22cyclictest0-21swapper/108:02:461
651299274,22cyclictest0-21swapper/108:02:461
6512992715,11cyclictest0-21swapper/107:35:221
6511992721,4cyclictest81rcu_preempt10:36:180
6511992721,3cyclictest81rcu_preempt11:10:200
6511992714,12cyclictest3-21ksoftirqd/011:00:160
6511992710,16cyclictest0-21swapper/012:22:540
651499268,17cyclictest0-21swapper/312:03:383
651499266,19cyclictest0-21swapper/310:47:493
651499266,19cyclictest0-21swapper/307:12:063
651499265,20cyclictest0-21swapper/310:43:063
651499265,20cyclictest0-21swapper/308:17:183
6514992613,12cyclictest0-21swapper/310:22:003
651399266,19cyclictest0-21swapper/211:00:362
651399265,20cyclictest0-21swapper/212:09:522
651399265,20cyclictest0-21swapper/210:32:282
651399265,20cyclictest0-21swapper/210:15:372
651399264,21cyclictest0-21swapper/209:41:152
651399264,21cyclictest0-21swapper/209:18:142
6513992612,13cyclictest0-21swapper/211:11:252
6513992610,15cyclictest0-21swapper/209:52:552
651299264,22cyclictest0-21swapper/107:27:081
6512992615,10cyclictest0-21swapper/107:30:161
6512992614,11cyclictest0-21swapper/108:50:241
6512992614,11cyclictest0-21swapper/107:40:201
6511992613,3cyclictest4225-21ssh09:22:430
6511992610,15cyclictest0-21swapper/012:19:330
6511992610,15cyclictest0-21swapper/009:43:010
1076522615,10sleep30-21swapper/308:37:013
651499257,17cyclictest0-21swapper/311:53:043
651499257,17cyclictest0-21swapper/309:55:043
651499256,18cyclictest0-21swapper/312:37:323
651499256,18cyclictest0-21swapper/311:41:163
651499256,18cyclictest0-21swapper/307:50:203
651499255,19cyclictest0-21swapper/311:20:263
651499255,19cyclictest0-21swapper/311:10:423
651499255,19cyclictest0-21swapper/310:37:513
651499254,20cyclictest0-21swapper/312:33:183
651499254,20cyclictest0-21swapper/312:27:443
651399256,18cyclictest0-21swapper/212:24:092
651399256,18cyclictest0-21swapper/211:56:042
651399255,19cyclictest0-21swapper/212:35:582
651399255,19cyclictest0-21swapper/212:00:092
651399255,19cyclictest0-21swapper/211:33:352
651399255,19cyclictest0-21swapper/210:42:382
651399255,19cyclictest0-21swapper/210:20:112
651399255,19cyclictest0-21swapper/209:22:332
651399253,21cyclictest0-21swapper/211:51:282
651399252,22cyclictest0-21swapper/211:40:422
651299254,20cyclictest0-21swapper/107:50:201
651299252,22cyclictest0-21swapper/108:05:261
651299252,22cyclictest0-21swapper/108:05:261
6512992515,9cyclictest0-21swapper/108:50:011
6512992513,11cyclictest0-21swapper/109:05:311
6512992513,11cyclictest0-21swapper/109:00:221
6512992513,11cyclictest0-21swapper/108:55:351
651199259,15cyclictest0-21swapper/011:42:220
651199259,15cyclictest0-21swapper/010:05:120
6511992521,3cyclictest0-21swapper/007:15:260
6511992520,4cyclictest0-21swapper/009:29:270
6511992519,4cyclictest81rcu_preempt10:40:320
6511992515,9cyclictest212050irq/31-eth011:20:440
6511992512,12cyclictest212050irq/31-eth012:02:480
6511992511,4cyclictest39-21rcuop/211:48:060
6511992510,2cyclictest81rcu_preempt11:25:220
651499247,16cyclictest0-21swapper/309:41:563
651499246,17cyclictest0-21swapper/310:00:593
651499246,17cyclictest0-21swapper/309:45:533
651499246,17cyclictest0-21swapper/309:20:073
651499246,17cyclictest0-21swapper/309:12:213
651499245,18cyclictest0-21swapper/311:08:353
651499245,18cyclictest0-21swapper/311:04:143
651499244,19cyclictest0-21swapper/310:51:003
651499244,19cyclictest0-21swapper/309:16:003
651499244,18cyclictest18989-21chrt10:10:383
6514992416,7cyclictest175012sleep308:55:263
6514992416,7cyclictest174252sleep311:15:413
6514992416,7cyclictest126492sleep312:18:003
651399247,17cyclictest0-21swapper/209:34:202
651399246,17cyclictest0-21swapper/210:02:502
651399246,17cyclictest0-21swapper/209:35:172
651399244,19cyclictest0-21swapper/211:24:162
651399244,19cyclictest0-21swapper/210:14:502
651399243,20cyclictest0-21swapper/210:58:102
651399243,19cyclictest0-21swapper/207:45:172
651399242,21cyclictest0-21swapper/211:46:262
6513992415,8cyclictest0-21swapper/212:30:222
6513992415,8cyclictest0-21swapper/211:36:412
6513992415,8cyclictest0-21swapper/211:28:072
6513992415,8cyclictest0-21swapper/211:05:212
6513992415,8cyclictest0-21swapper/208:25:362
651399241,22cyclictest0-21swapper/209:10:292
651299243,20cyclictest0-21swapper/107:45:181
6512992414,9cyclictest0-21swapper/108:30:251
6512992414,9cyclictest0-21swapper/108:25:361
6512992414,10cyclictest0-21swapper/107:17:171
6512992413,10cyclictest0-21swapper/107:55:311
6512992412,12cyclictest0-21swapper/108:15:181
6512992411,12cyclictest0-21swapper/107:22:081
6511992420,3cyclictest3-21ksoftirqd/010:45:330
6511992420,3cyclictest212050irq/31-eth009:13:170
6511992420,3cyclictest0-21swapper/011:53:130
6511992420,3cyclictest0-21swapper/010:51:590
6511992420,3cyclictest0-21swapper/007:40:320
6511992420,2cyclictest81rcu_preempt10:13:350
6511992419,4cyclictest3-21ksoftirqd/012:14:210
6511992419,4cyclictest3-21ksoftirqd/009:46:150
6511992419,4cyclictest212050irq/31-eth012:34:430
6511992418,3cyclictest81rcu_preempt10:25:320
6511992415,6cyclictest81rcu_preempt09:35:320
6511992414,2cyclictest0-21swapper/007:45:470
6511992411,12cyclictest24178-21ssh11:55:560
6511992410,13cyclictest0-21swapper/011:05:240
2039922415,8sleep30-21swapper/307:41:503
1709022414,9sleep30-21swapper/308:53:473
651499238,14cyclictest0-21swapper/309:25:073
651499237,15cyclictest0-21swapper/310:30:363
651499235,17cyclictest0-21swapper/309:34:183
651499233,19cyclictest0-21swapper/309:37:003
6514992315,7cyclictest211092sleep309:02:443
6514992315,7cyclictest133902sleep307:25:203
651399238,14cyclictest0-21swapper/212:26:042
651399236,16cyclictest0-21swapper/210:45:002
6513992315,8cyclictest0-21swapper/210:50:332
6513992315,8cyclictest0-21swapper/209:25:202
6513992315,8cyclictest0-21swapper/209:00:202
6513992315,8cyclictest0-21swapper/208:45:132
6513992314,8cyclictest0-21swapper/209:46:402
6513992314,8cyclictest0-21swapper/208:34:032
6512992314,8cyclictest0-21swapper/108:35:231
6512992314,8cyclictest0-21swapper/108:20:001
6512992311,11cyclictest0-21swapper/108:10:241
651199239,13cyclictest0-21swapper/009:50:040
6511992319,3cyclictest3-21ksoftirqd/007:35:220
6511992319,3cyclictest0-21swapper/010:57:200
6511992318,4cyclictest3-21ksoftirqd/010:30:580
6511992318,3cyclictest81rcu_preempt11:39:520
6511992317,4cyclictest81rcu_preempt10:18:090
6511992317,3cyclictest81rcu_preempt12:25:360
6511992316,6cyclictest212050irq/31-eth011:15:240
6511992316,6cyclictest212050irq/31-eth009:57:130
6511992316,4cyclictest29202-21hddtemp_smartct09:15:130
6511992311,2cyclictest0-21swapper/009:30:400
6511992310,12cyclictest0-21swapper/012:39:290
6511992310,12cyclictest0-21swapper/012:07:540
651499225,17cyclictest0-21swapper/307:22:093
651499224,17cyclictest0-21swapper/308:40:263
6514992214,7cyclictest102512sleep307:18:153
651399224,17cyclictest0-21swapper/207:25:232
6513992215,6cyclictest0-21swapper/207:15:282
6513992213,8cyclictest0-21swapper/208:15:002
6511992216,5cyclictest3-21ksoftirqd/008:25:360
6511992216,3cyclictest81rcu_preempt09:05:240
6511992216,3cyclictest81rcu_preempt09:00:130
6511992216,3cyclictest81rcu_preempt08:30:260
6511992216,3cyclictest81rcu_preempt08:15:150
6511992216,3cyclictest81rcu_preempt08:05:140
6511992216,3cyclictest81rcu_preempt08:05:140
6511992216,3cyclictest81rcu_preempt08:00:200
6511992216,3cyclictest81rcu_preempt08:00:200
6511992216,3cyclictest81rcu_preempt07:30:150
6511992216,3cyclictest81rcu_preempt07:25:260
6511992216,3cyclictest30835-21hddtemp_smartct11:30:120
6511992215,6cyclictest25972-21ntp_states07:55:260
6511992215,4cyclictest3-21ksoftirqd/008:20:140
6514992113,7cyclictest56982sleep308:25:273
6514992113,7cyclictest229762sleep309:05:353
6514992113,7cyclictest184792sleep307:38:263
651399213,17cyclictest0-21swapper/208:57:272
651399213,17cyclictest0-21swapper/208:02:152
651399213,17cyclictest0-21swapper/208:02:152
651399213,17cyclictest0-21swapper/207:30:262
6513992115,6cyclictest0-21swapper/208:43:082
6513992115,6cyclictest0-21swapper/208:37:322
6513992115,6cyclictest0-21swapper/208:24:062
6513992115,6cyclictest0-21swapper/207:55:282
6513992115,6cyclictest0-21swapper/207:50:162
6513992115,6cyclictest0-21swapper/207:40:322
6513992115,6cyclictest0-21swapper/207:13:102
6513992114,6cyclictest0-21swapper/208:06:592
6513992114,6cyclictest0-21swapper/208:06:592
6513992113,8cyclictest0-21swapper/208:15:142
6513992112,8cyclictest0-21swapper/208:55:012
6511992117,3cyclictest3-21ksoftirqd/008:35:190
6511992116,2cyclictest81rcu_preempt07:15:010
6511992115,3cyclictest81rcu_preempt08:55:420
6511992115,3cyclictest81rcu_preempt08:10:190
6511992115,3cyclictest81rcu_preempt07:20:160
6511992115,2cyclictest0-21swapper/008:41:480
6511992114,6cyclictest23913-21ntp_states07:50:180
6511992114,6cyclictest16167-21memory08:50:180
6511992111,2cyclictest0-21swapper/008:49:170
2665022114,6sleep30-21swapper/307:57:483
651499205,14cyclictest0-21swapper/308:20:213
651399203,16cyclictest0-21swapper/209:05:282
6513992014,6cyclictest0-21swapper/207:35:012
2237522013,6sleep30-21swapper/307:45:503
1474522015,4sleep30-21swapper/307:30:143
1473722013,6sleep30-21swapper/308:45:303
651399192,16cyclictest0-21swapper/207:20:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional