You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-08-05 - 06:16

Intel(R) Core(TM) i5 CPU 750 @ 2.67GHz, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #8, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the alll highest latencies:
System rack8slot3.osadl.org (updated Thu Aug 05, 2021 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
132392184165,15sleep10-21swapper/119:07:061
132352179160,15sleep20-21swapper/219:07:042
116592179105,69sleep30-21swapper/319:05:053
131512173105,64sleep00-21swapper/019:06:060
69042960,1sleep10-21swapper/100:04:021
167962870,1sleep116795-21diskmemload23:40:241
1373399346,27cyclictest0-21swapper/222:45:582
1373399343,30cyclictest0-21swapper/223:31:202
1373399343,30cyclictest0-21swapper/221:36:222
308402330,12sleep30-21swapper/321:10:023
1373399338,24cyclictest0-21swapper/223:57:412
1373399338,24cyclictest0-21swapper/221:14:172
1373399334,28cyclictest0-21swapper/223:52:492
1373399333,29cyclictest0-21swapper/223:41:442
1373399333,29cyclictest0-21swapper/223:11:552
1373399333,29cyclictest0-21swapper/222:57:132
13733993314,18cyclictest0-21swapper/200:34:442
1373399323,28cyclictest0-21swapper/223:27:352
1373399323,28cyclictest0-21swapper/223:16:572
1373399323,28cyclictest0-21swapper/219:56:362
1373399323,28cyclictest0-21swapper/200:15:202
1373399317,23cyclictest0-21swapper/222:30:062
1373399313,27cyclictest0-21swapper/221:44:442
13733993118,12cyclictest0-21swapper/223:21:572
13733993113,17cyclictest0-21swapper/222:15:562
1372599317,23cyclictest0-21swapper/100:12:581
1374099305,24cyclictest0-21swapper/323:26:593
1374099303,26cyclictest0-21swapper/323:11:543
1373399307,22cyclictest0-21swapper/222:41:242
1373399306,23cyclictest0-21swapper/223:03:542
1373399305,24cyclictest0-21swapper/222:02:532
1373399305,24cyclictest0-21swapper/200:00:262
1373399304,25cyclictest0-21swapper/221:29:402
1373399304,25cyclictest0-21swapper/200:39:092
1373399304,25cyclictest0-21swapper/200:07:592
1373399303,26cyclictest0-21swapper/222:51:252
1373399303,26cyclictest0-21swapper/222:08:042
1373399303,26cyclictest0-21swapper/221:45:252
1373399303,26cyclictest0-21swapper/219:19:162
13733993018,11cyclictest0-21swapper/200:20:412
1372599307,22cyclictest0-21swapper/121:36:221
1372599307,22cyclictest0-21swapper/121:11:591
1374099297,21cyclictest0-21swapper/321:33:163
1374099294,24cyclictest0-21swapper/321:36:223
1373399298,20cyclictest0-21swapper/222:20:052
1373399297,21cyclictest0-21swapper/223:36:152
1373399297,21cyclictest0-21swapper/222:36:232
1373399297,21cyclictest0-21swapper/221:52:562
1373399296,22cyclictest0-21swapper/200:25:332
1373399295,23cyclictest0-21swapper/221:23:292
1373399295,23cyclictest0-21swapper/200:11:522
1373399293,25cyclictest0-21swapper/223:07:292
1373399293,25cyclictest0-21swapper/222:27:592
1373399293,25cyclictest0-21swapper/221:34:582
1373399293,25cyclictest0-21swapper/221:04:362
1373399293,25cyclictest0-21swapper/220:25:312
1373399293,25cyclictest0-21swapper/220:19:282
1373399293,25cyclictest0-21swapper/220:19:272
1372599296,22cyclictest0-21swapper/123:11:101
1372599296,22cyclictest0-21swapper/121:31:571
157552280,1sleep00-21swapper/023:40:020
1374099287,20cyclictest0-21swapper/300:19:433
1374099284,23cyclictest0-21swapper/322:57:123
1374099283,24cyclictest0-21swapper/323:31:213
1373399286,21cyclictest0-21swapper/222:10:012
1373399283,24cyclictest0-21swapper/223:46:582
1373399283,24cyclictest0-21swapper/221:19:102
1373399282,25cyclictest0-21swapper/219:46:172
1372599286,21cyclictest0-21swapper/123:09:541
1372599283,24cyclictest0-21swapper/123:58:481
433622716,9sleep30-21swapper/322:21:003
1374099278,18cyclictest0-21swapper/321:58:393
1374099277,19cyclictest0-21swapper/323:59:503
1374099274,22cyclictest0-21swapper/321:26:023
1374099273,23cyclictest0-21swapper/323:41:443
1374099273,23cyclictest0-21swapper/320:07:563
13740992710,16cyclictest0-21swapper/323:49:253
13740992710,16cyclictest0-21swapper/322:19:163
1373399277,20cyclictest0-21swapper/221:55:232
1372599278,18cyclictest0-21swapper/121:54:451
1372599277,19cyclictest0-21swapper/122:45:491
1372599276,20cyclictest0-21swapper/122:28:051
1372599275,21cyclictest0-21swapper/123:49:171
1372599275,21cyclictest0-21swapper/123:26:061
1372599275,21cyclictest0-21swapper/123:18:131
1372599275,21cyclictest0-21swapper/122:22:381
1372599275,21cyclictest0-21swapper/100:08:391
1372599273,23cyclictest0-21swapper/100:20:021
30622615,9sleep30-21swapper/322:50:243
1374099267,18cyclictest0-21swapper/322:46:003
1374099266,19cyclictest0-21swapper/323:36:003
1374099266,19cyclictest0-21swapper/322:03:423
1374099266,19cyclictest0-21swapper/300:36:023
1374099265,20cyclictest0-21swapper/321:18:283
1374099264,21cyclictest0-21swapper/323:51:063
1374099263,22cyclictest0-21swapper/322:44:033
13740992610,15cyclictest0-21swapper/321:45:463
1373399262,23cyclictest0-21swapper/220:00:352
1373399262,23cyclictest0-21swapper/219:35:212
13733992615,10cyclictest0-21swapper/220:05:172
13733992613,12cyclictest0-21swapper/219:50:192
1372599268,17cyclictest0-21swapper/121:58:401
1372599267,18cyclictest0-21swapper/122:40:131
1372599267,18cyclictest0-21swapper/100:16:281
1372599266,20cyclictest0-21swapper/121:16:281
1372599266,19cyclictest0-21swapper/100:27:581
1372599265,20cyclictest0-21swapper/122:53:071
1372599265,20cyclictest0-21swapper/121:46:451
1372599265,20cyclictest0-21swapper/121:40:071
1374099257,17cyclictest0-21swapper/322:28:023
1374099257,17cyclictest0-21swapper/322:11:353
1374099256,18cyclictest0-21swapper/323:07:043
1374099256,18cyclictest0-21swapper/321:51:263
1374099256,18cyclictest0-21swapper/300:30:033
1374099255,19cyclictest0-21swapper/322:30:343
1374099255,19cyclictest0-21swapper/321:20:083
1374099255,19cyclictest0-21swapper/300:22:303
1374099254,20cyclictest0-21swapper/323:16:023
1374099254,20cyclictest0-21swapper/300:06:443
1374099253,21cyclictest0-21swapper/300:25:043
1374099252,22cyclictest0-21swapper/319:20:013
13740992515,9cyclictest240752sleep320:50:573
13740992515,9cyclictest132552sleep323:04:303
13740992510,14cyclictest0-21swapper/321:40:083
1373399253,21cyclictest0-21swapper/220:11:092
1373399252,22cyclictest0-21swapper/220:20:202
1372599257,17cyclictest0-21swapper/100:37:321
1372599256,18cyclictest0-21swapper/122:10:111
1372599255,20cyclictest0-21swapper/122:32:131
1372599255,19cyclictest0-21swapper/123:03:271
1372599254,21cyclictest0-21swapper/121:26:231
1372599254,20cyclictest0-21swapper/123:37:581
1372599254,20cyclictest0-21swapper/122:18:301
1372599254,20cyclictest0-21swapper/122:06:301
1372599254,20cyclictest0-21swapper/122:02:091
1372599254,20cyclictest0-21swapper/121:23:091
1372599253,21cyclictest0-21swapper/122:39:001
13717992514,10cyclictest56702sleep020:07:010
2469422413,9sleep30-21swapper/319:35:173
1374099247,16cyclictest0-21swapper/322:07:363
1374099247,16cyclictest0-21swapper/300:10:543
1374099246,17cyclictest0-21swapper/323:21:313
1374099244,19cyclictest0-21swapper/300:02:013
13740992415,8cyclictest296042sleep319:45:543
13740992415,8cyclictest180862sleep322:35:223
13740992414,9cyclictest316412sleep319:50:433
1373399243,20cyclictest0-21swapper/220:59:352
1373399243,20cyclictest0-21swapper/219:26:542
13733992416,8cyclictest0-21swapper/220:30:342
13733992415,8cyclictest0-21swapper/220:50:162
13733992415,8cyclictest0-21swapper/219:40:162
13733992415,8cyclictest0-21swapper/219:30:252
13733992413,10cyclictest0-21swapper/220:35:162
13733992412,11cyclictest0-21swapper/219:20:192
1372599249,15cyclictest0-21swapper/123:20:151
1372599245,18cyclictest0-21swapper/123:50:291
1372599245,18cyclictest0-21swapper/122:55:371
1372599244,19cyclictest0-21swapper/123:30:541
1372599243,20cyclictest0-21swapper/119:29:191
1372599242,21cyclictest0-21swapper/100:30:131
13725992415,8cyclictest0-21swapper/120:05:121
13725992415,8cyclictest0-21swapper/119:10:201
2005322313,9sleep30-21swapper/320:41:573
13740992315,7cyclictest221512sleep320:47:333
13740992314,8cyclictest96422sleep320:15:343
13740992314,8cyclictest96422sleep320:15:333
13740992314,8cyclictest0-21swapper/319:30:013
13740992313,9cyclictest305682sleep321:09:433
13740992313,9cyclictest209902sleep319:25:233
13740992313,9cyclictest182612sleep320:40:003
1373399232,20cyclictest0-21swapper/220:49:512
13733992316,6cyclictest0-21swapper/219:10:142
13733992314,8cyclictest0-21swapper/221:08:382
13733992314,8cyclictest0-21swapper/220:40:242
1372599233,19cyclictest0-21swapper/120:40:231
13725992315,8cyclictest0-21swapper/120:05:001
13725992314,8cyclictest0-21swapper/120:14:031
13717992318,4cyclictest0-21swapper/022:16:330
1196122314,8sleep30-21swapper/320:23:343
13740992214,7cyclictest263002sleep320:57:593
13740992214,7cyclictest194782sleep319:22:353
13740992213,8cyclictest79722sleep320:14:533
13740992213,8cyclictest322352sleep319:55:023
13740992213,8cyclictest156152sleep320:30:353
13740992212,9cyclictest35932sleep320:02:563
13740992212,9cyclictest152852sleep319:11:373
13740992212,9cyclictest138672sleep320:26:513
1372599225,16cyclictest0-21swapper/119:55:291
1372599222,19cyclictest0-21swapper/120:30:451
13725992214,8cyclictest0-21swapper/120:35:121
13725992213,8cyclictest0-21swapper/120:25:201
13717992216,5cyclictest13704-21cyclictest22:14:300
13717992215,6cyclictest0-21swapper/021:38:190
13740992112,8cyclictest278532sleep319:44:253
1372599214,16cyclictest0-21swapper/121:00:191
1372599214,16cyclictest0-21swapper/120:50:241
1372599213,17cyclictest0-21swapper/119:40:261
1372599212,8cyclictest0-21swapper/119:45:211
1372599212,18cyclictest0-21swapper/121:05:431
13725992115,6cyclictest0-21swapper/119:50:381
13725992115,6cyclictest0-21swapper/119:20:181
13725992112,8cyclictest0-21swapper/119:30:261
13717992117,3cyclictest212050irq/31-eth022:57:560
13717992117,3cyclictest0-21swapper/022:40:190
13717992115,5cyclictest13704-21cyclictest22:39:290
13717992114,6cyclictest237642sleep023:47:450
13717992114,6cyclictest0-21swapper/023:55:170
13717992113,7cyclictest0-21swapper/022:33:180
13740992014,6cyclictest0-21swapper/321:01:493
1372599203,16cyclictest0-21swapper/120:55:231
1372599203,16cyclictest0-21swapper/120:17:451
1372599203,16cyclictest0-21swapper/120:17:451
1372599202,17cyclictest0-21swapper/120:45:211
1372599202,17cyclictest0-21swapper/120:20:231
13717992015,3cyclictest9522-21perl23:00:140
13717992015,3cyclictest27376-21hddtemp_smartct22:45:160
13717992015,3cyclictest14945-21users21:25:330
13717992014,5cyclictest0-21swapper/023:09:380
13717992014,5cyclictest0-21swapper/021:16:560
13717992014,5cyclictest0-21swapper/000:27:090
13717992014,4cyclictest6407-21fschecks_count23:30:140
13717992014,4cyclictest634-21df21:45:180
13717992014,4cyclictest28409-21perl21:40:120
13717992014,4cyclictest13541-21timerwakeupswit20:25:250
1372599192,16cyclictest0-21swapper/119:35:191
13725991910,8cyclictest0-21swapper/119:15:161
13717991915,3cyclictest3143-21ls22:20:180
13717991915,3cyclictest31165-21cstates21:10:160
13717991915,3cyclictest24728-21irqstats19:35:170
13717991915,3cyclictest22657-21ssh00:20:100
13717991915,3cyclictest212050irq/31-eth022:54:580
13717991915,3cyclictest16927-21switchtime19:15:260
13717991915,3cyclictest15070-21sed19:10:220
13717991915,3cyclictest0-21swapper/021:32:060
13717991915,3cyclictest0-21swapper/020:35:100
13717991914,4cyclictest9173-21munin-node21:20:170
13717991914,4cyclictest8279-21uname22:25:220
13717991914,4cyclictest7032-21ssh21:50:420
13717991914,4cyclictest5480-21diskstats00:35:140
13717991914,4cyclictest32581-21ssh00:30:160
13717991914,4cyclictest31455-21ssh23:22:250
13717991914,4cyclictest26997-21diskstats21:00:120
13717991914,4cyclictest26296-21ssh23:50:140
13717991914,4cyclictest21465-21grep22:05:260
13717991914,4cyclictest21417-21ls20:45:190
13717991914,4cyclictest2127-21ntp_offset23:25:260
13717991914,4cyclictest14427-21ssh00:10:330
13717991914,4cyclictest10188-21ssh21:55:090
13717991914,4cyclictest0-21swapper/000:06:250
13717991913,5cyclictest0-21swapper/023:13:500
13717991913,4cyclictest25261-21users23:15:240
13717991913,4cyclictest15441-21df22:00:150
13717991815,3cyclictest0-21swapper/023:35:030
13717991815,3cyclictest0-21swapper/020:12:360
13717991815,3cyclictest0-21swapper/020:00:010
13717991815,3cyclictest0-21swapper/019:55:500
13717991815,3cyclictest0-21swapper/019:50:160
13717991814,3cyclictest98362sleep020:17:470
13717991814,3cyclictest98362sleep020:17:460
13717991814,3cyclictest33002sleep000:00:220
13717991814,3cyclictest261552sleep020:56:200
13717991814,3cyclictest241172sleep020:51:300
13717991814,3cyclictest0-21swapper/019:40:210
13717991813,4cyclictest22973-21ps19:30:220
13717991813,4cyclictest19157-21if_err_eth020:40:240
13717991813,4cyclictest17640-21ssh00:15:030
13717991813,4cyclictest14678-21munin-node20:30:180
13717991813,4cyclictest10268-21munin-node20:20:150
13717991813,3cyclictest18463-21hddtemp_smartct19:20:160
13717991714,3cyclictest0-21swapper/019:25:130
13717991713,3cyclictest0-21swapper/021:05:110
13717991611,3cyclictest28942-21memory19:45:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional