You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2019-06-19 - 02:58

Intel(R) Core(TM) i3-2310E CPU @ 2.10GHz, Linux 4.19.1-rt3 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Wed Jun 19, 2019 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
563099131123,7cyclictest0-21swapper/119:22:241
563099131123,7cyclictest0-21swapper/119:22:241
563299115111,2cyclictest0-21swapper/319:12:173
5287210139,20sleep10-21swapper/119:11:371
5629999895,1cyclictest0-21swapper/019:12:170
168762860,4sleep0562999cyclictest23:12:240
529828248,20sleep30-21swapper/319:11:433
494928247,20sleep00-21swapper/019:08:150
488328247,21sleep20-21swapper/219:07:362
5632998179,1cyclictest11935-21strings19:22:243
5632998179,1cyclictest11935-21strings19:22:243
279502810,2sleep327956-21needreboot21:07:253
5629996563,1cyclictest0-21swapper/019:22:240
5629996563,1cyclictest0-21swapper/019:22:240
3482380,6sleep2563199cyclictest22:22:202
563099260,1cyclictest0-21swapper/121:12:181
5630992219,1cyclictest0-21swapper/100:12:171
562999205,6cyclictest32090-21grep23:27:370
563299194,2cyclictest0-21swapper/323:15:123
5631991917,1cyclictest0-21swapper/219:12:172
562999185,5cyclictest23242-21ssh00:26:510
563299174,5cyclictest0-21swapper/322:48:353
5629991612,2cyclictest23745-21ssh00:27:170
563199150,13cyclictest0-21swapper/219:42:292
562999153,6cyclictest11149-21munin-run21:27:140
562999153,5cyclictest555-21snmpd20:29:560
562999152,8cyclictest0-21swapper/000:32:200
76312140,0sleep20-21swapper/200:10:182
563299144,5cyclictest0-21swapper/323:55:073
563299144,5cyclictest0-21swapper/322:27:213
563299144,5cyclictest0-21swapper/322:27:213
563299144,5cyclictest0-21swapper/321:17:033
563299144,5cyclictest0-21swapper/320:38:503
563299144,5cyclictest0-21swapper/300:33:103
563299140,12cyclictest613-21lldpd23:47:193
563199147,5cyclictest0-21swapper/223:34:362
563199144,5cyclictest0-21swapper/220:31:322
563199144,5cyclictest0-21swapper/220:08:582
563199144,5cyclictest0-21swapper/219:40:572
563099145,4cyclictest0-21swapper/121:55:221
563099140,12cyclictest0-21swapper/122:57:181
562999145,6cyclictest0-21swapper/022:28:020
562999145,6cyclictest0-21swapper/022:28:020
562999142,4cyclictest0-21swapper/023:07:580
562999141,8cyclictest29784-21ssh22:18:330
562999140,7cyclictest3596-21perf20:17:130
47132140,1sleep00-21swapper/021:19:530
563299133,5cyclictest0-21swapper/320:11:463
563299131,4cyclictest0-21swapper/319:50:163
563199139,2cyclictest10895-21tr20:32:172
563199134,4cyclictest0-21swapper/219:33:122
563199133,6cyclictest0-21swapper/222:37:382
563099138,3cyclictest10054-21sed19:17:291
563099134,8cyclictest0-21swapper/121:23:001
563099134,4cyclictest0-21swapper/100:06:551
562999138,3cyclictest234-21systemd-journal20:02:130
562999137,4cyclictest8976-21cron00:12:140
562999137,4cyclictest30207-21apt23:27:130
562999137,4cyclictest27668-21gltestperf23:57:220
562999137,4cyclictest27668-21gltestperf23:57:220
562999137,4cyclictest22115-21perf20:57:140
562999137,4cyclictest17062-21awk20:42:290
562999137,4cyclictest12149-21cron23:42:140
562999136,5cyclictest2590-21ssh22:24:160
562999136,5cyclictest23710-21ls22:12:270
562999136,5cyclictest23225-21ssh23:52:250
562999136,5cyclictest19349-21cat22:42:180
562999136,5cyclictest15444-21python00:17:290
562999136,4cyclictest18028-21grep23:47:230
562999135,6cyclictest22227-21cron22:12:140
562999134,7cyclictest26840-21sort19:57:140
562999134,6cyclictest0-21swapper/021:05:120
562999134,6cyclictest0-21swapper/021:05:120
562999134,4cyclictest0-21swapper/000:12:250
562999133,8cyclictest23154-21ssh21:38:170
562999133,3cyclictest18288-21diskstats19:37:210
562999133,3cyclictest11652-21irqstats20:32:220
562999130,1cyclictest0-21swapper/020:07:170
91782120,1sleep30-21swapper/323:37:283
563299124,3cyclictest23583-21/usr/sbin/munin20:57:303
563299124,2cyclictest0-21swapper/320:16:133
563299123,4cyclictest0-21swapper/320:22:223
563299122,5cyclictest0-21swapper/322:39:173
563299122,5cyclictest0-21swapper/322:16:013
563299122,5cyclictest0-21swapper/320:52:593
563299122,5cyclictest0-21swapper/319:17:363
563299121,6cyclictest0-21swapper/320:27:383
563299120,10cyclictest31411-21hddtemp_smartct21:47:203
563199127,3cyclictest8532-21gltestperf21:57:212
563199125,5cyclictest0-21swapper/221:43:212
563199124,3cyclictest6060-21ssh21:54:312
563199124,3cyclictest0-21swapper/223:22:102
563199124,3cyclictest0-21swapper/221:22:252
563199124,3cyclictest0-21swapper/220:17:252
563199123,6cyclictest14029-21ssh00:17:172
563199123,4cyclictest0-21swapper/223:13:242
563199123,4cyclictest0-21swapper/222:13:342
563199123,4cyclictest0-21swapper/221:52:102
563199122,5cyclictest0-21swapper/200:23:082
563099128,2cyclictest2448-21wc20:12:241
563099125,6cyclictest0-21swapper/122:07:311
563099124,7cyclictest0-21swapper/123:44:131
563099124,6cyclictest0-21swapper/123:14:001
563099124,6cyclictest0-21swapper/123:12:121
563099124,4cyclictest0-21swapper/100:24:381
563099124,3cyclictest0-21swapper/119:54:101
563099123,6cyclictest19152-21apt-get22:42:171
563099123,3cyclictest331-21fschecks_count22:22:201
563099120,2cyclictest31170-21df_inode21:47:181
563099120,11cyclictest0-21swapper/100:07:201
562999128,2cyclictest2871-21apt-get23:32:170
562999128,2cyclictest20731-21apt-get23:17:170
562999127,3cyclictest991-21grep22:57:140
562999127,3cyclictest27195-21cut21:07:190
562999126,4cyclictest8378-21ssh21:57:190
562999126,4cyclictest6867-21expr23:02:210
562999126,4cyclictest613-21lldpd23:42:190
562999126,4cyclictest613-21lldpd20:47:190
562999126,4cyclictest4192-21cpuspeed_turbos20:17:180
562999126,4cyclictest3452-21cpuspeed_turbos21:52:180
562999126,4cyclictest24422-21df22:47:180
562999126,4cyclictest1676-21cpuspeed_turbos22:57:200
562999126,4cyclictest1526-21ssh00:38:140
562999125,5cyclictest6576-21cat20:22:180
562999125,5cyclictest31552-21/usr/sbin/munin21:47:210
562999125,5cyclictest29222-21ssh21:12:180
562999125,5cyclictest28456-21ssh21:44:030
562999125,5cyclictest22954-21fschecks_time19:47:210
562999125,5cyclictest22832-21fschecks_time20:57:230
562999125,5cyclictest20307-21ssh21:36:300
562999125,5cyclictest19893-21cron19:42:140
562999125,5cyclictest16440-21kernelversion19:32:260
562999125,5cyclictest15274-21grep22:37:230
562999125,5cyclictest14302-21ntpq20:37:270
562999125,5cyclictest13806-21/usr/sbin/munin19:27:200
562999125,5cyclictest12876-21basename22:02:180
562999125,5cyclictest12224-21if_err_enp3s021:27:230
562999125,5cyclictest10038-21tune2fs22:32:200
562999122,5cyclictest0-21swapper/019:17:160
296912120,1sleep30-21swapper/322:18:243
563299117,2cyclictest28958-21diskmemload22:02:263
563299116,3cyclictest41150irq/33-enp3s0-r00:07:143
563299114,5cyclictest0-21swapper/323:06:063
563299114,5cyclictest0-21swapper/322:52:263
563299114,5cyclictest0-21swapper/321:22:303
563299114,5cyclictest0-21swapper/321:20:063
563299114,5cyclictest0-21swapper/320:50:173
563299114,5cyclictest0-21swapper/319:54:043
563299114,5cyclictest0-21swapper/319:43:393
563299114,5cyclictest0-21swapper/319:33:243
563299114,5cyclictest0-21swapper/300:27:413
563299114,4cyclictest0-21swapper/321:32:543
563299113,3cyclictest0-21swapper/300:39:083
563299111,6cyclictest0-21swapper/322:43:193
563299111,5cyclictest0-21swapper/322:58:193
563299111,5cyclictest0-21swapper/320:18:343
563299110,1cyclictest0-21swapper/300:22:293
563199119,1cyclictest0-21swapper/219:47:212
563199117,2cyclictest22952-21head20:57:242
563199117,2cyclictest10837-21dump-pmu-power23:07:132
563199114,6cyclictest0-21swapper/221:15:012
563199114,5cyclictest234-21systemd-journal00:27:542
563199114,5cyclictest0-21swapper/222:19:182
563199114,5cyclictest0-21swapper/221:38:132
563199114,5cyclictest0-21swapper/221:32:422
563199114,5cyclictest0-21swapper/200:37:422
563199114,5cyclictest0-21swapper/200:13:162
563199114,3cyclictest29704-21ssh00:32:262
563199114,2cyclictest0-21swapper/223:37:162
563199113,6cyclictest0-21swapper/222:45:212
563199113,6cyclictest0-21swapper/222:32:192
563199113,4cyclictest0-21swapper/223:44:282
563199113,3cyclictest0-21swapper/223:49:462
563199113,3cyclictest0-21swapper/222:59:402
563199113,3cyclictest0-21swapper/200:05:202
563199112,5cyclictest0-21swapper/220:53:412
563199112,4cyclictest0-21swapper/223:27:252
563199112,4cyclictest0-21swapper/222:07:282
563199112,4cyclictest0-21swapper/221:02:212
563199112,4cyclictest0-21swapper/221:02:212
563199112,2cyclictest4908-21cpuspeed_turbos22:27:182
563199112,2cyclictest4908-21cpuspeed_turbos22:27:182
563199111,5cyclictest0-21swapper/221:10:202
563199111,3cyclictest0-21swapper/222:52:172
563099117,2cyclictest28976-21cpu22:52:181
563099117,2cyclictest21255-21tr21:37:191
563099117,2cyclictest13297-21aten2_r8power_p20:37:181
563099117,2cyclictest12027-21head21:27:221
563099116,3cyclictest6212-21sendmail21:22:141
563099116,3cyclictest15869-21cpuspeed_turbos19:32:201
563099115,4cyclictest0-21swapper/120:32:471
563099114,6cyclictest0-21swapper/122:47:221
563099114,4cyclictest26952-21aten2_r8power_e21:07:181
563099113,3cyclictest0-21swapper/123:37:201
563099112,5cyclictest0-21swapper/120:07:461
563099112,4cyclictest0-21swapper/123:34:391
563099112,4cyclictest0-21swapper/123:02:161
563099112,4cyclictest0-21swapper/120:45:321
563099112,3cyclictest0-21swapper/123:47:221
563099111,8cyclictest6265-21sed22:27:291
563099111,8cyclictest6265-21sed22:27:291
563099111,5cyclictest0-21swapper/119:58:301
563099111,5cyclictest0-21swapper/100:30:501
563099111,3cyclictest499-21dbus-daemon22:22:141
563099110,6cyclictest0-21swapper/121:32:511
562999116,3cyclictest32115-21cpuspeed_turbos00:02:180
562999115,4cyclictest29255-21cat20:02:150
176332110,1sleep10-21swapper/122:40:111
563299108,1cyclictest0-21swapper/323:32:003
563299106,2cyclictest13164-21apt-get19:27:163
563299106,2cyclictest12574-21swap23:07:353
563299105,4cyclictest0-21swapper/321:27:483
563299105,3cyclictest32595-21cpuspeed_turbos22:22:183
563299103,5cyclictest0-21swapper/323:25:303
563299103,5cyclictest0-21swapper/322:35:203
563299103,5cyclictest0-21swapper/300:08:303
563299103,3cyclictest17830-21/usr/sbin/munin19:37:203
563299103,2cyclictest0-21swapper/320:32:303
563299101,6cyclictest22549-21/usr/sbin/munin21:37:303
563299101,4cyclictest0-21swapper/321:52:163
563299101,4cyclictest0-21swapper/320:04:283
563299100,8cyclictest21831-21strings23:17:253
563299100,8cyclictest0-21swapper/300:00:503
563299100,8cyclictest0-21swapper/300:00:503
563299100,5cyclictest0-21swapper/323:33:423
563199106,2cyclictest12388-21pmu-power23:07:332
563199105,3cyclictest23832-21vmstat23:52:302
563199104,5cyclictest0-21swapper/220:24:322
563199104,5cyclictest0-21swapper/220:14:162
563199104,4cyclictest0-21swapper/221:27:352
563199103,5cyclictest0-21swapper/222:03:372
563199103,5cyclictest0-21swapper/220:03:312
563199102,5cyclictest0-21swapper/219:27:182
563199101,7cyclictest0-21swapper/220:42:202
563199101,7cyclictest0-21swapper/220:37:292
563199101,7cyclictest0-21swapper/219:17:242
563199101,4cyclictest0-21swapper/223:58:282
563199101,4cyclictest0-21swapper/223:58:282
563199101,4cyclictest0-21swapper/223:26:502
563199101,4cyclictest0-21swapper/221:18:212
563099108,1cyclictest0-21swapper/122:03:181
563099106,2cyclictest23091-21gltestperf22:12:211
563099106,2cyclictest20577-21df_inode19:42:191
563099106,2cyclictest14018-21kernelversion19:27:231
563099105,3cyclictest6288-21cut19:12:221
563099105,3cyclictest14298-21cut00:17:191
563099104,5cyclictest0-21swapper/122:36:591
563099104,2cyclictest0-21swapper/120:53:561
563099103,3cyclictest0-21swapper/123:22:541
563099102,3cyclictest26708-21ssh21:42:251
563099102,3cyclictest0-21swapper/120:57:241
563099101,7cyclictest0-21swapper/119:37:241
563099101,4cyclictest28958-21diskmemload23:27:251
563099101,4cyclictest0-21swapper/121:02:301
563099101,4cyclictest0-21swapper/121:02:301
563099100,9cyclictest0-21swapper/123:17:211
563099100,5cyclictest0-21swapper/122:01:201
563099100,5cyclictest0-21swapper/120:30:111
563099100,5cyclictest0-21swapper/120:25:401
563099100,1cyclictest0-21swapper/100:01:081
563099100,1cyclictest0-21swapper/100:01:081
56329995,2cyclictest7957-21aten2_r8power_c21:57:173
56329995,2cyclictest28102-21pmu-power19:57:263
56329995,2cyclictest27304-21sh21:42:323
56329994,4cyclictest0-21swapper/320:44:563
56329994,3cyclictest9861-21gltestperf00:12:213
56329994,3cyclictest28958-21diskmemload23:42:183
56329994,3cyclictest17858-21aten2_r8power_v22:07:183
56329994,2cyclictest0-21swapper/321:02:573
56329994,2cyclictest0-21swapper/321:02:573
56329990,2cyclictest0-21swapper/300:17:173
56319995,3cyclictest24923-21grep19:52:182
56319995,2cyclictest11319-21df19:22:192
56319995,2cyclictest11319-21df19:22:192
56319994,4cyclictest0-21swapper/220:00:222
56319990,7cyclictest0-21swapper/222:47:202
56319990,2cyclictest0-21swapper/220:47:232
56309997,1cyclictest0-21swapper/119:47:381
56309996,2cyclictest241ktimersoftd/120:02:241
56309996,2cyclictest22774-21tail23:52:211
56309995,2cyclictest4141-21cpuspeed_turbos20:17:181
56309995,2cyclictest28958-21diskmemload00:37:241
56309995,2cyclictest17906-21tr20:47:181
56309994,3cyclictest28579-21cut00:32:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional