You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-11 - 02:13

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Sat Jun 10, 2023 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3158499146144,1cyclictest0-21swapper/207:10:322
3158399120111,8cyclictest0-21swapper/108:55:421
31104210746,31sleep30-21swapper/307:07:403
315839910092,7cyclictest0-21swapper/107:10:321
10582960,3sleep31061-21aten2_r8power_e09:25:343
303142950,1sleep00-21swapper/011:30:330
3126229147,32sleep10-21swapper/107:09:431
3112529047,32sleep20-21swapper/207:07:552
31582998987,1cyclictest0-21swapper/008:55:420
3096728945,32sleep00-21swapper/007:05:530
205622880,1sleep00-21swapper/010:18:220
307902870,1sleep219101-21diskmemload12:00:332
119112870,0sleep20-21swapper/212:12:072
13882840,1sleep30-21swapper/312:32:203
31582997270,1cyclictest0-21swapper/007:10:320
256392690,0sleep00-21swapper/009:15:580
31582993920,18cyclictest0-21swapper/011:00:350
3158499310,11cyclictest0-21swapper/209:30:302
31585993013,16cyclictest0-21swapper/311:10:343
3158599281,1cyclictest0-21swapper/308:05:373
172212270,0sleep20-21swapper/211:47:262
31585992623,2cyclictest13892-21strings08:55:423
217392260,0sleep10-21swapper/111:21:321
194952260,0sleep30-21swapper/307:55:333
132362260,0sleep20-21swapper/207:40:372
31584992523,1cyclictest0-21swapper/210:30:342
114722250,1sleep30-21swapper/309:35:453
16952240,0sleep00-21swapper/012:32:450
52602220,0sleep30-21swapper/312:35:493
3158499220,21cyclictest0-21swapper/207:15:362
31583992220,1cyclictest0-21swapper/107:40:321
118972220,1sleep00-21swapper/012:12:050
3158499210,19cyclictest0-21swapper/211:35:352
3158299205,8cyclictest3373-21awk12:05:150
152742200,0sleep20-21swapper/210:45:502
3158599194,3cyclictest0-21swapper/310:09:033
259052190,0sleep30-21swapper/309:50:443
3158599186,3cyclictest20457-21grep09:45:363
3158599174,6cyclictest0-21swapper/309:43:263
3158599166,3cyclictest19101-21diskmemload10:44:083
3158599160,3cyclictest15384-21awk11:15:493
3158299168,7cyclictest0-21swapper/008:31:190
3158299168,7cyclictest0-21swapper/007:44:350
3158299160,1cyclictest0-21swapper/012:06:020
3158599155,3cyclictest20019-21fschecks_count09:10:403
3158499151,1cyclictest0-21swapper/211:25:572
31584991510,3cyclictest21228-21sh08:00:152
3158299158,6cyclictest0-21swapper/012:17:010
3158299158,6cyclictest0-21swapper/011:48:390
3158299158,6cyclictest0-21swapper/011:12:230
3158299158,6cyclictest0-21swapper/010:28:410
3158299158,6cyclictest0-21swapper/009:53:550
3158299158,6cyclictest0-21swapper/008:41:570
3158299158,6cyclictest0-21swapper/008:41:570
3158299158,3cyclictest0-21swapper/010:24:350
3158299157,7cyclictest0-21swapper/010:37:330
3158299155,5cyclictest0-21swapper/009:37:590
3158299154,8cyclictest205-21jbd2/sda1-807:20:210
3158599149,3cyclictest30561-21cron12:30:163
3158399145,3cyclictest0-21swapper/109:28:261
3158299148,5cyclictest0-21swapper/007:29:130
3158299148,3cyclictest8527-21ssh10:05:450
3158299148,3cyclictest0-21swapper/011:21:330
3158299148,2cyclictest0-21swapper/010:56:110
3158299148,2cyclictest0-21swapper/010:41:230
3158299147,6cyclictest0-21swapper/011:16:070
3158299147,6cyclictest0-21swapper/007:33:070
3158299147,3cyclictest0-21swapper/012:26:390
3158299147,3cyclictest0-21swapper/008:00:110
3158299144,8cyclictest5933-21ssh11:07:170
3158299144,7cyclictest0-21swapper/010:51:030
315392143,8sleep30-21swapper/307:10:173
205542140,0chrt0-21swapper/312:20:383
3158599139,2cyclictest17465-21grep09:05:373
3158599137,4cyclictest9423-21head11:40:403
3158599137,4cyclictest27357-21df_inode10:25:383
3158599135,3cyclictest0-21swapper/307:35:193
3158599134,8cyclictest0-21swapper/312:18:493
3158599133,7cyclictest567-21runrttasks12:02:043
3158599133,5cyclictest0-21swapper/309:56:093
3158599130,4cyclictest7490-21ssh11:39:083
3158499138,3cyclictest15228-21grep07:45:312
3158499138,3cyclictest1226-21grep09:25:362
3158499134,4cyclictest23463-21ssh09:48:262
3158499134,4cyclictest23133-21ssh12:22:322
3158499134,4cyclictest0-21swapper/208:10:402
3158499134,4cyclictest0-21swapper/208:00:592
3158399138,3cyclictest3894-21sh07:20:151
3158399134,4cyclictest0-21swapper/111:17:441
3158399131,10cyclictest13301-21irqstats10:10:401
3158299138,4cyclictest0-21swapper/008:26:070
3158299138,4cyclictest0-21swapper/008:06:550
3158299138,4cyclictest0-21swapper/008:00:370
3158299137,3cyclictest0-21swapper/009:45:410
3158299137,3cyclictest0-21swapper/009:02:050
3158299137,2cyclictest0-21swapper/012:37:430
3158299136,6cyclictest0-21swapper/009:20:310
3158299136,6cyclictest0-21swapper/008:52:030
3158299136,6cyclictest0-21swapper/008:23:210
3158299136,6cyclictest0-21swapper/007:38:070
3158299136,4cyclictest0-21swapper/011:53:550
3158299136,4cyclictest0-21swapper/008:39:190
3158299135,7cyclictest0-21swapper/011:37:120
3158299135,7cyclictest0-21swapper/010:32:130
3158299135,7cyclictest0-21swapper/009:42:210
3158299135,7cyclictest0-21swapper/007:15:410
3158299133,1cyclictest29681-21ssh11:29:590
3158299132,2cyclictest31939-21ssh09:56:250
3158299130,9cyclictest22883-21diskmemload09:14:070
3158299130,9cyclictest0-21swapper/010:03:070
3158299130,9cyclictest0-21swapper/009:27:470
3158299130,9cyclictest0-21swapper/007:45:290
3158299130,10cyclictest15869-21ssh10:46:090
3158599127,4cyclictest0-21swapper/308:54:193
3158599127,3cyclictest3097-21grep08:30:413
3158599125,6cyclictest0-21swapper/311:26:183
3158599125,5cyclictest31771-21grep11:00:513
3158599125,5cyclictest30301-21uptime09:20:473
3158599124,5cyclictest0-21swapper/310:22:333
3158599121,2cyclictest0-21swapper/311:09:413
3158599120,5cyclictest14025-21aten2_r8power_c10:45:363
3158499126,4cyclictest27474-21uniq10:25:392
3158499126,4cyclictest19555-21ssh11:20:362
3158499125,6cyclictest0-21swapper/211:32:392
3158499125,5cyclictest516-21dbus-daemon09:40:152
3158499125,4cyclictest0-21swapper/208:22:062
3158499123,4cyclictest0-21swapper/211:51:432
3158499122,5cyclictest28702-21ssh12:27:442
3158499121,6cyclictest5148-21memory08:35:452
3158499121,6cyclictest0-21swapper/209:17:102
3158499121,10cyclictest25570-21sh10:23:422
3158499120,5cyclictest25562-21latency_hist08:10:152
3158499120,1cyclictest0-21swapper/208:30:332
3158399128,3cyclictest578-21idleruntime-cro09:25:151
3158399128,2cyclictest9415-21grep11:40:401
3158399125,5cyclictest26121-21sed09:50:461
3158399124,6cyclictest26137-21open_files11:25:441
3158399124,6cyclictest0-21swapper/110:43:101
3158399124,4cyclictest28284-21ssh10:58:321
3158399124,4cyclictest0-21swapper/111:55:521
3158399124,3cyclictest0-21swapper/112:35:441
3158399124,3cyclictest0-21swapper/111:31:061
3158399124,3cyclictest0-21swapper/110:21:061
3158399121,7cyclictest5003-21ntp_states12:05:441
3158399121,6cyclictest7217-21sed07:25:401
3158299128,3cyclictest0-21swapper/011:55:290
3158299128,3cyclictest0-21swapper/009:05:370
3158299128,3cyclictest0-21swapper/008:45:370
3158299128,3cyclictest0-21swapper/008:15:410
3158299127,4cyclictest0-21swapper/010:11:150
3158299127,4cyclictest0-21swapper/009:32:370
3158299127,4cyclictest0-21swapper/007:54:590
3158299125,4cyclictest0-21swapper/011:40:410
3158299124,7cyclictest21871-21rm12:20:490
174382120,0chrt0-21swapper/110:15:351
174042120,1sleep20-21swapper/207:50:352
3158599117,2cyclictest567-21runrttasks10:36:293
3158599117,2cyclictest26431-21cut08:10:393
3158599116,3cyclictest3132-21pmu-power07:15:453
3158599116,3cyclictest19080-21idleruntime-cro07:55:153
3158599115,5cyclictest0-21swapper/311:45:373
3158599115,4cyclictest31543-21sh11:30:453
3158599114,6cyclictest0-21swapper/310:15:363
3158599114,5cyclictest31457-21python08:20:433
3158599114,5cyclictest16935-21cron09:05:153
3158599113,3cyclictest4276-21df_inode12:05:373
3158599111,3cyclictest10045-21grep08:45:483
3158599110,4cyclictest7255-21unixbench-2d09:30:433
3158499118,2cyclictest5181-21ls07:20:412
3158499117,2cyclictest6623-21grep08:40:362
3158499117,2cyclictest6623-21grep08:40:362
3158499116,3cyclictest8824-21idleruntime-cro12:10:152
3158499116,3cyclictest567-21runrttasks11:41:352
3158499116,3cyclictest15304-21tr09:00:362
3158499115,5cyclictest0-21swapper/211:00:322
3158499115,3cyclictest0-21swapper/212:17:252
3158499114,5cyclictest16815-21unixbench_multi09:40:472
3158499113,6cyclictest579-21snmpd11:15:412
3158499112,4cyclictest0-21swapper/210:00:382
3158499111,8cyclictest29933-21ps09:20:452
3158499111,4cyclictest30263-21sh12:00:152
3158499111,3cyclictest14779-21munin-run09:00:152
3158499111,2cyclictest0-21swapper/211:10:332
3158499110,7cyclictest0-21swapper/211:08:292
3158399117,3cyclictest1955-21munin-plugin-st10:00:151
3158399116,3cyclictest8858-21grep11:10:371
3158399116,3cyclictest31022-21sh12:00:341
3158399116,3cyclictest21230-21dump-pmu-power08:00:151
3158399116,3cyclictest19799-21tr09:10:361
3158399116,3cyclictest19690-21sendmail12:20:161
3158399115,5cyclictest0-21swapper/112:23:411
3158399115,4cyclictest25799-21tr12:25:361
3158399115,4cyclictest0-21swapper/108:05:451
3158399115,3cyclictest0-21swapper/108:11:211
3158399114,6cyclictest0-21swapper/110:06:451
3158399114,6cyclictest0-21swapper/108:35:441
3158399114,5cyclictest626-21gdbus11:45:431
3158399114,5cyclictest579-21snmpd07:36:581
3158399114,5cyclictest11257-21fw_packets08:50:371
3158399114,5cyclictest0-21swapper/108:03:441
3158399113,6cyclictest0-21swapper/109:16:461
3158399113,5cyclictest0-21swapper/109:01:551
3158399112,6cyclictest21640-21ssh10:51:581
3158399111,4cyclictest10040-21munin-plugin-st09:35:151
3158399110,9cyclictest3131-21apt-get11:05:331
3158399110,6cyclictest21084-21ssh09:45:411
3158399110,5cyclictest19859-21latency_hist09:45:151
3158399110,5cyclictest1755-21ssh11:04:011
3158299118,3cyclictest0-21swapper/008:10:450
3158599106,3cyclictest38250irq/33-enp3s0-r09:15:433
3158599105,4cyclictest5393-21cut08:35:483
3158599105,4cyclictest19188-21/usr/sbin/munin10:50:343
3158599105,3cyclictest28194-21grep08:15:363
3158599105,3cyclictest12642-21grep10:10:353
3158599104,5cyclictest579-21snmpd07:22:073
3158599104,5cyclictest0-21swapper/311:50:213
3158599104,4cyclictest22133-21grep08:00:373
3158599104,4cyclictest19352-21ssh11:20:203
3158599104,4cyclictest15581-21grep07:45:343
3158599104,4cyclictest13106-21cut07:40:373
3158599104,3cyclictest0-21swapper/312:10:193
3158599103,3cyclictest0-21swapper/307:30:463
3158599101,7cyclictest32557-21if_enp3s010:30:413
3158599101,5cyclictest0-21swapper/308:40:333
3158599101,5cyclictest0-21swapper/308:40:333
3158599100,8cyclictest5797-21ssh10:03:273
3158599100,4cyclictest25352-21iwlist10:55:393
3158599100,4cyclictest25082-21ssh11:55:203
3158499106,3cyclictest75-21kswapd010:35:362
3158499106,3cyclictest19101-21diskmemload10:41:222
3158499106,3cyclictest1024-21kworker/u8:110:10:252
3158499106,2cyclictest32293-21acpi08:25:322
3158499105,3cyclictest9103-21gltestperf08:45:372
3158499105,3cyclictest26622sleep212:34:042
3158499105,3cyclictest20608-21grep09:10:442
3158499105,3cyclictest17374-21cpuspeed_turbos09:05:372
3158499105,3cyclictest0-21swapper/207:40:112
3158499104,4cyclictest8738-21grep07:30:432
3158499104,4cyclictest30485-21sed09:55:362
3158499104,4cyclictest12174-21grep08:50:452
3158499103,5cyclictest7655-21cpuspeed_turbos10:05:372
3158499101,7cyclictest75-21kswapd010:15:322
3158499101,7cyclictest29906-21tr08:20:152
3158499101,4cyclictest0-21swapper/210:55:412
3158399106,2cyclictest567-21runrttasks10:05:061
3158399106,2cyclictest19101-21diskmemload12:30:181
3158399105,4cyclictest19101-21diskmemload09:35:281
3158399105,4cyclictest1109-21awk08:25:441
3158399105,3cyclictest0-21swapper/111:50:441
3158399104,5cyclictest0-21swapper/111:35:301
3158399104,5cyclictest0-21swapper/108:18:511
3158399104,4cyclictest5495-21grep10:35:461
3158399104,4cyclictest516-21dbus-daemon08:45:461
3158399104,4cyclictest16059-21ntpq07:45:391
3158399104,4cyclictest0-21swapper/112:11:211
3158399104,4cyclictest0-21swapper/107:30:471
3158399101,7cyclictest17180-21/usr/sbin/munin09:05:411
3158399101,5cyclictest0-21swapper/108:42:541
3158399101,5cyclictest0-21swapper/108:42:541
3158399100,8cyclictest30127-21/usr/sbin/munin08:20:411
3158399100,5cyclictest31764-21ssh10:30:341
3158399100,5cyclictest28054-21/usr/sbin/munin10:25:431
3158399100,4cyclictest4155-21/usr/sbin/munin07:20:341
3158399100,4cyclictest14090-21wget10:45:361
257922100,0sleep20-21swapper/209:50:432
315859997,1cyclictest0-21swapper/307:25:173
315859996,2cyclictest568-21if_enp3s008:25:383
315849994,3cyclictest19716-21sed10:50:372
315849991,6cyclictest4635-21ssh12:35:412
315849990,8cyclictest0-21swapper/207:25:212
315839995,3cyclictest567-21runrttasks08:30:211
315839991,7cyclictest0-21swapper/107:50:441
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional