You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-09-30 - 17:49
/usr/bin/Xorg /usr/bin/Xorg

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of system in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Fri Sep 30, 2022 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2568399129127,1cyclictest0-21swapper/307:16:223
2568099116114,1cyclictest0-21swapper/007:16:220
842121110,1sleep00-21swapper/010:36:400
1606521000,1sleep20-21swapper/210:15:332
117572980,0sleep122-21ksoftirqd/112:35:231
25682998078,1cyclictest0-21swapper/207:20:522
25681997567,7cyclictest0-21swapper/107:16:221
81612380,1sleep00-21swapper/009:39:550
144982330,0sleep20-21swapper/210:41:432
121632320,1sleep00-21swapper/012:06:360
132252310,1sleep30-21swapper/310:41:323
90032300,0sleep20-21swapper/207:51:182
25683992920,8cyclictest0-21swapper/310:16:323
70052280,0sleep30-21swapper/309:38:263
289722270,1sleep20-21swapper/208:36:322
274822270,0sleep20-21swapper/209:27:432
97462260,1sleep20-21swapper/209:06:342
50602260,1sleep30-21swapper/308:56:333
34302250,0sleep00-21swapper/011:59:020
25681992520,3cyclictest603-21runrttasks08:00:341
128292240,0sleep10-21swapper/111:38:221
25683992218,2cyclictest14193-21sh11:11:303
2568399220,21cyclictest0-21swapper/309:01:323
2568099220,21cyclictest0-21swapper/010:01:340
2568099220,21cyclictest0-21swapper/007:41:310
2568399210,20cyclictest0-21swapper/308:16:313
25681992116,3cyclictest18403-21kworker/u8:211:20:311
2568099210,20cyclictest0-21swapper/011:31:310
2568399209,9cyclictest27439-21ssh10:54:003
2568399190,11cyclictest13768-21ssh12:07:433
2568399171,8cyclictest32411-21sh12:24:403
2568399170,10cyclictest21819-21sh09:22:453
2568099177,6cyclictest12-21ksoftirqd/012:32:360
2568399166,8cyclictest22533-21swap11:46:443
2568399164,10cyclictest18418-21ssh09:48:273
2568399161,8cyclictest21732-21sh12:43:383
2568399160,9cyclictest18829-21ssh11:43:563
2568399160,8cyclictest4762-21ssh10:33:383
2568399160,14cyclictest871-21irqstats11:56:373
2568199162,5cyclictest4476-21unixbench_multi11:01:451
2568099167,6cyclictest12-21ksoftirqd/010:13:150
2568099167,6cyclictest12-21ksoftirqd/009:46:520
2568099167,5cyclictest12-21ksoftirqd/012:24:440
2568099167,5cyclictest12-21ksoftirqd/012:12:490
2568099167,5cyclictest12-21ksoftirqd/009:58:140
2568099161,8cyclictest8958-21munin-run09:06:180
46412150,0chrt0-21swapper/008:56:180
2568399157,6cyclictest0-21swapper/311:26:343
2568399155,8cyclictest26268-21latency_hist08:31:193
2568399154,9cyclictest859-21cstates08:46:343
2568399154,9cyclictest7889-21head12:31:353
2568399151,9cyclictest12476-21ssh11:09:373
2568399151,8cyclictest5412-21cut11:31:393
2568399150,8cyclictest30931-21ssh11:54:563
2568199155,6cyclictest13284-21diskmemload10:13:491
2568199154,6cyclictest8288-21ssh11:34:441
2568199152,8cyclictest30666-21missed_timers10:56:391
2568199152,8cyclictest30666-21missed_timers10:56:391
2568199152,8cyclictest23245-21ntp_offset08:21:391
2568099157,5cyclictest12-21ksoftirqd/012:42:160
2568099157,5cyclictest12-21ksoftirqd/012:37:400
2568099157,5cyclictest12-21ksoftirqd/012:04:500
2568099157,5cyclictest12-21ksoftirqd/011:28:500
2568099157,5cyclictest12-21ksoftirqd/009:32:290
2568099156,6cyclictest12-21ksoftirqd/009:17:390
2568099156,6cyclictest12-21ksoftirqd/008:40:010
2568099156,5cyclictest12-21ksoftirqd/010:52:010
2568099156,5cyclictest12-21ksoftirqd/010:08:350
2568099155,5cyclictest0-21swapper/008:13:110
2568099154,6cyclictest141rcu_preempt10:22:190
2568099154,6cyclictest12-21ksoftirqd/010:44:440
2568099154,6cyclictest12-21ksoftirqd/009:41:300
2568099154,5cyclictest12-21ksoftirqd/012:30:590
2568099154,5cyclictest12-21ksoftirqd/012:30:590
2568099153,3cyclictest141rcu_preempt09:54:250
153122150,0chrt0-21swapper/212:37:442
303062140,0chrt0-21swapper/211:25:492
2568399146,7cyclictest13284-21diskmemload09:29:323
2568399145,7cyclictest23445-21mailstats08:21:413
2568399144,8cyclictest4201-21unixbench_singl08:51:453
2568399144,8cyclictest29664-21cat08:36:373
2568399144,8cyclictest29630-21ssh09:58:323
2568399144,8cyclictest16158-21rm09:17:453
2568399143,9cyclictest590-21snmpd10:08:503
2568399143,9cyclictest590-21snmpd07:28:543
2568399143,9cyclictest32708-21sh09:32:113
2568399143,9cyclictest25657-21rm12:18:143
2568399143,9cyclictest23303-21ssh10:50:543
2568399143,9cyclictest12506-21needreboot10:11:393
2568399142,7cyclictest0-21swapper/309:41:343
2568399141,9cyclictest8041-21runrttasks10:36:363
2568399141,11cyclictest9911-21/usr/sbin/munin11:36:313
2568399141,11cyclictest3543-21gltestperf11:01:353
2568399141,11cyclictest30564-21sed07:26:183
2568399141,11cyclictest2911-21/usr/sbin/munin07:36:333
2568399141,11cyclictest22725-21ssh10:21:313
2568399141,11cyclictest13284-21diskmemload12:01:393
2568399141,11cyclictest0-21swapper/308:31:313
2568399140,12cyclictest23666-21ssh09:53:023
2568399140,12cyclictest20376-21fschecks_count11:16:353
2568399140,12cyclictest15101-21ssh12:37:283
2568299147,5cyclictest6087-21ssh12:30:172
2568299147,5cyclictest6087-21ssh12:30:172
2568199144,8cyclictest0-21swapper/112:41:371
2568199144,5cyclictest0-21swapper/111:11:351
2568099146,5cyclictest12-21ksoftirqd/011:47:010
2568099146,5cyclictest12-21ksoftirqd/011:08:200
2568099146,5cyclictest12-21ksoftirqd/011:02:110
2568099146,5cyclictest12-21ksoftirqd/010:48:230
2568099146,5cyclictest12-21ksoftirqd/008:35:540
2568099146,5cyclictest12-21ksoftirqd/007:32:080
2568099145,5cyclictest141rcu_preempt07:49:580
2568099144,6cyclictest141rcu_preempt11:51:240
2568099144,6cyclictest131rcuc/009:21:330
2568099144,6cyclictest12-21ksoftirqd/010:28:420
2568099144,6cyclictest12-21ksoftirqd/010:16:480
2568099144,6cyclictest12-21ksoftirqd/009:27:050
2568099144,5cyclictest141rcu_preempt12:19:080
2568099144,5cyclictest0-21swapper/008:28:530
2568099143,7cyclictest131rcuc/011:20:460
2568099143,6cyclictest12-21ksoftirqd/010:56:500
2568099143,6cyclictest12-21ksoftirqd/010:56:500
25680991411,2cyclictest131rcuc/011:13:350
2568399134,7cyclictest30253-21tail10:56:353
2568399134,7cyclictest30253-21tail10:56:353
2568399134,7cyclictest12499-21pmu-power09:11:403
2568399131,10cyclictest7957-21latency07:46:403
2568399131,10cyclictest468-21perl10:01:383
2568399131,10cyclictest32692-21chrt08:45:553
2568399131,10cyclictest2076-21cstates12:26:323
2568399131,10cyclictest2076-21cstates12:26:323
2568399131,10cyclictest16635-21load08:06:363
2568399131,10cyclictest10333-21/usr/sbin/munin09:06:403
2568399130,8cyclictest26032-21rm11:21:333
2568399130,12cyclictest9240-21aten2_r8power_c07:51:323
2568399130,11cyclictest28449-21cut10:26:333
2568399130,11cyclictest14054-21fschecks_time08:01:333
2568399130,11cyclictest1323-21/usr/sbin/munin07:31:393
2568399130,11cyclictest11859-21/usr/sbin/munin07:56:333
2568299138,3cyclictest14868-21apt-get09:46:192
2568299138,3cyclictest10137-21grep11:36:322
2568299135,3cyclictest0-21swapper/210:24:412
2568299134,7cyclictest0-21swapper/212:21:382
2568299134,6cyclictest0-21swapper/209:38:222
2568299134,4cyclictest21854-21ssh11:17:102
2568299133,5cyclictest0-21swapper/211:47:442
2568199135,5cyclictest0-21swapper/110:53:311
2568199135,5cyclictest0-21swapper/109:48:251
2568199134,8cyclictest0-21swapper/112:16:151
2568199134,8cyclictest0-21swapper/109:23:331
2568199134,8cyclictest0-21swapper/107:47:491
2568199134,4cyclictest6323-21ssh12:30:351
2568199134,4cyclictest6323-21ssh12:30:351
2568199134,4cyclictest0-21swapper/112:40:551
2568199134,4cyclictest0-21swapper/109:17:331
2568199133,8cyclictest0-21swapper/110:28:311
2568199133,6cyclictest639-21ssh11:27:071
2568199133,6cyclictest2705-21/usr/sbin/munin08:51:371
2568199133,5cyclictest31910-21ntp_states08:41:391
2568199133,5cyclictest0-21swapper/111:08:281
2568199131,7cyclictest20024-21ssh10:18:231
2568199131,4cyclictest14399-21ssh12:08:311
2568099139,2cyclictest131rcuc/008:56:400
2568099137,3cyclictest12-21ksoftirqd/007:30:040
2568099135,6cyclictest131rcuc/007:36:400
2568099135,5cyclictest12-21ksoftirqd/011:22:350
2568099134,8cyclictest0-21swapper/009:06:210
2568099133,6cyclictest12-21ksoftirqd/011:41:470
2568099133,6cyclictest12-21ksoftirqd/011:36:420
2568099133,6cyclictest12-21ksoftirqd/010:31:560
2568099133,5cyclictest0-21swapper/009:12:120
2568399124,6cyclictest18199-21expr08:11:313
2568399120,10cyclictest4880-21aten2_r8power_c07:41:313
2568399120,10cyclictest16886-21taskset12:11:193
2568299127,3cyclictest24951-21grep08:26:352
2568299126,4cyclictest22329-21ls10:21:182
2568299125,5cyclictest24558-21gdbus11:01:432
2568299125,5cyclictest238-21systemd-journal10:29:482
2568299125,5cyclictest23618-21cron10:51:182
2568299124,6cyclictest0-21swapper/211:07:202
2568299124,6cyclictest0-21swapper/210:41:012
2568299124,3cyclictest0-21swapper/209:54:192
2568299124,3cyclictest0-21swapper/209:13:482
2568299124,3cyclictest0-21swapper/208:22:172
2568299124,2cyclictest0-21swapper/209:24:142
2568299123,7cyclictest7259-21ssh12:31:312
2568299123,7cyclictest27842-1kworker/u9:212:21:182
2568299123,4cyclictest0-21swapper/207:24:092
2568299123,3cyclictest0-21swapper/209:04:152
2568299122,5cyclictest0-21swapper/210:34:182
2568299121,8cyclictest15430-21apt-get09:46:312
2568299121,8cyclictest11120-21turbostat.cron08:01:132
2568299121,6cyclictest0-21swapper/208:45:152
2568299121,5cyclictest19465-21ssh12:41:362
2568299121,4cyclictest30235-21grep10:56:352
2568299121,4cyclictest30235-21grep10:56:352
2568199128,4cyclictest0-21swapper/111:51:471
2568199127,4cyclictest0-21swapper/108:10:371
2568199127,2cyclictest0-21swapper/109:34:351
2568199125,5cyclictest603-21runrttasks11:24:551
2568199125,5cyclictest28053-21ssh09:28:271
2568199125,5cyclictest10780-21ssh12:06:111
2568199124,5cyclictest0-21swapper/110:49:011
2568199123,8cyclictest0-21swapper/109:52:131
2568199123,4cyclictest0-21swapper/110:01:471
2568199122,5cyclictest0-21swapper/110:36:351
2568199120,7cyclictest6189-21df10:06:351
2568199120,4cyclictest15046-21users08:01:431
2568099123,6cyclictest12-21ksoftirqd/008:22:040
2568099123,4cyclictest12-21ksoftirqd/008:08:430
2568099122,6cyclictest12-21ksoftirqd/007:52:320
2568099122,6cyclictest12-21ksoftirqd/007:21:380
2568099122,3cyclictest12-21ksoftirqd/007:56:400
7822110,1chrt0-21swapper/211:27:172
2568299116,3cyclictest26693-21apt11:51:292
2568299115,4cyclictest18434-21sh11:43:252
2568299115,4cyclictest18302-21fschecks_count08:11:332
2568299115,4cyclictest17453-21cut12:11:332
2568299115,4cyclictest11573-21cut12:06:312
2568299114,5cyclictest538-21dbus-daemon08:56:422
2568299114,5cyclictest0-21swapper/211:57:022
2568299114,5cyclictest0-21swapper/210:10:552
2568299114,5cyclictest0-21swapper/210:03:292
2568299114,5cyclictest0-21swapper/209:34:402
2568299113,6cyclictest13762-21wget09:16:322
2568299113,6cyclictest0-21swapper/211:11:542
2568299113,6cyclictest0-21swapper/208:54:042
2568299113,3cyclictest0-21swapper/208:21:082
2568299111,5cyclictest0-21swapper/210:51:362
2568299111,5cyclictest0-21swapper/210:00:262
2568299110,5cyclictest5723-21aten2_r8power_p12:01:322
2568199116,4cyclictest0-21swapper/108:35:331
2568199115,5cyclictest0-21swapper/111:56:291
2568199115,5cyclictest0-21swapper/109:07:391
2568199115,5cyclictest0-21swapper/108:36:331
2568199115,4cyclictest6052-21wc07:41:411
2568199115,4cyclictest238-21systemd-journal09:06:131
2568199114,5cyclictest22259-21ssh11:46:411
2568199114,5cyclictest0-21swapper/110:32:411
2568199113,5cyclictest0-21swapper/110:43:071
2568199113,5cyclictest0-21swapper/110:21:331
2568199113,5cyclictest0-21swapper/108:30:171
2568199113,5cyclictest0-21swapper/107:51:491
2568199113,2cyclictest24671-21ssh12:16:571
2568199112,7cyclictest18512-21sh11:43:311
2568199111,5cyclictest30225-21ssh12:21:511
2568199111,5cyclictest0-21swapper/108:11:351
2568199110,6cyclictest0-21swapper/109:37:131
2568099115,4cyclictest32291-21sed08:41:420
2568099113,6cyclictest131rcuc/008:16:400
2568099113,4cyclictest12-21ksoftirqd/008:46:440
2568099111,6cyclictest0-21swapper/008:03:370
2568299105,3cyclictest6801-21systemctl07:46:182
2568299105,3cyclictest2972-21tr07:36:332
2568299105,3cyclictest0-21swapper/208:01:222
2568299104,4cyclictest1155-21grep08:46:362
2568299104,3cyclictest0-21swapper/207:34:302
2568299103,5cyclictest590-21snmpd07:51:222
2568299103,5cyclictest16989-21mailstats08:06:402
2568299101,7cyclictest4249-21/usr/sbin/munin11:31:412
2568299101,6cyclictest30676-21/usr/sbin/munin07:26:392
2568299101,2cyclictest28428-21idleruntime-cro08:36:192
2568199105,3cyclictest31301-21sed07:26:371
2568199104,5cyclictest0-21swapper/109:57:171
2568199104,5cyclictest0-21swapper/109:11:391
2568199104,5cyclictest0-21swapper/108:16:431
2568199104,5cyclictest0-21swapper/107:21:541
2568199104,4cyclictest5442-21head08:56:351
2568199104,4cyclictest1393-21interrupts08:46:381
2568199104,4cyclictest10810-21ntpq09:41:391
2568199103,5cyclictest590-21snmpd07:31:181
256819994,5cyclictest0-21swapper/107:36:391
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional