You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-25 - 07:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Sat May 25, 2024 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
388562199522,23cyclictest0-21swapper/000:16:430
388562199483,27cyclictest0-21swapper/023:26:370
388562199370,29cyclictest4017605-21uname22:56:460
388562199321,12cyclictest4009916-21ssh22:46:560
388562199320,2cyclictest0-21swapper/000:06:380
388562199311,16cyclictest4095392-21memory00:26:420
388562199310,23cyclictest0-21swapper/020:11:370
388562399305,5cyclictest4031287-21ntpq23:11:522
3885623992914,13cyclictest11050irq/107-eth%d22:56:512
388562399286,8cyclictest11050irq/107-eth%d00:26:482
388562199282,13cyclictest0-21swapper/023:12:000
3885621992719,1cyclictest0-21swapper/000:10:460
388562199271,25cyclictest4021385-21aten_r2power_fr23:01:380
388562199271,1cyclictest4030791-21latency_hist23:11:480
388562199262,19cyclictest0-21swapper/022:41:480
388562199260,7cyclictest3951886-21ssh21:41:360
388562399251,19cyclictest4071194-21ssh23:56:472
3885621992519,3cyclictest0-21swapper/021:36:480
3885621992518,1cyclictest0-21swapper/021:29:200
388562199251,6cyclictest0-21swapper/000:01:470
388562199251,5cyclictest11050irq/107-eth%d23:46:420
388562199251,22cyclictest3929952-21tail21:16:400
112299250,3rtkit-daemon1121-21rtkit-daemon19:57:330
3885623992419,2cyclictest3926573-21grep21:11:552
3885621992416,2cyclictest0-21swapper/022:21:120
388562399235,11cyclictest4098586-21/usr/sbin/munin00:31:492
388562299231,1cyclictest3983004-21ssh22:16:451
3885621992313,8cyclictest0-21swapper/022:31:510
3885623992219,2cyclictest4045270-21unixbench_singl23:26:552
388562199222,19cyclictest3995886-21ntp_kernel_pll_22:31:470
388562199222,19cyclictest3964815-21/usr/sbin/munin21:56:370
388562199222,18cyclictest4022619-21/usr/sbin/munin23:01:550
3885621992219,2cyclictest4102345-21fschecks_count00:36:440
3885621992217,3cyclictest3900571-21fschecks_count19:56:380
388562199221,19cyclictest4049030-21latency_hist23:31:490
388562199221,19cyclictest3934577-21gltestperf21:21:420
388562199220,7cyclictest3909416-21unin-run20:21:490
388562399212,6cyclictest0-21swapper/223:26:372
3885623992111,8cyclictest321-21systemd-journal22:56:492
3885622992113,3cyclictest0-21swapper/123:01:401
388562199213,12cyclictest3885580-21munin-run19:11:480
388562199211,11cyclictest3904671-21latency_hist20:06:480
388562299205,3cyclictest11050irq/107-eth%d23:46:481
388562299203,15cyclictest3886535-21sshd19:12:471
3885622992017,2cyclictest3952244-21fschecks_time21:41:401
388562199208,2cyclictest3983246-21sh22:16:490
388562199202,3cyclictest4070550-21/usr/sbin/munin23:56:400
388562199200,2cyclictest4091098-21fschecks_time00:21:430
112299200,4rtkit-daemon1121-21rtkit-daemon23:06:521
3885623991914,3cyclictest3952768-21ntp_kernel_pll_21:41:462
3885623991913,2cyclictest0-21swapper/200:11:342
388562399191,12cyclictest4087382-21/usr/sbin/munin00:16:432
388562299199,9cyclictest0-21swapper/122:26:511
3885622991916,2cyclictest0-21swapper/122:21:511
3885622991913,4cyclictest3924231-21ntp_states21:06:491
3885622991911,6cyclictest3978831-21latency_hist22:11:491
388562199197,5cyclictest3991542-21latency22:26:490
3885621991917,1cyclictest3925789-21munin-run21:11:480
388562199191,11cyclictest4062208-21/usr/sbin/munin23:46:490
388562199190,18cyclictest4099511-21ntpq00:31:450
388562399186,8cyclictest3923706-21sshd21:06:402
388562399185,2cyclictest11050irq/107-eth%d23:11:402
388562399183,4cyclictest0-21swapper/222:21:492
388562399182,8cyclictest3978950-21sed22:11:492
388562299189,6cyclictest0-21swapper/123:16:541
388562299186,8cyclictest3925784-21diskmemload22:56:401
388562299181,3cyclictest0-21swapper/123:01:531
3885622991813,3cyclictest0-21swapper/121:26:511
388562399174,11cyclictest3987277-21/usr/sbin/munin22:21:482
388562399174,10cyclictest3995393-21/usr/sbin/munin22:31:392
388562399173,9cyclictest3999881-21gltestperf22:36:402
388562399172,11cyclictest3961953-21/usr/sbin/munin21:51:552
3885623991713,2cyclictest3910376-21cpuspeed20:26:372
388562299175,8cyclictest4096315-21/usr/sbin/munin00:26:511
388562299172,9cyclictest4087775-21munin-run00:16:481
388562299172,10cyclictest4078928-21/usr/sbin/munin00:06:381
3885622991713,3cyclictest1003-21mta-sts-daemon22:34:191
3885622991712,2cyclictest4056900-21aten_r2power_cu23:41:351
3885622991711,4cyclictest4049316-21sh23:31:501
388562199174,6cyclictest0-21swapper/023:36:350
388562199171,4cyclictest11050irq/107-eth%d23:20:040
3885621991713,3cyclictest4057327-21gltestperf23:41:390
112299170,0rtkit-daemon3980713-21ssh22:13:582
388562499161,9cyclictest0-21swapper/323:11:523
388562499161,2cyclictest0-21swapper/323:56:403
388562399165,9cyclictest3909377-21munin-run20:21:482
388562399164,6cyclictest4090724-21/usr/sbin/munin00:21:432
388562399164,11cyclictest3896215-21cron19:41:482
388562399163,8cyclictest4022512-21/usr/sbin/munin23:01:532
388562399163,6cyclictest4079874-21latency_hist00:06:492
388562399163,10cyclictest3901315-21sed19:56:482
3885623991613,2cyclictest0-21swapper/220:51:392
388562299169,3cyclictest0-21swapper/123:51:521
388562299163,9cyclictest4003699-21/usr/sbin/munin22:41:421
388562299163,10cyclictest4075018-21/usr/sbin/munin00:01:431
388562299162,6cyclictest3947832-21fschecks_count21:36:391
388562299162,12cyclictest4008105-21/usr/sbin/munin22:46:381
388562299162,11cyclictest3987416-21latency_hist22:21:491
388562299162,10cyclictest3957162-21idleruntime-cro21:46:481
3885622991614,1cyclictest0-21swapper/123:16:361
3885622991613,2cyclictest3896962-21unixbench_singl19:41:541
3885622991612,3cyclictest0-21swapper/119:56:481
3885622991611,4cyclictest3907652-21cron20:16:481
388562299161,12cyclictest4040195-21/usr/sbin/munin23:21:511
3885622991610,4cyclictest3970755-21grep22:01:521
388562199169,4cyclictest0-21swapper/019:31:480
388562199165,1cyclictest0-21swapper/019:35:400
388562199162,11cyclictest3975270-21/usr/sbin/munin22:06:560
388562199162,11cyclictest3911247-21cat20:26:480
388562199161,6cyclictest3907418-21/usr/sbin/munin20:16:450
3885621991615,1cyclictest0-21swapper/021:41:520
388562199161,3cyclictest3899209-21ethtool19:51:410
3885621991611,2cyclictest3886377-21unixbench_multi19:11:550
388562499152,7cyclictest0-21swapper/323:21:403
388562499151,9cyclictest0-21swapper/322:16:493
388562499151,4cyclictest0-21swapper/300:21:533
388562499151,3cyclictest0-21swapper/323:36:383
388562399154,7cyclictest3916147-21wc20:41:492
388562399153,8cyclictest4039473-21/usr/sbin/munin23:21:412
388562399153,8cyclictest3906139-21idleruntime-cro20:11:492
3885623991512,2cyclictest4005450-21grep22:41:522
388562399151,13cyclictest4009917-21/usr/sbin/munin22:46:562
388562399151,11cyclictest4103076-21/usr/sbin/munin00:36:502
3885623991511,1cyclictest0-21swapper/222:06:412
388562399150,13cyclictest4003699-21/usr/sbin/munin22:41:452
388562299156,7cyclictest271ktimers/100:17:521
388562299155,8cyclictest4049241-21grep23:31:491
388562299155,7cyclictest3912900-21latency_hist20:31:491
388562299154,9cyclictest3939424-21ntpq21:26:471
388562299154,9cyclictest3911056-21true20:26:481
388562299154,8cyclictest4106084-21/usr/sbin/munin00:41:441
388562299153,10cyclictest3904673-21/usr/sbin/munin20:06:481
388562299152,8cyclictest4066668-21needreboot23:51:471
388562299152,7cyclictest4094647-21/usr/sbin/munin00:26:351
388562299151,9cyclictest3889556-21cut19:21:481
3885622991512,2cyclictest3921565-21grep20:56:551
388562199159,5cyclictest3914398-21ntpq20:36:480
388562199158,3cyclictest0-21swapper/022:06:360
388562199152,8cyclictest4008694-21awk22:46:440
388562199152,6cyclictest3923707-21/usr/sbin/munin21:06:400
3885621991511,3cyclictest3888278-21sshd19:16:570
388562199151,13cyclictest0-21swapper/021:56:510
112299150,2rtkit-daemon1121-21rtkit-daemon21:44:482
388562499143,9cyclictest0-21swapper/319:16:583
388562499143,7cyclictest0-21swapper/322:11:473
388562499141,4cyclictest0-21swapper/323:41:373
388562499141,2cyclictest0-21swapper/323:01:443
388562499141,2cyclictest0-21swapper/319:31:483
388562499141,1cyclictest0-21swapper/322:31:343
388562499141,11cyclictest0-21swapper/321:16:493
388562499141,10cyclictest0-21swapper/323:06:493
388562499140,1cyclictest0-21swapper/300:06:553
388562399149,4cyclictest3921540-21unixbench_singl20:56:552
388562399149,2cyclictest0-21swapper/223:31:532
388562399148,3cyclictest0-21swapper/220:51:522
388562399145,6cyclictest3948584-21munin-run21:36:482
388562399143,10cyclictest3891244-21/usr/sbin/munin19:26:472
388562399142,8cyclictest3944207-21ntpq21:31:492
388562399142,7cyclictest3889605-21latency_hist19:21:482
388562399141,11cyclictest3925971-21cut21:11:492
388562399141,11cyclictest3887118-21fschecks_time19:16:412
3885623991410,3cyclictest3966512-21grep21:56:522
388562299142,9cyclictest3965682-21ssh21:56:451
388562299141,4cyclictest3892558-21grep19:31:421
388562299141,4cyclictest0-21swapper/100:06:551
3885622991411,2cyclictest3905167-21unixbench_singl20:06:531
3885622991411,2cyclictest0-21swapper/119:26:461
3885622991410,3cyclictest3926554-21unixbench_singl21:11:551
3885622991410,2cyclictest1001-21mta-sts-daemon19:56:521
3885622991410,2cyclictest0-21swapper/120:41:461
388562199148,3cyclictest3919597-21mailstats20:51:510
388562199147,4cyclictest3885620-21cyclictest20:31:480
3885621991411,2cyclictest0-21swapper/020:36:540
3885621991411,0cyclictest0-21swapper/000:40:460
3885621991410,3cyclictest0-21swapper/019:26:410
388562199140,7cyclictest3922686-21ntpq21:01:490
112299140,5rtkit-daemon1003-21mta-sts-daemon23:36:502
112299140,1rtkit-daemon0-21swapper/220:44:062
388562499134,5cyclictest0-21swapper/321:16:393
388562499133,3cyclictest0-21swapper/322:56:443
388562499132,8cyclictest0-21swapper/322:46:403
388562499132,6cyclictest0-21swapper/319:26:443
388562499132,6cyclictest0-21swapper/300:37:583
388562499132,5cyclictest0-21swapper/321:36:363
388562499132,2cyclictest0-21swapper/323:31:433
388562499132,2cyclictest0-21swapper/320:41:473
388562499132,1cyclictest0-21swapper/322:21:423
388562499131,9cyclictest0-21swapper/319:11:483
388562499131,3cyclictest0-21swapper/321:06:503
388562499131,3cyclictest0-21swapper/300:01:443
388562499131,2cyclictest0-21swapper/323:41:523
388562499131,2cyclictest0-21swapper/322:51:483
388562499131,1cyclictest0-21swapper/323:46:533
388562499131,1cyclictest0-21swapper/300:21:453
388562499130,4cyclictest0-21swapper/300:31:383
388562499130,3cyclictest0-21swapper/322:36:493
388562499130,2cyclictest0-21swapper/323:21:553
388562399139,1cyclictest0-21swapper/220:16:402
388562399137,3cyclictest0-21swapper/220:01:472
388562399135,4cyclictest3931144-21/usr/sbin/munin21:16:502
388562399133,7cyclictest4062231-21/usr/sbin/munin23:46:492
388562399133,5cyclictest3893098-21latency_hist19:31:482
388562399131,8cyclictest3935551-21/usr/sbin/munin21:21:532
388562399131,11cyclictest3899021-21grep19:51:392
3885623991310,2cyclictest3913345-21unixbench_singl20:31:532
3885623991310,2cyclictest1003-21mta-sts-daemon20:01:512
388562299138,3cyclictest4009869-21grep22:46:551
388562299137,5cyclictest0-21swapper/120:41:491
388562299134,5cyclictest3920675-21/usr/sbin/munin20:56:441
388562299133,8cyclictest3925813-21/usr/sbin/munin21:11:481
388562299131,7cyclictest3935170-21ntpq21:21:481
388562299131,10cyclictest3960964-21/usr/sbin/munin21:51:431
3885622991310,3cyclictest3896169-21ntp_kernel_pll_19:41:471
3885622991310,2cyclictest0-21swapper/120:16:551
388562199139,3cyclictest0-21swapper/019:36:500
388562199134,5cyclictest3916228-21/usr/sbin/munin20:41:490
388562199132,7cyclictest3957464-21/usr/sbin/munin21:46:500
388562199131,8cyclictest3937059-21ssh21:24:040
388562499125,3cyclictest0-21swapper/321:36:493
388562499123,6cyclictest0-21swapper/320:46:433
388562499123,6cyclictest0-21swapper/319:56:483
388562499123,3cyclictest0-21swapper/321:56:343
388562499122,7cyclictest0-21swapper/300:36:373
388562499122,5cyclictest0-21swapper/321:46:503
388562499122,5cyclictest0-21swapper/320:51:493
388562499122,2cyclictest0-21swapper/323:06:523
388562499122,2cyclictest0-21swapper/320:36:483
388562499122,2cyclictest0-21swapper/320:26:483
388562499122,2cyclictest0-21swapper/319:36:463
388562499121,8cyclictest0-21swapper/320:11:483
388562499121,4cyclictest0-21swapper/321:46:473
388562499121,2cyclictest0-21swapper/322:41:353
388562499121,2cyclictest0-21swapper/319:11:563
388562499120,4cyclictest0-21swapper/322:21:563
388562499120,4cyclictest0-21swapper/300:16:443
388562499120,3cyclictest0-21swapper/320:06:463
388562499120,2cyclictest0-21swapper/322:06:493
388562399129,2cyclictest3894154-21gltestperf19:36:412
388562399126,4cyclictest4102003-21/usr/sbin/munin00:36:372
388562399122,8cyclictest4074915-21aten2.4-expect00:01:412
388562399121,9cyclictest3911796-21/usr/sbin/munin20:31:342
388562399121,4cyclictest3957497-21proc_pri21:46:512
388562399121,10cyclictest3897422-21grep19:46:382
388562399120,11cyclictest4061305-21/usr/sbin/munin23:46:442
388562299126,4cyclictest3966515-21unixbench_multi21:56:521
388562299122,8cyclictest4102428-21/usr/sbin/munin00:36:441
388562299122,8cyclictest3916702-21/usr/sbin/munin20:46:541
388562299122,8cyclictest3893774-21/usr/sbin/munin19:36:371
388562299122,7cyclictest3913678-21/usr/sbin/munin20:36:391
388562199129,2cyclictest0-21swapper/019:41:510
388562199123,4cyclictest0-21swapper/020:51:490
388562499113,5cyclictest0-21swapper/321:26:523
388562499113,4cyclictest0-21swapper/320:16:533
388562499112,6cyclictest0-21swapper/321:01:483
388562499112,4cyclictest0-21swapper/320:56:493
388562499112,2cyclictest0-21swapper/320:31:393
388562499112,2cyclictest0-21swapper/320:01:353
388562499111,2cyclictest0-21swapper/321:21:543
388562499111,2cyclictest0-21swapper/300:06:393
388562499111,1cyclictest0-21swapper/322:01:403
388562499111,1cyclictest0-21swapper/319:36:493
388562499110,6cyclictest0-21swapper/319:51:423
388562499110,3cyclictest0-21swapper/319:46:383
388562399111,8cyclictest3885847-21cut19:11:492
388562299112,4cyclictest3885562-21strings19:11:481
388562299111,8cyclictest3898823-21aten_r2power_vo19:51:371
388562499102,6cyclictest0-21swapper/321:01:503
388562499101,3cyclictest0-21swapper/320:16:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional