You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-12 - 12:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Wed Nov 12, 2025 00:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3399812996329,31cyclictest3488689-21ntpq22:08:060
339981299485,11cyclictest3501871-21/usr/sbin/munin22:23:010
339981299412,2cyclictest3607801-21ntpq00:18:010
3399812994029,10cyclictest3542071-21cut23:05:500
3399812994023,4cyclictest11050irq/107-eth%d00:30:500
3399813993925,10cyclictest3502842-21sh22:23:011
339981299382,7cyclictest0-21swapper/022:45:020
339981299382,33cyclictest3505080-21sendmail-msp22:27:590
339981299382,33cyclictest3505080-21sendmail-msp22:27:590
339981299373,22cyclictest11050irq/107-eth%d21:38:010
339981299368,20cyclictest111788-21systemd-journal22:15:530
339981299363,18cyclictest3399768-21munin-run19:15:490
339981299352,31cyclictest3596864-21sendmail-msp00:14:010
339981299341,7cyclictest3585393-21ntpq23:53:020
339981299324,15cyclictest0-21swapper/021:32:550
339981299322,29cyclictest0-21swapper/022:47:540
3399812993217,13cyclictest259-21jbd2/mmcblk0p2-819:46:480
3399813993022,4cyclictest0-21swapper/123:25:501
3399813993018,7cyclictest3613828-21sendmail-msp00:25:521
3399813993016,9cyclictest111788-21systemd-journal23:53:021
3399812993025,4cyclictest0-21swapper/020:10:550
3399812993024,6cyclictest0-21swapper/023:48:070
339981299295,13cyclictest0-21swapper/023:23:020
3399812992926,2cyclictest0-21swapper/000:42:590
339981499287,5cyclictest0-21swapper/200:30:502
3399812992816,2cyclictest3626269-21latency_hist00:40:490
339981499276,14cyclictest3597072-21ssh00:05:502
3399813992716,8cyclictest0-21swapper/123:37:591
339981299275,18cyclictest111788-21systemd-journal20:48:340
3399812992722,1cyclictest3516378-21irqstats22:37:590
339981299271,15cyclictest3511605-21sed22:32:570
339981299270,11cyclictest3621497-21ssh00:34:490
339981399267,11cyclictest1007-21mta-sts-daemon20:10:551
339981299266,1cyclictest3564334-1kworker/0:0H+kblockd00:05:500
339981299263,16cyclictest111788-21systemd-journal23:25:500
339981299262,10cyclictest3547744-21aten2.4-expect23:12:530
339981299261,21cyclictest3589916-21ntpq23:57:580
112699260,3rtkit-daemon1125-21rtkit-daemon22:11:292
339981499253,8cyclictest0-21swapper/222:42:562
112699250,3rtkit-daemon1125-21rtkit-daemon19:46:081
339981399240,8cyclictest171rcu_preempt23:05:501
339981499233,18cyclictest3495881-21store22:15:502
339981399235,4cyclictest11050irq/107-eth%d22:38:031
339981399232,4cyclictest171rcu_preempt00:42:581
3399813992319,3cyclictest3401965-21fschecks_count19:22:541
339981299238,10cyclictest3492034-21ssh22:12:240
339981299236,13cyclictest3472953-21ssh21:51:140
339981499224,16cyclictest3589917-21sed23:57:582
339981499224,14cyclictest3488694-21ssh22:08:062
339981499223,11cyclictest3449461-21sendmail-msp21:33:032
339981399224,12cyclictest3511123-21/usr/sbin/munin22:32:531
339981399224,10cyclictest0-21swapper/122:28:021
339981399224,10cyclictest0-21swapper/122:28:021
3399813992214,5cyclictest3553000-21sh23:17:581
339981299223,18cyclictest0-21swapper/021:58:050
3399814992117,3cyclictest3428535-21cron20:40:492
339981399213,15cyclictest3486324-21sendmail-msp22:13:031
339981399212,13cyclictest3454204-21latency_hist21:30:501
339981299212,17cyclictest3447223-21ntp_states21:23:020
339981299211,9cyclictest0-21swapper/000:23:070
339981299211,16cyclictest3454203-21latency_hist21:30:500
339981299210,20cyclictest0-21swapper/022:02:000
339981499207,11cyclictest3541863-21sendmail-msp23:08:012
339981499202,15cyclictest3576277-21ntpq23:43:002
3399814992011,7cyclictest3436800-21sendmail-msp21:08:382
339981399204,13cyclictest1008-21mta-sts-daemon23:32:271
339981399202,4cyclictest11050irq/107-eth%d00:18:011
3399813992013,6cyclictest3430219-21sendmail-msp20:48:001
339981499197,9cyclictest3552712-21/usr/sbin/munin23:17:552
339981499192,7cyclictest11050irq/107-eth%d21:57:512
339981499192,11cyclictest764-21rs:main2
3399814991914,4cyclictest1005-21mta-sts-daemon21:22:582
339981499190,3cyclictest3603703-21ntpq00:13:042
339981399198,5cyclictest259-21jbd2/mmcblk0p2-800:34:491
339981399195,10cyclictest3600760-21ssh00:09:421
339981399192,12cyclictest762-21in:imuxsock21:32:211
339981399192,12cyclictest3603697-21ssh00:13:041
3399813991916,2cyclictest0-21swapper/120:17:551
3399813991915,2cyclictest0-21swapper/121:23:021
339981299198,4cyclictest0-21swapper/019:18:040
339981299193,15cyclictest3442385-21/usr/sbin/munin21:17:590
3399812991911,5cyclictest11650irq/162-mmc023:30:500
339981499184,11cyclictest1007-21mta-sts-daemon00:23:022
339981499183,1cyclictest11050irq/107-eth%d23:22:552
339981499182,12cyclictest111788-21systemd-journal20:53:042
339981499181,4cyclictest0-21swapper/222:57:582
3399814991813,3cyclictest3502242-21fschecks_time22:22:552
3399814991811,6cyclictest3430219-21sendmail-msp20:48:342
339981499180,17cyclictest3422503-21cut20:22:562
339981399186,6cyclictest764-21rs:main1
339981399183,11cyclictest3529869-21ssh22:52:551
3399813991812,5cyclictest3435157-21cat21:00:491
339981299185,5cyclictest3576127-21ssh23:42:580
339981299184,7cyclictest3594504-21ssh00:02:580
339981299182,11cyclictest3530896-21/usr/sbin/munin22:53:060
3399812991815,2cyclictest3433400-21unixbench_multi20:53:100
112699180,8rtkit-daemon0-21swapper/021:45:500
339981499174,10cyclictest3453384-21ssh21:29:442
339981499172,9cyclictest3438951-21fschecks_count21:12:542
339981499172,10cyclictest3585410-21gcc23:53:022
339981499172,10cyclictest3442453-21ssh21:18:002
3399814991713,3cyclictest3416578-21grep20:03:082
339981499171,2cyclictest259-21jbd2/mmcblk0p2-822:28:342
339981499171,2cyclictest259-21jbd2/mmcblk0p2-822:28:342
339981399174,8cyclictest3438778-21/usr/sbin/munin21:12:521
339981399174,11cyclictest3580970-21ssh23:48:031
339981399173,11cyclictest3479463-21ntp_offset21:57:591
339981399173,10cyclictest3466488-21ssh21:43:321
339981399171,5cyclictest11050irq/107-eth%d23:10:021
3399813991714,2cyclictest3474435-21gltestperf21:52:561
3399813991712,3cyclictest0-21swapper/100:23:071
3399813991711,3cyclictest3590289-21find23:58:041
339981399171,11cyclictest111788-21systemd-journal20:28:011
339981399171,10cyclictest3523404-21sendmail-msp22:47:541
339981299178,7cyclictest3396830-1kworker/0:2H+kblockd19:28:010
339981299173,13cyclictest3407009-21fschecks_time19:37:580
3399812991715,2cyclictest0-21swapper/023:37:580
339981299171,4cyclictest3425331-21latency_hist20:30:490
339981299171,14cyclictest3435276-21grep21:00:500
3399812991710,4cyclictest0-21swapper/020:07:540
3399812991710,4cyclictest0-21swapper/020:07:540
339981599162,7cyclictest0-21swapper/322:06:503
339981499169,5cyclictest0-21swapper/200:33:032
339981499166,9cyclictest3474734-21/usr/sbin/munin21:52:582
339981499165,8cyclictest3463102-21ssh21:40:352
339981499162,9cyclictest3525003-21ssh22:47:542
3399814991613,2cyclictest3401383-21unixbench_singl19:18:052
339981399164,8cyclictest111788-21systemd-journal19:53:001
339981399164,5cyclictest3403124-21sendmail-msp19:33:001
339981399161,11cyclictest3400392-21fschecks_time19:17:551
3399813991610,4cyclictest0-21swapper/121:47:581
339981299168,3cyclictest0-21swapper/019:22:520
339981299163,10cyclictest3470858-21/usr/sbin/munin21:48:070
339981299160,9cyclictest0-21swapper/023:10:500
339981299160,15cyclictest0-21swapper/020:37:550
112699160,1rtkit-daemon0-21swapper/119:14:211
339981599153,7cyclictest0-21swapper/322:32:533
339981599153,6cyclictest0-21swapper/323:17:583
339981499159,4cyclictest0-21swapper/223:35:502
339981499154,8cyclictest3512387-21ssh22:33:072
339981499154,8cyclictest3414503-21/usr/sbin/munin19:58:052
339981499154,8cyclictest0-21swapper/220:43:002
339981499153,8cyclictest3541863-21sendmail-msp23:11:392
339981499153,8cyclictest3416991-21/usr/sbin/munin20:07:542
339981499153,8cyclictest3416991-21/usr/sbin/munin20:07:542
339981499153,10cyclictest3570815-21aten_r2power_vo23:37:532
339981499153,10cyclictest3562289-21ssh23:28:022
339981499152,9cyclictest3483438-21/usr/sbin/munin22:02:542
339981499152,9cyclictest3465546-21/usr/sbin/munin21:42:592
339981499152,8cyclictest3626193-21latency_hist00:40:492
339981499152,8cyclictest3580105-21telnet23:47:542
339981499152,11cyclictest3408387-21/usr/sbin/munin19:42:542
339981499151,13cyclictest2243333-21munin-node20:10:542
339981499150,13cyclictest3608218-21ssh00:18:052
339981399153,8cyclictest3535156-21awk22:57:591
339981399152,9cyclictest3578660-21latency_hist23:45:501
339981399152,9cyclictest3436935-21grep21:05:491
339981399152,9cyclictest3436935-21grep21:05:491
3399813991512,2cyclictest3426844-21unixbench_singl20:33:071
339981299153,2cyclictest3535397-21systemctl22:58:020
339981299152,9cyclictest967-21snmpd21:07:560
339981299151,6cyclictest0-21swapper/023:17:010
339981599145,6cyclictest0-21swapper/323:57:583
339981599144,4cyclictest0-21swapper/320:00:513
339981599143,7cyclictest0-21swapper/322:15:503
339981599143,4cyclictest0-21swapper/300:05:503
339981599142,6cyclictest0-21swapper/321:52:563
339981499148,4cyclictest3628774-21grep00:43:042
339981499145,4cyclictest3405909-21/usr/sbin/munin19:33:022
339981499144,5cyclictest3421474-21/usr/sbin/munin20:18:002
339981499143,10cyclictest3595176-21ssh00:03:052
339981499141,9cyclictest3401718-21aten_r2power_cu19:22:522
339981499141,3cyclictest3469302-21ssh21:47:502
3399814991411,2cyclictest1005-21mta-sts-daemon21:02:592
3399814991411,2cyclictest1005-21mta-sts-daemon21:02:592
3399814991411,2cyclictest1005-21mta-sts-daemon20:32:562
339981499140,4cyclictest3539042-21ssh23:02:552
339981399149,4cyclictest3438347-21unixbench_multi21:08:101
339981399143,9cyclictest3497693-21grep22:17:551
339981399143,9cyclictest1008-21mta-sts-daemon19:43:001
339981399142,9cyclictest3415510-21/usr/sbin/munin20:02:581
339981399142,7cyclictest3523370-21munin-run22:45:491
339981399142,7cyclictest3487148-21ssh22:06:501
339981399141,9cyclictest3623620-21fschecks_count00:37:551
339981399141,7cyclictest3414693-21unin-run20:00:491
3399813991411,3cyclictest3404173-21ntp_kernel_pll_19:28:001
339981399141,12cyclictest3432409-21grep20:52:591
339981399140,5cyclictest0-21swapper/120:42:581
339981299148,1cyclictest0-21swapper/019:57:580
339981299143,9cyclictest3422776-21/usr/sbin/munin20:22:580
339981299143,7cyclictest3420542-21/usr/sbin/munin20:17:540
339981299142,5cyclictest3439616-21/usr/sbin/munin21:13:030
339981299142,10cyclictest111788-21systemd-journal20:32:580
3399812991412,1cyclictest0-21swapper/020:03:020
3399812991411,2cyclictest3430111-21unixbench_singl20:43:100
339981599135,4cyclictest0-21swapper/322:13:033
339981599132,5cyclictest0-21swapper/323:53:023
339981599132,5cyclictest0-21swapper/322:42:533
339981599132,5cyclictest0-21swapper/321:42:533
339981599131,5cyclictest0-21swapper/323:26:543
339981499135,6cyclictest111788-21systemd-journal19:48:022
339981499132,10cyclictest3424214-21cut20:27:552
339981499130,10cyclictest3516128-21fschecks_time22:37:572
339981399137,4cyclictest0-21swapper/100:03:001
339981399135,6cyclictest3460107-21/usr/sbin/munin21:38:001
339981399131,11cyclictest3427437-21tune2fs20:37:571
339981299137,1cyclictest3435354-21/usr/sbin/munin21:02:570
339981299137,1cyclictest3435354-21/usr/sbin/munin21:02:570
339981299134,7cyclictest3409716-21unin-run19:45:500
339981299133,8cyclictest3406236-21/usr/sbin/munin19:33:060
339981599125,4cyclictest0-21swapper/300:13:043
339981599123,6cyclictest0-21swapper/320:13:043
339981599123,5cyclictest0-21swapper/322:38:053
339981599123,4cyclictest0-21swapper/322:25:533
339981599123,4cyclictest0-21swapper/322:25:533
339981599122,6cyclictest0-21swapper/300:30:503
339981599122,5cyclictest0-21swapper/300:18:013
339981599121,7cyclictest0-21swapper/323:37:593
339981599121,6cyclictest0-21swapper/322:23:013
339981599121,6cyclictest0-21swapper/321:27:583
339981599121,5cyclictest0-21swapper/323:42:593
339981599121,5cyclictest0-21swapper/319:22:573
339981499127,3cyclictest3530359-21/usr/sbin/munin22:52:582
339981499121,9cyclictest3433714-21/usr/sbin/munin20:57:522
339981499121,10cyclictest3411671-21/usr/sbin/munin19:52:522
339981399125,5cyclictest3441862-21fschecks_count21:17:561
339981399122,9cyclictest3557573-21ssh23:23:011
339981399122,9cyclictest3406984-21grep19:37:581
3399813991210,1cyclictest0-21swapper/122:02:581
339981399120,10cyclictest3417237-21tune2fs20:07:571
339981399120,10cyclictest3417237-21tune2fs20:07:571
339981299129,2cyclictest3411707-21cut19:52:520
339981599114,5cyclictest0-21swapper/319:46:483
339981599114,4cyclictest0-21swapper/323:48:033
339981599113,4cyclictest0-21swapper/322:02:543
339981599112,7cyclictest0-21swapper/321:33:033
339981599112,6cyclictest0-21swapper/319:37:573
339981599112,4cyclictest0-21swapper/320:42:593
339981599111,6cyclictest0-21swapper/323:03:033
339981599111,4cyclictest0-21swapper/323:22:553
339981599111,4cyclictest0-21swapper/320:32:543
339981499114,5cyclictest1008-21mta-sts-daemon19:37:582
339981399111,8cyclictest3422219-21/usr/sbin/munin20:22:541
339981599105,3cyclictest0-21swapper/300:33:013
339981599104,4cyclictest0-21swapper/323:30:503
339981599104,3cyclictest0-21swapper/322:57:583
339981599103,4cyclictest0-21swapper/319:18:013
339981599103,3cyclictest0-21swapper/320:17:533
339981599103,3cyclictest0-21swapper/319:52:553
339981599102,5cyclictest0-21swapper/322:52:593
339981599102,5cyclictest0-21swapper/321:12:563
339981599102,5cyclictest0-21swapper/320:48:023
339981599102,5cyclictest0-21swapper/300:43:053
339981599102,4cyclictest0-21swapper/323:11:393
339981599102,4cyclictest0-21swapper/320:53:023
339981599102,4cyclictest0-21swapper/319:33:003
339981599102,3cyclictest0-21swapper/300:01:443
339981599101,5cyclictest0-21swapper/322:47:543
339981599101,5cyclictest0-21swapper/319:58:023
339981599101,4cyclictest0-21swapper/321:37:213
339981599100,5cyclictest0-21swapper/321:57:533
339981499103,4cyclictest0-21swapper/219:15:492
33998159993,3cyclictest0-21swapper/319:27:533
33998159992,4cyclictest0-21swapper/320:57:533
33998159992,4cyclictest0-21swapper/300:20:523
33998159992,3cyclictest0-21swapper/323:10:023
33998159992,3cyclictest0-21swapper/321:22:373
33998159991,6cyclictest0-21swapper/321:47:133
33998159991,5cyclictest0-21swapper/321:02:573
33998159991,5cyclictest0-21swapper/321:02:573
33998159991,5cyclictest0-21swapper/319:42:543
33998159991,3cyclictest0-21swapper/320:27:353
33998159990,4cyclictest0-21swapper/321:07:563
33998159984,3cyclictest0-21swapper/300:37:543
33998159983,4cyclictest0-21swapper/320:07:543
33998159983,4cyclictest0-21swapper/320:07:543
33998159982,4cyclictest0-21swapper/320:37:563
33998159980,4cyclictest0-21swapper/321:16:353
33998159972,3cyclictest0-21swapper/320:22:543
33998159951,3cyclictest0-21swapper/319:15:493
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional