You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 19:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Mon Nov 24, 2025 12:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
264660199421,24cyclictest0-21swapper/012:26:080
2646601993914,4cyclictest0-21swapper/009:41:020
264660399349,3cyclictest171rcu_preempt10:48:071
264660199333,9cyclictest2679738-21ntp_states08:53:050
264660199321,21cyclictest2813355-21grep11:58:030
2646603993124,5cyclictest1007-21mta-sts-daemon10:38:051
264660199313,26cyclictest0-21swapper/009:53:070
2646604993025,4cyclictest0-21swapper/210:14:122
264660199301,3cyclictest2783997-21latency_hist11:21:000
2646601993012,4cyclictest0-21swapper/010:08:070
2646604992926,1cyclictest0-21swapper/212:18:042
2646603992918,8cyclictest0-21swapper/110:08:071
2646601992925,2cyclictest2653745-21latency_hist07:36:000
264660199290,20cyclictest2729576-1kworker/0:2H+mmc_complete10:27:580
264660399282,5cyclictest171rcu_preempt08:35:591
264660199284,3cyclictest0-21swapper/011:33:120
264660199282,16cyclictest2785063-21/usr/sbin/munin11:22:580
2646601992816,9cyclictest2841510-21ssh12:31:050
264660199281,20cyclictest2848354-21grep12:38:120
2646603992720,4cyclictest28-21ksoftirqd/112:18:041
2646601992719,3cyclictest2668631-21sed08:18:110
2646601992715,9cyclictest2700112-21ntpq09:33:050
2646604992622,3cyclictest0-21swapper/211:11:012
2646603992612,2cyclictest11050irq/107-eth%d11:30:101
264660399261,21cyclictest111788-21systemd-journal10:13:081
2646601992612,9cyclictest2800470-21dpkg11:41:010
264660199261,0cyclictest0-21swapper/010:59:360
264660499257,13cyclictest2243333-21munin-node07:36:032
2646601992520,1cyclictest0-21swapper/011:38:050
264660199251,23cyclictest2648351-21timerwakeupswit07:18:100
264660199250,22cyclictest0-21swapper/009:41:000
264660499236,0cyclictest11050irq/107-eth%d12:36:032
2646604992311,9cyclictest11050irq/107-eth%d10:18:072
264660199239,9cyclictest2822055-21tr12:08:030
264660199239,1cyclictest0-21swapper/009:23:040
264660199231,2cyclictest2711170-21fschecks_time09:48:050
2646601992312,3cyclictest2738131-21/usr/sbin/munin10:23:020
264660199231,21cyclictest0-21swapper/009:56:010
2646604992213,5cyclictest259-21jbd2/mmcblk0p2-809:33:052
2646603992212,8cyclictest0-21swapper/110:03:061
264660199222,16cyclictest967-21snmpd10:18:060
2646601992214,5cyclictest2756239-21sendmail-msp10:46:520
264660199220,13cyclictest2730819-21ntpq10:13:080
264660499216,9cyclictest0-21swapper/207:16:002
264660499213,13cyclictest2799884-21apt-get11:41:012
264660499212,14cyclictest2841388-21apt-config12:31:012
2646604992110,6cyclictest0-21swapper/212:27:592
264660499210,2cyclictest2762200-21ntpq10:53:052
264660399212,13cyclictest2709600-21sendmail-msp09:52:201
264660199213,16cyclictest2729576-1kworker/0:2H+kblockd10:46:000
2646601992119,1cyclictest2774843-21cat11:08:140
2646604992012,6cyclictest0-21swapper/207:16:012
264660399207,12cyclictest762-21in:imuxsock11:53:091
264660399203,13cyclictest2786002-21ssh11:23:071
2646603992016,2cyclictest2807717-21cron11:51:001
264660199204,10cyclictest2762196-21ssh10:53:050
264660199201,6cyclictest0-21swapper/008:08:140
264660199201,18cyclictest2749841-21ssh10:38:010
264660199201,11cyclictest2817415-21/usr/sbin/munin12:02:580
264660199200,20cyclictest0-21swapper/009:08:070
2646604991916,2cyclictest2821803-21fschecks_time12:08:012
2646604991914,4cyclictest1008-21mta-sts-daemon09:53:042
264660399196,8cyclictest2657166-21sendmail-msp07:46:161
264660399193,12cyclictest2845842-21ssh12:36:031
264660399192,14cyclictest122792-21ntpd10:28:071
264660399192,11cyclictest2836889-21sendmail-msp12:34:191
264660399192,11cyclictest11050irq/107-eth%d09:41:021
2646603991914,3cyclictest0-21swapper/111:33:371
264660199195,9cyclictest2646597-21unin-run07:16:000
2646601991912,6cyclictest2772270-21sendmail-msp11:13:020
264660199190,11cyclictest2725017-21idleruntime-cro10:06:000
264660599184,9cyclictest0-21swapper/312:31:063
264660499188,6cyclictest619-21mta-sts-daemon10:48:072
264660499187,8cyclictest0-21swapper/210:27:162
264660499186,7cyclictest2798008-21kernelversion11:38:032
264660499183,9cyclictest111788-21systemd-journal08:13:102
264660499182,10cyclictest111788-21systemd-journal09:26:012
264660399182,15cyclictest2647139-21apt-get07:16:021
264660399182,12cyclictest11050irq/107-eth%d10:18:051
2646603991815,2cyclictest2664314-21fschecks_time08:08:031
264660199184,8cyclictest2851560-21cut12:43:010
264660199182,11cyclictest2770183-21ssh11:03:050
2646601991810,5cyclictest0-21swapper/008:48:000
264660499178,8cyclictest2817454-21fschecks_count12:02:592
264660499174,7cyclictest2769621-21/usr/sbin/munin11:03:012
264660499173,8cyclictest111788-21systemd-journal11:46:262
264660499173,12cyclictest2719555-21/usr/sbin/munin09:58:102
264660499173,12cyclictest2703206-21/usr/sbin/munin09:38:002
264660499171,3cyclictest2749721-21aten_r2power_vo10:38:002
264660499171,13cyclictest2728467-21rm10:10:162
264660399173,8cyclictest0-21swapper/109:33:011
264660399173,7cyclictest2852382-21ssh12:43:101
264660399173,7cyclictest2803892-21ssh11:45:211
264660399173,11cyclictest111788-21systemd-journal11:16:081
264660399172,12cyclictest3763566-1kworker/1:0H+kblockd08:53:051
264660399172,11cyclictest2772270-21sendmail-msp11:06:101
264660399172,11cyclictest2662679-21fschecks_time08:03:011
2646603991713,3cyclictest2739127-21unixbench_multi10:23:121
2646603991710,5cyclictest2651212-21needreboot07:28:051
2646601991715,1cyclictest0-21swapper/011:53:010
2646601991713,3cyclictest0-21swapper/007:36:020
264660599162,9cyclictest0-21swapper/312:28:093
264660599162,8cyclictest0-21swapper/308:03:113
264660499167,6cyclictest1007-21mta-sts-daemon11:53:072
264660499163,7cyclictest2709600-21sendmail-msp09:46:252
264660499163,12cyclictest2692477-21/usr/sbin/munin09:23:032
264660499163,10cyclictest2688275-21/usr/sbin/munin09:18:002
264660499162,9cyclictest2674287-21/usr/sbin/munin08:38:012
264660499162,9cyclictest111788-21systemd-journal08:48:092
264660499161,10cyclictest2706310-21apt-get09:41:022
264660399163,10cyclictest2746550-21ntpq10:33:081
264660399162,11cyclictest2654482-21sshd07:38:011
2646603991613,2cyclictest0-21swapper/112:09:461
2646603991612,3cyclictest2652385-21fschecks_count07:33:011
264660399161,10cyclictest2761316-21/usr/sbin/munin10:53:111
264660399160,11cyclictest2706138-21cat09:41:001
264660199169,1cyclictest0-21swapper/009:31:000
264660199165,8cyclictest0-21swapper/011:46:260
264660199162,8cyclictest2825666-21/usr/sbin/munin12:13:100
2646601991611,4cyclictest2670595-21/usr/sbin/munin08:27:590
2646601991611,4cyclictest2670595-21/usr/sbin/munin08:27:590
2646601991610,5cyclictest2680763-21fschecks_count08:58:020
112699160,1rtkit-daemon0-21swapper/008:33:280
264660599155,4cyclictest0-21swapper/309:41:023
264660599154,6cyclictest0-21swapper/310:33:053
264660599153,6cyclictest0-21swapper/312:45:443
264660599153,5cyclictest0-21swapper/310:08:053
264660499155,7cyclictest2784998-21/usr/sbin/munin11:22:582
264660499154,9cyclictest1005-21mta-sts-daemon07:48:152
264660499154,6cyclictest2851548-21fschecks_count12:43:012
264660499153,6cyclictest2826636-21ntpq12:13:092
264660499153,10cyclictest619-21mta-sts-daemon11:33:112
264660499153,10cyclictest2777878-21fschecks_count11:13:042
264660499153,10cyclictest2684095-21cut09:08:032
264660499152,8cyclictest2679098-21/usr/sbin/munin08:52:572
264660499152,8cyclictest11050irq/107-eth%d10:33:082
264660499152,11cyclictest2657140-21awk07:46:002
264660499151,8cyclictest2670351-21sendmail-msp08:33:112
2646604991512,2cyclictest2781587-21gltestperf11:18:012
2646604991511,3cyclictest2723681-21unixbench_multi10:03:122
264660399156,6cyclictest2694398-21basename09:26:001
264660399153,8cyclictest2826569-21/usr/sbin/munin12:13:081
264660399153,7cyclictest111788-21systemd-journal09:48:231
264660399152,9cyclictest2695435-21/usr/sbin/munin09:28:101
2646603991512,1cyclictest0-21swapper/111:38:011
2646603991511,4cyclictest2676345-21ntp_kernel_pll_08:43:071
2646603991511,3cyclictest2765698-21grep10:58:011
2646603991511,3cyclictest2657022-21grep07:43:101
2646601991511,3cyclictest2651795-21unixbench_singl07:28:130
2646601991511,2cyclictest151ktimers/009:18:100
264660199150,12cyclictest2682946-21ntp_kernel_pll_09:03:160
112699150,2rtkit-daemon1125-21rtkit-daemon12:25:281
112699150,1rtkit-daemon0-21swapper/112:27:061
264660599144,7cyclictest0-21swapper/307:33:043
264660599144,5cyclictest0-21swapper/309:53:093
264660599143,5cyclictest0-21swapper/311:18:043
264660599143,5cyclictest0-21swapper/309:08:003
264660599142,6cyclictest0-21swapper/311:33:053
264660599141,8cyclictest0-21swapper/308:48:063
264660499148,3cyclictest2657166-21sendmail-msp07:53:062
264660499144,6cyclictest111788-21systemd-journal08:07:592
264660499143,9cyclictest2789323-21fschecks_count11:28:012
264660499143,7cyclictest2651866-21cut07:31:002
264660499142,8cyclictest2675845-21cut08:43:032
264660499142,8cyclictest0-21swapper/208:03:092
264660499141,9cyclictest259-21jbd2/mmcblk0p2-807:33:022
2646604991410,3cyclictest1008-21mta-sts-daemon11:58:092
264660399148,4cyclictest0-21swapper/109:58:021
264660399143,9cyclictest2667031-21munin-plugin-st08:16:001
264660399143,7cyclictest2813094-21/usr/sbin/munin11:57:591
2646603991410,3cyclictest0-21swapper/108:58:181
264660199149,3cyclictest0-21swapper/007:58:110
264660199142,9cyclictest2789869-21ntp_kernel_pll_11:28:060
264660199142,8cyclictest2834239-21/usr/sbin/munin12:22:590
264660199142,8cyclictest120491-21sshd08:13:060
264660199142,4cyclictest0-21swapper/012:18:070
264660199142,11cyclictest1008-21mta-sts-daemon09:13:060
264660199142,10cyclictest2657746-21fschecks_time07:48:090
264660199140,2cyclictest2746062-21grep10:33:030
264660599135,3cyclictest0-21swapper/312:36:033
264660599133,6cyclictest0-21swapper/308:53:053
264660599133,6cyclictest0-21swapper/308:36:003
264660599132,6cyclictest0-21swapper/312:13:093
264660599132,6cyclictest0-21swapper/310:28:073
264660599131,8cyclictest0-21swapper/310:13:083
264660599131,6cyclictest0-21swapper/310:48:073
264660599131,5cyclictest0-21swapper/308:58:033
264660499136,4cyclictest2765616-21/usr/sbin/munin10:58:002
264660499133,8cyclictest2649739-21/usr/sbin/munin07:23:062
264660499132,9cyclictest2738995-21ssh10:23:112
264660499132,8cyclictest2681541-21/usr/sbin/munin08:58:172
264660499132,8cyclictest2667585-21fschecks_count08:18:012
264660499131,9cyclictest2753277-21/usr/sbin/munin10:43:062
264660499131,8cyclictest2671700-21/usr/sbin/munin08:28:142
264660499131,8cyclictest2671700-21/usr/sbin/munin08:28:142
2646604991310,2cyclictest1006-21mta-sts-daemon07:58:062
264660399138,3cyclictest0-21swapper/108:18:011
264660399138,2cyclictest0-21swapper/108:38:031
264660399137,3cyclictest0-21swapper/107:23:041
264660399136,5cyclictest0-21swapper/111:03:011
264660399135,2cyclictest171rcu_preempt07:16:001
264660399134,5cyclictest2684738-21/usr/sbin/munin09:08:091
264660399133,8cyclictest762-21in:imuxsock11:13:141
264660399133,8cyclictest2671011-21sed08:28:031
264660399133,8cyclictest2671011-21sed08:28:031
264660399132,9cyclictest111788-21systemd-journal09:21:001
264660399131,9cyclictest2753306-21aten_r2power_cu10:42:591
264660399131,10cyclictest2818095-21ssh12:03:051
264660199133,8cyclictest2649159-21cut07:23:000
264660199131,7cyclictest2674166-21/usr/sbin/munin08:38:000
264660199131,10cyclictest967-21snmpd08:03:020
2646601991310,2cyclictest0-21swapper/008:43:070
264660199130,9cyclictest2659127-21basename07:52:590
264660599126,3cyclictest0-21swapper/311:41:013
264660599125,5cyclictest0-21swapper/308:43:073
264660599124,3cyclictest0-21swapper/312:03:053
264660599123,4cyclictest0-21swapper/308:23:013
264660599122,7cyclictest0-21swapper/311:53:023
264660599122,6cyclictest0-21swapper/310:38:053
264660599122,6cyclictest0-21swapper/310:18:033
264660599122,5cyclictest0-21swapper/310:03:003
264660599122,5cyclictest0-21swapper/309:33:013
264660599122,5cyclictest0-21swapper/309:03:053
264660599121,5cyclictest0-21swapper/309:13:033
264660499121,10cyclictest2670221-21sed08:23:122
264660399127,4cyclictest2677507-21cut08:48:031
264660399124,7cyclictest2660978-21grep07:58:011
264660399122,8cyclictest2670287-21/usr/sbin/munin08:23:121
264660399122,8cyclictest2659056-21/usr/sbin/munin07:52:581
264660399122,5cyclictest2683540-21idleruntime-cro09:06:001
264660199121,9cyclictest2656145-21head07:43:010
2646601991210,1cyclictest0-21swapper/008:23:050
264660599113,6cyclictest0-21swapper/309:18:023
264660599113,5cyclictest0-21swapper/308:38:013
264660599113,4cyclictest0-21swapper/307:57:593
264660599112,7cyclictest0-21swapper/310:42:593
264660599112,6cyclictest0-21swapper/312:08:013
264660599112,6cyclictest0-21swapper/307:36:023
264660599112,5cyclictest0-21swapper/307:52:583
264660599112,5cyclictest0-21swapper/307:16:013
264660599112,3cyclictest0-21swapper/309:37:593
264660599111,6cyclictest0-21swapper/312:18:043
264660599111,6cyclictest0-21swapper/309:48:053
264660599111,6cyclictest0-21swapper/309:28:103
264660599111,5cyclictest0-21swapper/307:43:053
264660599110,7cyclictest0-21swapper/310:23:053
264660499116,3cyclictest2683564-21sendmail-msp09:13:032
264660499111,9cyclictest2834103-21/usr/sbin/munin12:22:592
264660499110,8cyclictest2682480-21tune2fs09:03:122
264660399111,9cyclictest2685553-21/usr/sbin/munin09:12:591
264660599104,3cyclictest0-21swapper/311:03:053
264660599103,4cyclictest0-21swapper/311:13:063
264660599102,6cyclictest0-21swapper/311:48:123
264660599102,5cyclictest0-21swapper/312:23:043
264660599102,5cyclictest0-21swapper/310:53:053
264660599102,5cyclictest0-21swapper/309:23:063
264660599102,4cyclictest0-21swapper/311:11:013
264660599102,3cyclictest0-21swapper/307:16:013
264660599101,5cyclictest0-21swapper/311:28:083
264660599101,5cyclictest0-21swapper/311:22:583
264660599100,6cyclictest0-21swapper/311:58:403
264660599100,6cyclictest0-21swapper/309:57:583
264660599100,5cyclictest0-21swapper/307:27:593
264660599100,4cyclictest0-21swapper/307:46:163
26466059993,3cyclictest0-21swapper/308:28:033
26466059993,3cyclictest0-21swapper/308:28:033
26466059992,6cyclictest0-21swapper/308:08:003
26466059992,5cyclictest0-21swapper/311:38:003
26466059992,5cyclictest0-21swapper/310:57:583
26466059992,5cyclictest0-21swapper/308:12:593
26466059992,4cyclictest0-21swapper/308:18:003
26466059980,5cyclictest0-21swapper/307:23:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional