You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 06:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Mon Nov 03, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
303531599464,6cyclictest171rcu_preempt20:32:411
303531499431,5cyclictest171rcu_preempt00:42:570
3035316994219,8cyclictest11050irq/107-eth%d23:07:542
3035314994216,7cyclictest0-21swapper/000:03:270
303531499413,25cyclictest0-21swapper/021:47:520
3035314993727,6cyclictest3211963-21apt-get23:40:420
303531699357,17cyclictest3162830-21awk22:47:562
3035315993315,4cyclictest171rcu_preempt23:40:421
3035314993321,9cyclictest111788-21systemd-journal23:30:250
303531499310,24cyclictest0-21swapper/021:42:510
303531499301,6cyclictest0-21swapper/020:32:400
303531499301,20cyclictest3247379-21base6400:20:420
303531699298,14cyclictest111788-21systemd-journal20:35:452
3035316992910,17cyclictest1007-21mta-sts-daemon23:40:432
3035314992912,10cyclictest151ktimers/021:17:570
112699290,3rtkit-daemon1125-21rtkit-daemon22:56:001
3035314992816,7cyclictest0-21swapper/023:07:520
303531499280,5cyclictest3250025-21unixbench_singl00:23:010
303531499273,4cyclictest3205107-21ntpq23:32:560
303531499271,9cyclictest0-21swapper/023:36:100
303531499271,7cyclictest3193512-21ssh23:20:440
3035316992623,2cyclictest0-21swapper/223:52:512
303531599264,16cyclictest3162829-21ntpq22:47:561
303531599262,9cyclictest3144680-21ssh22:28:241
303531499267,6cyclictest3259731-21grep00:35:420
3035314992624,2cyclictest0-21swapper/019:32:540
3035314992624,1cyclictest0-21swapper/021:57:580
303531499261,24cyclictest3176037-21sh23:02:510
303531499261,20cyclictest3070888-21apt-key21:00:420
303531499261,16cyclictest0-21swapper/000:10:440
303531599255,15cyclictest3157809-21ntpq22:42:561
303531499254,5cyclictest0-21swapper/023:52:570
3035314992523,2cyclictest0-21swapper/019:15:410
3035314992518,1cyclictest0-21swapper/020:18:000
3035314992513,3cyclictest171rcu_preempt22:32:570
303531499251,23cyclictest0-21swapper/022:52:080
303531499251,19cyclictest3073955-21switchtime21:08:040
303531499250,4cyclictest3130313-21sed22:13:060
303531699243,5cyclictest0-21swapper/223:20:432
3035315992419,4cyclictest3058890-21fschecks_count20:27:501
303531499242,8cyclictest3236148-21ssh00:07:530
3035314992422,2cyclictest0-21swapper/019:17:550
3035314992420,1cyclictest0-21swapper/022:02:580
303531499241,4cyclictest3152408-21ssh22:37:490
3035314992413,6cyclictest3017901-1kworker/0:2H+kblockd21:32:590
303531499241,2cyclictest0-21swapper/023:47:510
303531499231,6cyclictest3160084-21apt-get22:45:450
303531499231,21cyclictest0-21swapper/021:52:570
303531699223,14cyclictest111788-21systemd-journal20:45:582
303531599224,13cyclictest3216933-21sendmail-msp23:48:081
3035315992219,2cyclictest3045758-21fschecks_time19:47:531
3035315992219,2cyclictest3045758-21fschecks_time19:47:531
303531499227,10cyclictest3065367-21sendmail-msp20:45:580
303531499221,3cyclictest3157820-21ntp_kernel_pll_22:42:560
303531699214,12cyclictest3141418-21sendmail-msp22:25:422
3035316992113,5cyclictest0-21swapper/200:02:552
303531599218,10cyclictest3115838-21ssh21:57:571
303531599212,15cyclictest3083899-21ssh21:23:321
303531599212,15cyclictest3083899-21ssh21:23:321
3035315992113,6cyclictest3267875-21munin-plugin-st00:45:411
3035315992113,5cyclictest1007-21mta-sts-daemon23:32:581
3035315992111,4cyclictest111788-21systemd-journal23:12:581
303531599210,17cyclictest3223116-21/usr/sbin/munin23:52:511
3035314992114,1cyclictest0-21swapper/022:17:490
303531499211,10cyclictest0-21swapper/000:26:070
303531499210,20cyclictest3125537-21cat22:08:060
303531499210,20cyclictest3096760-21if_wlan021:37:530
303531499210,1cyclictest171rcu_preempt22:28:050
112699210,4rtkit-daemon1007-21mta-sts-daemon19:37:551
112699210,2rtkit-daemon1007-21mta-sts-daemon23:30:192
303531799205,7cyclictest0-21swapper/322:47:573
303531699204,13cyclictest3128959-21stty22:12:492
303531699203,13cyclictest3238976-21packagekitd00:10:452
303531699201,8cyclictest3153428-21/usr/sbin/munin22:38:012
303531699201,14cyclictest3157811-21ssh22:42:562
303531599202,6cyclictest0-21swapper/121:37:511
303531599202,3cyclictest171rcu_preempt22:18:121
3035314992018,1cyclictest3178927-21sendmail-msp23:12:580
3035314992011,8cyclictest122792-21ntpd21:02:570
3035314992011,2cyclictest3192912-21latency_hist23:20:420
303531699195,10cyclictest764-21rs:main2
3035316991915,3cyclictest3133896-21grep22:17:522
3035316991914,3cyclictest3058914-21cut20:27:512
303531699191,14cyclictest111788-21systemd-journal21:32:592
303531599193,14cyclictest111788-21systemd-journal21:00:421
303531599193,13cyclictest3232704-21ssh00:03:001
303531599192,13cyclictest111788-21systemd-journal00:32:021
303531599192,12cyclictest3190408-21/usr/sbin/munin23:17:551
3035315991910,6cyclictest0-21swapper/122:12:491
303531499193,11cyclictest3262295-21ssh00:38:040
303531499190,5cyclictest3138438-21/usr/sbin/munin22:22:500
112699190,3rtkit-daemon1005-21mta-sts-daemon23:07:461
303531699183,14cyclictest3072616-21cron21:05:412
303531699181,15cyclictest3115837-21ntp_states21:57:572
303531699180,12cyclictest11050irq/107-eth%d00:20:442
303531599185,9cyclictest3044124-21cut19:42:511
303531599183,9cyclictest3249377-21grep00:22:531
303531499188,1cyclictest171rcu_preempt20:02:490
303531499183,6cyclictest171rcu_preempt20:42:540
3035314991813,1cyclictest0-21swapper/020:52:540
3035314991812,4cyclictest3072657-21sendmail-msp21:12:540
112699180,3rtkit-daemon1125-21rtkit-daemon21:41:581
303531699173,6cyclictest3245463-21/usr/sbin/munin00:18:002
303531699173,4cyclictest3176801-21/usr/sbin/munin23:02:582
303531699172,6cyclictest11050irq/107-eth%d00:32:582
303531699172,13cyclictest3122671-21ssh22:05:412
303531699172,12cyclictest0-21swapper/223:47:512
3035316991715,1cyclictest0-21swapper/220:42:492
3035316991713,3cyclictest3060432-21aten2.4-expect20:32:502
3035316991712,4cyclictest0-21swapper/222:07:532
303531699171,11cyclictest3148461-21ssh22:33:022
303531599179,6cyclictest0-21swapper/121:28:021
303531599173,6cyclictest3241377-21/usr/sbin/munin00:13:051
3035315991713,3cyclictest3106989-21grep21:48:041
3035315991712,4cyclictest0-21swapper/122:33:141
303531599171,13cyclictest3176468-21ssh23:02:531
3035315991710,6cyclictest3238564-21grep00:10:421
3035314991712,4cyclictest3037988-21ntp_kernel_pll_19:22:550
112699170,3rtkit-daemon1125-21rtkit-daemon23:19:392
303531699166,5cyclictest111788-21systemd-journal22:53:512
303531699164,9cyclictest3072657-21sendmail-msp21:12:552
303531699163,11cyclictest3035267-21munin-run19:15:412
303531699162,11cyclictest3236416-21ntpq00:07:572
303531699162,11cyclictest3171547-21cut22:57:532
303531699162,10cyclictest3057935-21/usr/sbin/munin20:22:592
3035316991612,3cyclictest3075936-21diskmemload21:17:572
303531699161,14cyclictest3101026-21ssh21:42:492
303531699161,11cyclictest3041414-21/usr/sbin/munin19:32:572
303531599169,4cyclictest0-21swapper/120:22:531
303531599168,5cyclictest3120977-21grep22:03:011
303531599164,5cyclictest171rcu_preempt23:36:101
303531599163,8cyclictest3166857-21fschecks_time22:52:521
303531599163,6cyclictest764-21rs:main1
3035315991613,2cyclictest3153712-21unixbench_singl22:38:021
303531599161,11cyclictest3139386-21/usr/sbin/munin22:23:001
303531499163,11cyclictest3043901-21aten_r2power_po19:42:490
303531499162,3cyclictest0-21swapper/022:57:580
3035314991614,1cyclictest3085248-21munin-run21:25:410
3035314991614,1cyclictest3085248-21munin-run21:25:410
3035314991612,2cyclictest0-21swapper/023:56:050
303531499161,14cyclictest151ktimers/019:49:240
303531499161,14cyclictest151ktimers/019:49:240
303531499160,15cyclictest3087975-21ssh21:28:020
303531799156,6cyclictest0-21swapper/322:42:563
303531799155,4cyclictest0-21swapper/300:12:213
303531799153,6cyclictest0-21swapper/322:53:513
303531799152,7cyclictest0-21swapper/323:47:513
303531699159,5cyclictest762-21in:imuxsock19:47:572
303531699159,5cyclictest762-21in:imuxsock19:47:572
303531699158,4cyclictest0-21swapper/223:58:042
303531699152,8cyclictest3045351-21latency_hist19:45:422
303531699152,8cyclictest0-21swapper/221:51:062
303531699152,10cyclictest3083111-21/usr/sbin/munin21:23:002
303531699152,10cyclictest3083111-21/usr/sbin/munin21:23:002
303531699151,11cyclictest3086809-21/usr/sbin/munin21:27:492
303531699151,11cyclictest3037133-21latency_hist19:20:412
303531599151,4cyclictest3194809-21/usr/sbin/munin23:23:041
303531499159,5cyclictest191rcuc/020:27:560
303531499158,5cyclictest151ktimers/020:12:510
303531499153,4cyclictest14-21ksoftirqd/020:07:480
303531499152,10cyclictest3049037-21cut19:57:540
3035314991511,3cyclictest0-21swapper/020:22:530
112699150,2rtkit-daemon1125-21rtkit-daemon20:48:181
112699150,1rtkit-daemon0-21swapper/019:40:230
303531799143,5cyclictest0-21swapper/321:23:003
303531799143,5cyclictest0-21swapper/321:23:003
303531799143,4cyclictest0-21swapper/322:09:473
303531799142,7cyclictest0-21swapper/323:07:543
303531799142,5cyclictest0-21swapper/322:31:053
303531699143,4cyclictest3049771-21/usr/sbin/munin19:58:032
303531699142,9cyclictest3067942-21tune2fs20:52:522
303531699142,6cyclictest3255690-21latency_hist00:30:452
303531699141,9cyclictest967-21snmpd21:36:122
3035316991411,2cyclictest1006-21mta-sts-daemon19:37:582
3035316991411,1cyclictest0-21swapper/200:42:552
303531699141,10cyclictest3051788-21sendmail-msp20:07:582
303531699141,10cyclictest3039123-21grep19:27:522
303531699140,11cyclictest3209476-21uname23:37:522
303531599144,7cyclictest3048808-21head19:57:521
303531599144,5cyclictest3261480-21/usr/sbin/munin00:37:541
303531599142,7cyclictest3092437-21/usr/sbin/munin21:32:581
303531599142,10cyclictest3245815-21/usr/sbin/munin00:18:041
303531599142,10cyclictest3051754-21munin-run20:05:421
303531599141,9cyclictest3228282-21/usr/sbin/munin23:57:591
303531599141,3cyclictest3063984-21/usr/sbin/munin20:42:481
3035315991411,2cyclictest3068941-21unixbench_singl20:53:021
303531599141,12cyclictest3056741-21wc20:20:421
303531499142,11cyclictest3039142-21fschecks_count19:27:520
303531499141,6cyclictest3048623-21cat19:55:410
303531799134,5cyclictest0-21swapper/300:38:053
303531799133,4cyclictest0-21swapper/322:12:493
303531799133,3cyclictest0-21swapper/300:20:443
303531799132,6cyclictest0-21swapper/321:17:523
303531799130,7cyclictest0-21swapper/323:17:553
303531799130,7cyclictest0-21swapper/321:32:563
303531699136,6cyclictest3069492-21/usr/sbin/munin20:57:502
303531699133,7cyclictest3055566-21/usr/sbin/munin20:17:492
303531699132,7cyclictest3073831-21/usr/sbin/munin21:08:012
303531699132,10cyclictest3045206-21sendmail-msp19:53:002
303531699131,11cyclictest3141377-21cron22:25:422
303531699131,10cyclictest3105531-21/usr/sbin/munin21:48:042
303531599134,4cyclictest3111695-21ssh21:53:031
303531599133,4cyclictest0-21swapper/100:26:391
303531599132,8cyclictest3041899-21cut19:35:411
303531599132,7cyclictest3051788-21sendmail-msp20:07:561
303531599131,9cyclictest3063616-21/usr/sbin/munin20:38:011
303531599131,9cyclictest3039204-21fschecks_time19:27:531
3035315991311,1cyclictest0-21swapper/120:58:011
303531599130,9cyclictest3053966-21fschecks_count20:12:511
303531799123,6cyclictest0-21swapper/323:52:513
303531799123,5cyclictest0-21swapper/319:37:503
303531799123,5cyclictest0-21swapper/300:32:583
303531799123,4cyclictest0-21swapper/300:28:053
303531799123,3cyclictest0-21swapper/322:02:553
303531799122,6cyclictest0-21swapper/321:01:173
303531799122,5cyclictest0-21swapper/321:52:553
303531799121,6cyclictest0-21swapper/321:37:503
303531799121,6cyclictest0-21swapper/320:48:033
303531799121,6cyclictest0-21swapper/320:37:543
303531799121,6cyclictest0-21swapper/320:22:543
303531799121,6cyclictest0-21swapper/320:07:483
303531799120,7cyclictest0-21swapper/319:47:593
303531799120,7cyclictest0-21swapper/319:47:593
303531699121,8cyclictest762-21in:imuxsock23:12:582
303531699121,8cyclictest3261281-21fschecks_count00:37:532
303531699121,10cyclictest3050568-21/usr/sbin/munin20:02:492
303531599123,8cyclictest3077932-21/usr/sbin/munin21:17:531
303531599122,8cyclictest3124506-21/usr/sbin/munin22:07:541
303531599122,8cyclictest3074780-21/usr/sbin/munin21:12:491
303531599122,7cyclictest3047997-21/usr/sbin/munin19:52:571
303531499124,1cyclictest3061700-21apt-get20:35:440
303531799114,5cyclictest0-21swapper/323:20:443
303531799113,5cyclictest0-21swapper/320:12:533
303531799113,4cyclictest0-21swapper/321:27:493
303531799112,6cyclictest0-21swapper/323:27:593
303531799112,5cyclictest0-21swapper/323:32:343
303531799112,5cyclictest0-21swapper/319:27:593
303531799112,4cyclictest0-21swapper/322:25:423
303531799112,4cyclictest0-21swapper/321:45:453
303531799112,4cyclictest0-21swapper/319:32:533
303531799112,4cyclictest0-21swapper/300:06:083
303531799111,7cyclictest0-21swapper/323:42:473
303531799111,5cyclictest0-21swapper/323:57:563
303531799111,4cyclictest0-21swapper/300:41:023
303531799110,5cyclictest0-21swapper/320:32:553
303531699112,7cyclictest3037513-21grep19:22:522
303531699110,9cyclictest3053825-21head20:12:492
303531599115,4cyclictest0-21swapper/119:22:541
303531599113,5cyclictest3073370-21/usr/sbin/munin21:07:551
303531599112,6cyclictest3035545-21/usr/sbin/munin19:17:481
112699110,4rtkit-daemon1005-21mta-sts-daemon19:11:591
303531799104,3cyclictest0-21swapper/322:25:423
303531799104,3cyclictest0-21swapper/319:17:543
303531799103,4cyclictest0-21swapper/323:02:553
303531799102,5cyclictest0-21swapper/320:27:513
303531799102,5cyclictest0-21swapper/320:17:493
303531799102,4cyclictest0-21swapper/322:37:513
303531799102,4cyclictest0-21swapper/320:02:493
303531799102,3cyclictest0-21swapper/319:22:493
303531799101,4cyclictest0-21swapper/321:57:483
303531799101,4cyclictest0-21swapper/300:17:483
303531799100,5cyclictest0-21swapper/320:42:553
30353179993,4cyclictest0-21swapper/321:08:013
30353179993,4cyclictest0-21swapper/300:02:553
30353179993,3cyclictest0-21swapper/321:12:503
30353179992,5cyclictest0-21swapper/321:42:503
30353179992,5cyclictest0-21swapper/319:52:573
30353179991,5cyclictest0-21swapper/323:37:273
30353179991,5cyclictest0-21swapper/319:42:523
30353179991,4cyclictest0-21swapper/320:52:503
30353179985,2cyclictest0-21swapper/323:12:573
30353179984,3cyclictest0-21swapper/322:57:543
30353179984,3cyclictest0-21swapper/322:17:513
30353179983,3cyclictest0-21swapper/320:57:513
30353179981,4cyclictest0-21swapper/319:57:543
30353179974,3cyclictest0-21swapper/319:15:423
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional