You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 12:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Sat Jul 12, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3372143997310,39cyclictest0-21swapper/023:04:070
337214399553,15cyclictest3419664-21fschecks_time21:21:560
3372143995111,37cyclictest0-21swapper/023:01:570
3372145995025,20cyclictest3412658-21diskmemload21:39:042
3372143994015,5cyclictest0-21swapper/021:39:010
337214399375,21cyclictest3422004-21sendmail-msp21:24:050
3372143993726,8cyclictest3440936-21latency_hist21:44:020
337214399371,21cyclictest0-21swapper/022:31:560
337214399351,1cyclictest3555208-21diskstats23:46:510
337214599343,10cyclictest11050irq/107-eth%d19:57:002
337214399332,20cyclictest0-21swapper/000:26:520
337214399321,2cyclictest3504574-21ssh22:52:000
3372144993121,9cyclictest1006-21mta-sts-daemon19:51:581
337214499303,23cyclictest3436409-21ssh21:39:041
3372143993025,4cyclictest3495037-21latency22:41:560
337214599296,7cyclictest0-21swapper/223:19:392
337214599296,19cyclictest967-21snmpd00:36:592
337214499297,18cyclictest1007-21mta-sts-daemon22:35:411
337214499294,5cyclictest11050irq/107-eth%d22:31:561
3372143992914,13cyclictest3367726-21kworker/u8:1+events_unbound19:14:020
337214399291,20cyclictest0-21swapper/022:06:590
337214599284,13cyclictest3443576-21sh21:46:552
3372144992814,7cyclictest3499410-21fschecks_time22:46:521
3372143992819,1cyclictest0-21swapper/022:56:510
3372145992719,6cyclictest3593014-21fschecks_count00:31:532
337214399274,22cyclictest0-21swapper/023:14:060
337214399270,20cyclictest0-21swapper/021:16:380
337214499265,3cyclictest171rcu_preempt22:06:581
337214499265,16cyclictest619-21mta-sts-daemon23:31:551
3372144992616,7cyclictest0-21swapper/121:36:511
337214399263,17cyclictest58-21kcompactd022:46:520
337214399262,5cyclictest3476363-21/usr/sbin/munin22:21:530
337214399260,21cyclictest0-21swapper/020:46:500
112699260,2rtkit-daemon1125-21rtkit-daemon00:31:071
337214599254,14cyclictest3515357-21apt-get23:04:062
337214499258,8cyclictest3474339-21ssh22:19:341
3372144992517,6cyclictest0-21swapper/121:31:581
337214399252,17cyclictest0-21swapper/022:26:490
337214399251,16cyclictest3545965-21/usr/sbin/munin23:36:570
337214399250,20cyclictest0-21swapper/020:16:570
3372145992417,4cyclictest3473476-21unin-run22:19:022
337214399242,6cyclictest3581937-21ssh00:16:590
3372143992418,1cyclictest0-21swapper/023:54:020
3372143992417,1cyclictest58-21kcompactd022:19:020
337214499234,11cyclictest11050irq/107-eth%d22:02:021
337214399234,17cyclictest3541712-21ntpq23:31:550
3372143992316,2cyclictest0-21swapper/022:02:010
3372145992215,5cyclictest3419665-21fschecks_time21:21:562
337214499226,11cyclictest0-21swapper/123:56:571
337214499225,11cyclictest3397390-21/usr/sbin/munin20:26:571
337214499223,12cyclictest3424938-21/usr/sbin/munin21:27:001
3372144992216,4cyclictest3380701-21latency_hist19:39:021
3372143992221,0cyclictest0-21swapper/019:57:000
3372143992218,3cyclictest3409979-21grep21:06:520
337214599213,14cyclictest3499409-21uniq22:46:522
337214499213,16cyclictest3473444-21munin-run22:19:021
3372144992116,4cyclictest3532152-21cut23:21:521
337214399217,12cyclictest1008-21mta-sts-daemon00:04:580
337214399215,14cyclictest3443745-21/usr/sbin/munin21:46:580
337214399212,4cyclictest3489668-21/usr/sbin/munin22:36:520
3372145992014,5cyclictest0-21swapper/221:31:582
3372145992013,6cyclictest0-21swapper/222:12:032
3372145992011,5cyclictest11050irq/107-eth%d00:04:082
337214499203,13cyclictest3581933-21ntp_states00:16:591
337214499203,12cyclictest3546144-21ssh23:36:581
337214499203,12cyclictest122792-21ntpd23:39:041
337214499202,5cyclictest58-21kcompactd023:04:061
3372143992015,3cyclictest3594155-21grep00:32:040
3372143992012,1cyclictest0-21swapper/023:21:500
337214399200,19cyclictest0-21swapper/023:56:500
337214599192,9cyclictest11050irq/107-eth%d23:01:572
337214399191,14cyclictest3466581-21ssh22:11:540
337214599183,12cyclictest1008-21mta-sts-daemon20:46:572
337214599183,11cyclictest633-21gpm21:59:492
337214599181,10cyclictest11050irq/107-eth%d21:57:082
337214499183,9cyclictest261rcuc/122:11:591
337214399183,11cyclictest69-21kswapd023:39:040
3372143991813,3cyclictest3378679-21unixbench_singl19:32:010
3372143991810,5cyclictest0-21swapper/000:01:590
337214699172,9cyclictest0-21swapper/323:04:063
337214699172,9cyclictest0-21swapper/322:46:523
337214699172,9cyclictest0-21swapper/300:16:593
337214599179,5cyclictest3548692-21sh23:39:042
337214599177,7cyclictest3494924-21/usr/sbin/munin22:41:552
337214599174,11cyclictest259-21jbd2/mmcblk0p2-823:24:292
337214599172,14cyclictest3528037-21/usr/sbin/munin23:16:572
337214599171,9cyclictest3424937-21sshd21:27:002
3372145991713,3cyclictest1007-21mta-sts-daemon22:31:562
337214499172,13cyclictest3601303-21awk00:44:021
337214499172,13cyclictest3601303-21awk00:44:021
337214499171,5cyclictest0-21swapper/100:36:561
3372144991714,2cyclictest3399471-21unixbench_singl20:32:011
337214499171,10cyclictest3559520-21basename23:51:511
337214399173,10cyclictest3411255-21/usr/sbin/munin21:11:490
337214399172,13cyclictest3372434-21aten_r2power_en19:16:510
3372143991716,1cyclictest0-21swapper/000:11:580
3372143991714,2cyclictest3429782-21threads21:32:010
337214399171,3cyclictest0-21swapper/000:34:170
112699170,4rtkit-daemon0-21swapper/221:11:562
112699170,2rtkit-daemon1125-21rtkit-daemon22:57:502
337214699165,5cyclictest0-21swapper/322:31:563
337214599168,4cyclictest0-21swapper/220:21:522
337214599168,4cyclictest0-21swapper/220:21:522
337214599164,10cyclictest3490864-21/usr/sbin/munin22:37:022
337214599163,11cyclictest3407759-21kworker/2:0+events22:19:342
337214599162,13cyclictest3400103-21cut20:36:532
337214599162,12cyclictest3448323-21ssh21:52:002
337214599162,10cyclictest3402990-21grep20:44:022
337214599161,12cyclictest3568580-21/usr/sbin/munin00:01:512
3372145991610,5cyclictest0-21swapper/220:09:042
337214499163,10cyclictest3569168-21/usr/sbin/munin00:01:551
337214499162,9cyclictest3419661-21fschecks_time21:21:561
337214499162,12cyclictest967-21snmpd20:09:021
3372144991612,3cyclictest3538934-21munin-plugin-st23:29:021
3372144991612,3cyclictest3388823-21grep20:02:031
3372144991612,3cyclictest1008-21mta-sts-daemon22:27:401
337214499160,13cyclictest3447696-21/usr/sbin/munin21:51:541
337214399165,6cyclictest3585915-21ssh00:21:560
337214399164,1cyclictest3599827-21gltestperf00:41:570
337214399164,1cyclictest3599827-21gltestperf00:41:570
337214399163,10cyclictest3522262-21/usr/sbin/munin23:11:530
337214399162,10cyclictest3516210-1kworker/0:1H+kblockd23:24:290
3372143991613,2cyclictest3409263-21unixbench_multi21:02:030
3372143991610,3cyclictest0-21swapper/020:04:020
337214399160,1cyclictest3374826-21ntpq19:21:540
112699160,3rtkit-daemon1125-21rtkit-daemon22:49:361
337214599159,3cyclictest0-21swapper/222:52:042
337214599154,9cyclictest3586458-21/usr/sbin/munin00:22:012
337214599153,9cyclictest3415457-21ssh21:16:572
337214599152,8cyclictest3436022-21apt-config21:39:022
3372145991511,3cyclictest3548128-21unin-run23:39:022
337214599151,13cyclictest3408278-21cut21:01:532
337214599151,11cyclictest3555227-21fschecks_count23:46:512
337214499153,9cyclictest111788-21systemd-journal23:44:591
337214499151,8cyclictest3522479-21ssh23:11:541
3372144991512,3cyclictest3509021-21ntp_kernel_pll_22:56:561
337214499151,12cyclictest3372435-21tail19:16:511
337214499150,12cyclictest3377640-21cut19:31:511
337214399152,7cyclictest3381886-21/usr/sbin/munin19:42:010
3372143991511,3cyclictest0-21swapper/020:26:510
3372143991511,2cyclictest0-21swapper/020:36:520
112699150,1rtkit-daemon0-21swapper/219:37:092
112699150,1rtkit-daemon0-21swapper/120:50:091
112699150,1rtkit-daemon0-21swapper/020:07:540
337214699145,6cyclictest0-21swapper/321:46:553
337214699145,4cyclictest0-21swapper/300:04:583
337214699144,5cyclictest0-21swapper/321:31:583
337214699143,6cyclictest0-21swapper/320:31:553
337214699142,6cyclictest0-21swapper/322:34:053
337214599149,4cyclictest0-21swapper/200:11:592
337214599148,5cyclictest1008-21mta-sts-daemon20:56:552
337214599147,5cyclictest0-21swapper/221:07:002
337214599144,7cyclictest3389432-21/usr/sbin/munin20:06:522
337214599144,7cyclictest3376273-21/usr/sbin/munin19:26:542
337214599141,9cyclictest3459699-21ssh22:04:022
337214599141,12cyclictest3480506-21ssh22:26:492
337214599141,11cyclictest3384232-21/usr/sbin/munin19:51:502
337214499145,5cyclictest3512682-21/usr/sbin/munin23:01:531
337214499144,6cyclictest3450580-21ssh21:54:261
337214499142,9cyclictest3590100-21/usr/sbin/munin00:26:591
337214499142,8cyclictest3402771-21cron20:44:011
337214499142,8cyclictest3392224-21/usr/sbin/munin20:12:011
337214499141,9cyclictest3573898-21ssh00:06:571
3372144991412,1cyclictest0-21swapper/119:26:591
3372144991411,2cyclictest3403445-21gltestperf20:46:531
3372144991411,2cyclictest3375379-21grep19:22:001
337214399149,3cyclictest151ktimers/021:54:260
337214399148,5cyclictest0-21swapper/019:39:020
337214399141,9cyclictest191rcuc/020:09:040
3372143991411,2cyclictest3375953-21cut19:26:520
337214399141,11cyclictest3396246-21true20:24:020
337214399141,11cyclictest3396246-21true20:24:020
337214399141,10cyclictest3406303-21/usr/sbin/munin20:56:490
337214399140,9cyclictest3448302-21ntpq21:51:590
337214699136,5cyclictest0-21swapper/323:01:523
337214699135,5cyclictest0-21swapper/323:26:503
337214699134,4cyclictest0-21swapper/322:26:543
337214699133,7cyclictest0-21swapper/320:09:043
337214699133,6cyclictest0-21swapper/321:56:583
337214699133,5cyclictest0-21swapper/322:51:583
337214699133,5cyclictest0-21swapper/321:59:493
337214699132,6cyclictest0-21swapper/321:21:563
337214699132,6cyclictest0-21swapper/319:19:023
337214699131,7cyclictest0-21swapper/323:56:573
337214699131,7cyclictest0-21swapper/323:46:553
337214699130,8cyclictest0-21swapper/323:41:503
337214599139,3cyclictest3397760-21unixbench_multi20:27:012
337214599139,2cyclictest0-21swapper/223:52:032
337214599135,4cyclictest3522237-21/usr/sbin/munin23:11:532
337214599132,10cyclictest967-21snmpd00:26:562
3372145991311,2cyclictest1005-21mta-sts-daemon19:42:052
337214599130,9cyclictest3384191-21grep19:49:022
337214499138,3cyclictest0-21swapper/100:11:521
337214499136,5cyclictest0-21swapper/120:37:021
337214499134,7cyclictest3406827-21/usr/sbin/munin20:56:521
337214499134,6cyclictest3408676-21/usr/sbin/munin21:01:561
337214499134,6cyclictest0-21swapper/123:14:061
337214499134,5cyclictest11050irq/107-eth%d22:41:571
337214499133,7cyclictest3382958-21fschecks_time19:46:551
337214499132,9cyclictest3394393-21cat20:19:021
337214499132,8cyclictest3411919-21/usr/sbin/munin21:11:541
337214499132,8cyclictest3386767-21sshd19:57:001
337214499132,7cyclictest3444130-21grep21:47:021
337214499131,9cyclictest3372319-21cat19:14:021
337214499131,10cyclictest3414910-21fschecks_count21:16:531
337214399134,5cyclictest3401372-21/usr/sbin/munin20:41:510
337214399133,5cyclictest3385330-21/usr/sbin/munin19:52:020
337214399131,11cyclictest3383367-21netstat19:46:570
337214699127,3cyclictest0-21swapper/323:16:573
337214699125,5cyclictest0-21swapper/320:41:533
337214699124,5cyclictest0-21swapper/322:04:343
337214699123,6cyclictest0-21swapper/322:11:543
337214699123,6cyclictest0-21swapper/320:16:523
337214699123,5cyclictest0-21swapper/319:31:563
337214699123,5cyclictest0-21swapper/300:11:543
337214699122,8cyclictest0-21swapper/322:42:003
337214699122,6cyclictest0-21swapper/321:41:583
337214699121,6cyclictest0-21swapper/323:31:553
337214699121,6cyclictest0-21swapper/322:19:043
337214699121,5cyclictest0-21swapper/322:56:503
337214699121,5cyclictest0-21swapper/321:36:513
337214599127,3cyclictest3394208-21latency_hist20:19:022
337214599123,7cyclictest0-21swapper/200:16:582
337214599123,6cyclictest3387505-21/usr/sbin/munin20:01:542
337214599122,6cyclictest3373663-21sed19:17:032
337214599121,8cyclictest3404969-21tune2fs20:51:522
337214599121,8cyclictest3374008-21/usr/sbin/munin19:21:472
337214599121,6cyclictest111788-21systemd-journal20:34:012
337214599120,3cyclictest0-21swapper/200:39:072
337214599120,3cyclictest0-21swapper/200:39:072
337214499123,5cyclictest3395609-21/usr/sbin/munin20:21:581
337214499123,5cyclictest3395609-21/usr/sbin/munin20:21:581
337214499122,7cyclictest3381091-21/usr/sbin/munin19:41:541
337214399123,5cyclictest3399614-21cat20:34:020
112699120,8rtkit-daemon1006-21mta-sts-daemon23:56:432
337214699114,4cyclictest0-21swapper/322:16:593
337214699113,4cyclictest0-21swapper/323:51:513
337214699113,4cyclictest0-21swapper/321:11:523
337214699113,4cyclictest0-21swapper/321:06:503
337214699113,4cyclictest0-21swapper/321:01:583
337214699113,4cyclictest0-21swapper/320:51:503
337214699113,4cyclictest0-21swapper/300:00:023
337214699113,3cyclictest0-21swapper/300:41:573
337214699113,3cyclictest0-21swapper/300:41:573
337214699112,6cyclictest0-21swapper/321:51:593
337214699112,5cyclictest0-21swapper/321:24:053
337214699112,5cyclictest0-21swapper/321:16:593
337214699112,5cyclictest0-21swapper/320:06:553
337214699112,5cyclictest0-21swapper/319:56:583
337214699111,5cyclictest0-21swapper/300:26:573
337214699110,6cyclictest0-21swapper/320:21:593
337214699110,6cyclictest0-21swapper/320:21:593
337214699110,5cyclictest0-21swapper/319:37:013
337214699110,5cyclictest0-21swapper/319:21:593
337214599115,4cyclictest3541188-21cut23:31:522
337214599114,5cyclictest3377609-21fschecks_count19:31:512
337214499114,2cyclictest11050irq/107-eth%d00:21:481
337214499111,5cyclictest3409704-21aten_r2power_fr21:06:501
337214399113,5cyclictest3405474-21/usr/sbin/munin20:51:560
112699110,2rtkit-daemon0-21swapper/219:10:512
337214699103,4cyclictest0-21swapper/319:39:193
337214699102,5cyclictest0-21swapper/319:26:533
337214699102,4cyclictest0-21swapper/323:36:553
337214699102,4cyclictest0-21swapper/300:19:363
337214699102,3cyclictest0-21swapper/320:01:513
33721469996,2cyclictest0-21swapper/323:19:393
33721469996,2cyclictest0-21swapper/320:59:013
33721469993,4cyclictest0-21swapper/319:46:563
33721469993,4cyclictest0-21swapper/300:32:043
33721469992,5cyclictest0-21swapper/323:11:553
33721469992,5cyclictest0-21swapper/320:37:023
33721469992,4cyclictest0-21swapper/320:26:513
33721469991,5cyclictest0-21swapper/300:34:303
33721469982,3cyclictest0-21swapper/320:46:503
33721469971,3cyclictest0-21swapper/319:51:503
33721469951,2cyclictest0-21swapper/319:14:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional