You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-04 - 09:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7.osadl.org (updated Fri Jul 04, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
163059399533,30cyclictest0-21swapper/022:07:080
163059599493,9cyclictest1754535-21ntpq22:46:532
163059399482,24cyclictest0-21swapper/022:01:450
1630593994423,15cyclictest0-21swapper/000:01:550
1630593994122,3cyclictest0-21swapper/023:47:180
163059599401,4cyclictest1741038-21ntpq22:31:532
1630593993924,6cyclictest2862296-1kworker/0:2H+kblockd21:24:300
1630595993729,3cyclictest0-21swapper/223:28:572
163059399372,27cyclictest1756504-21cat22:48:550
1630593993717,17cyclictest1649263-21kworker/u8:2-events_unbound20:16:480
163059599361,8cyclictest1822822-21ntp_states00:01:552
1630593993521,3cyclictest764-21rs:main0
163059399351,4cyclictest1673867-21sensors_fan21:16:590
163059399343,1cyclictest0-21swapper/021:31:520
163059399342,31cyclictest0-21swapper/021:45:070
1630593993415,2cyclictest0-21swapper/021:51:580
163059399331,23cyclictest1731695-21grep22:21:490
163059399331,1cyclictest0-21swapper/022:09:490
163059599321,13cyclictest36-21ksoftirqd/200:31:542
163059399322,22cyclictest0-21swapper/021:36:530
163059499312,5cyclictest171rcu_preempt20:16:481
163059499312,3cyclictest1630592-21cyclictest19:13:541
163059399311,25cyclictest1768359-21unixbench-2d23:01:580
163059399310,19cyclictest1812805-21ssh23:51:440
163059599292,5cyclictest1696388-21ntpq21:41:542
163059399291,26cyclictest0-21swapper/023:41:540
163059399290,18cyclictest0-21swapper/023:06:540
1630593992813,5cyclictest1774699-21ssh23:09:260
163059599272,3cyclictest0-21swapper/220:06:532
1630595992722,1cyclictest341rcuc/222:51:572
163059399272,2cyclictest0-21swapper/022:51:540
1630593992712,5cyclictest1787781-21sendmail-msp23:24:190
163059399271,19cyclictest0-21swapper/020:41:460
1630595992610,14cyclictest122792-21ntpd00:16:542
163059499263,9cyclictest1675445-21grep21:18:561
1630593992618,2cyclictest1727177-21cut22:16:480
1630593992611,7cyclictest0-21swapper/019:13:540
163059499255,13cyclictest619-21mta-sts-daemon22:11:561
163059399252,19cyclictest0-21swapper/000:21:490
1630593992521,1cyclictest0-21swapper/022:31:530
163059399251,23cyclictest1830447-21head00:11:490
112699250,1rtkit-daemon1006-21mta-sts-daemon23:48:021
1630595992417,5cyclictest0-21swapper/200:26:522
163059499248,11cyclictest1709272-21/usr/sbin/munin21:56:481
163059499245,13cyclictest992-21lldpd22:32:581
1630593992420,3cyclictest1678646-21unixbench_multi21:22:010
1630593992419,1cyclictest1764106-21unixbench_singl22:57:000
163059599236,13cyclictest1-21systemd22:03:542
163059599234,4cyclictest171rcu_preempt20:24:132
163059599231,9cyclictest1670799-21diskmemload00:21:522
1630595992313,2cyclictest171rcu_preempt22:41:522
163059499236,12cyclictest111788-21systemd-journal22:44:151
163059399232,14cyclictest1785396-21/usr/sbin/munin23:21:480
1630593992316,0cyclictest0-21swapper/023:16:520
163059399231,17cyclictest0-21swapper/019:31:530
163059399230,4cyclictest1655119-21iwlist20:26:490
163059399230,17cyclictest0-21swapper/023:36:490
163059599223,8cyclictest0-21swapper/222:11:562
163059599223,3cyclictest0-21swapper/223:01:542
163059599223,2cyclictest1852672-21cron00:38:552
1630595992219,2cyclictest0-21swapper/219:56:472
1630595992219,2cyclictest0-21swapper/219:56:472
163059399222,16cyclictest11050irq/107-eth%d23:28:570
1630593992213,1cyclictest1696686-21switchtime21:41:590
163059599213,2cyclictest1691434-21grep21:36:512
163059599212,7cyclictest11050irq/107-eth%d23:21:482
163059599212,3cyclictest0-21swapper/221:23:582
1630595992118,2cyclictest1809816-21unixbench_singl23:46:582
1630595992118,2cyclictest1670707-21unixbench_multi21:12:002
1630593992115,1cyclictest1854331-21fschecks_count00:41:480
163059599202,13cyclictest1645948-21apt-get19:58:572
1630595992015,4cyclictest0-21swapper/222:24:182
163059599201,3cyclictest1817328-21/usr/sbin/munin23:56:532
163059599201,16cyclictest1830546-21ssh00:11:502
1630595992010,3cyclictest171rcu_preempt21:31:592
163059499202,15cyclictest1789779-21aten_r2power_vo23:26:441
163059499202,14cyclictest1835062-21ssh00:16:571
1630593992017,2cyclictest0-21swapper/021:13:550
163059399201,18cyclictest1828626-21munin-run00:08:550
163059599198,9cyclictest1125-21rtkit-daemon19:41:532
1630595991916,2cyclictest1008-21mta-sts-daemon21:53:112
163059599190,5cyclictest1670799-21diskmemload22:06:572
163059499195,10cyclictest1846426-21ssh00:31:471
163059499195,10cyclictest1776676-21ssh23:11:501
163059499194,12cyclictest1679807-21sendmail-msp21:23:581
163059499192,14cyclictest1691972-21ssh21:36:551
1630594991915,3cyclictest0-21swapper/123:04:501
1630594991914,3cyclictest1700464-21gltestperf21:46:481
1630594991913,4cyclictest1656477-21cpuspeed20:31:471
163059399194,3cyclictest0-21swapper/019:26:480
163059399192,3cyclictest1670799-21diskmemload00:26:480
163059399192,10cyclictest11050irq/107-eth%d00:33:520
163059599182,12cyclictest111788-21systemd-journal20:16:482
1630595991815,2cyclictest1006-21mta-sts-daemon20:31:592
163059599181,3cyclictest171rcu_preempt22:34:022
163059599181,3cyclictest171rcu_preempt21:47:482
1630595991811,4cyclictest0-21swapper/219:16:512
163059599181,13cyclictest1854357-21fschecks_count00:41:482
163059499187,8cyclictest1005-21mta-sts-daemon22:26:501
163059499185,11cyclictest271ktimers/100:02:591
163059499183,9cyclictest1799490-21cut23:36:471
163059499182,2cyclictest11050irq/107-eth%d21:32:341
163059499182,13cyclictest1645371-21apt-get19:58:551
1630594991816,1cyclictest0-21swapper/122:16:551
1630594991812,3cyclictest0-21swapper/122:56:591
163059499181,16cyclictest1782012-21/usr/sbin/munin23:16:581
163059399184,11cyclictest1745695-21/usr/sbin/munin22:36:570
163059399182,11cyclictest1751752-21cut22:43:550
1630593991815,2cyclictest1709420-21grep21:56:490
163059699174,7cyclictest0-21swapper/320:16:483
163059699172,6cyclictest0-21swapper/322:06:503
163059599176,2cyclictest171rcu_preempt23:41:512
163059599171,3cyclictest1673087-21cut21:16:502
163059599171,2cyclictest0-21swapper/223:06:492
1630595991712,4cyclictest1125-21rtkit-daemon23:12:202
163059599170,3cyclictest36-21ksoftirqd/221:56:552
163059599170,3cyclictest0-21swapper/220:11:502
163059499179,6cyclictest1006-21mta-sts-daemon20:36:571
163059499179,6cyclictest1006-21mta-sts-daemon20:36:571
163059499178,6cyclictest1851931-21/usr/sbin/munin00:36:591
163059499176,7cyclictest1804699-21ssh23:41:531
163059499174,8cyclictest1826120-21/usr/sbin/munin00:07:001
163059499172,4cyclictest1679935-21latency_hist21:23:551
163059499172,13cyclictest1831306-21ssh00:11:571
163059499172,12cyclictest58-21kcompactd023:28:571
163059499172,11cyclictest1811505-21ssh23:49:271
163059499172,10cyclictest1750585-21sed22:42:021
1630594991712,4cyclictest0-21swapper/120:46:521
163059499171,12cyclictest1767969-21ssh23:01:541
163059399178,2cyclictest1668313-21awk21:06:500
163059399176,7cyclictest1852292-21ssh00:37:570
163059399173,8cyclictest11050irq/107-eth%d00:16:510
1630593991715,1cyclictest0-21swapper/023:56:460
1630593991715,1cyclictest0-21swapper/020:56:470
163059599165,6cyclictest1634118-21/usr/sbin/munin19:26:512
163059599164,7cyclictest1630546-21munin-run19:13:542
163059599164,10cyclictest1726175-21ssh22:15:422
163059599163,8cyclictest1826120-21/usr/sbin/munin00:06:482
163059599163,2cyclictest171rcu_preempt19:36:522
163059599162,10cyclictest1812803-21ssh23:51:442
163059599162,10cyclictest1792380-21base6423:28:552
163059599161,3cyclictest1799546-21grep23:36:472
1630595991613,2cyclictest1660829-21unixbench_multi20:42:002
163059599161,12cyclictest1652929-21apt-get20:18:582
163059599160,4cyclictest1659289-21apt20:38:552
163059599160,4cyclictest1659289-21apt20:38:552
163059499164,6cyclictest11050irq/107-eth%d21:41:471
163059499163,11cyclictest1838111-21ssh00:21:461
163059499161,3cyclictest1785354-21sort23:21:471
1630594991613,2cyclictest1643694-21unixbench_singl19:51:581
163059399165,6cyclictest1650660-21cron20:13:550
163059399163,11cyclictest1639523-21/usr/sbin/munin19:41:500
163059399161,8cyclictest1658215-21cut20:36:490
163059399161,8cyclictest1658215-21cut20:36:490
1630593991612,3cyclictest1666876-21ntp_kernel_err21:01:560
163059399161,12cyclictest1645409-21apt-config19:58:550
163059399161,12cyclictest1645409-21apt-config19:58:550
163059399160,11cyclictest0-21swapper/019:21:500
163059699154,5cyclictest0-21swapper/323:56:533
163059699153,5cyclictest0-21swapper/322:24:183
163059699152,8cyclictest0-21swapper/321:51:463
163059699152,6cyclictest0-21swapper/322:36:533
163059599153,9cyclictest1663179-21fschecks_time20:51:512
163059599153,7cyclictest111788-21systemd-journal19:23:552
163059599153,10cyclictest1660957-21sendmail-msp20:44:062
163059599152,6cyclictest1641017-21tune2fs19:46:502
163059599150,6cyclictest1677515-21grep21:21:502
163059599150,4cyclictest171rcu_preempt23:14:162
163059599150,11cyclictest1731590-21fschecks_time22:21:482
163059499154,8cyclictest1714260-21/usr/sbin/munin22:01:531
163059499154,4cyclictest1667232-21cat21:02:031
163059499153,9cyclictest1659853-21cut20:41:491
163059499152,9cyclictest1758535-21fschecks_count22:51:501
163059499151,8cyclictest1005-21mta-sts-daemon22:36:531
163059499151,2cyclictest1718631-21ssh22:06:511
163059399153,9cyclictest1640716-21/usr/sbin/munin19:46:480
163059399153,9cyclictest0-21swapper/020:46:540
163059399151,9cyclictest1631648-21/usr/sbin/munin19:16:510
163059399151,8cyclictest1656277-21basename20:31:460
1630593991511,3cyclictest1643741-21munin-plugin-st19:53:540
163059699144,5cyclictest0-21swapper/300:36:513
163059699143,7cyclictest0-21swapper/300:06:483
163059699143,7cyclictest0-21swapper/300:01:553
163059699143,6cyclictest0-21swapper/322:01:543
163059699143,4cyclictest0-21swapper/323:21:483
163059699143,4cyclictest0-21swapper/322:44:473
163059699142,8cyclictest0-21swapper/322:56:523
163059599142,9cyclictest1665932-21grep20:58:552
163059599140,4cyclictest171rcu_preempt22:57:062
163059499145,6cyclictest619-21mta-sts-daemon20:11:551
163059499144,6cyclictest1654875-21/usr/sbin/munin20:26:471
163059499143,9cyclictest11050irq/107-eth%d00:26:531
163059499143,8cyclictest1669879-21/usr/sbin/munin21:11:511
163059499142,9cyclictest1644024-21/usr/sbin/munin19:56:451
163059499142,9cyclictest1644024-21/usr/sbin/munin19:56:451
163059499142,8cyclictest1732207-21/usr/sbin/munin22:21:551
163059499142,7cyclictest1648982-21sed20:06:591
163059499142,11cyclictest1818244-21ntpq23:56:521
163059499142,10cyclictest1641077-21tune2fs19:46:501
163059499141,10cyclictest1668814-21/usr/sbin/munin21:06:571
163059399143,10cyclictest1647995-21fschecks_time20:06:490
163059399142,9cyclictest1663262-21gltestperf20:51:520
163059399140,12cyclictest1638338-21ps19:36:540
112699140,2rtkit-daemon1125-21rtkit-daemon19:14:511
163059699135,3cyclictest0-21swapper/323:41:533
163059699134,3cyclictest0-21swapper/320:21:523
163059699133,5cyclictest0-21swapper/300:18:553
163059699132,6cyclictest0-21swapper/300:26:583
163059699132,5cyclictest0-21swapper/323:46:593
163059699132,5cyclictest0-21swapper/323:06:523
163059699131,6cyclictest0-21swapper/323:01:243
163059599131,9cyclictest1642722-21/usr/sbin/munin19:51:482
163059599131,5cyclictest1666090-21/usr/sbin/munin21:01:562
163059599131,2cyclictest171rcu_preempt21:06:462
163059499134,5cyclictest1664738-21grep20:56:481
163059499133,6cyclictest1638171-21/usr/sbin/munin19:36:511
163059499132,9cyclictest1854435-21tune2fs00:41:491
163059499131,9cyclictest1653458-21if_end020:21:491
163059499131,8cyclictest1636690-21/usr/sbin/munin19:31:551
163059499131,10cyclictest1664095-21grep20:52:021
163059499131,10cyclictest1639147-21/usr/sbin/munin19:41:481
163059399133,7cyclictest0-21swapper/020:02:010
163059399132,7cyclictest1653316-21grep20:21:480
163059699126,4cyclictest0-21swapper/323:36:573
163059699123,6cyclictest0-21swapper/319:58:563
163059699123,5cyclictest0-21swapper/322:31:593
163059699123,5cyclictest0-21swapper/321:45:393
163059699123,4cyclictest0-21swapper/322:16:463
163059699123,4cyclictest0-21swapper/322:11:523
163059699123,4cyclictest0-21swapper/321:16:503
163059699122,5cyclictest0-21swapper/323:51:513
163059699122,5cyclictest0-21swapper/320:56:553
163059699122,5cyclictest0-21swapper/320:36:573
163059699122,5cyclictest0-21swapper/320:36:573
163059699121,7cyclictest0-21swapper/323:28:573
163059699121,7cyclictest0-21swapper/320:41:503
163059599123,2cyclictest1635874-21aten_r2power_po19:31:482
163059499122,8cyclictest1632598-21aten2.4-expect19:21:481
163059499121,7cyclictest1635520-21latency_hist19:28:551
163059699116,4cyclictest0-21swapper/321:56:483
163059699114,4cyclictest0-21swapper/319:31:583
163059699114,3cyclictest0-21swapper/319:46:543
163059699113,5cyclictest0-21swapper/322:51:533
163059699113,5cyclictest0-21swapper/319:41:523
163059699113,4cyclictest0-21swapper/323:16:503
163059699113,4cyclictest0-21swapper/321:23:573
163059699113,4cyclictest0-21swapper/321:21:513
163059699113,4cyclictest0-21swapper/320:31:473
163059699113,4cyclictest0-21swapper/319:16:493
163059699113,4cyclictest0-21swapper/300:31:533
163059699112,5cyclictest0-21swapper/323:25:023
163059699112,5cyclictest0-21swapper/323:09:263
163059699112,5cyclictest0-21swapper/321:31:543
163059699112,5cyclictest0-21swapper/321:11:543
163059699112,5cyclictest0-21swapper/320:46:523
163059699111,7cyclictest0-21swapper/300:21:523
163059699110,7cyclictest0-21swapper/321:41:543
163059699110,6cyclictest0-21swapper/319:51:573
163059499115,5cyclictest0-21swapper/121:51:481
163059699105,2cyclictest0-21swapper/322:21:493
163059699103,5cyclictest0-21swapper/322:41:573
163059699103,5cyclictest0-21swapper/319:56:453
163059699103,5cyclictest0-21swapper/319:56:453
163059699103,3cyclictest0-21swapper/320:04:513
163059699102,6cyclictest0-21swapper/300:41:483
163059699102,4cyclictest0-21swapper/321:01:523
163059699101,6cyclictest0-21swapper/319:21:483
163059699101,4cyclictest0-21swapper/300:09:033
16305969994,2cyclictest0-21swapper/321:06:523
16305969993,4cyclictest0-21swapper/320:24:133
16305969993,2cyclictest0-21swapper/320:11:513
16305969992,5cyclictest0-21swapper/319:26:483
16305969992,3cyclictest0-21swapper/320:49:103
16305969991,5cyclictest0-21swapper/319:36:483
16305969990,5cyclictest0-21swapper/321:34:253
16305969961,2cyclictest0-21swapper/319:13:543
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional