You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 09:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7.osadl.org (updated Mon Dec 01, 2025 00:43:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
166247299701,40cyclictest0-21swapper/022:18:040
1662472995832,10cyclictest1863278-21ssh00:06:080
1662472994424,6cyclictest1703038-21diskmemload23:47:480
1662472994140,1cyclictest0-21swapper/020:38:100
1662472994125,5cyclictest0-21swapper/021:18:100
166247299363,8cyclictest0-21swapper/023:08:010
1662472993629,3cyclictest0-21swapper/000:15:250
166247499352,8cyclictest1799621-21ntpq22:58:082
166247299353,21cyclictest0-21swapper/023:53:130
166247299342,29cyclictest1873168-21ntpq00:18:060
166247299341,20cyclictest0-21swapper/021:48:150
166247499336,8cyclictest1761548-21ssh22:18:042
166247299333,23cyclictest0-21swapper/022:38:060
166247299322,29cyclictest605-21avahi-daemon23:28:150
166247399316,5cyclictest1880674-21sendmail-msp00:26:081
166247399316,5cyclictest1880674-21sendmail-msp00:26:081
166247299313,3cyclictest1686923-21ntpq20:28:120
1662473993013,2cyclictest0-21swapper/100:03:111
166247299303,25cyclictest1880674-21sendmail-msp00:32:030
166247299296,6cyclictest0-21swapper/023:18:090
1662472992914,3cyclictest0-21swapper/021:31:570
1662472992912,5cyclictest0-21swapper/023:58:100
166247499287,14cyclictest111788-21systemd-journal20:26:102
166247399287,8cyclictest1743202-21ssh21:58:101
166247399283,21cyclictest11050irq/107-eth%d22:18:041
166247399282,6cyclictest171rcu_preempt19:33:101
166247299287,18cyclictest1662452-21unin-run19:16:060
1662472992815,3cyclictest1731679-21wc21:46:060
166247299280,20cyclictest0-21swapper/022:43:150
1662473992722,3cyclictest0-21swapper/100:08:551
1662472992715,2cyclictest1708378-21ssh21:21:070
166247299271,26cyclictest0-21swapper/022:33:160
166247299270,20cyclictest1715837-21grep21:28:160
166247499264,16cyclictest992-21lldpd22:43:062
166247499263,20cyclictest1889137-21unin-run00:36:062
166247399265,4cyclictest11050irq/107-eth%d23:27:481
166247399265,16cyclictest111788-21systemd-journal00:15:571
166247399263,17cyclictest1685534-21sendmail-msp20:26:101
1662472992614,3cyclictest0-21swapper/021:58:120
166247299260,3cyclictest1894770-21fschecks_count00:43:060
166247299260,2cyclictest1770863-21/usr/sbin/munin22:28:170
166247299260,2cyclictest1770863-21/usr/sbin/munin22:28:170
1662474992518,5cyclictest1788164-21sendmail-msp22:48:142
166247399255,15cyclictest619-21mta-sts-daemon00:32:031
166247399254,17cyclictest1895424-21ntp_states00:43:121
166247399252,19cyclictest1873170-21ssh00:18:061
166247299252,21cyclictest1862708-21unin-run00:06:050
166247299252,14cyclictest11050irq/107-eth%d00:21:090
166247299251,23cyclictest1822327-21tune2fs23:23:040
166247499246,2cyclictest11050irq/107-eth%d23:33:082
1662474992417,6cyclictest0-21swapper/222:27:032
1662474992417,6cyclictest0-21swapper/222:27:032
166247399245,17cyclictest2243333-21munin-node23:47:481
166247399240,7cyclictest171rcu_preempt22:29:491
166247399240,7cyclictest171rcu_preempt22:29:491
166247299243,14cyclictest1678936-21sendmail-msp20:08:430
1662472992418,1cyclictest0-21swapper/022:58:110
112699240,2rtkit-daemon1006-21mta-sts-daemon23:57:202
166247499235,10cyclictest1818307-21ntpq23:18:102
166247399232,2cyclictest171rcu_preempt20:47:031
1662473992316,6cyclictest0-21swapper/121:28:111
166247299232,16cyclictest111788-21systemd-journal23:15:540
1662472992311,4cyclictest1788164-21sendmail-msp22:48:140
166247299230,22cyclictest0-21swapper/023:43:070
166247499227,14cyclictest1006-21mta-sts-daemon00:10:172
166247499223,14cyclictest1756824-21/usr/sbin/munin22:13:062
1662474992211,6cyclictest1005-21mta-sts-daemon20:41:082
1662473992214,4cyclictest0-21swapper/123:08:131
166247299225,14cyclictest1788164-21sendmail-msp22:53:100
166247299221,10cyclictest0-21swapper/019:23:040
166247299220,6cyclictest1739070-21cat21:53:160
166247499216,11cyclictest967-21snmpd20:18:422
166247499214,12cyclictest1788164-21sendmail-msp22:54:412
166247499213,12cyclictest111788-21systemd-journal23:26:392
1662474992117,3cyclictest1894848-21fschecks_time00:43:062
166247399213,15cyclictest122792-21ntpd22:58:081
166247399212,6cyclictest0-21swapper/121:23:081
166247399212,4cyclictest171rcu_preempt22:43:101
166247299214,11cyclictest1750279-21sendmail-msp22:13:100
1662472992118,2cyclictest0-21swapper/022:26:020
1662472992113,5cyclictest1685879-21latency_hist20:26:060
166247299211,19cyclictest1803833-21fschecks_time23:03:050
166247299211,16cyclictest11050irq/107-eth%d21:38:030
166247399200,6cyclictest11050irq/107-eth%d22:14:081
166247299202,13cyclictest1880919-21ssh00:26:080
166247299202,13cyclictest1880919-21ssh00:26:080
166247299200,19cyclictest0-21swapper/023:38:110
166247499195,9cyclictest1805223-21ssh23:03:432
166247499194,10cyclictest607-21dbus-daemon00:21:062
166247499192,14cyclictest1738563-21ntpq21:53:102
1662474991914,2cyclictest0-21swapper/222:09:392
166247499191,2cyclictest0-21swapper/200:15:252
166247499191,15cyclictest967-21snmpd21:21:072
166247399196,11cyclictest1007-21mta-sts-daemon23:03:431
166247399193,5cyclictest171rcu_preempt19:53:141
166247399193,4cyclictest11050irq/107-eth%d22:34:541
166247399193,11cyclictest1676239-21fschecks_time19:58:031
166247399192,6cyclictest171rcu_preempt22:36:061
166247399192,12cyclictest11050irq/107-eth%d20:36:081
166247399192,10cyclictest1876221-21ssh00:21:091
166247299192,14cyclictest1693387-21/usr/sbin/munin20:48:120
166247299191,6cyclictest1677413-21cat20:01:060
1662472991914,3cyclictest1699620-21grep21:03:130
1662472991913,5cyclictest0-21swapper/021:08:110
166247299191,12cyclictest1685534-21sendmail-msp20:31:250
166247599183,8cyclictest0-21swapper/300:18:063
166247499186,9cyclictest1808104-21/usr/sbin/munin23:08:132
166247499183,10cyclictest1699755-21sendmail-msp21:06:242
1662474991815,3cyclictest1702405-21ntp_kernel_err21:13:092
1662474991815,2cyclictest1742649-21grep21:58:062
166247499181,12cyclictest1750279-21sendmail-msp22:06:062
166247499181,12cyclictest1698682-21cut21:03:042
166247399183,12cyclictest1719324-21ssh21:33:041
166247399183,10cyclictest1691721-21apt-get20:41:081
166247399182,2cyclictest171rcu_preempt22:48:111
1662473991815,2cyclictest1005-21mta-sts-daemon23:11:151
166247299182,12cyclictest1747999-21wc22:03:110
166247299181,16cyclictest0-21swapper/000:41:060
166247299181,13cyclictest1665773-21sendmail-msp19:28:060
166247599173,5cyclictest0-21swapper/323:43:093
166247499177,8cyclictest1781005-21ssh22:38:092
166247499175,8cyclictest11050irq/107-eth%d21:28:112
166247499174,9cyclictest1693172-21sendmail-msp20:48:042
166247499174,10cyclictest111788-21systemd-journal22:34:542
166247499172,13cyclictest1704845-21cut21:18:052
166247399171,3cyclictest171rcu_preempt23:33:081
1662473991713,3cyclictest1680532-21grep20:08:151
1662473991712,2cyclictest0-21swapper/123:38:161
1662473991711,5cyclictest1125-21rtkit-daemon23:18:161
166247399171,13cyclictest1705474-21/usr/sbin/munin21:18:111
1662473991710,6cyclictest1008-21mta-sts-daemon22:03:061
166247399170,6cyclictest171rcu_preempt21:43:091
166247299173,11cyclictest1831762-21cut23:33:050
166247299171,7cyclictest4049630-21kworker/0:0+events19:41:060
1662472991713,3cyclictest1678911-21idleruntime-cro20:06:060
1662472991712,3cyclictest1696382-21unixbench_singl20:53:200
1662472991710,5cyclictest1750279-21sendmail-msp22:06:430
112699170,5rtkit-daemon111788-21systemd-journal19:13:101
112699170,5rtkit-daemon1005-21mta-sts-daemon21:10:571
166247599163,5cyclictest0-21swapper/323:38:113
166247499166,6cyclictest0-21swapper/220:33:022
166247499164,9cyclictest1806724-21sendmail-msp23:15:542
166247499164,10cyclictest111788-21systemd-journal20:08:102
166247499163,11cyclictest259-21jbd2/mmcblk0p2-800:30:302
166247499163,11cyclictest259-21jbd2/mmcblk0p2-800:30:302
166247499162,13cyclictest1850284-21telnet23:53:032
166247499162,10cyclictest1723987-21fschecks_count21:38:042
1662474991613,2cyclictest0-21swapper/219:18:112
1662474991611,3cyclictest259-21jbd2/mmcblk0p2-819:33:052
166247499161,13cyclictest111788-21systemd-journal19:51:062
166247499161,10cyclictest1675058-21ntpq19:53:142
166247499160,10cyclictest11050irq/107-eth%d19:38:082
166247399169,4cyclictest1697994-21grep20:58:151
166247399164,8cyclictest1667010-21/usr/sbin/munin19:28:101
166247399162,3cyclictest171rcu_preempt21:38:031
166247399161,3cyclictest171rcu_preempt19:43:091
1662473991613,1cyclictest0-21swapper/121:53:031
1662473991610,3cyclictest1701933-21fschecks_count21:13:051
166247299166,3cyclictest1-21systemd19:19:110
166247299162,11cyclictest1672354-21sendmail-msp19:46:230
166247299162,10cyclictest1693149-21idleruntime-cro20:46:060
166247599154,6cyclictest0-21swapper/322:43:103
166247599153,8cyclictest0-21swapper/300:13:103
166247599153,6cyclictest0-21swapper/322:58:083
166247599153,6cyclictest0-21swapper/321:28:113
166247599152,7cyclictest0-21swapper/323:27:163
166247599152,7cyclictest0-21swapper/322:48:463
166247599152,6cyclictest0-21swapper/323:08:133
166247599152,6cyclictest0-21swapper/322:18:043
166247599151,7cyclictest0-21swapper/300:33:003
166247599151,7cyclictest0-21swapper/300:11:073
166247599151,7cyclictest0-21swapper/300:03:103
166247499159,2cyclictest0-21swapper/223:46:382
166247499155,5cyclictest1767324-21/usr/sbin/munin22:23:122
166247499153,9cyclictest1822766-21ssh23:23:072
166247499152,8cyclictest1731586-21sendmail21:46:062
166247499152,7cyclictest1837105-21ssh23:38:112
166247499151,8cyclictest1873138-21ntpq00:18:062
166247499151,10cyclictest1860865-21sed00:03:152
166247399156,6cyclictest1767084-21/usr/sbin/munin22:23:081
166247399154,8cyclictest764-21rs:main1
166247399152,9cyclictest1731615-21sendmail-msp21:48:031
166247399151,4cyclictest171rcu_preempt22:08:111
1662473991512,2cyclictest0-21swapper/120:26:061
166247299154,6cyclictest1681148-21fschecks_time20:13:070
1662472991512,2cyclictest1701924-21tune2fs21:13:040
166247599146,6cyclictest0-21swapper/321:21:073
166247599143,6cyclictest0-21swapper/323:58:103
166247599142,7cyclictest0-21swapper/323:18:103
166247599142,6cyclictest0-21swapper/323:47:483
166247599142,6cyclictest0-21swapper/323:13:133
166247499147,3cyclictest0-21swapper/219:58:012
166247499143,7cyclictest1844064-21cut23:46:062
166247499141,10cyclictest1672451-21grep19:46:062
1662474991410,3cyclictest1005-21mta-sts-daemon21:31:122
166247399145,7cyclictest0-21swapper/120:53:191
166247399144,8cyclictest1855627-21/usr/sbin/munin23:58:071
166247399144,7cyclictest1891236-21ssh00:38:111
166247399144,7cyclictest1841860-21/usr/sbin/munin23:43:111
166247399144,7cyclictest1663072-21/usr/sbin/munin19:18:051
166247399142,9cyclictest111788-21systemd-journal19:48:061
166247399142,8cyclictest1822794-21ntpq23:23:071
166247399142,6cyclictest1844085-21sendmail-msp23:53:171
1662473991412,1cyclictest0-21swapper/120:13:081
166247299143,7cyclictest1665773-21sendmail-msp19:33:100
166247299141,8cyclictest0-21swapper/019:53:150
166247299141,8cyclictest0-21swapper/019:43:030
112699140,3rtkit-daemon1005-21mta-sts-daemon19:26:582
166247599136,4cyclictest0-21swapper/300:38:153
166247599134,7cyclictest0-21swapper/321:58:103
166247599133,7cyclictest0-21swapper/323:33:083
166247599132,6cyclictest0-21swapper/323:03:083
166247599132,6cyclictest0-21swapper/319:48:033
166247599132,5cyclictest0-21swapper/300:43:073
166247599131,6cyclictest0-21swapper/321:33:023
166247599130,7cyclictest0-21swapper/322:03:143
166247599130,7cyclictest0-21swapper/320:28:443
166247599130,6cyclictest0-21swapper/320:41:083
166247499139,3cyclictest1696335-21grep20:53:202
166247499134,6cyclictest1664716-21fschecks_time19:23:062
166247499133,9cyclictest1678753-21sed20:03:132
166247499133,8cyclictest1733849-21/usr/sbin/munin21:48:092
166247499133,8cyclictest0-21swapper/220:36:072
166247499133,7cyclictest1697648-21/usr/sbin/munin20:58:112
166247499133,5cyclictest3040334-1kworker/2:0H+kblockd20:13:142
166247499131,10cyclictest1684082-21/usr/sbin/munin20:23:032
166247399139,3cyclictest0-21swapper/121:03:051
166247399139,3cyclictest0-21swapper/119:23:051
166247399138,3cyclictest0-21swapper/119:38:081
166247399138,2cyclictest0-21swapper/120:33:021
166247399133,6cyclictest1678465-21/usr/sbin/munin20:03:101
166247399131,2cyclictest171rcu_preempt20:18:091
166247299131,9cyclictest1682804-21fschecks_time20:18:040
166247299130,3cyclictest1698106-21/usr/sbin/munin21:01:060
166247599126,4cyclictest0-21swapper/322:38:063
166247599125,4cyclictest0-21swapper/320:33:023
166247599124,4cyclictest0-21swapper/320:38:113
166247599123,6cyclictest0-21swapper/322:30:213
166247599123,6cyclictest0-21swapper/322:30:213
166247599123,5cyclictest0-21swapper/319:28:103
166247599123,4cyclictest0-21swapper/321:08:103
166247599122,6cyclictest0-21swapper/320:58:093
166247599122,6cyclictest0-21swapper/319:46:053
166247599122,6cyclictest0-21swapper/300:26:073
166247599122,6cyclictest0-21swapper/300:26:073
166247599122,5cyclictest0-21swapper/322:23:003
166247599122,5cyclictest0-21swapper/321:17:413
166247599120,5cyclictest0-21swapper/319:58:033
166247599120,5cyclictest0-21swapper/319:31:203
166247499121,2cyclictest1891844-21awk00:38:172
166247599113,4cyclictest0-21swapper/321:48:063
166247599113,4cyclictest0-21swapper/321:43:083
166247599113,4cyclictest0-21swapper/320:52:583
166247599113,3cyclictest0-21swapper/323:21:563
166247599112,5cyclictest0-21swapper/322:53:043
166247599112,4cyclictest0-21swapper/322:31:233
166247599112,4cyclictest0-21swapper/319:53:053
166247599111,5cyclictest0-21swapper/320:08:093
166247599110,7cyclictest0-21swapper/323:53:023
166247599103,4cyclictest0-21swapper/321:52:213
166247599102,5cyclictest0-21swapper/321:38:033
166247599102,5cyclictest0-21swapper/320:18:033
166247599102,5cyclictest0-21swapper/320:06:063
166247599102,5cyclictest0-21swapper/319:38:043
166247599102,5cyclictest0-21swapper/300:23:183
166247599102,4cyclictest0-21swapper/320:13:143
166247599101,6cyclictest0-21swapper/322:08:073
16624759994,4cyclictest0-21swapper/321:03:043
16624759994,3cyclictest0-21swapper/322:12:303
16624759994,3cyclictest0-21swapper/319:23:083
16624759993,5cyclictest0-21swapper/321:13:063
16624759993,5cyclictest0-21swapper/319:16:083
16624759991,5cyclictest0-21swapper/320:26:063
16624749991,6cyclictest1662637-21latency_hist19:16:062
16624759982,2cyclictest0-21swapper/320:46:313
16624759941,2cyclictest0-21swapper/319:16:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional