You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-05-26 - 17:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7.osadl.org (updated Sun May 26, 2024 12:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
172162499363,14cyclictest1917644-21ntpq12:41:500
1721624993514,6cyclictest0-21swapper/011:31:540
1721624993418,5cyclictest0-21swapper/009:56:540
172162499321,26cyclictest171rcu_preempt12:21:500
1721624993126,3cyclictest0-21swapper/012:06:550
172162499302,16cyclictest1900640-21cut12:21:430
172162499301,25cyclictest1808640-21ntp_states10:16:480
172162499292,4cyclictest1837825-21ntpq10:56:480
172162499281,21cyclictest1790478-21sort09:51:420
172162499270,26cyclictest0-21swapper/011:41:530
172162499254,20cyclictest0-21swapper/010:11:430
172162499251,4cyclictest1878252-21/usr/sbin/munin11:51:390
172162499247,6cyclictest1856418-21munin-plugin-st11:21:500
1721624992417,5cyclictest0-21swapper/010:21:500
1721624992412,2cyclictest1859369-21/usr/sbin/munin11:26:380
172162499240,24cyclictest0-21swapper/009:16:500
172162499240,17cyclictest0-21swapper/011:06:430
112299240,2rtkit-daemon1121-21rtkit-daemon10:15:122
1721629992311,7cyclictest1841654-21munin-run11:01:502
172162499237,4cyclictest171rcu_preempt11:41:500
172162499237,4cyclictest171rcu_preempt11:41:500
172162499230,1cyclictest0-21swapper/009:46:480
172162499230,13cyclictest1887141-21timerwakeupswit12:02:020
172162699222,15cyclictest1871561-21sendmail-msp11:41:501
172162699222,15cyclictest1871561-21sendmail-msp11:41:501
172162499223,18cyclictest1882722-21latency_hist11:56:500
1721624992214,2cyclictest1886359-21munin-run12:01:500
172162499220,16cyclictest0-21swapper/010:24:560
172162999219,6cyclictest1908536-21latency_hist12:31:502
172162499216,15cyclictest1000-21mta-sts-daemon08:21:500
172162499211,5cyclictest1775358-21gltestperf09:31:420
172162499210,16cyclictest1853021-21latency_hist11:16:500
172162999209,8cyclictest1917639-21munin-run12:41:502
172162499200,11cyclictest1778639-21ssh09:36:340
112299200,1rtkit-daemon0-21swapper/111:18:011
172162999192,14cyclictest1875384-21cat11:46:502
172162699194,9cyclictest1896766-21aten_r2power_fr12:16:461
1721624991911,6cyclictest1848471-21fschecks_time11:11:450
112299190,6rtkit-daemon0-21swapper/211:02:412
172162999183,9cyclictest1779975-21/usr/sbin/munin09:36:502
1721629991810,4cyclictest0-21swapper/211:11:582
172162999180,11cyclictest1746397-21latency_hist08:26:502
172162699184,8cyclictest1722815-21sshd07:16:461
172162699184,10cyclictest1833254-21/usr/sbin/munin10:51:381
172162699183,9cyclictest1917797-21cat12:41:511
172162699183,11cyclictest1908561-21/usr/sbin/munin12:31:491
172162499184,11cyclictest1864046-21systemctl11:31:500
1721624991813,2cyclictest0-21swapper/012:36:410
172162499180,10cyclictest0-21swapper/008:31:360
172163099175,4cyclictest0-21swapper/312:41:503
172162999172,7cyclictest1901039-21ntpq12:21:502
1721629991712,4cyclictest321-21systemd-journal07:51:492
1721629991712,3cyclictest1889744-21cron12:06:502
1721629991710,6cyclictest1833516-21fschecks_time10:51:412
172162699178,7cyclictest1751439-21timerandwakeup08:41:501
172162699176,8cyclictest1744575-21munin-run08:21:501
172162699175,9cyclictest1749655-21wc08:36:501
172162699174,7cyclictest1864026-21munin-run11:31:501
172162699174,7cyclictest1738398-21/usr/sbin/munin08:01:501
172162699172,9cyclictest1754421-21ntpq08:51:501
172162699172,6cyclictest1746362-21latency_hist08:26:501
172162699171,4cyclictest1864741-21ssh11:31:561
172162699171,2cyclictest0-21swapper/109:11:481
1721626991711,5cyclictest1886409-21grep12:01:501
172162699171,12cyclictest1721619-21gcc07:11:501
172162499178,5cyclictest12050irq/162-mmc010:31:500
172162499177,2cyclictest1827084-21cat10:41:500
172162499176,3cyclictest1753548-21/usr/sbin/munin08:51:510
172162499175,4cyclictest0-21swapper/009:21:500
1721624991713,3cyclictest1001-21mta-sts-daemon12:14:070
1721624991712,4cyclictest613-21gpm10:34:190
172162499171,12cyclictest1734895-21ntpq07:51:500
172162999164,6cyclictest1845409-21ssh11:06:532
172162999162,12cyclictest1748167-21latency_hist08:31:502
172162999162,10cyclictest1761458-21sed09:11:502
172162999161,9cyclictest1904398-21fschecks_time12:26:422
1721629991612,3cyclictest0-21swapper/211:31:502
1721629991612,2cyclictest1882635-21cron11:56:502
172162699165,5cyclictest1889189-21/usr/sbin/munin12:06:541
172162699164,7cyclictest1764783-21latency_hist09:16:501
172162699164,6cyclictest1757850-21latency_hist09:01:501
172162699163,9cyclictest1755857-21munin-plugin-st08:56:491
172162699163,11cyclictest1794216-21idleruntime-cro09:56:501
172162699162,10cyclictest1830464-21/usr/sbin/munin10:46:501
1721626991610,3cyclictest0-21swapper/112:36:381
172162499164,3cyclictest171rcu_preempt07:41:500
172162499163,11cyclictest1838315-21/usr/sbin/munin10:56:520
172162499162,11cyclictest1739077-21fschecks_count08:06:440
172162499162,11cyclictest1739077-21fschecks_count08:06:440
1721624991610,1cyclictest0-21swapper/008:16:500
112299160,2rtkit-daemon0-21swapper/210:34:122
172162999154,6cyclictest1750893-21/usr/sbin/munin08:41:412
172162999154,6cyclictest0-21swapper/209:51:502
172162999153,8cyclictest1721793-21/usr/sbin/munin07:11:502
172162999153,7cyclictest1818500-21ssh10:31:342
172162999152,10cyclictest1879189-21/usr/sbin/munin11:51:502
172162999151,9cyclictest1912558-21if_wlan012:36:422
1721629991511,3cyclictest1771645-21grep09:26:442
1721629991511,3cyclictest1724693-21gltestperf07:21:512
172162999151,11cyclictest1754100-21if_wlan008:51:462
172162699159,4cyclictest1819617-21processes10:31:501
172162699156,8cyclictest1121-21rtkit-daemon11:11:591
172162699155,8cyclictest1728198-21ps07:31:501
172162699153,7cyclictest1802095-21ssh10:06:561
172162699152,9cyclictest1815569-21latency10:26:501
172162699152,11cyclictest1900429-21/usr/sbin/munin12:21:421
172162699152,11cyclictest11050irq/107-eth%d10:16:451
1721626991513,1cyclictest0-21swapper/111:56:361
1721626991512,2cyclictest1784046-21unixbench_multi09:41:541
1721626991511,3cyclictest1783203-21ntp_kernel_err09:41:471
172162699151,12cyclictest587-21mta-sts-daemon11:46:501
1721626991510,3cyclictest0-21swapper/107:36:421
172162499158,5cyclictest0-21swapper/007:22:000
172162499154,6cyclictest1728170-21/usr/sbin/munin07:31:490
172162499154,1cyclictest171rcu_preempt07:16:440
172162499153,8cyclictest1757851-21/usr/sbin/munin09:01:500
172162499153,8cyclictest1729982-21basename07:36:500
1721624991512,2cyclictest1908024-21cut12:31:430
1721624991512,2cyclictest1753467-21grep08:46:500
172162499150,9cyclictest1827273-21ps10:41:520
172163099144,6cyclictest0-21swapper/312:11:543
172163099144,4cyclictest0-21swapper/308:56:493
172163099143,5cyclictest0-21swapper/309:56:563
172163099142,5cyclictest0-21swapper/312:31:503
172163099141,5cyclictest0-21swapper/309:01:503
172162999144,9cyclictest1737114-21/usr/sbin/munin08:01:492
172162999144,8cyclictest1729218-21fschecks_count07:36:402
172162999144,4cyclictest1893259-21ssh12:11:392
172162999142,8cyclictest2008528-21snmpd12:12:272
172162999142,8cyclictest1826321-21grep10:41:422
172162999142,8cyclictest1815656-21/usr/sbin/munin10:26:502
172162999142,8cyclictest1735852-21fschecks_time07:56:432
172162999142,11cyclictest1722324-21/usr/sbin/munin07:16:392
172162999142,10cyclictest1798689-21/usr/sbin/munin10:01:562
172162999141,9cyclictest1802052-21ssh10:06:562
1721629991411,2cyclictest1002-21mta-sts-daemon11:59:082
1721629991410,3cyclictest1758940-21gltestperf09:06:422
172162699147,5cyclictest0-21swapper/109:26:481
172162699143,9cyclictest1747914-21/usr/sbin/munin08:31:481
172162699143,9cyclictest0-21swapper/111:11:491
172162699143,10cyclictest1742344-21cut08:16:451
172162699142,7cyclictest1819850-21/usr/sbin/munin10:31:511
1721626991412,1cyclictest0-21swapper/109:31:501
1721626991411,2cyclictest1739194-21gltestperf08:06:451
1721626991411,2cyclictest1739194-21gltestperf08:06:451
1721626991411,1cyclictest0-21swapper/111:51:411
1721626991410,3cyclictest1001-21mta-sts-daemon10:06:371
1721626991410,3cyclictest1000-21mta-sts-daemon10:19:511
1721626991410,3cyclictest0-21swapper/112:21:521
172162499149,4cyclictest1752693-21ntp_kernel_err08:46:430
172162499147,5cyclictest0-21swapper/008:07:000
172162499143,9cyclictest1745436-21/usr/sbin/munin08:26:370
172162499143,7cyclictest0-21swapper/007:11:500
172162499143,6cyclictest1780109-21ssh09:36:510
172162499142,9cyclictest1834103-21/usr/sbin/munin10:51:490
1721624991411,2cyclictest1799003-21grep10:01:580
172162499141,11cyclictest1724193-21/usr/sbin/munin07:21:480
172162499140,2cyclictest1769145-21timerandwakeup09:21:580
112299140,2rtkit-daemon1121-21rtkit-daemon08:15:402
172163099134,4cyclictest0-21swapper/312:06:503
172163099133,8cyclictest0-21swapper/311:06:503
172163099133,6cyclictest0-21swapper/310:37:013
172163099133,4cyclictest0-21swapper/307:41:493
172163099132,7cyclictest0-21swapper/311:31:443
172163099132,5cyclictest0-21swapper/307:31:503
172163099132,4cyclictest0-21swapper/311:11:573
172162999139,3cyclictest1121-21rtkit-daemon11:18:382
172162999138,4cyclictest0-21swapper/207:41:562
172162999137,4cyclictest0-21swapper/208:56:542
172162999137,3cyclictest0-21swapper/209:56:572
172162999135,7cyclictest0-21swapper/211:36:542
172162999135,7cyclictest0-21swapper/211:36:542
172162999134,6cyclictest1754668-21ntp_states08:51:522
172162999134,5cyclictest1775894-21munin-run09:31:492
172162999133,8cyclictest1749358-21/usr/sbin/munin08:36:432
172162999133,7cyclictest1724074-21aten_r2power_fr07:21:462
172162999133,7cyclictest0-21swapper/210:16:512
172162999132,9cyclictest1767880-21/usr/sbin/munin09:21:422
172162999132,9cyclictest1751994-21/usr/sbin/munin08:46:352
172162999132,8cyclictest1741434-21latency_hist08:11:492
172162999131,9cyclictest1859793-21/usr/sbin/munin11:26:402
172162999131,10cyclictest1727609-21grep07:31:412
1721629991310,2cyclictest1744119-21grep08:21:442
172162699138,3cyclictest1838051-21gcc10:56:501
172162699135,6cyclictest0-21swapper/107:51:431
172162699133,8cyclictest1759517-21date09:06:501
172162699133,6cyclictest1823704-21ssh10:36:561
172162699133,4cyclictest1886847-21/usr/sbin/munin12:01:551
172162699132,4cyclictest1860211-21ntpq11:26:451
172162699132,10cyclictest1838411-21ls10:56:531
172162699131,9cyclictest1790086-21cut09:51:391
172162699131,3cyclictest0-21swapper/107:46:391
172162499133,7cyclictest1738223-21/usr/sbin/munin08:01:490
172162499132,9cyclictest1731669-21/usr/sbin/munin07:41:500
172162499132,8cyclictest1751656-21latency_hist08:41:500
172162499131,9cyclictest0-21swapper/007:56:440
172163099124,4cyclictest0-21swapper/311:26:423
172163099123,6cyclictest0-21swapper/312:11:463
172163099123,5cyclictest0-21swapper/311:31:553
172163099122,5cyclictest0-21swapper/307:51:493
172163099121,5cyclictest0-21swapper/310:26:593
172162999127,3cyclictest0-21swapper/207:41:452
172162999125,5cyclictest0-21swapper/211:31:542
172162999124,7cyclictest0-21swapper/209:41:532
172162999122,6cyclictest1764822-21ntpq09:16:502
172162999120,8cyclictest1738635-21grep08:01:522
172162999120,8cyclictest1738635-21grep08:01:522
172162699129,2cyclictest1735412-21unixbench_singl07:51:551
172162699127,2cyclictest1773339-21ssh09:27:451
172162699124,5cyclictest1768531-21ntpq09:21:501
172162699124,5cyclictest1730519-21/usr/sbin/munin07:36:531
172162699122,8cyclictest1794900-21rm09:56:581
172162699122,8cyclictest1723967-21munin-node07:21:341
172162699121,8cyclictest1844985-21ssh11:06:501
172162499128,2cyclictest0-21swapper/009:11:380
172162499124,5cyclictest0-21swapper/009:01:550
172162499124,3cyclictest179156650ssh09:52:070
172163099114,3cyclictest0-21swapper/312:17:163
172163099113,5cyclictest0-21swapper/309:16:453
172163099113,5cyclictest0-21swapper/309:06:503
172163099113,4cyclictest0-21swapper/311:51:503
172163099112,5cyclictest0-21swapper/312:21:583
172163099112,5cyclictest0-21swapper/311:41:583
172163099112,5cyclictest0-21swapper/310:16:373
172163099112,5cyclictest0-21swapper/308:01:493
172163099112,4cyclictest0-21swapper/307:56:423
172163099112,3cyclictest0-21swapper/308:21:503
172163099111,7cyclictest0-21swapper/311:51:533
172163099111,5cyclictest0-21swapper/309:41:453
172162999115,4cyclictest1780358-21/usr/sbin/munin09:36:522
172162999113,6cyclictest1793844-21/usr/sbin/munin09:56:422
172162999111,8cyclictest1827648-21sed10:41:562
172162999111,7cyclictest1834534-21ssh10:51:532
172162699112,7cyclictest1739934-21/usr/sbin/munin08:06:561
172162699111,8cyclictest1725505-21/usr/sbin/munin07:22:031
172162699111,6cyclictest1752689-21/usr/sbin/munin08:46:431
172162499111,8cyclictest1748986-21grep08:36:400
172163099104,3cyclictest0-21swapper/309:51:423
172163099103,4cyclictest0-21swapper/309:56:483
172163099103,4cyclictest0-21swapper/309:31:363
172163099103,4cyclictest0-21swapper/308:51:443
172163099103,4cyclictest0-21swapper/308:41:503
172163099103,4cyclictest0-21swapper/307:11:503
172163099102,5cyclictest0-21swapper/310:56:523
172163099102,5cyclictest0-21swapper/310:21:423
172163099102,5cyclictest0-21swapper/310:01:513
172163099102,4cyclictest0-21swapper/310:21:513
172163099101,5cyclictest0-21swapper/311:36:523
172163099101,5cyclictest0-21swapper/311:36:523
172163099101,5cyclictest0-21swapper/309:21:503
172163099101,4cyclictest0-21swapper/312:01:393
172163099101,4cyclictest0-21swapper/308:31:503
172163099100,5cyclictest0-21swapper/310:11:433
17216309994,3cyclictest0-21swapper/312:36:433
17216309994,3cyclictest0-21swapper/309:41:503
17216309993,5cyclictest0-21swapper/308:11:513
17216309993,4cyclictest0-21swapper/309:11:503
17216309993,3cyclictest0-21swapper/310:41:523
17216309993,3cyclictest0-21swapper/310:31:523
17216309993,3cyclictest0-21swapper/308:21:523
17216309993,3cyclictest0-21swapper/307:41:533
17216309993,3cyclictest0-21swapper/307:22:003
17216309993,3cyclictest0-21swapper/307:16:513
17216309992,5cyclictest0-21swapper/308:46:393
17216309992,4cyclictest0-21swapper/310:51:433
17216309991,6cyclictest0-21swapper/310:51:523
17216309991,6cyclictest0-21swapper/309:31:533
17216309991,5cyclictest0-21swapper/309:21:503
17216309991,5cyclictest0-21swapper/308:06:513
17216309991,4cyclictest0-21swapper/307:16:443
17216309983,3cyclictest0-21swapper/307:36:483
17216309981,4cyclictest0-21swapper/311:16:523
17216309981,4cyclictest0-21swapper/308:26:563
17216309972,3cyclictest0-21swapper/308:01:523
17216309972,3cyclictest0-21swapper/308:01:523
17216309962,2cyclictest0-21swapper/311:06:513
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional