You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-14 - 05:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7.osadl.org (updated Fri Jun 14, 2024 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1480494993815,7cyclictest1684186-21/usr/sbin/munin00:06:500
148049499372,8cyclictest1604916-21grep22:41:570
148049499370,7cyclictest1577086-21ssh22:12:060
1480494993526,2cyclictest1550199-21sshd21:44:190
148049499313,19cyclictest1614232-21ssh22:51:540
148049499313,19cyclictest0-21swapper/022:26:530
148049499312,27cyclictest0-21swapper/022:47:010
148049499312,18cyclictest1656824-21fschecks_count23:36:540
1480494993027,2cyclictest1680651-21kernelversion00:02:030
148049499301,21cyclictest1648539-21switchtime23:27:080
148049499298,15cyclictest0-21swapper/022:07:090
148049499291,26cyclictest1639459-21users23:17:100
1480494992827,1cyclictest0-21swapper/000:17:050
148049499282,2cyclictest0-21swapper/021:41:580
1480494992816,3cyclictest0-21swapper/022:57:300
1480495992720,5cyclictest1553250-21systemctl21:47:061
1480494992713,3cyclictest1619558-21/usr/sbin/munin22:57:010
148049499270,25cyclictest0-21swapper/023:56:140
1480495992510,11cyclictest1480453-21/usr/sbin/munin19:12:061
148049499255,7cyclictest1633226-21diskstats23:11:570
148049499243,10cyclictest1662531-21/usr/sbin/munin23:42:080
148049499241,21cyclictest0-21swapper/000:37:080
148049699236,5cyclictest0-21swapper/222:51:592
1480495992315,6cyclictest271ktimers/122:22:031
148049499230,17cyclictest1556753-21awk21:51:520
148049699229,11cyclictest619-21systemd-logind23:52:062
1480496992210,5cyclictest1710199-21/usr/sbin/munin00:41:532
148049499222,4cyclictest1495018-21cut19:57:060
1480494992221,1cyclictest0-21swapper/022:31:530
1480494992218,3cyclictest1523888-21ssh21:16:570
1480494992214,1cyclictest0-21swapper/022:33:210
1480495992119,1cyclictest0-21swapper/123:17:051
112299210,2rtkit-daemon1001-21mta-sts-daemon00:14:121
148049699209,8cyclictest1703632-21tune2fs00:31:552
148049699209,7cyclictest1595407-21grep22:31:572
148049699208,11cyclictest1666237-21grep23:46:562
1480496992017,2cyclictest0-21swapper/221:12:102
148049599209,2cyclictest11050irq/107-eth%d00:37:001
148049599201,16cyclictest1633959-21grep23:12:061
148049599200,15cyclictest1652802-21/usr/sbin/munin23:32:021
148049499206,5cyclictest1700490-21ntpq00:27:020
1480494992017,2cyclictest0-21swapper/023:03:190
1480494992014,1cyclictest0-21swapper/000:11:570
148049499200,18cyclictest0-21swapper/021:37:010
112299200,5rtkit-daemon1121-21rtkit-daemon21:44:202
148049699198,8cyclictest1493273-21/usr/sbin/munin19:52:052
148049699198,4cyclictest1661691-21grep23:41:592
1480496991915,2cyclictest1514654-21munin-plugin-st20:57:052
1480496991912,4cyclictest1652176-21grep23:31:542
1480496991911,4cyclictest1623679-21fschecks_count23:01:542
148049599193,12cyclictest1000-21mta-sts-daemon19:37:001
148049499194,6cyclictest1529035-21ssh21:22:040
1480494991917,1cyclictest0-21swapper/023:12:090
148049499191,3cyclictest0-21swapper/021:57:060
148049699189,7cyclictest1638050-21cut23:16:572
148049699188,9cyclictest1590488-21/usr/sbin/munin22:26:522
148049699187,8cyclictest1506390-21cat20:32:062
148049699187,3cyclictest1504640-21ntp_states20:27:012
148049699185,12cyclictest0-21swapper/222:21:522
148049699184,10cyclictest1625394-21ssh23:02:322
148049699183,7cyclictest11050irq/107-eth%d22:12:062
1480496991816,1cyclictest0-21swapper/222:57:032
1480496991813,4cyclictest1697638-21/usr/sbin/munin00:22:062
1480496991813,4cyclictest1696666-21sed00:21:552
1480496991811,6cyclictest1689450-21date00:12:062
1480496991811,5cyclictest1604953-21gltestperf22:41:572
1480496991810,5cyclictest1679993-21/usr/sbin/munin00:01:562
148049599187,2cyclictest0-21swapper/100:31:531
148049599181,8cyclictest1483759-21/usr/sbin/munin19:22:061
1480495991814,3cyclictest1491017-21gltestperf19:46:541
1480495991812,5cyclictest0-21swapper/123:17:081
148049499186,2cyclictest0-21swapper/000:37:010
148049499181,9cyclictest1490375-21/usr/sbin/munin19:42:060
1480494991812,3cyclictest0-21swapper/021:31:510
148049499181,10cyclictest0-21swapper/022:07:000
112299180,4rtkit-daemon1121-21rtkit-daemon23:03:231
148049799174,8cyclictest0-21swapper/323:11:573
148049699177,8cyclictest1601340-21grep22:37:062
148049699176,8cyclictest1647495-21grep23:26:572
148049699176,6cyclictest575-21avahi-daemon22:02:012
148049699173,11cyclictest1543481-21ssh21:37:052
1480496991711,5cyclictest1675932-21/usr/sbin/munin23:56:572
148049699170,6cyclictest1547703-21kernelversion21:41:572
148049599172,13cyclictest1557941-21cron21:52:061
148049599172,12cyclictest0-21swapper/122:37:001
1480495991710,4cyclictest0-21swapper/119:26:551
1480495991710,3cyclictest1610747-21grep22:47:061
148049599170,16cyclictest1-21systemd23:42:061
148049499177,6cyclictest1671559-21/usr/sbin/munin23:52:020
148049499177,4cyclictest1661502-21/usr/sbin/munin23:41:560
148049499175,7cyclictest3210035-1kworker/0:2H+kblockd22:22:060
1480494991711,4cyclictest1486982-21grep19:32:050
1480494991711,4cyclictest0-21swapper/019:47:030
1480494991711,1cyclictest1501437-21sh20:17:060
148049499170,8cyclictest0-21swapper/000:31:510
148049799163,10cyclictest0-21swapper/300:01:563
148049699169,5cyclictest1689531-21ntpq00:12:072
148049699169,4cyclictest1576182-21/usr/sbin/munin22:11:572
148049699168,6cyclictest1484084-21head19:26:492
148049699167,8cyclictest1490147-21munin-plugin-st19:42:062
148049699164,3cyclictest1538439-21ntpq21:31:582
148049699162,8cyclictest0-21swapper/221:51:562
148049699162,10cyclictest1507156-21aten_r2power_po20:36:512
148049699161,1cyclictest1516063-21ntpq21:02:042
1480496991610,5cyclictest1707592-21/usr/sbin/munin00:36:592
1480496991610,5cyclictest1642779-21fschecks_time23:21:552
148049699160,2cyclictest1609951-21ntpq22:47:002
148049599165,8cyclictest1590512-21/usr/sbin/munin22:26:521
148049599162,8cyclictest1572125-21munin-run22:07:061
148049599162,12cyclictest1647536-21grep23:26:571
148049599162,12cyclictest1581336-21ssh22:16:581
1480495991613,2cyclictest1595426-21grep22:31:571
1480495991613,2cyclictest0-21swapper/119:52:051
1480495991611,3cyclictest1563180-21grep21:57:111
148049499169,5cyclictest0-21swapper/019:22:060
148049499166,6cyclictest1517745-21/usr/sbin/munin21:07:040
112299160,3rtkit-daemon1121-21rtkit-daemon21:23:130
148049799153,7cyclictest0-21swapper/300:42:043
148049799152,5cyclictest0-21swapper/321:04:173
148049799151,6cyclictest0-21swapper/322:36:533
148049699159,6cyclictest0-21swapper/221:22:072
148049699157,7cyclictest1510121-21/usr/sbin/munin20:42:062
148049699157,6cyclictest1572261-21grep22:07:062
148049699152,9cyclictest1495835-21tune2fs20:01:542
1480496991511,3cyclictest1656781-21/usr/sbin/munin23:36:532
1480496991511,3cyclictest1510274-21/usr/sbin/munin20:42:072
148049699151,11cyclictest1633325-21/usr/sbin/munin23:11:582
1480496991510,4cyclictest1684611-21grep00:06:562
148049599159,3cyclictest1495426-21grep19:57:101
148049599153,9cyclictest1514483-21/usr/sbin/munin20:57:021
148049599152,9cyclictest1670475-21/usr/sbin/munin23:51:491
148049599152,4cyclictest0-21swapper/100:12:041
148049599152,11cyclictest1610169-21/usr/sbin/munin22:47:031
148049599151,6cyclictest1528224-21cpuspeed21:21:531
1480495991510,4cyclictest0-21swapper/122:41:521
148049499153,7cyclictest1-21systemd19:12:060
148049499151,4cyclictest1515206-21munin-node21:01:510
148049499151,3cyclictest1567171-21ntpq22:02:010
148049499151,2cyclictest1519694-21latency_hist21:12:060
1480494991512,2cyclictest1696628-21gltestperf00:21:550
148049499151,1cyclictest0-21swapper/023:26:140
148049799144,6cyclictest0-21swapper/323:17:083
148049799141,9cyclictest0-21swapper/322:27:063
148049699149,3cyclictest1486142-21tail19:31:552
148049699144,6cyclictest1558239-21/usr/sbin/munin21:52:062
1480496991410,2cyclictest1493777-21grep19:52:082
148049599149,2cyclictest0-21swapper/100:22:061
148049599144,8cyclictest1708387-21/usr/sbin/munin00:37:081
148049599143,7cyclictest1516146-21munin-run21:02:061
148049599142,9cyclictest1523574-21cut21:16:531
148049599142,8cyclictest1681069-21awk00:02:061
148049599142,7cyclictest1499945-21latency_hist20:12:061
148049599141,7cyclictest11050irq/107-eth%d00:06:501
148049599141,3cyclictest1538166-21if_wlan021:31:541
1480495991411,2cyclictest0-21swapper/121:26:521
1480495991411,1cyclictest0-21swapper/122:56:501
148049599141,10cyclictest1697814-21grep00:22:071
148049599140,9cyclictest1667171-21latency_hist23:47:071
148049499148,2cyclictest1484819-21ntpq19:26:580
148049499145,3cyclictest1508778-21/usr/sbin/munin20:41:530
148049499143,8cyclictest1498161-21grep20:07:060
148049799133,6cyclictest0-21swapper/323:31:553
148049799133,5cyclictest0-21swapper/300:12:093
148049799132,4cyclictest0-21swapper/300:30:293
148049699139,3cyclictest1498707-21grep20:07:112
148049699139,2cyclictest1482835-21sed19:21:552
148049699138,4cyclictest1512396-21grep20:51:542
148049699138,3cyclictest1519382-21sed21:12:042
148049699137,5cyclictest1500419-21/usr/sbin/munin20:12:072
148049699137,4cyclictest1481077-21fschecks_time19:16:522
148049699137,3cyclictest1487742-21grep19:36:532
148049699136,5cyclictest1502541-21gltestperf20:21:542
148049699135,6cyclictest1528249-21/usr/sbin/munin21:21:532
148049699134,2cyclictest36-21ksoftirqd/219:12:062
148049699131,9cyclictest1490448-21sed19:42:062
1480496991311,1cyclictest1516872-21apt-get21:04:172
148049599139,3cyclictest0-21swapper/119:57:061
148049599135,6cyclictest1676272-21ssh23:57:021
148049599133,9cyclictest1489995-21/usr/sbin/munin19:42:041
148049599131,9cyclictest1547971-21ssh21:42:001
148049599131,9cyclictest1511515-21/usr/sbin/munin20:47:061
148049599131,10cyclictest1620308-21sed22:57:061
148049599131,10cyclictest1508956-21grep20:41:551
1480495991310,2cyclictest0-21swapper/123:36:521
148049499139,3cyclictest1502431-21fschecks_time20:21:530
148049499136,2cyclictest1481194-21idleruntime19:16:530
148049499131,9cyclictest1500031-21grep20:12:060
148049499131,3cyclictest1000-21mta-sts-daemon20:56:500
1480494991311,1cyclictest0-21swapper/020:26:580
148049499130,9cyclictest1493312-21/usr/sbin/munin19:52:060
148049799125,5cyclictest0-21swapper/322:52:063
148049799124,5cyclictest0-21swapper/300:21:553
148049799124,4cyclictest0-21swapper/322:57:053
148049799124,4cyclictest0-21swapper/322:17:033
148049799124,3cyclictest0-21swapper/321:42:063
148049799123,6cyclictest0-21swapper/322:37:073
148049799123,5cyclictest0-21swapper/323:56:563
148049799123,5cyclictest0-21swapper/319:31:513
148049799123,4cyclictest0-21swapper/322:01:523
148049799122,7cyclictest0-21swapper/322:12:063
148049799122,6cyclictest0-21swapper/322:47:013
148049799122,5cyclictest0-21swapper/323:47:023
148049799122,5cyclictest0-21swapper/300:12:023
148049799122,5cyclictest0-21swapper/300:06:503
148049799122,4cyclictest0-21swapper/323:27:063
148049799122,4cyclictest0-21swapper/320:06:513
148049799121,6cyclictest0-21swapper/321:17:053
148049699124,7cyclictest1497341-21head20:06:542
148049599129,2cyclictest0-21swapper/120:37:001
148049599128,2cyclictest0-21swapper/120:32:061
148049599122,8cyclictest1542306-21/usr/sbin/munin21:36:561
148049599122,8cyclictest1517689-21/usr/sbin/munin21:07:031
148049599122,7cyclictest1558314-21/usr/sbin/munin21:52:071
148049599121,8cyclictest1486729-21/usr/sbin/munin19:32:041
148049599121,7cyclictest1576671-21ssh22:12:031
148049499129,0cyclictest0-21swapper/019:36:500
148049499121,7cyclictest0-21swapper/020:01:550
148049499120,7cyclictest1510305-21/usr/sbin/munin20:47:100
148049499120,2cyclictest1506431-21ntpq20:32:070
148049799114,4cyclictest0-21swapper/323:52:063
148049799113,4cyclictest0-21swapper/322:27:073
148049799113,4cyclictest0-21swapper/321:31:483
148049799112,6cyclictest0-21swapper/322:07:053
148049799112,5cyclictest0-21swapper/322:59:083
148049799112,4cyclictest0-21swapper/321:36:513
148049799111,7cyclictest0-21swapper/323:38:033
148049799111,5cyclictest0-21swapper/321:52:053
148049599118,2cyclictest0-21swapper/120:12:071
148049599112,8cyclictest1002-21mta-sts-daemon19:16:521
148049599112,5cyclictest1502360-21/usr/sbin/munin20:21:521
148049599111,9cyclictest1497711-21/usr/sbin/munin20:06:581
148049599111,8cyclictest1510874-21/usr/sbin/munin20:46:581
148049599110,10cyclictest1518947-21grep21:11:571
148049499117,2cyclictest0-21swapper/020:46:560
148049499114,4cyclictest0-21swapper/020:31:570
148049799105,4cyclictest0-21swapper/323:17:013
148049799104,3cyclictest0-21swapper/323:06:503
148049799103,5cyclictest0-21swapper/320:02:003
148049799103,4cyclictest0-21swapper/320:07:113
148049799103,4cyclictest0-21swapper/319:52:053
148049799103,4cyclictest0-21swapper/319:47:063
148049799102,6cyclictest0-21swapper/320:57:053
148049799102,5cyclictest0-21swapper/321:01:523
148049799102,5cyclictest0-21swapper/300:26:593
148049799102,4cyclictest0-21swapper/319:52:083
148049799101,5cyclictest0-21swapper/323:35:443
148049799101,5cyclictest0-21swapper/321:47:023
148049799100,6cyclictest0-21swapper/321:17:073
148049599105,3cyclictest1503832-21/usr/sbin/munin20:26:511
14804979995,2cyclictest0-21swapper/321:12:063
14804979994,4cyclictest0-21swapper/321:27:033
14804979994,3cyclictest0-21swapper/320:36:533
14804979993,4cyclictest0-21swapper/319:22:063
14804979993,4cyclictest0-21swapper/300:32:073
14804979993,2cyclictest0-21swapper/320:26:513
14804979992,4cyclictest0-21swapper/319:41:533
14804979992,3cyclictest0-21swapper/320:12:063
14804979991,5cyclictest0-21swapper/322:21:113
14804979991,5cyclictest0-21swapper/320:17:103
14804979990,5cyclictest0-21swapper/320:42:053
14804979983,3cyclictest0-21swapper/319:26:543
14804979982,4cyclictest0-21swapper/321:52:063
14804979982,4cyclictest0-21swapper/320:27:093
14804979982,4cyclictest0-21swapper/319:17:003
14804979982,3cyclictest0-21swapper/320:42:073
14804979981,5cyclictest0-21swapper/320:47:093
14804979971,3cyclictest0-21swapper/319:36:503
14804979941,1cyclictest0-21swapper/319:12:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional