You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-02 - 03:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7.osadl.org (updated Wed Jul 02, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1401062996011,31cyclictest0-21swapper/023:51:060
140106299502,30cyclictest1451674-21sendmail-msp21:23:560
140106299483,7cyclictest1616808-21ssh00:23:580
140106299442,42cyclictest0-21swapper/019:41:530
140106299422,6cyclictest1539996-21latency_hist22:58:540
1401062994128,2cyclictest1445411-21mailstats21:16:560
140106299393,32cyclictest1401018-21munin-run19:13:530
140106299385,25cyclictest0-21swapper/022:16:530
140106299384,23cyclictest1556499-21ntpq23:16:500
140106299350,26cyclictest1489097-21sendmail-msp22:04:200
140106399348,19cyclictest619-21mta-sts-daemon23:18:271
140106299333,3cyclictest1432661-21fschecks_time20:46:470
140106299332,4cyclictest1610918-21ntpq00:16:500
1401062993322,3cyclictest0-21swapper/022:40:320
1401062993320,2cyclictest0-21swapper/023:01:520
140106299331,18cyclictest0-21swapper/022:34:000
1401062993226,3cyclictest0-21swapper/023:57:000
1401062993222,5cyclictest0-21swapper/022:21:540
140106299322,20cyclictest1533113-21ssh22:51:480
140106299321,23cyclictest0-21swapper/000:12:000
140106299314,23cyclictest1560650-21grep23:21:480
140106299311,2cyclictest0-21swapper/021:41:500
1401062993110,13cyclictest0-21swapper/023:09:040
140106299310,25cyclictest0-21swapper/023:03:540
140106299300,6cyclictest1514421-21/usr/sbin/munin22:31:550
140106399297,13cyclictest1630058-21/usr/sbin/munin00:41:531
140106299292,4cyclictest0-21swapper/020:01:520
140106299292,3cyclictest1627004-21/usr/sbin/munin00:36:580
140106299292,24cyclictest1629244-21aten_r2power_cu00:41:450
140106499285,14cyclictest111788-21systemd-journal00:04:012
140106399286,8cyclictest1607314-21ssh00:12:051
140106299282,25cyclictest1565975-21ld23:26:560
140106299282,22cyclictest1583485-21rm23:46:470
140106299281,25cyclictest1482733-21needreboot21:56:500
140106299280,2cyclictest1614652-21ssh00:21:490
140106499271,14cyclictest1463542-21/usr/sbin/munin21:36:442
1401062992726,1cyclictest0-21swapper/022:11:530
140106299272,4cyclictest1441010-21grep21:11:480
140106299272,23cyclictest1415190-21unixbench_singl19:51:570
140106299272,1cyclictest0-21swapper/023:36:540
1401062992716,9cyclictest1420782-21grep20:11:480
1401062992713,13cyclictest1472907-21fschecks_count21:46:460
140106299270,5cyclictest1415846-21grep19:56:480
140106299270,25cyclictest1406946-21fschecks_time19:31:480
140106499262,7cyclictest1524885-21ssh22:42:022
140106399265,6cyclictest1503455-21ssh22:18:551
140106299264,5cyclictest11050irq/107-eth%d22:26:510
140106299263,5cyclictest1597346-21cut00:01:480
140106299262,4cyclictest1435535-21latency_hist20:53:530
140106299261,4cyclictest1487271-21ntpq22:01:520
140106299260,9cyclictest1601707-21aten_r2power_fr00:06:460
140106299260,25cyclictest1460054-21grep21:31:570
1401064992520,3cyclictest1588383-21gltestperf23:51:462
1401064992513,7cyclictest11050irq/107-eth%d00:23:582
140106299258,10cyclictest1478191-21ld21:51:510
140106299255,19cyclictest1412226-21fschecks_time19:46:500
140106299254,15cyclictest0-21swapper/019:28:540
140106299253,21cyclictest1528663-21grep22:46:500
140106299252,4cyclictest1402677-21cron19:18:530
140106299252,22cyclictest1621933-21cut00:31:470
1401062992512,3cyclictest0-21swapper/023:30:510
140106299250,8cyclictest1463689-21grep21:36:460
140106299250,5cyclictest1430940-21grep20:41:470
140106499244,11cyclictest1406567-21apt-get19:28:562
140106499242,7cyclictest1575123-21ld23:36:542
1401064992420,3cyclictest1005-21mta-sts-daemon21:41:502
1401064992418,5cyclictest1625969-21fschecks_time00:36:482
140106299242,4cyclictest1427841-21cut20:31:480
140106299242,21cyclictest1408922-21grep19:36:470
140106299242,21cyclictest0-21swapper/021:21:580
140106299242,19cyclictest1440441-21latency_hist21:08:540
140106299241,4cyclictest1419025-21sort20:06:460
140106299241,21cyclictest1425743-21cut20:26:480
140106499235,9cyclictest1005-21mta-sts-daemon23:16:502
140106499232,18cyclictest1570523-21ntpq23:31:542
140106299233,2cyclictest1437565-21cut21:01:470
140106299232,20cyclictest1435902-21cut20:56:460
140106299232,20cyclictest1429472-21gltestperf20:36:500
140106299232,20cyclictest1403214-21sort19:21:470
140106299230,14cyclictest0-21swapper/023:41:410
140106499228,10cyclictest0-21swapper/200:01:522
140106499223,13cyclictest111788-21systemd-journal21:23:562
140106399225,11cyclictest111788-21systemd-journal00:23:581
1401063992215,5cyclictest1419103-21fschecks_count20:06:471
140106599214,5cyclictest0-21swapper/322:01:523
140106499214,10cyclictest1610923-21ntpq00:16:502
140106499211,3cyclictest0-21swapper/222:36:522
140106399212,16cyclictest1583484-21sh23:46:471
1401063992115,3cyclictest1593804-21timerandwakeup23:57:011
140106299213,2cyclictest0-21swapper/020:21:450
140106299212,2cyclictest0-21swapper/020:16:440
112699210,1rtkit-daemon0-21swapper/222:50:182
140106599202,8cyclictest0-21swapper/323:01:533
140106499203,11cyclictest11050irq/107-eth%d23:21:522
140106499202,3cyclictest11050irq/107-eth%d21:14:192
140106399207,9cyclictest1487279-21ssh22:01:521
140106399202,15cyclictest1495931-21fschecks_count22:11:481
140106499194,13cyclictest1437094-21grep20:58:542
1401064991917,1cyclictest0-21swapper/221:56:572
1401064991915,2cyclictest1438617-21unixbench_singl21:01:582
140106399195,11cyclictest1451674-21sendmail-msp21:23:541
1401063991912,4cyclictest0-21swapper/123:21:541
140106599186,3cyclictest0-21swapper/320:11:533
140106599183,4cyclictest0-21swapper/321:31:493
140106499183,11cyclictest1416708-21/usr/sbin/munin19:56:572
140106499182,11cyclictest1440864-21tune2fs21:11:482
1401064991814,3cyclictest1491388-21fschecks_time22:06:462
1401064991811,5cyclictest1541848-21ssh23:01:462
140106499180,13cyclictest1528845-21ssh22:46:502
140106399186,7cyclictest2433764-1kworker/1:1H-kblockd21:58:531
140106399182,13cyclictest1599707-21sendmail-msp00:04:011
140106399182,12cyclictest1466043-21grep21:38:531
1401063991816,1cyclictest0-21swapper/123:31:481
1401063991815,2cyclictest1005-21mta-sts-daemon22:51:481
1401063991812,2cyclictest0-21swapper/122:31:521
140106599175,3cyclictest0-21swapper/322:31:553
140106499176,7cyclictest1547595-21/usr/sbin/munin23:07:012
140106499175,10cyclictest1514714-21/usr/sbin/munin22:31:482
140106499173,11cyclictest1538408-21find22:56:552
140106499173,10cyclictest1458932-21ssh21:31:472
140106499172,11cyclictest1631391-21wc00:43:532
140106499172,11cyclictest1584374-21ssh23:46:552
140106499172,11cyclictest1403491-21/usr/sbin/munin19:21:482
1401064991714,1cyclictest0-21swapper/222:11:542
140106499171,13cyclictest1621643-21/usr/sbin/munin00:31:452
140106499171,10cyclictest1510903-21sh22:26:572
140106399174,8cyclictest1597888-21ntpq00:01:521
140106399174,10cyclictest1538114-21/usr/sbin/munin22:56:511
140106399173,13cyclictest1491385-21fschecks_time22:06:461
140106399172,4cyclictest0-21swapper/121:23:561
140106399172,13cyclictest1410501-21grep19:41:491
1401063991712,3cyclictest1547880-21grep23:07:021
112699170,3rtkit-daemon1125-21rtkit-daemon23:12:132
140106599166,3cyclictest0-21swapper/321:23:563
140106599162,7cyclictest0-21swapper/320:49:183
140106499167,8cyclictest0-21swapper/219:36:492
140106499167,7cyclictest1405653-21/usr/sbin/munin19:26:572
140106499163,12cyclictest1402690-21munin-run19:18:532
140106499163,10cyclictest111788-21systemd-journal21:44:262
1401064991613,2cyclictest0-21swapper/200:21:492
1401064991611,2cyclictest0-21swapper/223:26:542
140106499160,11cyclictest1477942-21/usr/sbin/munin21:51:492
140106399169,4cyclictest0-21swapper/122:27:001
140106399167,6cyclictest1468886-21ssh21:41:511
140106399164,9cyclictest1404734-21aten_r2power_vo19:26:461
140106399163,9cyclictest1574627-21fschecks_time23:36:511
140106399163,7cyclictest11050irq/107-eth%d23:51:561
140106399162,11cyclictest1524051-21fschecks_count22:41:521
1401063991614,1cyclictest0-21swapper/100:31:481
1401063991612,3cyclictest1438668-21munin-plugin-st21:03:531
140106399161,12cyclictest1435383-21apt20:53:531
1401063991610,4cyclictest0-21swapper/120:36:561
140106499156,7cyclictest351ktimers/220:29:102
140106499153,5cyclictest1593579-21/usr/sbin/munin23:56:572
1401064991512,2cyclictest0-21swapper/220:01:592
1401064991511,3cyclictest1410569-21fschecks_time19:41:502
1401064991511,2cyclictest0-21swapper/200:12:052
140106399154,9cyclictest1414800-21/usr/sbin/munin19:51:521
140106399154,8cyclictest0-21swapper/123:26:511
140106399153,9cyclictest1420733-21fschecks_count20:11:481
140106399153,8cyclictest0-21swapper/121:46:461
140106399153,10cyclictest1427369-21/usr/sbin/munin20:31:451
140106399152,9cyclictest1519649-21/usr/sbin/munin22:36:501
140106399152,9cyclictest11050irq/107-eth%d19:34:201
140106399152,11cyclictest1541844-21/usr/sbin/munin23:01:481
140106399151,12cyclictest1442095-21cat21:13:531
1401063991511,2cyclictest0-21swapper/100:16:561
140106599144,5cyclictest0-21swapper/323:16:503
140106599142,5cyclictest0-21swapper/300:23:583
140106599141,8cyclictest0-21swapper/322:46:473
140106499146,6cyclictest1429274-21/usr/sbin/munin20:36:492
140106499144,9cyclictest0-21swapper/223:41:502
140106499143,7cyclictest1449548-21if_wlan021:21:492
140106499143,4cyclictest1506104-21/usr/sbin/munin22:21:542
140106499142,9cyclictest1434290-21cut20:51:452
140106499142,9cyclictest1420147-21sed20:06:582
140106499142,8cyclictest1486803-21tune2fs22:01:482
140106499141,9cyclictest1500255-21cut22:16:512
140106499141,10cyclictest1426432-21/usr/sbin/munin20:26:572
140106499141,10cyclictest1414488-21grep19:51:482
140106399147,4cyclictest1431944-21grep20:41:571
140106399142,7cyclictest1477575-21ssh21:51:471
1401063991411,2cyclictest1404283-21unixbench_singl19:21:571
1401063991411,2cyclictest0-21swapper/119:31:481
140106399141,11cyclictest1402584-21sed19:16:571
140106599136,4cyclictest0-21swapper/322:11:463
140106599133,6cyclictest0-21swapper/321:44:263
140106599133,5cyclictest0-21swapper/322:27:003
140106599133,5cyclictest0-21swapper/319:51:553
140106599133,5cyclictest0-21swapper/300:16:503
140106599132,6cyclictest0-21swapper/321:51:503
140106599132,5cyclictest0-21swapper/321:41:503
140106599132,5cyclictest0-21swapper/319:16:473
140106499132,9cyclictest1439287-21fschecks_time21:06:472
140106499132,9cyclictest1413493-21awk19:48:532
140106399139,3cyclictest1459529-21ntp_kernel_pll_21:31:521
140106399139,3cyclictest0-21swapper/120:01:471
140106399137,5cyclictest1614325-21fschecks_time00:21:471
140106399135,5cyclictest1422922-21/usr/sbin/munin20:16:501
140106399135,4cyclictest1439863-21/usr/sbin/munin21:06:531
140106399133,9cyclictest1435665-21/usr/sbin/munin20:56:441
140106399133,7cyclictest1551364-21fschecks_time23:11:471
140106399133,6cyclictest1432574-21/usr/sbin/munin20:46:471
140106399132,8cyclictest1411983-21/usr/sbin/munin19:46:471
140106399132,7cyclictest1445076-21/usr/sbin/munin21:16:511
140106399132,6cyclictest1625694-21ssh00:36:461
140106399131,9cyclictest1427201-21base6420:28:541
140106399131,7cyclictest1424262-21if_wlan020:21:471
140106599124,4cyclictest0-21swapper/319:21:503
140106599123,5cyclictest0-21swapper/322:06:483
140106599123,3cyclictest0-21swapper/323:06:503
140106599122,7cyclictest0-21swapper/300:11:483
140106599122,6cyclictest0-21swapper/319:28:563
140106599121,7cyclictest0-21swapper/300:01:523
140106599121,6cyclictest0-21swapper/321:36:553
140106599121,5cyclictest0-21swapper/323:54:513
140106499123,7cyclictest1432378-21/usr/sbin/munin20:46:452
140106499121,9cyclictest1420799-21grep20:11:482
140106399126,3cyclictest1500402-21/usr/sbin/munin22:16:521
140106399124,4cyclictest1580053-21ssh23:42:001
140106399123,6cyclictest1528845-21ssh22:46:501
140106599115,3cyclictest0-21swapper/323:32:003
140106599114,4cyclictest0-21swapper/319:24:463
140106599113,5cyclictest0-21swapper/323:41:483
140106599113,5cyclictest0-21swapper/321:01:493
140106599113,4cyclictest0-21swapper/323:36:483
140106599113,4cyclictest0-21swapper/321:11:523
140106599113,4cyclictest0-21swapper/300:31:543
140106599113,3cyclictest0-21swapper/300:41:453
140106599112,6cyclictest0-21swapper/322:56:533
140106599112,6cyclictest0-21swapper/322:21:543
140106599112,6cyclictest0-21swapper/319:46:523
140106599112,5cyclictest0-21swapper/323:21:513
140106599112,4cyclictest0-21swapper/321:13:553
140106599111,6cyclictest0-21swapper/323:51:513
140106599111,6cyclictest0-21swapper/322:36:523
140106599111,6cyclictest0-21swapper/300:04:013
140106599111,5cyclictest0-21swapper/323:26:483
140106499117,2cyclictest0-21swapper/220:41:522
140106499112,7cyclictest1424065-21fschecks_time20:21:462
140106499111,7cyclictest1422433-21fschecks_time20:16:462
140106399118,2cyclictest1401167-21latency_hist19:13:531
140106399112,8cyclictest1415845-21tune2fs19:56:481
140106599106,2cyclictest0-21swapper/322:41:563
140106599104,4cyclictest0-21swapper/300:21:463
140106599103,5cyclictest0-21swapper/321:04:393
140106599103,4cyclictest0-21swapper/323:46:473
140106599103,4cyclictest0-21swapper/300:36:503
140106599102,6cyclictest0-21swapper/320:06:483
140106599102,5cyclictest0-21swapper/323:10:473
140106599102,5cyclictest0-21swapper/320:26:493
140106599102,4cyclictest0-21swapper/322:16:513
140106599101,6cyclictest0-21swapper/321:56:493
140106599101,5cyclictest0-21swapper/320:31:523
140106599101,4cyclictest0-21swapper/320:56:443
140106599100,7cyclictest0-21swapper/321:21:483
14010659993,4cyclictest0-21swapper/319:56:553
14010659992,6cyclictest0-21swapper/320:44:453
14010659992,5cyclictest0-21swapper/320:16:473
14010659992,4cyclictest0-21swapper/320:01:473
14010659992,3cyclictest0-21swapper/319:33:573
14010659991,5cyclictest0-21swapper/322:51:463
14010659991,4cyclictest0-21swapper/320:21:453
14010659991,3cyclictest0-21swapper/319:39:103
14010659990,5cyclictest0-21swapper/320:36:593
14010649994,4cyclictest0-21swapper/219:13:532
14010659982,4cyclictest0-21swapper/320:41:443
14010659963,2cyclictest0-21swapper/319:13:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional