You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-28 - 18:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7.osadl.org (updated Tue Oct 28, 2025 12:43:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
136287499487,24cyclictest1565630-21ntpq12:37:520
136287499352,3cyclictest1427988-21/usr/sbin/munin09:47:580
136287499325,18cyclictest0-21swapper/011:02:490
136287499300,29cyclictest1402427-1kworker/0:0H+kblockd10:48:160
136287699296,7cyclictest11050irq/107-eth%d10:29:352
136287499282,5cyclictest0-21swapper/010:17:520
136287499280,1cyclictest1532154-21sed11:57:580
136287599276,15cyclictest619-21mta-sts-daemon12:42:541
1362874992721,2cyclictest1007-21mta-sts-daemon10:31:440
136287499270,21cyclictest1529370-21sh11:55:370
136287699264,16cyclictest111788-21systemd-journal07:30:392
136287599267,4cyclictest11050irq/107-eth%d11:52:511
136287499262,17cyclictest1483931-21/usr/sbin/munin10:58:020
136287499261,13cyclictest1546017-21/usr/sbin/munin12:17:490
136287599254,14cyclictest1362840-21munin-run07:15:361
1362875992510,10cyclictest111788-21systemd-journal10:10:371
1362874992524,1cyclictest0-21swapper/012:08:020
1362874992522,2cyclictest1502461-21ssh11:20:400
1362874992519,4cyclictest0-21swapper/010:52:510
1362874992517,5cyclictest1005-21mta-sts-daemon12:41:060
1362874992514,9cyclictest1521717-21sendmail-msp11:48:070
136287499251,2cyclictest1364348-21timerwakeupswit07:17:580
136287599248,12cyclictest1005-21mta-sts-daemon10:31:441
1362874992420,1cyclictest0-21swapper/010:10:390
136287599235,9cyclictest111788-21systemd-journal10:07:581
1362874992322,1cyclictest69-21kswapd011:17:580
1362874992320,0cyclictest0-21swapper/010:04:260
1362874992319,3cyclictest0-21swapper/008:37:490
136287699224,15cyclictest111788-21systemd-journal11:45:582
1362876992212,8cyclictest0-21swapper/212:17:452
136287499222,16cyclictest1433755-21ssh09:54:000
1362874992219,2cyclictest1444390-21fschecks_time10:07:550
1362874992218,3cyclictest259-21jbd2/mmcblk0p2-811:05:450
1362874992214,3cyclictest1535959-21/usr/sbin/munin12:02:570
136287499221,15cyclictest1419712-21ssh09:36:500
112699220,1rtkit-daemon0-21swapper/109:45:171
136287699215,14cyclictest1447608-21ssh10:11:102
136287699214,13cyclictest1431103-21ssh09:51:202
136287699212,14cyclictest1570704-21sh12:42:532
1362876992116,3cyclictest1527090-21gltestperf11:52:522
136287699211,15cyclictest111788-21systemd-journal10:47:562
1362875992113,3cyclictest1385263-21unixbench_multi08:17:581
136287499217,4cyclictest0-21swapper/011:37:530
1362874992114,2cyclictest1520425-21sed11:42:590
136287499211,16cyclictest1387050-21sendmail-msp08:32:540
136287499210,21cyclictest0-21swapper/012:22:490
136287599202,16cyclictest1368386-21apt-get07:30:381
136287599202,10cyclictest11050irq/107-eth%d10:52:511
1362875992013,5cyclictest0-21swapper/110:17:511
1362875992012,5cyclictest0-21swapper/112:32:461
136287499207,5cyclictest1456149-21tail10:22:480
136287699195,11cyclictest1555469-21/usr/sbin/munin12:27:502
136287699195,10cyclictest1489200-21ssh11:03:022
136287599192,2cyclictest0-21swapper/111:41:081
136287599191,7cyclictest1399085-21grep09:02:471
1362875991912,5cyclictest0-21swapper/112:05:361
1362874991916,2cyclictest1409624-21ssh09:22:520
136287499190,12cyclictest1555361-21grep12:27:500
136287699183,9cyclictest1389272-21grep08:32:502
136287699182,14cyclictest69-21kswapd007:15:362
1362876991814,3cyclictest1377692-21cut07:57:492
1362876991813,4cyclictest0-21swapper/210:58:032
136287699181,14cyclictest1565226-21head12:37:492
136287599182,11cyclictest1426842-21sendmail-msp09:52:551
1362875991812,3cyclictest1566231-21unixbench_singl12:37:591
136287599181,13cyclictest1472800-21ssh10:42:511
136287499188,3cyclictest1468803-21/usr/sbin/munin10:37:530
136287499184,2cyclictest1425530-21sed09:42:580
136287499181,9cyclictest0-21swapper/011:27:550
1362874991814,3cyclictest1460337-21fschecks_time10:27:520
136287499181,3cyclictest1417719-21grep09:32:590
1362874991811,1cyclictest0-21swapper/009:20:010
136287699174,8cyclictest1444850-21awk10:07:582
136287699173,12cyclictest1426842-21sendmail-msp09:45:582
136287699172,10cyclictest1560574-21ssh12:32:522
136287699171,14cyclictest1502452-21apt-get11:20:392
136287599176,3cyclictest11050irq/107-eth%d11:48:031
136287599174,9cyclictest1395907-21grep08:52:491
136287599174,9cyclictest1395907-21grep08:52:491
136287599172,10cyclictest1460249-21grep10:27:511
1362875991712,4cyclictest1492358-21missed_timers11:07:511
1362875991711,5cyclictest1514075-21grep11:35:361
136287599171,11cyclictest1515558-21fschecks_count11:37:481
136287599171,11cyclictest1487799-21aten_r2power_cu11:02:461
136287499179,6cyclictest1367839-21unin-run07:30:360
136287499177,7cyclictest2688518-1kworker/0:2H+kblockd08:07:040
136287499176,6cyclictest1008-21mta-sts-daemon11:13:020
1362874991715,1cyclictest1472146-21aten_r2power_vo10:42:470
1362874991714,2cyclictest1436380-21gltestperf09:57:520
1362874991713,3cyclictest1400559-21latency_hist09:05:370
1362874991713,3cyclictest1384331-21fschecks_time08:17:480
1362874991713,2cyclictest1369802-21apt-get07:35:370
1362874991713,2cyclictest1006-21mta-sts-daemon08:47:550
136287499171,15cyclictest1395666-21head08:52:460
136287499171,15cyclictest1395666-21head08:52:460
136287499171,15cyclictest0-21swapper/012:33:410
112699170,1rtkit-daemon0-21swapper/007:57:410
136287799160,8cyclictest0-21swapper/311:12:493
136287699168,5cyclictest259-21jbd2/mmcblk0p2-811:27:552
136287699163,11cyclictest1539441-21ssh12:08:022
136287699163,10cyclictest0-21swapper/211:07:552
136287699162,9cyclictest1392298-21aten_r2power_fr08:42:472
136287699162,10cyclictest1542181-21/usr/sbin/munin12:13:032
136287699162,10cyclictest1468897-21ssh10:37:542
136287699161,5cyclictest1499461-21cpuspeed11:17:542
1362876991613,2cyclictest1472362-21cut10:42:482
1362876991613,2cyclictest1464508-21fschecks_count10:32:512
136287699161,11cyclictest1373461-21sendmail-msp07:47:462
136287599169,6cyclictest1380426-21munin-plugin-st08:05:361
136287599164,3cyclictest11050irq/107-eth%d10:22:501
136287599162,9cyclictest607-21dbus-daemon12:20:361
1362875991613,2cyclictest1387050-21sendmail-msp08:27:581
1362875991613,2cyclictest1387050-21sendmail-msp08:27:581
1362875991613,1cyclictest0-21swapper/109:18:021
136287499168,2cyclictest1413259-21ssh09:27:570
136287499163,4cyclictest1387013-21latency_hist08:25:360
136287499161,11cyclictest1397500-21fschecks_time08:58:180
136287499160,13cyclictest1369802-21apt-get07:35:390
136287799150,9cyclictest0-21swapper/309:55:363
136287699158,4cyclictest0-21swapper/212:22:472
136287699157,4cyclictest1005-21mta-sts-daemon09:07:592
136287699157,3cyclictest1006-21mta-sts-daemon11:33:172
136287699155,6cyclictest1006-21mta-sts-daemon08:00:452
136287699151,7cyclictest1421295-21ssh09:37:562
136287699151,13cyclictest1495866-21cut11:12:512
136287699151,11cyclictest1457174-21cat10:22:592
136287699150,6cyclictest1008-21mta-sts-daemon10:02:592
136287599155,8cyclictest1005-21mta-sts-daemon07:36:011
136287599155,6cyclictest1385681-21aten_r2power_en08:22:451
136287599154,7cyclictest1428099-21aten_r2power_fr09:47:471
136287599152,9cyclictest111788-21systemd-journal11:12:121
136287599151,8cyclictest1441123-21ssh10:03:031
1362875991512,2cyclictest0-21swapper/109:07:541
1362875991511,3cyclictest0-21swapper/108:12:591
136287599151,11cyclictest1531227-21tune2fs11:57:481
136287499159,4cyclictest0-21swapper/009:05:390
136287499158,6cyclictest0-21swapper/008:12:500
136287499158,4cyclictest0-21swapper/007:22:520
136287499158,4cyclictest0-21swapper/007:22:520
136287499157,6cyclictest259-21jbd2/mmcblk0p2-812:12:580
136287499153,3cyclictest111788-21systemd-journal11:31:010
136287499152,10cyclictest1387050-21sendmail-msp08:27:570
136287499152,10cyclictest1387050-21sendmail-msp08:27:570
136287499150,14cyclictest0-21swapper/007:45:390
136287799143,7cyclictest0-21swapper/312:28:013
136287799143,6cyclictest0-21swapper/312:07:563
136287799143,6cyclictest0-21swapper/309:42:583
136287799143,6cyclictest0-21swapper/309:28:003
136287799143,5cyclictest0-21swapper/308:32:553
136287799142,9cyclictest0-21swapper/311:55:393
136287799142,9cyclictest0-21swapper/311:52:563
136287799141,8cyclictest0-21swapper/311:37:523
136287799141,10cyclictest0-21swapper/308:12:453
136287699148,3cyclictest1382786-21gltestperf08:12:492
136287699147,6cyclictest1008-21mta-sts-daemon11:55:402
136287699147,4cyclictest1519387-21/usr/sbin/munin11:42:492
136287699145,6cyclictest1394842-21/usr/sbin/munin08:47:562
136287699145,6cyclictest1381701-21/usr/sbin/munin08:07:572
136287699144,7cyclictest1008-21mta-sts-daemon07:36:012
136287699144,6cyclictest0-21swapper/207:22:492
136287699144,6cyclictest0-21swapper/207:22:492
136287699143,8cyclictest1385518-21latency_hist08:20:362
136287699143,6cyclictest1388678-21munin-plugin-st08:30:362
136287699143,6cyclictest1388678-21munin-plugin-st08:30:362
136287699143,6cyclictest1367539-21/usr/sbin/munin07:28:042
136287699142,9cyclictest1413363-21ssh09:27:582
136287699141,9cyclictest1452383-21sh10:17:462
136287699141,9cyclictest1397913-21/usr/sbin/munin08:58:222
136287599149,3cyclictest1408843-21aten_r2power_cu09:22:471
136287599144,6cyclictest1507899-21/usr/sbin/munin11:27:471
136287599143,9cyclictest1468935-21grep10:37:551
136287599142,9cyclictest1476964-21/usr/sbin/munin10:48:001
136287599142,8cyclictest1553611-21sendmail-msp12:26:091
136287599142,8cyclictest1422919-21cron09:40:361
136287599142,8cyclictest1390888-21fschecks_time08:37:491
136287599142,7cyclictest111788-21systemd-journal09:30:551
136287599142,10cyclictest1413407-21ssh09:27:581
1362875991411,2cyclictest1398530-21cron09:00:361
136287599141,10cyclictest1402554-21aten_r2power_po09:12:471
136287599141,10cyclictest1402554-21aten_r2power_po09:12:471
136287599140,3cyclictest1393632-21sendmail-msp08:45:371
136287499140,9cyclictest1379012-21/usr/sbin/munin08:02:500
136287799133,6cyclictest0-21swapper/310:07:583
136287799133,5cyclictest0-21swapper/310:27:473
136287799132,6cyclictest0-21swapper/307:58:363
136287799132,1cyclictest0-21swapper/307:17:533
136287799131,9cyclictest0-21swapper/307:52:543
136287799131,9cyclictest0-21swapper/307:15:363
136287799130,1cyclictest0-21swapper/312:17:463
136287699133,8cyclictest1402797-21fschecks_time09:12:492
136287699133,8cyclictest1402797-21fschecks_time09:12:492
136287699132,8cyclictest1410276-21/usr/sbin/munin09:23:002
136287699132,8cyclictest1395609-21/usr/sbin/munin08:52:462
136287699132,8cyclictest1395609-21/usr/sbin/munin08:52:462
136287699132,5cyclictest1480823-21/usr/sbin/munin10:52:522
136287699131,9cyclictest1424494-21fschecks_time09:42:482
136287699131,8cyclictest1535395-21/usr/sbin/munin12:02:492
1362876991311,1cyclictest0-21swapper/209:17:592
136287699130,9cyclictest1417036-21/usr/sbin/munin09:32:512
136287699130,10cyclictest1436767-21grep09:57:552
136287599139,3cyclictest1436828-21ntp_offset09:57:561
136287599136,5cyclictest1377609-21fschecks_count07:57:491
136287599133,7cyclictest1374199-21/usr/sbin/munin07:47:461
136287599132,9cyclictest1366159-21idleruntime-cro07:25:361
136287599132,9cyclictest1366159-21idleruntime-cro07:25:361
136287599132,8cyclictest1389423-21iwlist08:32:511
136287599131,9cyclictest1381049-21fschecks_time08:07:491
136287599131,9cyclictest1376072-21cut07:52:481
136287599131,7cyclictest11050irq/107-eth%d11:17:541
136287599131,6cyclictest1373896-21apt-config07:45:371
136287599130,8cyclictest1503898-21tune2fs11:22:481
136287499131,9cyclictest1393142-21grep08:42:540
1362874991310,1cyclictest0-21swapper/007:52:500
136287499130,9cyclictest0-21swapper/007:42:540
136287799124,5cyclictest0-21swapper/311:07:463
136287799122,6cyclictest0-21swapper/310:53:233
136287799122,5cyclictest0-21swapper/312:12:553
136287799122,5cyclictest0-21swapper/309:07:493
136287799121,8cyclictest0-21swapper/311:27:493
136287799121,7cyclictest0-21swapper/312:32:473
136287799121,7cyclictest0-21swapper/310:05:363
136287799121,1cyclictest0-21swapper/310:48:013
136287799121,1cyclictest0-21swapper/308:27:483
136287799121,1cyclictest0-21swapper/308:27:483
136287799120,8cyclictest0-21swapper/311:47:483
136287799120,2cyclictest0-21swapper/311:05:373
136287799120,2cyclictest0-21swapper/310:42:463
136287799120,10cyclictest0-21swapper/312:37:523
136287699124,6cyclictest1515363-21ssh11:37:472
136287699124,5cyclictest1390861-21grep08:37:492
136287699123,6cyclictest1399508-21/usr/sbin/munin09:02:502
136287699123,6cyclictest1364077-21/usr/sbin/munin07:17:552
136287699123,5cyclictest1372290-21/usr/sbin/munin07:42:482
136287699121,7cyclictest1385912-21fschecks_count08:22:472
136287599129,2cyclictest1536980-21sendmail-msp12:11:411
136287599122,8cyclictest1394111-21/usr/sbin/munin08:47:461
136287599122,7cyclictest1550736-21/usr/sbin/munin12:22:481
136287599121,7cyclictest111788-21systemd-journal12:06:041
136287599121,1cyclictest0-21swapper/110:57:511
136287499120,9cyclictest1402826-21fschecks_time09:12:500
136287499120,9cyclictest1402826-21fschecks_time09:12:500
136287799115,5cyclictest0-21swapper/309:02:493
136287799115,2cyclictest0-21swapper/308:17:523
136287799113,6cyclictest0-21swapper/309:12:473
136287799113,6cyclictest0-21swapper/309:12:473
136287799113,5cyclictest0-21swapper/307:27:593
136287799113,4cyclictest0-21swapper/308:42:473
136287799112,7cyclictest0-21swapper/308:58:183
136287799112,6cyclictest0-21swapper/309:47:463
136287799112,6cyclictest0-21swapper/309:22:493
136287799112,6cyclictest0-21swapper/308:37:493
136287799112,6cyclictest0-21swapper/308:02:493
136287799112,3cyclictest0-21swapper/310:10:393
136287799111,8cyclictest0-21swapper/309:37:483
136287799111,7cyclictest0-21swapper/310:37:473
136287799111,7cyclictest0-21swapper/310:31:443
136287799111,7cyclictest0-21swapper/308:47:473
136287799111,6cyclictest0-21swapper/312:41:063
136287799111,6cyclictest0-21swapper/312:21:043
136287799111,6cyclictest0-21swapper/311:22:523
136287799111,5cyclictest0-21swapper/308:52:473
136287799111,5cyclictest0-21swapper/308:52:473
136287799111,2cyclictest0-21swapper/307:32:543
136287799111,1cyclictest0-21swapper/310:57:513
136287799111,1cyclictest0-21swapper/310:22:483
136287799111,1cyclictest0-21swapper/307:47:463
136287799110,8cyclictest0-21swapper/308:07:493
136287799110,3cyclictest0-21swapper/311:32:503
136287799110,1cyclictest0-21swapper/308:25:373
136287699118,2cyclictest259-21jbd2/mmcblk0p2-807:52:452
136287599118,2cyclictest1366577-21telnet07:27:481
136287599111,7cyclictest1363988-21ntp_states07:17:531
136287799103,5cyclictest0-21swapper/307:42:543
136287799103,4cyclictest0-21swapper/312:02:463
136287799103,4cyclictest0-21swapper/311:42:533
136287799103,4cyclictest0-21swapper/311:17:553
136287799101,7cyclictest0-21swapper/309:17:473
136287799101,6cyclictest0-21swapper/310:17:453
136287799101,2cyclictest0-21swapper/309:58:033
136287799101,2cyclictest0-21swapper/309:32:443
136287799101,2cyclictest0-21swapper/307:37:533
112699100,4rtkit-daemon1007-21mta-sts-daemon07:12:330
13628779991,6cyclictest0-21swapper/307:22:473
13628779991,6cyclictest0-21swapper/307:22:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional