You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 05:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sun Aug 16, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1254211996252,7cyclictest1524360-21latency_hist23:40:010
1254211995445,6cyclictest1549189-21latency_hist00:05:010
1254211995245,5cyclictest1569076-21latency_hist00:25:010
1254219995143,6cyclictest1276098-21apt-get19:30:002
1254215995044,4cyclictest1239316-21kworker/u8:1+flush-8:019:27:581
1254211994944,3cyclictest1350808-21kworker/u8:0+events_unbound21:18:000
1254211994944,3cyclictest1350808-21kworker/u8:0+events_unbound21:18:000
1254211994943,4cyclictest1326044-21kworker/u8:3+events_unbound20:35:010
1254215994842,5cyclictest1554486-21kworker/u8:1+events_unbound00:37:541
1254211994842,4cyclictest1306346-21kworker/u8:2+flush-8:020:12:470
1254215994638,6cyclictest1415513-21/usr/sbin/munin21:52:571
1254211994638,6cyclictest1534717-21/usr/sbin/munin23:52:570
1254211994638,6cyclictest1266404-21/usr/sbin/munin19:22:590
1254211994637,6cyclictest1315892-21latency_hist20:10:000
14047462450,10sleep01404749-21awk21:37:580
1254219994534,8cyclictest1306125-21cat20:00:002
1254215994540,4cyclictest1525202-21kworker/u8:2+flush-8:023:50:001
1254215994438,4cyclictest1350808-21kworker/u8:0+flush-8:021:12:541
1254215994437,5cyclictest1350808-21kworker/u8:0+flush-8:022:43:001
1254215994437,5cyclictest1350808-21kworker/u8:0+flush-8:022:42:591
1254215994434,7cyclictest1320832-21latency_hist20:15:011
1254219994336,5cyclictest1424906-21journal-offline21:59:192
1254215994338,4cyclictest1350808-21kworker/u8:0+flush-8:021:42:501
1254211994338,4cyclictest1461212-21kworker/u8:1+flush-8:023:07:470
1254211994334,7cyclictest275-21systemd-journal00:32:500
1254215994235,5cyclictest275-21systemd-journal23:08:351
1254211994237,3cyclictest1461212-21kworker/u8:1+flush-8:023:17:470
1254211994236,4cyclictest1365384-21kworker/u8:1+flush-8:021:27:550
1254219994130,8cyclictest1544917-21diskstats00:02:442
1254215994136,3cyclictest1306346-21kworker/u8:2+flush-8:020:17:591
1254215994135,4cyclictest1461212-21kworker/u8:1+events_unbound23:12:581
1254215994035,4cyclictest1350808-21kworker/u8:0+flush-8:022:37:591
1254211994036,3cyclictest1525202-21kworker/u8:2+events_unbound00:07:490
1254211994036,3cyclictest1259085-21cron19:15:000
1254215993935,3cyclictest1461212-21kworker/u8:1+flush-8:023:23:021
1254215993934,4cyclictest1409468-21kworker/u8:3+flush-8:021:57:491
1254215993934,4cyclictest1221985-21kworker/u8:2+flush-8:019:47:541
1254215993934,3cyclictest1261218-21kworker/u8:3+events_unbound19:45:001
1254211993935,3cyclictest1221985-21kworker/u8:2+flush-8:019:48:000
1254211993933,4cyclictest1365384-21kworker/u8:1+flush-8:022:28:000
1254219993829,7cyclictest1335653-21cat20:30:002
1254215993832,4cyclictest1461212-21kworker/u8:1+flush-8:023:38:001
1254215993831,5cyclictest1499861-21apt-get23:17:391
1254211993834,2cyclictest1564118-21sh00:20:010
1254211993829,7cyclictest1459596-21latency_hist22:35:010
1254215993732,4cyclictest1350808-21kworker/u8:0+flush-8:022:15:311
1254211993731,4cyclictest1350808-21kworker/u8:0+flush-8:021:42:510
1254211993727,8cyclictest275-21systemd-journal19:45:000
125421199370,35cyclictest1-21systemd21:32:570
1254211993633,2cyclictest1464533-21latency_hist22:40:000
1254215993531,2cyclictest1350808-21kworker/u8:0+flush-8:021:27:451
1254215993529,5cyclictest1469194-21kworker/u8:3+events_unbound22:47:541
1254215993529,5cyclictest1469194-21kworker/u8:3+events_unbound22:47:541
1254211993527,6cyclictest1355931-21/usr/sbin/munin20:53:000
1254211993524,9cyclictest275-21systemd-journal00:00:000
12494162354,10sleep10-21swapper/119:05:481
1254219993411,5cyclictest1568385-21ntpq00:22:552
1254219993411,13cyclictest0-21swapper/200:37:592
1254215993430,3cyclictest1306346-21kworker/u8:2+events_unbound20:10:011
1254215993429,4cyclictest1554486-21kworker/u8:1+events_unbound00:27:561
1254215993428,4cyclictest1365384-21kworker/u8:1+flush-8:021:22:571
1254211993430,3cyclictest1296319-21kworker/u8:1+flush-8:019:53:000
1254211993429,4cyclictest1469194-21kworker/u8:3+events_unbound22:47:560
1254211993429,4cyclictest1469194-21kworker/u8:3+events_unbound22:47:560
1254211993429,4cyclictest1326044-21kworker/u8:3+flush-8:020:37:530
1254211993424,8cyclictest275-21systemd-journal19:40:000
125421199341,30cyclictest1580469-21sshd00:37:500
125421999339,13cyclictest1316345-21apt-get20:12:402
125421999339,11cyclictest1261463-21apt-get19:17:422
1254219993318,10cyclictest1350998-21apt-get20:47:402
1254215993329,3cyclictest1489783-21kworker/u8:0+flush-8:000:18:021
1254215993326,5cyclictest1261018-21irqcore19:15:051
1254211993328,4cyclictest455829-21kworker/u8:0+events_unbound19:15:010
1254211993327,4cyclictest1350808-21kworker/u8:0+events_unbound20:47:550
1254211993326,5cyclictest1291153-21kworker/u8:0+flush-8:020:27:560
1254219993225,5cyclictest1474532-21cp22:50:002
1254219993225,5cyclictest1474532-21cp22:50:002
125421999321,14cyclictest1445204-21apt-get22:22:412
1254219993210,11cyclictest1543461-21ntpq23:57:542
1254215993227,4cyclictest1499636-21kworker/u8:4+events_unbound00:02:531
1254215993226,5cyclictest1409468-21kworker/u8:3+flush-8:021:47:521
1254211993229,2cyclictest1479627-21cron22:55:000
1254211993227,4cyclictest1306346-21kworker/u8:2+events_unbound20:57:550
1254211993227,4cyclictest1261218-21kworker/u8:3+events_unbound20:00:070
1254211993227,4cyclictest1261218-21kworker/u8:3+events_unbound20:00:070
1254211993225,5cyclictest1271867-21diskstats19:27:430
1254219993126,3cyclictest1563852-21unixbench_multi00:18:022
1254219993126,3cyclictest1366165-21fschecks_time21:02:432
1254219993122,4cyclictest1375713-21apt-get21:12:402
1254219993111,4cyclictest1558396-21ntpq00:12:552
1254219993111,4cyclictest1558396-21ntpq00:12:552
1254215993127,3cyclictest1307184-21irqrtprio20:02:481
1254215993127,3cyclictest1307184-21irqrtprio20:02:481
1254215993125,5cyclictest1221985-21kworker/u8:2+flush-8:019:37:541
1254215993124,5cyclictest1365384-21kworker/u8:1+flush-8:021:10:001
1254211993127,3cyclictest1365384-21kworker/u8:1+events_unbound22:02:440
1254211993126,3cyclictest1554486-21kworker/u8:1+events_unbound00:27:460
125421199310,29cyclictest1375286-21munin-run21:10:000
125421999309,11cyclictest1498703-21ntpq23:12:552
1254219993018,9cyclictest1494458-21awk23:10:012
1254215993026,3cyclictest1525202-21kworker/u8:2+flush-8:023:42:501
1254215993026,3cyclictest1291153-21kworker/u8:0+events_unbound20:27:551
1254215993025,4cyclictest455829-21kworker/u8:0+events_unbound19:12:541
1254215993024,5cyclictest1450192-21aten2_r5power_c22:27:421
1254211993025,4cyclictest1350808-21kworker/u8:0+events_unbound21:12:550
1254211993025,4cyclictest1306346-21kworker/u8:2+events_unbound20:45:010
1254211993024,5cyclictest1350808-21kworker/u8:0+events_unbound22:10:010
1254211993021,7cyclictest1280529-21ntpq19:32:520
1254219992925,2cyclictest1515031-21aten2_r5power_v23:32:422
1254219992920,4cyclictest1276788-21apt-get19:32:402
1254219992918,9cyclictest1384267-21/usr/sbin/munin21:17:512
1254219992918,9cyclictest1384267-21/usr/sbin/munin21:17:512
1254219992917,8cyclictest1455448-21/usr/sbin/munin22:32:442
1254219992916,10cyclictest1375078-21/usr/sbin/munin21:08:022
1254219992915,11cyclictest1400642-21/usr/sbin/munin21:37:392
1254219992913,13cyclictest1441014-21sed22:17:472
1254215992925,3cyclictest1525202-21kworker/u8:2+flush-8:000:23:011
1254215992925,2cyclictest0-21swapper/120:37:471
1254215992924,4cyclictest1239316-21kworker/u8:1+flush-8:019:21:131
1254215992924,3cyclictest1305188-21needreboot19:57:521
1254215992923,4cyclictest1499636-21kworker/u8:4+flush-8:023:32:471
1254215992920,6cyclictest1355504-21latency_hist20:50:011
1254215992917,4cyclictest1350808-21kworker/u8:0+events_unbound21:17:441
1254215992917,4cyclictest1350808-21kworker/u8:0+events_unbound21:17:441
1254211992925,3cyclictest1296319-21kworker/u8:1+flush-8:019:55:350
1254211992923,5cyclictest1444779-21kworker/u8:2+flush-8:022:22:530
1254211992923,4cyclictest1409468-21kworker/u8:3+events_unbound21:57:470
1254211992922,5cyclictest1514466-21latency_hist23:30:010
125421999289,9cyclictest1549650-21apt-get00:07:432
1254219992820,3cyclictest1291587-21apt-get19:47:412
1254219992818,8cyclictest1301106-21cat19:55:002
1254219992817,8cyclictest1430860-21/usr/sbin/munin22:07:492
1254219992814,12cyclictest1399851-21chrt21:33:312
1254215992823,4cyclictest1525202-21kworker/u8:2+events_unbound23:57:441
1254215992822,5cyclictest1365384-21kworker/u8:1+events_unbound21:37:591
1254215992822,4cyclictest1525202-21kworker/u8:2+flush-8:000:32:531
1254211992824,3cyclictest1409468-21kworker/u8:3+flush-8:021:45:060
1254211992824,3cyclictest1350808-21kworker/u8:0+events_unbound22:42:590
1254211992824,3cyclictest1350808-21kworker/u8:0+events_unbound22:42:590
1254211992823,4cyclictest1525202-21kworker/u8:2+flush-8:023:42:550
1254211992823,4cyclictest1525202-21kworker/u8:2+events_unbound00:15:000
1254211992823,4cyclictest1525202-21kworker/u8:2+events_unbound00:15:000
1254211992823,4cyclictest1469194-21kworker/u8:3+events_unbound22:57:350
1254211992823,4cyclictest1365384-21kworker/u8:1+events_unbound21:02:420
1254219992719,4cyclictest1474436-21apt-get22:50:022
1254219992717,7cyclictest1390725-21/usr/sbin/munin21:27:432
1254219992716,9cyclictest1326475-21/usr/sbin/munin20:22:432
1254219992716,8cyclictest1360847-21/usr/sbin/munin20:57:382
1254219992715,8cyclictest1406137-21/usr/sbin/munin21:42:482
1254219992712,12cyclictest1450595-21awk22:27:462
1254215992723,2cyclictest0-21swapper/122:12:421
1254215992719,6cyclictest1425420-21/usr/sbin/munin22:02:511
1254211992723,3cyclictest1461212-21kworker/u8:1+events_unbound23:00:030
1254211992722,3cyclictest1499636-21kworker/u8:4+flush-8:023:25:000
1254211992722,3cyclictest1350808-21kworker/u8:0+flush-8:022:17:510
1254211992719,5cyclictest275-21systemd-journal23:31:350
13841692260,3sleep3575-21kworker/3:2+events21:17:513
13841692260,3sleep3575-21kworker/3:2+events21:17:513
1254219992616,8cyclictest1336220-21/usr/sbin/munin20:32:462
1254219992616,8cyclictest1258596-21/usr/sbin/munin19:12:572
1254219992616,7cyclictest1469032-21/usr/sbin/munin22:43:002
1254219992616,7cyclictest1469032-21/usr/sbin/munin22:43:002
1254219992615,7cyclictest1266690-21/usr/sbin/munin19:22:452
1254219992614,7cyclictest1311415-21apt-get20:07:422
1254219992613,10cyclictest1510091-21tr23:27:432
1254219992610,11cyclictest1485012-21apt-get23:02:432
1254215992622,3cyclictest1469194-21kworker/u8:3+flush-8:022:52:501
1254215992621,4cyclictest1444779-21kworker/u8:2+events_unbound22:22:471
1254215992621,4cyclictest1326044-21kworker/u8:3+flush-8:020:22:491
1254215992620,4cyclictest1469194-21kworker/u8:3+events_unbound22:57:541
1254215992619,6cyclictest1525202-21kworker/u8:2+flush-8:000:07:561
1254215992619,5cyclictest275-21systemd-journal19:54:081
1254215992618,6cyclictest275-21systemd-journal19:32:081
1254215992616,8cyclictest1538545-21ntpq23:52:531
1254211992622,3cyclictest1306346-21kworker/u8:2+events_unbound20:17:570
1254211992621,4cyclictest1365384-21kworker/u8:1+events_unbound21:22:430
1254211992621,3cyclictest1365384-21kworker/u8:1+flush-8:021:52:540
1254219992517,5cyclictest1321441-21/usr/sbin/munin20:17:422
1254219992516,7cyclictest1425532-21/usr/sbin/munin22:02:422
1254219992516,7cyclictest1360077-21/usr/sbin/munin20:53:012
1254219992516,6cyclictest1435835-21/usr/sbin/munin22:12:462
1254219992516,4cyclictest1281746-21apt-get19:37:422
1254219992515,7cyclictest1519943-21/usr/sbin/munin23:37:432
1254219992513,8cyclictest1536267-21kthreadcore23:52:482
1254219992513,8cyclictest1525134-21fschecks_count23:42:442
1254219992513,7cyclictest1346066-21apt-get20:42:422
1254219992512,11cyclictest1414728-21sed21:47:582
1254219992511,12cyclictest1574074-21wc00:30:012
1254219992511,12cyclictest1461822-21cut22:37:492
1254215992520,3cyclictest1499636-21kworker/u8:4+flush-8:000:12:511
1254215992520,3cyclictest1499636-21kworker/u8:4+flush-8:000:12:511
1254211992521,3cyclictest1525202-21kworker/u8:2+events_unbound23:47:460
1254211992518,5cyclictest1254034-21latency_hist19:10:010
1254219992416,5cyclictest1415909-21/usr/sbin/munin21:52:442
1254219992416,5cyclictest1306572-21/usr/sbin/munin20:02:432
1254219992416,5cyclictest1306572-21/usr/sbin/munin20:02:432
1254219992415,7cyclictest1480318-21/usr/sbin/munin22:57:432
1254219992414,8cyclictest1504198-21seq23:18:022
1254219992412,9cyclictest1574456-21taskset00:32:392
1254219992412,8cyclictest1505376-21cut23:22:462
1254215992422,1cyclictest0-21swapper/121:32:421
1254215992420,3cyclictest1291153-21kworker/u8:0+flush-8:020:33:021
1254215992419,4cyclictest1469194-21kworker/u8:3+flush-8:023:02:401
1254215992419,4cyclictest1350808-21kworker/u8:0+flush-8:022:08:031
1254215992418,5cyclictest1461212-21kworker/u8:1+flush-8:023:28:011
1254211992420,3cyclictest1350808-21kworker/u8:0+flush-8:022:07:450
1254211992419,4cyclictest1461212-21kworker/u8:1+flush-8:023:12:540
1254219992315,6cyclictest1531223-21tr23:47:512
1254219992313,8cyclictest1287410-21ps19:42:482
1254219992312,9cyclictest1387317-21cut21:22:482
1254219992312,8cyclictest1342226-21cut20:37:492
1254215992318,3cyclictest1350808-21kworker/u8:0+flush-8:022:32:541
1254211992317,4cyclictest1326044-21kworker/u8:3+events_unbound20:22:480
1254215992218,2cyclictest0-21swapper/120:42:571
1254215992217,4cyclictest1366007-21cpuspeed_turbos21:02:411
1254215992216,5cyclictest1306346-21kworker/u8:2+flush-8:020:57:581
125421999218,10cyclictest1254255-21sed19:10:012
1254215992114,5cyclictest0-21swapper/120:52:531
12493612183,9sleep30-21swapper/319:05:063
14751252162,9sleep30-21swapper/322:52:423
12614662162,9sleep30-21swapper/319:17:423
14204972152,8sleep30-21swapper/321:57:403
15342782142,8sleep30-21swapper/323:50:003
15617822132,7sleep30-21swapper/300:17:533
15144902132,6sleep30-21swapper/323:30:023
13707262132,7sleep30-21swapper/321:07:413
13299882132,7sleep30-21swapper/320:22:553
13200322132,7sleep30-21swapper/320:12:513
15791032122,5sleep30-21swapper/300:35:023
15734472122,6sleep30-21swapper/300:28:003
15549002122,6sleep30-21swapper/300:12:473
15549002122,6sleep30-21swapper/300:12:473
15446422122,6sleep30-21swapper/300:02:403
15393542122,5sleep30-21swapper/323:55:013
15362612122,6sleep30-21swapper/323:52:493
15287072122,6sleep30-21swapper/323:42:583
15238722122,6sleep30-21swapper/323:38:003
15063032122,6sleep30-21swapper/323:22:513
14998652122,7sleep30-21swapper/323:17:423
14947902122,6sleep30-21swapper/323:11:363
14895392122,5sleep30-21swapper/323:05:023
14699282122,6sleep30-21swapper/322:47:403
14699282122,6sleep30-21swapper/322:47:403
14559572122,6sleep30-21swapper/322:32:493
14497322122,5sleep30-21swapper/322:25:013
14489142122,6sleep30-21swapper/322:22:523
14356892122,6sleep30-21swapper/322:12:453
14306532122,6sleep30-21swapper/322:07:483
14250072122,5sleep30-21swapper/322:00:013
14095672122,6sleep30-21swapper/321:43:003
14039192122,6sleep30-21swapper/321:37:503
13894992122,6sleep30-21swapper/321:22:583
13753982122,5sleep30-21swapper/321:10:013
13700652122,6sleep30-21swapper/321:02:593
13648712122,6sleep30-21swapper/320:57:583
13596842122,6sleep30-21swapper/320:52:563
13505702122,6sleep30-21swapper/320:45:023
13361112122,6sleep30-21swapper/320:32:463
13311692122,6sleep30-21swapper/320:27:403
13255802122,6sleep30-21swapper/320:18:013
13122972122,6sleep30-21swapper/320:07:503
13104802122,6sleep30-21swapper/320:03:003
13104802122,6sleep30-21swapper/320:03:003
12967672122,6sleep30-21swapper/319:52:453
12916462122,6sleep30-21swapper/319:47:443
12765122122,5sleep30-21swapper/319:30:023
12753532123,6sleep30-21swapper/319:27:533
12669012122,6sleep30-21swapper/319:22:483
15782392112,5sleep30-21swapper/300:32:533
15643272112,5sleep30-21swapper/300:20:013
15491822112,5sleep30-21swapper/300:05:013
15098402112,6sleep30-21swapper/323:25:523
14888272112,5sleep30-21swapper/323:02:573
14840632112,5sleep30-21swapper/322:57:593
14604252112,5sleep30-21swapper/322:37:453
14400402112,5sleep30-21swapper/322:15:023
14152552112,5sleep30-21swapper/321:50:023
14143692112,5sleep30-21swapper/321:47:533
13993382112,6sleep30-21swapper/321:32:573
13903962112,6sleep30-21swapper/321:25:503
13462272112,5sleep30-21swapper/320:42:453
13408102112,5sleep30-21swapper/320:35:023
13012842112,6sleep30-21swapper/319:55:103
12862502112,5sleep30-21swapper/319:40:013
12815892112,6sleep30-21swapper/319:36:003
12543212112,6sleep30-21swapper/319:10:043
14647682102,5sleep30-21swapper/322:40:023
14647682102,5sleep30-21swapper/322:40:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional