You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-19 - 15:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Tue May 19, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13285992650,2sleep3471rcuc/307:20:573
13514872630,5sleep30-21swapper/307:45:483
1314034995732,22cyclictest1404693-21ntpq08:36:000
1314039995242,7cyclictest1539548-21latency_hist10:55:011
1314042995141,7cyclictest1704890-21systemd-journal11:00:002
1314039995143,6cyclictest1345799-21kworker/u8:2+events_unbound10:56:031
1314034994838,7cyclictest1390713-21latency_hist08:25:010
1314039994738,7cyclictest1627631-21ntpq12:20:591
1314034994740,5cyclictest1335728-21kworker/u8:0+flush-8:009:31:020
1314039994641,4cyclictest1335728-21kworker/u8:0+events_unbound10:16:021
1314039994536,6cyclictest1370910-21latency_hist08:05:011
1314039994435,6cyclictest1564241-21latency_hist11:20:001
1314034994434,8cyclictest1548542-21ntpq11:01:010
1314034994420,21cyclictest1379912-21ntpq08:10:590
1314034994420,21cyclictest1379912-21ntpq08:10:580
1314039994338,3cyclictest1465426-21kworker/u8:1+flush-8:010:21:051
1314039994337,5cyclictest1335728-21kworker/u8:0+flush-8:010:11:011
1314034994335,5cyclictest1529672-21latency_hist10:45:010
131403499431,27cyclictest1425292-21sshd08:56:330
1314034994234,6cyclictest1579390-21/usr/sbin/munin11:35:580
1314034994234,6cyclictest1579113-21latency_hist11:35:000
1314034994232,8cyclictest1444493-21ntpq09:16:010
1314034994221,17cyclictest0-21swapper/010:30:030
1314034994220,19cyclictest1524696-21latency_hist10:40:010
1314042994134,5cyclictest1514995-21base6410:30:012
1314039994132,7cyclictest1429742-21ntpq09:01:051
1314039994132,7cyclictest1414909-21ntpq08:46:021
131403499415,26cyclictest0-21swapper/011:53:390
1314034994119,20cyclictest1484532-21grep09:56:060
1314039994035,3cyclictest459996-21kworker/u8:3+flush-8:007:16:031
1314039994035,3cyclictest1345799-21kworker/u8:2+flush-8:008:36:041
1314039994033,5cyclictest1335728-21kworker/u8:0+flush-8:007:56:061
1314039994033,5cyclictest1313887-21kworker/u8:1+events_unbound07:51:041
1314039994030,8cyclictest1593027-21ntpq11:46:001
1314034994010,21cyclictest0-21swapper/009:24:120
1314042993931,5cyclictest1485124-21cat10:00:012
1314039993933,4cyclictest1335728-21kworker/u8:0+flush-8:009:11:061
1314039993932,5cyclictest1385958-21kworker/u8:1+flush-8:008:51:011
1314034993921,16cyclictest1504301-21unixbench_multi10:16:050
131403499391,24cyclictest401-21dbus-daemon11:10:010
1314042993833,4cyclictest1313887-21kworker/u8:1+flush-8:008:06:042
1314042993831,5cyclictest1335728-21kworker/u8:0+flush-8:007:41:022
1314039993832,4cyclictest1465426-21kworker/u8:1+flush-8:010:40:531
1314039993831,5cyclictest1465426-21kworker/u8:1+events_unbound10:06:031
131403499388,21cyclictest0-21swapper/008:47:160
1314034993825,10cyclictest1704890-21systemd-journal10:29:590
1314042993729,6cyclictest1415710-21cat08:50:002
1314039993733,3cyclictest1335728-21kworker/u8:0+events_unbound07:40:011
1314039993731,4cyclictest459996-21kworker/u8:3+flush-8:007:10:541
1314034993727,8cyclictest1622718-21ntpq12:16:020
1314034993720,15cyclictest1638532-21apt-key12:35:000
1314034993720,15cyclictest1638532-21apt-key12:35:000
131380923722,9sleep30-21swapper/307:09:303
1314039993630,5cyclictest1345799-21kworker/u8:2+flush-8:009:21:001
1314039993629,5cyclictest1430837-21apt-get09:05:481
1314039993628,6cyclictest1568334-21ntpq11:21:011
1314039993627,6cyclictest1534584-21latency_hist10:50:001
1314039993626,8cyclictest1607892-21ntpq12:01:031
1314034993629,5cyclictest1375817-21latency_hist08:10:010
1314034993619,15cyclictest1330735-21unixbench_singl07:21:070
1314034993616,17cyclictest1395644-21latency_hist08:30:010
13135782363,9sleep10-21swapper/107:06:311
1314039993530,4cyclictest1345799-21kworker/u8:2+flush-8:008:40:511
1314039993529,4cyclictest1345799-21kworker/u8:2+flush-8:011:06:031
1314039993527,5cyclictest1704890-21systemd-journal08:28:321
131403499357,7cyclictest1356429-21diskstats07:50:510
131403499354,3cyclictest0-21swapper/012:20:480
1314034993518,15cyclictest1540442-21sort10:55:550
1314034993517,15cyclictest1339807-21cut07:30:590
1314034993513,19cyclictest1384851-21ntpq08:16:020
14301002340,5sleep3451irq_work/309:01:083
1314042993424,8cyclictest1424717-21ntpq08:56:012
1314039993428,5cyclictest1335728-21kworker/u8:0+flush-8:009:15:491
1314039993427,5cyclictest1588997-21latency_hist11:45:011
1314039993425,6cyclictest1618613-21latency_hist12:15:011
131403499344,4cyclictest0-21swapper/009:45:460
131403499344,4cyclictest0-21swapper/007:15:470
131403499343,4cyclictest0-21swapper/008:30:490
1314039993329,3cyclictest1568886-21kworker/u8:0+flush-8:011:25:521
1314039993329,3cyclictest1313887-21kworker/u8:1+flush-8:007:41:091
1314039993327,5cyclictest1465426-21kworker/u8:1+flush-8:010:36:001
1314039993327,4cyclictest1465426-21kworker/u8:1+flush-8:010:00:501
1314039993327,4cyclictest1464270-21ntpq09:35:591
1314039993327,4cyclictest1464270-21ntpq09:35:591
131403499338,6cyclictest1454321-21/usr/sbin/munin09:25:560
131403499334,3cyclictest0-21swapper/011:45:470
131403499333,3cyclictest0-21swapper/007:35:470
1314034993326,5cyclictest1416011-21apt-get08:50:460
131403499332,11cyclictest1314038-21latency_hist07:10:000
131403499331,9cyclictest1509216-21/usr/sbin/munin10:21:070
131403499331,9cyclictest1465712-21/usr/sbin/munin09:40:490
131403499331,9cyclictest1464471-21/usr/sbin/munin09:36:040
131403499331,9cyclictest1464471-21/usr/sbin/munin09:36:030
1314034993317,14cyclictest1704814-21sshd09:13:330
1314034993316,15cyclictest0-21swapper/012:36:050
1314034993316,15cyclictest0-21swapper/007:45:550
1314034993314,17cyclictest1633050-21unixbench_multi12:26:060
1314034993314,17cyclictest1633050-21unixbench_multi12:26:060
1314034993311,19cyclictest1704890-21systemd-journal11:25:010
1314042993226,4cyclictest1598550-21kworker/u8:3+flush-8:012:30:532
1314042993226,4cyclictest1598550-21kworker/u8:3+flush-8:012:30:532
1314042993226,4cyclictest1345799-21kworker/u8:2+events_unbound09:01:022
1314042993221,8cyclictest1628536-21awk12:25:002
1314039993226,5cyclictest1598550-21kworker/u8:3+flush-8:012:06:041
1314039993225,5cyclictest1385958-21kworker/u8:1+events_unbound08:21:011
131403499324,4cyclictest0-21swapper/010:45:470
131403499323,4cyclictest0-21swapper/010:00:480
1314034993226,4cyclictest1704890-21systemd-journal07:59:040
131403499321,9cyclictest1602975-21ntpq11:56:000
131403499321,8cyclictest1588368-21/usr/sbin/munin11:41:030
131403499321,8cyclictest1498861-21/usr/sbin/munin10:10:590
131403499321,8cyclictest1479231-21/usr/sbin/munin09:51:040
131403499321,8cyclictest1426327-21/usr/sbin/munin09:00:550
1314034993217,13cyclictest1573315-21ntp_kernel_pll_11:26:010
1314034993211,19cyclictest1317912-21grep07:10:580
131403499321,10cyclictest1559640-21/usr/sbin/munin11:15:490
131403499320,8cyclictest1406121-21/usr/sbin/munin08:40:470
1314042993127,3cyclictest1454419-21kworker/u8:3+events_unbound09:40:002
1314042993127,3cyclictest1454419-21kworker/u8:3+events_unbound09:40:002
1314042993124,5cyclictest1335728-21kworker/u8:0+flush-8:009:15:562
1314039993122,7cyclictest1374940-21ntpq08:06:001
131403499317,5cyclictest1614757-21cut12:10:530
131403499316,4cyclictest1609427-21grep12:05:520
131403499311,8cyclictest1558613-21/usr/sbin/munin11:11:080
131403499310,8cyclictest1431320-21/usr/sbin/munin09:05:550
131403499310,8cyclictest1350228-21/usr/sbin/munin07:41:050
131403499310,8cyclictest1335377-21/usr/sbin/munin07:26:060
16356532300,6sleep3451irq_work/312:30:553
16356532300,6sleep3451irq_work/312:30:543
1314042993026,2cyclictest1589519-21cpuspeed_turbos11:45:502
1314042993025,4cyclictest1345799-21kworker/u8:2+flush-8:012:01:042
1314039993025,3cyclictest1643591-21cron12:40:011
1314039993025,3cyclictest1338464-21kthreadcore07:30:581
1314039993023,5cyclictest1465426-21kworker/u8:1+events_unbound09:44:591
1314039993023,5cyclictest1313887-21kworker/u8:1+flush-8:007:45:481
1314039993018,8cyclictest1704890-21systemd-journal07:21:331
131403499301,9cyclictest1535417-21/usr/sbin/munin10:50:540
131403499301,9cyclictest1490191-21apt-get10:05:470
131403499301,8cyclictest1366549-21/usr/sbin/munin08:00:510
131403499301,10cyclictest589-21runrttasks12:00:490
1314042992926,2cyclictest1365996-21sendmail08:00:002
1314042992923,4cyclictest1618284-21kworker/u8:0+events_unbound12:15:552
1314042992922,5cyclictest459996-21kworker/u8:3+events_unbound07:25:592
1314039992925,3cyclictest1465426-21kworker/u8:1+events_unbound11:36:001
1314039992925,3cyclictest1465426-21kworker/u8:1+events_unbound09:50:551
1314039992924,4cyclictest1598550-21kworker/u8:3+events_unbound12:30:001
1314039992924,4cyclictest1598550-21kworker/u8:3+events_unbound12:30:001
1314039992924,3cyclictest1398138-21kthreadcore08:30:581
1314039992922,5cyclictest1470461-21apt-get09:45:461
1314039992922,5cyclictest1345799-21kworker/u8:2+flush-8:011:55:591
1314042992824,2cyclictest1599252-21aten2_r5power_p11:55:482
1314042992819,7cyclictest1366549-21diskstats08:00:502
1314042992818,8cyclictest1405559-21awk08:40:012
1314039992823,4cyclictest1465426-21kworker/u8:1+flush-8:011:50:481
13869582270,5sleep3451irq_work/308:20:563
1314042992723,2cyclictest1381326-21cpuspeed_turbos08:15:512
1314042992718,7cyclictest1345799-21kworker/u8:2+events_unbound11:11:052
1314042992716,9cyclictest1613710-21awk12:09:592
1314039992722,4cyclictest1335728-21kworker/u8:0+flush-8:009:30:521
1314039992720,5cyclictest1618284-21kworker/u8:0+flush-8:012:16:021
1314039992719,6cyclictest1465426-21kworker/u8:1+flush-8:011:31:011
1314039992622,3cyclictest1465426-21kworker/u8:1+events_unbound10:28:381
1314039992618,5cyclictest1455246-21latency_hist09:30:011
1314042992522,2cyclictest1490248-21aten2_r5power_e10:05:492
1314042992522,2cyclictest1351463-21fschecks_count07:45:492
1314042992521,3cyclictest1638303-21kworker/u8:0+events_unbound12:35:582
1314042992521,3cyclictest1465426-21kworker/u8:1+flush-8:010:41:032
1314039992519,4cyclictest1335596-21unixbench_multi07:26:071
1314042992420,3cyclictest1465426-21kworker/u8:1+events_unbound10:30:472
1314042992419,4cyclictest20977-21cron09:55:012
1314042992419,4cyclictest1375504-21kworker/u8:3+flush-8:008:11:032
1314042992419,4cyclictest1375504-21kworker/u8:3+flush-8:008:11:022
1314042992419,4cyclictest1313887-21kworker/u8:1+flush-8:007:31:012
1314042992419,3cyclictest1485475-21cpuspeed_turbos10:00:492
1314042992419,3cyclictest1460187-21cron09:34:592
1314042992419,3cyclictest0-21swapper/209:10:002
1314042992418,5cyclictest1345799-21kworker/u8:2+events_unbound09:26:072
1314042992413,9cyclictest1533754-21ntpq10:46:012
1314039992420,3cyclictest1375504-21kworker/u8:3+flush-8:008:10:041
1314039992420,3cyclictest1375504-21kworker/u8:3+flush-8:008:10:041
1314039992420,2cyclictest0-21swapper/112:35:001
1314039992420,2cyclictest0-21swapper/112:34:591
1314039992420,2cyclictest0-21swapper/111:11:051
1314039992417,5cyclictest1345799-21kworker/u8:2+flush-8:008:15:491
13750402230,2sleep3481ktimers/308:06:033
131404299230,8cyclictest14671981kthreadcore09:40:552
1314039992318,4cyclictest1465426-21kworker/u8:1+events_unbound09:55:491
1314039992317,5cyclictest1345799-21kworker/u8:2+events_unbound11:01:051
1314042992218,3cyclictest1465426-21kworker/u8:1+events_unbound11:51:022
1314042992218,2cyclictest1314527-21fschecks_count07:10:502
1314042992213,7cyclictest1504710-21awk10:19:592
1314039992218,2cyclictest0-21swapper/110:30:541
1314039992218,2cyclictest0-21swapper/108:55:571
15147482210,4sleep3451irq_work/310:30:013
131404299212,13cyclictest1416011-21apt-get08:50:482
131404299212,13cyclictest1406123-21apt-get08:40:492
131404299212,13cyclictest1395958-21apt-get08:30:502
1314042992117,3cyclictest1614324-21fschecks_time12:10:512
131404299202,13cyclictest1569523-21apt-get11:25:482
1314042992017,2cyclictest1341351-21aten2_r5power_v07:35:492
1314042992016,2cyclictest0-21swapper/210:25:002
1314042992016,2cyclictest0-21swapper/207:51:082
1314042992011,2cyclictest0-21swapper/211:10:012
13131072204,9sleep20-21swapper/207:06:042
131404299192,12cyclictest1568402-21ntpq11:21:032
1314042991915,2cyclictest0-21swapper/211:15:512
1314042991915,2cyclictest0-21swapper/210:35:572
1314042991914,3cyclictest0-21swapper/211:40:482
1314042991914,3cyclictest0-21swapper/209:20:562
1314042991911,6cyclictest1496880-21tr10:10:562
13658522182,5sleep30-21swapper/307:58:383
1314042991814,3cyclictest0-21swapper/212:26:062
1314042991814,3cyclictest0-21swapper/212:26:062
1314042991814,2cyclictest0-21swapper/208:25:582
1314042991813,3cyclictest1576133-21kthreadcore11:30:562
1314042991813,3cyclictest0-21swapper/207:15:022
1314042991811,5cyclictest1537174-21tr10:50:572
1314042991810,6cyclictest1471799-21cut09:45:552
1314042991712,3cyclictest1390714-21munin-plugin-st08:25:012
14105102163,4sleep30-21swapper/308:41:323
131404299167,7cyclictest1436422-21sed09:10:552
131404299162,13cyclictest0-21swapper/211:01:062
1314042991611,3cyclictest0-21swapper/211:35:542
16434742152,4sleep30-21swapper/312:38:423
1314042991511,2cyclictest0-21swapper/207:20:502
13662742142,8sleep30-21swapper/308:00:473
13607692142,6sleep30-21swapper/307:55:013
16224722134,5sleep30-21swapper/312:15:593
15544492132,6sleep30-21swapper/311:10:023
14899092132,6sleep30-21swapper/310:05:023
14741632134,5sleep30-21swapper/309:45:593
13907982132,6sleep30-21swapper/308:25:023
13414842131,7sleep30-21swapper/307:35:513
13229272132,7sleep30-21swapper/307:15:573
13149482132,6sleep30-21swapper/307:10:553
16290422122,6sleep30-21swapper/312:25:503
16290422122,6sleep30-21swapper/312:25:493
16242032122,6sleep30-21swapper/312:20:533
16137262122,5sleep30-21swapper/312:10:003
16093282122,6sleep30-21swapper/312:05:523
16044032122,6sleep30-21swapper/312:00:543
15890082122,5sleep30-21swapper/311:45:013
15792682122,6sleep30-21swapper/311:35:023
15697672122,6sleep30-21swapper/311:25:513
15649122122,6sleep30-21swapper/311:20:533
15634442122,6sleep30-21swapper/311:16:043
15415882122,6sleep30-21swapper/310:55:583
15391082122,6sleep30-21swapper/310:51:073
15287582122,6sleep30-21swapper/310:41:013
15191242122,6sleep30-21swapper/310:31:063
15040612122,6sleep30-21swapper/310:16:053
14960492122,6sleep30-21swapper/310:10:563
14693382122,6sleep30-21swapper/309:41:023
14624122122,6sleep30-21swapper/309:35:573
14624122122,6sleep30-21swapper/309:35:563
14493522122,6sleep30-21swapper/309:21:003
14246402122,6sleep30-21swapper/308:56:003
14111062122,7sleep30-21swapper/308:45:483
14006142122,5sleep30-21swapper/308:35:013
13995942122,6sleep30-21swapper/308:30:593
13854572122,6sleep30-21swapper/308:17:003
13760952122,6sleep30-21swapper/308:10:463
13760952122,6sleep30-21swapper/308:10:463
13472282122,6sleep30-21swapper/307:40:563
13318992122,6sleep30-21swapper/307:25:563
15996392112,5sleep30-21swapper/311:55:533
15944922112,5sleep30-21swapper/311:50:513
15883632112,6sleep30-21swapper/311:41:043
15744862112,5sleep30-21swapper/311:30:493
15540402112,5sleep30-21swapper/311:06:083
15449692112,5sleep30-21swapper/311:00:513
15345332112,6sleep30-21swapper/310:49:323
15200962112,5sleep30-21swapper/310:35:473
15049262112,5sleep30-21swapper/310:20:033
14851992112,6sleep30-21swapper/310:00:233
14839892111,5sleep30-21swapper/309:55:593
14799082112,6sleep30-21swapper/309:54:063
14557882112,5sleep30-21swapper/309:30:513
14503142112,5sleep30-21swapper/309:25:013
14406462112,5sleep30-21swapper/309:15:023
14361072112,5sleep30-21swapper/309:10:533
14308492112,5sleep30-21swapper/309:05:513
14158712112,5sleep30-21swapper/308:50:023
13365952112,5sleep30-21swapper/307:30:523
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional