You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 09:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Jul 30, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15625082710,2sleep3575-21kworker/3:2-events20:35:013
1475623994530,13cyclictest1742451-21fschecks_time23:37:560
1475623994511,21cyclictest0-21swapper/019:22:580
1475623994422,20cyclictest1627560-21diskstats21:42:560
1475632994332,8cyclictest1766384-21awk00:00:002
1475623994234,5cyclictest1507936-21kworker/u8:3+flush-8:019:52:570
1475623994226,14cyclictest0-21swapper/019:20:010
1475623994219,19cyclictest1602106-21latency_hist21:15:010
1475623994134,5cyclictest1542266-21latency_hist20:15:010
1475623994123,16cyclictest1796790-21apt-get00:32:520
1475632994032,6cyclictest1726707-21cp23:20:002
1475623994029,9cyclictest275-21systemd-journal23:10:010
1475623994024,14cyclictest1686873-21aten2_r5power_c22:42:570
15890642390,9sleep0141ktimers/021:03:020
1475623993930,7cyclictest1716481-21apt-get23:10:010
1475623993830,5cyclictest1681884-21/usr/sbin/munin22:38:110
1475623993821,15cyclictest0-21swapper/022:35:000
14710452384,10sleep10-21swapper/119:07:541
1475625993729,6cyclictest1777009-21/usr/sbin/munin00:13:151
1475623993724,11cyclictest1480524-21idleruntime-cro19:15:000
1475623993718,17cyclictest401-21dbus-daemon20:00:010
1475623993718,16cyclictest0-21swapper/021:07:530
1475623993713,21cyclictest1581723-21ntpq20:53:100
1475623993628,6cyclictest1755800-21ntpq23:48:030
1475623993628,6cyclictest1755800-21ntpq23:48:030
147562399362,30cyclictest1772081-21taskset00:07:570
147562399362,14cyclictest573-21runrttasks00:12:580
147562399360,12cyclictest1607469-21sshd21:22:250
147562399352,6cyclictest1670633-21ntpq22:23:070
147562399352,11cyclictest1781967-21apt-get00:17:540
147562399351,8cyclictest1766370-40ogrotate00:00:000
147562599349,17cyclictest1486681-21ld19:18:061
1475625993429,3cyclictest1614635-21kthreadcore21:28:031
1475623993426,6cyclictest1696243-21latency_hist22:50:000
1475623993426,6cyclictest1696243-21latency_hist22:50:000
147562399342,10cyclictest1700675-21ntpq22:53:060
1475623993418,14cyclictest1507463-21unixbench_multi19:38:120
147562399341,4cyclictest1747094-21apt-get23:42:550
1475623993414,18cyclictest1702500-21idleruntime22:57:580
1475623993413,17cyclictest1735926-21grep23:28:050
147562399341,12cyclictest1760702-21ntpq23:53:050
147562399341,10cyclictest1571591-21ntpq20:43:100
147562399341,10cyclictest1508177-21/usr/sbin/munin19:42:540
1475632993322,8cyclictest1671466-21cat22:25:012
1475625993329,3cyclictest1766365-21munin-run00:00:001
1475625993325,6cyclictest1776370-21grep00:08:191
147562399339,4cyclictest1543235-21grep20:17:580
147562399337,4cyclictest1582808-21/usr/sbin/munin20:57:530
147562399332,9cyclictest571-21snmpd20:22:550
1475623993327,4cyclictest1642157-21apt-get21:57:510
1475623993324,6cyclictest1621918-21latency_hist21:35:010
147562399331,9cyclictest1652426-21/usr/sbin/munin22:07:580
147562399331,8cyclictest1533239-21/usr/sbin/munin20:07:570
1475623993318,13cyclictest1641521-21unixbench_singl21:53:140
1475623993318,12cyclictest275-21systemd-journal23:31:250
1475623993317,14cyclictest0-21swapper/000:37:570
1475623993315,16cyclictest1606791-21unixbench_multi21:18:140
1475623993314,16cyclictest1795546-21needreboot00:28:050
147562599329,11cyclictest1619579-21ps21:33:021
1475625993228,2cyclictest0-21swapper/122:35:001
1475625993224,2cyclictest161rcu_preempt22:55:001
147562399323,7cyclictest1727308-21apt-get23:22:530
1475623993226,4cyclictest1771668-21latency_hist00:05:010
147562399321,9cyclictest1647091-21apt-get22:02:530
147562399321,9cyclictest1635989-21ntpq21:48:070
147562399321,9cyclictest1635989-21ntpq21:48:070
147562399321,9cyclictest1501627-21kthreadcore19:33:040
147562399321,6cyclictest1552860-21apt-get20:27:550
1475623993214,16cyclictest1657486-21sort22:12:590
1475623993212,18cyclictest401-21dbus-daemon23:05:010
1475623993211,5cyclictest1616235-21ntpq21:28:080
1475623993211,17cyclictest0-21swapper/019:10:010
147562399320,9cyclictest1576609-21/usr/sbin/munin20:48:130
147562399320,9cyclictest1576609-21/usr/sbin/munin20:48:130
147562599318,15cyclictest1655587-21ls22:08:041
1475625993127,3cyclictest1711552-21systemd-run23:05:011
1475625993127,2cyclictest1608248-21irqrtprio21:23:001
1475625993127,2cyclictest1476577-21irqcore19:13:011
147562399318,6cyclictest1675213-21cut22:28:050
147562399311,9cyclictest1725779-21/usr/sbin/munin23:18:050
147562399311,9cyclictest1626118-21ntpq21:38:060
147562399311,9cyclictest1497328-21/usr/sbin/munin19:28:110
1475623993114,14cyclictest0-21swapper/022:17:560
1475623993112,17cyclictest1559656-21kthreadcore20:33:020
147562399311,12cyclictest1516930-21ntpq19:48:080
1475623993110,19cyclictest0-21swapper/020:02:580
1475632993025,3cyclictest1587056-21unixbench_singl20:58:132
1475632993024,4cyclictest1746416-21unixbench_singl23:38:122
147562599308,10cyclictest1800199-21cut00:33:031
147562599307,15cyclictest1725925-21ld23:18:081
147562599306,11cyclictest1770062-21cut00:03:061
147562399303,3cyclictest0-21swapper/020:37:540
1475623993019,9cyclictest1787150-21diskstats00:22:590
147562599298,10cyclictest1628327-21cut21:43:001
1475625992920,6cyclictest1626825-21latency_hist21:40:011
1475625992919,2cyclictest161rcu_preempt22:43:141
1475632992824,2cyclictest1552917-21aten2_r5power_e20:27:552
1475632992823,3cyclictest1505365-21kthreadcore19:38:032
147562599287,10cyclictest1792779-21cut00:28:011
147562599287,10cyclictest1748050-21cut23:43:031
147562599286,6cyclictest1720947-21ntpq23:13:071
147562599283,10cyclictest1546806-21ntpq20:18:081
1475625992825,2cyclictest1574859-21kthreadcore20:48:061
1475625992825,2cyclictest1574859-21kthreadcore20:48:051
1475625992823,4cyclictest1499187-21kthreadcore19:33:021
1475625992820,2cyclictest161rcu_preempt20:35:001
1475625992818,2cyclictest161rcu_preempt19:55:001
147562599281,7cyclictest1597722-21aten2_r5power_p21:12:561
1475625992812,9cyclictest0-21swapper/120:38:031
1475632992723,2cyclictest1791114-21unixbench_multi00:23:142
147563299270,25cyclictest1772998-21kthreadcore00:08:052
1475625992723,3cyclictest1492676-21apt-get19:25:001
1475625992716,8cyclictest1607047-21latency_hist21:20:021
1475625992712,2cyclictest0-21swapper/122:38:031
1475632992623,2cyclictest1682174-21fschecks_count22:37:572
1475632992621,4cyclictest1557577-21kworker/u8:0+flush-8:020:48:132
1475632992621,4cyclictest1557577-21kworker/u8:0+flush-8:020:48:132
147562599268,12cyclictest1633974-21kthreadcore21:48:031
147562599268,12cyclictest1633974-21kthreadcore21:48:031
147562599267,5cyclictest1744187-21cut23:38:011
147562599266,11cyclictest1497894-21latency_hist19:30:011
147562599265,13cyclictest1582168-21unixbench_singl20:53:131
147562599265,10cyclictest1506023-21cut19:38:031
147562599262,5cyclictest0-21swapper/122:18:081
1475625992623,2cyclictest1527441-21cron20:00:001
1475625992622,2cyclictest0-21swapper/100:37:591
1475625992617,7cyclictest1732269-21apt-get23:27:531
1475625992617,3cyclictest161rcu_preempt20:58:031
1475625992610,4cyclictest161rcu_preempt23:47:501
1475625992610,4cyclictest161rcu_preempt23:47:501
1475632992522,2cyclictest1612600-21aten2_r5power_v21:27:562
1475632992519,4cyclictest1502726-21turbostat.cron19:35:002
1475632992517,6cyclictest1681609-21cat22:35:022
1475632992515,7cyclictest1687107-21fschecks_count22:42:592
147562599253,10cyclictest1667157-21expr22:22:571
147562599252,10cyclictest1595838-21kthreadcore21:08:031
1475625992520,4cyclictest1555023-21kthreadcore20:28:031
1475625992520,4cyclictest1532155-21unixbench_multi20:03:131
1475625992519,4cyclictest0-21swapper/123:10:001
147562599251,7cyclictest1731970-21latency_hist23:25:011
147562599250,7cyclictest1534835-21kthreadcore20:08:031
147562599250,6cyclictest1642866-21sed21:57:581
147562599250,15cyclictest1551771-21ntpq20:23:111
147562599250,11cyclictest1567755-21apt-get20:42:561
1475632992421,2cyclictest1666132-21unixbench_multi22:18:132
1475632992420,2cyclictest1606826-21unixbench_multi21:18:142
1475632992420,2cyclictest1577912-21aten2_r5power_e20:52:562
1475632992417,5cyclictest1771529-21cat00:05:012
1475632992417,5cyclictest1656409-21journal-offline22:09:072
1475632992416,6cyclictest1617402-21apt-get21:32:532
1475632992414,8cyclictest1660713-21ntpq22:13:042
147563299240,8cyclictest14845981kthreadcore19:18:022
147562599245,5cyclictest1639198-21cut21:53:031
147562599244,6cyclictest1541505-21netstat20:13:061
147562599242,12cyclictest30-21ksoftirqd/119:45:001
1475625992420,3cyclictest1784136-21kthreadcore00:18:031
1475625992410,7cyclictest0-21swapper/122:58:011
1475625992410,3cyclictest0-21swapper/100:23:031
147562599240,6cyclictest1514033-21ps19:48:011
147562599240,14cyclictest1650853-21ld22:03:051
17362122230,5sleep20-21swapper/223:28:112
16583462230,4sleep1281rcuc/122:13:001
1475632992319,2cyclictest0-21swapper/223:13:062
1475632992318,3cyclictest1756314-21unixbench_singl23:48:102
1475632992318,3cyclictest1756314-21unixbench_singl23:48:102
1475632992317,5cyclictest1616938-21kworker/u8:1+flush-8:021:42:572
1475632992317,4cyclictest1552157-21unixbench_multi20:23:132
1475632992316,5cyclictest1641689-21awk21:54:592
147562599237,5cyclictest0-21swapper/122:47:561
147562599237,5cyclictest0-21swapper/122:47:561
147562599236,2cyclictest161rcu_preempt21:03:071
147562599232,8cyclictest0-21swapper/123:33:011
147562599232,6cyclictest30-21ksoftirqd/122:28:011
1475625992319,2cyclictest0-21swapper/123:53:011
147563299222,14cyclictest1756984-21apt-get23:52:542
1475632992219,2cyclictest1518285-21cpuspeed_turbos19:52:552
1475632992218,2cyclictest1542061-21unixbench_singl20:13:142
1475632992218,2cyclictest0-21swapper/221:48:062
1475632992218,2cyclictest0-21swapper/221:48:062
1475632992212,8cyclictest1477263-21tr19:13:022
14753812229,9sleep20-21swapper/219:09:162
15627752210,6sleep3575-21kworker/3:2+mm_percpu_wq20:37:533
15555942212,6sleep30-21swapper/320:28:053
14887382210,5sleep2371rcuc/219:23:032
147563299212,13cyclictest1508178-21apt-get19:42:552
1475632992118,2cyclictest1588093-21fschecks_time21:02:582
1475632992117,3cyclictest0-21swapper/221:40:002
1475632992117,2cyclictest0-21swapper/221:08:002
1475632992116,4cyclictest1497547-21unixbench_multi19:28:132
147563299203,13cyclictest1526715-21ntpq19:58:072
1475632992017,2cyclictest1712925-21kthreadcore23:08:032
1475632992016,2cyclictest0-21swapper/223:35:002
1475632992015,3cyclictest0-21swapper/222:48:152
1475632992015,3cyclictest0-21swapper/222:48:142
1475632992014,4cyclictest1571992-21unixbench_multi20:43:152
1475632992011,2cyclictest0-21swapper/220:08:132
1475632992010,8cyclictest1542947-21munin-node20:17:532
147563299192,12cyclictest1726591-21apt-get23:20:032
1475632991910,7cyclictest1645568-21tr21:58:012
147563299183,2cyclictest17951511kthreadcore00:28:042
1475632991815,2cyclictest0-21swapper/222:54:592
1475632991814,2cyclictest1785630-21needreboot00:18:052
1475632991812,4cyclictest0-21swapper/220:32:592
147563299181,12cyclictest1796790-21apt-get00:32:542
14708362186,7sleep30-21swapper/319:05:113
147563299178,7cyclictest1779820-21tr00:13:072
147563299178,7cyclictest1532408-21awk20:05:002
1475632991713,2cyclictest1750779-21needreboot23:43:052
147563299171,12cyclictest1671807-21apt-get22:27:562
147563299168,6cyclictest1597702-21cut21:12:562
147563299162,2cyclictest0-21swapper/222:04:222
147563299162,13cyclictest0-21swapper/223:01:422
1475632991612,2cyclictest0-21swapper/219:47:552
15328692152,9sleep30-21swapper/320:07:543
147563299153,7cyclictest1566595-21ntpq20:38:082
147563299152,12cyclictest0-21swapper/200:36:132
1475632991512,1cyclictest0-21swapper/221:21:542
1475632991510,3cyclictest1703353-21kthreadcore22:58:012
17869052145,6sleep30-21swapper/300:22:573
17765832132,6sleep30-21swapper/300:10:013
16654432132,7sleep30-21swapper/322:18:043
16359862132,7sleep30-21swapper/321:48:073
16359862132,7sleep30-21swapper/321:48:073
16063952132,7sleep30-21swapper/321:18:103
15792202132,8sleep30-21swapper/320:53:043
15084232132,7sleep30-21swapper/319:42:583
18012462122,5sleep30-21swapper/300:35:013
17704342122,6sleep30-21swapper/300:03:073
17657282122,6sleep30-21swapper/323:58:103
17459562122,6sleep30-21swapper/323:38:083
17216442122,5sleep30-21swapper/323:15:013
17021352122,6sleep30-21swapper/322:57:563
16962132123,6sleep30-21swapper/322:49:503
16962132123,6sleep30-21swapper/322:49:503
16906892122,6sleep30-21swapper/322:43:123
16856062122,6sleep30-21swapper/322:38:063
16705272122,6sleep30-21swapper/322:23:063
16372202122,6sleep30-21swapper/321:52:573
16268582122,5sleep30-21swapper/321:40:013
16258192123,6sleep30-21swapper/321:38:043
16080242122,6sleep30-21swapper/321:23:013
15876792122,6sleep30-21swapper/321:02:263
15686422122,6sleep30-21swapper/320:43:053
15474952122,5sleep30-21swapper/320:20:013
15427242122,6sleep30-21swapper/320:15:043
15227632122,6sleep30-21swapper/319:55:263
15223452122,6sleep30-21swapper/319:53:133
14883722122,6sleep30-21swapper/319:23:003
17965862112,5sleep30-21swapper/300:30:363
17916742113,5sleep30-21swapper/300:26:113
17818352113,5sleep30-21swapper/300:16:353
17723292112,5sleep30-21swapper/300:08:013
17567402112,6sleep30-21swapper/323:50:043
17564412112,5sleep30-21swapper/323:49:163
17564412112,5sleep30-21swapper/323:49:153
17509122112,5sleep30-21swapper/323:43:093
17370442112,5sleep30-21swapper/323:31:113
17362832112,5sleep30-21swapper/323:28:133
17272622112,5sleep30-21swapper/323:22:353
17170672112,6sleep30-21swapper/323:11:403
17125062112,5sleep30-21swapper/323:08:033
17114302112,6sleep30-21swapper/323:03:583
16967152112,6sleep30-21swapper/322:50:183
16772202112,5sleep30-21swapper/322:33:013
16729362112,5sleep30-21swapper/322:28:033
16567182112,5sleep30-21swapper/322:10:063
16520212112,5sleep30-21swapper/322:07:533
16469962112,6sleep30-21swapper/322:01:593
16419652112,6sleep30-21swapper/321:55:423
16172432113,5sleep30-21swapper/321:31:103
16156592112,5sleep30-21swapper/321:28:053
15974422112,6sleep30-21swapper/321:10:403
15952042112,5sleep30-21swapper/321:08:043
15827002112,6sleep30-21swapper/320:56:483
15722272112,5sleep30-21swapper/320:45:013
15722272112,5sleep30-21swapper/320:45:013
15381402112,5sleep30-21swapper/320:12:593
15277312113,5sleep30-21swapper/320:00:353
15130272112,5sleep30-21swapper/319:47:073
15029772113,5sleep30-21swapper/319:35:203
14980272112,5sleep30-21swapper/319:30:063
14932702112,6sleep30-21swapper/319:27:263
14827032112,6sleep30-21swapper/319:15:343
14793922112,5sleep30-21swapper/319:13:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional