You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 20:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun Sep 20, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
195145221440,5sleep20-21swapper/212:29:152
18113442620,5sleep30-21swapper/310:09:163
1630620995642,10cyclictest278-21systemd-journal12:35:001
1630624995544,8cyclictest1897371-21cp11:35:012
1630624995042,6cyclictest278-21systemd-journal08:05:002
1630620995044,4cyclictest1799960-21kworker/u8:2+events_unbound10:15:011
1630620995041,6cyclictest278-21systemd-journal08:14:091
1630620995039,9cyclictest1701557-21ntpq08:19:111
1630620994839,7cyclictest1751992-21latency_hist09:10:011
1630620994742,4cyclictest266364-21kworker/u8:1+flush-8:008:04:021
1630620994741,5cyclictest1742628-21/usr/sbin/munin09:04:091
1630617994740,5cyclictest1635537-21latency_hist07:15:010
1630620994640,4cyclictest1647568-21apt-get07:25:001
1630620994638,6cyclictest1757459-21/usr/sbin/munin09:19:141
1630620994637,7cyclictest1906396-21ntpq11:44:091
1630620994636,6cyclictest278-21systemd-journal08:24:101
1630617994637,7cyclictest1891324-21ntpq11:29:070
1630620994537,6cyclictest278-21systemd-journal09:24:091
1630620994536,7cyclictest1802292-21apt-get10:03:561
1630620994437,5cyclictest266364-21kworker/u8:1+flush-8:007:29:161
1630617994438,4cyclictest266364-21kworker/u8:1+flush-8:007:59:010
1630620994338,3cyclictest1877250-21kworker/u8:0+flush-8:012:39:161
1630620994336,5cyclictest1620924-21kworker/u8:0+flush-8:008:34:161
1630620994237,4cyclictest1620924-21kworker/u8:0+events_unbound07:44:011
1630620994235,5cyclictest1877250-21kworker/u8:0+events_unbound12:24:091
1630620994231,9cyclictest1951184-21ntpq12:29:101
1630617994232,7cyclictest1732165-21latency_hist08:50:010
163061799420,39cyclictest1-21systemd11:40:000
19138882410,3sleep0201rcuc/011:54:060
1630620994136,4cyclictest1877250-21kworker/u8:0+flush-8:011:39:001
1630620994135,5cyclictest1791844-21kworker/u8:1+flush-8:011:14:131
1630620994134,6cyclictest1677715-21kworker/u8:2+events_unbound08:29:111
1630620994133,6cyclictest278-21systemd-journal10:25:001
1630624994034,5cyclictest1742361-21kworker/u8:1+flush-8:009:19:132
1630620994034,4cyclictest1902350-21kworker/u8:2+events_unbound12:15:001
1630620994031,6cyclictest278-21systemd-journal10:57:091
1630620993934,4cyclictest1799960-21kworker/u8:2+flush-8:011:04:071
1630620993934,4cyclictest1762116-21kworker/u8:4+events_unbound10:29:141
1630620993934,3cyclictest1620924-21kworker/u8:0+flush-8:007:49:161
1630620993932,5cyclictest1851624-21apt-get10:50:001
1630620993932,5cyclictest1712750-21kworker/u8:1+flush-8:008:54:101
1630617993932,4cyclictest1777002-21latency_hist09:35:000
1630617993931,6cyclictest1796783-21latency_hist09:55:010
1630617993930,7cyclictest278-21systemd-journal12:15:000
1630620993833,4cyclictest1737365-21kworker/u8:3+flush-8:009:14:171
1630620993832,4cyclictest266364-21kworker/u8:1+events_unbound07:19:051
1630620993832,4cyclictest1831925-21apt-get10:33:571
1630620993830,6cyclictest1677715-21kworker/u8:2+flush-8:009:49:141
1630617993831,5cyclictest1847244-21apt-get10:48:570
1630620993731,5cyclictest1762116-21kworker/u8:4+flush-8:010:39:141
1630620993729,6cyclictest1762116-21kworker/u8:4+flush-8:011:24:111
1630620993727,7cyclictest278-21systemd-journal12:09:091
1630617993730,5cyclictest1812135-21/usr/sbin/munin10:14:080
1630624993631,3cyclictest1762116-21kworker/u8:4+events_unbound10:10:012
1630620993623,10cyclictest1762116-21kworker/u8:4+flush-8:011:09:111
1630617993632,3cyclictest1902350-21kworker/u8:2+flush-8:011:44:170
1630617993626,8cyclictest1871713-21cp11:10:000
1630620993530,4cyclictest1910326-21kworker/u8:1+events_unbound11:49:151
1630620993529,4cyclictest1912559-21apt-get11:53:581
1630620993529,4cyclictest1762116-21kworker/u8:4+flush-8:011:19:061
1630620993527,6cyclictest1887582-21apt-get11:28:551
1630620993526,7cyclictest1762116-21kworker/u8:4+flush-8:009:54:131
1630617993530,3cyclictest266364-21kworker/u8:1+flush-8:007:24:120
1630617993529,4cyclictest1902350-21kworker/u8:2+events_unbound12:04:050
1630617993526,7cyclictest1921881-21latency_hist12:00:010
1630624993427,5cyclictest808610-21kworker/u8:4+events_unbound07:54:142
1630620993429,3cyclictest1791844-21kworker/u8:1+flush-8:010:09:071
1630620993427,5cyclictest1902350-21kworker/u8:2+flush-8:012:04:001
1630620993427,5cyclictest1687953-21apt-get08:08:571
1630620993427,5cyclictest1687953-21apt-get08:08:571
163062099341,30cyclictest1-21systemd09:59:091
163061799341,30cyclictest1642432-21munin-run07:20:010
1630624993329,2cyclictest1752578-21aten2_r5power_c09:13:592
1630624993328,3cyclictest1732747-21aten2_r5power_c08:53:592
1630624993324,7cyclictest1702325-21cp08:20:012
1630620993329,3cyclictest1799960-21kworker/u8:2+flush-8:010:54:131
1630620993328,3cyclictest1726511-21needreboot08:44:091
1630617993323,7cyclictest1841506-21apt-get10:40:010
1630620993227,4cyclictest1620924-21kworker/u8:0+flush-8:008:39:041
1630620993226,4cyclictest1620924-21kworker/u8:0+events_unbound08:49:061
1630620993222,7cyclictest1877250-21kworker/u8:0+flush-8:011:58:591
1630617993226,4cyclictest1801712-21cron10:00:000
1630617993226,4cyclictest1791844-21kworker/u8:1+events_unbound11:00:000
163061799320,30cyclictest1-21systemd09:49:090
1630624993127,3cyclictest1677715-21kworker/u8:2+events_unbound09:34:102
1630620993125,4cyclictest1762116-21kworker/u8:4+flush-8:010:19:071
1630620993125,4cyclictest1620924-21kworker/u8:0+flush-8:007:39:071
1630620993124,5cyclictest1902350-21kworker/u8:2+flush-8:012:19:091
1630617993126,4cyclictest1742361-21kworker/u8:1+events_unbound09:29:160
1630617993126,4cyclictest1742361-21kworker/u8:1+events_unbound09:29:160
1630617993122,7cyclictest1620924-21kworker/u8:0+flush-8:008:34:140
16258402313,8sleep10-21swapper/107:05:461
1630624993021,7cyclictest1657712-21turbostat.cron07:35:002
1630620993025,3cyclictest1631672-21irqcore07:14:081
1630620993019,8cyclictest1677472-21cron07:55:001
1630617993023,5cyclictest1791844-21kworker/u8:1+events_unbound11:10:020
1630624992925,3cyclictest1799960-21kworker/u8:2+flush-8:009:59:162
1630624992925,2cyclictest1912778-21cpuspeed_turbos11:54:002
1630624992924,3cyclictest1777584-21aten2_r5power_c09:38:592
1630620992923,4cyclictest1772057-21kworker/u8:0+flush-8:009:44:141
1630620992922,5cyclictest278-21systemd-journal07:31:101
1630620992918,8cyclictest278-21systemd-journal10:45:001
1630617992919,8cyclictest1662049-21ntpq07:39:090
1630624992823,3cyclictest1937553-21aten2_r5power_e12:19:022
1630620992823,4cyclictest1762116-21kworker/u8:4+flush-8:011:34:001
1630620992823,3cyclictest266364-21kworker/u8:1+events_unbound07:58:581
1630620992822,3cyclictest1737365-21kworker/u8:3+events_unbound08:59:061
1630617992823,3cyclictest1882032-21sendmail11:20:000
1630617992822,4cyclictest1762116-21kworker/u8:4+flush-8:010:19:100
1630617992821,5cyclictest1952929-21sort12:34:040
163061799281,21cyclictest1630503-21kworker/0:2+events07:53:150
18562502270,5sleep20-21swapper/210:54:132
1630624992723,3cyclictest1737365-21kworker/u8:3+flush-8:008:55:312
1630624992723,2cyclictest1762793-21fschecks_time09:24:022
1630620992723,3cyclictest1762116-21kworker/u8:4+flush-8:009:29:021
1630620992723,3cyclictest1762116-21kworker/u8:4+flush-8:009:29:021
163061799276,16cyclictest1861767-21kworker/0:2+events11:01:350
1630617992723,2cyclictest1802378-21aten2_r5power_p10:03:580
1630617992722,4cyclictest1677715-21kworker/u8:2+flush-8:008:59:150
1630617992722,3cyclictest1761886-21sendmail09:20:000
1630617992722,3cyclictest0-21swapper/012:30:000
1630617992720,5cyclictest1791844-21kworker/u8:1+flush-8:010:34:070
1630617992718,7cyclictest278-21systemd-journal08:10:000
1630617992718,7cyclictest278-21systemd-journal08:10:000
1630624992622,3cyclictest1932841-21fschecks_count12:14:012
1630624992622,2cyclictest1718136-21fschecks_count08:39:042
1630624992622,2cyclictest1706701-21needreboot08:24:092
1630620992619,4cyclictest0-21swapper/109:39:111
1630617992621,4cyclictest1877250-21kworker/u8:0+flush-8:012:39:210
1630617992621,3cyclictest1656416-21runrttasks07:34:070
1630617992620,5cyclictest1762116-21kworker/u8:4+flush-8:009:39:100
1630617992619,5cyclictest278-21systemd-journal07:50:000
1630624992522,2cyclictest1815847-21needreboot10:14:082
1630624992521,3cyclictest1957391-21aten2_r5power_v12:39:022
1630624992521,2cyclictest1822114-21aten2_r5power_e10:24:002
1630624992521,2cyclictest1727820-21aten2_r5power_e08:49:012
1630624992521,2cyclictest1631299-21cpuspeed_turbos07:14:032
163061799257,17cyclictest1682486-21kworker/0:0+events09:44:110
163061799253,21cyclictest1682486-21kworker/0:0+events08:44:190
1630617992520,3cyclictest1722161-21unixbench_singl08:39:200
163061799251,23cyclictest1861767-21kworker/0:2+events11:24:110
1630624992421,2cyclictest1772036-21basename09:30:002
1630624992421,2cyclictest1772036-21basename09:30:002
1630624992420,3cyclictest1877691-21aten2_r5power_v11:19:012
1630624992420,3cyclictest1668506-21fschecks_time07:49:002
1630624992420,2cyclictest1643387-21cpuspeed_turbos07:24:002
1630624992414,8cyclictest1851795-21cat10:50:002
1630620992418,5cyclictest1762116-21kworker/u8:4+flush-8:009:30:351
163061799246,17cyclictest1682486-21kworker/0:0+events08:54:080
163061799245,18cyclictest1682486-21kworker/0:0+events10:24:230
163061799242,16cyclictest576-21runrttasks10:28:570
1630617992420,3cyclictest1677715-21kworker/u8:2+flush-8:009:23:410
1630617992420,2cyclictest0-21swapper/008:04:130
1630617992419,4cyclictest266364-21kworker/u8:1+events_unbound07:29:080
1630617992417,5cyclictest1877250-21kworker/u8:0+flush-8:012:09:090
163061799240,10cyclictest18562532grep10:54:140
163062499232,19cyclictest1806550-21grep10:04:162
1630624992320,2cyclictest1722936-21aten2_r5power_v08:44:002
1630624992318,4cyclictest1791833-21idleruntime-cro09:50:002
163061799232,4cyclictest0-21swapper/011:34:250
1630617992318,4cyclictest1902350-21kworker/u8:2+events_unbound12:19:120
1630617992318,3cyclictest838-21mta-sts-daemon11:49:060
1630617992318,3cyclictest1846608-21unixbench_singl10:44:180
1630617992315,6cyclictest1756927-21latency_hist09:15:010
1630617992315,6cyclictest1712359-21latency_hist08:30:010
163061799231,21cyclictest1682486-21kworker/0:0+events09:09:110
1630617992310,11cyclictest0-21swapper/008:20:010
17124112220,3chrt75-21kworker/3:1-events08:30:023
1630624992219,2cyclictest1663341-21aten2_r5power_e07:44:002
1630624992218,3cyclictest1832143-21cpuspeed_turbos10:34:002
1630624992218,2cyclictest1887847-21fschecks_count11:28:592
1630624992215,5cyclictest1620924-21kworker/u8:0+events_unbound07:20:012
163061799226,15cyclictest1630503-21kworker/0:2+events07:43:590
163061799223,18cyclictest1861767-21kworker/0:2+events12:24:070
1630617992218,2cyclictest1706718-21needreboot08:24:090
1630617992217,3cyclictest1697089-21unixbench_multi08:14:170
1630617992215,5cyclictest1791844-21kworker/u8:1+flush-8:010:09:100
163062499212,13cyclictest1820942-21ntpq10:19:132
1630624992118,2cyclictest1712969-21aten2_r5power_e08:34:002
1630624992117,3cyclictest0-21swapper/212:04:172
1630624992117,3cyclictest0-21swapper/209:04:172
163062499211,5cyclictest1795729-21tr09:54:082
1630624992114,5cyclictest1931772-21apt-get12:10:002
1630624992113,6cyclictest278-21systemd-journal11:00:002
1630617992116,3cyclictest0-21swapper/007:10:010
19167482200,5chrt0-21swapper/311:54:173
17426272202,1sleep00-21swapper/009:03:580
1630624992016,2cyclictest1867527-21fschecks_count11:09:022
1630624992016,2cyclictest0-21swapper/211:59:132
1630624992016,2cyclictest0-21swapper/209:10:012
1630624992013,5cyclictest0-21swapper/211:15:012
163062499200,18cyclictest1650201-21tr07:29:062
16258722206,10sleep20-21swapper/207:06:102
19365622197,8sleep30-21swapper/312:14:163
1630624991916,2cyclictest1827048-21aten2_r5power_e10:28:592
1630624991915,2cyclictest0-21swapper/207:59:172
1630624991914,3cyclictest0-21swapper/210:40:002
163062499190,3cyclictest16600222cat07:39:062
16260562192,11sleep30-21swapper/307:08:323
163062499188,2cyclictest0-21swapper/208:30:012
163062499183,2cyclictest18990901kthreadcore11:39:062
163062499183,13cyclictest1846693-21latency_hist10:45:002
1630624991812,4cyclictest0-21swapper/209:44:112
1630624991811,5cyclictest0-21swapper/211:23:592
1630624991810,6cyclictest1691258-21tr08:09:082
1630624991810,6cyclictest1691258-21tr08:09:082
163062499179,6cyclictest1863813-21tr11:04:062
1630624991713,2cyclictest1902894-21cpuspeed_turbos11:44:002
1630624991713,2cyclictest0-21swapper/212:34:042
163062499171,12cyclictest1692886-21apt-get08:13:582
163062499167,7cyclictest1908395-21sed11:49:052
163062499162,2cyclictest0-21swapper/212:24:392
16731062152,9sleep30-21swapper/307:53:593
18759882142,8sleep30-21swapper/311:14:093
16933752143,7sleep30-21swapper/308:14:053
19445652132,7sleep30-21swapper/312:24:073
19264882130,2sleep375-21kworker/3:1-events12:04:163
18716032132,7sleep30-21swapper/311:10:003
18578432132,7sleep30-21swapper/310:59:053
17222362132,6sleep30-21swapper/308:40:013
16973862132,6sleep30-21swapper/308:15:013
16576992132,6sleep30-21swapper/307:35:013
16467812132,7sleep30-21swapper/307:24:093
19518102122,5sleep30-21swapper/312:30:013
19076632122,6sleep30-21swapper/311:49:003
18976852122,6sleep30-21swapper/311:38:573
18828652122,6sleep30-21swapper/311:24:003
18784612122,6sleep30-21swapper/311:19:073
18617722122,6sleep30-21swapper/311:00:013
18561272122,6sleep30-21swapper/310:54:113
18426562122,6sleep30-21swapper/310:44:043
18363582122,5sleep30-21swapper/310:35:013
18359142122,6sleep30-21swapper/310:34:173
18292592122,6sleep30-21swapper/310:29:073
18116262122,6sleep30-21swapper/310:10:013
18027702122,6sleep30-21swapper/310:04:033
17927632122,6sleep30-21swapper/309:54:043
17913092122,6sleep30-21swapper/309:49:153
17864572122,6sleep30-21swapper/309:44:183
17627282122,6sleep30-21swapper/309:24:033
17577352123,5sleep30-21swapper/309:19:013
17470462122,6sleep30-21swapper/309:05:013
17431132122,6sleep30-21swapper/309:04:053
17414222122,6sleep30-21swapper/308:59:113
17237402122,6sleep30-21swapper/308:44:063
17143402122,6sleep30-21swapper/308:34:073
16824302122,5sleep30-21swapper/308:00:013
16724732122,6sleep30-21swapper/307:49:173
16522132122,6sleep30-21swapper/307:29:153
16358392122,6sleep30-21swapper/307:15:023
19570242112,6sleep30-21swapper/312:36:033
19476282112,5sleep30-21swapper/312:29:013
19372172112,6sleep30-21swapper/312:15:493
19273652112,6sleep30-21swapper/312:08:583
19172842112,6sleep30-21swapper/311:56:363
19065592112,6sleep30-21swapper/311:44:153
18922682112,6sleep30-21swapper/311:30:473
18875912112,5sleep30-21swapper/311:28:583
18469992113,5sleep30-21swapper/310:46:093
18218862112,6sleep30-21swapper/310:22:093
18168502112,6sleep30-21swapper/310:16:073
17772502112,6sleep30-21swapper/309:35:223
17722702112,6sleep30-21swapper/309:30:093
17522222112,6sleep30-21swapper/309:10:073
17324502112,6sleep30-21swapper/308:50:523
17274302112,5sleep30-21swapper/308:45:033
17026892112,5sleep30-21swapper/308:20:073
16877942112,6sleep30-21swapper/308:07:153
16877942112,6sleep30-21swapper/308:07:153
16827122112,6sleep30-21swapper/308:00:213
16630602112,6sleep30-21swapper/307:41:273
16580012112,6sleep30-21swapper/307:35:533
16310842112,5sleep30-21swapper/307:14:023
17970162102,5sleep30-21swapper/309:55:093
17673272102,5sleep30-21swapper/309:25:033
17673272102,5sleep30-21swapper/309:25:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional