You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 11:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Thu May 07, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19112992860,2chrt0-21swapper/223:41:042
1637769996657,6cyclictest1753708-21latency_hist21:05:010
1637773996357,4cyclictest1848107-21apt-get22:40:021
1637769996156,3cyclictest1714098-21kworker/u8:1+flush-8:023:11:010
1637769996152,7cyclictest280-21systemd-journal23:20:010
16419162600,1chrt1641919-21proc_pri19:11:130
1637774996050,8cyclictest280-21systemd-journal19:36:152
1637769996054,4cyclictest1848107-21apt-get22:40:010
1637769995952,5cyclictest280-21systemd-journal19:41:160
1637769995849,7cyclictest1779009-21apt-get21:30:550
1637769995750,6cyclictest1694082-21kworker/u8:3+flush-8:020:36:060
1637769995747,8cyclictest1848928-21diskstats22:40:590
17022992530,6sleep30-21swapper/320:11:073
1637773995347,4cyclictest1813610-21apt-get22:05:561
1637773995345,6cyclictest1913656-21apt-get23:45:561
1637774995246,4cyclictest280-21systemd-journal22:00:002
1637774995246,4cyclictest1928133-40logrotate00:00:002
1637769995142,6cyclictest1808362-21latency_hist22:00:010
1637773995042,6cyclictest1888559-21base6423:20:011
1637774994843,4cyclictest1642660-21kworker/u8:1+flush-8:019:56:082
1637773994841,4cyclictest1958624-21apt-get00:30:551
1637773994739,6cyclictest1842942-21apt-get22:35:011
163776999471,44cyclictest1-21systemd19:59:590
1637773994638,6cyclictest1773525-21latency_hist21:25:011
1637769994539,4cyclictest1714098-21kworker/u8:1+events_unbound22:26:030
1637769994538,4cyclictest1758931-21kworker/u8:0+flush-8:021:41:010
1637773994436,6cyclictest1888242-21store23:20:011
1637769994440,3cyclictest1642660-21kworker/u8:1+flush-8:019:36:140
1637769994436,6cyclictest1958070-21apt-get00:30:000
1637769994435,6cyclictest280-21systemd-journal00:10:010
1637774994338,4cyclictest1729202-21kworker/u8:2+flush-8:022:56:142
1637774994338,3cyclictest1758931-21kworker/u8:0+flush-8:021:11:172
1637773994336,5cyclictest1918564-21/usr/sbin/munin23:51:141
1637773994332,8cyclictest1762785-21ntpq21:11:111
1637769994338,4cyclictest1642660-21kworker/u8:1+flush-8:019:51:140
1637769994333,8cyclictest1918838-21diskstats23:50:580
1637773994236,4cyclictest1933430-21apt-get00:05:571
1637773994231,8cyclictest280-21systemd-journal00:13:341
1637769994235,6cyclictest801828-21kworker/u8:2+flush-8:019:15:030
1637769994234,5cyclictest1918271-21latency_hist23:50:010
1637773994132,7cyclictest280-21systemd-journal00:40:001
1637773994132,7cyclictest1783963-21apt-get21:35:541
1637773994132,6cyclictest1843493-21apt-get22:35:561
1637773994131,8cyclictest280-21systemd-journal23:09:591
1637769994135,4cyclictest1903746-21apt-get23:35:560
1637769994134,5cyclictest801828-21kworker/u8:2+flush-8:019:46:130
1637769994133,6cyclictest801828-21kworker/u8:2+flush-8:019:26:010
1637773994032,6cyclictest1953481-21apt-get00:25:551
1637773994031,6cyclictest280-21systemd-journal23:11:361
1637769994033,5cyclictest1754029-21apt-get21:05:570
16374882408,20sleep10-21swapper/119:08:341
16373952404,32sleep20-21swapper/219:07:232
1637774993934,3cyclictest1758931-21kworker/u8:0+flush-8:021:36:072
1637773993933,4cyclictest1714098-21kworker/u8:1+events_unbound22:21:161
1637773993930,7cyclictest280-21systemd-journal19:19:321
1637773993930,6cyclictest1858254-21latency_hist22:50:011
1637773993927,9cyclictest1708025-21ntpq20:16:081
1637769993934,3cyclictest1729202-21kworker/u8:2+events_unbound21:21:070
1637769993933,4cyclictest1778452-21apt-get21:30:010
1637769993932,6cyclictest1758931-21kworker/u8:0+flush-8:021:16:150
1637774993831,5cyclictest280-21systemd-journal22:40:002
1637774993831,5cyclictest280-21systemd-journal21:10:002
1637774993827,8cyclictest280-21systemd-journal21:16:362
1637773993833,4cyclictest801828-21kworker/u8:2+flush-8:019:31:151
1637769993834,3cyclictest1729202-21kworker/u8:2+events_unbound22:11:130
1637769993833,4cyclictest801828-21kworker/u8:2+flush-8:020:01:140
1637769993831,5cyclictest1714098-21kworker/u8:1+flush-8:023:06:010
1637773993731,4cyclictest1928467-21apt-get00:00:571
1637769993733,3cyclictest1758931-21kworker/u8:0+events_unbound22:24:370
1637769993731,4cyclictest1898196-21kworker/u8:3+flush-8:000:06:170
1637769993730,5cyclictest280-21systemd-journal20:12:320
1637774993628,6cyclictest280-21systemd-journal20:23:332
1637774993626,7cyclictest280-21systemd-journal19:25:012
1637773993629,6cyclictest1729202-21kworker/u8:2+flush-8:022:16:141
1637773993629,6cyclictest1729202-21kworker/u8:2+flush-8:022:16:141
163776999360,33cyclictest1-21systemd23:30:010
1637774993527,6cyclictest280-21systemd-journal22:50:012
1637773993529,4cyclictest1679234-21kworker/u8:0+flush-8:020:21:071
1637773993528,5cyclictest801828-21kworker/u8:2+flush-8:019:26:131
1637773993526,7cyclictest1699341-21apt-get20:10:571
1637773993525,8cyclictest1893303-21apt-get23:25:011
1637773993524,8cyclictest1683303-21ntpq19:51:091
1637769993530,4cyclictest1928388-21kworker/u8:2+flush-8:000:01:170
1637774993429,4cyclictest1642660-21kworker/u8:1+flush-8:019:26:142
1637774993425,7cyclictest280-21systemd-journal21:00:012
1637773993427,5cyclictest1793876-21apt-get21:45:551
1637769993429,4cyclictest1898196-21kworker/u8:3+flush-8:023:56:010
1637769993428,4cyclictest1758931-21kworker/u8:0+flush-8:022:51:040
1637769993424,8cyclictest1875982-21kworker/u8:0+flush-8:023:21:060
1637769993423,9cyclictest1813859-21diskstats22:06:020
1637773993325,5cyclictest1773838-21apt-get21:25:561
1637773993323,8cyclictest1714163-21/usr/sbin/munin20:26:081
1637773993323,8cyclictest1714163-21/usr/sbin/munin20:26:081
1637773993228,3cyclictest1868117-21cron23:00:001
1637773993227,4cyclictest801828-21kworker/u8:2+flush-8:019:46:011
1637773993225,5cyclictest1694383-21apt-get20:05:561
1637769993227,3cyclictest1813277-21cron22:05:000
1637769993225,5cyclictest1729202-21kworker/u8:2+flush-8:022:56:110
1637774993127,3cyclictest1694082-21kworker/u8:3+events_unbound20:26:112
1637774993127,3cyclictest1694082-21kworker/u8:3+events_unbound20:26:112
1637774993126,3cyclictest1605894-21kworker/u8:0+flush-8:019:15:062
1637774993120,8cyclictest1948212-21awk00:20:002
1637773993128,2cyclictest1953185-21systemd-run00:25:001
1637773993126,4cyclictest1642660-21kworker/u8:1+events_unbound19:36:001
1637773993124,5cyclictest280-21systemd-journal22:01:361
1637769993126,4cyclictest1928388-21kworker/u8:2+flush-8:000:21:150
1637769993125,4cyclictest1928388-21kworker/u8:2+flush-8:000:36:010
1637769993124,5cyclictest1714098-21kworker/u8:1+flush-8:020:51:110
1637769993124,5cyclictest1694082-21kworker/u8:3+events_unbound20:41:140
1637774993022,6cyclictest1828965-21tr22:21:022
1637773993025,4cyclictest1729202-21kworker/u8:2+events_unbound21:05:591
1637773993025,4cyclictest1694082-21kworker/u8:3+events_unbound20:41:111
1637773993024,5cyclictest1898196-21kworker/u8:3+events_unbound23:56:131
1637773993020,7cyclictest1837097-21ntpq22:26:071
1637769993023,4cyclictest1928388-21kworker/u8:2+flush-8:000:31:000
1637769993021,6cyclictest1637609-21latency_hist19:10:010
1637774992925,2cyclictest1674711-21aten2_r5power_p19:45:572
1637774992923,4cyclictest1862834-21unixbench_singl22:51:152
1637774992922,5cyclictest1778708-21gpgv21:30:012
1637769992924,3cyclictest1694082-21kworker/u8:3+events_unbound20:56:110
1637769992924,2cyclictest0-21swapper/021:55:000
1637769992923,4cyclictest1729202-21kworker/u8:2+events_unbound20:45:580
1637769992923,4cyclictest1679234-21kworker/u8:0+flush-8:020:15:580
1637769992919,8cyclictest1713000-21ntpq20:21:110
1637774992824,2cyclictest1823720-21cpuspeed_turbos22:15:582
1637774992824,2cyclictest1823720-21cpuspeed_turbos22:15:582
1637774992822,4cyclictest1922811-21unixbench_multi23:51:162
1637774992820,5cyclictest280-21systemd-journal23:25:002
1637773992825,2cyclictest1863165-21ls22:55:001
1637773992823,3cyclictest1948205-21cron00:20:001
1637773992820,6cyclictest1728727-21apt-get20:40:011
1637769992824,3cyclictest1729202-21kworker/u8:2+flush-8:022:34:060
1637769992823,2cyclictest0-21swapper/000:20:000
1637769992821,5cyclictest1714098-21kworker/u8:1+flush-8:023:05:010
163776999281,25cyclictest1908670-21sshd23:40:360
1637774992724,2cyclictest1789000-21aten2_r5power_e21:40:582
1637773992722,4cyclictest1729202-21kworker/u8:2+events_unbound21:31:151
1637773992722,3cyclictest1764153-21cpuspeed_turbos21:15:581
1637773992722,3cyclictest1744396-21cpuspeed_turbos20:55:591
1637769992722,3cyclictest1714098-21kworker/u8:1+flush-8:022:46:020
1637769992721,4cyclictest801828-21kworker/u8:2+events_unbound19:21:140
1637769992719,5cyclictest1788610-21latency_hist21:40:010
1637774992622,3cyclictest801828-21kworker/u8:2+flush-8:019:11:142
1637774992622,2cyclictest1660085-21fschecks_time19:31:022
1637774992621,3cyclictest1952763-21unixbench_multi00:21:172
1637774992616,3cyclictest801828-21kworker/u8:2+events_unbound19:41:122
1637773992623,2cyclictest1823203-21systemd-run22:15:001
1637773992622,2cyclictest0-21swapper/120:46:081
1637773992621,4cyclictest801828-21kworker/u8:2+events_unbound20:01:011
1637773992621,4cyclictest1694082-21kworker/u8:3+flush-8:020:50:591
1637773992620,5cyclictest1694082-21kworker/u8:3+flush-8:020:31:041
1637773992617,7cyclictest1898765-21/usr/sbin/munin23:31:101
1637769992622,3cyclictest1679234-21kworker/u8:0+events_unbound20:06:110
1637769992621,3cyclictest1714098-21kworker/u8:1+events_unbound23:35:010
17928882250,2sleep1281rcuc/121:41:141
1637774992522,2cyclictest1942663-21unixbench_singl00:11:152
1637774992520,4cyclictest1758931-21kworker/u8:0+events_unbound21:45:132
1637773992519,4cyclictest1758931-21kworker/u8:0+flush-8:021:54:411
1637773992519,4cyclictest1688171-21needreboot19:56:051
1637773992517,6cyclictest1641789-21ntpq19:11:091
1637773992517,5cyclictest1908384-21latency_hist23:40:011
1637769992521,3cyclictest1758931-21kworker/u8:0+flush-8:021:46:140
1637769992520,4cyclictest1694082-21kworker/u8:3+flush-8:020:31:160
1637769992520,3cyclictest20977-21cron21:15:000
1637774992421,2cyclictest1898074-21unixbench_multi23:26:152
1637774992421,2cyclictest1779298-21fschecks_count21:31:002
1637774992419,4cyclictest1812943-21unixbench_singl22:01:172
1637774992419,4cyclictest0-21swapper/223:40:002
1637774992416,6cyclictest280-21systemd-journal00:40:002
1637774992416,6cyclictest1958325-21gpgv00:30:012
1637773992419,3cyclictest0-21swapper/122:00:001
1637773992418,4cyclictest0-21swapper/119:25:001
163777399241,21cyclictest1-21systemd23:00:361
16954702230,2sleep20-21swapper/220:06:052
1637774992319,2cyclictest1868724-21fschecks_count23:01:012
1637774992318,3cyclictest1693708-21unixbench_singl20:01:162
1637774992317,4cyclictest1882595-21unixbench_singl23:11:172
1637774992314,7cyclictest1888105-21turbostat.cron23:20:002
1637774992314,7cyclictest1728837-21cp20:40:012
1637773992318,4cyclictest1898196-21kworker/u8:3+events_unbound23:41:151
1637769992313,7cyclictest1694082-21kworker/u8:3+flush-8:020:26:090
1637769992313,7cyclictest1694082-21kworker/u8:3+flush-8:020:26:090
1637774992219,2cyclictest1704381-21aten2_r5power_p20:15:582
1637774992216,4cyclictest1877607-21unixbench_multi23:06:162
1637773992218,2cyclictest0-21swapper/121:01:021
1637773992215,5cyclictest280-21systemd-journal19:44:321
1637774992116,4cyclictest1758931-21kworker/u8:0+flush-8:022:05:412
1637774992116,3cyclictest1841858-21wc22:31:072
1637774992116,3cyclictest1753314-21unixbench_multi21:01:162
1637769992112,7cyclictest1663476-21ntpq19:31:090
163777499202,12cyclictest1958624-21apt-get00:30:572
1637774992017,2cyclictest1723770-21idleruntime-cro20:34:592
1637774992013,5cyclictest280-21systemd-journal22:45:012
1637774992010,8cyclictest280-21systemd-journal20:45:002
1637774992010,8cyclictest1932261-21ntpq00:01:112
1637769992014,4cyclictest1729202-21kworker/u8:2+flush-8:022:16:100
1637769992014,4cyclictest1729202-21kworker/u8:2+flush-8:022:16:100
16428082190,2sleep3481ktimers/319:15:013
1637774991916,2cyclictest1769123-21cpuspeed_turbos21:20:592
1637774991915,2cyclictest0-21swapper/222:26:022
1637774991915,2cyclictest0-21swapper/221:51:152
1637774991910,7cyclictest1741828-21tr20:51:062
1637774991815,2cyclictest1937713-21unixbench_singl00:06:172
1637774991812,4cyclictest1913884-21cpuspeed_turbos23:45:592
16374832183,8sleep30-21swapper/319:08:323
17876982170,2sleep3471rcuc/321:36:063
163777499179,6cyclictest1898196-21kworker/u8:3+events_unbound23:30:112
1637774991711,4cyclictest1703631-21grep20:11:172
163777499162,13cyclictest0-21swapper/222:10:192
1637774991611,3cyclictest0-21swapper/219:51:042
1637774991510,4cyclictest1729202-21kworker/u8:2+flush-8:020:45:042
17745352146,5sleep30-21swapper/321:26:043
17287062142,7sleep30-21swapper/320:40:013
18237442132,7sleep30-21swapper/322:16:003
18237442132,7sleep30-21swapper/322:16:003
17439422132,6sleep30-21swapper/320:55:023
17195472133,6sleep30-21swapper/320:31:033
16965022132,7sleep30-21swapper/320:06:063
16636842134,5sleep30-21swapper/319:31:143
19528832122,6sleep30-21swapper/300:21:363
19475542122,6sleep30-21swapper/300:16:143
19352442122,6sleep30-21swapper/300:06:073
19322022122,6sleep30-21swapper/300:01:093
19270852122,6sleep30-21swapper/323:56:083
19212092122,6sleep30-21swapper/323:51:073
19181772122,6sleep30-21swapper/323:48:583
19080252122,6sleep30-21swapper/323:36:183
18987942122,6sleep30-21swapper/323:31:003
18936142122,5sleep30-21swapper/323:25:023
18825362122,6sleep30-21swapper/323:11:173
18774092122,6sleep30-21swapper/323:06:163
18682772122,6sleep30-21swapper/323:00:023
18631152122,6sleep30-21swapper/322:54:363
18536182122,6sleep30-21swapper/322:45:583
18438672122,6sleep30-21swapper/322:36:033
18421602122,6sleep30-21swapper/322:31:133
18378572122,6sleep30-21swapper/322:28:363
18323262122,6sleep30-21swapper/322:21:143
18190412122,6sleep30-21swapper/322:11:023
18031212122,6sleep30-21swapper/321:51:363
17943592122,6sleep30-21swapper/321:46:033
17833202122,6sleep30-21swapper/321:31:183
17688002123,5sleep30-21swapper/321:20:023
17540122123,6sleep30-21swapper/321:05:573
17345382122,6sleep30-21swapper/320:45:593
17335662122,6sleep30-21swapper/320:41:183
17092362123,5sleep30-21swapper/320:20:583
17042992122,6sleep30-21swapper/320:15:583
16862322122,6sleep30-21swapper/319:56:033
16834432122,6sleep30-21swapper/319:51:143
16751502122,6sleep30-21swapper/319:46:043
16537012122,6sleep30-21swapper/319:21:123
16428082122,5sleep30-21swapper/319:15:013
19672642112,5sleep30-21swapper/300:36:093
19621482112,6sleep30-21swapper/300:31:073
19572952111,6sleep30-21swapper/300:26:143
19383882112,5sleep30-21swapper/300:10:573
19125232112,5sleep30-21swapper/323:41:113
18926902112,5sleep30-21swapper/323:21:173
18872142112,5sleep30-21swapper/323:16:073
18634192112,5sleep30-21swapper/322:55:283
18489272112,5sleep30-21swapper/322:41:003
18126132112,5sleep30-21swapper/322:01:153
18034262112,5sleep30-21swapper/321:55:003
17931762112,5sleep30-21swapper/321:41:173
17685232112,6sleep30-21swapper/321:19:383
17589952112,5sleep30-21swapper/321:10:593
17490362113,5sleep30-21swapper/321:00:163
17394762112,5sleep30-21swapper/320:51:013
17150392112,5sleep30-21swapper/320:26:053
17150392112,5sleep30-21swapper/320:26:053
16936972112,5sleep30-21swapper/320:01:173
16695732112,5sleep30-21swapper/319:40:023
16646662112,5sleep30-21swapper/319:35:573
16544942112,5sleep30-21swapper/319:25:013
18169252102,5sleep30-21swapper/322:06:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional