You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 14:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Mar 18, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
173559321570,5sleep30-21swapper/308:51:433
19432152540,2sleep00-21swapper/012:21:420
1630556995344,6cyclictest1647517-21latency_hist07:25:010
18956072470,3chrt0-21swapper/211:31:482
19054632460,6sleep20-21swapper/211:41:472
1630561994536,6cyclictest1916127-21latency_hist11:55:011
1630556994333,7cyclictest1677193-21latency_hist07:55:000
1630556994333,7cyclictest1677193-21latency_hist07:55:000
1630561994237,4cyclictest790210-21kworker/u8:4+flush-8:007:11:361
1630561994232,8cyclictest1816117-21ntpq10:11:441
1630566994134,5cyclictest1746966-21gpgv09:05:002
1630561994132,6cyclictest1667355-21latency_hist07:45:011
1630566993929,8cyclictest1851806-21/usr/sbin/munin10:50:002
1630561993933,4cyclictest1620852-21kworker/u8:1+flush-8:008:16:371
1630561993929,8cyclictest1641738-21ntpq07:16:451
1630561993829,6cyclictest1717198-21latency_hist08:35:011
1630561993729,5cyclictest1771797-21latency_hist09:30:001
1630561993727,8cyclictest1727463-21/usr/sbin/munin08:46:481
1630556993626,8cyclictest1658020-21diskstats07:36:360
1630566993526,7cyclictest1945960-21cat12:25:002
1630561993522,10cyclictest280-21systemd-journal09:05:521
1630556993529,4cyclictest1637817-21kworker/u8:0+flush-8:007:31:370
1630561993428,4cyclictest1742289-21apt-get09:01:321
1630561993427,5cyclictest1802525-21apt-get10:01:311
1630561993328,3cyclictest1648413-21irqcore07:26:421
1630561993323,8cyclictest280-21systemd-journal12:25:001
1630556993326,5cyclictest1832652-21fschecks_count10:31:360
163055699330,27cyclictest1697190-21kworker/0:2+events11:35:280
1630561993226,4cyclictest1960614-21unixbench_singl12:36:521
1630561993226,4cyclictest1787194-21apt-get09:46:331
1630561993223,6cyclictest1761859-21latency_hist09:20:011
1630556993229,2cyclictest1712280-21systemd-run08:30:010
1630556993226,4cyclictest1699701-21kthreadcore08:16:420
163055699320,27cyclictest1955961-21kworker/0:0+events12:35:420
1630561993127,3cyclictest0-21swapper/110:30:001
1630561993127,2cyclictest1801918-21munin-run10:00:001
1630561993125,4cyclictest401-21dbus-daemon12:30:001
1630561993125,4cyclictest1861378-21unixbench_singl10:56:521
1630561993123,6cyclictest1752345-21/usr/sbin/munin09:11:491
1630561993123,5cyclictest1906211-21latency_hist11:45:011
1630561993122,6cyclictest280-21systemd-journal08:22:521
1630556993122,7cyclictest280-21systemd-journal11:20:000
1630556993122,7cyclictest280-21systemd-journal11:20:000
1630561993027,2cyclictest1781894-21sendmail09:40:001
1630561993026,2cyclictest0-21swapper/112:05:001
1630561993024,4cyclictest1637817-21kworker/u8:0+flush-8:007:36:371
1630556993025,3cyclictest1927117-21irqrtprio12:06:390
1630556993025,3cyclictest1861394-21unixbench_singl10:56:520
1630556993025,3cyclictest1767492-21fschecks_count09:26:370
1630556993018,9cyclictest280-21systemd-journal10:15:010
163055699301,25cyclictest1697190-21kworker/0:2+events09:41:180
1630566992926,2cyclictest1771488-21unixbench_singl09:26:532
1630566992926,2cyclictest1731692-21unixbench_multi08:46:502
1630561992924,4cyclictest1955895-21kworker/u8:1-ext4-rsv-conversion12:35:001
1630561992923,4cyclictest1697382-21kworker/u8:2-events_unbound09:00:001
1630561992921,6cyclictest1881833-21/usr/sbin/munin11:21:431
1630561992919,7cyclictest1821902-21latency_hist10:20:011
1630556992925,2cyclictest1916147-21systemd-run11:55:010
1630556992924,3cyclictest1950949-21cron12:30:000
1630556992924,3cyclictest1886033-21timerwakeupswit11:21:510
1630556992924,3cyclictest1691357-21needreboot08:06:440
1630556992923,4cyclictest1723259-21irqrtprio08:41:380
1630556992921,6cyclictest1746866-21latency_hist09:05:010
163055699291,27cyclictest1697190-21kworker/0:2+events10:38:180
163055699291,27cyclictest1697190-21kworker/0:2+events10:17:560
163055699291,27cyclictest1697190-21kworker/0:2+events09:38:100
163055699291,22cyclictest1697190-21kworker/0:2+events09:46:160
163055699290,28cyclictest1697190-21kworker/0:2+events11:33:320
163055699290,24cyclictest1697190-21kworker/0:2+events11:25:000
1630566992824,3cyclictest1862111-21aten2_r5power_e11:01:332
1630561992821,5cyclictest1637817-21kworker/u8:0+flush-8:008:06:371
1630561992821,5cyclictest1620852-21kworker/u8:1+flush-8:007:56:371
1630561992821,5cyclictest1620852-21kworker/u8:1+flush-8:007:56:371
1630561992820,6cyclictest280-21systemd-journal12:11:541
1630561992818,7cyclictest280-21systemd-journal08:15:011
1630556992823,3cyclictest0-21swapper/008:00:000
1630556992823,3cyclictest0-21swapper/008:00:000
163055699282,21cyclictest1697190-21kworker/0:2+events12:00:120
163055699281,26cyclictest219511-21kworker/0:0+events07:18:350
163055699281,26cyclictest1697190-21kworker/0:2+events10:54:100
163055699281,26cyclictest1697190-21kworker/0:2+events10:10:000
163055699281,22cyclictest1697190-21kworker/0:2+events11:55:360
163055699281,22cyclictest1697190-21kworker/0:2+events11:05:130
163055699281,22cyclictest1697190-21kworker/0:2+events10:20:360
163055699281,22cyclictest1697190-21kworker/0:2+events09:55:560
163055699281,22cyclictest1697190-21kworker/0:2+events08:55:020
163055699281,22cyclictest1697190-21kworker/0:2+events08:30:200
163055699280,27cyclictest1697190-21kworker/0:2+events11:01:020
1630566992723,2cyclictest1722162-21sendmail08:40:002
1630566992723,2cyclictest1666998-21unixbench_multi07:41:502
1630566992722,3cyclictest1772450-21fschecks_count09:31:362
1630561992723,2cyclictest0-21swapper/112:16:391
1630561992723,2cyclictest0-21swapper/111:40:001
1630561992722,3cyclictest1846597-21unixbench_singl10:41:521
163055699279,17cyclictest1950778-21kworker/0:3+events12:32:220
1630556992723,3cyclictest20977-21cron09:25:000
163055699271,25cyclictest219511-21kworker/0:0+events08:24:000
163055699271,25cyclictest1697190-21kworker/0:2+events09:12:380
163055699271,21cyclictest219511-21kworker/0:0+events07:45:320
163055699271,21cyclictest1697190-21kworker/0:2+events12:10:020
163055699271,21cyclictest1697190-21kworker/0:2+events11:40:100
1630566992621,3cyclictest1852382-21cpuspeed_turbos10:51:342
1630566992620,4cyclictest1667977-21fschecks_count07:46:352
1630561992623,2cyclictest1837655-21cut10:36:351
1630561992623,2cyclictest1723253-21irqrtprio08:41:381
1630561992623,2cyclictest1657396-21cron07:35:001
1630561992622,3cyclictest1797203-21kworker/u8:1+flush-8:010:50:201
1630561992622,2cyclictest1906802-21cpuspeed_turbos11:46:341
1630561992622,2cyclictest1782853-21irqcore09:41:391
1630561992621,3cyclictest1881131-21unixbench_multi11:16:521
1630561992621,3cyclictest1881131-21unixbench_multi11:16:521
1630561992620,4cyclictest1831019-21kworker/u8:0+flush-8:011:01:361
1630561992615,9cyclictest1870755-21ntpq11:06:451
163055699266,15cyclictest1697190-21kworker/0:2+events10:25:200
1630556992621,3cyclictest0-21swapper/007:15:010
1630556992620,4cyclictest1806770-21unixbench_multi10:01:510
1630556992619,5cyclictest1876211-21unixbench_singl11:11:510
163055699261,24cyclictest1697190-21kworker/0:2+events10:47:240
163055699261,24cyclictest1697190-21kworker/0:2+events10:44:300
163055699261,24cyclictest1697190-21kworker/0:2+events09:34:240
163055699261,24cyclictest1697190-21kworker/0:2+events08:54:220
163055699261,21cyclictest1697190-21kworker/0:2+events12:15:060
163055699260,21cyclictest1697190-21kworker/0:2+events08:45:040
16257602264,6sleep10-21swapper/107:05:201
1630566992522,2cyclictest1737648-21fschecks_count08:56:362
1630566992522,2cyclictest1703043-21fschecks_count08:21:362
1630566992521,2cyclictest1931418-21aten2_r5power_v12:11:332
1630566992520,4cyclictest401-21dbus-daemon09:55:012
1630561992521,2cyclictest0-21swapper/111:15:001
1630561992521,2cyclictest0-21swapper/108:01:301
1630561992520,4cyclictest1716992-21kworker/u8:0+flush-8:008:36:361
1630561992520,3cyclictest0-21swapper/110:10:011
1630561992519,4cyclictest1926397-21apt-get12:06:321
163055699256,18cyclictest219511-21kworker/0:0+events07:44:400
163055699251,23cyclictest219511-21kworker/0:0+events08:11:300
163055699251,23cyclictest219511-21kworker/0:0+events07:27:240
163055699251,23cyclictest1697190-21kworker/0:2+events09:15:320
163055699251,23cyclictest1697190-21kworker/0:2+events09:09:560
163055699251,23cyclictest1697190-21kworker/0:2+events08:37:180
17978622240,2sleep21797868-21irqcore09:56:382
1630566992420,2cyclictest1822399-21aten2_r5power_v10:21:372
1630566992420,2cyclictest0-21swapper/208:15:002
1630566992420,2cyclictest0-21swapper/207:11:392
1630566992416,6cyclictest1682464-21cat08:00:002
1630566992416,6cyclictest1682464-21cat08:00:002
1630561992420,2cyclictest0-21swapper/111:31:361
1630561992420,2cyclictest0-21swapper/108:26:511
1630561992416,6cyclictest280-21systemd-journal09:34:521
1630561992414,8cyclictest1826045-21ntpq10:21:481
1630556992417,5cyclictest1796404-21grep09:51:530
163055699241,22cyclictest219511-21kworker/0:0+events08:00:140
163055699241,22cyclictest1697190-21kworker/0:2+events11:48:220
1630566992320,2cyclictest1781526-21unixbench_multi09:36:512
1630566992320,2cyclictest1726771-21unixbench_multi08:41:512
1630566992320,2cyclictest1658084-21fschecks_time07:36:372
1630566992319,3cyclictest1916516-21aten2_r5power_c11:56:322
1630566992319,2cyclictest0-21swapper/211:21:432
1630561992320,2cyclictest1796952-21wc09:55:011
1630561992319,2cyclictest0-21swapper/107:51:361
1630561992319,2cyclictest0-21swapper/107:51:361
1630561992318,3cyclictest0-21swapper/108:51:361
1630561992315,6cyclictest401-21dbus-daemon10:30:371
18289502220,3chrt75-21kworker/3:1+events10:26:423
163056699227,4cyclictest0-21swapper/210:15:372
163056699224,16cyclictest1786173-21cut09:41:502
1630566992219,2cyclictest1831955-21latency_hist10:30:012
1630566992213,7cyclictest1701616-21grep08:16:522
1630561992218,2cyclictest0-21swapper/111:56:341
1630561992218,2cyclictest0-21swapper/107:21:471
163056699219,8cyclictest1867010-21apt-get11:06:322
163056699212,13cyclictest1896662-21apt-get11:36:332
1630566992117,2cyclictest1955637-21unixbench_singl12:31:512
1630566992117,2cyclictest1946592-21cpuspeed_turbos12:26:352
1630561992118,2cyclictest0-21swapper/109:21:421
1630561992117,2cyclictest0-21swapper/111:30:001
1630561992117,2cyclictest0-21swapper/107:46:311
1630561992115,4cyclictest1831019-21kworker/u8:0+events_unbound10:46:391
16302772212,14sleep00-21swapper/007:08:480
16255852213,8sleep30-21swapper/307:05:023
163056699202,13cyclictest1672643-21apt-get07:51:332
163056699202,13cyclictest1672643-21apt-get07:51:332
1630566992017,2cyclictest1716850-21unixbench_multi08:31:532
1630566992015,3cyclictest1872160-21cpuspeed_turbos11:11:342
1630566992015,3cyclictest1756936-21turbostat.cron09:15:002
1630566992012,6cyclictest1642768-21grep07:20:012
1630566992011,7cyclictest1926034-21cat12:05:002
1630566992011,7cyclictest1764404-21ps09:21:412
1630566992010,8cyclictest1916133-21awk11:55:002
163056699195,12cyclictest1711990-21sshd08:26:512
163056699192,12cyclictest1787194-21apt-get09:46:352
1630566991916,2cyclictest1747744-21fschecks_count09:06:362
1630566991915,2cyclictest0-21swapper/211:26:442
1630566991914,3cyclictest1906659-21aten2_r5power_p11:46:332
1630566991914,3cyclictest1687302-21turbostat.cron08:05:002
1630566991914,3cyclictest0-21swapper/212:16:522
1630566991912,5cyclictest1647867-21find07:26:352
1630566991911,6cyclictest1880544-21cat11:16:442
1630566991911,6cyclictest1880544-21cat11:16:442
1630566991910,7cyclictest1656925-21grep07:31:512
16257962193,12sleep20-21swapper/207:05:502
163056699188,7cyclictest1737149-21ls08:55:012
163056699182,11cyclictest1832386-21apt-get10:31:332
1630566991813,3cyclictest0-21swapper/210:36:402
1630566991812,4cyclictest0-21swapper/207:21:362
163056699179,6cyclictest1812495-21cut10:11:342
163056699177,8cyclictest1806309-21awk10:01:452
1630566991714,2cyclictest0-21swapper/209:16:342
1630566991713,2cyclictest0-21swapper/212:36:492
1630566991713,2cyclictest0-21swapper/210:56:482
1630566991713,2cyclictest0-21swapper/210:41:322
1630566991713,2cyclictest0-21swapper/210:06:292
1630566991713,2cyclictest0-21swapper/208:09:442
18559252166,6sleep30-21swapper/310:51:463
16315902160,2chrt75-21kworker/3:1+events07:11:393
163056699169,5cyclictest1929068-21cut12:06:422
19016212152,8sleep30-21swapper/311:41:333
18018942151,7sleep30-21swapper/310:00:013
19601252132,7sleep30-21swapper/312:36:473
19450442132,7sleep30-21swapper/312:21:503
19214152132,6sleep30-21swapper/312:01:323
19161492132,6sleep30-21swapper/311:55:023
18864382132,7sleep30-21swapper/311:25:003
18596172132,6sleep30-21swapper/310:56:433
18170802132,6sleep30-21swapper/310:15:023
18114672131,8sleep30-21swapper/310:06:513
18025292132,7sleep30-21swapper/310:01:343
17523752133,6sleep30-21swapper/309:11:343
16726462132,7sleep30-21swapper/307:51:333
16726462132,7sleep30-21swapper/307:51:333
16432902132,7sleep30-21swapper/307:21:393
19503502122,6sleep30-21swapper/312:26:523
19404662122,6sleep30-21swapper/312:16:523
19274912122,6sleep30-21swapper/312:06:413
19121452122,6sleep30-21swapper/311:51:403
18966362122,6sleep30-21swapper/311:36:323
18955072122,6sleep30-21swapper/311:31:463
18761982122,6sleep30-21swapper/311:11:523
18669352122,6sleep30-21swapper/311:05:543
18427932122,7sleep30-21swapper/310:41:383
18394802122,6sleep30-21swapper/310:36:413
18265902122,6sleep30-21swapper/310:21:563
18138082122,6sleep30-21swapper/310:11:413
17918472122,6sleep30-21swapper/309:50:023
17917332122,6sleep30-21swapper/309:49:343
17773312122,6sleep30-21swapper/309:36:343
17611162122,6sleep30-21swapper/309:16:483
17271532122,6sleep30-21swapper/308:45:023
17181472121,7sleep30-21swapper/308:36:393
17089572122,6sleep30-21swapper/308:26:403
17045342122,6sleep30-21swapper/308:21:423
16980592122,6sleep30-21swapper/308:16:413
16934842121,7sleep30-21swapper/308:11:393
16831312122,6sleep30-21swapper/308:01:363
16799612122,6sleep30-21swapper/307:56:423
16799612122,6sleep30-21swapper/307:56:423
16722672122,6sleep30-21swapper/307:50:003
16627022122,6sleep30-21swapper/307:41:303
16582702122,6sleep30-21swapper/307:36:403
16516162122,6sleep30-21swapper/307:26:493
19513272112,5sleep30-21swapper/312:31:333
19311662112,5sleep30-21swapper/312:10:023
19064352112,5sleep30-21swapper/311:45:023
18906512112,5sleep30-21swapper/311:26:503
18765392112,5sleep30-21swapper/311:15:013
18765392112,5sleep30-21swapper/311:15:013
18635512112,5sleep30-21swapper/311:01:413
18471882112,6sleep30-21swapper/310:46:003
18323602112,5sleep30-21swapper/310:31:313
17827332112,5sleep30-21swapper/309:41:393
17721332112,5sleep30-21swapper/309:31:323
17670612112,5sleep30-21swapper/309:25:023
17624992112,5sleep30-21swapper/309:21:373
17473672112,5sleep30-21swapper/309:05:453
17421482112,5sleep30-21swapper/309:00:023
17410552112,5sleep30-21swapper/308:56:453
17228792112,5sleep30-21swapper/308:41:373
17129662112,5sleep30-21swapper/308:31:373
16919752112,5sleep30-21swapper/308:06:543
16526712112,5sleep30-21swapper/307:30:023
16417192112,6sleep30-21swapper/307:16:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional