You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 17:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Thu Jul 23, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
190483121000,18sleep3577-21kworker/3:2+events10:52:463
168224099511,47cyclictest1-21systemd07:35:010
168224099511,47cyclictest1-21systemd07:35:000
1682240994942,5cyclictest1723810-21base6407:50:010
1682240994738,7cyclictest1693968-21latency_hist07:20:020
20058392460,4chrt0-21swapper/112:32:461
1682242994525,18cyclictest1928632-21kthreadcore11:17:431
1682240994535,7cyclictest1682051-21latency_hist07:10:010
168224099451,40cyclictest1-21systemd07:15:000
1682242994334,6cyclictest1738774-21latency_hist08:05:021
1682242994327,14cyclictest1723738-21apt-key07:50:011
1682240994333,8cyclictest2001001-21ntpq12:27:480
1682246994233,7cyclictest1837788-21apt-get09:45:002
1682242994125,13cyclictest1773469-21latency_hist08:40:011
1682242994115,6cyclictest0-21swapper/109:45:031
168224099411,36cyclictest1738791-21true08:05:000
1682242994020,8cyclictest1947076-21latency_hist11:35:011
1682240994029,7cyclictest278-21systemd-journal11:47:500
168224099401,33cyclictest1793293-21kworker/0:0+events09:11:370
1682240993930,6cyclictest1952039-21latency_hist11:40:010
1682242993830,5cyclictest1887718-21latency_hist10:35:011
168224099382,31cyclictest1897645-21kworker/0:0+events11:11:130
1682246993733,3cyclictest1848131-21kworker/u8:2+flush-8:010:55:012
1682242993728,7cyclictest278-21systemd-journal09:42:581
168224099372,30cyclictest1932263-21kworker/0:2+events12:17:050
168224099372,30cyclictest1932263-21kworker/0:2+events11:51:050
168224099372,30cyclictest1827909-21kworker/0:2+events09:51:490
168224099370,32cyclictest1827909-21kworker/0:2+events09:55:130
1682246993629,5cyclictest1882786-21/usr/sbin/munin10:30:002
1682240993627,6cyclictest1897612-21latency_hist10:45:010
1682240993615,15cyclictest278-21systemd-journal12:32:500
168224099361,30cyclictest1738795-21kworker/0:1+events08:45:170
1682240993529,4cyclictest1774866-21kthreadcore08:42:460
1682240993527,6cyclictest1783779-21/usr/sbin/munin08:52:470
1682240993525,8cyclictest1908148-21diskstats10:57:400
1682240993523,9cyclictest1862250-21ntpq10:07:490
168224099352,32cyclictest1827909-21kworker/0:2+events10:31:170
168224099351,29cyclictest1827909-21kworker/0:2+events09:36:050
168224099350,29cyclictest1645603-21kworker/0:0+events07:25:330
1682246993430,3cyclictest1848131-21kworker/u8:2+flush-8:011:17:432
1682240993427,5cyclictest1723744-21kworker/u8:0+events_unbound09:42:460
168224099342,31cyclictest1827909-21kworker/0:2+events10:18:050
1682242993326,5cyclictest1709239-21apt-get07:37:361
1682240993325,5cyclictest1956991-21latency_hist11:45:010
17063042320,5sleep3451irq_work/307:32:453
17063042320,5sleep3451irq_work/307:32:453
1682246993228,3cyclictest1937196-21kworker/u8:0+events_unbound12:40:012
1682246993227,4cyclictest1748684-21kworker/u8:3+flush-8:010:12:492
1682246993226,4cyclictest1956987-21cron11:45:002
1682246993226,4cyclictest1748684-21kworker/u8:3+events_unbound09:27:432
1682242993223,7cyclictest1813462-21/usr/sbin/munin09:22:521
168224099328,19cyclictest1793293-21kworker/0:0+events09:30:140
168224099322,25cyclictest1738795-21kworker/0:1+events08:05:250
168224099321,30cyclictest1932263-21kworker/0:2+events12:04:100
168224099321,30cyclictest1713046-21kworker/0:3+events07:52:170
168224099321,30cyclictest1713046-21kworker/0:3+events07:38:210
168224099321,27cyclictest1897645-21kworker/0:0+events11:05:220
168224099320,30cyclictest1738795-21kworker/0:1+events08:58:370
19849142310,4sleep10-21swapper/112:12:481
1682242993126,4cyclictest1867972-21kworker/u8:1+events_unbound11:57:441
1682242993122,6cyclictest1827873-21latency_hist09:35:001
1682240993126,3cyclictest2007871-21irqrtprio12:37:420
1682240993126,3cyclictest1730075-21irqrtprio07:57:440
168224099312,27cyclictest1827909-21kworker/0:2+events10:04:130
1682240993122,6cyclictest1798205-21latency_hist09:05:010
168224099312,24cyclictest1932263-21kworker/0:2+events12:07:290
1682246993023,5cyclictest1857853-21awk10:05:002
1682242993025,3cyclictest1749840-21irqrtprio08:17:451
1682242993021,7cyclictest1818373-21/usr/sbin/munin09:27:471
168224099308,19cyclictest1793293-21kworker/0:0+events09:15:020
168224099306,19cyclictest1827909-21kworker/0:2+events10:21:130
1682240993025,2cyclictest0-21swapper/010:37:500
168224099302,27cyclictest1827909-21kworker/0:2+events10:11:290
1682240993017,12cyclictest1738795-21kworker/0:1+events08:17:570
1682242992923,4cyclictest1793722-21apt-get09:02:391
168224099299,16cyclictest1932263-21kworker/0:2+events11:31:140
168224099298,20cyclictest1738795-21kworker/0:1+events08:29:010
168224099298,16cyclictest1738795-21kworker/0:1+events08:30:090
168224099297,21cyclictest1827909-21kworker/0:2+events10:29:490
1682240992923,4cyclictest1769655-21tr08:37:440
168224099292,26cyclictest1793293-21kworker/0:0+events09:24:410
168224099292,26cyclictest1738795-21kworker/0:1+events08:10:450
1682240992920,7cyclictest1718008-21ntpq07:42:500
168224099291,27cyclictest1897645-21kworker/0:0+events11:03:450
168224099291,27cyclictest1793293-21kworker/0:0+events09:28:370
19378252280,15sleep20-21swapper/211:27:392
1682246992824,2cyclictest1693710-21unixbench_multi07:17:562
1682246992823,4cyclictest1723744-21kworker/u8:0+flush-8:008:47:542
168224699281,25cyclictest1-21systemd12:20:002
1682242992824,3cyclictest1695153-21irqrtprio07:22:451
1682242992824,2cyclictest0-21swapper/108:45:001
1682242992820,5cyclictest278-21systemd-journal10:18:001
168224099288,19cyclictest1897645-21kworker/0:0+events11:22:250
168224099288,19cyclictest1897645-21kworker/0:0+events11:22:250
168224099288,15cyclictest1897645-21kworker/0:0+events11:27:130
168224099282,25cyclictest1793293-21kworker/0:0+events09:09:290
168224099282,25cyclictest1738795-21kworker/0:1+events08:24:370
168224099282,21cyclictest1897645-21kworker/0:0+events11:15:370
168224099280,27cyclictest1897645-21kworker/0:0+events10:51:130
1682246992722,4cyclictest1748684-21kworker/u8:3+flush-8:008:37:502
1682246992720,5cyclictest1896779-21needreboot10:42:472
1682242992723,2cyclictest0-21swapper/107:35:001
1682242992723,2cyclictest0-21swapper/107:35:001
1682242992723,2cyclictest0-21swapper/107:15:041
1682242992721,4cyclictest1754818-21irqrtprio08:22:441
1682242992720,6cyclictest1793261-21idleruntime-cro09:00:001
168224099272,24cyclictest1645603-21kworker/0:0+events07:20:490
168224099271,25cyclictest1932263-21kworker/0:2+events12:14:330
168224099271,21cyclictest1991844-21kworker/0:0+events12:20:010
168224099270,22cyclictest1827909-21kworker/0:2+events10:45:450
1682246992622,3cyclictest1858565-21aten2_r5power_c10:07:392
1682246992621,3cyclictest1922835-21aten2_r5power_p11:12:412
1682246992617,7cyclictest278-21systemd-journal09:55:012
1682242992622,2cyclictest1813009-21cron09:20:001
1682242992622,2cyclictest0-21swapper/110:40:001
1682242992621,3cyclictest1906625-21needreboot10:52:481
1682242992619,5cyclictest1912828-21/usr/sbin/munin11:02:471
1682242992618,5cyclictest1857862-21apt-get10:05:001
168224299261,6cyclictest1877872-21apt10:25:011
168224099262,23cyclictest1827909-21kworker/0:2+events09:45:100
1682246992521,2cyclictest1918081-21fschecks_count11:07:412
1682246992520,3cyclictest1968226-21kthreadcore11:57:442
1682242992521,3cyclictest1991782-21cron12:20:001
1682242992521,3cyclictest1783169-21unixbench_singl08:47:561
1682242992521,2cyclictest0-21swapper/112:28:261
168224099251,23cyclictest1932263-21kworker/0:2+events11:55:490
1682246992419,4cyclictest1813015-21idleruntime-cro09:20:002
1682242992421,2cyclictest1956989-21cron11:45:001
1682242992420,3cyclictest21170-21cron08:15:001
1682242992420,3cyclictest1729588-21tr07:57:401
1682242992420,2cyclictest0-21swapper/110:47:461
1682242992420,2cyclictest0-21swapper/109:52:571
1682242992420,2cyclictest0-21swapper/107:27:571
1682242992419,4cyclictest1951771-21unixbench_multi11:37:551
1682246992319,2cyclictest1888194-21aten2_r5power_c10:37:382
168224299239,5cyclictest0-21swapper/108:30:031
1682242992320,2cyclictest0-21swapper/107:55:001
1682242992319,3cyclictest1927049-21unixbench_singl11:12:571
1682242992319,2cyclictest0-21swapper/110:45:011
1682242992319,2cyclictest0-21swapper/107:12:431
1682242992318,3cyclictest1763340-21unixbench_singl08:27:551
1682242992318,3cyclictest0-21swapper/110:30:001
17247762220,6chrt0-21swapper/207:52:422
1682246992219,2cyclictest1784155-21fschecks_time08:52:402
1682246992219,2cyclictest1723718-21latency_hist07:50:012
1682246992216,4cyclictest1683484-21kthreadcore07:12:442
1682246992215,5cyclictest1852905-21cat10:00:002
168224299228,5cyclictest0-21swapper/109:38:471
168224299228,5cyclictest0-21swapper/108:09:321
1682242992218,2cyclictest0-21swapper/109:12:411
1682242992217,3cyclictest0-21swapper/112:02:531
1682242992214,6cyclictest1921595-21ntpq11:07:511
16819052225,11sleep10-21swapper/107:08:211
1682246992118,2cyclictest2002483-21fschecks_count12:32:392
1682246992118,2cyclictest1981919-21munin-plugin-st12:10:002
1682246992117,3cyclictest0-21swapper/212:30:002
1682246992117,2cyclictest0-21swapper/211:47:492
1682246992115,4cyclictest1912169-21unixbench_singl10:57:572
1682242992116,3cyclictest0-21swapper/111:47:401
1682242992116,3cyclictest0-21swapper/111:25:001
1682242992116,3cyclictest0-21swapper/111:25:001
1682242992116,3cyclictest0-21swapper/110:07:481
1682242992115,4cyclictest1848131-21kworker/u8:2+flush-8:010:12:211
1682242992115,4cyclictest0-21swapper/112:37:531
1682242992115,4cyclictest0-21swapper/109:07:541
1682242992114,5cyclictest0-21swapper/112:07:441
1682242992111,8cyclictest1852146-21ntpq09:57:501
168224699208,8cyclictest1982362-21apt-get12:12:392
168224699202,13cyclictest1873358-21apt-get10:22:392
1682246992016,2cyclictest0-21swapper/211:25:012
1682246992016,2cyclictest0-21swapper/211:25:002
1682246992016,2cyclictest0-21swapper/207:42:442
1682246992015,4cyclictest1723744-21kworker/u8:0+events_unbound08:07:592
1682246992015,4cyclictest1682114-21kworker/u8:1+events_unbound07:37:422
1682242992015,4cyclictest0-21swapper/108:52:391
1682242992014,4cyclictest0-21swapper/112:22:371
1682242992014,4cyclictest0-21swapper/111:52:491
1682242992012,6cyclictest1939382-21tr11:27:451
1682242992012,6cyclictest1911720-21ntp_states10:57:521
1682242992011,7cyclictest1714467-21df_inode07:42:411
1682246991915,3cyclictest1823475-21aten2_r5power_v09:32:402
1682246991915,2cyclictest1992519-21fschecks_count12:22:402
1682246991915,2cyclictest0-21swapper/210:17:402
1682246991915,2cyclictest0-21swapper/208:35:002
168224699191,13cyclictest1699366-21apt-get07:27:392
16778522194,9sleep20-21swapper/207:07:422
168224699182,5cyclictest0-21swapper/207:32:402
168224699182,5cyclictest0-21swapper/207:32:392
168224699182,12cyclictest1738024-21ntpq08:02:502
1682246991813,3cyclictest0-21swapper/209:47:552
1682246991812,4cyclictest371rcuc/209:37:482
1682246991812,4cyclictest1898979-21tr10:47:452
168224699181,13cyclictest1788764-21apt-get08:57:372
1682246991810,6cyclictest1757635-21tr08:22:472
1682246991810,6cyclictest1731124-21tr07:57:462
16776022182,9sleep30-21swapper/307:07:393
168224699179,6cyclictest1976967-21cron12:05:002
168224699172,11cyclictest1951329-21ntpq11:37:512
1682246991713,2cyclictest0-21swapper/211:05:002
1682246991713,2cyclictest0-21swapper/209:12:562
1682246991712,3cyclictest0-21swapper/208:42:522
1682246991712,3cyclictest0-21swapper/208:17:552
168224699170,2cyclictest19644902cut11:52:472
18572122167,6sleep30-21swapper/310:02:523
168224699168,6cyclictest1944884-21tr11:32:462
168224699162,5cyclictest0-21swapper/208:13:512
168224699162,13cyclictest0-21swapper/209:05:162
168224699162,13cyclictest0-21swapper/208:25:042
168224699162,13cyclictest0-21swapper/207:21:312
1682246991613,2cyclictest0-21swapper/210:31:482
1682246991611,4cyclictest0-21swapper/209:00:102
17645732150,11sleep30-21swapper/308:32:443
1682246991510,3cyclictest0-21swapper/209:22:492
20076752132,7sleep30-21swapper/312:37:423
20017562131,8sleep30-21swapper/312:30:003
19918312132,6sleep30-21swapper/312:20:013
19823362132,7sleep30-21swapper/312:12:393
19769652131,7sleep30-21swapper/312:05:013
19524732136,4sleep30-21swapper/311:42:383
19520182132,6sleep30-21swapper/311:40:013
19371632132,6sleep30-21swapper/311:25:003
19367052132,6sleep30-21swapper/311:22:563
19367052132,6sleep30-21swapper/311:22:563
18982972132,7sleep30-21swapper/310:47:413
18823102132,7sleep30-21swapper/310:27:563
18729242132,6sleep30-21swapper/310:20:013
17937272135,5sleep30-21swapper/309:02:423
17685822132,6sleep30-21swapper/308:35:013
17635142131,8sleep30-21swapper/308:30:003
17137882132,6sleep30-21swapper/307:40:013
17029592132,7sleep30-21swapper/307:27:493
19612222122,6sleep30-21swapper/311:47:513
19449572122,6sleep30-21swapper/311:32:473
19232452122,6sleep30-21swapper/311:12:453
19215842122,6sleep30-21swapper/311:07:513
19148412123,5sleep30-21swapper/311:02:463
19086192122,6sleep30-21swapper/310:57:443
18938502123,5sleep30-21swapper/310:42:443
18870332123,5sleep30-21swapper/310:32:533
18637102122,6sleep30-21swapper/310:12:403
18585072122,6sleep30-21swapper/310:07:373
18479092122,5sleep30-21swapper/309:55:013
18383022122,6sleep30-21swapper/309:45:513
18371602122,7sleep30-21swapper/309:42:543
18221502122,6sleep30-21swapper/309:27:493
17986572122,6sleep30-21swapper/309:07:393
17441832122,6sleep30-21swapper/308:12:383
17337582122,6sleep30-21swapper/307:59:263
17275392123,6sleep30-21swapper/307:52:483
17218062122,6sleep30-21swapper/307:47:473
16898222122,6sleep30-21swapper/307:17:423
20021252112,5sleep30-21swapper/312:31:453
19873042112,5sleep30-21swapper/312:17:403
19772782112,6sleep30-21swapper/312:06:013
19716182112,5sleep30-21swapper/311:57:583
19631192112,5sleep30-21swapper/311:52:453
19277522112,5sleep30-21swapper/311:17:383
18881672112,5sleep30-21swapper/310:37:383
18683742112,5sleep30-21swapper/310:17:363
18314162112,5sleep30-21swapper/309:37:483
18271122111,6sleep30-21swapper/309:32:513
18081072112,5sleep30-21swapper/309:15:013
18035442112,5sleep30-21swapper/309:12:373
17923542112,6sleep30-21swapper/308:57:483
17837762112,6sleep30-21swapper/308:52:343
17831712112,5sleep30-21swapper/308:47:573
17737902112,6sleep30-21swapper/308:41:033
17539302112,6sleep30-21swapper/308:20:503
17488912113,5sleep30-21swapper/308:15:033
17392242112,6sleep30-21swapper/308:07:383
17340852112,6sleep30-21swapper/308:00:233
17132802112,5sleep30-21swapper/307:37:563
16942502112,6sleep30-21swapper/307:20:393
16864402112,5sleep30-21swapper/307:12:523
18433222102,5sleep30-21swapper/309:51:563
18132632102,5sleep30-21swapper/309:20:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional