You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 14:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sun May 17, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16897362720,4sleep30-21swapper/307:25:573
17547102630,3sleep0201rcuc/008:30:580
17922312590,1sleep01792234-21cut09:10:560
1670648995539,14cyclictest1875659-21apt-get10:35:470
1670648995430,21cyclictest280-21systemd-journal10:20:000
1670650995346,5cyclictest1870162-40mandb10:27:351
167064899521,38cyclictest1999637-21true12:40:010
1670653995043,5cyclictest280-21systemd-journal09:25:122
1670650994942,5cyclictest280-21systemd-journal11:40:381
1670650994939,7cyclictest280-21systemd-journal09:34:351
1670648994726,8cyclictest1953948-21ntpq11:51:020
1670648994638,6cyclictest1810200-21ntpq09:26:010
1670648994624,8cyclictest1864555-21ntpq10:21:010
1670648994539,4cyclictest1865737-21apt-get10:25:490
167064899451,42cyclictest1-21systemd12:10:460
1670648994437,5cyclictest1650632-21kworker/u8:3+flush-8:009:50:500
1670648994435,7cyclictest1900556-21/usr/sbin/munin11:01:010
167064899443,17cyclictest583-21snmpd08:45:470
1670648994422,6cyclictest280-21systemd-journal10:45:010
1670653994334,7cyclictest1687310-21cron07:25:002
1670650994337,4cyclictest280-21systemd-journal12:35:521
1670650994334,7cyclictest1854664-21ntpq10:11:021
1670650994334,6cyclictest1905182-21latency_hist11:05:011
1670648994324,5cyclictest1800793-21grep09:16:070
1670648994324,5cyclictest1800793-21grep09:16:060
1670648994235,5cyclictest1756790-21apt-get08:35:480
1670648994233,6cyclictest1825895-21latency_hist09:45:010
1670648994231,9cyclictest1801757-21diskstats09:20:530
1670648994231,9cyclictest1671119-21diskstats07:10:540
1670650994130,8cyclictest280-21systemd-journal07:46:351
1670650994032,5cyclictest280-21systemd-journal10:21:331
1670648993831,5cyclictest1741644-21sh08:20:000
1670648993828,8cyclictest1726018-21ntpq08:01:020
1670648993730,5cyclictest1741983-21apt-get08:20:470
1670650993627,6cyclictest280-21systemd-journal10:59:341
1670650993626,7cyclictest1885218-21latency_hist10:45:001
1670648993629,5cyclictest1650632-21kworker/u8:3+flush-8:010:00:540
1670650993529,4cyclictest280-21systemd-journal08:30:341
1670648993525,8cyclictest1790387-21ntpq09:06:030
167064899352,27cyclictest1682407-21kworker/0:0+events07:35:490
1670653993426,6cyclictest280-21systemd-journal12:19:592
1670650993426,6cyclictest1741958-21/usr/sbin/munin08:20:591
1670648993427,5cyclictest1940025-21latency_hist11:40:000
1670648993427,5cyclictest1721003-21ntpq07:55:590
1670650993326,5cyclictest1905493-21apt-get11:05:491
1670650993322,9cyclictest280-21systemd-journal08:00:011
1670648993325,6cyclictest1979539-21latency_hist12:20:010
1670648993323,8cyclictest1839791-21ntpq09:56:010
1670650993228,3cyclictest1665613-21kworker/u8:1+events_unbound10:30:251
1670650993228,3cyclictest1665613-21kworker/u8:1+events_unbound08:53:181
1670650993225,5cyclictest1796523-21apt-get09:15:471
1670650993225,5cyclictest1796523-21apt-get09:15:471
1670648993224,6cyclictest1890942-21diskstats10:50:530
1670648993224,6cyclictest1829939-21ntpq09:46:020
1670648993222,8cyclictest1885311-21cp10:45:000
167065099317,16cyclictest1841029-21apt-get10:00:491
1670650993126,4cyclictest1665613-21kworker/u8:1+flush-8:007:54:401
1670650993125,5cyclictest1665613-21kworker/u8:1+flush-8:008:55:311
1670648993128,2cyclictest1650632-21kworker/u8:3+flush-8:007:29:360
1670648993126,3cyclictest1816842-21irqcore09:35:550
1670653993010,10cyclictest0-21swapper/211:50:592
1670650993026,3cyclictest1650632-21kworker/u8:3+flush-8:007:20:001
1670650993026,3cyclictest1650632-21kworker/u8:3+flush-8:007:19:591
1670650993025,3cyclictest1989476-21systemd-run12:30:011
1670650993025,3cyclictest1860414-21cron10:20:001
1670650993024,4cyclictest1741657-21latency_hist08:20:001
1670650993023,5cyclictest1969953-21apt-get12:10:471
1670650993018,1cyclictest161rcu_preempt11:10:521
1670650993018,1cyclictest161rcu_preempt11:10:521
1670648993025,3cyclictest1985314-21irqcore12:25:550
1670648993025,3cyclictest1761946-21cpuspeed_turbos08:40:510
1670648993021,6cyclictest1850573-21latency_hist10:10:010
1670648993020,8cyclictest1730883-21ntpq08:06:050
1670648993019,9cyclictest1732343-21diskstats08:10:530
1670653992925,2cyclictest1915630-21fschecks_count11:15:552
1670653992921,6cyclictest280-21systemd-journal08:30:002
167065099297,4cyclictest30-21ksoftirqd/112:05:591
167065099296,15cyclictest1949101-21ntpq11:46:051
167065099296,15cyclictest1890854-21awk10:50:511
1670650992924,3cyclictest1825135-21seq09:41:051
1670650992913,10cyclictest1686385-21needreboot07:21:011
1670650992912,9cyclictest1691351-21ntpq07:25:591
167065099291,12cyclictest0-21swapper/109:10:501
1670648992917,9cyclictest1910676-21diskstats11:10:530
1670648992917,9cyclictest1910676-21diskstats11:10:520
16658412292,6sleep00-21swapper/007:05:200
1670653992820,6cyclictest280-21systemd-journal08:42:342
1670653992810,4cyclictest0-21swapper/209:40:572
1670653992810,4cyclictest0-21swapper/207:15:592
1670653992810,4cyclictest0-21swapper/207:15:592
1670653992810,10cyclictest0-21swapper/207:25:562
167065099286,11cyclictest30-21ksoftirqd/109:05:011
1670650992823,3cyclictest1757381-21irqcore08:35:551
1670650992820,6cyclictest280-21systemd-journal09:58:351
1670650992811,10cyclictest1761722-21apt-get08:40:471
1670648992823,4cyclictest1775841-21unixbench_multi08:51:090
1670653992724,2cyclictest1716952-21cron07:55:002
1670653992722,3cyclictest1880285-21idleruntime-cro10:40:002
167065099278,4cyclictest30-21ksoftirqd/110:05:591
167065099277,9cyclictest161rcu_preempt11:15:581
167065099274,16cyclictest1767148-21cat08:45:541
167065099273,10cyclictest0-21swapper/107:31:011
1670650992724,1cyclictest0-21swapper/109:21:091
1670650992723,2cyclictest1925478-21cpuspeed_turbos11:25:521
1670650992717,7cyclictest280-21systemd-journal10:46:351
1670650992713,4cyclictest0-21swapper/108:26:351
167064899278,17cyclictest1974622-21kworker/0:2+events12:31:450
1670648992723,2cyclictest1786340-21idleruntime-cro09:05:000
1670648992723,2cyclictest1712021-21cron07:50:010
1670648992722,3cyclictest1781425-21systemd-run09:00:000
1670648992722,3cyclictest0-21swapper/007:35:010
1670648992720,5cyclictest1716960-21latency_hist07:55:010
1670648992720,5cyclictest1682358-21cron07:20:000
1670648992720,5cyclictest1682358-21cron07:20:000
1670648992718,6cyclictest1984469-21latency_hist12:25:010
1670648992710,15cyclictest1771289-21kworker/0:0+events10:55:510
19858322260,2sleep375-21kworker/3:1+events12:25:573
167065399269,4cyclictest0-21swapper/208:06:002
167065399268,9cyclictest0-21swapper/209:10:582
167065399266,5cyclictest0-21swapper/212:25:572
167065399265,5cyclictest1944529-21grep11:41:082
167065399263,12cyclictest1945238-21apt-get11:45:502
1670653992623,2cyclictest1816627-21fschecks_time09:35:512
1670653992612,2cyclictest421rcuog/212:11:002
1670653992610,4cyclictest0-21swapper/211:20:592
167065399260,14cyclictest1839784-21awk09:56:012
167065099267,12cyclictest30-21ksoftirqd/110:36:021
167065099266,9cyclictest161rcu_preempt11:55:571
167065099266,6cyclictest1722229-21http08:00:491
167065099266,10cyclictest30-21ksoftirqd/109:50:511
167065099265,10cyclictest30-21ksoftirqd/111:25:021
167065099264,7cyclictest30-21ksoftirqd/109:05:571
167065099264,10cyclictest0-21swapper/112:01:061
167065099263,11cyclictest1735950-21open_files08:11:061
1670650992621,3cyclictest413-21systemd-logind09:30:011
1670650992621,3cyclictest1816845-21irqcore09:35:551
1670650992613,2cyclictest161rcu_preempt11:35:591
167064899264,21cyclictest1954857-21kworker/0:1+events12:09:510
1670648992621,3cyclictest1-21systemd10:31:350
1670648992619,5cyclictest280-21systemd-journal11:30:380
167065399257,10cyclictest0-21swapper/209:46:002
167065399256,5cyclictest1930803-21cut11:30:562
1670653992517,6cyclictest280-21systemd-journal08:55:002
1670653992510,8cyclictest39-21ksoftirqd/212:35:552
167065399250,11cyclictest1909312-21ntp_states11:06:052
167065099259,3cyclictest161rcu_preempt12:20:581
167065099257,8cyclictest161rcu_preempt12:15:581
167065099256,9cyclictest161rcu_preempt09:46:001
167065099256,8cyclictest161rcu_preempt07:40:551
167065099255,6cyclictest30-21ksoftirqd/111:50:571
1670650992522,2cyclictest291ktimers/111:32:331
1670650992518,5cyclictest1670869-21apt-get07:10:501
167064899258,15cyclictest1771289-21kworker/0:0+events11:20:580
1670648992517,1cyclictest0-21swapper/011:55:480
16704442253,5sleep20-21swapper/207:09:362
167065399248,4cyclictest0-21swapper/209:35:012
167065399247,5cyclictest0-21swapper/210:19:482
167065399247,4cyclictest0-21swapper/208:16:002
1670653992419,4cyclictest1899898-21unixbench_singl10:56:072
1670653992419,3cyclictest1956051-21tail11:55:562
167065399240,11cyclictest1770344-21awk08:45:592
167065099246,3cyclictest161rcu_preempt12:30:501
167065099243,11cyclictest30-21ksoftirqd/107:35:501
1670648992419,3cyclictest0-21swapper/008:30:010
1670648992417,5cyclictest1815121-21ntpq09:30:590
167065399239,4cyclictest39-21ksoftirqd/209:01:002
167065399235,4cyclictest0-21swapper/209:20:592
167065399235,3cyclictest161rcu_preempt08:35:482
167065399232,12cyclictest39-21ksoftirqd/208:14:372
1670653992319,2cyclictest1796813-21cut09:15:522
1670653992319,2cyclictest1796813-21cut09:15:522
1670653992319,2cyclictest1746595-21cron08:25:002
1670653992319,2cyclictest0-21swapper/207:40:012
1670653992318,3cyclictest1935324-21tr11:35:512
1670653992317,4cyclictest1874947-21unixbench_multi10:31:092
167065399230,8cyclictest1707859-21awk07:45:552
167065399230,5cyclictest1776759-21apt-get08:55:492
167065399230,12cyclictest1869923-21sed10:26:082
167065399230,11cyclictest1894915-21awk10:51:092
167065099237,5cyclictest0-21swapper/108:05:571
1670648992319,3cyclictest1855164-21unixbench_singl10:11:080
1670648992314,6cyclictest1949092-21ntpq11:46:050
1670648992312,8cyclictest1915340-21apt-get11:15:530
167065399226,3cyclictest161rcu_preempt12:06:002
167065399226,3cyclictest161rcu_preempt10:41:012
167065399226,2cyclictest161rcu_preempt12:30:482
167065399223,5cyclictest0-21swapper/207:11:072
167065399222,9cyclictest0-21swapper/210:11:062
1670653992218,3cyclictest1841248-21cpuspeed_turbos10:00:522
1670653992218,2cyclictest0-21swapper/209:50:492
1670653992216,4cyclictest1890034-21unixbench_singl10:46:102
167065399220,12cyclictest1901948-21grep11:00:582
167064899228,13cyclictest1771289-21kworker/0:0+events12:03:350
167064899227,13cyclictest1682407-21kworker/0:0+events07:21:030
167064899226,13cyclictest1682407-21kworker/0:0+events07:40:480
1670648992218,2cyclictest0-21swapper/011:45:010
167064899220,20cyclictest1771289-21kworker/0:0+events11:30:010
16696892222,12sleep11669708-21ntpq07:06:061
18254922210,2sleep3481ktimers/309:41:083
167065399215,3cyclictest161rcu_preempt08:01:082
167065399215,3cyclictest161rcu_preempt07:56:022
167065399213,4cyclictest0-21swapper/208:30:572
167065399212,9cyclictest0-21swapper/211:14:142
167065399212,9cyclictest0-21swapper/211:14:132
1670653992117,3cyclictest1960310-21cpuspeed_turbos12:00:492
1670653992117,2cyclictest0-21swapper/210:05:522
167065399210,5cyclictest1865427-21munin-run10:25:002
1670648992111,7cyclictest1909213-21ntpq11:06:020
167065399208,2cyclictest161rcu_preempt07:30:532
1670653992016,2cyclictest0-21swapper/212:20:552
167065399196,2cyclictest161rcu_preempt07:40:342
167065399192,9cyclictest0-21swapper/209:05:582
167065399190,5cyclictest1927408-21ps11:25:582
16703512193,9sleep30-21swapper/307:08:233
18619352164,9sleep30-21swapper/310:20:583
19766162140,2chrt75-21kworker/3:1+events12:15:583
17792612145,5sleep30-21swapper/308:55:583
17712422144,5sleep30-21swapper/308:50:013
19736982132,7sleep30-21swapper/312:11:013
19488552132,7sleep30-21swapper/311:46:003
19336682132,7sleep30-21swapper/311:30:593
19113122132,7sleep30-21swapper/311:10:583
19113122132,7sleep30-21swapper/311:10:583
19051642132,7sleep30-21swapper/311:04:593
18165012134,5sleep30-21swapper/309:35:523
17367412132,6sleep30-21swapper/308:15:023
17160552132,7sleep30-21swapper/307:51:023
19801112122,6sleep30-21swapper/312:20:523
19597862122,5sleep30-21swapper/312:00:023
19500202122,6sleep30-21swapper/311:50:023
19347652122,5sleep30-21swapper/311:35:023
19264322122,6sleep30-21swapper/311:25:593
19197632123,5sleep30-21swapper/311:17:363
18952802122,5sleep30-21swapper/310:55:013
18893742122,6sleep30-21swapper/310:46:013
18842932122,6sleep30-21swapper/310:41:003
18784242122,6sleep30-21swapper/310:35:593
18399192122,6sleep30-21swapper/309:56:053
18110952122,5sleep30-21swapper/309:30:023
17915112122,6sleep30-21swapper/309:10:103
17708042122,6sleep30-21swapper/308:46:083
17614902122,5sleep30-21swapper/308:40:023
17575112122,6sleep30-21swapper/308:35:563
17507332122,6sleep30-21swapper/308:26:053
17458042123,5sleep30-21swapper/308:21:033
17213242122,6sleep30-21swapper/307:56:083
17077972122,6sleep30-21swapper/307:45:573
16969892122,6sleep30-21swapper/307:32:523
16827162122,6sleep30-21swapper/307:20:533
16759902122,6sleep30-21swapper/307:15:033
16759902122,6sleep30-21swapper/307:15:023
19951682112,5sleep30-21swapper/312:35:523
19902382112,5sleep30-21swapper/312:30:553
19654682112,5sleep30-21swapper/312:05:553
19551032112,5sleep30-21swapper/311:55:483
19402742112,5sleep30-21swapper/311:40:473
19199772112,5sleep30-21swapper/311:20:013
19094892112,5sleep30-21swapper/311:06:083
18956092112,5sleep30-21swapper/310:55:493
18709212112,5sleep30-21swapper/310:30:533
18657412112,5sleep30-21swapper/310:25:523
18558252112,6sleep30-21swapper/310:15:523
18507952112,5sleep30-21swapper/310:10:013
18460232112,5sleep30-21swapper/310:05:533
18410332112,5sleep30-21swapper/310:00:523
18310642113,5sleep30-21swapper/309:50:163
18261142112,5sleep30-21swapper/309:45:033
18067012113,5sleep30-21swapper/309:25:523
18027382112,5sleep30-21swapper/309:20:593
17962262112,5sleep30-21swapper/309:15:013
17962262112,5sleep30-21swapper/309:15:013
17865032112,5sleep30-21swapper/309:05:023
17816882112,5sleep30-21swapper/309:00:483
17517432112,5sleep30-21swapper/308:30:033
17321802112,5sleep30-21swapper/308:10:523
17271902112,5sleep30-21swapper/308:05:543
17224772112,5sleep30-21swapper/308:00:533
17023792112,5sleep30-21swapper/307:40:033
16974832112,5sleep30-21swapper/307:35:493
16709132112,5sleep30-21swapper/307:10:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional