You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 10:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sat Aug 15, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
162031123220,3sleep3575-21kworker/3:2+events20:47:593
158762521360,4sleep3481ktimers/320:17:493
16392042710,3sleep1161rcu_preempt21:07:511
15426772600,3chrt281rcuc/119:32:491
15159102580,5chrt0-21swapper/019:07:480
1519357995751,4cyclictest1810356-21cp00:00:002
16737162540,4chrt371rcuc/221:42:512
1519355995446,6cyclictest1626141-21/usr/sbin/munin20:57:591
1519355995042,6cyclictest1524284-21latency_hist19:15:011
1519351994940,6cyclictest1665583-21latency_hist21:35:010
1519351994840,6cyclictest275-21systemd-journal22:45:000
1519351994838,7cyclictest1700909-21latency_hist22:10:010
1519351994737,7cyclictest1550506-21ntpq19:37:520
1519351994641,4cyclictest1691277-21kworker/u8:1+flush-8:022:02:460
1519355994540,4cyclictest1715960-21kworker/u8:0+flush-8:022:27:561
1519355994538,5cyclictest1691277-21kworker/u8:1+flush-8:022:07:581
1519351994539,3cyclictest1-21systemd20:40:000
1519351994537,6cyclictest1710784-21latency_hist22:20:010
1519355994438,5cyclictest187032-21kworker/u8:0+flush-8:020:52:581
1519351994436,5cyclictest1580969-21latency_hist20:10:010
1519351994339,3cyclictest1556056-21kworker/u8:2+flush-8:019:47:570
1519351994337,4cyclictest1690791-21apt-get22:00:010
1519355994236,4cyclictest1615695-21gpgv20:45:001
1519351994234,6cyclictest275-21systemd-journal22:53:080
17016112410,2chrt1519345-21cyclictest22:12:431
15867612410,1sleep01586763-21basename20:17:460
1519357994130,9cyclictest1725865-21awk22:35:002
1519351994134,5cyclictest1776111-21apt-get23:27:410
1519351994134,5cyclictest1641036-21apt-get21:12:400
1519355994034,5cyclictest1715960-21kworker/u8:0+flush-8:022:47:581
1519355994030,7cyclictest1730843-21latency_hist22:40:011
1519351994035,4cyclictest187032-21kworker/u8:0+flush-8:020:52:440
1519351993934,3cyclictest1625730-21kworker/u8:3+flush-8:021:02:570
1519351993934,3cyclictest1625730-21kworker/u8:3+flush-8:021:02:570
1519351993933,4cyclictest1810430-21kworker/u8:3+flush-8:000:05:000
1519351993930,6cyclictest1715941-21latency_hist22:25:010
1519351993929,7cyclictest1540351-21ntpq19:27:530
1519355993833,4cyclictest1519231-21kworker/u8:3+flush-8:019:42:441
1519355993829,7cyclictest1756306-21apt-get23:07:411
1519355993829,6cyclictest275-21systemd-journal22:58:081
1519355993828,7cyclictest275-21systemd-journal20:40:001
1519351993833,4cyclictest1751125-21kworker/u8:1+flush-8:023:12:580
1519351993833,3cyclictest1810430-21kworker/u8:3+flush-8:000:12:450
1519351993832,5cyclictest187032-21kworker/u8:0+events_unbound20:00:010
1519351993832,4cyclictest1805830-21apt-get23:57:400
1519351993832,4cyclictest1635848-21kworker/u8:2+events_unbound23:35:010
151935199381,33cyclictest1740775-21munin-run22:50:000
15146642384,9sleep10-21swapper/119:06:261
1519357993730,5cyclictest1745813-21journal-offline22:53:482
1519355993730,5cyclictest275-21systemd-journal22:34:081
1519351993730,5cyclictest1751125-21kworker/u8:1+flush-8:023:47:580
1519355993631,4cyclictest1815650-21kworker/u8:4+flush-8:000:22:591
1519355993627,6cyclictest1531174-21latency_hist19:20:011
1519351993631,4cyclictest1751125-21kworker/u8:1+flush-8:023:08:040
1519351993631,3cyclictest1524544-21irqcore19:15:010
1519351993630,4cyclictest1541769-21apt-get19:32:410
1519355993528,5cyclictest1841610-21irqrtprio00:32:481
1519351993530,3cyclictest1800437-21kworker/u8:0+flush-8:000:20:010
1519357993430,3cyclictest1487150-21kworker/u8:1+flush-8:019:17:542
1519351993425,7cyclictest275-21systemd-journal21:30:000
1519355993328,3cyclictest275-21systemd-journal23:58:091
1519355993328,3cyclictest1519231-21kworker/u8:3+events_unbound20:02:461
1519351993328,4cyclictest1800437-21kworker/u8:0+events_unbound00:22:580
1519351993327,5cyclictest1715960-21kworker/u8:0+flush-8:022:32:590
1519351993327,4cyclictest1635848-21kworker/u8:2+flush-8:021:52:500
1519351993326,5cyclictest1585899-21latency_hist20:15:010
1519357993225,5cyclictest1710783-21apt22:20:002
1519357993225,5cyclictest1556056-21kworker/u8:2+flush-8:019:52:542
1519355993228,3cyclictest1745767-21kworker/u8:3+flush-8:023:02:561
1519355993227,3cyclictest1776831-21irqrtprio23:27:481
1519355993226,4cyclictest1815650-21kworker/u8:4+events_unbound00:17:551
1519355993226,4cyclictest1631727-21irqcore21:02:471
1519355993226,4cyclictest1631727-21irqcore21:02:471
1519355993226,4cyclictest1565821-21grep19:52:581
1519355993225,5cyclictest1825077-21grep00:13:001
1519355993222,8cyclictest1735041-21ntpq22:42:551
1519351993227,3cyclictest1556056-21kworker/u8:2+events_unbound19:52:400
1519357993125,4cyclictest1815650-21kworker/u8:4+events_unbound00:22:482
1519355993126,4cyclictest1770929-21kworker/u8:3+flush-8:023:32:481
1519355993125,5cyclictest1681123-21kworker/u8:3+events_unbound21:52:431
1519355993125,4cyclictest1751125-21kworker/u8:1+flush-8:023:12:541
1519355993122,7cyclictest275-21systemd-journal19:23:051
1519355993121,8cyclictest1580268-21ntpq20:07:561
1519351993127,3cyclictest1519231-21kworker/u8:3+events_unbound19:22:560
1519351993125,4cyclictest1815650-21kworker/u8:4+events_unbound00:32:440
1519351993124,6cyclictest1635848-21kworker/u8:2+flush-8:023:37:520
1519351993124,5cyclictest1645367-21kworker/u8:3+events_unbound21:17:530
1519357993026,3cyclictest1590828-21cron20:20:002
1519357993025,3cyclictest1825074-21unixbench_multi00:13:002
1519355993026,3cyclictest1660924-21kworker/u8:1+flush-8:021:47:441
1519355993024,4cyclictest1569661-21kthreadcore19:57:501
1519355993022,6cyclictest1556739-21aten2_r5power_v19:47:421
1519351993026,2cyclictest1600776-21systemd-run20:30:000
1519351993024,5cyclictest1715960-21kworker/u8:0+events_unbound22:37:530
1519351993023,5cyclictest1850468-21gpgv00:40:010
1519357992925,2cyclictest1770717-21systemd-run23:20:012
1519357992923,4cyclictest1715960-21kworker/u8:0+events_unbound22:42:432
1519357992922,5cyclictest1785551-21cron23:35:002
1519355992925,3cyclictest1800437-21kworker/u8:0+events_unbound00:38:411
1519355992924,4cyclictest1635848-21kworker/u8:2+flush-8:023:49:221
1519355992924,4cyclictest1487150-21kworker/u8:1+flush-8:019:35:051
1519355992923,5cyclictest1656194-21aten2_r5power_c21:27:421
1519355992922,5cyclictest1791013-21aten2_r5power_c23:42:431
1519355992920,7cyclictest1810836-21/usr/sbin/munin00:02:501
1519351992925,3cyclictest1715960-21kworker/u8:0+flush-8:022:57:590
1519351992925,3cyclictest1591096-21kworker/u8:2+flush-8:020:22:590
1519351992923,4cyclictest1751658-21grep23:02:420
1519357992824,3cyclictest1660631-21munin-plugin-st21:30:002
1519357992821,5cyclictest1763406-21kthreadcore23:12:492
1519355992823,3cyclictest1805399-21systemd-run23:55:001
1519355992823,3cyclictest1650938-21kworker/u8:4+flush-8:021:22:511
1519355992823,2cyclictest0-21swapper/122:20:001
1519355992822,4cyclictest1691277-21kworker/u8:1+flush-8:022:22:561
1519355992821,6cyclictest1581506-21aten2_r5power_p20:12:431
1519351992824,3cyclictest1605477-21unixbench_singl20:33:000
1519351992823,4cyclictest1519231-21kworker/u8:3+events_unbound19:42:430
1519351992823,3cyclictest1715960-21kworker/u8:0+events_unbound22:27:460
1519351992822,4cyclictest187032-21kworker/u8:0+events_unbound19:12:520
1519351992819,7cyclictest1671198-21/usr/sbin/munin21:42:590
1519357992719,6cyclictest1636338-21cut21:07:452
1519355992723,3cyclictest1800437-21kworker/u8:0+flush-8:000:08:001
1519355992723,3cyclictest1800437-21kworker/u8:0+flush-8:000:08:001
1519355992723,3cyclictest1519231-21kworker/u8:3+events_unbound20:22:501
1519355992720,5cyclictest1770701-21sendmail23:20:001
1519355992720,5cyclictest1536576-21apt-get19:27:401
1519351992723,3cyclictest1815650-21kworker/u8:4+events_unbound00:25:410
1519351992723,3cyclictest1705841-21systemd-run22:15:000
1519351992723,3cyclictest1605509-21kworker/u8:1+flush-8:020:40:310
1519351992722,3cyclictest1616993-21irqrtprio20:47:470
1519351992720,5cyclictest1751125-21kworker/u8:1+events_unbound23:52:480
17336662260,5sleep3481ktimers/322:42:513
1519357992616,8cyclictest1700906-21awk22:10:002
1519357992616,8cyclictest1650704-21awk21:20:002
1519355992623,2cyclictest1598427-21kthreadcore20:27:491
1519355992622,2cyclictest0-21swapper/123:22:491
1519355992622,2cyclictest0-21swapper/121:17:461
1519355992621,4cyclictest1566971-21kworker/u8:1+events_unbound20:17:541
1519355992621,3cyclictest1645522-21latency_hist21:15:011
1519355992619,4cyclictest1691277-21kworker/u8:1+events_unbound22:05:001
1519351992622,3cyclictest1680851-21apt-key21:50:010
1519351992621,3cyclictest844-21mta-sts-daemon23:17:440
1519357992522,2cyclictest1551918-21tr19:42:432
1519357992521,2cyclictest1661299-21cpuspeed_turbos21:32:422
1519355992521,2cyclictest0-21swapper/121:37:441
1519355992519,4cyclictest1770929-21kworker/u8:3+events_unbound23:37:591
1519351992520,4cyclictest187032-21kworker/u8:0+flush-8:020:56:120
1519351992519,4cyclictest1771151-21apt-get23:22:380
1519357992420,2cyclictest1816062-21cpuspeed_turbos00:07:442
1519357992420,2cyclictest1816062-21cpuspeed_turbos00:07:442
1519357992415,7cyclictest1616275-21apt-get20:47:402
151935799240,22cyclictest1830346-21munin-run00:20:012
1519355992420,2cyclictest0-21swapper/121:32:491
1519355992419,4cyclictest1635848-21kworker/u8:2+flush-8:021:42:451
1519355992418,4cyclictest1745949-21latency_hist22:55:001
1519355992417,5cyclictest1838107-21kthreadcore00:27:491
151935199242,2cyclictest421rcuog/221:22:430
1519351992420,3cyclictest1751125-21kworker/u8:1+events_unbound23:42:440
1519351992420,3cyclictest1575239-21needreboot20:02:510
1519351992419,4cyclictest187032-21kworker/u8:0+events_unbound21:37:530
1519351992418,5cyclictest1635848-21kworker/u8:2+events_unbound21:08:010
1519357992319,2cyclictest1685816-21cron21:55:002
1519357992315,2cyclictest521rcuop/300:27:412
1519357992313,8cyclictest1780619-21cat23:30:002
151935799231,11cyclictest1600744-21cron20:30:002
1519355992319,2cyclictest0-21swapper/120:47:581
1519355992314,7cyclictest1690792-21latency_hist22:00:011
1519351992319,3cyclictest1810430-21kworker/u8:3+events_unbound00:07:180
1519351992319,3cyclictest1810430-21kworker/u8:3+events_unbound00:07:180
1519357992219,2cyclictest1571597-21aten2_r5power_e20:02:412
1519357992218,2cyclictest1800986-21aten2_r5power_v23:52:432
1519357992218,2cyclictest0-21swapper/222:22:512
1519357992217,4cyclictest1536944-21cut19:27:452
1519357992217,3cyclictest1846034-21cpuspeed_turbos00:37:422
1519357992215,5cyclictest1645707-21base6421:15:012
1519357992215,5cyclictest1578856-21cut20:07:512
1519355992217,3cyclictest1519231-21kworker/u8:3+flush-8:020:32:491
17136122210,3sleep3575-21kworker/3:2-events22:22:493
165565722114,4sleep30-21swapper/321:24:273
1519357992118,2cyclictest1631429-21fschecks_count21:02:452
1519357992118,2cyclictest1631429-21fschecks_count21:02:452
1519357992118,2cyclictest1546006-21unixbench_multi19:33:012
1519357992117,2cyclictest1676242-21aten2_r5power_p21:47:422
1519357992110,8cyclictest1601204-21apt-get20:32:402
151935799210,8cyclictest17016102/usr/sbin/munin22:12:432
1519357992017,2cyclictest1815379-21cron00:05:002
1519357992016,3cyclictest0-21swapper/220:45:002
1519357992016,2cyclictest1520038-21fschecks_time19:12:442
1519357992015,3cyclictest1585682-21unixbench_singl20:13:022
1519357992015,3cyclictest0-21swapper/222:27:442
151935799192,16cyclictest0-21swapper/220:57:592
1519357991915,3cyclictest1795451-21cron23:45:002
1519357991915,2cyclictest0-21swapper/222:50:002
1519357991915,2cyclictest0-21swapper/219:23:012
1519357991914,4cyclictest1566833-21fschecks_time19:57:442
1519357991910,7cyclictest1749421-21tr22:57:502
151935799190,6cyclictest1547893-21tr19:37:472
15147282193,9sleep30-21swapper/319:07:163
15145622194,10sleep20-21swapper/219:05:062
151935799189,7cyclictest1651138-21munin-node21:22:402
151935799182,11cyclictest1624948-21ntpq20:52:522
1519357991815,2cyclictest0-21swapper/222:00:002
1519357991814,2cyclictest0-21swapper/223:08:012
151935799181,12cyclictest1751345-21apt-get23:02:402
1519357991810,6cyclictest1670505-21cron21:40:002
1519357991714,2cyclictest1800198-21unixbench_singl23:48:002
1519357991714,2cyclictest1726343-21aten2_r5power_c22:37:422
1519357991713,2cyclictest0-21swapper/223:37:472
1519357991713,2cyclictest0-21swapper/223:22:562
1519357991713,2cyclictest0-21swapper/220:37:422
151935799167,7cyclictest1558387-21cut19:47:492
1519357991613,2cyclictest1591425-21aten2_r5power_v20:22:432
1519357991612,2cyclictest0-21swapper/222:05:012
1519357991511,2cyclictest0-21swapper/200:32:402
18210372134,5sleep30-21swapper/300:12:443
17659262132,6sleep30-21swapper/323:15:023
17607722132,7sleep30-21swapper/323:10:013
17515862133,7sleep30-21swapper/323:02:423
16606102130,7sleep30-21swapper/321:30:023
16462082132,7sleep30-21swapper/321:17:413
16106792132,6sleep30-21swapper/320:40:013
15672142133,7sleep30-21swapper/319:57:483
18460702122,6sleep30-21swapper/300:37:443
18412562122,6sleep30-21swapper/300:32:473
18259412122,6sleep30-21swapper/300:17:423
18102172122,6sleep30-21swapper/323:59:003
18012442122,6sleep30-21swapper/323:52:473
17926032122,6sleep30-21swapper/323:42:513
17898872122,6sleep30-21swapper/323:37:573
17853652122,6sleep30-21swapper/323:33:003
17508622122,5sleep30-21swapper/323:00:013
17411832122,7sleep30-21swapper/322:50:023
17401082122,6sleep30-21swapper/322:47:583
17259822122,6sleep30-21swapper/322:35:023
17161662122,5sleep30-21swapper/322:25:023
17063782122,6sleep30-21swapper/322:17:443
17009572122,6sleep30-21swapper/322:10:023
16878512123,6sleep30-21swapper/321:57:503
16815952122,6sleep30-21swapper/321:52:443
16698942123,6sleep30-21swapper/321:37:563
16615462122,6sleep30-21swapper/321:32:463
16356932122,6sleep30-21swapper/321:05:013
15962722122,6sleep30-21swapper/320:27:413
15910882122,6sleep30-21swapper/320:20:073
15715442122,6sleep30-21swapper/320:02:423
15465772122,6sleep30-21swapper/319:36:053
15457862122,6sleep30-21swapper/319:33:003
15365802122,7sleep30-21swapper/319:27:433
15316602122,6sleep30-21swapper/319:22:453
15266862122,6sleep30-21swapper/319:17:473
18357972112,6sleep30-21swapper/300:26:043
18312042112,5sleep30-21swapper/300:22:433
18158472112,5sleep30-21swapper/300:07:433
18158472112,5sleep30-21swapper/300:07:433
18152882112,6sleep30-21swapper/300:03:533
17957052112,6sleep30-21swapper/323:45:163
17756732112,5sleep30-21swapper/323:25:013
17710852112,6sleep30-21swapper/323:22:083
17649892112,5sleep30-21swapper/323:12:533
17212002112,6sleep30-21swapper/322:30:443
16962412112,6sleep30-21swapper/322:05:363
16918652111,6sleep30-21swapper/322:02:473
16757312112,5sleep30-21swapper/321:45:023
16710382112,5sleep30-21swapper/321:40:363
16450302112,6sleep30-21swapper/321:13:003
16310402112,6sleep30-21swapper/321:01:443
16310402112,6sleep30-21swapper/321:01:443
16259632112,6sleep30-21swapper/320:55:223
16216012112,5sleep30-21swapper/320:52:453
16059592112,6sleep30-21swapper/320:35:483
16009752112,5sleep30-21swapper/320:30:023
15813942112,5sleep30-21swapper/320:12:413
15762582112,5sleep30-21swapper/320:05:023
15614342112,6sleep30-21swapper/319:51:063
15564122112,6sleep30-21swapper/319:45:123
15516642112,5sleep30-21swapper/319:42:393
15196092112,6sleep30-21swapper/319:11:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional