You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-22 - 18:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sat Aug 22, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
149682323610,6sleep30-21swapper/307:52:423
15148192670,3chrt201rcuc/008:07:520
1453698995749,6cyclictest1733545-21latency_hist11:50:010
1453698995651,4cyclictest1475591-21kworker/u8:3+events_unbound08:47:540
1453701995550,3cyclictest1733560-21kworker/u8:0+flush-8:012:00:001
1453701995549,4cyclictest1453578-21kworker/u8:2+events_unbound09:05:001
1453698995550,3cyclictest1694289-21kworker/u8:2+events_unbound11:40:000
1453701995348,4cyclictest1555064-21kworker/u8:0+flush-8:009:42:521
1453701995145,4cyclictest1609999-21kworker/u8:3+events_unbound10:00:011
1453701995045,4cyclictest1733560-21kworker/u8:0+flush-8:012:07:531
1453701995045,4cyclictest1733560-21kworker/u8:0+flush-8:012:07:531
1453701995043,5cyclictest1505781-21kworker/u8:1+flush-8:008:02:381
1453701994943,5cyclictest1505781-21kworker/u8:1+flush-8:008:22:521
1453701994943,4cyclictest1555064-21kworker/u8:0+events_unbound10:27:381
1453701994843,3cyclictest1694289-21kworker/u8:2+events_unbound11:32:541
1453701994842,5cyclictest1694289-21kworker/u8:2+flush-8:011:12:441
1453701994841,5cyclictest1580294-21kworker/u8:4+flush-8:009:22:481
1453701994837,8cyclictest275-21systemd-journal11:06:181
1453698994838,8cyclictest1739170-21diskstats11:57:390
16431852470,3sleep3575-21kworker/3:2-events10:17:453
1453701994739,6cyclictest1630013-21apt-get10:07:351
1453703994639,5cyclictest1565163-21base6409:00:002
1453701994641,4cyclictest1418855-21kworker/u8:1+events_unbound07:17:531
1453701994640,5cyclictest1669310-21kworker/u8:0+events_unbound10:52:431
1453701994540,4cyclictest1718561-21kworker/u8:3+flush-8:012:02:531
1453701994540,4cyclictest1555064-21kworker/u8:0+flush-8:009:47:441
1453703994435,7cyclictest275-21systemd-journal09:20:002
1453701994440,3cyclictest1426351-21kworker/u8:0+flush-8:007:22:501
1453701994439,3cyclictest1555064-21kworker/u8:0+events_unbound08:57:371
1453701994438,5cyclictest1475591-21kworker/u8:3+flush-8:008:47:501
1453701994438,4cyclictest1694289-21kworker/u8:2+flush-8:011:22:581
1453701994438,4cyclictest1570142-21kworker/u8:1+flush-8:009:07:441
1453701994437,5cyclictest1718561-21kworker/u8:3+flush-8:011:52:501
1453701994340,2cyclictest1758506-21kworker/u8:3+events_unbound12:17:431
1453701994338,4cyclictest1580294-21kworker/u8:4+flush-8:009:27:391
1453701994338,3cyclictest1418855-21kworker/u8:1+flush-8:007:42:431
1453701994338,3cyclictest1418855-21kworker/u8:1+flush-8:007:42:431
1453701994337,5cyclictest1654044-21kworker/u8:1+events_unbound11:17:471
1453701994337,4cyclictest1418855-21kworker/u8:1+flush-8:007:52:501
1453701994337,4cyclictest1418855-21kworker/u8:1+flush-8:007:37:521
1453701994336,5cyclictest1727898-21ntpq11:42:491
1453701994336,5cyclictest1599836-21kworker/u8:2+flush-8:010:22:501
144905324327,10sleep10-21swapper/107:06:581
1453701994238,3cyclictest1453578-21kworker/u8:2+flush-8:008:20:011
1453701994237,4cyclictest1748203-21kworker/u8:2+events_unbound12:27:371
1453701994236,5cyclictest1773446-21kworker/u8:1+flush-8:012:37:431
1453701994236,4cyclictest1748203-21kworker/u8:2+flush-8:012:22:491
1453701994235,5cyclictest1475591-21kworker/u8:3+flush-8:008:12:501
1453701994234,5cyclictest275-21systemd-journal10:42:181
1453701994232,7cyclictest1474934-21ntpq07:27:521
1453698994238,3cyclictest1555064-21kworker/u8:0+events_unbound09:37:420
1453701994137,3cyclictest1773446-21kworker/u8:1+flush-8:012:32:411
1453701994137,3cyclictest1718561-21kworker/u8:3+flush-8:011:38:201
1453701994136,4cyclictest1555064-21kworker/u8:0+flush-8:009:52:481
1453701994135,5cyclictest1453578-21kworker/u8:2+events_unbound07:32:381
1453701994035,4cyclictest1654044-21kworker/u8:1+events_unbound11:27:391
1453701994035,4cyclictest1599836-21kworker/u8:2+flush-8:009:37:541
1453701993935,3cyclictest1599836-21kworker/u8:2+events_unbound09:35:011
1453701993932,5cyclictest1654044-21kworker/u8:1+flush-8:010:32:431
1453701993929,3cyclictest1475591-21kworker/u8:3+events_unbound08:32:411
1453698993930,7cyclictest1594920-21latency_hist09:30:010
1453701993833,4cyclictest1580294-21kworker/u8:4+events_unbound09:17:541
1453701993833,3cyclictest1555064-21kworker/u8:0+flush-8:010:02:431
1453701993832,4cyclictest1570142-21kworker/u8:1+flush-8:009:12:541
1453701993832,4cyclictest1570142-21kworker/u8:1+flush-8:009:12:541
1453701993832,4cyclictest1555064-21kworker/u8:0+flush-8:010:17:541
1453701993831,5cyclictest1729053-21apt-get11:47:341
1453701993831,5cyclictest1475591-21kworker/u8:3+flush-8:007:57:491
1453698993831,5cyclictest1549900-21grep08:42:560
1453698993830,6cyclictest1639407-21latency_hist10:15:010
1453698993829,6cyclictest1614745-21latency_hist09:50:010
1453698993828,8cyclictest1757517-21ntpq12:12:480
145369899380,36cyclictest1-21systemd10:51:180
1453701993731,5cyclictest1654044-21kworker/u8:1+flush-8:010:37:391
1453701993731,5cyclictest1654044-21kworker/u8:1+flush-8:010:37:391
1453703993627,7cyclictest1490601-21gpgv07:45:002
1453703993627,7cyclictest1490601-21gpgv07:45:002
1453701993632,3cyclictest1555064-21kworker/u8:0+events_unbound10:12:431
1453701993631,3cyclictest1748203-21kworker/u8:2+events_unbound12:12:441
1453698993630,4cyclictest401-21dbus-daemon07:30:000
1453698993629,5cyclictest1457877-21ntpq07:12:480
1453701993530,4cyclictest1654044-21kworker/u8:1+flush-8:010:47:381
1453701993526,6cyclictest275-21systemd-journal08:08:181
1453698993528,5cyclictest1570142-21kworker/u8:1+events_unbound09:07:500
1453698993525,7cyclictest1490494-21latency_hist07:45:000
1453698993525,7cyclictest1490494-21latency_hist07:45:000
1453701993429,4cyclictest1475591-21kworker/u8:3+events_unbound08:37:461
1453701993429,4cyclictest1453578-21kworker/u8:2+flush-8:007:47:571
1453698993410,16cyclictest1648881-21cat10:22:550
1453701993329,3cyclictest1669310-21kworker/u8:0+flush-8:011:02:541
1453701993327,4cyclictest1475591-21kworker/u8:3+flush-8:008:27:481
1453698993324,6cyclictest1654044-21kworker/u8:1+flush-8:011:32:490
1453698993310,15cyclictest1463438-21cut07:17:430
16523932320,2sleep3481ktimers/310:27:443
1453701993227,4cyclictest1418855-21kworker/u8:1+flush-8:007:10:311
1453698993225,5cyclictest1748367-21latency_hist12:05:000
1453698993221,8cyclictest1658400-21ntpq10:32:480
1453701993126,4cyclictest1505781-21kworker/u8:1+events_unbound08:42:471
145369899319,6cyclictest1705492-21cat11:22:440
145369899319,6cyclictest1680609-21cat10:57:440
145369899313,16cyclictest1693546-21python311:07:530
1453698993124,4cyclictest1619645-21cron09:55:000
1453698993121,8cyclictest1764292-21irqcore12:22:420
1453698993110,5cyclictest1529946-21sed08:22:540
14490292314,9sleep20-21swapper/207:06:392
1453703993026,3cyclictest1496136-21aten2_r5power_c07:52:372
1453703993025,3cyclictest1654044-21kworker/u8:1+flush-8:011:25:012
1453703993025,3cyclictest1620449-21fschecks_time09:57:392
1453703993023,5cyclictest1675225-21irqrtprio10:52:432
1453701993026,3cyclictest1609999-21kworker/u8:3+flush-8:010:57:071
1453698993026,2cyclictest0-21swapper/008:55:000
145369899302,27cyclictest646713-21kworker/0:3+events12:32:460
145369899300,6cyclictest1493116-21cat07:47:450
145369899300,14cyclictest1465433-21apt-get07:20:030
1453703992925,3cyclictest1767964-21unixbench_singl12:22:552
1453701992924,4cyclictest1475591-21kworker/u8:3+events_unbound08:52:381
145369899299,9cyclictest1584549-21python309:17:540
145369899295,13cyclictest1501023-21/usr/sbin/munin07:57:340
1453698992925,2cyclictest1479746-21needreboot07:32:460
1453698992918,8cyclictest1688863-21latency_hist11:05:010
145369899290,16cyclictest1579405-21ntpq09:12:510
145369899290,16cyclictest1579405-21ntpq09:12:510
145369899285,13cyclictest1735299-21cut11:52:430
1453698992821,5cyclictest1728332-21grep11:42:550
1453698992814,2cyclictest0-21swapper/009:42:410
145369899281,15cyclictest1673345-21ntpq10:47:490
1453703992722,3cyclictest1534906-21unixbench_multi08:27:542
1453703992722,3cyclictest1510267-21unixbench_multi08:02:552
1453703992721,4cyclictest1689267-21base6411:05:012
145369899274,12cyclictest1713075-21ntpq11:27:490
145369899273,10cyclictest1543608-21kthreadcore08:37:450
1453698992721,4cyclictest1475591-21kworker/u8:3+flush-8:008:17:230
145369899272,12cyclictest0-21swapper/012:17:360
1453698992716,2cyclictest1589332-21ntpq09:22:500
1453698992713,2cyclictest0-21swapper/011:12:460
145369899270,15cyclictest1653565-21ntp_states10:27:490
145369899270,15cyclictest1499317-21kthreadcore07:52:450
145369899270,14cyclictest1622847-21kthreadcore09:57:440
1453703992623,2cyclictest1683921-21cron11:00:002
1453703992623,2cyclictest1569906-21unixbench_singl09:02:562
1453703992622,2cyclictest1610502-21fschecks_count09:47:412
145369899263,14cyclictest1770870-21kthreadcore12:27:450
145369899263,13cyclictest1562795-21kthreadcore08:57:450
145369899263,11cyclictest1781423-21cut12:37:450
1453698992617,2cyclictest161rcu_preempt09:03:410
1453698992616,3cyclictest161rcu_preempt10:17:450
1453698992615,3cyclictest161rcu_preempt08:27:450
1453698992614,3cyclictest1660876-21grep10:37:440
1453698992614,3cyclictest1660876-21grep10:37:440
1453698992612,2cyclictest0-21swapper/007:37:550
145369899260,17cyclictest1596636-21grep09:32:450
145369899260,11cyclictest1507647-21kthreadcore08:02:440
145369899260,10cyclictest1634510-21awk10:10:000
17156712250,2sleep3575-21kworker/3:2+events11:32:453
1453703992522,2cyclictest1758945-21cpuspeed_turbos12:17:382
1453703992521,2cyclictest1649829-21aten2_r5power_p10:27:372
1453703992521,2cyclictest1595714-21fschecks_time09:32:412
1453703992520,4cyclictest1453578-21kworker/u8:2-ext4-rsv-conversion08:10:002
1453703992520,3cyclictest1476052-21aten2_r5power_c07:32:362
145369899253,9cyclictest1625309-21cpuspeed_turbos10:02:380
1453698992514,2cyclictest1699404-21/usr/sbin/munin11:17:420
1453698992512,2cyclictest0-21swapper/008:12:570
145369899251,14cyclictest1668312-21ntpq10:42:480
145369899251,12cyclictest1535699-21aten2_r5power_p08:32:380
1453703992421,2cyclictest1663934-21unixbench_singl10:37:562
1453703992421,2cyclictest1663934-21unixbench_singl10:37:562
1453703992420,2cyclictest1634488-21cron10:10:002
1453703992420,2cyclictest1549860-21unixbench_multi08:42:562
1453698992411,2cyclictest0-21swapper/012:07:370
1453698992411,2cyclictest0-21swapper/012:07:370
1453703992320,2cyclictest1635028-21aten2_r5power_p10:12:372
1453703992319,3cyclictest1585843-21fschecks_time09:22:402
1453703992319,2cyclictest1728393-21unixbench_singl11:42:552
1453703992319,2cyclictest1694585-21aten2_r5power_v11:12:382
1453703992318,3cyclictest1782817-21unixbench_singl12:37:552
1453703992218,3cyclictest1605491-21cpuspeed_turbos09:42:362
1453703992218,2cyclictest1744164-21fschecks_count12:02:392
1453703992218,2cyclictest1470664-21cron07:25:002
1453703992218,2cyclictest0-21swapper/207:20:002
145370399212,14cyclictest1520797-21apt-get08:17:362
145370399212,13cyclictest1699431-21apt-get11:17:352
1453703992118,2cyclictest1709561-21fschecks_count11:27:402
1453703992118,2cyclictest1550825-21fschecks_count08:47:402
1453703992118,2cyclictest1495396-21unixbench_multi07:47:562
1453703992116,3cyclictest0-21swapper/212:32:562
16927712200,6sleep30-21swapper/311:07:453
1453703992017,2cyclictest1768955-21fschecks_time12:27:402
1453703992017,2cyclictest1555755-21fschecks_count08:52:382
1453703992016,3cyclictest1570627-21aten2_r5power_e09:07:362
1453703992016,2cyclictest0-21swapper/211:47:422
1453703992012,6cyclictest1530247-21cron08:25:002
14534242202,12sleep00-21swapper/007:08:460
1453703991915,3cyclictest1535844-21cpuspeed_turbos08:32:392
1453703991915,2cyclictest1714451-21cpuspeed_turbos11:32:392
1453703991915,2cyclictest1471144-21aten2_r5power_c07:27:382
1453703991915,2cyclictest0-21swapper/210:02:382
1453703991915,2cyclictest0-21swapper/207:12:532
1453703991914,3cyclictest0-21swapper/211:07:542
1453703991910,7cyclictest1671162-21tr10:47:442
1453703991910,7cyclictest1645993-21tr10:22:442
1453703991910,7cyclictest1519156-21tr08:12:482
145370399189,7cyclictest1503140-21tr07:57:442
145370399187,2cyclictest161rcu_preempt09:15:002
145370399187,2cyclictest161rcu_preempt09:15:002
1453703991813,4cyclictest1733560-21kworker/u8:0+events_unbound12:07:452
1453703991813,4cyclictest1733560-21kworker/u8:0+events_unbound12:07:452
145370399181,13cyclictest1481011-21apt-get07:37:362
1453703991810,6cyclictest1667103-21tr10:42:452
14489682183,9sleep30-21swapper/307:05:523
145370399177,8cyclictest1602392-21tr09:37:452
1453703991713,2cyclictest0-21swapper/211:57:372
1453703991712,3cyclictest0-21swapper/211:52:452
1453703991712,3cyclictest0-21swapper/210:17:452
145370399162,5cyclictest0-21swapper/212:12:432
145370399162,13cyclictest0-21swapper/210:32:542
1453703991613,2cyclictest1590561-21aten2_r5power_v09:27:372
1453703991612,3cyclictest0-21swapper/208:40:002
1453703991612,2cyclictest0-21swapper/211:37:412
145370399161,11cyclictest1619092-21/usr/sbin/munin09:52:532
15750662145,5sleep30-21swapper/309:10:003
17641762132,7sleep30-21swapper/312:22:423
17596132133,7sleep30-21swapper/312:17:443
17039652133,5sleep30-21swapper/311:20:023
16492842134,5sleep30-21swapper/310:25:003
14895362133,6sleep30-21swapper/307:42:483
14895362133,6sleep30-21swapper/307:42:483
14699342132,7sleep30-21swapper/307:22:493
14581692132,6sleep30-21swapper/307:12:543
17781962122,6sleep30-21swapper/312:35:023
17417522122,6sleep30-21swapper/311:57:463
17353002122,6sleep30-21swapper/311:52:443
17231762122,6sleep30-21swapper/311:37:563
17131332122,6sleep30-21swapper/311:27:523
16985042122,6sleep30-21swapper/311:12:553
16846432122,6sleep30-21swapper/311:02:403
16789972122,6sleep30-21swapper/310:55:023
16731662122,6sleep30-21swapper/310:47:473
16650062122,6sleep30-21swapper/310:42:423
16364322122,6sleep30-21swapper/310:12:443
16295962122,6sleep30-21swapper/310:05:023
16189302122,6sleep30-21swapper/309:52:503
16103262122,6sleep30-21swapper/309:47:403
15904542122,6sleep30-21swapper/309:27:383
15863792122,6sleep30-21swapper/309:22:443
15765582122,6sleep30-21swapper/309:12:453
15765582122,6sleep30-21swapper/309:12:453
15656622122,6sleep30-21swapper/309:02:373
15550942122,6sleep30-21swapper/308:50:013
15410342122,6sleep30-21swapper/308:37:413
15361262122,6sleep30-21swapper/308:32:443
15302812122,5sleep30-21swapper/308:25:013
15146392122,6sleep30-21swapper/308:07:483
15064642122,6sleep30-21swapper/308:02:423
14806192122,6sleep30-21swapper/307:35:013
14782532122,6sleep30-21swapper/307:32:453
14648332122,6sleep30-21swapper/307:17:523
17734042113,5sleep30-21swapper/312:30:243
17688832112,5sleep30-21swapper/312:27:403
17535482112,6sleep30-21swapper/312:10:063
17486272113,5sleep30-21swapper/312:05:323
17486272113,5sleep30-21swapper/312:05:323
17477102112,5sleep30-21swapper/312:02:523
17288272112,5sleep30-21swapper/311:45:023
17241242112,5sleep30-21swapper/311:42:373
16992412112,6sleep30-21swapper/311:15:283
16785992112,5sleep30-21swapper/310:52:573
16595342112,6sleep30-21swapper/310:36:523
16595342112,6sleep30-21swapper/310:36:523
16544572112,5sleep30-21swapper/310:30:023
16248842112,6sleep30-21swapper/310:00:243
16198782112,5sleep30-21swapper/309:55:023
16048472112,5sleep30-21swapper/309:40:023
16041612112,5sleep30-21swapper/309:37:533
15951282112,5sleep30-21swapper/309:30:023
15804882112,5sleep30-21swapper/309:17:343
15603962112,6sleep30-21swapper/308:57:163
15504042112,6sleep30-21swapper/308:45:563
15453782112,5sleep30-21swapper/308:40:023
15255392112,6sleep30-21swapper/308:20:123
15206162112,6sleep30-21swapper/308:15:383
15161352112,5sleep30-21swapper/308:12:413
15008632112,6sleep30-21swapper/307:55:403
14709072112,5sleep30-21swapper/307:25:183
14910532102,5sleep30-21swapper/307:46:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional