You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-30 - 09:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun Aug 30, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14518042860,5chrt0-21swapper/321:52:423
15171112650,0sleep1281rcuc/122:57:491
15965282640,4chrt0-21swapper/100:20:001
13094952490,3sleep3575-21kworker/3:2+events19:32:293
1287471994840,5cyclictest1452960-21latency_hist21:55:000
1287475994637,6cyclictest1472693-21latency_hist22:15:001
1287471994637,6cyclictest1512438-21latency_hist22:55:010
1287475994436,5cyclictest1611496-21latency_hist00:35:011
1287475994434,8cyclictest1506712-21ntpq22:47:431
12869082440,16sleep10-21swapper/119:07:551
1287471994133,5cyclictest1606560-21latency_hist00:30:000
1287475994031,7cyclictest275-21systemd-journal19:36:251
1287471994031,6cyclictest1358384-21latency_hist20:20:010
14820892390,2sleep3575-21kworker/3:2-events22:22:443
1287475993832,5cyclictest1606565-21idleruntime-cro00:30:001
1287475993827,8cyclictest275-21systemd-journal21:50:281
128747199380,36cyclictest1547031-21true23:30:000
1287471993728,6cyclictest1383843-21grep20:47:320
128747199361,31cyclictest1309096-21unin-run19:30:010
1287479993530,4cyclictest1098329-21kworker/u8:2+events_unbound20:27:482
1287471993527,6cyclictest275-21systemd-journal00:20:000
1287471993525,7cyclictest1477603-21apt-get22:20:010
15290082340,3sleep0201rcuc/023:12:370
1287479993424,8cyclictest275-21systemd-journal00:25:012
1287475993425,6cyclictest275-21systemd-journal23:20:001
1287471993426,6cyclictest1383122-21latency_hist20:45:010
1287475993325,6cyclictest1438368-21/usr/sbin/munin21:42:421
1287471993329,2cyclictest1576693-21basename00:00:000
1287471993328,3cyclictest1472677-21cron22:15:010
1287471993326,5cyclictest1423180-21latency_hist21:25:010
1287471993316,14cyclictest275-21systemd-journal22:06:280
128747199330,31cyclictest1601444-21unin-run00:25:010
1287479993227,4cyclictest1373435-21kworker/u8:0+events_unbound00:32:462
1287475993227,3cyclictest1552941-21irqcore23:37:341
1287475993227,3cyclictest1419225-21irqcore21:22:361
1287475993226,4cyclictest1576678-21cron00:00:001
1287479993126,4cyclictest1098329-21kworker/u8:2+flush-8:020:17:482
1287479993125,4cyclictest1413002-21gpgv21:15:002
1287475993127,3cyclictest1343618-21systemd-run20:05:001
1287471993123,6cyclictest1556660-21unixbench_singl23:37:470
15020812300,4sleep00-21swapper/022:42:470
1287479993026,3cyclictest1571714-21cron23:55:002
1287475993025,3cyclictest1398167-21cron21:00:001
1287475993022,5cyclictest1368271-21latency_hist20:30:011
1287475993020,8cyclictest275-21systemd-journal22:20:011
1287475993019,8cyclictest275-21systemd-journal19:12:251
1287471993027,2cyclictest1486911-21needreboot22:27:410
1287471993025,3cyclictest1318109-21needreboot19:37:430
1287471993023,5cyclictest1388960-21cpuspeed_turbos20:52:320
1287471993023,3cyclictest1408070-21systemd-run21:10:000
1287475992924,4cyclictest1354114-21cpuspeed_turbos20:17:311
1287475992924,3cyclictest1551966-21cron23:35:001
1287475992924,3cyclictest1373435-21kworker/u8:0+flush-8:020:37:391
1287475992923,4cyclictest1487493-21unixbench_singl22:27:491
1287475992921,6cyclictest275-21systemd-journal19:42:251
1287471992925,2cyclictest1343593-21cron20:05:000
1287471992924,3cyclictest1532944-21fschecks_count23:17:330
1287471992923,4cyclictest1517413-21systemd-run23:00:010
1287471992923,4cyclictest1333480-21unixbench_singl19:52:500
1287471992921,5cyclictest1482810-21latency_hist22:25:010
1287479992825,2cyclictest1517124-21unixbench_multi22:57:492
1287479992824,2cyclictest1507245-21unixbench_singl22:47:512
1287479992823,3cyclictest1527245-21cron23:10:002
1287475992825,2cyclictest1527277-21systemd-run23:10:011
1287475992824,3cyclictest1566997-21kworker/u8:2+events_unbound00:07:391
1287475992824,3cyclictest1566997-21kworker/u8:2+events_unbound00:07:391
1287475992824,3cyclictest1383638-21wget20:47:301
1287475992824,2cyclictest1390895-21kthreadcore20:52:391
1287475992823,3cyclictest1462839-21sh22:05:001
1287475992823,3cyclictest1399355-21irqrtprio21:02:351
1287475992822,4cyclictest1591304-21unixbench_singl00:12:501
1287475992821,5cyclictest1557345-21apt-get23:42:291
1287471992822,3cyclictest1567563-21fschecks_time23:52:350
1287479992724,2cyclictest1417369-21needreboot21:17:422
1287479992724,2cyclictest1314736-21fschecks_count19:37:352
1287479992723,3cyclictest1098329-21kworker/u8:2+events_unbound20:03:252
1287479992722,3cyclictest1240806-21kworker/u8:3+events_unbound23:30:112
1287479992722,3cyclictest1098329-21kworker/u8:2+events_unbound20:20:022
1287475992723,3cyclictest1329304-21aten2_r5power_p19:52:321
1287475992721,4cyclictest1457687-21unixbench_singl21:57:511
1287475992721,4cyclictest1457687-21unixbench_singl21:57:511
1287475992720,6cyclictest1498276-21cpuspeed_turbos22:42:311
1287471992724,1cyclictest1388515-21kworker/u8:1+events_unbound22:00:000
1287471992724,1cyclictest1388515-21kworker/u8:1+events_unbound22:00:000
1287471992723,3cyclictest1240806-21kworker/u8:3+flush-8:021:36:590
1287471992722,3cyclictest1-21systemd23:45:000
1287471992722,2cyclictest0-21swapper/021:15:000
1287471992721,4cyclictest1566448-21timerwakeupswit23:47:490
1287479992623,2cyclictest1344303-21fschecks_count20:07:322
1287479992622,3cyclictest1388515-21kworker/u8:1+events_unbound00:27:452
1287479992621,3cyclictest1487485-21unixbench_singl22:27:492
1287479992621,3cyclictest1388515-21kworker/u8:1+events_unbound21:20:022
1287475992622,3cyclictest1433046-21systemd-run21:35:001
1287475992622,2cyclictest0-21swapper/122:32:501
1287475992622,2cyclictest0-21swapper/100:37:411
1287475992621,4cyclictest1313744-21unixbench_multi19:32:491
1287475992621,3cyclictest1581673-21systemd-run00:05:001
1287475992620,4cyclictest1413660-21apt-get21:17:301
1287475992619,5cyclictest1352730-21ntpq20:12:441
1287475992617,7cyclictest275-21systemd-journal19:50:001
1287471992620,3cyclictest1374037-21idleruntime20:37:350
1287471992620,3cyclictest0-21swapper/021:35:010
1287471992618,6cyclictest1298432-21ntpq19:17:420
1287479992521,3cyclictest1562412-21aten2_r5power_v23:47:322
1287479992521,3cyclictest1388515-21kworker/u8:1+events_unbound21:07:422
1287475992520,4cyclictest1522121-21unixbench_singl23:02:501
1287475992520,4cyclictest1382868-21unixbench_multi20:42:471
1287475992519,4cyclictest1344070-21aten2_r5power_c20:07:301
1287475992517,6cyclictest1508003-21aten2_r5power_p22:52:331
128747199252,16cyclictest571-21snmpd23:22:320
1287471992521,3cyclictest401-21dbus-daemon22:50:010
1287471992521,2cyclictest1364722-21kthreadcore20:27:370
1287471992520,3cyclictest1517995-21cpuspeed23:02:320
1287471992520,3cyclictest0-21swapper/020:15:000
1287471992519,4cyclictest1313798-21unixbench_singl19:32:490
1287471992519,4cyclictest0-21swapper/000:40:000
1287471992519,3cyclictest0-21swapper/019:57:460
1287479992420,3cyclictest1533004-21fschecks_time23:17:332
1287479992420,3cyclictest1240806-21kworker/u8:3+events_unbound21:01:362
1287479992420,3cyclictest1240806-21kworker/u8:3+events_unbound20:35:012
1287479992418,1cyclictest421rcuog/220:47:302
1287479992416,6cyclictest1392561-21ntpq20:52:452
1287475992420,2cyclictest0-21swapper/121:50:001
1287475992420,2cyclictest0-21swapper/121:27:341
1287475992419,3cyclictest0-21swapper/119:17:401
1287475992412,3cyclictest0-21swapper/120:22:371
1287471992419,3cyclictest1328783-21idleruntime-cro19:50:000
1287471992419,3cyclictest0-21swapper/020:22:370
1287471992418,4cyclictest1373435-21kworker/u8:0+flush-8:000:12:340
1287471992418,4cyclictest0-21swapper/019:22:420
1287471992417,4cyclictest275-21systemd-journal00:00:120
1287471992410,10cyclictest1323872-21apt19:45:000
15375962230,4sleep20-21swapper/223:22:292
1287479992320,2cyclictest1498079-21aten2_r5power_c22:42:302
1287479992320,2cyclictest1368822-21aten2_r5power_v20:32:322
1287479992319,3cyclictest1423647-21aten2_r5power_c21:27:322
1287479992318,3cyclictest1437707-21unixbench_singl21:37:502
1287479992316,2cyclictest161rcu_preempt23:57:362
1287479992310,3cyclictest13094982sort19:32:292
1287475992319,3cyclictest1301800-21kthreadcore19:22:391
1287475992318,4cyclictest1571475-21unixbench_multi23:52:501
1287475992318,3cyclictest0-21swapper/100:25:011
1287475992316,5cyclictest1412147-21needreboot21:12:421
1287471992318,3cyclictest8450irq/124-ahci[0000:00:12.0]20:55:140
1287471992318,3cyclictest1523000-21cpuspeed_turbos23:07:300
1287471992318,3cyclictest1424541-21kthreadcore21:27:380
1287471992317,4cyclictest1492648-21cron22:35:000
1287471992316,5cyclictest20885-21sendmail-mta20:07:370
1287471992313,7cyclictest1444193-21cut21:47:380
1287471992313,6cyclictest1403132-21latency_hist21:05:010
13201872220,2sleep3481ktimers/319:42:363
128747999223,2cyclictest161rcu_preempt22:20:012
1287479992220,1cyclictest1463611-21cut22:07:332
1287479992219,2cyclictest1453510-21aten2_r5power_v21:57:322
1287479992219,2cyclictest1453510-21aten2_r5power_v21:57:322
1287479992218,3cyclictest1388515-21kworker/u8:1+events_unbound21:50:052
1287479992218,2cyclictest0-21swapper/200:40:002
1287479992216,4cyclictest1447922-21gpgv21:50:002
1287479992214,5cyclictest275-21systemd-journal00:15:002
1287475992218,3cyclictest1528410-21irqrtprio23:12:361
1287475992218,2cyclictest0-21swapper/123:22:351
1287475992218,2cyclictest0-21swapper/122:07:381
1287475992218,2cyclictest0-21swapper/121:37:381
1287475992218,2cyclictest0-21swapper/121:07:481
1287471992218,2cyclictest44750irq/129-enp3s0-TxRx-200:09:290
1287471992218,2cyclictest44750irq/129-enp3s0-TxRx-200:09:290
1287471992218,2cyclictest1288038-21cpuspeed_turbos19:12:370
1287471992217,3cyclictest0-21swapper/021:45:000
1287471992216,4cyclictest0-21swapper/021:20:010
16107652210,4chrt0-21swapper/000:32:430
128747999218,9cyclictest1493095-21apt-get22:37:312
128747999215,3cyclictest161rcu_preempt20:42:362
128747999212,4cyclictest0-21swapper/220:56:202
1287479992119,1cyclictest1557873-21sed23:42:372
1287479992117,3cyclictest0-21swapper/219:30:002
1287479992117,2cyclictest0-21swapper/200:20:002
1287479992115,4cyclictest0-21swapper/223:12:362
1287479992110,9cyclictest1433033-21awk21:35:002
1287475992117,2cyclictest0-21swapper/122:37:321
1287475992117,2cyclictest0-21swapper/122:22:411
1287475992117,2cyclictest0-21swapper/119:27:311
1287475992116,3cyclictest0-21swapper/123:30:011
1287475992116,3cyclictest0-21swapper/120:32:341
1287475992115,5cyclictest1334211-21aten2_r5power_e19:57:311
128747199212,18cyclictest0-21swapper/020:33:030
128747199211,8cyclictest1548174-21grep23:32:370
1287471992115,4cyclictest0-21swapper/022:02:300
14722132200,3chrt575-21kworker/3:2-events22:12:493
128747999202,12cyclictest1507918-21apt-get22:52:322
1287479992018,1cyclictest1468509-21cut22:12:342
1287479992017,2cyclictest1438423-21aten2_r5power_c21:42:322
1287479992016,3cyclictest1566997-21kworker/u8:2+events_unbound00:00:012
1287479992016,3cyclictest1373435-21kworker/u8:0+events_unbound23:36:092
1287479992016,2cyclictest0-21swapper/219:15:032
128747999200,2cyclictest161rcu_preempt22:32:312
1287471992015,3cyclictest1494816-21runrttasks22:37:390
12871272204,10sleep20-21swapper/219:07:572
14031162198,7sleep30-21swapper/321:05:003
128747999196,3cyclictest161rcu_preempt22:02:322
128747999196,2cyclictest161rcu_preempt19:20:052
128747999192,9cyclictest0-21swapper/200:07:402
128747999192,9cyclictest0-21swapper/200:07:402
128747999192,13cyclictest1542543-21apt-get23:27:312
1287479991915,3cyclictest1272620-21kworker/u8:4+flush-8:020:10:152
1287479991915,3cyclictest1098329-21kworker/u8:2+events_unbound19:42:552
1287479991910,7cyclictest1481641-21tr22:22:402
1287475991916,2cyclictest0-21swapper/123:47:461
12872582193,9sleep30-21swapper/319:09:303
128747999183,9cyclictest1287823-21apt-get19:12:342
128747999182,2cyclictest0-21swapper/223:03:342
1287479991816,1cyclictest1324598-21cut19:47:342
128747999180,10cyclictest1333266-21switchtime19:52:492
12872482183,8sleep00-21swapper/019:09:230
128747999162,1cyclictest0-21swapper/219:56:532
12878202152,8sleep30-21swapper/319:12:353
14468482142,8sleep30-21swapper/321:47:423
15858312132,7sleep30-21swapper/300:07:433
15858312132,7sleep30-21swapper/300:07:433
15230202132,7sleep30-21swapper/323:07:323
15075422132,6sleep30-21swapper/322:50:023
15004962132,7sleep30-21swapper/322:42:403
14592342134,5sleep30-21swapper/322:02:393
13731772133,6sleep30-21swapper/320:34:503
13629432133,6sleep30-21swapper/320:22:503
13487362132,6sleep30-21swapper/320:10:023
13238962132,6sleep30-21swapper/319:45:023
13050452132,7sleep30-21swapper/319:27:363
13003782132,7sleep30-21swapper/319:22:383
15969092122,6sleep30-21swapper/300:22:323
15770522122,6sleep30-21swapper/300:01:293
15724052122,6sleep30-21swapper/323:57:323
15712792122,6sleep30-21swapper/323:52:503
15628002122,6sleep30-21swapper/323:47:373
15612182122,6sleep30-21swapper/323:42:473
15421262122,5sleep30-21swapper/323:25:013
15330892122,6sleep30-21swapper/323:17:353
15313722122,6sleep30-21swapper/323:12:413
15173562122,5sleep30-21swapper/323:00:013
15127672122,6sleep30-21swapper/322:56:283
15028232122,6sleep30-21swapper/322:45:283
14930692122,6sleep30-21swapper/322:37:303
14885842122,6sleep30-21swapper/322:32:363
14828352122,6sleep30-21swapper/322:25:023
14383972122,6sleep30-21swapper/321:42:323
14331562122,6sleep30-21swapper/321:35:023
14285002125,5sleep30-21swapper/321:32:293
14140292122,6sleep30-21swapper/321:17:363
14081352122,5sleep30-21swapper/321:10:013
13890972122,6sleep30-21swapper/320:52:363
13874742122,6sleep30-21swapper/320:47:463
13739552122,6sleep30-21swapper/320:37:353
13675972122,7sleep30-21swapper/320:27:483
13538192122,6sleep30-21swapper/320:17:003
13438652124,5sleep30-21swapper/320:05:323
13296432122,6sleep30-21swapper/319:52:363
12989922122,6sleep30-21swapper/319:17:573
16159122112,5sleep30-21swapper/300:37:493
16073412112,5sleep30-21swapper/300:32:353
16020712112,5sleep30-21swapper/300:27:293
15918912112,6sleep30-21swapper/300:16:583
15869312112,6sleep30-21swapper/300:11:203
15522302112,5sleep30-21swapper/323:35:293
15474612112,6sleep30-21swapper/323:32:323
15379812112,5sleep30-21swapper/323:22:373
14735022112,5sleep30-21swapper/322:17:353
14662482112,5sleep30-21swapper/322:07:403
14532002112,6sleep30-21swapper/321:55:163
14532002112,6sleep30-21swapper/321:55:163
14234002112,5sleep30-21swapper/321:25:023
14186112112,5sleep30-21swapper/321:22:293
14040422112,5sleep30-21swapper/321:07:373
13936562112,5sleep30-21swapper/320:57:293
13789292112,6sleep30-21swapper/320:42:323
13395272112,6sleep30-21swapper/320:02:353
13341222112,6sleep30-21swapper/319:57:263
13142302112,5sleep30-21swapper/319:35:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional