You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 07:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Wed Jul 15, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
167900021990,3sleep3584-21kworker/3:2-events21:22:333
17380312970,4sleep00-21swapper/022:22:280
17986302720,5sleep30-21swapper/323:22:333
1545842996455,6cyclictest1806888-21latency_hist23:30:021
1545842996357,4cyclictest1598357-21kworker/u8:4+flush-8:020:57:451
1545842996150,8cyclictest281-21systemd-journal22:15:001
1545842995545,7cyclictest1717672-21latency_hist22:00:011
1545842995346,6cyclictest1637933-21kworker/u8:0+flush-8:021:42:411
1545842995343,7cyclictest1598249-21grub-install20:01:341
1545844995039,8cyclictest1866425-21cp00:30:012
1545838995042,5cyclictest281-21systemd-journal21:30:010
1545842994943,5cyclictest1598357-21kworker/u8:4+events_unbound00:27:321
1545842994939,7cyclictest1652835-21latency_hist20:55:001
1545838994938,8cyclictest281-21systemd-journal00:35:010
1545842994843,3cyclictest1598357-21kworker/u8:4+flush-8:020:07:441
1545838994840,6cyclictest1663703-21diskstats21:07:310
1545838994838,7cyclictest281-21systemd-journal20:54:140
1545842994741,4cyclictest1826713-21kworker/u8:0+events_unbound00:00:001
1545842994741,3cyclictest1777233-21kworker/u8:1+flush-8:023:02:451
1545842994640,4cyclictest1667270-21kworker/u8:2+flush-8:021:07:461
1545842994639,5cyclictest1710884-21kworker/u8:2+flush-8:022:47:331
1545842994633,8cyclictest281-21systemd-journal23:17:441
1545842994538,5cyclictest1710884-21kworker/u8:2+events_unbound22:52:331
1545838994534,8cyclictest281-21systemd-journal20:01:160
1545842994438,4cyclictest1777233-21kworker/u8:1+events_unbound23:37:451
1545842994335,6cyclictest1710884-21kworker/u8:2+flush-8:021:52:441
1545842994235,5cyclictest1777233-21kworker/u8:1+flush-8:023:12:401
1545842994235,5cyclictest1598357-21kworker/u8:4+flush-8:020:12:391
1545838994236,4cyclictest1710884-21kworker/u8:2+events_unbound22:07:350
1545838994232,7cyclictest281-21systemd-journal00:26:530
1545842994135,4cyclictest1777233-21kworker/u8:1+flush-8:023:42:311
1545844994029,9cyclictest1632990-21awk20:35:002
1545842994034,4cyclictest1710884-21kworker/u8:2+events_unbound22:02:271
1545838994031,6cyclictest1622885-21latency_hist20:25:010
1545842993934,3cyclictest1836669-21kworker/u8:2+flush-8:000:07:451
1545842993933,4cyclictest1710884-21kworker/u8:2+flush-8:022:57:311
1545842993933,4cyclictest1598357-21kworker/u8:4+flush-8:021:22:401
1545842993932,5cyclictest1851938-21apt-get00:17:251
1545842993932,5cyclictest1582447-21kworker/u8:3+events_unbound20:42:431
1545842993931,6cyclictest1647072-21ntpq20:47:381
1545842993930,6cyclictest1303013-21kworker/u8:1+flush-8:019:17:401
1545838993935,3cyclictest1672746-21kworker/u8:1+flush-8:021:27:430
1545838993930,7cyclictest1835804-21ntpq23:57:370
16018312380,5sleep30-21swapper/320:02:373
1545842993834,3cyclictest1598357-21kworker/u8:4+events_unbound00:22:291
1545842993832,4cyclictest1598357-21kworker/u8:4+flush-8:000:37:291
1545842993831,5cyclictest1582447-21kworker/u8:3+events_unbound19:47:421
1545842993830,6cyclictest1637933-21kworker/u8:0+flush-8:021:37:381
1545838993830,5cyclictest1612804-21sshd20:13:050
1545838993829,7cyclictest1830895-21ntpq23:52:380
1545838993829,7cyclictest1716937-21ntpq21:57:390
1545842993732,4cyclictest1504653-21kworker/u8:3+flush-8:019:27:441
1545842993732,3cyclictest1637933-21kworker/u8:0+events_unbound21:47:341
1545842993727,7cyclictest1627792-21apt-get20:30:001
1545838993732,3cyclictest1783551-21kthreadcore23:07:320
1545838993730,5cyclictest281-21systemd-journal20:33:080
1545838993728,6cyclictest1822417-21diskstats23:47:270
15455592373,11sleep10-21swapper/119:08:311
1545842993632,3cyclictest1598357-21kworker/u8:4+flush-8:000:05:011
1545842993632,3cyclictest1598357-21kworker/u8:4+events_unbound23:45:021
1545842993630,4cyclictest1743115-21apt-get22:27:251
1545838993630,5cyclictest1598357-21kworker/u8:4+flush-8:022:49:150
1545838993630,5cyclictest1598357-21kworker/u8:4+flush-8:020:48:140
1545838993628,5cyclictest1747598-21latency_hist22:30:010
1545842993530,4cyclictest1637933-21kworker/u8:0+events_unbound21:04:531
1545842993530,4cyclictest1637933-21kworker/u8:0+events_unbound21:04:531
1545842993530,3cyclictest1598357-21kworker/u8:4+events_unbound20:37:341
1545844993423,8cyclictest1781541-21ntpq23:02:422
1545838993431,2cyclictest1811851-21basename23:35:000
1545838993429,3cyclictest1801969-21cron23:24:590
1545838993428,4cyclictest1762148-21grep22:42:440
1545838993428,4cyclictest1598357-21kworker/u8:4+flush-8:023:40:200
1545838993428,4cyclictest1582447-21kworker/u8:3+flush-8:020:42:310
15456272344,10sleep20-21swapper/219:09:252
1545844993328,4cyclictest1592653-21kworker/u8:0+flush-8:020:01:332
1545842993328,4cyclictest1598357-21kworker/u8:4+events_unbound21:32:451
1545842993326,5cyclictest1710884-21kworker/u8:2+events_unbound22:32:291
1545842993325,6cyclictest1727411-21kworker/u8:0+flush-8:022:17:411
1545838993329,3cyclictest1836669-21kworker/u8:2+flush-8:000:16:000
1545838993327,5cyclictest1637933-21kworker/u8:0+flush-8:021:02:140
1545838993327,5cyclictest1637933-21kworker/u8:0+flush-8:021:02:140
1545844993224,6cyclictest1618028-21cat20:20:012
1545844993222,7cyclictest1747606-21awk22:30:002
1545838993228,3cyclictest1598357-21kworker/u8:4+flush-8:022:38:150
1545838993227,3cyclictest1557635-21apt19:20:000
1545838993226,4cyclictest1598357-21kworker/u8:4+flush-8:000:11:270
1545838993224,6cyclictest1627789-21latency_hist20:30:010
1545842993126,3cyclictest1303013-21kworker/u8:1+flush-8:019:37:441
1545842993125,5cyclictest1598357-21kworker/u8:4+flush-8:000:12:401
1545842993123,6cyclictest1797428-21/usr/sbin/munin23:22:431
1545842993123,6cyclictest1504653-21kworker/u8:3+flush-8:019:12:421
1545838993127,3cyclictest1-21systemd00:40:000
1545838993126,4cyclictest1637933-21kworker/u8:0+events_unbound21:37:360
1545838993121,8cyclictest1733222-21diskstats22:17:300
1545844993027,2cyclictest1568190-21tr19:32:282
1545844993025,3cyclictest1627567-21unixbench_singl20:27:462
1545844993018,10cyclictest1871491-21awk00:35:012
1545842993026,3cyclictest1672746-21kworker/u8:1+events_unbound21:27:291
1545842993025,3cyclictest1808042-21irqrtprio23:32:331
1545842993024,5cyclictest1710884-21kworker/u8:2+events_unbound22:07:281
1545842993024,5cyclictest1598357-21kworker/u8:4+flush-8:020:17:391
1545838993026,3cyclictest1577454-21munin-run19:40:010
1545844992925,2cyclictest1682869-21cron21:25:002
1545842992924,4cyclictest1727411-21kworker/u8:0+flush-8:023:07:441
1545842992924,3cyclictest1598357-21kworker/u8:4+events_unbound00:32:371
1545842992924,3cyclictest1567548-21kworker/u8:2+flush-8:019:32:431
1545842992923,5cyclictest1598357-21kworker/u8:4+flush-8:023:52:391
1545842992922,5cyclictest1672746-21kworker/u8:1+events_unbound21:17:411
1545838992925,3cyclictest1598357-21kworker/u8:4+flush-8:022:54:150
1545838992924,4cyclictest1710884-21kworker/u8:2+flush-8:022:01:140
1545844992824,3cyclictest1592279-21sh19:55:002
1545844992823,3cyclictest1847223-21cpuspeed_turbos00:12:282
1545842992824,3cyclictest1667270-21kworker/u8:2+events_unbound21:12:281
1545842992823,4cyclictest1598357-21kworker/u8:4+flush-8:022:20:211
1545842992822,4cyclictest1587781-21apt-get19:52:261
1545842992820,6cyclictest1582447-21kworker/u8:3+flush-8:020:32:411
1545838992823,4cyclictest1777233-21kworker/u8:1+flush-8:023:01:520
1545838992823,4cyclictest1598357-21kworker/u8:4+flush-8:000:24:260
1545838992823,3cyclictest1672099-21needreboot21:12:360
1545838992823,3cyclictest1580070-21kthreadcore19:42:350
1545844992722,4cyclictest1687818-21munin-run21:30:002
1545842992722,3cyclictest0-21swapper/120:22:421
1545842992721,4cyclictest1303013-21kworker/u8:1+events_unbound19:42:291
1545842992720,5cyclictest1598357-21kworker/u8:4+flush-8:022:37:261
1545838992723,3cyclictest1504653-21kworker/u8:3+flush-8:019:22:350
1545838992715,10cyclictest1703548-21diskstats21:47:300
1545844992621,3cyclictest1672906-21cron21:15:002
1545842992620,3cyclictest0-21swapper/119:57:251
1545838992621,4cyclictest1598357-21kworker/u8:4+flush-8:023:26:160
1545838992621,4cyclictest1598357-21kworker/u8:4+flush-8:022:56:150
1545838992620,4cyclictest1844468-21kthreadcore00:07:360
1545844992522,2cyclictest1856139-21unixbench_multi00:17:452
1545844992522,2cyclictest1836367-21unixbench_singl23:57:452
1545844992521,2cyclictest1777183-21cron23:00:002
1545844992520,4cyclictest1598357-21kworker/u8:4+flush-8:022:42:422
154583899252,22cyclictest0-21swapper/020:57:440
1545838992521,3cyclictest1546776-21sort19:12:340
1545838992519,5cyclictest1582447-21kworker/u8:3+flush-8:019:58:140
1545838992519,4cyclictest1617676-21unixbench_singl20:17:470
1545838992518,5cyclictest1677179-21ntpq21:17:400
1545838992517,6cyclictest1603507-21/usr/sbin/munin20:07:370
1545844992421,2cyclictest1827390-21fschecks_count23:52:282
1545844992421,2cyclictest1550457-21unixbench_multi19:12:472
1545844992420,3cyclictest1717672-21latency_hist22:00:012
1545844992420,3cyclictest1582149-21unixbench_multi19:42:472
1545844992420,2cyclictest0-21swapper/221:00:002
154584499241,21cyclictest1742505-21unin-run22:25:002
1545838992419,4cyclictest384-21dbus-daemon21:25:000
1545838992419,4cyclictest1582447-21kworker/u8:3+flush-8:019:47:410
1545838992418,4cyclictest1732258-21grep22:12:470
1545838992414,2cyclictest0-21swapper/020:37:350
1545838992411,11cyclictest1812594-21grep23:37:300
154584499235,16cyclictest1622268-21grep20:22:422
1545844992320,2cyclictest1842334-21fschecks_count00:07:302
1545842992317,3cyclictest0-21swapper/122:42:421
1545838992318,3cyclictest1796797-21unixbench_singl23:17:460
1545838992317,4cyclictest1712497-21unixbench_singl21:52:460
1545838992317,3cyclictest0-21swapper/021:42:410
1545838992317,3cyclictest0-21swapper/019:52:280
15410932232,15sleep00-21swapper/019:05:450
154584499228,12cyclictest1562090-21sshd19:22:442
1545844992219,2cyclictest1733058-21aten2_r5power_p22:17:292
1545844992218,2cyclictest1663181-21latency_hist21:05:002
1545844992218,2cyclictest1663181-21latency_hist21:05:002
1545844992217,3cyclictest1806677-21unixbench_singl23:27:462
1545844992215,5cyclictest1816796-21cat23:40:002
1545844992212,2cyclictest0-21swapper/223:07:292
154584499220,6cyclictest17014382cut21:42:382
1545842992216,3cyclictest0-21swapper/119:22:451
154584499216,2cyclictest15578322cut19:20:012
1545844992118,2cyclictest1787767-21cpuspeed_turbos23:12:282
1545844992118,2cyclictest1603589-21aten2_r5power_e20:07:262
1545844992117,3cyclictest1718343-21cpuspeed_turbos22:02:282
1545844992117,2cyclictest1748377-21fschecks_time22:32:302
1545844992112,7cyclictest1801979-21turbostat.cron23:24:592
154584499211,18cyclictest1768654-21uname22:52:342
1545844992111,3cyclictest0-21swapper/220:15:012
1545838992115,4cyclictest1777233-21kworker/u8:1+events_unbound23:12:430
1545838992115,4cyclictest0-21swapper/019:27:340
1545838992114,5cyclictest1504653-21kworker/u8:3+events_unbound19:32:300
1545844992015,4cyclictest0-21swapper/221:40:002
1545844992012,6cyclictest1724282-21kthreadcore22:07:332
154583899205,2cyclictest161rcu_preempt00:02:260
1545838992015,4cyclictest1727411-21kworker/u8:0+flush-8:022:31:190
154584499193,14cyclictest1643554-21tr20:47:292
1545844991915,2cyclictest1707606-21grep21:47:542
1545844991915,2cyclictest1648575-21fschecks_count20:52:292
1545844991915,2cyclictest0-21swapper/223:32:452
1545844991915,2cyclictest0-21swapper/223:17:312
1545844991915,2cyclictest0-21swapper/200:40:012
154584499191,15cyclictest1712705-21ls21:55:002
15455062193,9sleep30-21swapper/319:07:493
18585572180,3sleep3584-21kworker/3:2+mm_percpu_wq00:22:363
154584499189,7cyclictest281-21systemd-journal20:00:012
154584499185,11cyclictest1755194-21cut22:37:342
154584499182,5cyclictest0-21swapper/223:44:572
1545844991814,3cyclictest1633474-21aten2_r5power_e20:37:272
1545844991814,2cyclictest0-21swapper/221:32:272
154584499181,15cyclictest1667570-21grep21:07:462
154584499173,12cyclictest1583582-21grep19:47:312
1545844991712,3cyclictest0-21swapper/223:47:252
154584499162,2cyclictest0-21swapper/219:37:572
154584499162,13cyclictest0-21swapper/220:42:322
154584499162,13cyclictest0-21swapper/219:27:222
1545844991613,2cyclictest0-21swapper/221:18:592
154584499152,4cyclictest0-21swapper/200:02:092
1545844991510,3cyclictest0-21swapper/222:12:372
154584499150,2cyclictest18585602cut00:22:362
18465842144,6sleep30-21swapper/300:10:013
17879132147,4sleep30-21swapper/323:12:313
154584499145,7cyclictest1765938-21cut22:47:352
17822212132,6sleep30-21swapper/323:05:013
17319572130,5sleep30-21swapper/322:12:443
16539832133,7sleep30-21swapper/320:57:353
16078682132,7sleep30-21swapper/320:08:043
15824122132,6sleep30-21swapper/319:45:013
15639802132,6sleep30-21swapper/319:27:353
15619132132,7sleep30-21swapper/319:22:423
15496062132,7sleep30-21swapper/319:12:393
18692352122,6sleep30-21swapper/300:32:363
18457832123,5sleep30-21swapper/300:07:403
18409952122,6sleep30-21swapper/300:02:433
18217532122,6sleep30-21swapper/323:45:023
18125672122,6sleep30-21swapper/323:37:313
18061392122,6sleep30-21swapper/323:27:403
17737592122,6sleep30-21swapper/322:57:353
17365872122,6sleep30-21swapper/322:17:393
17275662122,5sleep30-21swapper/322:10:003
17190052122,6sleep30-21swapper/322:02:343
17163822123,5sleep30-21swapper/321:57:373
17121262122,6sleep30-21swapper/321:52:433
16972592122,6sleep30-21swapper/321:37:433
16849432122,6sleep30-21swapper/321:27:363
16709352122,6sleep30-21swapper/321:12:353
16379412122,5sleep30-21swapper/320:40:013
16228682122,6sleep30-21swapper/320:25:013
16174842122,6sleep30-21swapper/320:17:463
15920802122,6sleep30-21swapper/319:52:473
15839872120,2sleep3481ktimers/319:47:323
18717302112,6sleep30-21swapper/300:35:123
18615962112,5sleep30-21swapper/300:25:013
18517522112,6sleep30-21swapper/300:15:223
18319012112,6sleep30-21swapper/323:55:403
18276242111,6sleep30-21swapper/323:52:323
18172942112,6sleep30-21swapper/323:42:283
18113652112,5sleep30-21swapper/323:32:473
17929472112,5sleep30-21swapper/323:17:343
17781042112,5sleep30-21swapper/323:02:323
17675632112,6sleep30-21swapper/322:50:133
17628312112,5sleep30-21swapper/322:47:283
17579322112,5sleep30-21swapper/322:42:263
17529142112,6sleep30-21swapper/322:37:093
17478182112,6sleep30-21swapper/322:30:033
17429672112,6sleep30-21swapper/322:25:493
17383272112,5sleep30-21swapper/322:22:323
17031042112,6sleep30-21swapper/321:45:133
17022062112,5sleep30-21swapper/321:42:443
16882882112,6sleep30-21swapper/321:30:163
16732932112,6sleep30-21swapper/321:17:003
16628402110,6sleep30-21swapper/321:05:013
16586562112,5sleep30-21swapper/321:02:333
16586562112,5sleep30-21swapper/321:02:323
16481092112,6sleep30-21swapper/320:50:283
16431842112,6sleep30-21swapper/320:45:523
16338732112,6sleep30-21swapper/320:37:323
16293562112,5sleep30-21swapper/320:32:353
16231852112,6sleep30-21swapper/320:26:053
16087122112,6sleep30-21swapper/320:12:293
15927392112,5sleep30-21swapper/319:57:283
15733292112,5sleep30-21swapper/319:37:303
15679252112,6sleep30-21swapper/319:32:173
15511792111,6sleep30-21swapper/319:15:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional