You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 20:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Jul 22, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
189773199182162,18cyclictest0-21swapper/011:22:520
189773999161152,7cyclictest2152584-21ntpq11:22:532
1897734999285,5cyclictest0-21swapper/111:22:521
20255962580,5sleep20-21swapper/209:17:422
1897731994840,6cyclictest2083171-21ntpq10:12:500
1897734994737,7cyclictest1949725-21latency_hist08:00:011
21667412430,1sleep02166745-21cut11:37:470
21667412430,1sleep02166745-21cut11:37:470
1897739994232,8cyclictest278-21systemd-journal10:55:022
1897731994131,7cyclictest1999592-21kworker/u8:3+flush-8:008:52:530
1897731994034,4cyclictest2009484-21sh09:00:010
1897739993929,8cyclictest1974749-21cat08:25:022
1897731993930,6cyclictest1954679-21latency_hist08:05:010
1897731993829,6cyclictest2148281-21latency_hist11:20:020
189773199381,34cyclictest395-21dbus-daemon10:55:010
1897731993730,5cyclictest2202776-21kworker/u8:3+flush-8:012:27:410
1897731993730,5cyclictest2049288-21cat09:40:000
1897739993631,4cyclictest1999592-21kworker/u8:3+flush-8:009:07:552
1897734993630,4cyclictest1915004-21kworker/u8:0+flush-8:008:42:461
1897734993630,4cyclictest1915004-21kworker/u8:0+flush-8:008:42:461
1897734993626,7cyclictest1924920-21latency_hist07:35:011
1897731993631,4cyclictest1984447-21kworker/u8:1+events_unbound08:42:560
1897731993631,4cyclictest1984447-21kworker/u8:1+events_unbound08:42:560
189773199360,33cyclictest2044129-21true09:35:000
1897731993530,3cyclictest2093871-21kworker/u8:2+events_unbound10:40:000
1897731993529,4cyclictest1944790-21kworker/u8:2+events_unbound08:12:520
18929542354,10sleep10-21swapper/107:05:501
1897731993430,3cyclictest2039380-21kworker/u8:3+events_unbound10:32:410
1897731993429,3cyclictest1902624-21latency_hist07:15:010
18974452342,3sleep00-21swapper/007:08:500
1897739993326,5cyclictest278-21systemd-journal12:02:492
1897734993327,5cyclictest2049528-21kworker/u8:0+flush-8:010:47:551
1897734993324,7cyclictest1960037-21/usr/sbin/munin08:12:501
1897731993326,5cyclictest2202776-21kworker/u8:3+events_unbound12:22:510
1897739993227,3cyclictest2168663-21aten2_r5power_p11:42:382
1897731993225,5cyclictest2049528-21kworker/u8:0+events_unbound09:42:510
1897731993219,11cyclictest2049528-21kworker/u8:0+flush-8:010:45:000
1897739993127,3cyclictest1915004-21kworker/u8:0+flush-8:008:17:462
1897739993125,4cyclictest1902732-21gpgv07:15:002
1897734993127,3cyclictest1941021-21irqrtprio07:52:451
1897734993127,2cyclictest1980621-21irqcore08:32:451
1897734993126,3cyclictest2095022-21irqrtprio10:27:441
1897731993127,3cyclictest1958814-21needreboot08:07:500
1897731993125,4cyclictest1999592-21kworker/u8:3+events_unbound09:05:010
21450782300,1sleep12145083-21tr11:17:461
1897739993025,3cyclictest2129044-21aten2_r5power_e11:02:402
1897734993027,2cyclictest2065108-21irqcore09:57:431
1897734993024,4cyclictest2099311-21apt-get10:32:381
1897734993024,4cyclictest1902632-21apt-get07:15:011
1897734993023,5cyclictest2188600-21apt-get12:02:391
1897734993023,5cyclictest2088219-21ntpq10:17:521
1897734993022,6cyclictest2049339-21apt-key09:40:011
1897734993021,7cyclictest278-21systemd-journal09:27:491
1897731993025,3cyclictest1873387-21kworker/u8:2+events_unbound07:27:540
1897731993025,3cyclictest0-21swapper/011:35:000
1897731993019,8cyclictest2018647-21ntpq09:07:520
1897739992921,6cyclictest1950460-21fschecks_count08:02:452
1897734992921,6cyclictest278-21systemd-journal11:50:021
1897734992921,6cyclictest2104267-21apt-get10:37:371
1897734992920,7cyclictest2187374-21ntpq11:57:521
189773199292,26cyclictest2083957-21kworker/0:0+events12:14:230
1897731992919,8cyclictest1902632-21apt-get07:15:030
1897731992913,13cyclictest2049528-21kworker/u8:0+flush-8:010:02:490
1897739992822,4cyclictest2163866-21fschecks_count11:37:412
1897739992822,4cyclictest2163866-21fschecks_count11:37:412
1897739992819,7cyclictest2158865-21cpuspeed_turbos11:32:412
1897734992823,3cyclictest2163119-21kworker/u8:0-ext4-rsv-conversion12:20:001
1897734992823,3cyclictest1985695-21irqrtprio08:37:451
1897734992822,4cyclictest2163119-21kworker/u8:0+flush-8:012:37:471
1897734992822,4cyclictest2163119-21kworker/u8:0+flush-8:012:37:471
1897734992820,6cyclictest2202956-21latency_hist12:15:011
1897731992822,4cyclictest2049528-21kworker/u8:0+flush-8:011:12:570
1897731992821,5cyclictest2118637-21kworker/u8:1+events_unbound11:52:450
1897731992816,9cyclictest278-21systemd-journal09:20:000
189773199280,27cyclictest1934914-21kworker/0:2+events08:27:450
1897739992723,2cyclictest2182368-21grep11:52:492
1897739992722,3cyclictest1999847-21aten2_r5power_c08:52:402
1897739992719,6cyclictest2084611-21cpuspeed_turbos10:17:402
1897734992724,2cyclictest2179409-21irqrtprio11:52:451
1897734992723,2cyclictest0-21swapper/109:00:001
1897734992722,3cyclictest2039380-21kworker/u8:3+flush-8:010:52:451
1897734992720,5cyclictest2193535-21apt-get12:07:381
1897734992719,6cyclictest2217827-21latency_hist12:30:011
1897734992719,6cyclictest2014443-21latency_hist09:05:011
1897731992722,4cyclictest2019381-21kworker/u8:1+flush-8:009:27:580
1897731992722,3cyclictest2064115-21cron09:55:000
189773199272,15cyclictest578-21runrttasks11:02:410
1897731992711,3cyclictest161rcu_preempt11:57:400
1897739992622,3cyclictest2079678-21cpuspeed_turbos10:12:402
1897739992622,2cyclictest1915786-21fschecks_time07:27:412
1897739992621,4cyclictest1920642-21kworker/u8:1+flush-8:007:32:522
1897739992621,3cyclictest2174063-21fschecks_time11:47:412
1897739992621,3cyclictest2143926-21aten2_r5power_v11:17:402
1897734992622,3cyclictest1955848-21irqrtprio08:07:461
1897734992622,2cyclictest1909955-21systemd07:20:011
1897734992621,3cyclictest1911027-21irqcore07:22:451
1897731992624,1cyclictest0-21swapper/007:57:560
1897731992624,1cyclictest0-21swapper/007:37:540
1897731992620,4cyclictest2151671-21kworker/u8:2+flush-8:012:07:430
1897731992620,4cyclictest1984447-21kworker/u8:1+events_unbound08:37:510
1897731992620,4cyclictest1974211-21unixbench_singl08:22:580
1897731992618,6cyclictest2168552-21/usr/sbin/munin11:42:470
189773199261,24cyclictest2083957-21kworker/0:0+events12:02:350
189773199261,24cyclictest1934914-21kworker/0:2+events09:10:390
1897739992519,4cyclictest1909921-21gpgv07:20:002
1897734992522,2cyclictest2020166-21cut09:12:431
1897734992519,4cyclictest2029349-21latency_hist09:20:011
1897734992518,6cyclictest2049528-21kworker/u8:0+flush-8:010:23:551
1897734992518,5cyclictest2163155-21latency_hist11:35:001
1897734992517,6cyclictest2208383-21/usr/sbin/munin12:22:551
1897731992522,2cyclictest2039380-21kworker/u8:3+events_unbound09:57:480
189773199252,22cyclictest0-21swapper/007:52:560
1897731992521,3cyclictest1980255-21cpuspeed_turbos08:32:420
1897731992520,4cyclictest2039380-21kworker/u8:3+flush-8:011:07:550
1897731992517,6cyclictest1914228-21ntpq07:22:500
1897739992421,2cyclictest1975317-21cpuspeed_turbos08:27:412
1897739992420,3cyclictest2118637-21kworker/u8:1+flush-8:011:27:462
1897739992420,3cyclictest1935550-21cpuspeed_turbos07:47:412
1897739992419,4cyclictest2182991-21kworker/u8:3+flush-8:011:57:582
1897739992419,4cyclictest1897384-21kworker/u8:3+flush-8:007:43:012
1897734992420,3cyclictest2202776-21kworker/u8:3+flush-8:012:31:561
1897734992420,2cyclictest2060340-21irqrtprio09:52:451
1897734992418,4cyclictest1919253-21ntpq07:27:511
1897734992416,6cyclictest278-21systemd-journal09:47:501
189773199243,20cyclictest1909971-21kworker/0:1+events07:41:390
189773199242,21cyclictest2083957-21kworker/0:0+events12:38:430
189773199242,21cyclictest2083957-21kworker/0:0+events12:38:430
1897731992421,2cyclictest2049528-21kworker/u8:0+events_unbound10:22:540
1897731992420,3cyclictest2049528-21kworker/u8:0+events_unbound10:17:390
1897731992419,4cyclictest1897384-21kworker/u8:3+flush-8:007:32:430
1897739992319,3cyclictest2104298-21aten2_r5power_c10:37:392
1897739992319,3cyclictest1960376-21fschecks_time08:12:432
1897739992319,2cyclictest2223323-21aten2_r5power_p12:37:402
1897739992319,2cyclictest2223323-21aten2_r5power_p12:37:392
1897739992314,7cyclictest278-21systemd-journal12:10:012
189773499238,3cyclictest21689452tune2fs11:42:401
1897734992321,1cyclictest0-21swapper/110:42:551
1897734992319,3cyclictest2118637-21kworker/u8:1+flush-8:011:06:201
1897734992319,2cyclictest0-21swapper/107:37:411
1897734992317,5cyclictest2039380-21kworker/u8:3+flush-8:009:32:561
1897734992317,4cyclictest2019150-21unixbench_singl09:07:581
1897734992316,5cyclictest278-21systemd-journal10:58:491
189773199232,20cyclictest2083957-21kworker/0:0+events12:31:030
189773199232,20cyclictest1934914-21kworker/0:2+events09:45:430
189773199232,20cyclictest1934914-21kworker/0:2+events09:24:390
189773199232,14cyclictest578-21runrttasks10:57:380
189773199232,14cyclictest575-21snmpd12:17:380
189773199231,15cyclictest578-21runrttasks10:27:370
1897731992310,11cyclictest141ktimers/010:47:450
18934912231,14sleep21893568-21awk07:07:442
1897739992217,4cyclictest2163119-21kworker/u8:0+flush-8:012:20:312
1897734992218,2cyclictest0-21swapper/110:12:391
1897734992218,2cyclictest0-21swapper/110:07:431
1897734992218,2cyclictest0-21swapper/108:22:421
1897734992218,2cyclictest0-21swapper/107:42:431
1897731992218,2cyclictest0-21swapper/008:20:000
1897731992215,5cyclictest1984447-21kworker/u8:1+flush-8:008:47:510
189773999213,2cyclictest421rcuog/209:02:472
1897739992117,3cyclictest1985187-21cpuspeed_turbos08:37:422
1897739992117,2cyclictest2063907-21unixbench_singl09:52:572
1897739992117,2cyclictest0-21swapper/209:40:002
1897739992111,3cyclictest0-21swapper/209:22:492
189773499217,5cyclictest0-21swapper/111:01:551
1897734992117,2cyclictest0-21swapper/108:52:441
1897734992117,2cyclictest0-21swapper/107:47:561
1897734992114,5cyclictest0-21swapper/111:37:481
1897734992114,5cyclictest0-21swapper/111:37:481
189773199212,18cyclictest2083957-21kworker/0:0+events11:25:030
1897731992116,3cyclictest1935673-21fschecks_time07:47:430
1897731992114,5cyclictest2173509-21base6411:45:000
189773999203,4cyclictest0-21swapper/211:12:462
1897739992017,2cyclictest1910766-21fschecks_count07:22:422
1897739992016,2cyclictest0-21swapper/210:57:492
1897739992015,3cyclictest0-21swapper/210:30:002
1897739992013,5cyclictest0-21swapper/207:40:012
1897739992011,7cyclictest2055936-21cut09:47:442
1897734992016,3cyclictest0-21swapper/109:37:551
1897734992016,2cyclictest0-21swapper/109:22:411
1897734992015,3cyclictest1969479-21cron08:20:001
1897734992014,4cyclictest0-21swapper/111:27:411
1897734992014,4cyclictest0-21swapper/108:47:441
1897734992014,3cyclictest0-21swapper/110:02:411
18931242203,9sleep30-21swapper/307:07:413
21177152190,2sleep20-21swapper/210:47:502
1897739991915,2cyclictest0-21swapper/208:00:012
1897739991911,6cyclictest2099761-21awk10:32:442
1897739991911,6cyclictest2069144-21sendmail-msp10:00:002
1897739991910,7cyclictest1941036-21sed07:52:452
189773999190,5cyclictest19985912netstat08:47:492
189773499195,5cyclictest0-21swapper/108:26:201
1897734991914,3cyclictest0-21swapper/108:05:001
1897734991913,4cyclictest0-21swapper/111:11:501
189773199190,17cyclictest2078338-21ntp_states10:07:530
189773999188,7cyclictest2089818-21if_err_enp3s010:22:432
1897739991815,2cyclictest2039831-21cpuspeed_turbos09:32:432
1897739991814,3cyclictest0-21swapper/210:10:002
1897739991810,6cyclictest2220382-21tr12:32:462
1897739991810,6cyclictest2202365-21cut12:12:552
1897739991810,6cyclictest2037417-21cut09:27:492
1897739991810,6cyclictest1-21systemd10:05:002
189773999179,6cyclictest2216587-21cut12:27:472
189773999179,6cyclictest2019890-21cut09:12:412
1897739991713,2cyclictest2136538-21kthreadcore11:07:482
1897739991713,2cyclictest0-21swapper/209:42:582
1897739991713,2cyclictest0-21swapper/208:41:192
1897739991713,2cyclictest0-21swapper/208:41:192
1897739991711,2cyclictest0-21swapper/208:30:292
1897739991710,5cyclictest1955172-21cut08:07:402
189773999168,6cyclictest2203757-21sort12:17:412
189773999162,13cyclictest0-21swapper/210:40:162
1897739991611,3cyclictest0-21swapper/209:00:012
19034352140,5sleep30-21swapper/307:15:023
20938372132,6sleep30-21swapper/310:25:013
20488092130,2sleep3471rcuc/309:37:583
19895192132,6sleep30-21swapper/308:40:013
19895192132,6sleep30-21swapper/308:40:013
22268052122,6sleep30-21swapper/312:37:493
22268052122,6sleep30-21swapper/312:37:493
22209142123,6sleep30-21swapper/312:32:473
22129072122,6sleep30-21swapper/312:25:013
21930142122,6sleep30-21swapper/312:04:193
21839682122,6sleep30-21swapper/311:57:453
21825702122,6sleep30-21swapper/311:52:563
21688252122,6sleep30-21swapper/311:42:403
21626742122,6sleep30-21swapper/311:32:573
21541872122,6sleep30-21swapper/311:27:443
21483192122,6sleep30-21swapper/311:20:013
21472632122,6sleep30-21swapper/311:17:493
21338152122,6sleep30-21swapper/311:06:213
21278702122,6sleep30-21swapper/310:57:553
21190422123,6sleep30-21swapper/310:52:373
21087982122,5sleep30-21swapper/310:40:013
20842972122,6sleep30-21swapper/310:16:503
20834612122,6sleep30-21swapper/310:12:573
20645532123,5sleep30-21swapper/309:57:363
20610112122,6sleep30-21swapper/309:52:483
20542552122,6sleep30-21swapper/309:45:013
20514582122,6sleep30-21swapper/309:42:483
20292932122,6sleep30-21swapper/309:20:023
20284982122,6sleep30-21swapper/309:17:483
20153672120,8sleep30-21swapper/309:07:453
20028942122,6sleep30-21swapper/308:52:493
19948852122,6sleep30-21swapper/308:47:393
19800052122,6sleep30-21swapper/308:32:393
19649732123,5sleep30-21swapper/308:17:383
19551122122,6sleep30-21swapper/308:07:393
19411872122,6sleep30-21swapper/307:52:473
19024462122,6sleep30-21swapper/307:12:593
22127912112,6sleep30-21swapper/312:23:523
22032372112,5sleep30-21swapper/312:15:503
21983432113,5sleep30-21swapper/312:11:053
21933482112,5sleep30-21swapper/312:05:363
21735462112,6sleep30-21swapper/311:45:213
21635312112,6sleep30-21swapper/311:37:023
21635312112,6sleep30-21swapper/311:37:023
21387662112,6sleep30-21swapper/311:11:513
21293312112,5sleep30-21swapper/311:02:443
21077692112,6sleep30-21swapper/310:37:493
20992652112,6sleep30-21swapper/310:32:233
20982132112,5sleep30-21swapper/310:27:543
20743272112,6sleep30-21swapper/310:05:153
20733962112,5sleep30-21swapper/310:02:543
20395452112,6sleep30-21swapper/309:32:133
20344442112,6sleep30-21swapper/309:25:073
20196972112,6sleep30-21swapper/309:11:263
20097852112,6sleep30-21swapper/309:00:433
20050642112,5sleep30-21swapper/308:57:383
19870872112,5sleep30-21swapper/308:37:483
19748792113,5sleep30-21swapper/308:25:093
19736792112,5sleep30-21swapper/308:22:523
19599412112,6sleep30-21swapper/308:11:243
19495832112,6sleep30-21swapper/307:58:243
19352072112,6sleep30-21swapper/307:46:293
19301732112,6sleep30-21swapper/307:40:153
19291762112,5sleep30-21swapper/307:37:503
19203672112,6sleep30-21swapper/307:32:373
19152892112,6sleep30-21swapper/307:26:033
21139312102,5sleep30-21swapper/310:45:033
19499672102,5sleep30-21swapper/308:00:053
19102752102,5sleep30-21swapper/307:20:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional