You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 01:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Apr 06, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1575090996947,19cyclictest1715927-21cp09:30:012
16452342630,5sleep375-21kworker/3:1+mm_percpu_wq08:16:303
19006872620,4chrt0-21swapper/012:36:230
1575088996055,3cyclictest1601902-21kworker/u8:0+events_unbound08:56:361
1575088995650,4cyclictest1880415-21kworker/u8:0+flush-8:012:16:391
1575085995650,4cyclictest1766348-21apt-get10:20:370
1575088995547,6cyclictest1601902-21kworker/u8:0+flush-8:008:01:321
1575088995447,5cyclictest738143-21kworker/u8:4+flush-8:008:06:331
1575088995245,5cyclictest1800977-21kworker/u8:1+flush-8:011:21:371
1575088995245,5cyclictest1766079-21kworker/u8:0+events_unbound11:56:341
1575088995245,5cyclictest1601902-21kworker/u8:0+flush-8:009:26:371
1575088995144,5cyclictest1850246-21kworker/u8:1+events_unbound11:51:351
1575088995043,5cyclictest1755896-21kworker/u8:2+flush-8:010:11:371
1575085995031,17cyclictest1575310-21/usr/sbin/munin07:11:320
1575088994840,6cyclictest1522702-21kworker/u8:0+flush-8:007:16:331
157508599481,33cyclictest589-21runrttasks08:26:330
1575088994742,4cyclictest1850246-21kworker/u8:1+flush-8:012:01:351
1575088994742,4cyclictest1755896-21kworker/u8:2+events_unbound10:26:351
1575088994742,4cyclictest1601902-21kworker/u8:0+events_unbound07:41:331
1575085994727,17cyclictest1805751-21systemd-run11:00:010
1575088994641,4cyclictest1815837-21kworker/u8:3+events_unbound11:16:361
1575085994637,6cyclictest1790849-21latency_hist10:45:010
1575085994636,8cyclictest1829578-21ntpq11:21:310
1575088994540,4cyclictest738143-21kworker/u8:4+flush-8:007:11:371
1575088994540,4cyclictest1815837-21kworker/u8:3+flush-8:011:11:321
1575088994538,5cyclictest738143-21kworker/u8:4+flush-8:007:21:341
1575088994529,4cyclictest1800977-21kworker/u8:1+flush-8:011:31:291
1575088994439,3cyclictest1796006-21kworker/u8:2+events_unbound11:30:011
1575088994438,5cyclictest1800977-21kworker/u8:1+events_unbound10:56:381
1575088994438,4cyclictest738143-21kworker/u8:4+flush-8:008:31:381
1575088994438,4cyclictest1796006-21kworker/u8:2+events_unbound11:01:361
1575090994328,12cyclictest1653619-21kthreadcore08:26:282
1575088994339,3cyclictest1601902-21kworker/u8:0+flush-8:009:06:361
1575088994338,4cyclictest738143-21kworker/u8:4+events_unbound08:41:331
1575088994338,4cyclictest738143-21kworker/u8:4+events_unbound08:41:331
1575088994337,4cyclictest1691104-21kworker/u8:1+flush-8:010:46:321
1575088994337,4cyclictest1691104-21kworker/u8:1+flush-8:010:46:321
1575088994333,7cyclictest1691104-21kworker/u8:1+flush-8:009:11:331
1575085994335,5cyclictest1785896-21latency_hist10:40:000
1575085994327,14cyclictest1869936-21unixbench_multi12:01:400
1575085994324,17cyclictest1762192-21irqrtprio10:16:260
157508599431,32cyclictest1660344-21ntpq08:31:320
1575088994237,4cyclictest1574942-21kworker/u8:2+events_unbound07:46:341
1575088994236,5cyclictest1741552-21kworker/u8:3+flush-8:010:16:271
1575088994236,4cyclictest1865567-21kworker/u8:4+events_unbound12:06:311
1575088994236,4cyclictest1705739-21latency_hist09:20:011
1575088994235,5cyclictest1596925-21kworker/u8:1+flush-8:007:31:381
1575085994215,23cyclictest1884510-21python312:16:380
1575085994212,22cyclictest1855902-21idleruntime11:51:240
1575090994123,15cyclictest1626440-21awk08:00:002
1575088994134,6cyclictest1522702-21kworker/u8:0+flush-8:007:26:371
157508899410,39cyclictest1-21systemd12:40:001
1575085994133,5cyclictest1671100-21latency_hist08:45:000
1575085994133,5cyclictest1671100-21latency_hist08:45:000
1575085994123,16cyclictest1865060-21systemctl12:00:000
1575088994036,3cyclictest738143-21kworker/u8:4+flush-8:007:36:261
157508599401,21cyclictest1591509-21vmstat07:21:400
157508599400,25cyclictest1701094-21runrttasks09:16:010
1575088993934,4cyclictest1850246-21kworker/u8:1+events_unbound11:46:321
1575088993934,4cyclictest1735877-21kworker/u8:2+flush-8:009:51:371
1575088993933,5cyclictest738143-21kworker/u8:4+flush-8:008:11:381
1575085993927,10cyclictest1671446-21apt-get08:46:190
157508599391,21cyclictest1850579-21taskset11:46:190
1575088993834,2cyclictest1601902-21kworker/u8:0+events_unbound07:56:211
1575088993833,4cyclictest1766079-21kworker/u8:0+events_unbound11:06:311
1575088993833,4cyclictest1691104-21kworker/u8:1+flush-8:009:31:401
1575088993832,5cyclictest1780789-21kworker/u8:3+flush-8:010:36:221
1575088993832,5cyclictest1691104-21kworker/u8:1+events_unbound09:56:361
1575088993832,5cyclictest1601902-21kworker/u8:0+events_unbound08:46:221
157508599382,23cyclictest0-21swapper/010:27:280
157508599382,22cyclictest0-21swapper/011:07:410
157508599382,22cyclictest0-21swapper/009:09:190
157508599380,24cyclictest1845576-21runrttasks11:40:480
157508599380,23cyclictest1720816-21runrttasks09:32:100
157509099372,13cyclictest1726349-21apt-get09:41:202
1575088993732,4cyclictest1626677-21kworker/u8:1+events_unbound08:21:331
1575088993731,4cyclictest1776374-21apt-get10:31:191
1575088993731,4cyclictest1691104-21kworker/u8:1+flush-8:010:41:381
1575088993730,5cyclictest280-21systemd-journal12:34:181
157508599373,27cyclictest0-21swapper/009:36:180
157508599373,26cyclictest0-21swapper/008:21:200
157508599372,23cyclictest0-21swapper/010:52:120
157508599372,21cyclictest0-21swapper/010:09:020
157508599372,21cyclictest0-21swapper/007:33:000
157508599372,19cyclictest0-21swapper/011:01:590
157508599371,22cyclictest1700679-21runrttasks09:13:400
1575090993621,12cyclictest1870636-21apt-get12:06:192
1575088993632,3cyclictest1601902-21kworker/u8:0+events_unbound07:51:351
1575088993631,4cyclictest1766079-21kworker/u8:0+events_unbound10:51:251
1575088993630,5cyclictest1691104-21kworker/u8:1+events_unbound10:01:221
1575088993630,5cyclictest1601902-21kworker/u8:0+events_unbound09:21:311
157508599363,28cyclictest0-21swapper/007:16:180
157508599363,18cyclictest0-21swapper/008:19:510
157508599362,23cyclictest0-21swapper/007:46:000
1575085993620,13cyclictest882-21mta-sts-daemon11:11:340
1575085993618,16cyclictest1761116-21cron10:15:000
1575085993613,20cyclictest1715073-21ntpq09:26:340
157508599361,22cyclictest589-21runrttasks11:18:250
157508599361,22cyclictest589-21runrttasks09:44:420
157508599361,22cyclictest589-21runrttasks09:04:130
157508599361,20cyclictest1611583-21runrttasks07:44:350
157508599361,19cyclictest1746087-21runrttasks09:57:470
157508599361,19cyclictest1632121-21sort08:06:240
157508599360,23cyclictest589-21runrttasks09:52:090
157508599360,23cyclictest589-21runrttasks08:04:260
157508599360,22cyclictest1899749-21runrttasks12:32:250
157508599360,22cyclictest1685901-21runrttasks08:59:560
157508599360,22cyclictest1641009-21runrttasks08:12:200
1575090993526,6cyclictest1646172-21awk08:20:002
157509099352,13cyclictest1860442-21apt-get11:56:202
157509099352,13cyclictest1815924-21apt-get11:11:202
1575090993520,13cyclictest1859777-21unixbench_singl11:51:392
1575090993520,13cyclictest1696411-21cpuspeed_turbos09:11:232
1575088993530,4cyclictest1865567-21kworker/u8:4+flush-8:012:26:331
1575088993530,4cyclictest1726226-21kworker/u8:0+events_unbound09:41:221
1575088993529,4cyclictest1626677-21kworker/u8:1+flush-8:008:26:321
1575088993527,6cyclictest1686291-21apt-get09:01:201
157508599355,16cyclictest0-21swapper/009:47:180
157508599353,26cyclictest0-21swapper/010:31:190
157508599352,24cyclictest0-21swapper/008:51:570
157508599352,22cyclictest0-21swapper/012:26:190
157508599352,19cyclictest0-21swapper/012:20:450
1575085993517,16cyclictest1836021-21fschecks_time11:31:240
1575085993517,16cyclictest1621122-21unixbench_multi07:51:390
1575085993514,18cyclictest0-21swapper/011:26:390
157508599351,31cyclictest1874414-21ntpq12:06:330
157508599351,21cyclictest589-21runrttasks12:11:090
157508599351,21cyclictest589-21runrttasks10:48:190
157508599351,21cyclictest589-21runrttasks10:48:190
157508599351,21cyclictest589-21runrttasks07:28:300
157508599351,20cyclictest1746559-21runrttasks10:00:350
157508599351,20cyclictest1621709-21runrttasks07:55:110
157508599350,23cyclictest589-21runrttasks07:36:370
157508599350,22cyclictest589-21runrttasks08:38:570
157508599350,20cyclictest1710777-21runrttasks09:23:190
157509099342,12cyclictest1656633-21apt-get08:31:212
157509099342,12cyclictest1616890-21apt-get07:51:202
1575090993415,2cyclictest0-21swapper/208:01:202
1575088993429,4cyclictest1835586-21kworker/u8:3+flush-8:011:41:331
1575088993429,3cyclictest1876160-21irqcore12:11:261
1575088993429,3cyclictest1766079-21kworker/u8:0+events_unbound10:25:011
1575088993428,4cyclictest1665892-21kworker/u8:2+events_unbound09:36:311
157508599342,18cyclictest0-21swapper/011:35:420
1575090993316,4cyclictest0-21swapper/210:40:002
1575090993316,3cyclictest1646882-21fschecks_time08:21:232
1575090993316,2cyclictest0-21swapper/207:15:042
157509099324,9cyclictest1796132-21apt-get10:51:222
1575090993215,2cyclictest1721037-21cron09:35:002
1575090993212,6cyclictest1771728-21fschecks_count10:26:232
1575088993228,3cyclictest1716366-21kworker/u8:3+events_unbound09:46:341
1575090993125,4cyclictest1637590-21kthreadcore08:11:282
1575090993114,3cyclictest0-21swapper/211:50:002
1575090993113,3cyclictest0-21swapper/207:21:312
1575088993126,4cyclictest738143-21kworker/u8:4+flush-8:008:51:331
1575090993021,6cyclictest1795782-21turbostat.cron10:50:002
1575090993021,6cyclictest1795782-21turbostat.cron10:50:002
1575090993014,3cyclictest0-21swapper/212:01:402
1575088993025,4cyclictest738143-21kworker/u8:4+flush-8:008:16:371
15748402303,8sleep20-21swapper/207:09:122
157509099292,8cyclictest1597047-21apt-get07:31:182
1575090992811,6cyclictest1686578-21grep09:01:242
1575088992823,3cyclictest738143-21kworker/u8:4+flush-8:008:36:291
16053852270,6sleep30-21swapper/307:36:293
1575090992723,2cyclictest1612203-21cpuspeed_turbos07:46:222
157038922712,9sleep10-21swapper/107:06:181
1575090992620,4cyclictest1705409-21unixbench_singl09:16:372
1575090992620,3cyclictest1776404-21aten2_r5power_c10:31:212
1575090992619,5cyclictest280-21systemd-journal12:20:002
1575088992622,2cyclictest0-21swapper/111:40:001
157508599260,22cyclictest1574920-21latency_hist07:10:010
1575088992517,3cyclictest1865567-21kworker/u8:4+events_unbound12:20:381
1575090992414,2cyclictest0-21swapper/211:31:402
1575088992420,3cyclictest1726226-21kworker/u8:0+events_unbound10:06:371
15749032244,12sleep30-21swapper/307:10:013
1575090992319,3cyclictest1830906-21aten2_r5power_v11:26:202
1575090992319,2cyclictest1840883-21cpuspeed_turbos11:36:222
1575090992319,2cyclictest1746930-21fschecks_count10:01:232
1575090992319,2cyclictest1731566-21aten2_r5power_c09:46:182
1575090992319,2cyclictest1691308-21aten2_r5power_p09:06:202
1575090992319,2cyclictest1662459-21kthreadcore08:36:262
1575090992318,3cyclictest1895553-21cpuspeed_turbos12:31:222
1575090992318,3cyclictest1756583-21aten2_r5power_p10:11:212
1575090992218,2cyclictest0-21swapper/207:40:002
1575090992217,3cyclictest0-21swapper/210:20:002
1575090992217,3cyclictest0-21swapper/208:56:382
1575090992213,7cyclictest1746277-21run-parts10:00:002
1575090992117,2cyclictest1676693-21fschecks_count08:51:242
1575090992017,2cyclictest1806141-21aten2_r5power_e11:01:212
1575090992012,6cyclictest1878256-21tr12:11:292
157509099199,8cyclictest1723483-21tr09:36:272
157509099192,12cyclictest1890416-21apt-get12:26:212
157509099192,12cyclictest1631732-21apt-get08:06:202
1575090991915,3cyclictest0-21swapper/207:26:382
1575090991915,2cyclictest0-21swapper/209:55:012
1575090991814,2cyclictest0-21swapper/211:21:292
1575090991814,2cyclictest0-21swapper/210:41:372
157509099181,12cyclictest1766460-21apt-get10:21:202
17152032170,2sleep3481ktimers/309:26:363
157509099178,7cyclictest280-21systemd-journal12:36:172
157509099178,7cyclictest1672320-21sed08:46:262
1575090991714,2cyclictest0-21swapper/209:21:392
1575090991713,2cyclictest0-21swapper/211:20:002
1575090991713,2cyclictest0-21swapper/211:06:382
1575090991713,2cyclictest0-21swapper/208:41:322
1575090991713,2cyclictest0-21swapper/208:41:322
15970502162,9sleep30-21swapper/307:31:203
157509099168,6cyclictest280-21systemd-journal11:40:172
1575090991613,2cyclictest0-21swapper/207:13:452
1575090991612,3cyclictest0-21swapper/207:41:282
1575090991612,2cyclictest0-21swapper/210:06:222
1575090991611,3cyclictest0-21swapper/210:56:302
18208622152,8sleep30-21swapper/311:16:213
17797662150,2chrt75-21kworker/3:1-events10:31:293
1575090991510,3cyclictest0-21swapper/212:21:292
18843642142,8sleep30-21swapper/312:16:373
18504872146,5sleep30-21swapper/311:45:293
18098992143,7sleep30-21swapper/311:01:363
18852432132,6sleep30-21swapper/312:20:023
18800412136,5sleep30-21swapper/312:13:443
18697122132,7sleep30-21swapper/312:01:403
18161732132,7sleep30-21swapper/311:11:233
17957642132,6sleep30-21swapper/310:50:003
17957642132,6sleep30-21swapper/310:50:003
17455062132,7sleep30-21swapper/309:56:353
16702302132,7sleep30-21swapper/308:41:313
16702302132,7sleep30-21swapper/308:41:313
16270102132,7sleep30-21swapper/308:01:223
16123512132,7sleep30-21swapper/307:46:253
16076772132,6sleep30-21swapper/307:41:273
18949932122,5sleep30-21swapper/312:30:013
18592332122,6sleep30-21swapper/311:51:323
18448972122,6sleep30-21swapper/311:36:403
18353712122,5sleep30-21swapper/311:30:013
18311642122,6sleep30-21swapper/311:26:243
18256292122,5sleep30-21swapper/311:20:023
18010392122,6sleep30-21swapper/310:56:063
17859372122,5sleep30-21swapper/310:40:013
17828242122,6sleep30-21swapper/310:36:283
17676032122,6sleep30-21swapper/310:21:433
17611432122,5sleep30-21swapper/310:15:013
17514092122,6sleep30-21swapper/310:05:023
17260422122,6sleep30-21swapper/309:40:023
17106342122,6sleep30-21swapper/309:21:403
17054292122,6sleep30-21swapper/309:16:383
17003882122,6sleep30-21swapper/309:11:413
16850702122,6sleep30-21swapper/308:56:323
16762902122,6sleep30-21swapper/308:50:143
16718162122,6sleep30-21swapper/308:46:243
16568772122,6sleep30-21swapper/308:31:243
16547232122,6sleep30-21swapper/308:26:303
16217742122,6sleep30-21swapper/307:56:043
15929082122,6sleep30-21swapper/307:26:263
15752992122,6sleep30-21swapper/307:11:143
19012152111,6sleep30-21swapper/312:36:273
18903682112,6sleep30-21swapper/312:26:043
18710432112,5sleep30-21swapper/312:06:253
18601182112,5sleep30-21swapper/311:55:023
18456112112,5sleep30-21swapper/311:41:173
18149862112,5sleep30-21swapper/311:06:383
17965882112,5sleep30-21swapper/310:51:293
17713262112,6sleep30-21swapper/310:25:123
17564502112,6sleep30-21swapper/310:11:033
17469862112,5sleep30-21swapper/310:01:253
17364222116,4sleep30-21swapper/309:51:013
17314192112,5sleep30-21swapper/309:45:073
17213972112,5sleep30-21swapper/309:36:213
17164752112,5sleep30-21swapper/309:31:233
16910982112,5sleep30-21swapper/309:05:023
16876082112,5sleep30-21swapper/309:01:293
16611712112,5sleep30-21swapper/308:35:013
16479932112,5sleep30-21swapper/308:21:283
16410712112,5sleep30-21swapper/308:13:103
16355702112,5sleep30-21swapper/308:06:353
16167592112,5sleep30-21swapper/307:50:023
15916522112,6sleep30-21swapper/307:23:303
15802542112,5sleep30-21swapper/307:15:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional