You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 00:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Jun 23, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26534852630,2sleep375-21kworker/3:1-events11:55:243
2367731996050,8cyclictest2428735-21kworker/u8:1+flush-8:008:50:220
2367731995949,8cyclictest2527718-21kworker/u8:1+flush-8:010:20:380
2367734995548,5cyclictest2562363-21ntpq10:20:331
2367731995546,6cyclictest2434035-21latency_hist08:15:010
2367739995442,9cyclictest2433150-21ntpq08:10:312
2367731995446,6cyclictest2439448-21kworker/u8:2+flush-8:008:25:310
25047662530,4chrt371rcuc/209:25:252
25047662530,4chrt371rcuc/209:25:242
2367731995348,3cyclictest2548071-21kworker/u8:0+events_unbound10:35:220
236773199521,49cyclictest1-21systemd10:10:010
2367739995142,7cyclictest1704890-21systemd-journal10:10:012
2367739995141,7cyclictest2444207-21turbostat.cron08:25:002
2367734995145,4cyclictest2533197-21kworker/u8:2+events_unbound11:50:371
2367734995142,6cyclictest2503597-21latency_hist09:25:011
2367734995043,5cyclictest2428161-21ntpq08:05:311
2367734995036,10cyclictest1704890-21systemd-journal12:00:441
2367731995039,8cyclictest2592053-21ntpq10:50:330
2367739994840,5cyclictest2372791-21munin-node07:15:022
2367731994735,10cyclictest1704890-21systemd-journal09:50:000
2367731994640,5cyclictest2548071-21kworker/u8:0+flush-8:010:15:320
2367734994539,4cyclictest2548071-21kworker/u8:0+flush-8:010:15:381
2367734994537,6cyclictest2573128-21latency_hist10:35:001
2367731994536,6cyclictest2632935-21latency_hist11:35:000
2367734994439,3cyclictest2597862-21kworker/u8:4+flush-8:011:10:361
2367734994432,9cyclictest1704890-21systemd-journal11:35:431
2367731994337,4cyclictest2548071-21kworker/u8:0+flush-8:010:25:360
2367731994335,5cyclictest2428735-21kworker/u8:1+flush-8:008:45:360
2367731994331,9cyclictest2583572-21diskstats10:45:180
2367734994235,5cyclictest1704890-21systemd-journal10:40:441
2367734994231,8cyclictest2463094-21ntpq08:40:341
2367731994230,9cyclictest2438051-21ntpq08:15:310
2367731994135,4cyclictest1645010-21kworker/u8:1+flush-8:007:35:350
2367739994034,4cyclictest2399065-21kworker/u8:3+flush-8:007:40:152
2367731994034,4cyclictest2419199-21kworker/u8:0+flush-8:008:35:200
2367731994032,6cyclictest2383479-21ntpq07:20:300
2367731994026,10cyclictest1704890-21systemd-journal08:05:000
2367734993932,5cyclictest2448280-21ntpq08:25:321
2367734993930,6cyclictest2676559-21ntpq12:15:321
2367731993933,4cyclictest2527718-21kworker/u8:1+events_unbound11:40:270
2367731993930,6cyclictest2443315-21ntpq08:20:320
2367731993926,9cyclictest2618282-21kworker/u8:0+flush-8:011:55:320
2367739993830,5cyclictest2513444-21journal-offline09:34:272
2367734993830,6cyclictest2527718-21kworker/u8:1+flush-8:011:05:311
2367734993830,5cyclictest2568210-21latency_hist10:30:011
2367731993833,4cyclictest2533197-21kworker/u8:2+flush-8:010:30:360
2367731993832,4cyclictest2419199-21kworker/u8:0+flush-8:009:10:230
2367731993827,8cyclictest2596997-21ntpq10:55:330
2367731993731,4cyclictest2527718-21kworker/u8:1+events_unbound10:00:260
2367731993730,5cyclictest2533197-21kworker/u8:2+flush-8:011:00:310
2367731993730,4cyclictest2661748-21kworker/u8:3+flush-8:012:05:300
2367731993729,6cyclictest2414172-21basename07:55:010
2367734993631,3cyclictest2512665-21ntpq09:30:341
2367734993630,4cyclictest2652984-21apt-get11:55:161
2367734993530,3cyclictest2523458-21gpgv09:45:001
2367734993528,5cyclictest2677992-21apt-get12:20:171
2367734993524,8cyclictest1704890-21systemd-journal09:11:431
2367731993530,3cyclictest2533197-21kworker/u8:2+flush-8:012:25:200
2367731993528,5cyclictest2439448-21kworker/u8:2+flush-8:008:55:210
2367731993528,5cyclictest1645010-21kworker/u8:1+events_unbound07:10:330
2367731993525,8cyclictest2414692-21diskstats07:55:220
2367739993424,8cyclictest2519120-21fschecks_time09:40:222
2367734993425,7cyclictest2428735-21kworker/u8:1+flush-8:009:35:211
2367739993328,4cyclictest2358030-21kworker/u8:2+flush-8:008:00:312
2367739993324,6cyclictest2444784-21fschecks_time08:25:212
2367734993327,4cyclictest2667567-21journal-offline12:10:001
2367734993325,6cyclictest2404502-21/usr/sbin/munin07:45:301
2367734993324,7cyclictest2438138-21ntpq08:15:341
2367731993329,3cyclictest2533197-21kworker/u8:2+flush-8:009:55:360
2367731993328,3cyclictest2518730-21kworker/u8:2+flush-8:009:40:320
2367731993327,4cyclictest2697464-21latency_hist12:40:010
2367731993327,4cyclictest2697464-21latency_hist12:40:000
2367731993326,5cyclictest1704890-21systemd-journal09:04:220
2367731993325,5cyclictest2403305-21ntpq07:40:310
2367739993226,4cyclictest1645010-21kworker/u8:1+flush-8:007:20:322
2367734993226,4cyclictest2697497-21true12:40:001
2367734993226,4cyclictest2697497-21true12:40:001
2367734993226,4cyclictest2552474-21ntpq10:10:311
2367734993223,7cyclictest2627956-21latency_hist11:30:011
2367731993227,3cyclictest8550irq/124-ahci[0000:00:12.0]09:05:310
2367731993224,6cyclictest2618282-21kworker/u8:0+flush-8:011:20:360
2367731993224,5cyclictest2508160-21grep09:25:380
2367731993224,5cyclictest2508160-21grep09:25:370
2367731993224,5cyclictest2389603-21/usr/sbin/munin07:30:290
2367734993128,2cyclictest2527718-21kworker/u8:1+events_unbound11:15:341
2367734993126,3cyclictest2453657-21unixbench_multi08:30:401
2367734993124,6cyclictest2419199-21kworker/u8:0+flush-8:008:55:301
2367734993124,5cyclictest1704890-21systemd-journal08:23:431
2367734993123,6cyclictest2358030-21kworker/u8:2+flush-8:007:10:361
2367734993123,5cyclictest2384436-21latency_hist07:25:021
2367731993127,3cyclictest2607877-21basename11:10:000
2367731993124,5cyclictest2428735-21kworker/u8:1+flush-8:009:20:000
2367731993121,8cyclictest2532604-21ntpq09:50:310
2367739993025,4cyclictest2533197-21kworker/u8:2+flush-8:011:25:362
2367739993025,3cyclictest2449779-21fschecks_time08:30:242
2367739993024,4cyclictest2553981-21fschecks_time10:15:222
2367739993021,7cyclictest2608427-21fschecks_count11:10:202
2367739993018,9cyclictest2618168-21cat11:20:012
2367734993027,2cyclictest2687616-21systemd-run12:29:591
2367734993026,3cyclictest2533197-21kworker/u8:2+flush-8:010:45:201
2367734993025,4cyclictest2527718-21kworker/u8:1+events_unbound10:05:211
2367734993020,8cyclictest2413234-21ntpq07:50:301
2367731993024,4cyclictest2637891-21systemd-run11:40:000
2367731993023,5cyclictest2677469-21apt-get12:20:000
2367731993020,8cyclictest2449678-21diskstats08:30:230
2367739992924,3cyclictest2688152-21fschecks_count12:30:212
2367739992921,6cyclictest2524201-21fschecks_count09:45:212
2367739992920,7cyclictest2393890-21unixbench_singl07:30:382
2367734992924,3cyclictest2573624-21cpuspeed_turbos10:35:211
2367731992925,3cyclictest1645010-21kworker/u8:1+events_unbound07:25:260
2367731992923,4cyclictest2409260-21systemd-run07:50:000
2367731992917,8cyclictest1704890-21systemd-journal11:15:000
2367739992823,3cyclictest2533092-21unixbench_multi09:50:382
2367739992822,4cyclictest2687154-21unixbench_multi12:25:402
2367734992822,4cyclictest2464232-21apt-get08:45:181
2367734992821,5cyclictest2538501-21latency_hist10:00:011
2367734992821,5cyclictest2454366-21apt-get08:35:171
2367731992822,4cyclictest2428677-21unixbench_singl08:05:380
2367731992820,6cyclictest2379003-21grep07:15:380
2367731992820,5cyclictest2428735-21kworker/u8:1+events_unbound09:35:250
2367739992722,4cyclictest2667001-21kworker/u8:1+flush-8:012:10:332
2367739992720,5cyclictest2661748-21kworker/u8:3+events_unbound12:00:352
2367739992718,7cyclictest2404841-21fschecks_time07:45:222
2367739992717,8cyclictest2493688-21/usr/sbin/munin09:15:002
2367734992723,3cyclictest885-21mta-sts-daemon11:40:371
2367734992723,3cyclictest2527718-21kworker/u8:1+flush-8:011:48:151
2367734992722,3cyclictest2622625-21unixbench_singl11:20:371
2367734992720,5cyclictest2479074-21apt-get09:00:161
2367734992720,5cyclictest1704890-21systemd-journal10:05:011
2367731992717,8cyclictest2498880-21/usr/sbin/munin09:20:300
2367739992623,2cyclictest2643124-21aten2_r5power_c11:45:182
2367739992623,2cyclictest2367965-21aten2_r5power_e07:10:202
2367739992622,2cyclictest2464455-21cpuspeed_turbos08:45:212
2367739992621,3cyclictest2558875-21fschecks_count10:20:242
2367739992620,4cyclictest2593481-21fschecks_count10:55:222
2367739992620,4cyclictest2499196-21fschecks_count09:20:222
2367739992620,4cyclictest2428735-21kworker/u8:1+events_unbound08:40:372
2367739992617,7cyclictest2697068-21unixbench_singl12:35:392
2367739992617,7cyclictest2697068-21unixbench_singl12:35:392
2367739992617,7cyclictest2603511-21fschecks_time11:05:222
2367739992617,7cyclictest2471332-21kthreadcore08:50:282
2367734992622,3cyclictest2602916-21systemd-run11:05:001
2367734992619,5cyclictest2419142-21cron08:00:001
2367734992618,6cyclictest2618282-21kworker/u8:0+flush-8:012:30:311
2367734992616,8cyclictest2672509-21ls12:14:591
2367731992620,4cyclictest2533197-21kworker/u8:2+events_unbound10:10:190
2367731992618,6cyclictest2618282-21kworker/u8:0+flush-8:012:30:320
23629442266,13sleep10-21swapper/107:05:191
24106362250,5sleep30-21swapper/307:50:273
2367739992521,2cyclictest2479104-21aten2_r5power_c09:00:172
2367739992520,4cyclictest2682208-21unixbench_multi12:20:372
2367739992520,3cyclictest2592504-21unixbench_multi10:50:382
2367734992521,2cyclictest2391788-21kthreadcore07:30:261
2367734992520,4cyclictest2498618-21apt09:20:001
2367734992520,3cyclictest2419199-21kworker/u8:0+flush-8:008:10:261
2367734992520,3cyclictest2379010-21unixbench_multi07:15:371
2367731992523,1cyclictest0-21swapper/012:15:370
2367731992521,2cyclictest2672538-21systemd-run12:15:000
2367731992520,3cyclictest2583081-21systemd-run10:45:010
2367731992518,5cyclictest2662612-21/usr/sbin/munin12:05:000
2367731992515,7cyclictest2647784-21cat11:50:000
2367739992419,3cyclictest2563832-21fschecks_count10:25:222
2367739992418,4cyclictest2657645-21turbostat.cron11:59:592
2367734992420,3cyclictest2473413-21unixbench_multi08:50:391
2367734992419,4cyclictest2618282-21kworker/u8:0+flush-8:011:34:151
2367734992419,3cyclictest2592514-21unixbench_multi10:50:391
2367734992416,6cyclictest2419199-21kworker/u8:0+events_unbound09:45:341
2367731992419,3cyclictest2509412-21sort09:30:260
2367731992419,2cyclictest0-21swapper/008:40:310
23946292230,4sleep1291ktimers/107:35:191
2367739992319,3cyclictest2618282-21kworker/u8:0+events_unbound11:20:232
2367739992318,3cyclictest2409857-21fschecks_time07:50:222
2367739992318,3cyclictest2398803-21unixbench_multi07:35:372
2367739992318,3cyclictest0-21swapper/209:10:002
2367739992316,5cyclictest2518523-21/usr/sbin/munin09:40:012
2367739992315,6cyclictest2478416-21grep08:55:382
2367739992315,6cyclictest0-21swapper/211:40:002
236773999230,21cyclictest2439041-21munin-run08:20:012
2367734992318,3cyclictest2533197-21kworker/u8:2+events_unbound10:55:341
2367731992319,2cyclictest0-21swapper/011:20:000
2367731992318,3cyclictest2533197-21kworker/u8:2+events_unbound11:25:220
2367739992218,2cyclictest2583409-21aten2_r5power_p10:45:182
2367739992217,4cyclictest2677485-21dpkg12:20:002
2367739992215,5cyclictest2577527-21timerandwakeup10:35:372
2367739992212,8cyclictest2497097-21cut09:15:272
2367734992217,4cyclictest2428735-21kworker/u8:1+flush-8:009:05:311
2367734992217,4cyclictest1645010-21kworker/u8:1+flush-8:007:25:321
2367734992216,5cyclictest2513346-21kworker/u8:3+flush-8:009:50:311
2367734992215,5cyclictest1645010-21kworker/u8:1+flush-8:007:40:321
2367739992117,2cyclictest2638451-21fschecks_time11:40:212
2367734992113,6cyclictest2423108-21grep08:00:301
2367731992117,3cyclictest2618282-21kworker/u8:0+events_unbound11:50:250
23629742214,11sleep30-21swapper/307:05:203
236773999202,9cyclictest0-21swapper/211:50:272
2367739992016,3cyclictest2553358-21idleruntime-cro10:15:012
2367739992011,7cyclictest0-21swapper/210:30:282
2367739992010,7cyclictest2599055-21uname11:00:262
2367734992016,3cyclictest2508559-21/usr/sbin/munin09:30:001
2367734992016,3cyclictest2508559-21/usr/sbin/munin09:29:591
2367731992011,7cyclictest2367584-21latency_hist07:10:020
2367739991914,3cyclictest0-21swapper/210:40:222
2367739991911,6cyclictest2535999-21tr09:55:282
23672272193,10sleep20-21swapper/207:05:442
2367739991815,2cyclictest2424470-21aten2_r5power_p08:05:202
2367739991814,2cyclictest2539131-21fschecks_time10:00:212
2367739991814,2cyclictest2454655-21fschecks_count08:35:212
2367739991814,2cyclictest0-21swapper/207:25:292
2367739991811,5cyclictest0-21swapper/211:30:162
236773999179,6cyclictest2666812-21cut12:05:352
2367739991713,2cyclictest0-21swapper/207:55:252
26774552153,7sleep30-21swapper/312:20:003
26018702142,8sleep30-21swapper/311:00:313
25583072144,6sleep30-21swapper/310:20:013
26343142132,7sleep30-21swapper/311:35:263
25802362133,7sleep30-21swapper/310:40:283
25140202132,7sleep30-21swapper/309:35:233
24993792132,7sleep30-21swapper/309:20:253
24877642132,7sleep30-21swapper/309:05:293
24640972132,6sleep30-21swapper/308:45:013
24491442131,7sleep30-21swapper/308:30:003
23982932132,7sleep30-21swapper/307:35:313
26965922123,5sleep30-21swapper/312:35:343
26965922123,5sleep30-21swapper/312:35:333
26628762122,6sleep30-21swapper/312:05:203
26579382122,6sleep30-21swapper/312:00:173
26485402122,6sleep30-21swapper/311:50:273
26428412122,5sleep30-21swapper/311:45:013
26282992122,6sleep30-21swapper/311:30:203
26254032122,6sleep30-21swapper/311:25:263
26185512122,6sleep30-21swapper/311:20:213
26120432122,6sleep30-21swapper/311:10:333
25830482122,5sleep30-21swapper/310:45:013
25731902122,5sleep30-21swapper/310:35:013
25484222122,6sleep30-21swapper/310:10:023
25386902122,6sleep30-21swapper/310:00:023
25331722122,6sleep30-21swapper/309:50:403
25085162122,6sleep30-21swapper/309:29:453
25085162122,6sleep30-21swapper/309:29:453
24939552122,6sleep30-21swapper/309:15:193
24738442122,5sleep30-21swapper/308:55:013
24602112122,6sleep30-21swapper/308:40:293
24589632122,6sleep30-21swapper/308:39:203
24281682123,5sleep30-21swapper/308:05:333
24141872122,5sleep30-21swapper/307:55:013
24043722122,6sleep30-21swapper/307:45:023
23873302122,6sleep30-21swapper/307:25:283
23794942122,5sleep30-21swapper/307:20:013
23785422122,6sleep30-21swapper/307:15:333
23725652122,6sleep30-21swapper/307:14:443
26878942110,7sleep30-21swapper/312:30:193
26829362112,6sleep30-21swapper/312:25:233
26779612112,6sleep30-21swapper/312:20:133
26676042112,5sleep30-21swapper/312:10:013
26397442112,5sleep30-21swapper/311:40:273
26137052112,5sleep30-21swapper/311:15:283
26031222112,6sleep30-21swapper/311:05:073
25932482110,7sleep30-21swapper/310:55:213
25918762112,5sleep30-21swapper/310:50:303
25688482112,6sleep30-21swapper/310:30:253
25681232112,6sleep30-21swapper/310:29:083
25589832112,5sleep30-21swapper/310:20:243
25437792111,6sleep30-21swapper/310:05:203
25342312112,5sleep30-21swapper/309:55:253
25275912112,5sleep30-21swapper/309:45:293
25187742112,6sleep30-21swapper/309:40:203
25088272112,5sleep30-21swapper/309:30:203
24889702112,5sleep30-21swapper/309:10:023
24790892112,5sleep30-21swapper/309:00:183
24694422112,6sleep30-21swapper/308:50:243
24504592112,5sleep30-21swapper/308:30:283
24390922110,5sleep30-21swapper/308:20:023
24343032112,6sleep30-21swapper/308:15:203
24295892112,6sleep30-21swapper/308:10:223
24207862110,7sleep30-21swapper/308:00:273
23996182112,5sleep30-21swapper/307:40:203
23896022112,5sleep30-21swapper/307:30:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional