You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 12:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Wed Jun 10, 2026 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
320387122200,2sleep3451irq_work/319:40:023
335340521500,2sleep375-21kworker/3:1+events22:10:383
34521892570,4chrt0-21swapper/123:50:321
34288022530,5chrt13-21ksoftirqd/023:25:390
3172051995235,14cyclictest3297041-21ntpq21:10:441
3172051995141,7cyclictest3471541-21latency_hist00:10:001
3172051994840,6cyclictest3347084-21apt-get22:02:471
3172051994737,8cyclictest3366623-21ntpq22:20:421
3172056994636,7cyclictest1704890-21systemd-journal23:17:482
3172051994637,7cyclictest3182923-21ntpq19:15:411
3172051994637,7cyclictest3182923-21ntpq19:15:401
3172047994540,3cyclictest3139223-21kworker/u8:2+flush-8:019:20:340
317205699441,25cyclictest3398419-21/usr/sbin/munin22:55:362
3172051994323,17cyclictest1704890-21systemd-journal20:33:481
3172047994335,6cyclictest3347555-21/usr/sbin/munin22:05:450
3172051994232,7cyclictest3382362-21apt-get22:40:001
3172051994132,7cyclictest3417407-21/usr/sbin/munin23:15:401
3172051994131,8cyclictest3282162-21ntpq20:55:431
3172047994136,3cyclictest3183862-21kworker/u8:0+flush-8:019:40:490
3172047994135,4cyclictest3435960-21ntpq23:30:410
3172047994123,14cyclictest1704890-21systemd-journal22:00:480
3172051994031,7cyclictest3476757-21/usr/sbin/munin00:15:411
3172051994030,7cyclictest1704890-21systemd-journal22:41:471
3172051994027,9cyclictest1704890-21systemd-journal19:24:461
3172051994025,12cyclictest1704890-21systemd-journal21:45:481
3172047994031,6cyclictest3203632-21latency_hist19:40:020
3172047994029,8cyclictest3139223-21kworker/u8:2+flush-8:020:30:470
3172056993917,19cyclictest1704890-21systemd-journal20:00:462
3172051993933,4cyclictest3297915-21kworker/u8:1+events_unbound00:30:441
3172051993926,11cyclictest3243297-21sh20:20:001
3172051993923,14cyclictest3208843-21/usr/sbin/munin19:45:411
3172047993932,5cyclictest3342301-21latency_hist22:00:000
3172047993931,6cyclictest3247384-21ntpq20:20:400
3172047993930,7cyclictest3391579-21ntpq22:45:420
3172047993930,6cyclictest3183862-21kworker/u8:0+flush-8:020:05:480
3172056993820,16cyclictest0-21swapper/219:15:462
3172056993820,16cyclictest0-21swapper/219:15:462
317205199389,21cyclictest0-21swapper/119:59:481
3172051993831,5cyclictest3129120-21kworker/u8:3+flush-8:022:55:361
3172047993830,7cyclictest3129120-21kworker/u8:3+flush-8:019:50:340
3172047993829,7cyclictest3197762-21ntpq19:30:400
3172056993726,9cyclictest1704890-21systemd-journal20:10:452
3172056993711,21cyclictest3184129-21apt-get19:20:292
3172051993729,6cyclictest3446802-21latency_hist23:45:011
3172051993729,6cyclictest3397414-21latency_hist22:55:011
3172051993729,6cyclictest3397414-21latency_hist22:55:001
3172051993717,17cyclictest1704890-21systemd-journal22:34:591
3172047993728,7cyclictest3252321-21ntpq20:25:430
3172047993728,6cyclictest3427013-21latency_hist23:25:010
3172051993625,9cyclictest3447314-21cpuspeed_turbos23:45:331
3172051993624,10cyclictest3417173-21systemd-run23:15:011
3172047993627,7cyclictest3287099-21ntpq21:00:430
3172056993526,7cyclictest3466615-21turbostat.cron00:05:002
3172056993522,11cyclictest3491919-21fschecks_count00:30:342
3172056993521,12cyclictest3332034-21unixbench_multi21:45:492
3172056993519,14cyclictest3213493-21cron19:50:012
3172051993527,5cyclictest3233461-21latency_hist20:10:001
3172051993525,7cyclictest1704890-21systemd-journal21:56:471
3172051993518,15cyclictest1704890-21systemd-journal23:25:011
3172051993516,17cyclictest3486673-21acpi00:25:281
3172047993527,6cyclictest3460692-21ntpq23:55:420
3172047993525,7cyclictest3417149-21latency_hist23:15:010
3172056993428,4cyclictest3273465-21apt-get20:50:292
3172056993428,4cyclictest3273465-21apt-get20:50:292
3172056993414,18cyclictest1704890-21systemd-journal23:10:012
317205699341,26cyclictest3228809-21apt-get20:05:292
3172051993427,5cyclictest3308094-21apt-get21:25:281
3172047993428,4cyclictest3129120-21kworker/u8:3+flush-8:020:50:310
3172047993428,4cyclictest3129120-21kworker/u8:3+flush-8:020:50:300
3172047993427,5cyclictest3283059-21latency_hist21:00:010
3172047993427,5cyclictest1704890-21systemd-journal20:41:470
3172047993424,8cyclictest3222665-21ntpq19:55:420
31716702344,9sleep10-21swapper/119:09:351
31716702344,9sleep10-21swapper/119:09:351
317205699331,26cyclictest3288288-21apt-get21:05:312
317205699331,25cyclictest3308094-21apt-get21:25:292
3172056993311,18cyclictest3423613-21tr23:20:382
317205199339,19cyclictest589-21runrttasks23:05:301
317205199334,6cyclictest0-21swapper/100:10:341
317205199334,5cyclictest0-21swapper/119:10:301
317205199334,5cyclictest0-21swapper/119:10:291
3172051993329,3cyclictest3441841-21cron23:40:001
3172051993329,2cyclictest3358659-21irqrtprio22:15:351
3172051993326,5cyclictest3306943-21ntpq21:20:471
3172051993324,7cyclictest3268509-21/usr/sbin/munin20:45:411
3172051993321,11cyclictest0-21swapper/100:20:341
3172051993321,11cyclictest0-21swapper/100:20:331
3172051993321,10cyclictest3464099-21kthreadcore00:00:401
3172047993325,6cyclictest3412215-21latency_hist23:10:010
317205699322,23cyclictest3194021-21apt-get19:30:292
3172056993216,14cyclictest3243636-21aten2_r5power_c20:20:292
317205699320,17cyclictest3189808-21/usr/sbin/munin19:25:382
317205199327,8cyclictest3313004-21apt-get21:30:311
317205199326,5cyclictest3431046-21sed23:25:431
317205199324,5cyclictest0-21swapper/122:10:301
317205199324,4cyclictest0-21swapper/119:25:311
3172051993227,3cyclictest3402855-21cpuspeed_turbos23:00:321
317205199322,11cyclictest3247434-21ntpq20:20:421
3172051993219,11cyclictest0-21swapper/100:35:401
3172047993227,3cyclictest3382368-21latency_hist22:40:010
317205699312,23cyclictest3437169-21apt-get23:35:282
3172056993121,7cyclictest3223195-21unixbench_singl19:55:492
3172056993116,13cyclictest3368031-21cpuspeed_turbos22:25:332
317205699311,24cyclictest3402632-21apt-get23:00:312
3172056993112,16cyclictest3349615-21tr22:05:382
317205199319,6cyclictest3300784-21cut21:15:391
317205199314,5cyclictest0-21swapper/121:00:301
317205199313,5cyclictest0-21swapper/119:35:301
3172051993116,13cyclictest0-21swapper/120:50:371
3172051993116,13cyclictest0-21swapper/120:50:361
3172051993115,14cyclictest0-21swapper/121:35:371
317205199311,10cyclictest3207761-21ntpq19:40:471
3172047993127,3cyclictest3297915-21kworker/u8:1+flush-8:021:42:240
3172047993124,5cyclictest3139223-21kworker/u8:2+flush-8:020:35:470
3172056993025,3cyclictest3298266-21aten2_r5power_p21:15:312
3172056993024,4cyclictest3268255-21sh20:45:002
3172056993015,13cyclictest0-21swapper/220:30:002
3172056993015,13cyclictest0-21swapper/200:20:332
3172056993015,13cyclictest0-21swapper/200:20:322
3172056993015,12cyclictest0-21swapper/222:30:482
3172056993015,12cyclictest0-21swapper/222:15:012
317205699301,25cyclictest3452220-21/usr/sbin/munin23:50:312
3172056993011,16cyclictest3488773-21tr00:25:382
3172056993011,16cyclictest3367282-21sshd22:22:032
317205699300,15cyclictest32149022cut19:50:372
317205199307,3cyclictest0-21swapper/120:04:011
317205199307,10cyclictest0-21swapper/123:58:401
3172051993017,11cyclictest3292931-21latency_hist21:10:021
3172051993016,12cyclictest0-21swapper/123:30:321
3172051993014,14cyclictest3262182-21latency20:35:411
3172051993014,14cyclictest0-21swapper/119:30:361
3172051993011,3cyclictest0-21swapper/120:10:391
3172051993011,2cyclictest0-21swapper/122:45:381
3172047993026,2cyclictest3173019-21irqrtprio19:10:370
3172047993026,2cyclictest3173019-21irqrtprio19:10:370
3172047993025,3cyclictest3193762-21systemd-run19:30:010
3172047993022,6cyclictest3357914-21/usr/sbin/munin22:15:410
3172047993022,6cyclictest3242432-21ntpq20:15:440
3172047993021,7cyclictest3376527-21ntpq22:30:430
317205699298,18cyclictest3318767-21sed21:35:372
3172056992924,3cyclictest3432345-21aten2_r5power_v23:30:312
3172056992923,4cyclictest3303514-21fschecks_time21:20:372
317205699292,24cyclictest3346443-21ntpq22:00:462
317205699292,22cyclictest3257496-21ntpq20:30:432
317205699291,23cyclictest3383339-21/usr/sbin/munin22:40:352
3172056992911,16cyclictest3326228-21tr21:40:392
3172056992911,15cyclictest3313377-21fw_packets21:30:342
3172056992910,16cyclictest0-21swapper/200:15:382
3172056992910,15cyclictest3392777-21cut22:50:312
3172056992910,15cyclictest3392777-21cut22:50:302
317205199293,5cyclictest0-21swapper/120:25:281
3172051992916,11cyclictest0-21swapper/121:40:471
3172051992915,12cyclictest0-21swapper/121:50:351
3172051992915,12cyclictest0-21swapper/119:50:391
317205199291,11cyclictest3351333-21ntpq22:05:431
3172047992922,5cyclictest3292570-21grep21:05:490
317205699288,18cyclictest3446236-21grep23:40:492
317205699288,17cyclictest3427517-21tr23:25:332
317205699287,17cyclictest3338615-21cut21:55:362
3172056992821,6cyclictest3262909-21unixbench_singl20:35:502
3172056992813,13cyclictest3358156-21cpuspeed_turbos22:15:312
317205699281,24cyclictest3172780-21cat19:10:362
317205699281,24cyclictest3172780-21cat19:10:352
317205699281,23cyclictest3466872-21/usr/sbin/munin00:05:282
3172056992812,14cyclictest3447166-21aten2_r5power_p23:45:322
3172056992810,16cyclictest3283047-21cron20:59:592
3172056992810,16cyclictest3203645-21systemctl19:40:002
317205699280,24cyclictest3471829-21/usr/sbin/munin00:10:332
3172051992824,2cyclictest3369967-21kthreadcore22:25:401
3172051992814,12cyclictest0-21swapper/120:44:471
3172047992823,3cyclictest3297886-21cron21:15:010
3172047992820,7cyclictest3500599-21sshd00:35:500
317205699275,18cyclictest3412560-21cut23:10:322
317205699272,21cyclictest3391646-21ntpq22:45:452
3172056992715,10cyclictest0-21swapper/200:35:472
317205699271,23cyclictest3333231-21/usr/sbin/munin21:50:362
3172056992710,15cyclictest0-21swapper/223:55:372
3172056992710,14cyclictest3238903-21cpuspeed_turbos20:15:322
3172047992722,4cyclictest3139223-21kworker/u8:2+flush-8:019:15:320
3172047992722,4cyclictest3139223-21kworker/u8:2+flush-8:019:15:310
3172047992722,4cyclictest3129120-21kworker/u8:3+events_unbound22:27:530
3172047992721,5cyclictest3297915-21kworker/u8:1+events_unbound22:50:390
3172047992721,5cyclictest3297915-21kworker/u8:1+events_unbound22:50:390
3172047992717,8cyclictest3308343-21diskstats21:25:330
317205699261,22cyclictest3293412-21cat21:10:322
3172056992612,13cyclictest0-21swapper/221:00:502
3172056992610,14cyclictest0-21swapper/220:45:352
317205699260,23cyclictest3377711-21/usr/sbin/munin22:35:302
3172047992619,5cyclictest3383484-21ps22:40:360
3172047992612,3cyclictest0-21swapper/019:45:310
3172056992510,14cyclictest0-21swapper/219:40:382
3172047992514,2cyclictest0-21swapper/023:50:470
3172047992513,3cyclictest0-21swapper/000:30:460
3172047992420,3cyclictest3297915-21kworker/u8:1+flush-8:023:01:010
3172047992419,4cyclictest3183862-21kworker/u8:0+flush-8:022:14:520
3172047992419,4cyclictest3183862-21kworker/u8:0+flush-8:021:30:390
3172047992418,4cyclictest3306987-21ntpq21:20:470
3172047992416,6cyclictest3491348-21latency_hist00:30:010
3172047992411,2cyclictest0-21swapper/020:10:440
31715972243,14sleep00-21swapper/019:08:370
31715972243,14sleep00-21swapper/019:08:370
317205699239,11cyclictest0-21swapper/219:10:012
317205699239,11cyclictest0-21swapper/219:10:012
3172047992319,3cyclictest3462448-21sort00:00:370
3172047992317,4cyclictest3432178-21kworker/u8:0+flush-8:000:20:560
3172047992317,4cyclictest3432178-21kworker/u8:0+flush-8:000:20:550
3172047992316,5cyclictest3367522-21latency_hist22:25:010
3172047992217,4cyclictest3432178-21kworker/u8:0+flush-8:000:10:360
3172047992217,4cyclictest3129120-21kworker/u8:3+flush-8:020:00:310
3172047992215,5cyclictest3372141-21kworker/u8:2+flush-8:023:15:330
317204799221,10cyclictest3470716-21ntpq00:05:470
3172047992117,3cyclictest3297915-21kworker/u8:1+flush-8:022:55:300
3172047992114,4cyclictest3297915-21kworker/u8:1+events_unbound21:45:440
3172047992113,5cyclictest3301862-21grep21:15:410
317204799208,8cyclictest401-21dbus-daemon23:40:000
3172047992016,3cyclictest3318530-21sort21:35:360
3172047992016,3cyclictest0-21swapper/023:49:500
3172047992015,3cyclictest3480857-21wc00:15:480
3172047992015,2cyclictest0-21swapper/020:45:410
3172047991914,3cyclictest3442488-21tune2fs23:40:340
32148992180,3sleep375-21kworker/3:1+events19:50:373
3172047991810,6cyclictest3333219-21cat21:50:360
31671092183,8sleep30-21swapper/319:05:313
31671092183,8sleep30-21swapper/319:05:303
34371722162,9sleep30-21swapper/323:35:303
34856252144,6sleep30-21swapper/300:20:533
34856252144,6sleep30-21swapper/300:20:523
34026062142,7sleep30-21swapper/323:00:313
34723362132,7sleep30-21swapper/300:10:403
34709102132,7sleep30-21swapper/300:05:523
34309872132,7sleep30-21swapper/323:25:433
33823482132,7sleep30-21swapper/322:39:593
33626162132,6sleep30-21swapper/322:20:013
33584112132,7sleep30-21swapper/322:15:363
33374312132,6sleep30-21swapper/321:55:023
33286892135,5sleep30-21swapper/321:45:383
32880112132,6sleep30-21swapper/321:05:023
32734392131,8sleep30-21swapper/320:50:293
32734392131,8sleep30-21swapper/320:50:293
32583472132,7sleep30-21swapper/320:34:593
32246012133,6sleep30-21swapper/320:00:373
31727782132,7sleep30-21swapper/319:10:373
31727782132,7sleep30-21swapper/319:10:363
34920012122,6sleep30-21swapper/300:30:363
34881812122,6sleep30-21swapper/300:25:383
34786602122,6sleep30-21swapper/300:15:393
34609432122,6sleep30-21swapper/323:55:483
34327102120,8sleep30-21swapper/323:30:363
34211932122,6sleep30-21swapper/323:15:443
34122292122,6sleep30-21swapper/323:10:023
34121852122,6sleep30-21swapper/323:09:493
33986162122,6sleep30-21swapper/322:55:373
33931372122,6sleep30-21swapper/322:50:363
33931372122,6sleep30-21swapper/322:50:353
33880792122,6sleep30-21swapper/322:45:343
33869032122,6sleep30-21swapper/322:40:483
33732652122,6sleep30-21swapper/322:30:373
33724442122,5sleep30-21swapper/322:30:013
33468612122,6sleep30-21swapper/322:00:523
33327522122,6sleep30-21swapper/321:50:323
33183192122,6sleep30-21swapper/321:35:363
33127472122,6sleep30-21swapper/321:30:013
33085882122,6sleep30-21swapper/321:25:363
32857282122,6sleep30-21swapper/321:00:403
32634362122,5sleep30-21swapper/320:40:023
32590292122,6sleep30-21swapper/320:35:363
32480742122,6sleep30-21swapper/320:22:483
32386492122,6sleep30-21swapper/320:15:293
32343232122,6sleep30-21swapper/320:10:363
32288122122,6sleep30-21swapper/320:05:313
32128422122,6sleep30-21swapper/319:45:483
32041282121,7sleep30-21swapper/319:40:343
31945262122,6sleep30-21swapper/319:30:363
31926522122,6sleep30-21swapper/319:25:423
31846232122,6sleep30-21swapper/319:20:353
35003432112,5sleep30-21swapper/300:35:453
34618592112,6sleep30-21swapper/300:00:063
34519542112,5sleep30-21swapper/323:50:033
34506062112,5sleep30-21swapper/323:45:413
34443662112,5sleep30-21swapper/323:40:403
34223932112,5sleep30-21swapper/323:20:323
33515822112,5sleep30-21swapper/322:05:483
33228662112,5sleep30-21swapper/321:40:293
33053482112,5sleep30-21swapper/321:20:433
32935272112,5sleep30-21swapper/321:10:363
32821212112,5sleep30-21swapper/320:55:423
32685382112,6sleep30-21swapper/320:45:313
32521352112,5sleep30-21swapper/320:25:413
32193802112,5sleep30-21swapper/319:55:353
31791172112,5sleep30-21swapper/319:15:073
31791172112,5sleep30-21swapper/319:15:073
32984192102,5sleep30-21swapper/321:15:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional