You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 14:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Jun 17, 2026 12:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
39884072800,5sleep20-21swapper/211:10:322
3744452997362,8cyclictest3749364-21apt-get07:15:011
3744452997362,8cyclictest3749364-21apt-get07:15:001
3744449997044,23cyclictest4049997-21diskstats12:15:260
3744449996845,21cyclictest3975575-21/usr/sbin/munin11:00:320
40323062660,2chrt75-21kworker/3:1-events11:55:333
3744456996561,3cyclictest3965622-21kworker/u8:0+flush-8:011:05:442
3744449996556,7cyclictest1704890-21systemd-journal11:59:590
3744456996256,4cyclictest3860993-21kworker/u8:2+flush-8:009:40:442
3744456995851,5cyclictest3860993-21kworker/u8:2+flush-8:010:35:382
3744452995851,4cyclictest3915353-21latency_hist10:00:001
3744449995853,3cyclictest3830749-21kworker/u8:0+flush-8:009:15:270
3744449995849,6cyclictest3835126-21ntpq08:35:390
3744452995746,8cyclictest4073317-21ntpq12:35:331
3744449995735,20cyclictest3970899-21diskstats10:55:270
3744449995537,15cyclictest1704890-21systemd-journal12:25:280
3744452995438,11cyclictest1704890-21systemd-journal11:44:591
3744449995445,6cyclictest3865707-21latency_hist09:10:010
3744456995348,3cyclictest3965622-21kworker/u8:0+flush-8:010:50:362
3744452995340,9cyclictest1704890-21systemd-journal12:29:591
3744452995339,10cyclictest1704890-21systemd-journal08:54:281
3744449995342,8cyclictest3770459-21ntpq07:30:370
3744449995342,8cyclictest3770459-21ntpq07:30:370
3744449995334,16cyclictest3930179-21latency_hist10:15:000
3744449995325,15cyclictest3847099-21kthreadcore08:50:340
40694212520,2chrt481ktimers/312:35:013
39462862520,2sleep13744444-21cyclictest10:30:301
3744449995244,6cyclictest3895932-21sshd09:40:280
3744456995146,3cyclictest3860993-21kworker/u8:2+flush-8:011:40:422
3744452995141,6cyclictest1704890-21systemd-journal09:16:271
3744449995139,9cyclictest3805401-21ntpq08:05:360
3744449995136,14cyclictest3856570-21sshd09:00:270
3744449995132,17cyclictest3749364-21apt-get07:15:040
3744456995046,3cyclictest3830749-21kworker/u8:0+events_unbound09:15:432
3744456995045,4cyclictest4009582-21kworker/u8:1+flush-8:011:55:392
3744456995045,4cyclictest3686736-21kworker/u8:2+flush-8:007:20:412
3744449995045,4cyclictest3782010-21sshd07:45:280
3744449995043,5cyclictest3965622-21kworker/u8:0+flush-8:011:45:420
3744449995029,19cyclictest4055084-21sshd12:20:280
3744449995029,19cyclictest4055084-21sshd12:20:270
3744452994942,5cyclictest1704890-21systemd-journal08:45:011
3744452994939,7cyclictest3860993-21kworker/u8:2+events_unbound10:05:421
3744452994843,4cyclictest3790651-21ntpq07:50:391
3744449994837,9cyclictest3999107-21ntpq11:20:340
3744456994741,4cyclictest3761448-21kworker/u8:1+events_unbound08:50:452
3744452994741,4cyclictest3761448-21kworker/u8:1+flush-8:007:40:391
3744449994737,8cyclictest3840090-21ntpq08:40:360
3744456994635,8cyclictest4039612-21awk12:04:592
3744452994640,4cyclictest3761448-21kworker/u8:1+events_unbound07:30:311
3744452994640,4cyclictest3761448-21kworker/u8:1+events_unbound07:30:311
3744449994637,7cyclictest3920581-21/usr/sbin/munin10:05:340
3744456994540,4cyclictest3878441-21kworker/u8:3+events_unbound09:20:392
3744452994537,6cyclictest3855786-21latency_hist09:00:011
3744452994535,7cyclictest3965622-21kworker/u8:0+events_unbound11:30:371
3744452994534,8cyclictest3729890-21kworker/u8:0+flush-8:007:25:411
3744456994435,7cyclictest3890447-21turbostat.cron09:35:002
3744452994434,7cyclictest4009582-21kworker/u8:1+events_unbound12:30:421
3744452994432,8cyclictest1704890-21systemd-journal12:05:271
3744456994339,3cyclictest3729890-21kworker/u8:0+flush-8:007:25:382
3744456994336,5cyclictest3831171-21cat08:35:002
3744456994336,2cyclictest3825287-21kworker/u8:2+events_unbound08:35:312
3744452994334,6cyclictest3761448-21kworker/u8:1+events_unbound08:10:431
3744449994223,17cyclictest3990724-21fschecks_time11:15:280
3744456994137,3cyclictest3775534-21kworker/u8:0+events_unbound07:35:422
374444999413,2cyclictest0-21swapper/007:50:230
3744456994036,3cyclictest4035631-21kworker/u8:3+events_unbound12:20:002
3744452994032,6cyclictest3729890-21kworker/u8:0+flush-8:007:15:281
3744452993929,8cyclictest3876145-21diskstats09:20:251
3744452993929,7cyclictest3860993-21kworker/u8:2+flush-8:010:10:371
3744449993928,9cyclictest3989244-21ntpq11:10:370
3744452993831,5cyclictest3990373-21kworker/u8:3+events_unbound11:20:011
3744452993828,7cyclictest3761448-21kworker/u8:1+flush-8:010:40:401
3744449993830,6cyclictest3934457-21ntpq10:15:350
3744449993822,14cyclictest3801352-21cron08:05:010
3744449993820,16cyclictest3825663-21unixbench_multi08:25:430
37442262382,6sleep1885-21mta-sts-daemon07:09:061
3744456993726,8cyclictest3855800-21awk09:00:002
3744452993731,4cyclictest3761448-21kworker/u8:1+flush-8:008:46:091
3744452993730,5cyclictest4029258-21grep11:50:421
3744452993730,5cyclictest3800417-21ntpq08:00:351
3744449993730,5cyclictest1704890-21systemd-journal10:34:150
3744449993719,16cyclictest401-21dbus-daemon09:30:000
381041223630,4sleep03775534-21kworker/u8:0+flush-8:008:10:410
3744456993631,4cyclictest3775534-21kworker/u8:0+events_unbound07:40:422
3744456993629,5cyclictest3749626-21gpgv07:15:022
3744456993629,5cyclictest3749626-21gpgv07:15:012
3744452993627,7cyclictest3935642-21apt-get10:20:231
3744452993625,8cyclictest3761448-21kworker/u8:1+flush-8:009:30:361
3744452993623,9cyclictest1704890-21systemd-journal11:55:271
3744449993632,3cyclictest3761448-21kworker/u8:1+flush-8:007:39:270
3744449993631,4cyclictest3905802-21sshd09:50:270
3744449993631,4cyclictest3905802-21sshd09:50:270
3744449993615,19cyclictest0-21swapper/012:02:280
40135332350,5sleep3451irq_work/311:35:343
3744452993528,5cyclictest3761448-21kworker/u8:1+flush-8:007:35:401
3744452993527,6cyclictest3835985-21latency_hist08:40:011
3744449993525,8cyclictest3749364-21apt-get07:15:010
3744449993525,8cyclictest3749364-21apt-get07:15:000
3744449993520,13cyclictest3916311-21irqcore10:00:300
3744449993519,14cyclictest3830632-21unixbench_singl08:30:450
3744449993518,15cyclictest0-21swapper/010:50:000
3744449993514,18cyclictest0-21swapper/011:25:240
3744456993430,3cyclictest3860993-21kworker/u8:2+flush-8:010:05:432
3744452993428,4cyclictest4009582-21kworker/u8:1+flush-8:012:00:381
3744452993426,6cyclictest3860993-21kworker/u8:2+events_unbound11:35:371
3744449993414,18cyclictest3795456-21ntpq07:55:350
3744449993413,19cyclictest1704890-21systemd-journal10:25:010
3744456993329,3cyclictest3860993-21kworker/u8:2+events_unbound11:45:292
3744452993328,3cyclictest3881369-21irqcore09:25:301
3744452993328,3cyclictest3686736-21kworker/u8:2+flush-8:007:20:271
3744452993327,4cyclictest3990373-21kworker/u8:3+flush-8:011:20:321
3744452993323,8cyclictest3944319-21ntpq10:25:361
374444999338,22cyclictest0-21swapper/011:05:250
3744449993319,12cyclictest0-21swapper/010:50:430
3744449993318,13cyclictest0-21swapper/008:46:100
3744449993317,14cyclictest0-21swapper/010:35:410
3744449993315,16cyclictest4009947-21latency_hist11:35:010
3744449993315,16cyclictest0-21swapper/010:40:380
3744449993315,15cyclictest0-21swapper/010:25:230
3744456993227,3cyclictest3751847-21aten2_r5power_c07:15:262
3744452993225,5cyclictest3761448-21kworker/u8:1+events_unbound09:10:411
374444999321,8cyclictest3762161-21/usr/sbin/munin07:25:280
3744449993215,15cyclictest0-21swapper/012:05:350
3744449993213,17cyclictest3876426-21sort09:20:280
374444999321,2cyclictest37771642ps07:40:320
374444999321,10cyclictest3815249-21ntpq08:15:370
38223352310,7sleep3451irq_work/308:25:323
3744452993126,4cyclictest3775534-21kworker/u8:0+flush-8:008:05:411
3744452993124,5cyclictest3895683-21apt-get09:40:241
3744452993124,5cyclictest3865415-40mandb09:06:281
3744452993124,4cyclictest3761448-21kworker/u8:1+events_unbound09:00:241
3744449993126,4cyclictest3901344-21sshd09:45:280
3744449993126,4cyclictest3901344-21sshd09:45:270
374444999311,9cyclictest4073370-21ntpq12:35:340
374444999311,9cyclictest3889510-21ntpq09:30:330
374444999311,8cyclictest3869753-21ntpq09:10:360
3744449993115,14cyclictest3891020-21grep09:35:300
3744449993112,17cyclictest4047040-21kthreadcore12:10:320
374444999311,10cyclictest3910723-21/usr/sbin/munin09:55:230
374444999310,10cyclictest3851626-21/usr/sbin/munin08:55:300
3744452993024,4cyclictest3910202-21cron09:55:001
3744452993024,4cyclictest3910202-21cron09:55:001
3744452993024,3cyclictest0-21swapper/110:20:001
3744452993022,6cyclictest3860993-21kworker/u8:2+flush-8:009:35:391
3744452993022,6cyclictest3761448-21kworker/u8:1+flush-8:008:20:381
3744452993020,6cyclictest3761448-21kworker/u8:1+events_unbound08:30:361
374444999309,2cyclictest0-21swapper/007:20:410
374444999301,8cyclictest4010354-21/usr/sbin/munin11:35:250
3744449993013,15cyclictest0-21swapper/011:50:260
3744456992922,5cyclictest3860993-21kworker/u8:2+events_unbound11:36:022
3744456992919,8cyclictest3910587-21cat09:55:012
3744456992919,8cyclictest3910587-21cat09:55:002
3744452992922,5cyclictest4009582-21kworker/u8:1+flush-8:012:15:411
3744452992922,5cyclictest3990373-21kworker/u8:3+flush-8:011:25:381
374444999299,5cyclictest4066800-21cut12:30:320
3744449992910,2cyclictest0-21swapper/008:20:340
374444999290,9cyclictest4019026-21/usr/sbin/munin11:40:410
3744456992819,6cyclictest3766618-21kworker/u8:3+events_unbound08:20:112
3744452992820,6cyclictest3811521-21apt-get08:15:241
3744452992819,6cyclictest4053524-21kworker/u8:0+flush-8:012:20:311
3744452992819,6cyclictest4053524-21kworker/u8:0+flush-8:012:20:311
3744456992723,2cyclictest4064678-21aten2_r5power_e12:30:242
3744456992723,2cyclictest3821492-21aten2_r5power_e08:25:262
3744456992716,8cyclictest3860924-21cat09:05:012
3744452992724,2cyclictest3920354-21systemd-run10:04:591
3744452992722,3cyclictest3980288-21systemd-run11:05:011
3744452992722,3cyclictest3783809-21kthreadcore07:45:321
3744456992621,3cyclictest3796003-21unixbench_singl07:55:422
3744456992621,3cyclictest3761448-21kworker/u8:1+events_unbound08:00:082
3744456992616,8cyclictest4059389-21turbostat.cron12:25:002
3744456992616,8cyclictest4059389-21turbostat.cron12:25:002
374445699260,8cyclictest3813311-21cut08:15:332
3744452992620,4cyclictest3955273-21unin-run10:40:011
3744452992619,5cyclictest4049042-21grep12:10:421
3744456992522,2cyclictest3990521-21aten2_r5power_v11:15:262
3744456992521,3cyclictest3830749-21kworker/u8:0+events_unbound09:06:342
3744456992521,2cyclictest4005343-21aten2_r5power_v11:30:242
3744456992517,6cyclictest3895400-21awk09:39:592
3744452992519,4cyclictest3795969-21unixbench_multi07:55:421
3744452992518,5cyclictest3860993-21kworker/u8:2+events_unbound09:45:331
3744452992518,5cyclictest3860993-21kworker/u8:2+events_unbound09:45:321
3744456992421,2cyclictest3910776-21aten2_r5power_e09:55:252
374445699240,8cyclictest40268061kthreadcore11:50:312
3744452992420,2cyclictest0-21swapper/108:25:301
3744452992418,4cyclictest1704890-21systemd-journal11:10:001
37442302243,4sleep00-21swapper/007:09:090
374445699234,3cyclictest38058102wc08:05:432
3744456992320,2cyclictest3900929-21fschecks_count09:45:252
3744456992320,2cyclictest3900929-21fschecks_count09:45:252
3744456992318,3cyclictest3934920-21unixbench_multi10:15:402
3744456992317,4cyclictest4000584-21fschecks_count11:25:262
3744456992317,4cyclictest3940302-21turbostat.cron10:25:002
3744452992318,2cyclictest0-21swapper/110:46:341
3744452992317,4cyclictest3860993-21kworker/u8:2+events_unbound10:55:341
3744452992315,6cyclictest3965622-21kworker/u8:0+flush-8:011:45:411
3744456992219,2cyclictest3940691-21aten2_r5power_v10:25:252
3744456992218,2cyclictest4074238-21cron12:40:012
374445699220,6cyclictest38846222awk09:25:372
3744452992213,7cyclictest3761448-21kworker/u8:1+flush-8:011:10:371
3744456992115,4cyclictest0-21swapper/210:15:022
3744456992111,7cyclictest3957014-21tr10:40:332
3744456992111,2cyclictest0-21swapper/210:45:342
3744456992016,3cyclictest3686736-21kworker/u8:2+events_unbound07:30:072
3744456992016,3cyclictest3686736-21kworker/u8:2+events_unbound07:30:062
3744452992012,5cyclictest0-21swapper/110:50:401
38109292192,5sleep30-21swapper/308:11:093
3744456991916,2cyclictest3945838-21fschecks_time10:30:282
3744456991910,7cyclictest3838804-21tr08:40:322
37396942194,9sleep20-21swapper/207:05:262
374445699182,11cyclictest4044815-21apt-get12:10:252
3744456991813,3cyclictest3845542-21unixbench_singl08:46:102
3744456991813,3cyclictest0-21swapper/211:05:012
3744456991812,4cyclictest3775534-21kworker/u8:0+events_unbound07:45:022
3744456991812,4cyclictest0-21swapper/210:00:322
37442132184,8sleep30-21swapper/307:08:553
374445699173,10cyclictest3869788-21ntpq09:10:372
3744456991713,3cyclictest3965622-21kworker/u8:0+flush-8:011:20:492
3744456991713,2cyclictest0-21swapper/207:50:362
3744456991712,3cyclictest0-21swapper/210:55:312
3744456991613,2cyclictest0-21swapper/212:26:012
3744456991613,2cyclictest0-21swapper/208:10:402
3744456991612,2cyclictest0-21swapper/212:05:372
38659872153,8sleep30-21swapper/309:10:243
40494582142,8sleep30-21swapper/312:15:003
40200752142,8sleep30-21swapper/311:45:213
39802502142,7sleep30-21swapper/311:05:013
38056382142,8sleep30-21swapper/308:05:433
37556032142,8sleep30-21swapper/307:15:383
40571282132,7sleep30-21swapper/312:20:343
40571282132,7sleep30-21swapper/312:20:333
39551852132,7sleep30-21swapper/310:40:013
38706922132,5sleep30-21swapper/309:15:013
38585852132,7sleep30-21swapper/309:00:333
38129362133,6sleep30-21swapper/308:15:333
37606402133,6sleep30-21swapper/307:20:403
40695692124,5sleep30-21swapper/312:35:233
40601692122,6sleep30-21swapper/312:25:313
40497522122,6sleep30-21swapper/312:15:243
40158692122,6sleep30-21swapper/311:40:333
40040272122,6sleep30-21swapper/311:25:363
39952352122,5sleep30-21swapper/311:20:023
39945332122,6sleep30-21swapper/311:15:453
39847542122,6sleep30-21swapper/311:05:463
39707202122,6sleep30-21swapper/310:55:253
39700192122,6sleep30-21swapper/310:50:453
39452642122,6sleep30-21swapper/310:30:023
39449592122,6sleep30-21swapper/310:26:293
39355312122,5sleep30-21swapper/310:20:023
39306542122,6sleep30-21swapper/310:15:213
39260132122,6sleep30-21swapper/310:10:323
39210812122,6sleep30-21swapper/310:05:293
39193862122,6sleep30-21swapper/310:00:363
39092822122,6sleep30-21swapper/309:50:373
39092822122,6sleep30-21swapper/309:50:363
38995642122,6sleep30-21swapper/309:40:413
38945012122,6sleep30-21swapper/309:35:403
38866772123,6sleep30-21swapper/309:30:313
38610462122,6sleep30-21swapper/309:05:253
38557722122,6sleep30-21swapper/309:00:013
38458822122,5sleep30-21swapper/308:50:003
38451192122,6sleep30-21swapper/308:46:083
38360742122,5sleep30-21swapper/308:40:023
38315532123,6sleep30-21swapper/308:35:283
37959932122,6sleep30-21swapper/307:55:443
37905872122,6sleep30-21swapper/307:50:383
37855072122,6sleep30-21swapper/307:45:393
37712342122,6sleep30-21swapper/307:33:283
37712342122,6sleep30-21swapper/307:33:273
40443912112,5sleep30-21swapper/312:08:183
40351412112,5sleep30-21swapper/312:00:263
40293412112,5sleep30-21swapper/311:50:443
40049712112,5sleep30-21swapper/311:30:003
39860572112,5sleep30-21swapper/311:10:303
39606382112,5sleep30-21swapper/310:45:033
39603822112,5sleep30-21swapper/310:44:463
39106912112,5sleep30-21swapper/309:55:233
39010612112,5sleep30-21swapper/309:45:273
39010612112,5sleep30-21swapper/309:45:273
38811462112,5sleep30-21swapper/309:25:283
38762732112,5sleep30-21swapper/309:20:263
38263512112,5sleep30-21swapper/308:30:273
38164502112,5sleep30-21swapper/308:20:243
38011492112,5sleep30-21swapper/308:02:373
37766382112,5sleep30-21swapper/307:40:273
37713772112,5sleep30-21swapper/307:35:013
37615212112,5sleep30-21swapper/307:25:023
37489262112,5sleep30-21swapper/307:10:533
37489262112,5sleep30-21swapper/307:10:533
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional