You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 21:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Jun 19, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
347635521040,3chrt451irq_work/309:50:403
334034221020,3chrt75-21kworker/3:1-events07:35:313
3311399997463,8cyclictest3416666-21ntpq08:50:330
3311402997157,9cyclictest1704890-21systemd-journal12:20:391
3311399997057,11cyclictest3272026-21kworker/u8:3+flush-8:008:00:370
3311402996448,13cyclictest3417854-21/usr/sbin/munin08:55:331
3311399996451,10cyclictest3491064-21ntpq10:05:350
3311402996251,9cyclictest3322201-21ntpq07:15:391
3311402996251,8cyclictest3505947-21ntpq10:20:361
3311402996247,10cyclictest1704890-21systemd-journal08:45:301
3311406996155,4cyclictest3375051-21kworker/u8:3+flush-8:008:55:372
3311399996152,6cyclictest3338408-21kworker/u8:0+flush-8:007:35:270
3311399996150,8cyclictest3625266-21ntpq12:20:360
3311402995949,8cyclictest1704890-21systemd-journal12:00:011
3311399995949,8cyclictest3332323-21ntpq07:25:360
3311399995949,7cyclictest3462090-21apt-get09:40:000
3311399995847,8cyclictest1704890-21systemd-journal09:25:300
3311399995844,5cyclictest3282938-21kworker/u8:2+flush-8:007:20:370
3311399995751,5cyclictest3419838-21kworker/u8:1+events_unbound09:40:380
3311399995746,8cyclictest3580830-21ntpq11:35:350
3311406995651,3cyclictest3282938-21kworker/u8:2+flush-8:007:45:412
3311402995648,5cyclictest3590622-21ntpq11:45:321
3311402995647,6cyclictest3605468-21ntpq12:00:351
3311402995642,11cyclictest3571720-21/usr/sbin/munin11:30:331
3311402995633,12cyclictest3387049-21ntpq08:20:331
3311399995652,2cyclictest3282938-21kworker/u8:2+flush-8:008:35:450
3311406995449,4cyclictest3367338-21kworker/u8:1+flush-8:008:05:342
3311406995448,4cyclictest3545841-21kworker/u8:1+events_unbound11:05:382
3311399995448,4cyclictest3282938-21kworker/u8:2+flush-8:007:40:320
3311399995444,7cyclictest1704890-21systemd-journal08:30:010
3311399995443,9cyclictest3500980-21ntpq10:15:350
3311399995443,7cyclictest3282938-21kworker/u8:2+flush-8:008:10:360
3311402995342,9cyclictest3555683-21ntpq11:10:331
3311399995347,4cyclictest3556840-21kworker/u8:0+events_unbound11:40:410
3311399995347,4cyclictest3556840-21kworker/u8:0+events_unbound11:40:410
3311399995345,5cyclictest3375051-21kworker/u8:3+events_unbound09:30:400
3311406995243,7cyclictest3541749-21awk11:00:002
3311399995241,8cyclictest3481141-21ntpq09:55:350
3311406995146,4cyclictest3375051-21kworker/u8:3+flush-8:008:50:402
3311406995145,4cyclictest3476782-21kworker/u8:0+flush-8:010:50:402
3311402995141,7cyclictest3640310-21ntpq12:35:331
3311406995045,3cyclictest3493894-21kworker/u8:3+flush-8:010:10:362
3311406995045,3cyclictest3419838-21kworker/u8:1+flush-8:009:50:412
3311406995042,6cyclictest3561664-21cat11:20:012
3311399995044,4cyclictest3282938-21kworker/u8:2+flush-8:009:20:300
3311399995043,5cyclictest3296187-21kworker/u8:0+flush-8:007:10:400
3311399995042,6cyclictest3325750-21kworker/u8:1+flush-8:007:30:330
3311399995039,9cyclictest3615462-21ntpq12:10:400
3311406994944,3cyclictest3563517-21kworker/u8:3+flush-8:011:25:262
3311406994844,3cyclictest3606612-21kworker/u8:1+flush-8:012:35:372
3311406994842,4cyclictest3493894-21kworker/u8:3+flush-8:010:45:362
3311399994741,4cyclictest3569201-21kworker/u8:4+flush-8:011:30:390
3311406994641,4cyclictest3556840-21kworker/u8:0+flush-8:012:25:352
3311406994641,4cyclictest3282938-21kworker/u8:2+events_unbound07:15:052
3311406994641,3cyclictest3556840-21kworker/u8:0+flush-8:012:30:352
3311402994635,9cyclictest1704890-21systemd-journal09:50:401
3311406994537,6cyclictest3383037-21awk08:20:002
3311402994536,7cyclictest3437403-21latency_hist09:15:011
3311402994536,7cyclictest3437403-21latency_hist09:15:001
3311399994538,5cyclictest3375051-21kworker/u8:3+events_unbound10:00:340
3311399994536,7cyclictest3375051-21kworker/u8:3+events_unbound09:15:380
3311406994433,9cyclictest3565615-21ntpq11:20:352
3311402994435,6cyclictest3373126-21apt-get08:10:211
3311402994433,7cyclictest1704890-21systemd-journal12:31:401
3311399994337,4cyclictest3556840-21kworker/u8:0+flush-8:011:20:410
3311399994337,4cyclictest3521473-21kworker/u8:2+events_unbound10:40:010
3311399994337,4cyclictest3493894-21kworker/u8:3+events_unbound10:40:280
3311402994234,6cyclictest3537051-21/usr/sbin/munin10:55:331
3311402994227,12cyclictest3328538-21apt-get07:25:221
3311402994214,14cyclictest0-21swapper/112:05:391
3311399994237,4cyclictest3545841-21kworker/u8:1+flush-8:011:05:410
3311399994236,4cyclictest3272026-21kworker/u8:3+flush-8:007:45:250
36019642410,2sleep20-21swapper/212:00:252
3311406994136,3cyclictest3493894-21kworker/u8:3+flush-8:011:10:252
3311406994132,6cyclictest3507204-21cat10:25:012
3311402994133,5cyclictest3383039-21latency_hist08:20:011
3311402994020,16cyclictest1704890-21systemd-journal11:26:411
3311399994034,4cyclictest3606612-21kworker/u8:1+events_unbound12:35:320
3311399994033,4cyclictest3282938-21kworker/u8:2+flush-8:009:05:400
3311399994031,6cyclictest3591554-21latency_hist11:50:000
3311406993934,3cyclictest3476782-21kworker/u8:0+events_unbound11:00:272
3311402993931,6cyclictest3419838-21kworker/u8:1+flush-8:009:00:391
3311402993930,6cyclictest3527185-21/usr/sbin/munin10:45:361
34912612380,2sleep20-21swapper/210:05:402
34380302380,1sleep13438026-21fschecks_time09:15:261
3311406993833,4cyclictest3375051-21kworker/u8:3+flush-8:008:50:012
3311399993833,4cyclictest3375051-21kworker/u8:3+flush-8:008:30:390
3311399993833,3cyclictest3476782-21kworker/u8:0+events_unbound10:45:240
3311399993831,5cyclictest3375051-21kworker/u8:3+events_unbound09:49:450
3311402993714,14cyclictest421rcuog/209:37:241
3311399993730,5cyclictest3569201-21kworker/u8:4+events_unbound12:00:240
3311399993729,6cyclictest3476782-21kworker/u8:0+events_unbound10:50:230
3311399993729,6cyclictest3403330-21diskstats08:40:270
3311399993722,9cyclictest3563517-21kworker/u8:3+flush-8:011:55:230
331140299363,25cyclictest0-21swapper/108:40:231
3311402993626,8cyclictest3521086-21ntpq10:35:361
3311399993631,4cyclictest3493894-21kworker/u8:3+flush-8:011:10:330
3311399993631,3cyclictest3477148-21systemd-run09:55:000
3311399993629,5cyclictest3556840-21kworker/u8:0+flush-8:011:25:380
3311399993626,8cyclictest3626663-21/usr/sbin/munin12:25:330
34060522350,5sleep3451irq_work/308:40:323
331140299353,25cyclictest0-21swapper/109:20:221
3311402993529,3cyclictest3324335-21irqrtprio07:20:291
3311402993526,7cyclictest3556840-21kworker/u8:0+events_unbound12:15:401
3311402993525,7cyclictest1704890-21systemd-journal08:50:011
3311402993515,16cyclictest3586601-21latency_hist11:45:011
3311402993515,16cyclictest3586601-21latency_hist11:45:011
3311399993529,4cyclictest3556840-21kworker/u8:0+flush-8:011:15:400
3311406993427,5cyclictest3576826-21cat11:35:012
3311402993428,4cyclictest3611609-21apt-get12:10:231
3311402993425,7cyclictest3492249-21/usr/sbin/munin10:10:331
3311399993427,5cyclictest3282938-21kworker/u8:2+flush-8:007:15:310
33065892343,9sleep10-21swapper/107:05:161
3311406993328,3cyclictest3556840-21kworker/u8:0+events_unbound11:45:382
331140299333,25cyclictest0-21swapper/108:00:211
3311402993324,6cyclictest3392912-21latency_hist08:30:011
3311402993323,8cyclictest0-21swapper/107:40:011
331140299332,24cyclictest3452495-21apt-get09:30:231
3311402993317,14cyclictest3536793-21cron10:55:001
3311406993227,4cyclictest3521473-21kworker/u8:2+flush-8:010:35:422
3311406993222,8cyclictest3616297-21awk12:15:012
3311402993214,15cyclictest3462617-21apt-get09:40:201
3311399993225,5cyclictest3282938-21kworker/u8:2+flush-8:008:45:360
3311399993220,9cyclictest3506836-21apt-get10:25:010
331140299313,21cyclictest3522252-21apt-get10:40:221
3311402993112,17cyclictest3358501-21cpuspeed_turbos07:55:251
3311399993127,3cyclictest3375051-21kworker/u8:3+flush-8:008:55:410
3311399993126,4cyclictest3282938-21kworker/u8:2+flush-8:007:50:270
3311399993126,3cyclictest3563517-21kworker/u8:3+flush-8:011:54:110
331140299302,22cyclictest3398154-21apt-get08:35:261
3311402993020,8cyclictest3432075-21unixbench_singl09:05:451
331140299301,3cyclictest3467530-21apt-get09:45:221
3311399993022,6cyclictest3382147-21ntpq08:15:360
3311399993016,10cyclictest1704890-21systemd-journal11:00:400
36286242290,2sleep3471rcuc/312:25:303
3311406992925,2cyclictest3511610-21unixbench_multi10:25:432
331140299298,19cyclictest1-21systemd07:15:001
331140299294,12cyclictest0-21swapper/112:28:111
331140299292,21cyclictest407-21mta-sts-daemon11:00:211
331140299292,21cyclictest1704890-21systemd-journal07:40:231
3311402992915,11cyclictest0-21swapper/110:00:251
3311402992913,14cyclictest3550856-21ntp_states11:05:371
3311402992912,14cyclictest3517155-21latency_hist10:35:001
3311399992925,3cyclictest3493894-21kworker/u8:3+flush-8:010:11:090
3311399992925,2cyclictest0-21swapper/012:20:000
331140299283,20cyclictest0-21swapper/107:50:241
331140299282,22cyclictest3560725-21ntpq11:15:371
3311402992817,9cyclictest0-21swapper/110:07:401
3311402992813,12cyclictest3577224-21grep11:35:241
331140299281,21cyclictest3348417-21apt-get07:45:211
3311402992812,14cyclictest3510995-21missed_timers10:25:341
331140299281,10cyclictest3595644-21ntpq11:50:371
331140299281,10cyclictest3368148-21apt-get08:05:211
3311399992824,3cyclictest3556840-21kworker/u8:0+flush-8:012:05:320
3311399992821,5cyclictest3476782-21kworker/u8:0+flush-8:010:25:250
3311406992723,2cyclictest3402808-21tr08:40:002
3311406992723,2cyclictest3387596-21unixbench_singl08:20:412
331140299278,16cyclictest589-21runrttasks08:32:201
331140299273,18cyclictest3333490-21apt-get07:30:181
331140299273,18cyclictest0-21swapper/109:25:231
3311402992713,12cyclictest3501331-21timerandwakeup10:15:411
3311399992723,3cyclictest3493894-21kworker/u8:3+events_unbound10:30:340
3311399992723,3cyclictest3375051-21kworker/u8:3+flush-8:008:24:170
3311399992722,3cyclictest3631839-21cpuspeed_turbos12:30:230
3311399992722,3cyclictest3437401-21cron09:15:000
3311399992722,3cyclictest3437401-21cron09:14:590
3311406992621,3cyclictest3397452-21unixbench_multi08:30:422
3311402992615,8cyclictest0-21swapper/111:25:001
331140299261,10cyclictest3481141-21ntpq09:55:341
33111982263,17sleep00-21swapper/007:09:530
35545502250,5sleep3451irq_work/311:10:293
3311406992521,2cyclictest3373237-21aten2_r5power_v08:10:242
3311406992521,2cyclictest0-21swapper/207:30:012
331140699251,9cyclictest35965962cat11:55:012
3311406992519,4cyclictest3419838-21kworker/u8:1+events_unbound09:30:092
3311399992520,3cyclictest3423430-21irqcore09:00:290
3311406992420,2cyclictest3616829-21fschecks_count12:15:262
3311406992420,2cyclictest3358368-21aten2_r5power_p07:55:242
3311406992417,5cyclictest3513120-21cut10:30:282
33680732230,2sleep3481ktimers/308:05:013
331140699231,8cyclictest34380262fschecks_time09:15:262
3311406992313,7cyclictest3526936-21awk10:45:002
3311406992310,11cyclictest3356247-21tr07:50:322
3311406992217,4cyclictest3563517-21kworker/u8:3+events_unbound11:56:212
3311406992213,7cyclictest3462344-21sed09:40:012
3311399992218,2cyclictest3541781-21systemd-run11:00:010
3311406992116,4cyclictest3325750-21kworker/u8:1+flush-8:007:20:372
3311406992115,4cyclictest3367338-21kworker/u8:1+flush-8:008:00:412
3311399992118,2cyclictest3311391-21cyclictest08:05:230
33063982213,9sleep30-21swapper/307:05:023
35505452200,3sleep3451irq_work/311:05:323
3311406992017,2cyclictest3626390-21awk12:25:002
3311406992015,4cyclictest3282938-21kworker/u8:2-ext4-rsv-conversion09:10:002
3311406992015,3cyclictest0-21swapper/207:10:332
331140699201,2cyclictest36078811kthreadcore12:05:312
3311399992013,5cyclictest3338408-21kworker/u8:0+flush-8:007:55:410
33111582204,10sleep20-21swapper/207:09:232
331140699197,4cyclictest0-21swapper/209:55:242
3311406991915,2cyclictest0-21swapper/209:00:392
345970821810,5sleep30-21swapper/309:35:323
331140699188,8cyclictest3467264-21awk09:45:002
331140699186,2cyclictest521rcuop/311:35:302
3311406991814,2cyclictest3482595-21cpuspeed_turbos10:00:232
3311406991814,2cyclictest0-21swapper/209:25:262
3311406991814,2cyclictest0-21swapper/209:10:442
3311406991814,2cyclictest0-21swapper/209:10:432
3311406991810,6cyclictest3390173-21cut08:25:312
35407912170,2sleep3471rcuc/310:55:333
331140699179,6cyclictest3584639-21cut11:40:312
331140699179,6cyclictest3584639-21cut11:40:302
3311406991714,2cyclictest3497423-21cpuspeed_turbos10:15:242
3311406991713,2cyclictest0-21swapper/209:45:452
3311406991713,2cyclictest0-21swapper/209:22:142
331140699168,6cyclictest3333911-21awk07:30:242
331140699167,7cyclictest3345589-21tr07:40:332
3311406991612,3cyclictest0-21swapper/208:40:292
3311406991510,3cyclictest3338485-21aten2_r5power_c07:35:242
36012402146,5sleep30-21swapper/311:57:493
34334542144,6sleep30-21swapper/309:10:323
34334542144,6sleep30-21swapper/309:10:313
33931932142,8sleep30-21swapper/308:30:233
36220102132,7sleep30-21swapper/312:20:303
36066232132,7sleep30-21swapper/312:05:213
35946782133,7sleep30-21swapper/311:50:313
34666132132,7sleep30-21swapper/309:40:423
34522482132,6sleep30-21swapper/309:30:013
34129182133,5sleep30-21swapper/308:50:213
33530632130,7sleep30-21swapper/307:50:013
33162752132,6sleep30-21swapper/307:15:023
36365612122,6sleep30-21swapper/312:35:233
36208852122,6sleep30-21swapper/312:15:483
36155782122,6sleep30-21swapper/312:10:423
35872442122,6sleep30-21swapper/311:45:263
35769662122,6sleep30-21swapper/311:35:233
35659262122,6sleep30-21swapper/311:20:423
35604762122,6sleep30-21swapper/311:15:333
35361492122,6sleep30-21swapper/310:50:403
35271602122,5sleep30-21swapper/310:45:033
35225002122,6sleep30-21swapper/310:40:253
35176472122,6sleep30-21swapper/310:35:273
35125602122,6sleep30-21swapper/310:30:263
35112222122,6sleep30-21swapper/310:25:403
35063802122,6sleep30-21swapper/310:20:423
34926822122,6sleep30-21swapper/310:10:273
34870332122,5sleep30-21swapper/310:05:023
34861402122,6sleep30-21swapper/310:00:353
34771952122,5sleep30-21swapper/309:55:023
34514472122,6sleep30-21swapper/309:25:403
34321112122,6sleep30-21swapper/309:05:463
34229142123,6sleep30-21swapper/309:00:233
34126592122,5sleep30-21swapper/308:50:003
33981582122,6sleep30-21swapper/308:35:283
33836972122,6sleep30-21swapper/308:20:273
33778572122,5sleep30-21swapper/308:15:023
33680732122,5sleep30-21swapper/308:05:023
33432112122,6sleep30-21swapper/307:40:023
33239872122,6sleep30-21swapper/307:20:273
36361922112,5sleep30-21swapper/312:34:023
36020862112,5sleep30-21swapper/312:00:273
35819332112,5sleep30-21swapper/311:40:213
35819332112,5sleep30-21swapper/311:40:203
35759572112,5sleep30-21swapper/311:30:423
35667932112,5sleep30-21swapper/311:25:233
35424132112,5sleep30-21swapper/311:00:283
34717882112,5sleep30-21swapper/309:45:423
34428792112,5sleep30-21swapper/309:20:273
34376472112,5sleep30-21swapper/309:15:213
34178292112,5sleep30-21swapper/308:55:033
33882612112,5sleep30-21swapper/308:25:243
33731302112,6sleep30-21swapper/308:10:233
33592042112,5sleep30-21swapper/307:55:313
33538022112,5sleep30-21swapper/307:50:293
33336532112,5sleep30-21swapper/307:30:233
33330062112,6sleep30-21swapper/307:27:263
33115262112,6sleep30-21swapper/307:10:163
35012312102,5sleep30-21swapper/310:15:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional