You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 00:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Tue Jun 16, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40059632880,6chrt0-21swapper/207:45:342
3965566997465,7cyclictest4190655-21kworker/u8:0+flush-8:011:15:430
40404912720,5chrt0-21swapper/208:20:342
3965566996645,8cyclictest4125436-21ntpq09:45:390
3965574996454,8cyclictest4161112-21cp10:25:002
3965574996256,4cyclictest4190655-21kworker/u8:0+flush-8:011:40:442
3965574996155,4cyclictest31536-21apt-get11:30:002
3965571996054,4cyclictest4106255-21kworker/u8:3+events_unbound10:05:421
3965571995948,6cyclictest1704890-21systemd-journal09:45:421
3965571995851,4cyclictest56754-21kworker/u8:1+events_unbound12:35:421
3965571995851,4cyclictest56754-21kworker/u8:1+events_unbound12:35:421
3965571995850,6cyclictest4106255-21kworker/u8:3+flush-8:009:30:361
3965571995847,8cyclictest4150194-21ntpq10:10:381
3965571995846,9cyclictest4115580-21ntpq09:35:381
3965574995752,4cyclictest4076485-21kworker/u8:1+events_unbound11:00:432
3965571995650,4cyclictest2596405-21kworker/u8:2+events_unbound08:40:001
3965571995649,4cyclictest4106255-21kworker/u8:3+flush-8:010:00:311
3965571995649,4cyclictest4106255-21kworker/u8:3+flush-8:010:00:311
3965571995648,6cyclictest4042542-21kworker/u8:3+events_unbound08:45:431
828032550,2chrt75-21kworker/3:1+events12:20:333
3965571995548,5cyclictest2596405-21kworker/u8:2+flush-8:007:25:441
3965571995547,6cyclictest4057381-21/usr/sbin/munin08:40:441
3965574995349,3cyclictest3908046-21kworker/u8:0+flush-8:007:40:432
3965571995349,3cyclictest4042542-21kworker/u8:3+flush-8:008:25:411
3965571995344,6cyclictest4156081-21latency_hist10:20:021
41673382520,1sleep14167344-21sed10:30:321
3965571995244,6cyclictest4077160-21/usr/sbin/munin09:00:391
3965571995244,6cyclictest2596405-21kworker/u8:2+flush-8:008:30:281
3965571995139,9cyclictest1704890-21systemd-journal11:50:411
3965574995044,4cyclictest4042542-21kworker/u8:3+flush-8:008:55:392
3965571995044,4cyclictest3908046-21kworker/u8:0+flush-8:008:10:301
3965571995041,6cyclictest3976403-21ntpq07:15:371
3965571994916,31cyclictest1-21systemd09:55:411
3965571994916,31cyclictest1-21systemd09:55:411
3965566994940,6cyclictest4026992-21latency_hist08:10:010
3965566994838,7cyclictest66399-21latency_hist12:05:010
3965566994739,6cyclictest56754-21kworker/u8:1+flush-8:012:05:260
3965566994737,8cyclictest2596405-21kworker/u8:2+flush-8:008:35:310
3965566994737,7cyclictest4042542-21kworker/u8:3+flush-8:008:45:310
3965571994640,4cyclictest4091970-21kworker/u8:2+flush-8:009:15:311
3965571994635,8cyclictest10889-21ntpq11:05:371
3965566994636,8cyclictest4090878-21ntpq09:10:400
3965571994539,4cyclictest3908046-21kworker/u8:0+flush-8:007:20:361
3965574994439,4cyclictest4042542-21kworker/u8:3+flush-8:008:40:452
3965574994438,5cyclictest4091970-21kworker/u8:2+flush-8:009:15:332
3965571994436,5cyclictest81475-21latency_hist12:20:001
3965571994434,8cyclictest4156627-21diskstats10:20:261
3965566994435,7cyclictest4072482-21diskstats08:55:290
3965566994434,7cyclictest4047262-21latency_hist08:30:010
3965574994339,3cyclictest56754-21kworker/u8:1+events_unbound12:10:402
3965574994334,7cyclictest4111526-21turbostat.cron09:34:592
3965574994334,6cyclictest1704890-21systemd-journal12:35:002
3965571994337,4cyclictest4012450-21apt-get07:55:251
3965571994336,5cyclictest3908046-21kworker/u8:0+flush-8:008:20:281
3965571994336,3cyclictest3908046-21kworker/u8:0+flush-8:007:35:261
3965571994333,7cyclictest4076897-21latency_hist09:00:011
3965571994331,9cyclictest3969560-21ntpq07:10:361
3965571994236,4cyclictest4042542-21kworker/u8:3+flush-8:008:50:411
3965571994235,4cyclictest12076-21apt-get11:10:221
3965571994232,7cyclictest4186235-21/usr/sbin/munin10:50:391
3965574994137,3cyclictest4091970-21kworker/u8:2+flush-8:010:40:262
3965574994130,9cyclictest4057122-21awk08:40:002
3965571994135,4cyclictest4106255-21kworker/u8:3+events_unbound09:40:381
3965571994133,5cyclictest56754-21kworker/u8:1+events_unbound12:25:271
3965571994125,10cyclictest1704890-21systemd-journal09:21:411
3965566994131,8cyclictest3997073-21apt-get07:40:010
3965566994130,9cyclictest4037094-21apt-get08:20:000
3965566994129,9cyclictest1704890-21systemd-journal11:40:000
3965571994033,5cyclictest46126-21kworker/u8:2+events_unbound12:20:281
3965571994031,6cyclictest60586-21ntpq11:55:401
3965571994031,2cyclictest161rcu_preempt09:14:591
3965566994036,3cyclictest4190655-21kworker/u8:0+events_unbound11:20:340
3965571993930,7cyclictest1704890-21systemd-journal10:42:421
3965571993929,7cyclictest4085897-21ntpq09:05:381
3965566993929,8cyclictest4180135-21ntpq10:40:360
3965566993929,8cyclictest1704890-21systemd-journal10:20:000
3965571993833,4cyclictest3908046-21kworker/u8:0+flush-8:008:05:291
3965571993832,4cyclictest4091970-21kworker/u8:2+events_unbound10:25:421
3965571993832,4cyclictest2596405-21kworker/u8:2+flush-8:007:30:311
3965566993833,4cyclictest2596405-21kworker/u8:2+events_unbound09:05:420
39611932384,10sleep20-21swapper/207:05:312
39611932384,10sleep20-21swapper/207:05:312
3965574993732,3cyclictest46126-21kworker/u8:2+flush-8:012:15:402
3965571993731,4cyclictest4076485-21kworker/u8:1+flush-8:011:35:261
3965566993732,3cyclictest4091970-21kworker/u8:2+flush-8:010:25:320
3965566993731,4cyclictest4091970-21kworker/u8:2+events_unbound09:20:400
3965566993727,8cyclictest1704890-21systemd-journal12:30:410
3965571993630,4cyclictest46126-21kworker/u8:2+events_unbound12:30:331
3965571993629,4cyclictest4161477-21kworker/u8:0+flush-8:010:35:371
3965571993627,6cyclictest4106255-21kworker/u8:3+events_unbound09:50:301
3965566993630,5cyclictest4091970-21kworker/u8:2+events_unbound09:15:340
3965566993630,5cyclictest3908046-21kworker/u8:0+flush-8:007:15:290
3965566993626,8cyclictest4171389-21kworker/u8:3+flush-8:011:30:370
3965566993626,7cyclictest4135481-21ntpq09:55:390
3965566993626,7cyclictest4135481-21ntpq09:55:380
3965571993530,4cyclictest2596405-21kworker/u8:2+events_unbound07:45:371
3965571993529,4cyclictest4181352-21apt-get10:45:251
3965571993527,6cyclictest4076485-21kworker/u8:1+events_unbound10:55:431
3965566993530,3cyclictest4161477-21kworker/u8:0+events_unbound10:35:420
3965566993525,7cyclictest76543-21latency_hist12:15:010
396556699351,28cyclictest3965436-21kworker/0:0+events07:25:240
396556699350,30cyclictest4125609-21kworker/0:3+events11:40:180
3965574993423,8cyclictest4032327-21cat08:15:012
3965571993427,5cyclictest5961-21ntpq11:00:371
3965566993426,6cyclictest4161477-21kworker/u8:0+flush-8:010:30:390
3965566993426,6cyclictest3991171-21ntpq07:30:380
39653762344,6sleep10-21swapper/107:09:481
39653762344,6sleep10-21swapper/107:09:481
98612330,5sleep3451irq_work/311:05:333
3965571993328,4cyclictest2596405-21kworker/u8:2+flush-8:007:40:421
3965566993326,5cyclictest4190655-21kworker/u8:0+events_unbound11:10:000
3965574993226,4cyclictest4076485-21kworker/u8:1+flush-8:010:15:282
3965571993226,4cyclictest3965431-21kworker/u8:1+flush-8:008:15:361
3965571993225,5cyclictest61-21kcompactd011:30:021
3965571993225,5cyclictest26187-21grep11:20:451
3965566993225,6cyclictest4042542-21kworker/u8:3+flush-8:009:00:290
3965566993225,5cyclictest46126-21kworker/u8:2+flush-8:011:55:290
396556699321,30cyclictest4125609-21kworker/0:3+events10:14:190
396556699321,29cyclictest4125609-21kworker/0:3+events11:25:280
396556699320,31cyclictest4047306-21kworker/0:0+events08:54:160
41432182310,4chrt0-21swapper/210:05:322
3965571993124,5cyclictest26908-21apt-get11:25:241
3965571993123,6cyclictest1704890-21systemd-journal12:05:421
3965571993121,8cyclictest50679-21ntpq11:45:391
396556699317,19cyclictest3965436-21kworker/0:0+events08:10:110
3965566993127,3cyclictest2596405-21kworker/u8:2+events_unbound07:50:430
3965566993126,4cyclictest4106255-21kworker/u8:3+events_unbound10:20:370
3965566993124,6cyclictest2596405-21kworker/u8:2+flush-8:008:00:370
396556699311,29cyclictest4091763-21kworker/0:1+events09:30:570
396556699310,30cyclictest4091763-21kworker/0:1+events09:37:150
3965571993026,3cyclictest4190655-21kworker/u8:0+events_unbound11:20:011
396556699307,18cyclictest51575-21kworker/0:1+events11:50:070
396556699303,26cyclictest4125609-21kworker/0:3+events10:50:240
3965566993024,4cyclictest4106255-21kworker/u8:3+flush-8:010:00:290
3965566993024,4cyclictest4106255-21kworker/u8:3+flush-8:010:00:280
396556699302,27cyclictest4047306-21kworker/0:0+events08:42:030
3965574992924,4cyclictest3965431-21kworker/u8:1+events_unbound08:15:282
3965574992923,4cyclictest56509-21cat11:55:002
3965574992918,8cyclictest4166302-21cat10:30:012
396556699297,21cyclictest4047306-21kworker/0:0+events08:30:560
396556699292,26cyclictest66436-21kworker/0:0+events12:15:240
396556699291,27cyclictest4091763-21kworker/0:1+events09:25:390
3965574992823,3cyclictest4185600-21unixbench_singl10:45:452
3965574992823,3cyclictest3986788-21unixbench_singl07:25:452
3965574992822,4cyclictest31536-21apt-get11:30:022
3965574992820,6cyclictest4101651-21turbostat.cron09:25:002
396556699289,18cyclictest3965436-21kworker/0:0+events07:46:270
396556699288,19cyclictest4125609-21kworker/0:3+events11:46:210
396556699288,15cyclictest4125609-21kworker/0:3+events10:55:270
396556699286,21cyclictest3965436-21kworker/0:0+events07:11:260
396556699281,26cyclictest4091763-21kworker/0:1+events09:40:260
3965566992810,17cyclictest4125609-21kworker/0:3+events10:45:410
3965566992810,17cyclictest4125609-21kworker/0:3+events10:05:430
3965574992723,2cyclictest3965859-21aten2_r5power_v07:10:262
3965571992721,5cyclictest2596405-21kworker/u8:2+events_unbound08:00:361
3965571992721,3cyclictest0-21swapper/112:00:441
3965571992719,5cyclictest1704890-21systemd-journal11:44:421
396556699278,18cyclictest66436-21kworker/0:0+events12:28:230
396556699278,18cyclictest3965436-21kworker/0:0+events07:58:390
396556699278,14cyclictest4125609-21kworker/0:3+events11:00:190
3965566992718,6cyclictest16738-21latency_hist11:15:010
396556699271,25cyclictest66436-21kworker/0:0+events12:20:290
396556699271,25cyclictest4027025-21kworker/0:1+events08:20:230
396556699271,25cyclictest3965436-21kworker/0:0+events07:21:310
396556699270,26cyclictest4125609-21kworker/0:3+events09:52:430
3965574992623,2cyclictest62007-21fschecks_count12:00:292
3965574992623,2cyclictest4046831-21unixbench_multi08:25:442
3965574992622,3cyclictest4017514-21aten2_r5power_v08:00:262
3965574992622,3cyclictest2596405-21kworker/u8:2+events_unbound08:50:462
3965574992622,2cyclictest4121027-21unixbench_singl09:40:462
3965571992619,5cyclictest56754-21kworker/u8:1+events_unbound12:10:321
396556699269,16cyclictest66436-21kworker/0:0+events12:35:370
396556699269,16cyclictest66436-21kworker/0:0+events12:35:370
396556699269,16cyclictest3965436-21kworker/0:0+events07:40:020
3965574992521,2cyclictest4171682-21fschecks_count10:35:282
3965574992521,2cyclictest4136735-21aten2_r5power_v10:00:272
3965574992521,2cyclictest4136735-21aten2_r5power_v10:00:272
3965574992520,4cyclictest4086831-21kworker/u8:0+events_unbound09:10:452
3965574992420,2cyclictest3993313-21kthreadcore07:35:322
3965571992418,4cyclictest3908046-21kworker/u8:0+events_unbound07:50:241
396557499232,14cyclictest4062341-21apt-get08:45:262
3965574992319,2cyclictest4146497-21aten2_r5power_c10:10:272
3965571992217,3cyclictest281rcuc/109:29:591
40630692210,6sleep375-21kworker/3:1+mm_percpu_wq08:45:323
3965574992117,3cyclictest4076485-21kworker/u8:1+events_unbound09:55:012
3965574992117,2cyclictest7369-21cpuspeed_turbos11:05:262
3965574992117,2cyclictest3987718-21fschecks_count07:30:292
3965574992113,6cyclictest4116467-21awk09:40:002
39651962213,7sleep00-21swapper/007:07:300
39651962213,7sleep00-21swapper/007:07:300
396557499202,12cyclictest4101933-21apt-get09:25:272
3965574992016,3cyclictest2596405-21kworker/u8:2+flush-8:007:50:482
3965574992016,2cyclictest0-21swapper/212:09:592
3965574992011,7cyclictest99303-21cut12:35:342
3965574992011,7cyclictest99303-21cut12:35:332
3965574992010,8cyclictest0-21swapper/209:05:252
396557499200,7cyclictest46939-21cut11:45:262
396557499192,12cyclictest4022337-21apt-get08:05:242
3965574991915,2cyclictest0-21swapper/211:10:352
3965574991915,2cyclictest0-21swapper/210:00:002
3965574991915,2cyclictest0-21swapper/209:59:592
3965574991913,4cyclictest0-21swapper/207:55:312
3965574991910,7cyclictest60603-21grep11:55:402
396557499188,8cyclictest4081860-21cron09:05:002
396557499188,3cyclictest0-21swapper/211:35:392
396557499183,2cyclictest41699342cut10:30:352
3965574991815,2cyclictest4047831-21fschecks_count08:30:282
3965574991814,2cyclictest3978231-21irqcore07:20:302
3965574991814,2cyclictest0-21swapper/211:20:352
39607682183,8sleep30-21swapper/307:05:123
39607682183,8sleep30-21swapper/307:05:113
396557499173,2cyclictest8282cat10:55:352
3965574991713,2cyclictest0-21swapper/212:20:322
396557499171,12cyclictest17010-21apt-get11:15:232
3965574991613,2cyclictest0-21swapper/210:53:222
3965574991612,2cyclictest0-21swapper/212:25:312
3965574991612,2cyclictest0-21swapper/209:45:342
396557499156,7cyclictest3971724-21cat07:15:032
419432142,7sleep30-21swapper/311:40:263
867542135,5sleep30-21swapper/312:25:243
41859712132,6sleep30-21swapper/310:50:013
41511402132,6sleep30-21swapper/310:15:023
40423512132,6sleep30-21swapper/308:25:013
378912133,6sleep30-21swapper/311:35:323
306572132,7sleep30-21swapper/311:25:413
18972132,7sleep30-21swapper/311:00:013
156672132,7sleep30-21swapper/311:10:363
919112122,6sleep30-21swapper/312:30:303
812792122,6sleep30-21swapper/312:17:423
664652122,5sleep30-21swapper/312:05:013
622642122,6sleep30-21swapper/312:00:323
571632122,6sleep30-21swapper/311:55:313
515402122,6sleep30-21swapper/311:50:013
41761432122,6sleep30-21swapper/310:40:013
41716702122,6sleep30-21swapper/310:35:293
41657372122,6sleep30-21swapper/310:25:443
41572632122,6sleep30-21swapper/310:20:323
41469232122,6sleep30-21swapper/310:10:323
41321412122,6sleep30-21swapper/309:55:323
41321412122,6sleep30-21swapper/309:55:323
41271242122,6sleep30-21swapper/309:50:303
41256752122,6sleep30-21swapper/309:45:433
41073972122,6sleep30-21swapper/309:30:313
41016802122,5sleep30-21swapper/309:25:023
41010442122,6sleep30-21swapper/309:20:443
40924422122,6sleep30-21swapper/309:15:303
40769292122,5sleep30-21swapper/309:00:023
40753722122,6sleep30-21swapper/308:55:353
40676512122,6sleep30-21swapper/308:50:313
40515372122,6sleep30-21swapper/308:30:443
40381592122,6sleep30-21swapper/308:20:333
40224232122,6sleep30-21swapper/308:05:273
40171492122,6sleep30-21swapper/308:00:023
39921292122,6sleep30-21swapper/307:35:013
39824622122,5sleep30-21swapper/307:25:033
39771492124,5sleep30-21swapper/307:18:073
39661682122,6sleep30-21swapper/307:10:303
220152122,6sleep30-21swapper/311:20:273
965952112,5sleep30-21swapper/312:35:243
965952112,5sleep30-21swapper/312:35:233
720742112,5sleep30-21swapper/312:10:283
522002112,5sleep30-21swapper/311:50:283
41873722112,5sleep30-21swapper/310:50:343
41687952112,5sleep30-21swapper/310:30:353
41461252112,5sleep30-21swapper/310:09:243
41363632112,5sleep30-21swapper/310:00:013
41363632112,5sleep30-21swapper/310:00:003
41171272112,6sleep30-21swapper/309:40:313
41155212112,5sleep30-21swapper/309:35:373
40910922112,5sleep30-21swapper/309:10:453
40826162112,6sleep30-21swapper/309:05:313
40611202112,5sleep30-21swapper/308:40:383
40527622112,5sleep30-21swapper/308:35:303
40369742112,5sleep30-21swapper/308:18:403
40278922112,5sleep30-21swapper/308:10:343
40126112112,5sleep30-21swapper/307:55:293
40110862112,5sleep30-21swapper/307:50:343
40033782112,5sleep30-21swapper/307:45:333
39976082112,5sleep30-21swapper/307:40:283
39879302112,5sleep30-21swapper/307:30:323
39776092112,5sleep30-21swapper/307:20:253
360122112,6sleep30-21swapper/311:30:423
24572112,5sleep30-21swapper/311:00:283
167502112,5sleep30-21swapper/311:15:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional