You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 16:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Jun 12, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
87811623900,2sleep3481ktimers/312:00:003
69876421750,1sleep375-21kworker/3:1-events08:55:493
60275821710,6sleep30-21swapper/307:20:383
588531997568,5cyclictest758968-21kworker/u8:3+flush-8:010:05:461
588525996959,7cyclictest918181-21latency_hist12:40:000
588535996049,8cyclictest913403-21cat12:35:012
588531996051,7cyclictest1704890-21systemd-journal10:53:091
588531995947,9cyclictest723225-21ntpq09:20:421
588531995853,3cyclictest620373-21kworker/u8:2+flush-8:007:55:311
588531995853,3cyclictest620373-21kworker/u8:2+flush-8:007:55:301
588531995651,4cyclictest723261-21kworker/u8:2+events_unbound10:15:411
588531995649,5cyclictest567992-21kworker/u8:3+flush-8:008:20:421
588531995447,5cyclictest669507-21kworker/u8:0+flush-8:009:10:301
588531995447,4cyclictest758968-21kworker/u8:3+events_unbound11:50:291
588531995443,8cyclictest892007-21ntpq12:10:401
588525995444,7cyclictest592575-21ntpq07:10:430
588531995044,4cyclictest567992-21kworker/u8:3+flush-8:008:35:421
588531994942,5cyclictest614902-21kworker/u8:1+flush-8:008:15:341
588531994938,9cyclictest629177-21ntpq07:45:441
588535994837,8cyclictest679467-21cat08:40:012
588531994842,4cyclictest614902-21kworker/u8:1+events_unbound07:35:411
588531994841,5cyclictest567992-21kworker/u8:3+flush-8:008:30:321
588531994741,4cyclictest908415-21kworker/u8:2+flush-8:012:35:431
588531994741,4cyclictest620373-21kworker/u8:2+events_unbound08:00:451
588531994740,4cyclictest614902-21kworker/u8:1+events_unbound08:10:441
588531994739,5cyclictest828698-21latency_hist11:10:001
588531994737,8cyclictest1704890-21systemd-journal10:00:011
588535994640,4cyclictest588395-21kworker/u8:1+flush-8:007:10:312
588531994641,3cyclictest813055-21kworker/u8:1+events_unbound12:00:361
588531994637,7cyclictest733327-21ntpq09:30:401
588531994636,8cyclictest743310-21ntpq09:40:421
588531994636,7cyclictest896950-21ntpq12:15:391
588531994635,8cyclictest847581-21ntpq11:25:421
588531994539,4cyclictest723261-21kworker/u8:2+flush-8:010:00:451
588531994538,5cyclictest567992-21kworker/u8:3+events_unbound08:40:461
588525994535,8cyclictest734485-21/usr/sbin/munin09:35:390
588531994434,8cyclictest693577-21ntpq08:50:451
588531994432,9cyclictest1704890-21systemd-journal09:45:411
588531994432,9cyclictest1704890-21systemd-journal09:45:401
588525994434,8cyclictest1704890-21systemd-journal11:00:000
588535994337,4cyclictest567992-21kworker/u8:3+flush-8:008:25:312
588535994334,7cyclictest674456-21/usr/sbin/munin08:35:012
588531994337,4cyclictest813055-21kworker/u8:1+flush-8:011:10:271
588525994332,9cyclictest643901-21ntpq08:00:380
588531994235,5cyclictest567992-21kworker/u8:3+events_unbound07:50:431
58825624227,10sleep10-21swapper/107:08:571
588531994136,4cyclictest503921-21kworker/u8:0+events_unbound07:25:441
588531994134,5cyclictest908415-21kworker/u8:2+flush-8:012:30:311
588531994129,9cyclictest792661-21ntpq10:30:391
588531994034,4cyclictest567992-21kworker/u8:3+events_unbound09:15:431
588531994033,6cyclictest758968-21kworker/u8:3+events_unbound10:35:421
588531994033,6cyclictest567992-21kworker/u8:3+events_unbound07:30:481
588535993930,7cyclictest729053-21apt-get09:30:002
588531993931,6cyclictest783892-21kworker/u8:1+flush-8:010:25:421
588531993924,10cyclictest729053-21apt-get09:30:011
588525993930,7cyclictest862438-21ntpq11:40:410
588525993930,7cyclictest862438-21ntpq11:40:410
588525993930,7cyclictest819012-21/usr/sbin/munin11:00:390
588525993926,10cyclictest758968-21kworker/u8:3+flush-8:011:25:120
58852599391,37cyclictest758984-21kworker/0:2+events10:21:050
6133712380,5sleep3451irq_work/307:30:413
588535993834,3cyclictest567992-21kworker/u8:3+events_unbound08:25:012
588531993834,3cyclictest758968-21kworker/u8:3+flush-8:012:05:461
588531993833,3cyclictest588395-21kworker/u8:1+flush-8:007:10:461
588531993830,6cyclictest758968-21kworker/u8:3+events_unbound10:55:311
588531993830,6cyclictest723261-21kworker/u8:2+flush-8:010:10:461
588531993829,6cyclictest1704890-21systemd-journal11:47:411
588525993832,4cyclictest669507-21kworker/u8:0+flush-8:009:50:310
588535993733,3cyclictest723261-21kworker/u8:2+flush-8:009:20:442
588531993732,4cyclictest902221-21kworker/u8:0+events_unbound12:20:461
588531993731,4cyclictest758968-21kworker/u8:3+events_unbound10:20:371
588531993729,5cyclictest858665-21apt-get11:40:271
588531993729,5cyclictest858665-21apt-get11:40:271
588535993631,3cyclictest758968-21kworker/u8:3+events_unbound10:05:302
588531993628,5cyclictest503921-21kworker/u8:0+events_unbound07:20:401
588531993627,6cyclictest689533-21latency_hist08:50:011
588525993631,4cyclictest614902-21kworker/u8:1+flush-8:008:10:470
588525993630,5cyclictest669507-21kworker/u8:0+flush-8:008:32:110
588525993625,10cyclictest793200-21kworker/u8:2+flush-8:012:20:020
58852599360,34cyclictest1-21systemd07:45:000
588525993531,3cyclictest804527-21irqrtprio10:45:340
588525993529,5cyclictest813055-21kworker/u8:1+flush-8:010:55:010
588525993526,7cyclictest679385-21latency_hist08:40:000
58852599352,31cyclictest639924-21kworker/0:1+events09:30:090
58852599351,33cyclictest798607-21kworker/0:1+events11:59:510
588535993429,4cyclictest620373-21kworker/u8:2+flush-8:007:55:482
588535993429,4cyclictest620373-21kworker/u8:2+flush-8:007:55:472
588531993427,5cyclictest758968-21kworker/u8:3+events_unbound10:40:311
588531993427,5cyclictest567992-21kworker/u8:3+flush-8:008:55:351
588531993426,6cyclictest645118-21apt-get08:05:251
588531993424,7cyclictest813055-21kworker/u8:1+flush-8:011:35:401
58852599348,21cyclictest798607-21kworker/0:1+events12:15:050
588525993429,4cyclictest813055-21kworker/u8:1+events_unbound12:30:470
588525993425,6cyclictest763903-21latency_hist10:05:020
58852599342,31cyclictest568743-21kworker/0:3+events07:57:510
58852599342,31cyclictest568743-21kworker/0:3+events07:57:500
58852599342,30cyclictest639924-21kworker/0:1+events09:48:410
58852599342,30cyclictest639924-21kworker/0:1+events09:48:400
58852599342,26cyclictest639924-21kworker/0:1+events09:25:180
7731202330,5sleep3451irq_work/310:10:453
588531993328,4cyclictest758968-21kworker/u8:3+flush-8:011:55:481
588531993327,4cyclictest664889-21aten2_r5power_c08:25:291
588531993325,6cyclictest843513-21latency_hist11:25:001
588525993327,5cyclictest723261-21kworker/u8:2+flush-8:009:56:110
588525993324,7cyclictest853664-21/usr/sbin/munin11:35:370
588525993324,7cyclictest764906-21irqrtprio10:05:340
58852599332,30cyclictest798607-21kworker/0:1+events11:34:270
58852599332,30cyclictest758984-21kworker/0:2+events10:33:140
58852599332,30cyclictest568743-21kworker/0:3+events07:32:250
58852599332,30cyclictest568743-21kworker/0:3+events07:27:310
58852599332,26cyclictest639924-21kworker/0:1+events09:00:250
588525993310,22cyclictest798607-21kworker/0:1+events11:48:120
588535993227,3cyclictest503921-21kworker/u8:0+events_unbound07:15:312
588531993228,3cyclictest793200-21kworker/u8:2+flush-8:010:45:301
588531993227,4cyclictest595954-21kworker/u8:2+flush-8:007:20:011
588525993228,2cyclictest907079-21needreboot12:25:390
58852599322,25cyclictest568743-21kworker/0:3+events07:50:110
58852599321,30cyclictest798607-21kworker/0:1+events12:11:430
58852599321,30cyclictest798607-21kworker/0:1+events11:53:130
58852599321,30cyclictest798607-21kworker/0:1+events11:08:270
58852599321,30cyclictest639924-21kworker/0:1+events08:25:430
58852599321,30cyclictest568743-21kworker/0:3+events07:39:540
588531993125,4cyclictest903370-21apt-get12:25:271
588525993128,2cyclictest772825-21needreboot10:10:380
588525993127,2cyclictest625977-21irqcore07:45:370
588525993126,4cyclictest813055-21kworker/u8:1+flush-8:012:00:430
58852599311,25cyclictest798607-21kworker/0:1+events11:20:070
58852599310,30cyclictest798607-21kworker/0:1+events11:16:240
588535993026,3cyclictest723261-21kworker/u8:2+events_unbound10:00:422
588535993025,4cyclictest793200-21kworker/u8:2+flush-8:011:40:312
588535993025,4cyclictest793200-21kworker/u8:2+flush-8:011:40:302
588531993021,7cyclictest838569-21cron11:20:001
58852599306,19cyclictest639924-21kworker/0:1+events09:05:190
588525993024,4cyclictest567992-21kworker/u8:3+flush-8:008:55:300
58852599302,27cyclictest639924-21kworker/0:1+events09:16:050
588525993022,6cyclictest684575-21latency_hist08:45:010
58852599301,27cyclictest568743-21kworker/0:3+events07:20:380
58852599300,29cyclictest639924-21kworker/0:1+events08:47:210
588535992926,2cyclictest813055-21kworker/u8:1+events_unbound10:53:162
588535992924,4cyclictest567992-21kworker/u8:3+events_unbound08:55:462
588531992925,2cyclictest749391-21aten2_r5power_e09:50:291
58852599295,19cyclictest798607-21kworker/0:1+events12:05:050
58852599293,25cyclictest758984-21kworker/0:2+events10:39:290
58852599292,26cyclictest639924-21kworker/0:1+events09:41:580
58852599292,26cyclictest568743-21kworker/0:3+events07:18:110
58852599291,27cyclictest639924-21kworker/0:1+events08:21:320
588535992823,4cyclictest758968-21kworker/u8:3-ext4-rsv-conversion12:00:012
588535992823,3cyclictest814071-21fschecks_count10:55:312
588531992822,4cyclictest793200-21kworker/u8:2+events_unbound11:30:451
58852599289,18cyclictest639924-21kworker/0:1+events08:17:030
58852599281,26cyclictest639924-21kworker/0:1+events09:23:370
58852599280,27cyclictest758984-21kworker/0:2+events10:19:190
58852599280,23cyclictest758984-21kworker/0:2+events10:25:130
58852599280,23cyclictest639924-21kworker/0:1+events08:50:270
588535992723,3cyclictest669507-21kworker/u8:0+events_unbound09:50:352
588535992723,2cyclictest896880-21grep12:15:372
588535992723,2cyclictest793953-21aten2_r5power_v10:35:262
588535992722,3cyclictest848781-21aten2_r5power_c11:30:282
588535992721,4cyclictest843086-21unixbench_multi11:20:452
58852599272,24cyclictest798607-21kworker/0:1+events11:10:430
588535992622,3cyclictest824268-21fschecks_count11:05:322
588535992622,2cyclictest615714-21fschecks_count07:35:342
588531992621,4cyclictest624699-21unixbench_multi07:40:501
588531992621,3cyclictest821212-21kthreadcore11:00:381
588531992621,3cyclictest735229-21irqrtprio09:35:351
588531992619,5cyclictest704319-21cron09:05:001
58852599263,18cyclictest639924-21kworker/0:1+events09:10:040
58852599261,24cyclictest568743-21kworker/0:3+events08:07:020
588535992520,4cyclictest902221-21kworker/u8:0+events_unbound12:20:422
588535992517,5cyclictest1704890-21systemd-journal12:40:002
58852599254,20cyclictest758984-21kworker/0:2+events10:44:110
5880342253,3sleep00-21swapper/007:06:020
588535992421,2cyclictest883645-21fschecks_count12:05:312
588531992419,3cyclictest704847-21cpuspeed_turbos09:05:311
8558982230,3sleep20-21swapper/211:35:362
588535992320,2cyclictest719178-21sendmail09:19:592
588535992318,3cyclictest843827-21aten2_r5power_c11:25:292
588535992219,2cyclictest620781-21fschecks_time07:40:342
588535992218,2cyclictest0-21swapper/211:10:322
5835532223,9sleep30-21swapper/307:05:023
588535992118,2cyclictest868594-21aten2_r5power_p11:50:282
588535992117,3cyclictest630027-21cron07:50:002
588535992016,2cyclictest778289-21unixbench_multi10:15:452
588535992014,4cyclictest0-21swapper/208:05:482
588535992010,8cyclictest1704890-21systemd-journal10:33:412
588535992010,2cyclictest0-21swapper/209:00:262
5872982203,10sleep20-21swapper/207:05:412
588535991916,2cyclictest0-21swapper/208:10:412
588535991915,3cyclictest689922-21aten2_r5power_v08:50:302
588535991915,2cyclictest0-21swapper/212:25:402
588535991915,2cyclictest0-21swapper/211:15:482
588535991915,2cyclictest0-21swapper/211:01:412
588535991911,6cyclictest739190-21turbostat.cron09:40:002
588535991911,5cyclictest804211-21if_enp3s010:45:332
588535991910,7cyclictest880385-21tr12:00:362
588535991910,7cyclictest747702-21tr09:45:382
588535991910,7cyclictest747702-21tr09:45:372
588535991814,3cyclictest684913-21aten2_r5power_e08:45:292
588535991814,2cyclictest0-21swapper/212:10:402
588535991814,2cyclictest0-21swapper/210:20:352
588535991810,4cyclictest773124-21mailstats10:10:452
58853599172,11cyclictest802609-21ntpq10:40:402
588535991713,3cyclictest567992-21kworker/u8:3+events_unbound07:35:002
588535991713,2cyclictest640447-21fschecks_count08:00:302
588535991712,3cyclictest0-21swapper/208:40:382
588535991711,4cyclictest0-21swapper/210:25:352
588535991711,4cyclictest0-21swapper/207:20:312
58853599171,11cyclictest654967-21apt-get08:15:312
58853599170,14cyclictest705201-21ps09:05:362
58853599162,2cyclictest0-21swapper/211:46:062
58853599162,13cyclictest0-21swapper/209:41:142
588535991613,2cyclictest0-21swapper/209:32:142
588535991613,2cyclictest0-21swapper/209:10:272
58853599161,11cyclictest609179-21sshd07:25:392
7572132150,3sleep2371rcuc/209:55:402
58853599152,12cyclictest0-21swapper/207:50:162
7886172146,5sleep30-21swapper/310:29:533
6898112142,8sleep30-21swapper/308:50:293
9031062132,6sleep30-21swapper/312:25:013
8689872134,5sleep30-21swapper/311:50:353
8541722132,7sleep30-21swapper/311:35:343
8526402132,7sleep30-21swapper/311:30:443
8278392133,6sleep30-21swapper/311:05:443
7937052132,6sleep30-21swapper/310:35:013
7787172132,6sleep30-21swapper/310:20:013
7350102132,7sleep30-21swapper/309:35:343
6695122132,6sleep30-21swapper/308:30:013
6169802132,7sleep30-21swapper/307:35:403
8986862122,6sleep30-21swapper/312:20:323
8781162122,5sleep30-21swapper/312:00:023
8595472122,6sleep30-21swapper/311:40:343
8595472122,6sleep30-21swapper/311:40:343
8442492122,6sleep30-21swapper/311:25:343
8341432122,6sleep30-21swapper/311:15:313
8287222122,5sleep30-21swapper/311:10:013
8189772122,5sleep30-21swapper/311:00:023
8152522122,6sleep30-21swapper/310:55:373
8132472122,6sleep30-21swapper/310:53:113
8035352122,5sleep30-21swapper/310:45:023
8030722122,6sleep30-21swapper/310:40:483
7594662121,7sleep30-21swapper/310:00:313
7530622122,6sleep30-21swapper/309:50:403
7481682122,6sleep30-21swapper/309:45:423
7481682122,6sleep30-21swapper/309:45:413
7309702122,6sleep30-21swapper/309:30:373
7248362122,6sleep30-21swapper/309:25:363
7194712122,6sleep30-21swapper/309:20:293
6865062123,5sleep30-21swapper/308:45:383
6684282122,6sleep30-21swapper/308:25:413
6549392122,6sleep30-21swapper/308:15:283
6477722122,6sleep30-21swapper/308:05:383
6439442122,6sleep30-21swapper/308:00:403
6373212122,6sleep30-21swapper/307:55:393
6373212122,6sleep30-21swapper/307:55:383
6300242122,5sleep30-21swapper/307:50:013
6253912122,6sleep30-21swapper/307:45:313
6202262122,6sleep30-21swapper/307:40:023
6064312122,6sleep30-21swapper/307:25:373
5960502122,6sleep30-21swapper/307:15:343
5889432122,6sleep30-21swapper/307:10:313
9175172112,5sleep30-21swapper/312:35:453
9120862112,5sleep30-21swapper/312:30:403
8931382112,5sleep30-21swapper/312:15:033
8882672112,5sleep30-21swapper/312:10:283
8838792112,5sleep30-21swapper/312:05:363
8633022112,5sleep30-21swapper/311:45:013
8426702113,5sleep30-21swapper/311:20:413
7889402112,5sleep30-21swapper/310:30:293
7790352112,5sleep30-21swapper/310:20:293
7645532112,6sleep30-21swapper/310:05:323
7582892112,5sleep30-21swapper/309:55:503
7394902112,6sleep30-21swapper/309:40:293
7147972111,6sleep30-21swapper/309:15:333
7100472112,5sleep30-21swapper/309:10:353
7048642112,5sleep30-21swapper/309:05:333
6999252112,6sleep30-21swapper/309:00:313
6802912112,5sleep30-21swapper/308:40:333
6752162112,5sleep30-21swapper/308:35:363
6598412112,5sleep30-21swapper/308:20:033
6500852112,5sleep30-21swapper/308:10:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional