You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 20:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Sat Jul 04, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2990552750,5sleep1291ktimers/111:30:121
37729997060,7cyclictest248843-21latency_hist10:40:021
2907902670,5chrt0-21swapper/211:20:182
2129112610,4chrt0-21swapper/110:00:191
37729995955,3cyclictest313620-21kworker/u8:2+flush-8:012:30:261
37729995646,7cyclictest348630-21latency_hist12:20:011
37726995650,4cyclictest298168-21kworker/u8:1+flush-8:011:40:290
2503552560,2chrt75-21kworker/3:1+events10:40:193
37726995550,4cyclictest119688-21kworker/u8:0+flush-8:008:30:240
2035322550,4chrt0-21swapper/109:50:281
37729995448,4cyclictest243633-21kworker/u8:0+events_unbound11:20:301
37732995233,16cyclictest1704890-21systemd-journal10:35:002
37732995128,6cyclictest1704890-21systemd-journal11:54:592
37729995146,4cyclictest2878278-21kworker/u8:2+flush-8:007:15:271
37729995145,4cyclictest2878278-21kworker/u8:2+flush-8:009:30:291
37729995143,5cyclictest368456-21latency_hist12:40:001
37729995141,8cyclictest104090-21apt-get08:15:011
653532500,3sleep10-21swapper/107:35:161
37732995029,6cyclictest1704890-21systemd-journal11:35:002
37732994930,7cyclictest234197-21apt-get10:25:082
37729994944,4cyclictest218172-21kworker/u8:1+flush-8:010:45:251
37729994943,4cyclictest5614-21kworker/u8:0+flush-8:008:00:261
37726994943,5cyclictest298168-21kworker/u8:1+flush-8:011:35:240
37726994942,5cyclictest58578-21ntpq07:25:210
2299362490,3sleep375-21kworker/3:1-mm_percpu_wq10:20:163
37729994842,4cyclictest5614-21kworker/u8:0+flush-8:007:25:261
37729994841,5cyclictest313620-21kworker/u8:2+flush-8:011:50:231
37729994839,6cyclictest64463-21latency_hist07:35:021
37726994843,3cyclictest209365-21kworker/u8:4+flush-8:011:05:110
37729994743,3cyclictest5614-21kworker/u8:0+flush-8:007:45:261
37729994742,4cyclictest164446-21kworker/u8:3+flush-8:010:15:231
37726994735,9cyclictest282647-21ntpq11:10:220
37726994640,4cyclictest209365-21kworker/u8:4+flush-8:011:45:130
37729994541,3cyclictest313620-21kworker/u8:2+flush-8:011:55:291
37729994541,3cyclictest2878278-21kworker/u8:2+flush-8:008:05:331
37729994540,4cyclictest164446-21kworker/u8:3+flush-8:010:20:241
37729994535,8cyclictest42654-21latency_hist07:15:011
37729994535,8cyclictest42654-21latency_hist07:15:001
37729994532,10cyclictest1704890-21systemd-journal09:56:391
37726994541,3cyclictest298168-21kworker/u8:1+flush-8:012:15:250
37726994540,4cyclictest129717-21kworker/u8:0+flush-8:008:45:130
37729994436,6cyclictest298168-21kworker/u8:1+flush-8:012:10:231
37729994434,7cyclictest1704890-21systemd-journal09:09:591
37726994438,5cyclictest194593-21kworker/u8:2+flush-8:009:45:210
37726994438,4cyclictest5614-21kworker/u8:0+flush-8:007:15:330
37726994434,8cyclictest1704890-21systemd-journal11:30:000
37726994434,8cyclictest108380-21ntpq08:15:220
1646872440,2sleep0201rcuc/009:15:120
37729994339,3cyclictest209365-21kworker/u8:4+flush-8:010:55:101
37729994338,4cyclictest3400174-21kworker/u8:3+flush-8:007:40:241
37729994337,5cyclictest2878278-21kworker/u8:2+flush-8:009:25:251
37729994334,6cyclictest169477-21apt-get09:20:061
37726994339,3cyclictest313620-21kworker/u8:2+events_unbound11:55:250
37726994338,3cyclictest209365-21kworker/u8:4+flush-8:011:00:260
37726994333,8cyclictest73464-21ntpq07:40:200
37726994333,7cyclictest224011-21latency_hist10:15:010
37729994236,4cyclictest2878278-21kworker/u8:2+flush-8:008:25:261
37729994235,5cyclictest209365-21kworker/u8:4+flush-8:011:00:231
37729994234,6cyclictest104090-21apt-get08:15:011
37729994234,5cyclictest169208-21latency_hist09:20:011
37726994237,4cyclictest3400174-21kworker/u8:3+flush-8:008:05:270
37726994237,4cyclictest298168-21kworker/u8:1+flush-8:011:30:280
37726994236,4cyclictest184007-21apt-get09:35:010
37729994136,4cyclictest129717-21kworker/u8:0+events_unbound09:00:141
37729994134,5cyclictest2878278-21kworker/u8:2+flush-8:008:40:251
37726994137,3cyclictest324038-21kworker/u8:0+flush-8:012:35:300
37726994136,3cyclictest313620-21kworker/u8:2+flush-8:011:50:250
37726994135,4cyclictest2878278-21kworker/u8:2+flush-8:008:10:150
37726994131,8cyclictest262755-21ntpq10:50:230
2617472410,5sleep10-21swapper/110:50:201
37729994035,4cyclictest129717-21kworker/u8:0+flush-8:008:45:201
37729994031,7cyclictest1704890-21systemd-journal11:45:001
37726994036,3cyclictest2878278-21kworker/u8:2+flush-8:008:40:270
37726994034,4cyclictest324038-21kworker/u8:0+flush-8:012:05:280
37726994033,4cyclictest149290-21kworker/u8:1+flush-8:009:44:550
37729993933,5cyclictest209365-21kworker/u8:4+flush-8:011:10:241
37729993931,6cyclictest164446-21kworker/u8:3+flush-8:010:30:311
37726993933,4cyclictest218172-21kworker/u8:1+events_unbound10:25:190
37732993829,7cyclictest1704890-21systemd-journal08:40:002
37729993834,3cyclictest209365-21kworker/u8:4+events_unbound11:48:391
37729993834,3cyclictest194593-21kworker/u8:2+events_unbound09:45:251
37729993833,4cyclictest2878278-21kworker/u8:2+events_unbound07:55:191
37729993832,5cyclictest149290-21kworker/u8:1+flush-8:009:40:221
37726993833,3cyclictest108926-21kworker/u8:1+flush-8:008:35:260
37729993732,4cyclictest298168-21kworker/u8:1+flush-8:012:20:211
37726993732,4cyclictest164446-21kworker/u8:3+flush-8:010:00:260
37726993731,4cyclictest164446-21kworker/u8:3+flush-8:009:20:210
3126722370,6sleep3451irq_work/311:40:233
37729993632,3cyclictest298168-21kworker/u8:1+flush-8:012:00:261
37729993631,4cyclictest3400174-21kworker/u8:3+flush-8:007:20:131
37729993630,4cyclictest5614-21kworker/u8:0+flush-8:007:50:241
37729993630,4cyclictest243633-21kworker/u8:0+events_unbound10:40:281
37726993632,3cyclictest3400174-21kworker/u8:3+events_unbound07:20:270
37726993632,3cyclictest298168-21kworker/u8:1+events_unbound12:00:270
37726993531,3cyclictest2878278-21kworker/u8:2+flush-8:008:25:310
37726993531,3cyclictest243633-21kworker/u8:0+events_unbound10:40:260
37726993531,3cyclictest218172-21kworker/u8:1+flush-8:010:55:270
37726993527,6cyclictest243633-21kworker/u8:0+flush-8:011:15:220
37726993525,3cyclictest129717-21kworker/u8:0+events_unbound09:05:250
37729993430,3cyclictest298168-21kworker/u8:1+flush-8:011:35:161
37729993428,4cyclictest334049-21apt-get12:05:071
37726993429,3cyclictest2878278-21kworker/u8:2+events_unbound09:25:180
37726993428,4cyclictest129717-21kworker/u8:0+flush-8:009:00:100
37729993328,4cyclictest313620-21kworker/u8:2+flush-8:012:25:231
37729993328,3cyclictest2878278-21kworker/u8:2+events_unbound09:10:191
37729993328,3cyclictest129717-21kworker/u8:0+events_unbound08:50:271
37729993328,3cyclictest108926-21kworker/u8:1+flush-8:008:35:101
37726993329,3cyclictest209365-21kworker/u8:4+events_unbound10:05:220
37726993329,3cyclictest209365-21kworker/u8:4+events_unbound10:05:210
37729993228,3cyclictest209365-21kworker/u8:4+flush-8:011:05:241
37729993228,3cyclictest164446-21kworker/u8:3+flush-8:009:35:311
37729993228,3cyclictest164446-21kworker/u8:3+events_unbound10:10:241
37729993228,3cyclictest108926-21kworker/u8:1+events_unbound08:20:191
37729993227,3cyclictest243633-21kworker/u8:0+flush-8:011:15:231
37726993229,2cyclictest89219-21cron08:00:000
37726993228,3cyclictest5614-21kworker/u8:0+flush-8:007:45:320
37726993228,3cyclictest324038-21kworker/u8:0+flush-8:012:30:310
37726993228,3cyclictest164446-21kworker/u8:3+flush-8:009:50:160
37726993226,4cyclictest324038-21kworker/u8:0+flush-8:012:25:110
37726993225,5cyclictest228028-21ntpq10:15:210
37726993127,3cyclictest3400174-21kworker/u8:3+events_unbound07:30:260
37726993127,2cyclictest352630-21needreboot12:20:190
37726993126,4cyclictest194593-21kworker/u8:2+events_unbound09:55:120
37726993126,3cyclictest2878278-21kworker/u8:2+flush-8:009:10:240
37726993126,3cyclictest218172-21kworker/u8:1+flush-8:010:45:250
37726993125,4cyclictest108926-21kworker/u8:1+events_unbound08:20:120
37726993124,5cyclictest164446-21kworker/u8:3+flush-8:010:30:270
37726993124,5cyclictest164446-21kworker/u8:3+flush-8:009:35:100
37729993026,3cyclictest243633-21kworker/u8:0+events_unbound11:25:261
37729993024,4cyclictest2878278-21kworker/u8:2+events_unbound08:55:291
37726993026,3cyclictest5614-21kworker/u8:0+flush-8:007:50:260
37732992925,2cyclictest79672-21aten2_r5power_e07:50:112
37726992925,3cyclictest2878278-21kworker/u8:2+flush-8:008:55:260
37732992824,2cyclictest284067-21cpuspeed_turbos11:15:112
37732992819,7cyclictest1704890-21systemd-journal12:25:392
37732992819,7cyclictest1704890-21systemd-journal12:10:402
37726992824,3cyclictest5614-21kworker/u8:0+flush-8:007:35:310
37726992823,4cyclictest2878278-21kworker/u8:2+events_unbound08:00:300
37726992819,7cyclictest338933-21/usr/sbin/munin12:10:270
37726992722,3cyclictest218172-21kworker/u8:1+events_unbound10:35:290
37732992623,2cyclictest273941-21aten2_r5power_e11:05:112
37732992623,2cyclictest229309-21aten2_r5power_e10:20:112
37732992622,2cyclictest84580-21aten2_r5power_c07:55:092
37732992622,2cyclictest278955-21aten2_r5power_v11:10:122
37732992622,2cyclictest194536-21aten2_r5power_e09:45:092
37732992621,3cyclictest314071-21cpuspeed_turbos11:45:122
37732992620,4cyclictest118827-21unixbench_singl08:25:312
37732992618,6cyclictest104341-21gpgv08:15:012
37729992622,3cyclictest108926-21kworker/u8:1+events_unbound08:32:381
37726992622,3cyclictest2878278-21kworker/u8:2+events_unbound07:10:280
37726992622,3cyclictest2878278-21kworker/u8:2+events_unbound07:10:270
374502262,6sleep00-21swapper/007:08:310
374502262,6sleep00-21swapper/007:08:310
2370782260,5sleep3451irq_work/310:25:183
37732992521,2cyclictest199517-21aten2_r5power_e09:50:112
37732992519,4cyclictest1704890-21systemd-journal12:25:002
37732992517,5cyclictest1704890-21systemd-journal11:00:012
37726992517,6cyclictest139670-21aten2_r5power_c08:50:110
37732992421,2cyclictest258340-21unixbench_singl10:45:292
37732992421,2cyclictest213642-21unixbench_multi10:00:282
37732992420,2cyclictest179411-21aten2_r5power_p09:30:112
37729992420,2cyclictest0-21swapper/110:05:141
37729992420,2cyclictest0-21swapper/110:05:141
3772699248,8cyclictest0-21swapper/011:20:120
37732992319,2cyclictest69940-21cpuspeed_turbos07:40:102
37732992319,2cyclictest273209-21unixbench_singl11:00:292
37732992319,2cyclictest224355-21aten2_r5power_p10:15:102
37732992319,2cyclictest0-21swapper/211:40:002
37732992319,2cyclictest0-21swapper/209:00:012
37732992319,2cyclictest0-21swapper/207:25:012
37732992318,3cyclictest1704890-21systemd-journal10:14:592
37729992319,2cyclictest0-21swapper/110:25:151
37732992218,2cyclictest174678-21fschecks_count09:25:122
37732992218,2cyclictest139726-21aten2_r5power_p08:50:102
3773299220,11cyclictest653572irqcore07:35:162
37726992216,4cyclictest0-21swapper/010:20:190
2054132220,4sleep375-21kworker/3:1-events09:55:163
3773299216,2cyclictest1535022mailstats09:00:272
37732992118,2cyclictest184847-21fschecks_time09:35:132
37732992118,2cyclictest169563-21aten2_r5power_p09:20:102
37732992117,2cyclictest129805-21aten2_r5power_e08:40:102
37732992117,2cyclictest0-21swapper/209:55:152
37732992117,2cyclictest0-21swapper/208:00:282
37732992117,2cyclictest0-21swapper/207:25:162
373292214,10sleep10-21swapper/107:06:551
373292214,10sleep10-21swapper/107:06:551
3773299204,3cyclictest1646902tr09:15:122
37732992016,2cyclictest0-21swapper/211:25:252
37732992016,2cyclictest0-21swapper/208:05:242
37732992012,6cyclictest368132-21sshd12:36:022
37732991916,2cyclictest324285-21cpuspeed_turbos11:55:112
37732991916,2cyclictest0-21swapper/212:05:172
37732991915,3cyclictest214383-21aten2_r5power_c10:05:082
37732991915,3cyclictest214383-21aten2_r5power_c10:05:082
37732991915,2cyclictest124029-21unixbench_multi08:30:282
37732991915,2cyclictest0-21swapper/210:50:252
37732991911,6cyclictest109606-21cut08:20:102
37732991910,7cyclictest78194-21tr07:45:182
375612194,9sleep20-21swapper/207:09:572
375612194,9sleep20-21swapper/207:09:562
371612193,8sleep30-21swapper/307:05:283
371612193,8sleep30-21swapper/307:05:273
3773299182,4cyclictest0-21swapper/212:00:142
37732991814,2cyclictest0-21swapper/209:05:232
37732991814,2cyclictest0-21swapper/207:15:032
3773299172,11cyclictest193303-21ntpq09:40:212
37732991713,2cyclictest0-21swapper/212:15:202
37732991713,2cyclictest0-21swapper/210:35:222
37732991712,4cyclictest109285-21idleruntime-cro08:20:002
37732991711,4cyclictest0-21swapper/210:40:202
37732991711,4cyclictest0-21swapper/208:45:192
1095402178,5sleep30-21swapper/308:20:083
442522167,5sleep30-21swapper/307:15:033
3773299167,7cyclictest62643-21tr07:30:202
3773299167,2cyclictest0-21swapper/209:10:122
37732991613,2cyclictest0-21swapper/212:30:292
37732991613,2cyclictest0-21swapper/207:11:302
37732991613,2cyclictest0-21swapper/207:11:292
37732991612,2cyclictest0-21swapper/211:40:142
3604962160,7sleep3451irq_work/312:30:193
1631762166,6sleep30-21swapper/309:10:213
3648592142,7sleep30-21swapper/312:35:183
991822132,6sleep30-21swapper/308:10:023
664552133,6sleep30-21swapper/307:35:193
3485032133,6sleep30-21swapper/312:18:403
3345492132,7sleep30-21swapper/312:05:163
3290222132,6sleep30-21swapper/312:00:023
3046232132,7sleep30-21swapper/311:35:173
2946952133,6sleep30-21swapper/311:25:193
2140812132,7sleep30-21swapper/310:04:593
2041452132,6sleep30-21swapper/309:55:013
1577852133,6sleep30-21swapper/309:05:203
1513112132,7sleep30-21swapper/309:00:193
1245942132,6sleep30-21swapper/308:35:013
944332122,6sleep30-21swapper/308:05:073
894722122,6sleep30-21swapper/308:00:073
749362122,6sleep30-21swapper/307:45:133
696942122,6sleep30-21swapper/307:40:083
644092122,6sleep30-21swapper/307:34:373
552972123,5sleep30-21swapper/307:25:153
536372122,6sleep30-21swapper/307:20:263
417182122,6sleep30-21swapper/307:10:223
417182122,6sleep30-21swapper/307:10:213
3560392122,6sleep30-21swapper/312:25:183
3387252122,5sleep30-21swapper/312:10:013
3240342122,6sleep30-21swapper/311:55:043
3191992122,6sleep30-21swapper/311:50:143
2785992122,5sleep30-21swapper/311:10:023
2727842122,6sleep30-21swapper/311:00:273
2439082122,6sleep30-21swapper/310:35:023
2399802122,6sleep30-21swapper/310:30:203
2202072122,6sleep30-21swapper/310:10:183
2147242122,6sleep30-21swapper/310:05:123
2147242122,6sleep30-21swapper/310:05:113
1894922122,6sleep30-21swapper/309:40:083
1858442122,6sleep30-21swapper/309:35:183
1691872122,5sleep30-21swapper/309:20:013
1485932122,6sleep30-21swapper/308:55:283
1413622122,6sleep30-21swapper/308:50:193
1344632122,5sleep30-21swapper/308:45:023
1333552122,6sleep30-21swapper/308:40:193
1192102122,6sleep30-21swapper/308:30:013
848482112,5sleep30-21swapper/307:55:133
796182112,5sleep30-21swapper/307:50:113
3535632112,5sleep30-21swapper/312:24:263
3183802112,6sleep30-21swapper/311:47:423
2988662111,6sleep30-21swapper/311:30:123
2893212112,5sleep30-21swapper/311:20:163
2838522112,5sleep30-21swapper/311:15:113
2739702112,6sleep30-21swapper/311:05:113
2635112112,6sleep30-21swapper/310:52:353
2572842112,5sleep30-21swapper/310:45:213
2278182112,5sleep30-21swapper/310:15:193
1942462112,5sleep30-21swapper/309:45:013
1792982112,6sleep30-21swapper/309:30:083
1790522112,5sleep30-21swapper/309:30:013
1645082112,5sleep30-21swapper/309:15:113
1196902112,5sleep30-21swapper/308:30:093
1045572112,5sleep30-21swapper/308:15:083
2639372102,5sleep30-21swapper/310:55:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional