You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 16:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Sun Jul 12, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
279443123260,3sleep3451irq_work/310:00:133
262189299167162,3cyclictest2947692-21latency_hist12:35:011
2621889996245,15cyclictest2947542-21apt-get12:35:010
27721882580,6chrt451irq_work/309:35:163
27577452560,2chrt481ktimers/309:20:243
26881022500,1sleep02688105-21switchtime08:10:220
2621892995040,7cyclictest2713622-21latency_hist08:40:001
2621889995041,6cyclictest2818607-21kworker/u8:1+flush-8:012:10:160
2621892994839,6cyclictest2793211-21latency_hist10:00:001
2621889994740,5cyclictest2813001-21kworker/u8:4+flush-8:010:20:000
2621892994637,6cyclictest2932535-21latency_hist12:20:011
2621889994640,4cyclictest2607384-21kworker/u8:2+flush-8:007:40:160
2621889994536,6cyclictest2827257-21ntpq10:30:130
29080242440,5sleep20-21swapper/211:55:042
2621892994334,7cyclictest2941517-21ntpq12:25:151
2621889994333,7cyclictest1704890-21systemd-journal09:10:000
2621892994233,7cyclictest2748350-21/usr/sbin/munin09:15:141
2621892994233,6cyclictest2897869-21latency_hist11:45:021
2621892994232,8cyclictest2732509-21ntpq08:55:171
2621892994232,8cyclictest2732509-21ntpq08:55:161
2621889994235,5cyclictest2708156-21kworker/u8:3+flush-8:009:10:080
28994722410,2sleep3471rcuc/311:45:113
2621892994134,5cyclictest2747366-21ntpq09:10:151
2621889994135,4cyclictest2762392-21kworker/u8:2+flush-8:009:30:230
2621889994135,4cyclictest2579504-21kworker/u8:1+flush-8:008:25:070
2621889994134,5cyclictest2663530-21kworker/u8:3+flush-8:007:55:160
2621889994131,8cyclictest2642808-21ntpq07:25:150
2621892994036,3cyclictest2762283-21ntpq09:25:171
2621892994031,7cyclictest2912982-21apt-get12:00:021
2621892994031,6cyclictest1704890-21systemd-journal07:16:351
2621892994028,9cyclictest1704890-21systemd-journal10:13:441
2621892994026,10cyclictest1704890-21systemd-journal10:15:431
2621889994035,4cyclictest2607384-21kworker/u8:2+flush-8:007:50:160
2621889994034,4cyclictest2788197-21latency_hist09:55:010
2621889994015,9cyclictest2916793-21ntpq12:00:160
2621889993934,3cyclictest2743360-21kworker/u8:1+flush-8:009:25:060
2621889993933,4cyclictest2752394-21kworker/u8:0+flush-8:010:20:210
2621889993931,6cyclictest2707686-21ntpq08:30:160
2621889993931,5cyclictest2853498-21kworker/u8:2+flush-8:011:05:060
2621889993832,4cyclictest2773264-21kworker/u8:3+events_unbound09:45:210
2621889993826,8cyclictest2788217-21kworker/u8:2+flush-8:010:10:050
29431942370,3sleep375-21kworker/3:1+events12:30:083
2621892993728,7cyclictest2773117-21apt-get09:40:011
2621892993727,7cyclictest1704890-21systemd-journal11:54:431
2621889993732,3cyclictest2818607-21kworker/u8:1+flush-8:011:45:060
2621889993731,4cyclictest2752394-21kworker/u8:0+flush-8:009:35:220
2621889993731,4cyclictest2679273-21kworker/u8:0+events_unbound08:40:210
26216802373,9sleep10-21swapper/107:09:521
2621894993627,7cyclictest2947412-21apt-get12:35:032
2621892993629,5cyclictest2639110-21apt-get07:25:031
2621894993529,3cyclictest2743360-21kworker/u8:1+flush-8:010:00:042
2621892993524,8cyclictest1704890-21systemd-journal11:17:441
2621889993529,4cyclictest2679273-21kworker/u8:0+flush-8:008:20:160
2621889993528,5cyclictest2878026-21kworker/u8:0+flush-8:012:25:060
262188999351,31cyclictest2803355-21true10:10:010
2621892993430,2cyclictest2874042-21irqrtprio11:20:101
2621889993430,3cyclictest2863649-21kworker/u8:3+flush-8:011:25:230
2621889993430,3cyclictest2663530-21kworker/u8:3+flush-8:007:45:350
2621889993429,3cyclictest2607384-21kworker/u8:2+flush-8:008:00:170
2621889993425,7cyclictest2633649-21apt-get07:20:020
2621894993323,8cyclictest2633649-21apt-get07:20:002
2621894993322,9cyclictest2868660-21fschecks_count11:15:072
2621892993325,6cyclictest1704890-21systemd-journal07:31:351
2621889993328,3cyclictest2853498-21kworker/u8:2+events_unbound11:20:160
2621889993328,3cyclictest2752394-21kworker/u8:0+events_unbound10:35:100
2621889993326,5cyclictest2887006-21kworker/u8:2+flush-8:011:50:060
2621889993326,5cyclictest2752394-21kworker/u8:0+flush-8:011:00:180
2621889993326,5cyclictest2579504-21kworker/u8:1+flush-8:007:10:180
2621889993324,7cyclictest2634405-21diskstats07:20:090
26210322333,6sleep20-21swapper/207:05:232
2621894993225,5cyclictest2947406-21latency_hist12:35:012
2621894993223,7cyclictest2803939-21fschecks_time10:10:092
2621889993226,4cyclictest2679273-21kworker/u8:0+events_unbound08:45:180
2621889993225,5cyclictest2773264-21kworker/u8:3+flush-8:009:40:180
2621889993222,8cyclictest1704890-21systemd-journal12:40:000
2621889993220,10cyclictest2863649-21kworker/u8:3+flush-8:011:30:090
2621889993220,10cyclictest2863649-21kworker/u8:3+flush-8:011:30:080
27212932310,3sleep375-21kworker/3:1+events08:45:113
2621892993124,5cyclictest2649169-21apt-get07:35:031
2621889993125,5cyclictest2621730-21kworker/u8:0+events_unbound07:30:200
2621889993122,7cyclictest2852026-21ntpq10:55:170
2621889993120,9cyclictest2689248-21diskstats08:15:070
2621894993025,4cyclictest2818607-21kworker/u8:1+flush-8:010:25:092
2621894993025,4cyclictest2743360-21kworker/u8:1+flush-8:009:15:162
2621889993024,5cyclictest2798013-21kworker/u8:3+flush-8:010:45:150
2621889993024,4cyclictest2693790-21kworker/u8:2+flush-8:008:35:100
2621889993022,6cyclictest2912720-21latency_hist12:00:020
2621889993021,7cyclictest2753288-21latency_hist09:20:020
2621894992924,4cyclictest2863649-21kworker/u8:3+events_unbound11:10:172
2621894992924,3cyclictest2723811-21aten2_r5power_c08:50:042
2621894992921,6cyclictest2643766-21sh07:30:012
2621894992920,6cyclictest2664357-21cpuspeed_turbos07:50:042
2621892992922,5cyclictest2579504-21kworker/u8:1+events_unbound07:20:191
2621892992921,6cyclictest2818532-21/usr/sbin/munin10:25:161
2621889992925,3cyclictest2752394-21kworker/u8:0+events_unbound10:00:250
2621889992925,3cyclictest2708156-21kworker/u8:3+events_unbound08:55:220
2621889992925,3cyclictest2708156-21kworker/u8:3+events_unbound08:55:210
2621889992924,4cyclictest2921752-21kworker/u8:3+flush-8:012:15:070
2621889992924,3cyclictest2847033-21needreboot10:50:150
2621889992922,5cyclictest2872614-21unixbench_multi11:15:220
2621889992922,5cyclictest2818607-21kworker/u8:1+events_unbound11:40:170
2621889992922,5cyclictest2743360-21kworker/u8:1+flush-8:009:20:170
2621894992823,3cyclictest2674367-21fschecks_count08:00:082
2621894992822,4cyclictest2878550-21fschecks_count11:25:072
2621894992822,4cyclictest2714238-21fschecks_time08:40:062
2621894992822,4cyclictest2679273-21kworker/u8:0+events_unbound08:15:002
2621892992824,2cyclictest0-21swapper/107:15:011
2621892992820,6cyclictest2842124-21ntpq10:45:141
2621892992817,8cyclictest1704890-21systemd-journal09:33:391
2621889992822,4cyclictest2887006-21kworker/u8:2+events_unbound12:05:050
2621889992822,4cyclictest2793320-21cp10:00:000
2621889992822,4cyclictest2653906-21awk07:40:010
2621889992819,7cyclictest1704890-21systemd-journal10:45:000
262188999281,26cyclictest2738438-21kworker/0:2+events11:35:150
29396682270,5sleep3451irq_work/312:25:113
2621894992723,3cyclictest2621730-21kworker/u8:0+events_unbound07:20:202
2621894992723,2cyclictest2823779-21fschecks_count10:30:052
2621894992722,3cyclictest2893468-21fschecks_count11:40:072
2621894992722,3cyclictest2773914-21fschecks_count09:40:082
2621894992722,3cyclictest2654528-21fschecks_time07:40:072
2621894992721,4cyclictest2887501-21unixbench_singl11:30:222
2621894992721,4cyclictest2887501-21unixbench_singl11:30:222
2621894992721,4cyclictest2843558-21cpuspeed_turbos10:50:052
2621894992721,4cyclictest2787734-21unixbench_multi09:50:222
2621894992719,6cyclictest2928111-21fschecks_count12:15:072
2621892992723,3cyclictest2899036-21kthreadcore11:45:101
2621892992722,3cyclictest2674076-21apt-get08:00:031
2621892992719,5cyclictest2778332-21latency_hist09:45:011
2621889992722,4cyclictest2708156-21kworker/u8:3+flush-8:009:00:130
2621889992721,4cyclictest2679273-21kworker/u8:0+events_unbound08:50:180
2621894992622,3cyclictest2934184-21kworker/u8:2+flush-8:012:20:212
2621894992622,2cyclictest2923249-21fschecks_time12:10:072
2621894992622,2cyclictest2888238-21aten2_r5power_e11:35:052
2621894992621,4cyclictest2679273-21kworker/u8:0+events_unbound08:05:222
2621894992621,3cyclictest2729090-21fschecks_time08:55:072
2621894992621,3cyclictest2729090-21fschecks_time08:55:072
2621894992620,4cyclictest2913297-21fschecks_time12:00:072
2621894992620,4cyclictest2734306-21irqcore09:00:112
2621894992620,4cyclictest2719112-21fschecks_count08:45:062
2621894992620,4cyclictest2709240-21fschecks_time08:35:082
2621894992618,6cyclictest2646166-21kthreadcore07:30:122
2621892992622,2cyclictest2855667-21kthreadcore11:00:161
2621892992622,2cyclictest2823803-21cut10:30:041
2621892992621,3cyclictest2803340-21basename10:10:011
2621892992621,3cyclictest0-21swapper/109:55:011
2621892992617,7cyclictest2738629-21/usr/sbin/munin09:05:161
2621889992620,4cyclictest2853498-21kworker/u8:2+events_unbound11:10:050
29504302250,5sleep3451irq_work/312:35:113
2621894992520,3cyclictest2753821-21fschecks_count09:20:082
2621894992516,7cyclictest2833769-21fschecks_time10:40:082
2621894992514,9cyclictest2663897-21awk07:50:012
2621894992514,9cyclictest1704890-21systemd-journal12:26:422
2621892992521,2cyclictest885-21mta-sts-daemon07:40:081
2621892992521,2cyclictest2704216-21cut08:30:081
2621892992521,2cyclictest0-21swapper/108:05:091
2621892992520,3cyclictest2833228-21systemd-run10:40:011
2621892992520,3cyclictest0-21swapper/109:50:011
2621892992520,2cyclictest0-21swapper/110:00:011
2621892992519,4cyclictest0-21swapper/107:50:131
2621892992518,5cyclictest2848501-21cpuspeed_turbos10:55:071
26532592240,6sleep3451irq_work/307:35:243
262189499242,7cyclictest0-21swapper/211:50:052
2621894992420,2cyclictest2669332-21cpuspeed_turbos07:55:062
2621894992419,4cyclictest2818607-21kworker/u8:1+flush-8:010:35:302
2621894992419,3cyclictest2918293-21fschecks_time12:05:082
2621894992419,3cyclictest2699378-21fschecks_time08:25:062
2621894992417,6cyclictest2769355-21kthreadcore09:35:112
2621892992421,2cyclictest2912724-21munin-plugin-st12:00:011
2621892992420,2cyclictest2723601-21latency_hist08:50:011
2621892992419,3cyclictest1-21systemd08:25:001
2621892992419,3cyclictest0-21swapper/112:25:001
2621892992414,3cyclictest421rcuog/210:20:111
2621889992419,3cyclictest0-21swapper/010:25:120
2621894992318,4cyclictest2679273-21kworker/u8:0+events_unbound08:15:052
2621894992318,3cyclictest2694373-21fschecks_time08:20:072
2621892992318,3cyclictest0-21swapper/109:25:021
2621892992318,2cyclictest0-21swapper/108:50:021
2621892992316,5cyclictest2679273-21kworker/u8:0+flush-8:008:15:141
2621892992316,3cyclictest0-21swapper/110:40:041
2621892992313,7cyclictest2927594-21latency_hist12:15:011
2621894992218,3cyclictest2788217-21kworker/u8:2+flush-8:010:05:242
2621894992217,4cyclictest2762392-21kworker/u8:2+flush-8:009:30:152
2621894992217,3cyclictest0-21swapper/211:00:012
2621894992217,3cyclictest0-21swapper/210:00:012
2621892992218,2cyclictest882-21mta-sts-daemon08:25:121
2621892992218,2cyclictest0-21swapper/112:05:141
2621892992218,2cyclictest0-21swapper/110:50:051
2621892992217,3cyclictest2867683-21unixbench_multi11:10:231
2621892992217,3cyclictest0-21swapper/111:05:101
2621889992216,3cyclictest0-21swapper/008:05:160
2621894992117,3cyclictest2743360-21kworker/u8:1+flush-8:009:45:122
2621894992117,2cyclictest0-21swapper/211:05:212
2621894992117,2cyclictest0-21swapper/207:15:022
2621894992116,3cyclictest0-21swapper/209:25:242
262189299214,2cyclictest26881052switchtime08:10:221
2621892992117,2cyclictest2714608-21irqrtprio08:40:091
2621892992117,2cyclictest0-21swapper/107:55:081
2621892992117,2cyclictest0-21swapper/107:45:221
2621892992116,3cyclictest0-21swapper/111:30:041
2621892992116,3cyclictest0-21swapper/111:30:031
2621892992111,8cyclictest2882034-21ntpq11:25:171
2621889992116,4cyclictest2936531-21ntp_kernel_err12:20:140
2621894992012,6cyclictest0-21swapper/210:25:002
2621894992010,8cyclictest2855312-21tr11:00:152
2621892992014,4cyclictest0-21swapper/111:35:051
2621892992014,4cyclictest0-21swapper/109:00:061
262189499197,4cyclictest0-21swapper/207:35:042
2621894991916,2cyclictest2898172-21aten2_r5power_e11:45:042
2621894991915,2cyclictest0-21swapper/208:35:012
2621894991910,7cyclictest2741727-21tr09:05:152
2621892991911,6cyclictest2948303-21awk12:35:061
2621894991813,3cyclictest0-21swapper/210:45:052
26215522182,10sleep00-21swapper/007:08:140
26208592183,8sleep30-21swapper/307:05:193
262189499172,2cyclictest0-21swapper/211:20:042
262189499169,5cyclictest2744426-21sed09:10:102
2621894991613,2cyclictest2808533-21aten2_r5power_c10:15:032
27775172140,10sleep30-21swapper/309:40:233
28529742131,7sleep30-21swapper/311:00:003
27833312132,6sleep30-21swapper/309:50:013
27822962132,7sleep30-21swapper/309:45:163
27596272132,7sleep30-21swapper/309:25:143
29317722122,6sleep30-21swapper/312:15:223
29231482122,6sleep30-21swapper/312:10:073
29177142122,6sleep30-21swapper/312:05:023
28963502122,6sleep30-21swapper/311:40:133
28920402122,6sleep30-21swapper/311:35:213
28821532122,6sleep30-21swapper/311:25:203
28738242122,6sleep30-21swapper/311:20:123
28688422122,6sleep30-21swapper/311:15:103
28672822122,6sleep30-21swapper/311:10:193
28589422122,6sleep30-21swapper/311:05:113
28437642122,6sleep30-21swapper/310:50:093
28421232122,6sleep30-21swapper/310:45:163
28334272122,5sleep30-21swapper/310:40:033
28139002122,6sleep30-21swapper/310:20:073
28084662122,5sleep30-21swapper/310:15:023
28072152122,6sleep30-21swapper/310:10:173
27887122122,6sleep30-21swapper/309:55:083
27425812122,6sleep30-21swapper/309:05:243
27340962122,6sleep30-21swapper/309:00:103
27237532122,6sleep30-21swapper/308:50:033
26990002122,5sleep30-21swapper/308:25:023
26844932122,6sleep30-21swapper/308:10:093
26772422122,6sleep30-21swapper/308:00:153
26694712122,6sleep30-21swapper/307:55:083
26630702122,6sleep30-21swapper/307:45:223
26579542122,6sleep30-21swapper/307:40:153
26444422122,6sleep30-21swapper/307:30:093
26436872122,6sleep30-21swapper/307:29:083
26341562121,7sleep30-21swapper/307:20:043
26223972122,6sleep30-21swapper/307:10:103
29330502112,5sleep30-21swapper/312:20:073
29129862112,6sleep30-21swapper/312:00:053
29085072112,5sleep30-21swapper/311:55:103
29030512112,5sleep30-21swapper/311:50:053
28878772112,6sleep30-21swapper/311:34:363
28878772112,6sleep30-21swapper/311:34:353
28535842112,5sleep30-21swapper/311:00:093
28289592112,5sleep30-21swapper/310:35:123
28235192112,5sleep30-21swapper/310:30:033
28183292112,5sleep30-21swapper/310:25:023
28008212112,5sleep30-21swapper/310:05:143
27671832112,5sleep30-21swapper/309:30:153
27485752112,5sleep30-21swapper/309:15:023
27435962112,5sleep30-21swapper/309:10:043
27289892112,5sleep30-21swapper/308:55:083
27289892112,5sleep30-21swapper/308:55:073
27177482112,5sleep30-21swapper/308:40:203
27087172112,5sleep30-21swapper/308:35:023
26987402112,6sleep30-21swapper/308:24:433
26889702112,5sleep30-21swapper/308:15:033
26793802112,5sleep30-21swapper/308:05:083
26678562112,5sleep30-21swapper/307:50:143
26270552112,5sleep30-21swapper/307:15:043
27042022101,5sleep30-21swapper/308:30:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional