You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 22:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Mon Jul 13, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5683352670,2sleep2371rcuc/221:30:122
5043152470,2chrt371rcuc/220:25:242
423235994642,3cyclictest629228-21kworker/u8:0+events_unbound22:50:201
423235994642,3cyclictest408657-21kworker/u8:2+events_unbound19:40:211
423235994642,3cyclictest408657-21kworker/u8:2+events_unbound00:00:231
423235994635,4cyclictest583524-21ntpq21:45:161
423231994641,3cyclictest408657-21kworker/u8:2+flush-8:019:15:050
423235994440,3cyclictest71236-21kworker/u8:1+events_unbound20:45:061
423235994440,3cyclictest629228-21kworker/u8:0+events_unbound23:30:201
423235994440,3cyclictest408657-21kworker/u8:2+events_unbound22:30:181
423235994440,3cyclictest408657-21kworker/u8:2+events_unbound21:55:191
423235994438,4cyclictest614161-21apt-get22:20:021
423235994432,5cyclictest682835-21ntpq23:25:151
423240994334,7cyclictest1704890-21systemd-journal23:40:002
423235994339,3cyclictest408657-21kworker/u8:2+events_unbound23:10:081
423235994339,3cyclictest408657-21kworker/u8:2+events_unbound21:30:051
423235994239,2cyclictest629228-21kworker/u8:0+events_unbound22:35:221
423235994238,3cyclictest408657-21kworker/u8:2+events_unbound23:15:231
423235994238,3cyclictest369911-21kworker/u8:0+events_unbound21:25:031
423235994233,5cyclictest0-21swapper/121:05:011
423235994232,8cyclictest623396-21ntpq22:25:181
423235994231,9cyclictest434161-21ntpq19:15:201
423235994138,2cyclictest599270-21kworker/u8:3+events_unbound00:00:001
423235994137,3cyclictest408657-21kworker/u8:2+events_unbound22:10:241
423235994137,3cyclictest408657-21kworker/u8:2+events_unbound19:35:211
423235994036,3cyclictest71236-21kworker/u8:1+events_unbound19:46:121
423235994036,3cyclictest688336-21kworker/u8:1+events_unbound23:40:071
423235994036,3cyclictest688336-21kworker/u8:1+events_unbound23:40:061
423235994036,3cyclictest408657-21kworker/u8:2+events_unbound21:15:101
423235994036,3cyclictest408657-21kworker/u8:2+events_unbound20:29:591
423231994035,4cyclictest569516-21kworker/u8:1+events_unbound21:35:210
423240993932,4cyclictest614161-21apt-get22:20:002
423235993936,2cyclictest569516-21kworker/u8:1+events_unbound21:50:051
423235993935,3cyclictest71236-21kworker/u8:1+events_unbound20:10:211
423235993935,3cyclictest71236-21kworker/u8:1+events_unbound20:10:211
423235993935,3cyclictest71236-21kworker/u8:1+events_unbound19:50:051
423235993935,3cyclictest71236-21kworker/u8:1+events_unbound19:50:041
423235993935,3cyclictest408657-21kworker/u8:2+events_unbound20:00:581
423235993935,3cyclictest369911-21kworker/u8:0+events_unbound20:55:211
423231993932,5cyclictest1704890-21systemd-journal19:25:000
423235993835,2cyclictest599270-21kworker/u8:3+events_unbound00:23:161
423235993834,3cyclictest71236-21kworker/u8:1+events_unbound20:15:051
423235993834,3cyclictest688336-21kworker/u8:1+events_unbound00:18:031
423235993834,3cyclictest599270-21kworker/u8:3+events_unbound00:26:381
423235993834,3cyclictest408657-21kworker/u8:2+events_unbound20:35:251
423235993834,3cyclictest408657-21kworker/u8:2+events_unbound00:10:031
423235993834,3cyclictest408657-21kworker/u8:2+events_unbound00:05:311
423235993834,3cyclictest369911-21kworker/u8:0+events_unbound20:06:371
423231993832,4cyclictest659006-21latency_hist23:05:010
4225672384,10sleep10-21swapper/119:05:251
423235993733,3cyclictest71236-21kworker/u8:1+events_unbound20:40:361
423235993733,3cyclictest629228-21kworker/u8:0+events_unbound22:55:201
423235993733,3cyclictest599270-21kworker/u8:3+events_unbound00:31:041
423235993733,3cyclictest569516-21kworker/u8:1+events_unbound22:15:591
423235993733,3cyclictest408657-21kworker/u8:2+events_unbound23:23:391
423235993733,3cyclictest408657-21kworker/u8:2+events_unbound22:06:281
423235993733,3cyclictest408657-21kworker/u8:2+events_unbound20:34:541
423235993733,3cyclictest369911-21kworker/u8:0+events_unbound21:10:571
423235993732,4cyclictest629228-21kworker/u8:0+events_unbound22:47:001
423235993732,4cyclictest569516-21kworker/u8:1+events_unbound21:44:371
423235993724,10cyclictest1704890-21systemd-journal23:50:001
423235993632,3cyclictest408657-21kworker/u8:2+events_unbound21:23:381
423231993632,3cyclictest629228-21kworker/u8:0+flush-8:022:40:130
423235993532,2cyclictest688336-21kworker/u8:1+events_unbound23:53:001
423235993532,2cyclictest629228-21kworker/u8:0+events_unbound22:44:001
423235993531,3cyclictest71236-21kworker/u8:1+events_unbound19:22:581
423235993531,3cyclictest629228-21kworker/u8:0+events_unbound23:00:251
423235993531,3cyclictest369911-21kworker/u8:0+events_unbound20:51:181
423231993531,3cyclictest599270-21kworker/u8:3+events_unbound00:35:100
423231993531,3cyclictest408657-21kworker/u8:2+flush-8:019:45:080
423231993524,8cyclictest1704890-21systemd-journal20:05:000
423235993430,3cyclictest569516-21kworker/u8:1+events_unbound22:00:081
423235993430,3cyclictest369911-21kworker/u8:0+events_unbound19:12:001
423235993429,4cyclictest688336-21kworker/u8:1+events_unbound00:35:091
423231993429,3cyclictest614164-21awk22:19:590
423231993428,4cyclictest71236-21kworker/u8:1+flush-8:019:55:080
423231993427,5cyclictest702601-21ntpq23:45:150
423231993422,9cyclictest1704890-21systemd-journal20:50:010
423235993329,3cyclictest408657-21kworker/u8:2+events_unbound20:21:291
423231993323,8cyclictest1704890-21systemd-journal19:31:590
423235993229,2cyclictest688336-21kworker/u8:1+events_unbound23:35:241
423235993228,3cyclictest71236-21kworker/u8:1+events_unbound19:31:331
423235993228,3cyclictest71236-21kworker/u8:1+events_unbound19:26:111
423235993227,4cyclictest71236-21kworker/u8:1+events_unbound19:55:421
423231993226,4cyclictest408657-21kworker/u8:2+flush-8:021:10:080
423231993225,5cyclictest619616-21apt-get22:25:030
423231993224,6cyclictest594324-21latency_hist22:00:000
423231993223,7cyclictest440309-21/usr/sbin/munin19:25:150
423240993125,4cyclictest579055-21unixbench_singl21:40:232
423235993127,3cyclictest569516-21kworker/u8:1+events_unbound21:37:011
423235993127,3cyclictest408657-21kworker/u8:2+events_unbound23:07:401
423235993127,3cyclictest369911-21kworker/u8:0+events_unbound21:09:001
423231993127,3cyclictest514199-21unixbench_singl20:35:240
423231993126,4cyclictest629228-21kworker/u8:0+flush-8:022:37:010
423231993126,3cyclictest369911-21kworker/u8:0+events_unbound19:10:000
423231993124,5cyclictest539368-21latency_hist21:05:020
423231993124,5cyclictest369911-21kworker/u8:0+flush-8:020:50:120
423231993122,4cyclictest369911-21kworker/u8:0+flush-8:019:10:050
4226282313,9sleep20-21swapper/219:06:112
423240993022,6cyclictest1704890-21systemd-journal22:15:002
423231993021,7cyclictest455455-21diskstats19:40:060
5234522290,2sleep3481ktimers/320:45:143
423231992921,6cyclictest1704890-21systemd-journal21:30:000
423240992824,2cyclictest538913-21unixbench_singl21:00:252
423240992821,5cyclictest1704890-21systemd-journal23:16:592
423231992824,3cyclictest713495-21idleruntime-cro00:00:010
423231992824,3cyclictest598807-21unixbench_multi22:00:230
423231992824,2cyclictest0-21swapper/022:54:590
423231992823,3cyclictest748572-21systemd-run00:35:010
423240992724,2cyclictest648648-21unixbench_multi22:50:212
423231992721,4cyclictest71236-21kworker/u8:1+events_unbound20:20:220
423231992719,5cyclictest673810-21latency_hist23:20:010
42323199271,24cyclictest693312-21sshd23:35:580
6035912260,2sleep3451irq_work/322:05:203
423240992623,2cyclictest490468-21fschecks_time20:15:082
423240992620,4cyclictest633826-21unixbench_singl22:35:232
423231992621,3cyclictest667858-21needreboot23:10:140
423231992621,3cyclictest465324-21cpuspeed_turbos19:50:030
423231992621,3cyclictest465324-21cpuspeed_turbos19:50:030
423231992620,4cyclictest880-21mta-sts-daemon19:35:060
423231992620,4cyclictest408657-21kworker/u8:2+flush-8:020:25:230
423231992620,4cyclictest401-21dbus-daemon22:35:000
423231992619,5cyclictest629228-21kworker/u8:0+events_unbound23:20:070
6805312250,6sleep3451irq_work/323:25:113
423240992521,2cyclictest450340-21aten2_r5power_v19:35:042
42323199252,20cyclictest0-21swapper/023:40:040
42323199252,20cyclictest0-21swapper/023:40:030
423231992521,3cyclictest401-21dbus-daemon21:34:520
423231992521,2cyclictest683328-21unixbench_multi23:25:230
423231992518,5cyclictest604458-21apt-get22:10:020
42323199250,23cyclictest484954-21munin-run20:10:000
42323199250,15cyclictest1-21systemd00:15:010
423240992420,3cyclictest489397-21unixbench_multi20:10:242
423240992420,3cyclictest489397-21unixbench_multi20:10:232
42323199242,21cyclictest0-21swapper/021:40:210
423231992420,3cyclictest71236-21kworker/u8:1+flush-8:020:10:080
423231992420,3cyclictest71236-21kworker/u8:1+flush-8:020:10:080
423231992420,3cyclictest569516-21kworker/u8:1+flush-8:021:50:040
423231992419,4cyclictest408657-21kworker/u8:2+flush-8:022:45:110
423231992419,3cyclictest718633-21latency_hist00:05:020
423231992418,4cyclictest509626-21anacron20:34:510
423231992417,5cyclictest408657-21kworker/u8:2+flush-8:021:45:040
42323199240,23cyclictest554353-21sshd21:18:570
7122352230,2sleep3481ktimers/323:55:123
42324099232,15cyclictest624312-21apt-get22:30:012
423240992320,2cyclictest732446-21grep00:15:162
423240992320,2cyclictest668418-21grep23:10:222
423240992320,2cyclictest589693-21aten2_r5power_e21:55:042
423240992319,2cyclictest529924-21cpuspeed_turbos20:55:052
423231992319,2cyclictest0-21swapper/000:05:260
423231992318,4cyclictest369911-21kworker/u8:0+flush-8:020:15:200
423231992318,3cyclictest619359-21cron22:25:010
423231992317,4cyclictest369911-21kworker/u8:0+flush-8:020:55:160
423231992316,1cyclictest0-21swapper/022:55:020
423240992219,2cyclictest470324-21fschecks_count19:55:062
423240992218,2cyclictest465314-21cpuspeed_turbos19:50:042
423240992218,2cyclictest465314-21cpuspeed_turbos19:50:032
423240992217,4cyclictest459502-21unixbench_singl19:40:222
423240992214,6cyclictest479891-21cp20:05:012
423231992218,3cyclictest688336-21kworker/u8:1+events_unbound00:15:130
423231992218,2cyclictest0-21swapper/021:05:020
423231992217,4cyclictest708479-21idleruntime-cro23:55:000
423231992217,3cyclictest603785-21unixbench_singl22:05:220
423231992214,6cyclictest688705-21latency_hist23:35:010
42324099212,4cyclictest0-21swapper/223:05:062
42324099211,5cyclictest742502-21memory00:25:152
423240992115,4cyclictest554951-21apt-get21:20:032
423240992115,4cyclictest523907-21timerandwakeup20:45:242
423240992113,6cyclictest1704890-21systemd-journal19:35:002
423231992117,2cyclictest0-21swapper/000:25:000
423231992115,4cyclictest408657-21kworker/u8:2+flush-8:023:05:040
423240992017,2cyclictest639664-21cpuspeed_turbos22:45:052
423240992017,2cyclictest624661-21aten2_r5power_v22:30:032
423240992016,2cyclictest0-21swapper/221:20:012
423240992015,3cyclictest0-21swapper/222:20:012
423240992014,3cyclictest0-21swapper/219:10:022
423240992012,6cyclictest1704890-21systemd-journal20:40:002
42324099200,5cyclictest747661-21ntpq00:30:182
423231992015,3cyclictest0-21swapper/021:20:160
4763512190,2sleep3481ktimers/320:00:133
42324099198,4cyclictest0-21swapper/220:52:542
42324099192,12cyclictest697713-21ntpq23:40:172
42324099192,12cyclictest697713-21ntpq23:40:172
423240991915,2cyclictest0-21swapper/223:45:052
423240991913,4cyclictest0-21swapper/221:45:102
423240991913,3cyclictest688697-21sh23:34:592
423240991912,5cyclictest483925-21grep20:05:132
423231991915,2cyclictest0-21swapper/000:25:080
423231991914,3cyclictest519548-21idleruntime-cro20:45:010
4186112193,9sleep30-21swapper/319:05:073
423240991815,2cyclictest638772-21unixbench_singl22:40:232
423240991815,2cyclictest461091-21kthreadcore19:45:102
423240991815,2cyclictest0-21swapper/219:20:232
423240991814,2cyclictest0-21swapper/222:55:132
423240991814,2cyclictest0-21swapper/222:00:102
423240991814,2cyclictest0-21swapper/200:40:012
423240991814,2cyclictest0-21swapper/200:20:222
42324099172,12cyclictest603595-21switchtime22:05:202
423240991713,2cyclictest713468-21cron00:00:002
423240991713,2cyclictest544514-21cron21:10:012
423240991713,2cyclictest509646-21sh20:35:012
423240991713,2cyclictest0-21swapper/200:10:032
423240991712,3cyclictest0-21swapper/200:10:012
423240991711,4cyclictest0-21swapper/219:15:272
423240991710,5cyclictest682584-21tr23:25:122
6185972167,5sleep30-21swapper/322:20:183
42324099167,7cyclictest440370-21cut19:25:042
42324099163,8cyclictest544782-21apt-get21:10:032
42324099163,7cyclictest677948-21ntpq23:20:192
423240991613,2cyclictest0-21swapper/223:01:462
423240991612,2cyclictest713971-21cpuspeed_turbos00:00:062
423240991612,2cyclictest0-21swapper/221:25:102
423240991611,3cyclictest0-21swapper/223:50:102
423240991610,4cyclictest0-21swapper/221:35:132
42324099152,2cyclictest0-21swapper/220:20:032
423240991512,2cyclictest515207-21fschecks_time20:40:072
5447792142,8sleep30-21swapper/321:10:043
42324099149,3cyclictest0-21swapper/221:50:112
7389092132,7sleep30-21swapper/300:25:043
6531932131,8sleep30-21swapper/322:55:183
6109962132,7sleep30-21swapper/322:15:143
5851332134,5sleep30-21swapper/321:50:083
5549542132,7sleep30-21swapper/321:20:043
4947882132,7sleep30-21swapper/320:20:003
4709202133,6sleep30-21swapper/319:55:113
4697672130,9sleep30-21swapper/319:55:003
4697672130,9sleep30-21swapper/319:55:003
7534482120,8sleep30-21swapper/300:40:013
7466112122,6sleep30-21swapper/300:30:133
7190412123,5sleep30-21swapper/300:05:093
7139982122,6sleep30-21swapper/300:00:073
7038022122,6sleep30-21swapper/323:50:043
6993912122,6sleep30-21swapper/323:45:113
6839282122,6sleep30-21swapper/323:30:013
6775802122,6sleep30-21swapper/323:20:153
6728442122,6sleep30-21swapper/323:15:163
6590372122,5sleep30-21swapper/323:05:023
6557372122,6sleep30-21swapper/323:00:123
6342752122,5sleep30-21swapper/322:40:013
6260052122,6sleep30-21swapper/322:30:113
6199862122,6sleep30-21swapper/322:25:083
6044612122,6sleep30-21swapper/322:10:043
5988172122,6sleep30-21swapper/322:00:253
5806072122,6sleep30-21swapper/321:45:113
5697882122,6sleep30-21swapper/321:35:053
5497722122,6sleep30-21swapper/321:15:053
5393112122,6sleep30-21swapper/321:04:543
5299452122,6sleep30-21swapper/320:55:073
5245052122,5sleep30-21swapper/320:50:023
5092162122,6sleep30-21swapper/320:30:243
5043642122,6sleep30-21swapper/320:25:573
4987052122,6sleep30-21swapper/320:20:163
4898462122,6sleep30-21swapper/320:14:573
4898462122,6sleep30-21swapper/320:14:573
4849172122,5sleep30-21swapper/320:10:013
4500022122,5sleep30-21swapper/319:35:023
4490272122,6sleep30-21swapper/319:30:153
4431072122,6sleep30-21swapper/319:25:133
4357262122,6sleep30-21swapper/319:20:093
7381532112,6sleep30-21swapper/300:21:433
7287212112,5sleep30-21swapper/300:15:043
7239802112,5sleep30-21swapper/300:10:063
6936722112,5sleep30-21swapper/323:40:013
6936722112,5sleep30-21swapper/323:40:003
6925482112,5sleep30-21swapper/323:35:163
6644222112,5sleep30-21swapper/323:10:063
6469982110,7sleep30-21swapper/322:50:133
6396962112,5sleep30-21swapper/322:45:073
6339692112,6sleep30-21swapper/322:36:413
5903562112,5sleep30-21swapper/321:55:113
5748992112,6sleep30-21swapper/321:40:063
5650702112,5sleep30-21swapper/321:30:063
5402392112,5sleep30-21swapper/321:05:073
5186542112,5sleep30-21swapper/320:40:183
5099072112,5sleep30-21swapper/320:35:053
4605382112,6sleep30-21swapper/319:45:083
4593062112,5sleep30-21swapper/319:40:233
4306452112,5sleep30-21swapper/319:15:103
4229552112,5sleep30-21swapper/319:10:003
5600092101,5sleep30-21swapper/321:25:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional