You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 07:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot1s.osadl.org (updated Sun Dec 14, 2025 01:37:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1364121110,3sleep30-21swapper/321:06:553
130372910,6chrt0-21swapper/300:00:053
130372910,6chrt0-21swapper/300:00:053
123732900,3sleep10-21swapper/121:01:591
123732900,3sleep10-21swapper/121:01:591
42962780,3sleep30-21swapper/323:36:533
258282600,3chrt0-21swapper/323:06:553
107912590,1chrt0-21swapper/121:00:021
107912590,1chrt0-21swapper/121:00:021
59722440,3sleep20-21swapper/220:46:532
59722440,3sleep20-21swapper/220:46:532
47862440,2sleep10-21swapper/123:37:011
251692430,1sleep125294-21/usr/sbin/munin00:32:001
251692430,1sleep125294-21/usr/sbin/munin00:32:001
274412400,2sleep00-21swapper/020:16:560
212142400,2sleep10-21swapper/121:26:591
190082380,2sleep10-21swapper/121:21:541
190082380,2sleep10-21swapper/121:21:541
22062360,3sleep30-21swapper/323:31:513
22062360,3sleep30-21swapper/323:31:513
2514993429,4cyclictest572-21cups-browsed22:11:591
2514993427,5cyclictest22584-21unixbench-2d22:56:591
2514993328,4cyclictest1346-21avahi-daemon22:21:561
2514993327,3cyclictest0-21swapper/123:01:591
251399331,24cyclictest13065-21latency_hist00:00:060
251399331,24cyclictest13065-21latency_hist00:00:060
72062320,2sleep03252-21kworker/0:0+events20:50:050
72062320,2sleep03252-21kworker/0:0+events20:50:050
2514993226,4cyclictest12867-21latency_hist00:00:041
2514993226,4cyclictest12867-21latency_hist00:00:041
2514993224,6cyclictest15548-21cat22:40:021
2514993224,6cyclictest15548-21cat22:40:021
2513993224,6cyclictest602-21latency_hist22:00:010
2514993127,3cyclictest22175-21idleruntime-cro00:25:021
2514993127,3cyclictest22175-21idleruntime-cro00:25:021
2514993126,4cyclictest27218-21threads00:37:001
2514993126,4cyclictest27218-21threads00:37:001
2514993126,4cyclictest1346-21avahi-daemon21:51:571
2514993124,5cyclictest595-21sshd19:51:581
2514993124,5cyclictest595-21sshd19:51:581
2514993124,5cyclictest26927-21sshd23:10:431
2514993124,5cyclictest26927-21sshd23:10:431
2514993124,5cyclictest24815-21netstat21:36:571
2514993124,5cyclictest24815-21netstat21:36:571
27922300,2sleep02970-21sed20:36:580
2514993026,2cyclictest0-21swapper/121:10:011
2514993023,5cyclictest22761-21kernelversion21:31:531
2514993023,5cyclictest14786-21threads19:41:591
2513993022,5cyclictest550-21cron22:50:010
2513993018,4cyclictest2512-21cyclictest23:51:580
2513993018,4cyclictest2512-21cyclictest23:51:580
2514992925,2cyclictest0-21swapper/120:30:021
2514992925,2cyclictest0-21swapper/120:30:021
2514992924,3cyclictest3417-21kworker/u9:4-xprtiod00:00:241
2514992924,3cyclictest3417-21kworker/u9:4-xprtiod00:00:241
2514992922,5cyclictest7607-21fschecks_time20:51:511
2514992922,5cyclictest6848-21fschecks_time22:16:521
2514992922,5cyclictest24662-21latency_hist20:10:031
2514992922,5cyclictest24662-21latency_hist20:10:031
2513992922,5cyclictest9711-21grep22:21:580
2513992920,7cyclictest14035-21processes00:01:570
2513992920,7cyclictest14035-21processes00:01:570
2514992823,4cyclictest29352-21latency_hist21:50:021
2514992823,4cyclictest29352-21latency_hist21:50:021
2514992821,5cyclictest1666-21latency_hist20:35:051
2514992821,5cyclictest16124-21kernelversion19:46:521
2513992823,3cyclictest0-21swapper/020:35:010
2513992822,4cyclictest2512-21cyclictest22:17:000
2513992821,5cyclictest0-21swapper/021:40:020
2513992821,5cyclictest0-21swapper/021:40:020
321992270,2chrt32194-21gzip21:56:541
2514992723,3cyclictest31003-21fschecks_time23:21:521
2514992723,3cyclictest31003-21fschecks_time23:21:521
2514992721,5cyclictest5260-21latency_hist20:45:031
2514992721,5cyclictest5260-21latency_hist20:45:031
2514992720,5cyclictest27567-21sshd20:16:581
2514992720,5cyclictest16547-21needreboot22:41:571
2513992721,4cyclictest2512-21cyclictest22:38:230
2513992721,4cyclictest2512-21cyclictest22:38:230
2513992721,4cyclictest142-21systemd-journal00:34:580
2513992721,4cyclictest142-21systemd-journal00:34:580
2513992721,4cyclictest1346-21avahi-daemon19:56:590
2513992720,5cyclictest8600-21switchtime23:46:590
2513992720,5cyclictest6367-21latency_hist22:15:030
2513992719,6cyclictest12346-21fschecks_count22:31:520
2513992717,8cyclictest6134-21gltestperf23:41:530
2513992717,8cyclictest6134-21gltestperf23:41:530
2514992620,5cyclictest17856-21unixbench_multi21:16:591
2514992620,4cyclictest0-21swapper/121:41:521
2514992619,5cyclictest1264-21fschecks_time22:01:521
2514992619,5cyclictest1264-21fschecks_time22:01:521
2513992622,2cyclictest0-21swapper/020:21:530
2513992620,4cyclictest0-21swapper/019:41:590
2513992620,3cyclictest0-21swapper/023:07:540
2513992619,5cyclictest4389-21sshd22:09:580
2513992619,5cyclictest26847-21missed_timers00:36:550
2513992619,5cyclictest26847-21missed_timers00:36:550
2513992618,6cyclictest19827-21fschecks_time22:51:510
2513992618,6cyclictest19827-21fschecks_time22:51:510
2513992618,6cyclictest18163-21needreboot19:51:580
2513992618,6cyclictest18163-21needreboot19:51:580
2513992618,6cyclictest16067-21fschecks_count22:41:520
2513992617,7cyclictest21150-21ntp_offset21:26:580
2513992617,7cyclictest16302-21needreboot19:46:540
2513992617,6cyclictest32129-21latency_hist20:30:040
2513992617,6cyclictest32129-21latency_hist20:30:040
49682250,3sleep30-21swapper/322:11:513
2514992521,3cyclictest412-21gltestperf23:26:521
2514992521,3cyclictest412-21gltestperf23:26:521
2514992519,5cyclictest2512-21cyclictest19:56:541
2514992519,4cyclictest0-21swapper/123:10:011
2514992519,4cyclictest0-21swapper/120:01:571
2514992518,5cyclictest16037-21switchtime00:07:001
2514992518,5cyclictest16037-21switchtime00:07:001
2514992517,6cyclictest8629-21sort23:46:591
2514992516,7cyclictest20570-21sort22:52:001
2514992516,7cyclictest20570-21sort22:52:001
2513992521,2cyclictest0-21swapper/020:55:010
2513992519,5cyclictest2512-21cyclictest20:55:080
2513992519,5cyclictest2512-21cyclictest20:55:080
2513992519,4cyclictest21654-21fschecks_time22:56:500
2513992519,4cyclictest19123-21gltestperf00:16:520
2513992519,4cyclictest19123-21gltestperf00:16:520
2513992519,4cyclictest0-21swapper/021:15:020
2513992518,6cyclictest24050-21ntp_offset23:01:580
2513992518,5cyclictest25923-21sshd21:40:580
2513992518,5cyclictest1200-21fschecks_count22:01:510
2513992518,5cyclictest1200-21fschecks_count22:01:510
2513992517,6cyclictest30726-21ls21:51:590
2513992516,7cyclictest17208-21fschecks_time00:11:530
2513992516,7cyclictest17208-21fschecks_time00:11:530
2513992516,7cyclictest17208-21fschecks_time00:11:530
2514992420,2cyclictest0-21swapper/123:51:581
2514992420,2cyclictest0-21swapper/123:51:581
2514992419,3cyclictest0-21swapper/122:31:531
2514992419,3cyclictest0-21swapper/120:36:571
2514992418,4cyclictest729-21dbus-daemon22:06:581
2514992418,4cyclictest2602-21kernelversion23:31:541
2514992418,4cyclictest2602-21kernelversion23:31:541
2513992419,4cyclictest15013-21sshd00:05:490
2513992419,4cyclictest15013-21sshd00:05:490
2513992418,4cyclictest2512-21cyclictest23:19:560
2513992418,4cyclictest11294-21fschecks_count21:01:490
2513992418,4cyclictest11294-21fschecks_count21:01:490
2513992417,5cyclictest22170-21latency_hist00:25:020
2513992417,5cyclictest22170-21latency_hist00:25:020
2513992417,5cyclictest10683-21sed22:26:510
2513992417,5cyclictest10683-21sed22:26:510
2513992416,6cyclictest28011-21fschecks_count21:46:530
2513992416,6cyclictest28011-21fschecks_count21:46:530
2513992413,9cyclictest5434-21cron23:40:020
2514992319,3cyclictest24030-21idleruntime-cro00:30:021
2514992319,3cyclictest24030-21idleruntime-cro00:30:021
2514992319,3cyclictest24030-21idleruntime-cro00:30:021
2514992319,2cyclictest0-21swapper/123:41:561
2514992319,2cyclictest0-21swapper/123:41:561
2514992319,2cyclictest0-21swapper/120:11:581
2514992319,2cyclictest0-21swapper/119:36:531
2514992319,2cyclictest0-21swapper/100:16:521
2514992319,2cyclictest0-21swapper/100:16:521
2514992318,3cyclictest0-21swapper/100:12:001
2514992318,3cyclictest0-21swapper/100:12:001
2514992318,3cyclictest0-21swapper/100:12:001
2513992319,3cyclictest32592-21/usr/sbin/munin23:26:590
2513992319,3cyclictest32592-21/usr/sbin/munin23:26:590
2513992318,3cyclictest0-21swapper/019:36:530
2513992317,4cyclictest547-21rs:main0
2513992317,4cyclictest547-21rs:main0
2513992317,4cyclictest13868-21sendmail_mailtr21:06:590
2513992317,4cyclictest0-21swapper/020:42:010
2513992317,4cyclictest0-21swapper/020:42:010
2513992317,3cyclictest0-21swapper/021:31:510
2514992213,7cyclictest142-21systemd-journal22:48:091
251399228,9cyclictest26308-21kworker/0:0+events_power_efficient20:14:580
2513992217,3cyclictest0-21swapper/000:26:590
2513992217,3cyclictest0-21swapper/000:26:590
2513992217,3cyclictest0-21swapper/000:26:590
2513992216,4cyclictest24591-21idleruntime-cro20:10:020
2513992216,4cyclictest24591-21idleruntime-cro20:10:020
2513992215,5cyclictest17206-21latency21:16:520
2513992213,7cyclictest18753-21fschecks_count21:21:510
2513992213,7cyclictest18753-21fschecks_count21:21:510
2516992116,3cyclictest18782sleep322:01:593
2516992116,3cyclictest18782sleep322:01:593
251599212,12cyclictest0-21swapper/200:00:042
251599212,12cyclictest0-21swapper/200:00:042
2514992117,2cyclictest0-21swapper/122:26:541
2514992117,2cyclictest0-21swapper/122:26:541
2514992117,2cyclictest0-21swapper/120:46:581
2514992117,2cyclictest0-21swapper/120:46:581
2514992114,5cyclictest14835-21/usr/sbin/munin21:11:581
251399215,4cyclictest30941-21fschecks_count23:21:520
251399215,4cyclictest30941-21fschecks_count23:21:520
2513992115,4cyclictest21341-21fschecks_count20:01:510
2516992014,3cyclictest63182chrt20:46:573
2516992014,3cyclictest63182chrt20:46:573
251599202,12cyclictest0-21swapper/200:00:072
251599202,12cyclictest0-21swapper/200:00:072
2514992016,2cyclictest0-21swapper/123:16:501
2514992014,4cyclictest0-21swapper/120:21:531
2513992015,3cyclictest0-21swapper/023:31:250
2513992015,3cyclictest0-21swapper/023:31:250
2516991813,3cyclictest114142sleep322:26:593
2516991813,3cyclictest114142sleep322:26:593
2516991812,4cyclictest27673-21taskset20:16:593
251699181,12cyclictest9363-21chrt20:56:503
251699181,12cyclictest9363-21chrt20:56:503
251599181,12cyclictest4086-21chrt22:07:002
251599181,10cyclictest0-21swapper/221:06:592
158402180,2sleep20-21swapper/221:12:012
2516991712,3cyclictest210822sleep321:26:583
2516991711,4cyclictest8554-21chrt23:46:583
251599173,11cyclictest0-21swapper/221:41:582
251599172,9cyclictest0-21swapper/200:16:582
251599172,9cyclictest0-21swapper/200:16:582
251599171,12cyclictest28390-21taskset20:20:032
251699161,12cyclictest7354-21chrt20:51:113
251599163,9cyclictest0-21swapper/200:23:592
251599163,9cyclictest0-21swapper/200:23:592
251599162,10cyclictest15240-21chrt22:36:592
251599162,10cyclictest15240-21chrt22:36:592
251599161,11cyclictest4906-21chrt23:37:012
251599161,11cyclictest28798-21chrt20:21:522
251599161,11cyclictest24525-21chrt21:36:532
251599161,11cyclictest24525-21chrt21:36:532
251599161,11cyclictest21805-21chrt20:01:542
251599161,11cyclictest20184-21chrt22:51:542
251599161,11cyclictest20184-21chrt22:51:542
251599161,11cyclictest0-21swapper/222:41:502
251599161,10cyclictest0-21swapper/200:06:592
251599161,10cyclictest0-21swapper/200:06:592
251599160,12cyclictest23199-21taskset21:31:592
97952151,2sleep30-21swapper/322:22:463
251699151,10cyclictest25026-21chrt20:11:523
2516991510,3cyclictest210892chrt22:55:013
2516991510,3cyclictest210892chrt22:55:013
251599153,9cyclictest0-21swapper/220:52:592
251599153,8cyclictest0-21swapper/221:57:592
251599153,8cyclictest0-21swapper/220:32:572
251599152,9cyclictest0-21swapper/219:37:572
251599151,9cyclictest25752-21chrt23:06:542
251599151,11cyclictest0-21swapper/223:26:542
251599151,11cyclictest0-21swapper/223:26:542
251599151,11cyclictest0-21swapper/223:11:522
251599151,11cyclictest0-21swapper/223:11:522
251599151,11cyclictest0-21swapper/221:21:592
251599151,11cyclictest0-21swapper/221:21:592
251599151,10cyclictest23283-21taskset00:26:572
251599151,10cyclictest23283-21taskset00:26:572
251599151,10cyclictest23283-21taskset00:26:572
251599151,10cyclictest0-21swapper/220:58:592
251599151,10cyclictest0-21swapper/220:58:592
251699149,3cyclictest322122chrt20:30:093
251699149,3cyclictest246552chrt00:31:533
251699149,3cyclictest246552chrt00:31:533
251699149,3cyclictest244412chrt20:08:303
251699149,3cyclictest244412chrt20:08:303
251699149,3cyclictest213872chrt22:56:053
251699149,2cyclictest0-21swapper/320:22:013
251699148,4cyclictest126802sleep321:05:033
251699148,4cyclictest126802sleep321:05:033
251699141,9cyclictest27761-21chrt21:45:503
251699141,9cyclictest27761-21chrt21:45:503
251699141,9cyclictest23993-21chrt21:35:173
251699141,9cyclictest23993-21chrt21:35:173
251699141,9cyclictest17443-21chrt19:51:143
251699141,9cyclictest17443-21chrt19:51:143
251699141,8cyclictest28741-21chrt23:15:153
251699141,11cyclictest20041-21chrt00:17:013
251699141,11cyclictest20041-21chrt00:17:013
251599149,3cyclictest261712chrt00:36:102
251599149,3cyclictest261712chrt00:36:102
251599149,3cyclictest109642chrt23:54:332
251599149,3cyclictest109642chrt23:54:332
251599148,3cyclictest313632sleep220:26:582
251599148,3cyclictest313632sleep220:26:582
251599142,9cyclictest0-21swapper/223:22:582
251599142,9cyclictest0-21swapper/223:22:582
251599141,9cyclictest0-21swapper/222:21:582
251599141,9cyclictest0-21swapper/221:51:512
251599141,8cyclictest0-21swapper/220:07:002
251599141,8cyclictest0-21swapper/220:07:002
251599141,6cyclictest0-21swapper/223:35:032
251599141,6cyclictest0-21swapper/223:35:032
251599141,11cyclictest0-21swapper/221:27:012
251599141,11cyclictest0-21swapper/220:00:022
251599141,10cyclictest24967-21chrt20:11:512
251599141,10cyclictest15583-21chrt19:46:062
251599141,10cyclictest14213-21chrt19:41:522
251699139,2cyclictest0-21swapper/323:42:403
251699139,2cyclictest0-21swapper/323:42:403
251699139,2cyclictest0-21swapper/322:09:583
251699139,2cyclictest0-21swapper/320:45:003
251699139,2cyclictest0-21swapper/320:45:003
251699138,3cyclictest3412chrt21:57:083
251699138,3cyclictest321482chrt23:23:513
251699138,3cyclictest321482chrt23:23:513
251699138,3cyclictest295702chrt21:50:213
251699138,3cyclictest234072chrt00:26:583
251699138,3cyclictest234072chrt00:26:583
251699138,3cyclictest234072chrt00:26:583
251699138,3cyclictest232042chrt23:00:233
251699138,3cyclictest210832chrt20:00:103
251699138,3cyclictest17072chrt20:35:203
251699138,3cyclictest169022chrt00:11:193
251699138,3cyclictest169022chrt00:11:193
251699138,3cyclictest169022chrt00:11:193
251699138,3cyclictest164142chrt00:07:493
251699138,3cyclictest164142chrt00:07:493
251699138,2cyclictest0-21swapper/323:10:123
251699138,2cyclictest0-21swapper/323:10:123
251699137,4cyclictest205942sleep300:20:523
251699137,4cyclictest205942sleep300:20:523
251699137,4cyclictest158802sleep322:41:393
251699131,9cyclictest19259-21chrt19:55:483
251699131,9cyclictest10819-21chrt23:52:413
251699131,9cyclictest10819-21chrt23:52:413
251699131,8cyclictest6480-21chrt22:15:213
251699131,8cyclictest30362-21chrt20:25:113
251699131,8cyclictest30362-21chrt20:25:113
251699131,8cyclictest26098-21chrt00:35:143
251699131,8cyclictest26098-21chrt00:35:143
251699131,8cyclictest22131-21chrt21:30:073
251699131,8cyclictest17621-21chrt22:45:163
251699131,8cyclictest15512-21chrt19:45:113
251699131,8cyclictest11796-21chrt19:35:143
251699131,10cyclictest15551-21chrt21:11:583
251699131,10cyclictest1468-21chrt23:27:013
251699131,10cyclictest1468-21chrt23:27:013
251699131,10cyclictest13832-21chrt00:01:543
251699131,10cyclictest13832-21chrt00:01:543
251599138,3cyclictest91262chrt23:49:432
251599138,3cyclictest277922chrt21:46:142
251599138,3cyclictest277922chrt21:46:142
251599138,3cyclictest17262chrt20:35:352
251599138,3cyclictest0-21swapper/221:18:162
251599131,9cyclictest28809-21chrt23:16:062
251599131,9cyclictest24588-21chrt23:02:072
251599131,9cyclictest17610-21chrt22:45:072
251599131,9cyclictest12420-21chrt22:31:522
251599131,9cyclictest11944-21chrt22:30:032
251599131,9cyclictest11944-21chrt22:30:032
251599131,9cyclictest0-21swapper/220:41:582
251599131,9cyclictest0-21swapper/220:41:582
251599131,9cyclictest0-21swapper/219:55:022
251599131,9cyclictest0-21swapper/219:55:022
251599131,8cyclictest902-21chrt22:00:132
251599131,8cyclictest902-21chrt22:00:132
251599131,8cyclictest24263-21chrt00:30:272
251599131,8cyclictest24263-21chrt00:30:272
251599131,10cyclictest11920-21chrt21:01:562
251599131,10cyclictest11920-21chrt21:01:562
251699127,3cyclictest139212chrt22:35:313
251699127,3cyclictest139212chrt22:35:313
251699121,9cyclictest19830-21chrt21:22:033
251699121,9cyclictest19830-21chrt21:22:033
251699121,9cyclictest13661-21chrt19:40:083
251699121,9cyclictest13228-21chrt22:32:013
251699121,8cyclictest25856-21chrt21:40:083
251699121,8cyclictest16574-21chrt21:15:233
251599127,3cyclictest56842chrt23:40:142
251599127,3cyclictest56842chrt23:40:142
251599127,3cyclictest183722chrt00:14:112
251599127,3cyclictest183722chrt00:14:112
251599127,3cyclictest183722chrt00:14:112
251599121,9cyclictest6539-21chrt22:16:042
251599121,9cyclictest21431-21chrt22:56:412
251599120,8cyclictest4614-21chrt22:10:062
plot09:55:358
setyrange[0.8:*]5
setylabel"Numberoflatencysamples"6
setxrange[0:400]4
setxlabel"Latencyus-Maximumusplottedon2
settitle"Latencyrack4slot1s"0
setterminalpbmcolor1
setoutput"r4s1s.ppm"7
setlogscaley3
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional