You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 21:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Jan 10, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4134282995342,6cyclictest4136050-21latency_hist07:15:021
4134277995340,9cyclictest121ktimers/011:05:120
4134282994833,11cyclictest27843-21sendmail11:19:591
4134282994833,11cyclictest27843-21sendmail11:19:591
4134286994739,4cyclictest41741-21sendmail12:00:002
4134286994735,8cyclictest4166450-21sendmail08:40:012
4134277994718,19cyclictest0-21swapper/011:15:000
4134282994531,9cyclictest231ktimers/110:55:121
4134277994435,5cyclictest38318-21munin-plugin-st11:50:000
4134288994235,3cyclictest54151-21apt-get12:35:143
4134282994235,4cyclictest4159406-21idleruntime-cro08:20:011
4134288994128,8cyclictest13971-21apt-get10:40:143
4134288994127,10cyclictest391ktimers/308:35:133
4134288994125,10cyclictest4188254-21grep09:40:243
4134286994127,10cyclictest311ktimers/210:10:112
4134282994130,7cyclictest4162578-21grep08:25:261
4134288994033,3cyclictest6913-21apt-get10:20:123
4134288994032,4cyclictest4173291-21sendmail09:00:013
4134282994032,5cyclictest4133892-21kworker/u8:1+events_unbound07:30:041
4134282994030,5cyclictest0-21swapper/109:00:161
4134288993933,3cyclictest4145735-21apt-get07:40:123
4134288993933,3cyclictest4145735-21apt-get07:40:123
4134288993932,3cyclictest4173523-21apt-get09:00:133
4134288993926,8cyclictest4170171-21/usr/sbin/munin08:50:123
4134288993925,11cyclictest4175680-21/usr/sbin/munin09:05:223
4134286993931,5cyclictest53928-21idleruntime-cro12:35:002
4134286993931,5cyclictest10318-21munin-plugin-st10:30:012
4134286993931,4cyclictest0-21swapper/207:35:022
4134288993832,3cyclictest4144011-21apt-get07:35:113
4134288993832,3cyclictest4140391-21apt-get07:25:123
4134288993831,4cyclictest4180370-21apt-get09:20:103
4134288993831,4cyclictest4180370-21apt-get09:20:093
4134288993831,4cyclictest10542-21apt-get10:30:123
4134288993831,3cyclictest40248-21apt-get11:55:113
4134288993829,5cyclictest3482-21apt-get10:10:123
4134288993828,7cyclictest4150849-21apt-get07:55:123
4134288993828,7cyclictest4136744-21apt-get07:15:143
4134288993828,6cyclictest36836-21apt-get11:45:113
4134288993827,7cyclictest6660-21sh10:20:013
4134288993825,10cyclictest4153421-21/usr/sbin/munin08:00:253
4134288993824,11cyclictest4184698-21/usr/sbin/munin09:30:253
4134286993826,6cyclictest0-21swapper/207:25:022
4134282993827,7cyclictest4155550-21grep08:05:241
4134282993825,8cyclictest18845-21cron10:54:591
4134277993828,7cyclictest4133892-21kworker/u8:1+events_unbound07:35:010
4134288993732,2cyclictest12249-21apt-get10:35:143
4134288993731,3cyclictest4176939-21apt-get09:10:123
4134288993730,4cyclictest28290-21apt-get11:20:103
4134288993726,9cyclictest46861-21apt-get12:15:043
4134288993726,8cyclictest4163779-21/usr/sbin/munin08:30:223
4134288993726,8cyclictest4162229-21/usr/sbin/munin08:25:233
4134288993726,7cyclictest21024-21apt-get11:00:133
4134288993725,8cyclictest38723-21/usr/sbin/munin11:50:143
4134288993725,7cyclictest46298-21/usr/sbin/munin12:10:253
4134288993724,9cyclictest4166685-21apt-get08:40:153
4134288993724,10cyclictest51680-21/usr/sbin/munin12:25:263
4134288993723,8cyclictest4190625-21apt-get09:50:133
4134288993723,11cyclictest34479-21/usr/sbin/munin11:35:253
4134288993723,10cyclictest30255-21/usr/sbin/munin11:25:133
4134288993722,10cyclictest19141-21/usr/sbin/munin10:55:133
4134288993721,13cyclictest4159830-21apt-get08:20:063
4134286993727,6cyclictest0-21swapper/211:10:152
4134282993727,6cyclictest0-21swapper/108:55:011
4134277993729,4cyclictest0-21swapper/007:15:010
4134288993631,2cyclictest4157900-21apt-get08:15:113
4134288993630,3cyclictest41972-21apt-get12:00:113
4134288993628,4cyclictest0-21swapper/312:20:233
4134288993626,7cyclictest36269-21cron11:41:013
4134288993625,9cyclictest8397-21apt-get10:25:053
4134288993625,7cyclictest52565-21/usr/sbin/munin12:30:183
4134288993625,6cyclictest24551-21diskstats11:10:153
4134288993624,9cyclictest4192663-21/usr/sbin/munin09:55:153
4134288993624,9cyclictest2649-21/usr/sbin/munin10:05:233
4134288993624,9cyclictest25907-21apt-get11:15:053
4134288993624,9cyclictest25907-21apt-get11:15:053
4134288993624,7cyclictest4168709-21/usr/sbin/munin08:45:163
4134288993623,11cyclictest16272-21/usr/sbin/munin10:45:223
4134286993625,6cyclictest0-21swapper/210:50:162
4134286993624,7cyclictest0-21swapper/211:00:252
4134282993627,5cyclictest0-21swapper/112:35:001
4134282993625,7cyclictest29278-21grep11:20:231
4134288993529,3cyclictest4188920-21apt-get09:45:133
4134288993525,7cyclictest4185602-21df_inode09:35:133
4134288993525,7cyclictest4155523-21/usr/sbin/munin08:05:253
4134288993525,7cyclictest1160-21sshd10:00:313
4134288993524,8cyclictest4156193-21apt-get08:10:113
4134288993524,8cyclictest4139195-21/usr/sbin/munin07:20:243
4134288993524,8cyclictest18681-21cron10:52:593
4134288993523,9cyclictest31910-21/usr/sbin/munin11:30:163
4134288993522,9cyclictest4149143-21apt-get07:50:123
4134288993520,11cyclictest23250-21/usr/sbin/munin11:05:203
4134286993528,4cyclictest4155962-21sh08:10:002
4134286993525,6cyclictest0-21swapper/207:40:002
4134286993524,6cyclictest0-21swapper/208:10:242
4134282993524,7cyclictest0-21swapper/109:00:011
4134277993528,3cyclictest0-21swapper/009:50:000
4134288993428,3cyclictest4182079-21apt-get09:25:143
4134288993428,3cyclictest4182079-21apt-get09:25:133
4134288993425,6cyclictest4142545-21memory07:30:203
4134288993423,8cyclictest43679-21apt-get12:05:123
4134288993423,8cyclictest4178981-21/usr/sbin/munin09:15:183
4134286993422,9cyclictest311ktimers/211:50:122
4134282993427,4cyclictest55638-21idleruntime-cro12:40:001
4134282993425,5cyclictest0-21swapper/109:55:241
4134277993427,4cyclictest4166469-21idleruntime-cro08:40:010
4134277993425,6cyclictest0-21swapper/011:20:000
4134277993425,6cyclictest0-21swapper/011:19:590
4134277993424,6cyclictest0-21swapper/009:40:240
4134288993323,7cyclictest4148118-21/usr/sbin/munin07:45:243
4134288993323,7cyclictest4148118-21/usr/sbin/munin07:45:233
4134288993321,9cyclictest4134440-21/usr/sbin/munin07:10:133
4134286993325,4cyclictest0-21swapper/211:40:252
4134286993325,4cyclictest0-21swapper/209:20:132
4134286993325,4cyclictest0-21swapper/209:20:132
4134286993324,5cyclictest0-21swapper/210:20:012
4134286993323,6cyclictest0-21swapper/212:40:002
4134286993323,6cyclictest0-21swapper/210:40:002
4134286993323,6cyclictest0-21swapper/210:05:012
4134286993323,6cyclictest0-21swapper/208:15:152
4134286993323,6cyclictest0-21swapper/207:50:262
4134282993324,5cyclictest0-21swapper/110:50:001
4134282993323,6cyclictest4944-21cron10:15:001
4134282993321,8cyclictest22032-21grep11:00:261
413427799336,24cyclictest4160475-21sshd08:20:220
4134277993324,6cyclictest0-21swapper/010:40:170
4134277993324,5cyclictest0-21swapper/009:10:240
4134277993323,7cyclictest0-21swapper/007:25:020
4134277993316,3cyclictest17382-21apt-get10:50:110
4134277993310,19cyclictest15880-21tune2fs10:45:150
4134286993222,7cyclictest42130-21fschecks_count12:00:132
4134286993222,6cyclictest0-21swapper/208:55:232
4134286993221,6cyclictest0-21swapper/209:25:172
4134286993221,6cyclictest0-21swapper/209:25:172
4134282993225,4cyclictest0-21swapper/109:50:241
4134282993224,5cyclictest0-21swapper/107:20:251
4134282993223,6cyclictest10310-21apt10:30:011
4134282993221,7cyclictest0-21swapper/110:15:241
4134282993220,8cyclictest1070-21grep10:00:281
413427799328,9cyclictest29668-21taskset11:23:570
413427799327,21cyclictest0-21swapper/010:20:010
4134277993223,5cyclictest0-21swapper/009:34:590
413428699318,20cyclictest311ktimers/210:05:122
4134286993122,5cyclictest0-21swapper/211:25:232
4134286993121,6cyclictest0-21swapper/211:09:592
4134286993112,4cyclictest131rcu_preempt08:30:122
4134282993120,7cyclictest34468-21grep11:35:231
4134282993120,7cyclictest0-21swapper/108:05:011
4134282993119,8cyclictest4148439-21grep07:45:261
4134282993119,8cyclictest4148439-21grep07:45:251
413427799318,20cyclictest4157705-21cat08:15:010
4134277993123,4cyclictest0-21swapper/009:20:230
4134277993123,4cyclictest0-21swapper/009:20:230
4134277993122,5cyclictest0-21swapper/011:35:240
4134277993118,4cyclictest131rcu_preempt10:03:100
413428699307,20cyclictest311ktimers/212:22:382
4134286993023,3cyclictest0-21swapper/212:05:232
4134286993022,4cyclictest0-21swapper/207:55:142
4134286993021,5cyclictest0-21swapper/207:45:002
4134286993021,5cyclictest0-21swapper/207:45:002
4134286993020,6cyclictest0-21swapper/212:25:262
4134286993020,6cyclictest0-21swapper/209:39:592
4134282993021,6cyclictest4183547-21sh09:30:001
4134282993021,6cyclictest4183547-21sh09:29:591
413427799307,19cyclictest4175190-21date09:05:020
4134277993024,4cyclictest4173279-21grep09:00:010
4134277993021,6cyclictest4145937-21tune2fs07:40:150
4134277993021,6cyclictest4145937-21tune2fs07:40:150
4134277993017,9cyclictest121ktimers/010:55:110
4134277993014,13cyclictest0-21swapper/009:05:130
4134277993010,5cyclictest11-21ksoftirqd/011:55:190
413428699295,13cyclictest311ktimers/211:25:012
413428699294,6cyclictest32-21ksoftirqd/207:45:152
413428699294,6cyclictest32-21ksoftirqd/207:45:152
4134286992923,3cyclictest0-21swapper/212:15:162
4134286992921,4cyclictest0-21swapper/211:15:262
4134286992921,4cyclictest0-21swapper/211:15:262
4134286992921,4cyclictest0-21swapper/210:55:252
4134286992917,6cyclictest131rcu_preempt07:14:332
4134286992913,4cyclictest131rcu_preempt08:44:002
4134282992921,4cyclictest0-21swapper/107:35:261
4134282992918,7cyclictest4184839-21grep09:30:261
4134277992923,3cyclictest0-21swapper/010:25:000
4134277992921,5cyclictest0-21swapper/008:00:010
4134277992920,6cyclictest0-21swapper/012:20:230
413428699289,9cyclictest131rcu_preempt09:15:172
413428699286,8cyclictest0-21swapper/208:49:412
413428699286,13cyclictest0-21swapper/210:46:282
413428699285,6cyclictest0-21swapper/209:30:202
4134286992818,7cyclictest311ktimers/207:28:512
4134286992818,6cyclictest34429-21grep11:35:232
4134286992818,6cyclictest0-21swapper/209:10:012
4134286992811,8cyclictest131rcu_preempt12:11:082
4134286992810,8cyclictest131rcu_preempt11:45:562
4134286992810,5cyclictest32-21ksoftirqd/209:50:162
4134286992810,10cyclictest0-21swapper/208:00:252
4134282992821,3cyclictest0-21swapper/111:25:221
4134282992819,5cyclictest4160909-21grep08:20:261
4134282992815,9cyclictest36139-21grep11:40:241
413427799288,17cyclictest0-21swapper/007:15:230
4134277992822,3cyclictest0-21swapper/008:00:260
4134277992815,10cyclictest4191199-21ntpq09:50:210
4134277992813,3cyclictest131rcu_preempt08:45:510
4134277992812,13cyclictest4166789-21/usr/sbin/munin08:40:160
413428699277,17cyclictest311ktimers/209:40:172
4134286992718,7cyclictest311ktimers/210:41:162
4134286992717,6cyclictest0-21swapper/210:20:252
4134286992716,4cyclictest131rcu_preempt08:50:292
4134286992711,3cyclictest131rcu_preempt07:15:202
4134282992721,3cyclictest0-21swapper/111:30:141
4134282992719,5cyclictest231ktimers/112:15:121
4134282992719,4cyclictest0-21swapper/109:40:001
4134282992718,4cyclictest0-21swapper/107:50:151
4134282992717,7cyclictest0-21swapper/110:45:001
413427799278,9cyclictest131rcu_preempt12:28:400
413427799273,13cyclictest0-21swapper/008:32:350
4134277992720,3cyclictest0-21swapper/010:15:010
4134277992719,4cyclictest0-21swapper/009:35:150
4134277992718,6cyclictest0-21swapper/007:50:240
4134277992717,7cyclictest54744-21/usr/sbin/munin12:35:240
4134277992717,7cyclictest4162765-21cron08:27:010
4134277992716,7cyclictest4145072-21grep07:35:250
4134277992714,10cyclictest47627-21/usr/sbin/munin12:15:170
4134277992714,10cyclictest4193409-21/usr/sbin/munin09:55:230
4134277992712,11cyclictest4179227-21/usr/sbin/munin09:15:220
4134277992711,9cyclictest131rcu_preempt10:33:440
4134277992710,13cyclictest4155547-21unixbench_singl08:05:250
4134286992616,7cyclictest311ktimers/208:27:242
4134286992611,3cyclictest0-21swapper/208:20:062
4134286992610,9cyclictest131rcu_preempt09:10:252
4134282992619,4cyclictest51773-21unixbench_singl12:25:271
4134282992619,4cyclictest0-21swapper/107:55:141
4134282992618,4cyclictest0-21swapper/109:10:211
4134282992617,5cyclictest0-21swapper/111:45:231
4134282992616,7cyclictest43838-21fschecks_count12:05:141
413427799269,9cyclictest131rcu_preempt11:25:170
413427799269,8cyclictest131rcu_preempt12:11:530
4134277992618,5cyclictest0-21swapper/010:10:010
4134277992616,7cyclictest13872-21sed10:40:010
4134277992615,8cyclictest0-21swapper/012:00:110
4134277992614,9cyclictest4183157-21/usr/sbin/munin09:25:260
4134277992614,9cyclictest4183157-21/usr/sbin/munin09:25:250
4134277992614,9cyclictest10048-21sshd10:26:550
4134277992612,11cyclictest4140502-21/usr/sbin/munin07:25:140
4134277992611,6cyclictest131rcu_preempt11:51:510
413427799261,14cyclictest0-21swapper/011:43:160
413427799261,13cyclictest0-21swapper/011:30:370
413427799261,12cyclictest0-21swapper/007:45:510
413427799261,12cyclictest0-21swapper/007:45:510
413427799260,15cyclictest0-21swapper/008:16:300
413428699256,5cyclictest32-21ksoftirqd/211:30:232
413428699252,9cyclictest0-21swapper/209:01:462
4134286992513,8cyclictest4193344-21grep09:55:242
4134282992517,4cyclictest0-21swapper/112:15:001
4134282992517,4cyclictest0-21swapper/110:35:271
4134282992516,4cyclictest0-21swapper/109:20:231
4134282992516,4cyclictest0-21swapper/109:20:221
4134282992515,7cyclictest204-21dbus-daemon07:25:021
413427799259,13cyclictest52814-21kernelversion12:30:200
4134277992514,8cyclictest44820-21cron12:06:000
4134277992510,11cyclictest4170309-21fschecks_time08:50:150
413428699248,9cyclictest131rcu_preempt09:45:072
4134286992414,3cyclictest131rcu_preempt10:30:252
4134282992416,5cyclictest8395-21idleruntime-cro10:25:001
4134282992415,6cyclictest4165041-21ls08:35:121
4134282992317,3cyclictest0-21swapper/108:30:241
4134282992317,3cyclictest0-21swapper/108:10:211
4134282992317,3cyclictest0-21swapper/107:20:001
4134282992315,5cyclictest0-21swapper/109:10:001
4134282992314,6cyclictest4187590-21grep09:40:161
4134282992314,5cyclictest49240-21fschecks_time12:20:151
4134282992314,5cyclictest0-21swapper/110:10:011
4134282992313,7cyclictest38674-21forks11:50:151
413428299231,11cyclictest0-21swapper/110:33:461
4134282992216,3cyclictest0-21swapper/109:45:131
4134282992216,3cyclictest0-21swapper/108:40:271
413428299212,13cyclictest43439-21cron12:05:001
4134282992114,4cyclictest4169440-21unixbench_singl08:45:251
413428299211,10cyclictest41302-21grep11:55:251
413428299201,12cyclictest0-21swapper/107:42:411
413428299201,12cyclictest0-21swapper/107:42:401
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional