You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 17:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Fri May 08, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2919794995340,9cyclictest3013068-21idleruntime-cro11:40:012
2919785995346,4cyclictest3030117-21grep12:30:010
2919789995239,9cyclictest231ktimers/111:50:141
2919797995042,6cyclictest3019837-21kworker/u8:2+events_unbound12:05:533
2919785994938,7cyclictest3004061-21grep11:10:240
2919797994740,5cyclictest3004435-21kworker/u8:3+events_unbound12:10:533
2919789994738,5cyclictest3019858-21cron12:00:001
2919794994635,8cyclictest311ktimers/211:30:112
2919785994612,11cyclictest131rcu_preempt08:00:100
2919797994536,7cyclictest2947715-21kworker/u8:3+events_unbound08:30:053
2919797994437,4cyclictest3027230-21kworker/u8:0+events_unbound12:31:003
2919789994436,6cyclictest2966165-21unixbench_singl09:20:261
2919794994333,7cyclictest311ktimers/208:30:112
2919797994236,4cyclictest2992816-21kworker/u8:0+events_unbound11:00:403
2919797994236,4cyclictest2992816-21kworker/u8:0+events_unbound11:00:403
2919794994232,6cyclictest2977025-21munin-plugin-st09:55:002
2919794994221,6cyclictest0-21swapper/207:40:022
2919789994235,5cyclictest2971376-21kworker/u8:3+events_unbound09:50:211
2919789994235,5cyclictest2921353-21kworker/u8:3+events_unbound07:29:581
2919789994235,5cyclictest2921353-21kworker/u8:3+events_unbound07:29:581
2919797994134,4cyclictest438-21cron12:20:003
2919797994134,4cyclictest2987271-21munin-plugin-st10:25:013
2919797994133,6cyclictest3012948-21kworker/u8:1+events_unbound11:40:503
2919785994134,4cyclictest3032028-21idleruntime-cro12:34:590
2919797994034,4cyclictest2962880-21kworker/u8:2+events_unbound09:45:213
2919797994034,4cyclictest2962880-21kworker/u8:2+events_unbound09:45:213
2919797994028,8cyclictest391ktimers/308:00:103
2919789994034,4cyclictest2962880-21kworker/u8:2+events_unbound09:25:161
2919789994033,4cyclictest2963159-21sh09:15:001
2919797993933,4cyclictest2945915-21kworker/u8:2+events_unbound08:50:103
2919797993932,5cyclictest2971376-21kworker/u8:3+events_unbound09:56:423
2919797993928,7cyclictest2969564-21grep09:30:243
2919789993920,6cyclictest131rcu_preempt07:10:111
2919785993930,6cyclictest0-21swapper/009:45:110
2919785993930,6cyclictest0-21swapper/009:45:110
2919797993831,4cyclictest2964884-21sendmail09:20:013
2919797993830,6cyclictest2950074-21kworker/u8:1+events_unbound08:48:423
2919797993822,7cyclictest131rcu_preempt09:40:123
2919797993822,7cyclictest131rcu_preempt09:40:113
2919785993819,5cyclictest131rcu_preempt11:35:110
2919797993731,4cyclictest3004435-21kworker/u8:3+events_unbound11:20:433
2919797993726,7cyclictest2947808-21auditctl08:30:003
2919794993727,7cyclictest3015139-21fschecks_count11:45:162
2919794993727,7cyclictest0-21swapper/207:50:242
2919794993727,6cyclictest2972964-21unixbench_multi09:40:252
2919794993727,6cyclictest2972964-21unixbench_multi09:40:242
2919789993730,5cyclictest2976657-21kworker/u8:1+events_unbound10:02:411
2919789993730,4cyclictest2988725-21unixbench_multi10:25:231
2919789993727,6cyclictest2986812-21unixbench_multi10:20:241
2919789993724,9cyclictest231ktimers/109:05:131
2919797993628,6cyclictest3004435-21kworker/u8:3+events_unbound11:30:493
2919794993611,7cyclictest32-21ksoftirqd/212:05:202
2919794993611,5cyclictest32-21ksoftirqd/207:45:002
2919789993624,7cyclictest0-21swapper/112:10:001
2919785993627,7cyclictest2971376-21kworker/u8:3+events_unbound09:40:220
2919785993627,7cyclictest2971376-21kworker/u8:3+events_unbound09:40:210
2919785993611,3cyclictest131rcu_preempt11:20:110
2919797993527,6cyclictest2980177-21kworker/u8:0+events_unbound10:06:413
2919797993527,4cyclictest0-21swapper/310:45:143
2919797993526,6cyclictest0-21swapper/311:55:003
2919797993524,8cyclictest391ktimers/309:10:123
2919797993518,5cyclictest2950074-21kworker/u8:1+events_unbound08:40:223
2919794993520,9cyclictest1-21systemd09:45:212
2919794993520,9cyclictest1-21systemd09:45:202
2919789993526,6cyclictest2985127-21unixbench_singl10:15:251
2919789993525,6cyclictest0-21swapper/107:25:011
2919797993428,4cyclictest3007901-21kworker/u8:2+events_unbound11:25:463
2919797993428,4cyclictest2986978-21kworker/u8:1+events_unbound10:55:393
2919797993428,4cyclictest2986978-21kworker/u8:1+events_unbound10:55:383
2919797993424,7cyclictest3001562-21cut11:05:163
2919797993424,7cyclictest3001562-21cut11:05:163
291979499349,7cyclictest0-21swapper/210:30:242
2919794993425,5cyclictest0-21swapper/211:20:252
2919794993422,8cyclictest2981707-21grep10:05:262
2919794993418,11cyclictest311ktimers/208:55:122
2919785993429,3cyclictest2963495-21sshd09:15:150
2919785993427,5cyclictest2959621-21kworker/u8:0+events_unbound09:06:400
2919785993427,4cyclictest0-21swapper/009:40:010
2919797993326,5cyclictest2926994-21kworker/u8:1+events_unbound07:34:593
2919797993325,5cyclictest2988725-21tail10:25:243
2919797993318,5cyclictest2899314-21kworker/u8:1+events_unbound07:17:163
2919797993313,12cyclictest131rcu_preempt10:00:253
2919794993325,5cyclictest2928371-21unixbench_multi07:30:252
2919794993323,6cyclictest3004050-21unixbench_multi11:10:252
2919794993322,7cyclictest0-21swapper/209:35:152
2919789993325,5cyclictest3027941-21unixbench_multi12:20:241
2919789993324,6cyclictest2937121-21unixbench_multi07:55:241
2919789993323,6cyclictest0-21swapper/109:45:251
2919789993323,6cyclictest0-21swapper/109:45:241
2919789993322,7cyclictest0-21swapper/112:30:001
2919785993326,4cyclictest2921353-21kworker/u8:3-ext4-rsv-conversion08:20:010
2919785993326,4cyclictest2921353-21kworker/u8:3-ext4-rsv-conversion08:20:000
2919785993324,6cyclictest2967000-21sshd09:25:150
2919797993222,4cyclictest0-21swapper/307:40:003
2919797993214,6cyclictest40-21ksoftirqd/309:25:153
2919797993212,12cyclictest131rcu_preempt08:55:183
291979499329,6cyclictest32-21ksoftirqd/210:25:002
2919794993224,4cyclictest0-21swapper/211:00:252
2919794993224,4cyclictest0-21swapper/211:00:252
2919794993219,7cyclictest0-21swapper/212:20:002
2919794993210,4cyclictest2947870-21latency_hist08:30:012
2919789993223,5cyclictest0-21swapper/108:15:171
2919789993223,5cyclictest0-21swapper/108:15:161
2919789993222,7cyclictest2983369-21grep10:10:251
2919789993222,6cyclictest0-21swapper/109:00:001
2919789993221,9cyclictest231ktimers/107:40:121
2919789993213,4cyclictest3004435-21kworker/u8:3+events_unbound12:19:051
291978599322,5cyclictest2963170-21grep09:15:010
2919785993225,5cyclictest2945915-21kworker/u8:2+events_unbound08:55:110
2919785993225,4cyclictest0-21swapper/010:40:000
2919785993225,3cyclictest0-21swapper/010:55:250
2919785993225,3cyclictest0-21swapper/010:55:250
2919785993222,6cyclictest0-21swapper/010:30:240
2919797993121,6cyclictest0-21swapper/311:10:153
2919797993115,6cyclictest131rcu_preempt07:10:163
291979499319,5cyclictest32-21ksoftirqd/209:25:212
291979499317,6cyclictest0-21swapper/212:10:142
2919794993124,4cyclictest2989178-21idleruntime-cro10:30:002
2919794993124,4cyclictest0-21swapper/207:45:252
2919794993123,5cyclictest2986978-21kworker/u8:1+events_unbound11:15:412
2919794993123,4cyclictest0-21swapper/208:15:002
2919794993120,7cyclictest0-21swapper/210:35:252
2919794993110,5cyclictest32-21ksoftirqd/210:15:222
2919789993119,8cyclictest2998995-21grep10:55:251
2919789993119,8cyclictest2998995-21grep10:55:251
291978999311,4cyclictest131rcu_preempt08:35:131
2919785993123,4cyclictest0-21swapper/008:30:240
2919785993117,11cyclictest2919776-21cyclictest08:25:120
291979799306,15cyclictest40-21ksoftirqd/312:00:213
2919797993022,6cyclictest2921353-21kworker/u8:3+events_unbound07:43:423
2919797993020,6cyclictest0-21swapper/308:20:263
2919797993019,7cyclictest0-21swapper/309:00:233
2919797993019,4cyclictest131rcu_preempt10:40:233
2919797993015,6cyclictest40-21ksoftirqd/311:19:593
2919797993013,13cyclictest40-21ksoftirqd/310:15:213
291979499308,5cyclictest0-21swapper/208:45:152
291979499307,6cyclictest32-21ksoftirqd/207:15:022
2919794993019,8cyclictest2926697-21grep07:25:252
2919794993019,8cyclictest2926697-21grep07:25:252
2919794993018,8cyclictest3021122-21grep12:00:252
2919794993018,8cyclictest1-21systemd07:59:592
2919789993023,5cyclictest2987694-21kworker/u8:4+events_unbound10:30:331
2919789993023,5cyclictest2956030-21kworker/u8:3+events_unbound09:00:421
2919789993023,3cyclictest0-21swapper/107:40:001
2919789993022,5cyclictest0-21swapper/108:15:011
2919789993021,5cyclictest0-21swapper/108:00:251
2919789993020,8cyclictest231ktimers/109:15:121
2919789993020,6cyclictest0-21swapper/111:15:251
2919789993019,7cyclictest0-21swapper/108:25:261
2919785993023,4cyclictest2978313-21head09:55:250
2919785993023,3cyclictest0-21swapper/011:00:260
2919785993023,3cyclictest0-21swapper/011:00:250
291979799299,11cyclictest40-21ksoftirqd/309:05:183
291979799294,13cyclictest40-21ksoftirqd/311:55:253
2919797992917,5cyclictest131rcu_preempt08:05:243
2919797992917,3cyclictest131rcu_preempt10:15:003
2919797992910,6cyclictest131rcu_preempt08:15:143
2919797992910,6cyclictest131rcu_preempt08:15:133
291979499297,6cyclictest32-21ksoftirqd/212:25:192
291979499295,6cyclictest32-21ksoftirqd/207:10:132
2919794992921,5cyclictest0-21swapper/211:05:242
2919794992921,5cyclictest0-21swapper/211:05:242
2919794992921,5cyclictest0-21swapper/208:45:012
2919794992921,4cyclictest0-21swapper/209:25:012
2919794992919,7cyclictest0-21swapper/212:30:142
2919789992922,5cyclictest2976657-21kworker/u8:1+events_unbound10:05:211
2919789992919,6cyclictest0-21swapper/110:00:001
2919785992922,4cyclictest0-21swapper/008:05:260
2919785992921,4cyclictest0-21swapper/007:15:230
291979799289,10cyclictest131rcu_preempt10:50:243
291979799288,12cyclictest131rcu_preempt12:35:233
291979799287,3cyclictest131rcu_preempt08:15:013
2919797992817,3cyclictest131rcu_preempt11:45:143
2919797992812,8cyclictest40-21ksoftirqd/312:30:013
291979799281,14cyclictest2934525-21/usr/sbin/munin07:50:153
291979799281,14cyclictest0-21swapper/310:35:203
2919797992810,6cyclictest40-21ksoftirqd/308:40:003
291979499288,6cyclictest32-21ksoftirqd/208:50:182
291979499287,5cyclictest32-21ksoftirqd/211:40:202
291979499285,7cyclictest0-21swapper/209:30:122
291979499284,4cyclictest301rcuc/211:28:182
2919794992819,6cyclictest0-21swapper/209:05:002
2919794992818,6cyclictest2979104-21fschecks_count10:00:162
2919789992821,3cyclictest0-21swapper/108:20:151
2919789992819,5cyclictest0-21swapper/112:40:001
2919789992814,10cyclictest231ktimers/111:00:131
2919789992814,10cyclictest231ktimers/111:00:121
2919785992821,4cyclictest0-21swapper/007:55:240
2919785992821,4cyclictest0-21swapper/007:10:240
291979799276,12cyclictest40-21ksoftirqd/307:55:493
291979799276,12cyclictest40-21ksoftirqd/307:45:123
2919797992715,5cyclictest131rcu_preempt07:30:013
2919797992715,5cyclictest131rcu_preempt07:30:013
291979799270,15cyclictest0-21swapper/307:23:283
291979499277,5cyclictest32-21ksoftirqd/208:20:212
291979499276,7cyclictest0-21swapper/211:50:202
291979499276,5cyclictest32-21ksoftirqd/208:05:252
291979499273,6cyclictest32-21ksoftirqd/211:55:182
291979499271,9cyclictest2963832-21sed09:15:192
2919794992718,7cyclictest3032786-21ntp_kernel_pll_12:35:202
2919789992721,3cyclictest0-21swapper/111:25:151
2919789992720,5cyclictest2921353-21kworker/u8:3+events_unbound07:54:591
2919789992718,5cyclictest0-21swapper/108:45:251
2919789992711,9cyclictest0-21swapper/109:30:251
2919785992720,5cyclictest199-21systemd-network09:30:240
291979799266,12cyclictest40-21ksoftirqd/309:20:183
291979799264,7cyclictest40-21ksoftirqd/309:50:153
291979799264,11cyclictest0-21swapper/310:31:203
2919797992614,4cyclictest131rcu_preempt11:35:223
291979499265,5cyclictest0-21swapper/210:11:002
291979499261,9cyclictest3028236-21cron12:23:002
2919794992619,3cyclictest0-21swapper/208:15:252
2919794992619,3cyclictest0-21swapper/208:15:252
291978999262,3cyclictest131rcu_preempt10:40:121
2919789992620,3cyclictest0-21swapper/111:05:131
2919789992620,3cyclictest0-21swapper/111:05:131
2919789992619,4cyclictest0-21swapper/111:50:011
2919789992618,5cyclictest2916194-21kworker/u8:2+events_unbound07:17:481
2919789992617,5cyclictest0-21swapper/111:40:001
2919789992617,5cyclictest0-21swapper/111:30:241
2919789992617,5cyclictest0-21swapper/109:35:151
2919789992612,6cyclictest131rcu_preempt10:40:011
2919785992618,5cyclictest2962880-21kworker/u8:2+events_unbound09:20:150
2919785992618,4cyclictest0-21swapper/008:20:240
291979499254,6cyclictest0-21swapper/208:35:162
2919794992518,4cyclictest0-21swapper/209:10:152
2919794992517,5cyclictest0-21swapper/208:00:262
2919794992512,4cyclictest131rcu_preempt07:20:222
2919794992510,4cyclictest131rcu_preempt10:50:232
2919794992510,4cyclictest131rcu_preempt10:41:122
2919789992519,4cyclictest2947715-21kworker/u8:3+events_unbound08:30:021
2919789992516,6cyclictest3021170-21unixbench_singl12:00:251
2919789992515,7cyclictest2933720-21grep07:45:261
2919789992513,9cyclictest231ktimers/111:40:121
2919785992519,3cyclictest2982154-21idleruntime-cro10:10:000
2919785992519,2cyclictest0-21swapper/012:07:100
2919785992517,5cyclictest2971376-21kworker/u8:3+events_unbound10:00:420
2919785992517,5cyclictest0-21swapper/007:45:000
2919785992515,7cyclictest2987257-21apt-get10:25:010
291978599251,20cyclictest0-21swapper/010:18:530
291979499247,5cyclictest32-21ksoftirqd/210:55:152
291979499247,5cyclictest32-21ksoftirqd/210:55:152
2919794992410,7cyclictest131rcu_preempt10:45:022
2919789992417,5cyclictest3027230-21kworker/u8:0+events_unbound12:30:021
2919789992415,6cyclictest0-21swapper/109:40:241
2919789992415,6cyclictest0-21swapper/109:40:241
291978999241,12cyclictest0-21swapper/108:40:061
2919785992419,3cyclictest2921353-21kworker/u8:3-events_freezable_power_07:50:200
2919785992418,3cyclictest0-21swapper/012:40:000
2919785992418,3cyclictest0-21swapper/011:40:250
2919785992417,5cyclictest2980177-21kworker/u8:0+events_unbound10:10:150
2919785992417,3cyclictest0-21swapper/010:49:200
2919785992417,3cyclictest0-21swapper/008:36:560
2919785992417,3cyclictest0-21swapper/007:37:360
2919785992415,6cyclictest2925453-21basename07:25:000
2919785992413,7cyclictest0-21swapper/008:45:260
291978599241,19cyclictest0-21swapper/011:28:380
291978599241,19cyclictest0-21swapper/010:42:130
291978599241,19cyclictest0-21swapper/009:54:360
291978599241,19cyclictest0-21swapper/009:01:430
291978599240,4cyclictest2954868-21apt-get08:50:100
291979499236,10cyclictest32-21ksoftirqd/209:05:202
291978999236,5cyclictest131rcu_preempt07:30:111
2919789992317,4cyclictest2921353-21kworker/u8:3+events_unbound08:05:441
2919789992315,6cyclictest3003873-21switchtime11:10:231
2919789992314,6cyclictest0-21swapper/112:10:221
2919789992314,3cyclictest24-21ksoftirqd/110:45:211
2919789992310,7cyclictest131rcu_preempt10:50:221
2919785992317,3cyclictest0-21swapper/012:10:180
2919785992317,3cyclictest0-21swapper/011:45:240
2919785992316,3cyclictest0-21swapper/008:43:220
291978599231,5cyclictest3017667-21date11:50:240
291978599231,20cyclictest0-21swapper/012:15:140
291978599231,19cyclictest3027145-21fschecks_time12:20:140
291978599231,18cyclictest0-21swapper/008:11:200
291978599231,18cyclictest0-21swapper/007:29:370
291978599231,18cyclictest0-21swapper/007:29:360
2919789992213,5cyclictest0-21swapper/108:50:081
291978999221,13cyclictest0-21swapper/111:24:111
291978599221,8cyclictest2932710-21cpu07:45:120
2919785992215,3cyclictest0-21swapper/011:59:190
2919785992214,5cyclictest0-21swapper/012:00:200
291978599221,3cyclictest0-21swapper/010:50:130
2919785992213,6cyclictest2988244-21ntpq10:25:190
2919785992114,3cyclictest0-21swapper/007:32:050
2919785992111,7cyclictest3010222-21cut11:30:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional