You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 15:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Tue Dec 09, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3952246995245,5cyclictest4042666-21kworker/u8:0+events_unbound11:35:163
3952238994533,9cyclictest3980505-21idleruntime-cro08:30:011
3952235994535,6cyclictest3972132-21fschecks_count08:05:160
3952235994534,7cyclictest3990731-21munin-plugin-st09:00:000
3952238994434,7cyclictest3976881-21sendmail08:20:001
3952235994434,6cyclictest3986903-21grep08:45:270
3952246994236,4cyclictest4059471-21kworker/u8:1+events_unbound12:30:283
3952241994231,8cyclictest311ktimers/210:10:162
3952235994134,4cyclictest4046148-21cron11:40:010
3952246994032,4cyclictest0-21swapper/311:59:593
3952246994030,6cyclictest215-21dbus-daemon11:40:173
3952241994027,9cyclictest1-21systemd12:15:242
3952238994032,5cyclictest4007999-21cron09:50:001
3952238994032,5cyclictest4007999-21cron09:50:001
3952246993927,9cyclictest391ktimers/307:20:143
3952246993827,7cyclictest4018448-21sh10:20:013
3952246993823,5cyclictest3959239-21kworker/u8:0+events_unbound07:44:513
3952241993831,5cyclictest4047860-21kworker/u8:2+events_unbound12:00:212
3952235993827,6cyclictest0-21swapper/010:39:590
3952241993729,6cyclictest311ktimers/210:05:152
3952238993729,4cyclictest0-21swapper/111:35:161
3952235993730,4cyclictest4042291-21unixbench_multi11:25:270
3952246993628,4cyclictest3952226-21cyclictest10:09:593
3952241993627,5cyclictest4018020-21unixbench_singl10:15:252
3952241993627,5cyclictest0-21swapper/211:10:152
3952241993625,7cyclictest3959124-21grep07:25:282
3952238993626,6cyclictest0-21swapper/108:50:001
3952246993529,4cyclictest4010743-21kworker/u8:0+events_unbound09:59:583
3952246993528,4cyclictest0-21swapper/311:10:003
3952246993516,7cyclictest131rcu_preempt11:30:113
3952241993526,5cyclictest0-21swapper/209:35:152
3952238993527,4cyclictest4056401-21idleruntime-cro12:10:001
3952238993525,6cyclictest0-21swapper/110:20:011
3952238993523,7cyclictest0-21swapper/107:15:011
3952235993527,4cyclictest0-21swapper/009:55:270
3952235993526,4cyclictest0-21swapper/008:45:010
3952235993525,6cyclictest0-21swapper/011:10:010
3952235993524,6cyclictest0-21swapper/008:15:260
3952246993425,5cyclictest0-21swapper/308:25:233
3952241993426,5cyclictest4028591-21kworker/u8:1+events_unbound10:50:072
3952241993426,4cyclictest0-21swapper/209:30:012
3952241993424,5cyclictest0-21swapper/210:45:002
3952238993426,4cyclictest3995539-21timerwakeupswit09:10:241
3952238993426,4cyclictest0-21swapper/108:10:271
3952238993424,6cyclictest0-21swapper/109:20:261
3952238993424,6cyclictest0-21swapper/107:40:011
3952238993422,9cyclictest231ktimers/110:55:151
3952235993423,6cyclictest0-21swapper/007:15:010
3952246993323,6cyclictest0-21swapper/309:45:283
3952246993323,6cyclictest0-21swapper/309:45:273
3952241993322,7cyclictest3967919-21grep07:50:252
3952238993325,4cyclictest0-21swapper/111:40:271
3952238993325,4cyclictest0-21swapper/107:20:161
3952238993324,4cyclictest0-21swapper/111:10:011
3952235993321,8cyclictest0-21swapper/010:20:010
3952235993318,11cyclictest121ktimers/009:45:160
3952235993318,11cyclictest121ktimers/009:45:150
395224699327,7cyclictest131rcu_preempt09:50:113
395224699327,7cyclictest131rcu_preempt09:50:113
3952246993225,5cyclictest4042666-21kworker/u8:0+events_unbound11:51:313
3952246993225,5cyclictest4038752-21kworker/u8:1+events_unbound11:29:313
3952246993225,5cyclictest4030361-21kworker/u8:0+events_unbound10:55:093
3952246993225,3cyclictest0-21swapper/310:30:233
3952246993223,4cyclictest0-21swapper/309:15:163
3952241993225,4cyclictest0-21swapper/211:05:262
3952241993224,5cyclictest0-21swapper/212:35:242
3952241993224,4cyclictest0-21swapper/208:00:322
3952241993223,6cyclictest0-21swapper/210:30:002
3952241993222,7cyclictest3964838-21latency_hist07:45:002
395223899328,7cyclictest0-21swapper/112:15:231
3952238993225,4cyclictest3959603-21idleruntime-cro07:30:001
3952238993224,4cyclictest0-21swapper/111:20:171
3952238993224,4cyclictest0-21swapper/107:45:321
3952238993224,4cyclictest0-21swapper/107:45:311
3952238993218,7cyclictest131rcu_preempt10:00:591
3952235993222,7cyclictest0-21swapper/007:45:010
3952235993222,6cyclictest0-21swapper/010:30:020
3952235993222,6cyclictest0-21swapper/009:30:270
3952235993222,6cyclictest0-21swapper/008:50:270
3952246993125,4cyclictest4064723-21kworker/u8:2+events_unbound12:35:283
3952246993124,4cyclictest0-21swapper/308:00:303
3952246993123,4cyclictest0-21swapper/312:15:253
3952246993123,4cyclictest0-21swapper/311:15:283
3952246993123,4cyclictest0-21swapper/308:20:263
3952246993122,4cyclictest0-21swapper/310:35:033
395224699310,3cyclictest0-21swapper/309:05:133
3952241993123,4cyclictest0-21swapper/211:00:282
3952241993123,4cyclictest0-21swapper/209:00:302
3952241993123,4cyclictest0-21swapper/208:30:252
3952241993122,5cyclictest0-21swapper/211:45:452
395223899319,6cyclictest0-21swapper/108:50:151
395223899315,6cyclictest3954307-21munin-node07:15:021
3952238993110,5cyclictest24-21ksoftirqd/109:40:011
3952235993124,4cyclictest0-21swapper/012:10:310
3952235993123,4cyclictest0-21swapper/010:00:170
3952235993123,4cyclictest0-21swapper/009:15:010
3952246993024,4cyclictest4042666-21kworker/u8:0+events_unbound11:45:123
3952246993023,5cyclictest3994311-21kworker/u8:1+events_unbound09:10:433
3952246993023,3cyclictest0-21swapper/310:45:163
3952246993023,3cyclictest0-21swapper/310:45:163
3952246993022,6cyclictest4020063-21kworker/u8:2+events_unbound10:25:143
3952246993022,5cyclictest3956188-21cut07:20:013
3952246993014,6cyclictest4014603-21kworker/u8:2+events_unbound10:13:293
3952241993022,4cyclictest0-21swapper/209:40:162
3952241993021,5cyclictest0-21swapper/212:20:242
3952241993019,7cyclictest0-21swapper/207:35:272
395223899309,6cyclictest0-21swapper/107:50:161
395223899309,3cyclictest0-21swapper/112:25:261
395223899309,3cyclictest0-21swapper/112:25:261
395223899308,6cyclictest0-21swapper/110:40:241
395223899302,7cyclictest3997767-21latency_hist09:20:001
3952238993017,10cyclictest3952226-21cyclictest10:10:161
3952238993014,9cyclictest131rcu_preempt11:02:201
3952235993024,3cyclictest0-21swapper/012:24:590
3952235993021,5cyclictest0-21swapper/010:59:590
3952235993020,6cyclictest0-21swapper/010:10:270
3952235993020,5cyclictest0-21swapper/008:00:190
3952235993019,7cyclictest0-21swapper/011:10:240
3952235993019,6cyclictest0-21swapper/012:00:250
3952235993019,6cyclictest0-21swapper/011:20:270
3952246992922,5cyclictest4035854-21kworker/u8:0+events_unbound11:20:133
3952246992922,3cyclictest0-21swapper/309:00:293
3952246992921,4cyclictest0-21swapper/307:55:353
3952246992918,7cyclictest0-21swapper/308:05:263
3952246992916,8cyclictest391ktimers/312:05:103
3952246992916,6cyclictest4000865-21kworker/u8:0+events_unbound09:29:493
3952246992912,10cyclictest3976706-21kworker/u8:1+events_unbound08:39:483
3952241992924,3cyclictest3989849-21kworker/u8:1+events_unbound08:59:482
3952241992921,5cyclictest0-21swapper/207:10:262
3952241992921,4cyclictest0-21swapper/211:50:182
395223899299,6cyclictest24-21ksoftirqd/111:15:011
395223899297,5cyclictest24-21ksoftirqd/108:35:021
395223899296,6cyclictest0-21swapper/110:25:261
395223899296,5cyclictest24-21ksoftirqd/108:55:231
3952238992921,4cyclictest0-21swapper/111:10:111
3952238992920,6cyclictest4028272-21unixbench_singl10:45:251
3952238992920,6cyclictest4028272-21unixbench_singl10:45:251
3952238992920,5cyclictest0-21swapper/110:40:001
3952235992921,4cyclictest0-21swapper/011:50:170
3952235992920,5cyclictest0-21swapper/011:55:260
3952235992919,6cyclictest0-21swapper/007:25:010
3952246992822,4cyclictest3968151-21kworker/u8:2+events_unbound08:13:423
3952246992821,4cyclictest0-21swapper/308:45:273
3952241992822,3cyclictest0-21swapper/212:05:152
3952241992821,3cyclictest0-21swapper/210:40:002
3952241992820,4cyclictest0-21swapper/209:10:002
3952241992819,5cyclictest0-21swapper/209:10:262
3952241992819,4cyclictest0-21swapper/208:40:172
395223899288,6cyclictest0-21swapper/108:00:241
395223899287,5cyclictest0-21swapper/107:30:131
3952238992821,4cyclictest0-21swapper/111:45:441
3952238992820,4cyclictest0-21swapper/112:00:011
3952238992816,8cyclictest1-21systemd09:59:571
3952238992815,8cyclictest131rcu_preempt12:04:441
395223599289,16cyclictest4027914-21wc10:45:230
395223599289,16cyclictest4027914-21wc10:45:230
3952235992820,3cyclictest0-21swapper/007:40:010
3952235992819,5cyclictest0-21swapper/010:45:000
3952235992818,6cyclictest0-21swapper/012:25:270
3952235992818,6cyclictest0-21swapper/012:25:270
3952235992817,7cyclictest4059795-21cron12:20:000
3952246992717,6cyclictest4033378-21grep11:00:263
3952246992714,5cyclictest4047860-21kworker/u8:2+events_unbound12:13:013
3952246992713,4cyclictest3987545-21kworker/u8:0+events_unbound08:50:183
3952241992719,6cyclictest146-21jbd2/mmcblk1p2-812:31:042
3952241992719,4cyclictest0-21swapper/211:25:282
3952241992718,6cyclictest311ktimers/207:55:142
3952241992717,7cyclictest3997208-21cat09:15:252
395223899278,6cyclictest0-21swapper/110:05:271
395223899278,5cyclictest4006363-21sed09:45:001
395223899278,10cyclictest0-21swapper/111:50:141
395223899276,4cyclictest3994481-21cat09:10:011
3952238992719,4cyclictest0-21swapper/108:20:271
3952235992717,6cyclictest0-21swapper/009:25:260
3952235992717,6cyclictest0-21swapper/008:35:260
395224699262,4cyclictest131rcu_preempt08:30:123
3952246992620,4cyclictest3962726-21kworker/u8:1+events_unbound07:48:093
3952246992620,4cyclictest3962726-21kworker/u8:1+events_unbound07:48:093
3952246992619,5cyclictest3956418-21kworker/u8:3+events_unbound07:35:193
3952246992618,5cyclictest3956418-21kworker/u8:3+events_unbound07:25:163
3952246992618,4cyclictest0-21swapper/310:00:263
3952246992617,6cyclictest3948644-21kworker/u8:1+events_unbound07:10:223
3952246992612,8cyclictest0-21swapper/308:20:013
3952241992620,3cyclictest0-21swapper/212:30:002
3952241992620,3cyclictest0-21swapper/212:30:002
3952241992618,4cyclictest0-21swapper/209:45:282
3952241992618,4cyclictest0-21swapper/209:45:282
3952241992613,9cyclictest3952226-21cyclictest07:20:142
395223899269,5cyclictest131rcu_preempt07:40:141
395223899268,4cyclictest131rcu_preempt09:00:061
395223899263,5cyclictest4023569-21latency_hist10:35:001
3952238992616,6cyclictest0-21swapper/108:05:261
3952238992616,3cyclictest131rcu_preempt07:56:241
395223599263,19cyclictest0-21swapper/010:27:420
3952235992619,5cyclictest3956418-21kworker/u8:3+events_unbound07:31:080
3952235992619,3cyclictest0-21swapper/010:10:000
3952235992617,6cyclictest4030395-21basename10:55:000
3952235992616,6cyclictest0-21swapper/009:20:250
395224699255,5cyclictest40-21ksoftirqd/307:54:103
3952246992519,4cyclictest4029087-21cut10:50:173
3952246992519,3cyclictest0-21swapper/312:00:153
3952246992518,5cyclictest4012825-21kworker/u8:1+events_unbound10:40:113
3952246992517,4cyclictest0-21swapper/312:25:173
3952246992517,4cyclictest0-21swapper/312:25:163
3952246992516,5cyclictest4000865-21kworker/u8:0+events_unbound09:30:523
3952241992519,3cyclictest0-21swapper/207:45:292
3952241992519,3cyclictest0-21swapper/207:45:292
3952241992518,4cyclictest0-21swapper/210:00:192
3952241992518,3cyclictest0-21swapper/209:30:252
3952241992517,5cyclictest3999017-21unixbench_multi09:20:262
3952241992517,4cyclictest0-21swapper/208:50:182
3952241992517,4cyclictest0-21swapper/207:19:272
3952241992516,4cyclictest0-21swapper/208:19:382
395223899254,4cyclictest221rcuc/108:35:161
395223899253,6cyclictest4041809-21missed_timers11:25:221
3952238992516,5cyclictest4020163-21auditctl10:25:011
3952238992514,4cyclictest131rcu_preempt10:54:011
3952235992517,5cyclictest121ktimers/012:05:190
3952235992517,5cyclictest0-21swapper/009:40:250
3952235992516,6cyclictest121ktimers/009:00:110
3952246992418,4cyclictest4061212-21kworker/u8:2+events_unbound12:24:443
3952246992418,4cyclictest3996034-21kworker/u8:2+events_unbound09:22:503
3952246992418,3cyclictest0-21swapper/309:40:003
3952241992418,3cyclictest0-21swapper/208:10:232
3952241992417,4cyclictest4046529-21sshd11:40:172
395223899249,4cyclictest131rcu_preempt12:30:591
395223899245,6cyclictest0-21swapper/109:50:161
395223899245,6cyclictest0-21swapper/109:50:161
395223899242,15cyclictest0-21swapper/108:42:531
3952238992416,4cyclictest0-21swapper/109:25:261
3952238992410,7cyclictest131rcu_preempt11:30:211
3952235992417,4cyclictest3956172-21cron07:20:010
3952235992415,5cyclictest0-21swapper/012:30:260
3952235992415,5cyclictest0-21swapper/009:54:490
3952235992415,5cyclictest0-21swapper/009:54:490
3952235992412,9cyclictest4066649-21tr12:40:000
395223599241,21cyclictest4046499-21cstates11:40:150
395223599241,20cyclictest4037207-21apt-get11:15:050
395223599241,19cyclictest0-21swapper/009:09:050
395223599241,19cyclictest0-21swapper/007:49:580
395223599241,19cyclictest0-21swapper/007:49:580
3952246992317,4cyclictest4012825-21kworker/u8:1+events_unbound10:23:023
3952246992312,2cyclictest0-21swapper/308:40:253
3952241992317,3cyclictest0-21swapper/211:30:172
3952241992317,3cyclictest0-21swapper/210:00:002
3952241992316,4cyclictest0-21swapper/211:40:002
3952241992316,4cyclictest0-21swapper/208:45:192
3952241992315,4cyclictest39805042sleep208:30:012
395223899238,9cyclictest131rcu_preempt12:35:461
3952235992316,3cyclictest0-21swapper/008:32:090
3952235992312,8cyclictest3974732-21grep08:10:270
395223599231,18cyclictest0-21swapper/009:16:440
395223599231,18cyclictest0-21swapper/007:25:480
395223599230,19cyclictest0-21swapper/010:23:560
395223599230,19cyclictest0-21swapper/007:54:500
395224699226,5cyclictest40-21ksoftirqd/308:55:293
3952241992216,3cyclictest0-21swapper/210:30:262
3952241992216,3cyclictest0-21swapper/208:05:232
3952241992214,4cyclictest0-21swapper/211:20:012
3952235992215,3cyclictest0-21swapper/007:57:490
3952235992214,5cyclictest3977433-21df08:20:130
3952235992210,8cyclictest4044041-21grep11:30:250
395223599220,18cyclictest0-21swapper/011:48:590
395223599220,18cyclictest0-21swapper/011:01:330
3952246992113,6cyclictest391ktimers/309:40:123
3952241992115,4cyclictest146-21jbd2/mmcblk1p2-810:55:062
3952241992115,4cyclictest0-21swapper/211:55:252
3952241992115,3cyclictest0-21swapper/208:20:162
3952241992114,4cyclictest0-21swapper/207:30:262
395224199211,11cyclictest0-21swapper/210:45:212
395224199211,11cyclictest0-21swapper/210:45:212
395223599211,17cyclictest4003957-21/usr/sbin/munin09:35:250
3952241992012,5cyclictest4056848-21fschecks_time12:10:222
3952241991914,3cyclictest4018699-21/usr/sbin/munin10:20:142
3952241991912,4cyclictest4009708-21auditctl09:55:002
3952241991912,4cyclictest4009708-21auditctl09:54:592
395224199188,8cyclictest3982575-21cut08:35:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional