You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 18:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Wed Mar 11, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3795471995039,8cyclictest3857394-21grep10:05:252
3795466994936,9cyclictest3826910-21sendmail08:40:001
3795466994433,7cyclictest3853924-21grep09:55:231
3795466994433,7cyclictest3853924-21grep09:55:231
3795475994331,9cyclictest391ktimers/311:30:093
3795471994334,7cyclictest311ktimers/211:45:122
3795471994333,6cyclictest3833248-21grep08:55:242
3795462994332,8cyclictest3899150-21apt-get12:10:000
3795475994234,5cyclictest3833719-21cut09:00:013
3795471994232,7cyclictest3881888-21sendmail11:20:002
3795475994128,10cyclictest391ktimers/309:20:123
3795471994132,5cyclictest0-21swapper/210:55:162
3795475994029,7cyclictest0-21swapper/307:20:013
3795471994032,6cyclictest311ktimers/207:35:132
3795471994032,6cyclictest311ktimers/207:35:122
3795471994032,5cyclictest3895984-21kworker/u8:3+events_unbound12:03:492
3795462994033,4cyclictest3887211-21sh11:35:010
3795466993932,4cyclictest3861427-21cron10:20:011
3795471993827,7cyclictest3829841-21grep08:45:252
3795462993829,5cyclictest3857396-21unixbench_singl10:05:250
3795462993828,8cyclictest121ktimers/008:25:110
3795462993827,8cyclictest3802569-21tail07:25:270
3795475993726,7cyclictest3891855-21grep11:45:253
3795471993727,7cyclictest3901054-21cron12:15:002
3795462993729,4cyclictest0-21swapper/010:04:590
3795462993726,7cyclictest3904066-21grep12:20:240
3795462993726,7cyclictest3904066-21grep12:20:230
379546299372,5cyclictest131rcu_preempt07:20:140
3795462993725,8cyclictest3807675-21grep07:40:270
3795462993725,8cyclictest3807675-21grep07:40:270
3795462993718,5cyclictest0-21swapper/008:20:010
3795475993625,7cyclictest3909150-21grep12:35:253
3795471993627,5cyclictest3799400-21apt-get07:20:012
379546299363,7cyclictest3852679-21cron09:55:000
379546299363,7cyclictest3852679-21cron09:55:000
3795462993625,7cyclictest3799629-21apt-key07:20:010
3795475993528,3cyclictest0-21swapper/310:09:593
3795471993524,7cyclictest0-21swapper/210:30:012
3795466993527,4cyclictest0-21swapper/108:05:001
3795466993525,7cyclictest231ktimers/108:55:121
3795466993524,8cyclictest3813268-21sendmail08:00:001
3795466993524,7cyclictest0-21swapper/111:45:241
3795466993524,7cyclictest0-21swapper/110:40:011
3795462993527,4cyclictest0-21swapper/009:35:000
3795462993527,3cyclictest0-21swapper/012:39:590
3795475993425,4cyclictest0-21swapper/308:30:163
3795471993426,4cyclictest0-21swapper/208:20:162
3795471993424,6cyclictest0-21swapper/210:10:252
3795471993423,6cyclictest0-21swapper/210:15:252
3795466993421,11cyclictest231ktimers/110:20:101
3795462993427,4cyclictest3850992-21kthreadd09:50:000
3795462993426,4cyclictest0-21swapper/010:00:000
3795462993426,4cyclictest0-21swapper/010:00:000
3795462993426,4cyclictest0-21swapper/008:30:250
3795462993425,6cyclictest0-21swapper/012:35:000
3795462993424,7cyclictest3838402-21grep09:10:240
3795462993422,9cyclictest121ktimers/009:15:130
3795475993325,4cyclictest0-21swapper/308:05:013
3795475993324,6cyclictest0-21swapper/312:35:003
3795471993326,4cyclictest0-21swapper/209:15:172
3795471993326,3cyclictest0-21swapper/211:35:232
3795471993319,10cyclictest311ktimers/211:40:132
3795466993325,4cyclictest0-21swapper/111:30:011
3795466993325,4cyclictest0-21swapper/109:20:011
3795466993323,7cyclictest3842259-21audit_send_reply09:25:011
3795466993321,8cyclictest0-21swapper/112:35:251
3795462993326,3cyclictest0-21swapper/007:35:010
3795462993325,4cyclictest0-21swapper/010:35:260
3795462993322,7cyclictest3795803-21tune2fs07:10:160
3795475993223,6cyclictest3839258-21fschecks_time09:15:163
3795475993221,8cyclictest3881888-21sendmail11:20:003
3795471993225,4cyclictest0-21swapper/212:30:132
3795471993224,4cyclictest0-21swapper/211:00:232
3795471993223,7cyclictest3825149-21kworker/u8:0+events_unbound09:48:242
3795466993225,3cyclictest0-21swapper/111:05:001
3795466993224,4cyclictest0-21swapper/110:10:001
3795466993223,6cyclictest3878870-21fschecks_count11:10:161
3795466993223,4cyclictest0-21swapper/110:45:151
3795466993222,5cyclictest0-21swapper/107:15:011
3795466993220,8cyclictest3895752-21sendmail12:00:001
3795462993226,3cyclictest0-21swapper/012:20:000
3795462993223,6cyclictest0-21swapper/011:55:010
3795462993223,4cyclictest0-21swapper/011:25:230
3795462993221,6cyclictest3828161-21grep08:40:240
3795462993220,8cyclictest121ktimers/012:00:090
3795475993124,4cyclictest0-21swapper/310:45:273
3795475993123,5cyclictest3904058-21unixbench_singl12:20:243
3795475993123,5cyclictest3904058-21unixbench_singl12:20:233
3795475993123,4cyclictest0-21swapper/309:40:003
3795475993122,6cyclictest3866542-21sh10:35:003
3795475993121,6cyclictest0-21swapper/310:20:013
3795471993124,4cyclictest3878481-21idleruntime-cro11:10:002
3795471993124,4cyclictest0-21swapper/212:05:232
3795471993123,4cyclictest0-21swapper/207:45:142
3795471993122,4cyclictest0-21swapper/207:55:162
3795471993121,7cyclictest3849290-21idleruntime-cro09:45:002
3795471993121,6cyclictest3887354-21cat11:35:012
3795471993119,7cyclictest0-21swapper/207:40:272
3795471993119,7cyclictest0-21swapper/207:40:272
3795466993123,4cyclictest0-21swapper/111:15:281
3795466993122,6cyclictest0-21swapper/110:35:011
3795462993123,4cyclictest0-21swapper/011:40:170
3795462993123,4cyclictest0-21swapper/007:45:230
3795462993121,6cyclictest0-21swapper/008:45:250
3795462993120,6cyclictest0-21swapper/010:40:250
3795462993115,13cyclictest11-21ksoftirqd/007:50:130
379546299310,24cyclictest131rcu_preempt09:00:190
3795475993024,3cyclictest3888903-21cron11:40:013
3795475993022,5cyclictest391ktimers/307:25:153
3795475993022,4cyclictest0-21swapper/311:20:253
3795471993023,5cyclictest3816200-21unixbench_multi08:05:262
3795471993020,6cyclictest0-21swapper/208:35:162
3795471993018,9cyclictest311ktimers/212:25:112
3795471993018,9cyclictest311ktimers/212:25:102
3795466993023,4cyclictest0-21swapper/107:25:181
3795466993023,3cyclictest0-21swapper/111:00:001
3795466993022,4cyclictest0-21swapper/110:00:251
3795466993022,4cyclictest0-21swapper/108:50:141
3795466993020,7cyclictest3816660-21cron08:10:001
3795462993024,3cyclictest0-21swapper/008:00:000
3795462993022,4cyclictest3881880-21sh11:20:000
3795462993022,4cyclictest0-21swapper/012:25:250
3795462993022,4cyclictest0-21swapper/012:25:250
3795462993016,9cyclictest0-21swapper/010:55:260
3795475992922,4cyclictest0-21swapper/308:35:163
3795471992923,4cyclictest3825149-21kworker/u8:0+events_unbound10:03:282
3795471992923,3cyclictest3845870-21audit_send_reply09:35:002
3795471992922,4cyclictest0-21swapper/210:40:012
3795471992921,4cyclictest0-21swapper/210:30:242
3795471992920,6cyclictest3904028-21grep12:20:242
3795471992920,6cyclictest3904028-21grep12:20:242
3795471992920,5cyclictest0-21swapper/207:25:012
3795462992920,6cyclictest0-21swapper/012:10:250
3795462992918,7cyclictest3816113-21grep08:05:250
3795475992822,3cyclictest0-21swapper/312:00:003
3795475992820,4cyclictest0-21swapper/307:55:003
3795475992819,6cyclictest3806868-21fschecks_time07:40:173
3795475992819,6cyclictest3806868-21fschecks_time07:40:173
3795475992819,5cyclictest0-21swapper/308:10:163
3795471992821,5cyclictest3809711-21kworker/u8:1+events_unbound08:00:422
3795471992817,7cyclictest3862676-21grep10:20:242
379547199281,10cyclictest38846382awk11:25:212
3795466992822,4cyclictest3799852-21kworker/u8:2+events_unbound08:28:051
3795466992822,3cyclictest0-21swapper/111:40:011
379546299289,3cyclictest131rcu_preempt07:35:130
379546299289,3cyclictest131rcu_preempt07:35:130
3795462992821,5cyclictest3862781-21kworker/u8:3+events_unbound11:23:450
3795462992818,6cyclictest3843761-21grep09:25:260
3795462992816,8cyclictest3866075-21grep10:30:240
3795462992816,8cyclictest0-21swapper/008:58:090
3795475992720,4cyclictest0-21swapper/310:50:193
3795475992719,5cyclictest0-21swapper/310:45:013
3795475992719,4cyclictest0-21swapper/309:50:253
3795475992719,4cyclictest0-21swapper/309:50:253
3795475992719,4cyclictest0-21swapper/307:10:263
3795471992721,3cyclictest0-21swapper/209:25:012
3795471992720,5cyclictest3830249-21kworker/u8:2+events_unbound09:03:122
3795471992720,4cyclictest0-21swapper/208:30:252
3795471992720,3cyclictest0-21swapper/209:35:242
3795471992719,6cyclictest311ktimers/209:25:032
379546299273,19cyclictest204-21dbus-daemon11:48:470
379546299272,4cyclictest38726092grep10:50:220
3795462992721,3cyclictest0-21swapper/011:35:230
3795462992718,6cyclictest0-21swapper/009:40:000
3795462992717,7cyclictest3894805-21ntp_kernel_pll_11:55:180
3795475992620,4cyclictest3858728-21missed_timers10:10:193
3795475992618,4cyclictest0-21swapper/310:20:243
3795475992618,4cyclictest0-21swapper/308:45:243
3795475992617,5cyclictest0-21swapper/308:20:263
3795475992616,6cyclictest0-21swapper/311:04:593
3795471992618,5cyclictest0-21swapper/208:20:012
3795471992617,5cyclictest0-21swapper/208:40:252
3795471992616,6cyclictest0-21swapper/209:50:262
3795471992616,6cyclictest0-21swapper/209:50:252
3795471992615,7cyclictest0-21swapper/207:25:282
379546699269,4cyclictest131rcu_preempt12:15:201
3795466992619,5cyclictest3899707-21kworker/u8:1+events_unbound12:13:521
3795466992619,3cyclictest0-21swapper/108:20:261
3795466992618,4cyclictest0-21swapper/112:08:501
3795462992622,2cyclictest13550irq/42-30be0000.ethernet11:00:100
3795462992622,2cyclictest13550irq/42-30be0000.ethernet09:20:120
3795462992620,4cyclictest3855782-21kworker/u8:1+events_unbound10:23:320
3795462992620,3cyclictest0-21swapper/010:10:250
3795462992619,4cyclictest3826896-21munin-plugin-st08:40:010
3795462992614,8cyclictest438-21cron09:44:590
379547599259,7cyclictest131rcu_preempt11:11:563
379547599255,4cyclictest38777852swap11:05:263
3795475992519,4cyclictest3898058-21latency12:05:173
3795475992519,3cyclictest0-21swapper/310:30:013
3795475992518,4cyclictest0-21swapper/308:15:243
3795475992518,4cyclictest0-21swapper/307:35:263
3795475992518,4cyclictest0-21swapper/307:35:263
3795475992518,3cyclictest0-21swapper/309:40:273
3795475992517,5cyclictest0-21swapper/309:35:003
3795471992520,3cyclictest3873561-21latency_hist10:55:012
3795471992519,3cyclictest0-21swapper/207:50:182
3795471992518,5cyclictest3899707-21kworker/u8:1+events_unbound12:35:442
3795471992518,5cyclictest3857709-21kworker/u8:2+events_unbound10:45:152
3795471992518,4cyclictest0-21swapper/211:50:172
3795471992518,4cyclictest0-21swapper/210:40:242
3795471992516,6cyclictest3838059-21fgrep09:10:232
3795466992518,3cyclictest0-21swapper/109:40:011
3795466992517,4cyclictest0-21swapper/107:40:011
3795466992517,4cyclictest0-21swapper/107:40:011
3795466992516,4cyclictest3799432-21sendmail-msp07:20:011
3795466992515,7cyclictest231ktimers/112:00:101
3795466992515,7cyclictest0-21swapper/107:45:181
3795475992418,3cyclictest3800396-21ntpq07:20:213
3795475992418,3cyclictest0-21swapper/311:25:203
3795475992416,5cyclictest3836731-21unixbench_singl09:05:283
3795475992412,10cyclictest3795454-21cyclictest10:35:143
379547599241,20cyclictest3901824-21ntpq12:15:193
3795471992418,3cyclictest0-21swapper/212:15:182
3795471992418,3cyclictest0-21swapper/211:55:122
3795471992417,4cyclictest3822229-21fschecks_time08:25:142
3795471992416,5cyclictest0-21swapper/211:20:162
3795471992416,5cyclictest0-21swapper/207:30:252
3795471992416,4cyclictest0-21swapper/207:10:252
3795466992418,3cyclictest0-21swapper/112:25:181
3795466992418,3cyclictest0-21swapper/112:25:181
3795466992418,3cyclictest0-21swapper/109:40:191
3795466992416,5cyclictest3869958-21sh10:45:001
3795466992416,5cyclictest3646133-1kworker/1:2H+kblockd09:50:011
3795466992416,5cyclictest3646133-1kworker/1:2H+kblockd09:50:011
3795466992414,7cyclictest3835780-21df09:05:171
379546699241,19cyclictest3883692-21sshd11:23:431
379546699241,11cyclictest0-21swapper/109:31:131
3795462992417,3cyclictest0-21swapper/010:47:570
379546299241,19cyclictest0-21swapper/010:15:460
3795475992317,4cyclictest3850580-21unixbench_singl09:45:253
3795475992315,5cyclictest0-21swapper/309:55:143
3795475992315,5cyclictest0-21swapper/309:55:143
3795475992314,7cyclictest3855921-21seq10:02:553
3795475992314,6cyclictest3893169-21awk11:50:243
3795475992313,7cyclictest3808628-21ls07:45:133
3795475992312,7cyclictest3811923-21uniq07:55:173
3795471992317,3cyclictest0-21swapper/211:10:102
3795471992317,3cyclictest0-21swapper/208:50:182
3795471992317,3cyclictest0-21swapper/208:10:162
3795471992316,4cyclictest0-21swapper/209:05:282
3795466992317,3cyclictest3803399-21fschecks_count07:30:151
3795466992315,4cyclictest0-21swapper/107:22:541
3795466992312,3cyclictest3864852-21idleruntime-cro10:30:011
3795462992317,3cyclictest13550irq/42-30be0000.ethernet08:10:170
379546299231,18cyclictest0-21swapper/010:27:100
379546299231,18cyclictest0-21swapper/008:53:470
3795475992216,4cyclictest0-21swapper/307:30:243
3795466992216,3cyclictest0-21swapper/111:30:231
3795466992215,3cyclictest0-21swapper/108:15:011
3795466992213,5cyclictest0-21swapper/111:05:281
3795462992218,2cyclictest0-21swapper/009:05:160
3795462992215,4cyclictest0-21swapper/011:10:260
3795462992215,3cyclictest0-21swapper/011:06:590
3795475992115,3cyclictest0-21swapper/311:40:263
3795475992115,3cyclictest0-21swapper/309:00:223
3795475992114,4cyclictest0-21swapper/308:25:153
3795475992112,4cyclictest438-21cron08:45:013
3795471992115,3cyclictest0-21swapper/209:55:192
3795471992115,3cyclictest0-21swapper/209:55:192
379546699216,4cyclictest131rcu_preempt08:47:291
3795466992115,3cyclictest0-21swapper/108:15:181
3795466992113,5cyclictest0-21swapper/110:15:011
3795466992111,6cyclictest0-21swapper/108:45:011
379546299211,3cyclictest0-21swapper/008:21:210
379547599209,8cyclictest3830714-21cut08:50:153
3795475992014,4cyclictest391ktimers/312:00:093
3795475992014,4cyclictest0-21swapper/310:55:173
3795475992013,5cyclictest391ktimers/312:10:063
3795475992013,4cyclictest3842890-21fschecks_time09:25:163
3795466992014,3cyclictest0-21swapper/112:30:171
3795466992013,4cyclictest231ktimers/109:28:131
379546699192,12cyclictest3835420-21cron09:05:001
3795466991913,3cyclictest0-21swapper/112:20:221
3795466991913,3cyclictest0-21swapper/112:20:221
3795466991913,3cyclictest0-21swapper/108:30:171
3795466991912,4cyclictest3849700-21fschecks_count09:45:171
3795466991911,5cyclictest0-21swapper/107:50:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional