You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 15:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Mon Jul 13, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2573527995226,22cyclictest0-21swapper/211:05:002
2573531995137,10cyclictest391ktimers/312:20:133
2573527995116,30cyclictest311ktimers/208:50:122
2573531995025,20cyclictest0-21swapper/309:05:113
2573531994827,17cyclictest0-21swapper/311:30:163
2573527994839,6cyclictest2580430-21grep07:25:292
2573531994618,25cyclictest0-21swapper/311:30:003
2573523994640,4cyclictest2670334-21kworker/u8:0+events_unbound11:55:401
2573523994636,7cyclictest2637184-21grep10:10:261
2573531994538,4cyclictest2634353-21fschecks_count10:05:173
2573519994536,5cyclictest2673828-21sh12:00:000
2573531994436,5cyclictest2677259-21latency_hist12:10:003
2573531994435,5cyclictest2687707-21munin-plugin-st12:40:003
2573527994437,4cyclictest2628458-21unixbench_singl09:45:252
2573523994436,5cyclictest2580111-21sendmail_mailqu07:25:271
2573519994334,6cyclictest2611357-21grep08:55:270
2573531994234,5cyclictest2672120-21cron11:55:003
257353199422,4cyclictest2653611-21apt-get11:00:123
2573527994226,11cyclictest311ktimers/211:25:122
2573523994236,4cyclictest2667707-21kworker/u8:3+events_unbound11:45:381
2573531994125,13cyclictest0-21swapper/312:15:003
257353199411,11cyclictest2656303-21unixbench_multi11:05:253
257352799411,8cyclictest2600116-21/usr/sbin/munin08:25:172
257352799411,10cyclictest2601579-21apt-get08:30:122
2573531994033,4cyclictest2660218-21idleruntime-cro11:20:003
257353199401,11cyclictest0-21swapper/308:50:123
257352799409,28cyclictest2643467-21ntp_kernel_err10:30:202
257352799407,28cyclictest0-21swapper/208:15:282
257352799401,9cyclictest2664904-21head11:30:302
257352799401,11cyclictest2639994-21/usr/sbin/munin10:20:192
257352799401,10cyclictest2631245-21/usr/sbin/munin09:55:202
2573523994033,5cyclictest2589200-21kworker/u8:1+events_unbound07:54:511
2573531993932,4cyclictest2673823-21cron12:00:003
2573531993929,6cyclictest0-21swapper/307:45:003
2573531993920,16cyclictest0-21swapper/309:50:013
257353199391,9cyclictest2683506-21/usr/sbin/munin12:25:243
257353199391,9cyclictest2650890-21/usr/sbin/munin10:50:253
257353199391,9cyclictest2650890-21/usr/sbin/munin10:50:253
257352799399,27cyclictest2595200-21/usr/sbin/munin08:10:192
2573527993930,5cyclictest0-21swapper/211:45:372
257352799391,9cyclictest2658873-21cut11:15:162
257352799391,8cyclictest2632813-21if_eth010:00:182
257352799391,6cyclictest2658474-21cron11:15:002
257352799391,10cyclictest2682384-21apt-get12:25:062
257352799391,10cyclictest2634543-21/usr/sbin/munin10:05:202
257352799391,10cyclictest2622604-21/usr/sbin/munin09:30:182
257352799391,10cyclictest2589838-21/usr/sbin/munin07:55:182
2573519993932,4cyclictest2578768-21runrttasks07:20:250
257353199382,9cyclictest2653187-21runrttasks11:00:003
257353199382,9cyclictest2653187-21runrttasks11:00:003
257353199381,9cyclictest2631366-21/usr/sbin/munin09:55:233
257353199381,10cyclictest2588376-21/usr/sbin/munin07:50:223
257352799383,7cyclictest2594517-21latency_hist08:10:012
2573527993830,4cyclictest0-21swapper/211:00:002
2573527993830,4cyclictest0-21swapper/211:00:002
257352799382,5cyclictest2646813-21meminfo10:40:172
257352799381,9cyclictest2665662-21/usr/sbin/munin11:35:142
257352799381,8cyclictest2636645-21/usr/sbin/munin10:10:212
257352799381,8cyclictest2610892-21/usr/sbin/munin08:55:232
257352799381,8cyclictest2588599-21/usr/sbin/munin07:50:252
257352799381,7cyclictest2672363-21/usr/sbin/munin11:55:182
257352799381,7cyclictest2650956-21/usr/sbin/munin10:50:252
257352799381,7cyclictest2650956-21/usr/sbin/munin10:50:252
257352799381,6cyclictest2676814-21/usr/sbin/munin12:05:302
257352799381,6cyclictest2675171-21sshd12:00:342
257352799381,5cyclictest2645168-21/usr/sbin/munin10:35:222
2573523993832,4cyclictest2590913-21kworker/u8:0+events_unbound08:55:111
2573519993827,7cyclictest2633581-21grep10:00:290
2573519993826,8cyclictest2628375-21grep09:45:250
257353199373,3cyclictest2667493-21fw_packets11:40:173
257353199373,3cyclictest2667493-21fw_packets11:40:163
257353199372,9cyclictest2592401-21unixbench_singl08:00:293
257353199372,8cyclictest2581272-21fschecks_count07:30:163
2573531993726,7cyclictest0-21swapper/311:40:003
257353199372,3cyclictest2626450-21swap09:40:253
257353199371,9cyclictest2679309-21/usr/sbin/munin12:15:163
257353199371,9cyclictest2641386-21sort10:25:163
257353199371,9cyclictest2616129-21wc09:10:253
257353199371,9cyclictest2598526-21/usr/sbin/munin08:20:193
257353199371,8cyclictest2657496-21grep11:10:183
257353199371,7cyclictest2643234-21/usr/sbin/munin10:30:173
257353199371,7cyclictest2630128-21grep09:50:253
257353199371,7cyclictest2610428-21df_inode08:55:163
257353199371,5cyclictest2647836-21apt-get10:45:063
257353199371,5cyclictest2622933-21/usr/sbin/munin09:30:243
257353199371,12cyclictest2640086-21grep10:20:213
257352799378,26cyclictest164-21systemd-journal09:10:102
257352799371,9cyclictest2642775-21latency_hist10:30:012
257352799371,9cyclictest2624012-21/usr/sbin/munin09:35:122
257352799371,9cyclictest2577973-21/usr/sbin/munin07:20:172
257352799371,8cyclictest2614255-21/usr/sbin/munin09:05:202
257352799371,7cyclictest2681759-21/usr/sbin/munin12:20:242
257352799371,5cyclictest2619078-21fschecks_time09:20:172
257352799371,5cyclictest2582898-21/usr/sbin/munin07:35:142
257352799371,4cyclictest2638009-21/usr/sbin/munin10:15:182
2573523993731,4cyclictest2656485-21kworker/u8:1+events_unbound11:24:421
2573523993729,4cyclictest2591115-21sendmail08:00:001
2573519993725,8cyclictest0-21swapper/007:15:010
257353199368,24cyclictest2589740-21df_inode07:55:163
257353199367,26cyclictest2674184-21expr12:00:123
257353199365,5cyclictest2661030-21/usr/sbin/munin11:20:233
257353199363,6cyclictest2595072-21awk08:10:173
257353199363,4cyclictest2599991-21df_inode08:25:153
2573531993627,6cyclictest0-21swapper/307:45:273
2573531993627,6cyclictest0-21swapper/307:45:263
257353199362,4cyclictest2603443-21fschecks_count08:35:163
257353199362,4cyclictest2603443-21fschecks_count08:35:163
257353199361,9cyclictest2637824-21munin-node10:15:133
257353199361,8cyclictest2685409-21grep12:30:263
257353199361,8cyclictest2619156-21if_eth009:20:183
257353199361,8cyclictest2583070-21/usr/sbin/munin07:35:163
257353199361,8cyclictest2577829-21/usr/sbin/munin07:20:153
257353199361,7cyclictest2645178-21/usr/sbin/munin10:35:213
257353199361,6cyclictest2632748-21fschecks_time10:00:173
257353199361,5cyclictest2646704-21/usr/sbin/munin10:40:173
257353199361,5cyclictest2636573-21meminfo10:10:193
257353199361,5cyclictest2597829-21seq08:19:023
257353199361,4cyclictest2669484-21/usr/sbin/munin11:45:223
257353199361,4cyclictest2612244-21grep09:00:173
257352799369,22cyclictest0-21swapper/208:50:012
257352799368,25cyclictest2685461-21cat12:30:272
257352799367,7cyclictest2686739-21cat12:35:202
257352799363,4cyclictest2612596-21ntp_states09:00:222
257352799362,4cyclictest2606287-21cron08:43:002
257352799361,9cyclictest2679881-21wc12:15:252
257352799361,9cyclictest2626136-21/usr/sbin/munin09:40:202
257352799361,9cyclictest2573802-21/usr/sbin/munin07:10:152
257352799361,7cyclictest645-21runrttasks09:51:102
257352799361,5cyclictest2667949-21fgrep11:40:252
257352799361,5cyclictest2667949-21fgrep11:40:252
257352799361,3cyclictest2586671-21meminfo07:45:202
257352799361,3cyclictest2586671-21meminfo07:45:202
257352799361,12cyclictest2656302-21tail11:05:252
257352799361,10cyclictest2662043-21cat11:25:022
257352799361,10cyclictest2621026-21wc09:25:202
257352799361,10cyclictest2586051-21date07:45:012
257352799360,11cyclictest2677718-21fschecks_time12:10:162
2573523993630,4cyclictest2656485-21kworker/u8:1+events_unbound11:32:411
2573523993626,7cyclictest231ktimers/110:50:111
2573523993626,7cyclictest231ktimers/110:50:111
2573523993625,6cyclictest0-21swapper/109:45:001
2573523993610,8cyclictest24-21ksoftirqd/109:50:161
2573519993623,9cyclictest2653163-21awk11:00:000
2573519993623,9cyclictest2653163-21awk11:00:000
257353199352,8cyclictest164-21systemd-journal09:35:133
257353199351,9cyclictest2573959-21/usr/sbin/munin07:10:173
257353199351,8cyclictest2605936-21/usr/sbin/munin08:40:243
257353199351,8cyclictest2593163-21df_inode08:05:163
257353199351,8cyclictest2575679-21munin-node07:15:033
257353199351,7cyclictest2606700-21munin-node08:45:123
257353199351,5cyclictest2621904-21runrttasks09:28:363
257353199351,5cyclictest2617685-21/usr/sbin/munin09:15:233
257352799352,5cyclictest2670874-21cut11:50:182
257352799351,9cyclictest2648370-21/usr/sbin/munin10:45:152
257352799351,6cyclictest2582147-21head07:30:282
257352799351,5cyclictest2617232-21/usr/sbin/munin09:15:152
257352799351,5cyclictest2603442-21fschecks_count08:35:162
257352799351,5cyclictest2603442-21fschecks_count08:35:162
257352799351,5cyclictest2598313-21cut08:20:162
257352799351,5cyclictest2576616-21/usr/sbin/munin07:15:262
2573523993529,4cyclictest2577187-21kworker/u8:0+events_unbound07:44:421
2573523993525,6cyclictest0-21swapper/111:00:001
2573523993525,6cyclictest0-21swapper/111:00:001
2573523993525,6cyclictest0-21swapper/107:20:011
2573523993524,3cyclictest131rcu_preempt10:00:171
2573519993526,5cyclictest0-21swapper/010:15:280
2573519993526,5cyclictest0-21swapper/008:30:000
257353199341,7cyclictest2602425-21timerandwakeup08:30:263
2573523993428,4cyclictest2676929-21kworker/u8:2+events_unbound12:06:401
2573523993426,6cyclictest2682233-21kworker/u8:2+events_unbound12:32:401
2573523993424,4cyclictest131rcu_preempt11:10:231
2573519993426,4cyclictest0-21swapper/011:00:160
2573519993423,6cyclictest0-21swapper/009:40:000
2573523993322,5cyclictest131rcu_preempt07:49:481
2573523993322,5cyclictest131rcu_preempt07:49:481
2573523993315,5cyclictest131rcu_preempt11:15:231
2573519993324,5cyclictest0-21swapper/009:20:170
2573519993324,4cyclictest0-21swapper/008:30:170
2573519993321,8cyclictest2614776-21grep09:05:260
2573519993321,7cyclictest0-21swapper/010:50:270
2573519993321,7cyclictest0-21swapper/010:50:260
257352399328,7cyclictest24-21ksoftirqd/109:15:001
257352399326,5cyclictest24-21ksoftirqd/107:20:231
257352399323,17cyclictest24-21ksoftirqd/110:30:011
2573523993217,9cyclictest131rcu_preempt07:10:251
2573523993214,9cyclictest131rcu_preempt09:35:181
2573523993210,6cyclictest131rcu_preempt10:45:251
2573523993210,5cyclictest131rcu_preempt12:20:011
2573519993224,4cyclictest0-21swapper/010:10:000
2573519993223,6cyclictest2657221-21fschecks_time11:10:140
2573519993223,5cyclictest0-21swapper/011:30:000
2573519993220,8cyclictest2670425-21sh11:50:000
257352399319,7cyclictest24-21ksoftirqd/109:20:001
257352399317,7cyclictest24-21ksoftirqd/110:10:011
257352399317,6cyclictest24-21ksoftirqd/110:15:221
257352399315,7cyclictest24-21ksoftirqd/112:10:181
257352399315,6cyclictest24-21ksoftirqd/111:40:261
257352399315,6cyclictest24-21ksoftirqd/111:40:261
2573523993122,5cyclictest0-21swapper/109:55:261
2573523993121,7cyclictest231ktimers/111:25:201
2573523993120,3cyclictest131rcu_preempt08:35:201
2573523993120,3cyclictest131rcu_preempt08:35:201
2573523993115,3cyclictest131rcu_preempt12:35:251
2573523993112,10cyclictest131rcu_preempt08:15:401
2573523993111,4cyclictest0-21swapper/111:35:121
2573523993110,13cyclictest131rcu_preempt10:40:221
2573519993123,4cyclictest0-21swapper/009:40:270
2573519993123,4cyclictest0-21swapper/009:00:260
2573519993122,5cyclictest2577467-21grep07:20:010
2573519993122,5cyclictest13550irq/42-30be0000.ethernet09:15:100
257352399309,12cyclictest24-21ksoftirqd/108:10:231
257352399308,7cyclictest24-21ksoftirqd/109:30:001
257352399308,12cyclictest131rcu_preempt11:51:031
257352399306,7cyclictest24-21ksoftirqd/108:00:241
257352399305,6cyclictest24-21ksoftirqd/107:30:251
2573523993024,4cyclictest2609548-21kworker/u8:1+events_unbound08:51:411
2573523993013,4cyclictest131rcu_preempt08:45:131
257352399301,18cyclictest0-21swapper/108:25:121
2573519993020,4cyclictest0-21swapper/007:25:180
2573519993019,6cyclictest2681972-21grep12:20:250
257352399299,14cyclictest24-21ksoftirqd/108:20:231
257352399297,15cyclictest24-21ksoftirqd/112:25:241
2573523992923,3cyclictest231ktimers/111:05:021
2573523992922,5cyclictest2590913-21kworker/u8:0+events_unbound08:06:341
2573523992922,4cyclictest231ktimers/107:35:131
2573523992921,4cyclictest0-21swapper/109:20:271
2573523992918,3cyclictest131rcu_preempt09:00:171
2573523992913,9cyclictest131rcu_preempt08:30:271
2573523992912,10cyclictest131rcu_preempt09:05:251
2573519992921,5cyclictest0-21swapper/010:45:280
2573519992920,4cyclictest0-21swapper/007:55:010
2573519992919,5cyclictest0-21swapper/012:25:170
257352399286,9cyclictest24-21ksoftirqd/112:00:181
257352399283,6cyclictest24-21ksoftirqd/109:30:251
2573523992818,7cyclictest231ktimers/110:40:011
2573523992811,10cyclictest131rcu_preempt11:05:261
2573519992820,5cyclictest2616900-21apt09:15:000
2573519992818,6cyclictest0-21swapper/011:40:010
2573519992817,7cyclictest2585523-21grep07:40:250
2573519992814,8cyclictest0-21swapper/010:25:220
257352399279,5cyclictest131rcu_preempt09:47:011
2573523992721,4cyclictest2635390-21kworker/u8:2+events_unbound10:22:421
2573523992717,4cyclictest131rcu_preempt12:20:131
2573519992720,4cyclictest2647412-21sed10:40:240
2573519992720,3cyclictest0-21swapper/010:20:230
2573519992718,5cyclictest2581663-21ntpq07:30:220
2573523992618,5cyclictest231ktimers/110:30:191
2573523992612,5cyclictest131rcu_preempt08:40:111
2573519992619,3cyclictest0-21swapper/011:20:210
2573519992618,5cyclictest2677247-21cron12:10:000
2573519992618,5cyclictest0-21swapper/012:00:250
2573519992618,4cyclictest0-21swapper/011:55:000
2573519992618,4cyclictest0-21swapper/008:45:210
2573519992617,6cyclictest2610183-21sort08:55:010
2573519992617,5cyclictest0-21swapper/007:35:150
257351999261,6cyclictest2635677-21apt-get10:10:050
257351999261,5cyclictest2655314-21apt-get11:05:120
2573519992613,8cyclictest2606038-21head08:40:240
2573519992612,9cyclictest2668832-21grep11:45:000
2573519992612,9cyclictest2668832-21grep11:45:000
257351999254,14cyclictest2592827-21grep08:05:010
2573519992517,5cyclictest0-21swapper/009:50:250
2573519992418,2cyclictest0-21swapper/008:05:250
2573519992416,4cyclictest0-21swapper/012:30:230
2573519992415,4cyclictest0-21swapper/011:20:000
257351999240,20cyclictest0-21swapper/009:34:450
257351999232,18cyclictest2642945-21chrt10:30:110
2573519992316,4cyclictest2645171-21ntpq10:35:210
2573519992316,4cyclictest2596632-21tune2fs08:15:180
2573519992316,4cyclictest0-21swapper/012:20:010
2573519992316,3cyclictest0-21swapper/008:35:170
2573519992316,3cyclictest0-21swapper/008:35:160
257351999231,5cyclictest2621683-21runrttasks09:25:540
2573519992314,5cyclictest2686469-21ls12:35:170
2573519992313,6cyclictest2664865-21grep11:30:290
257351999231,18cyclictest0-21swapper/012:12:250
257351999231,18cyclictest0-21swapper/009:57:560
257351999230,19cyclictest0-21swapper/008:11:200
257351999230,19cyclictest0-21swapper/007:48:540
257351999230,19cyclictest0-21swapper/007:48:530
257351999221,17cyclictest0-21swapper/007:55:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional