You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 00:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Wed Aug 12, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2745205995433,17cyclictest2795758-21readlink09:35:001
2745201995323,11cyclictest2794906-21/usr/sbin/munin09:30:250
2745201995219,12cyclictest2848933-21idleruntime-cro12:10:010
2745201995017,11cyclictest2811350-21ls10:20:010
2745201994820,10cyclictest2765657-21ls08:05:270
2745201994813,17cyclictest2759496-21latency_hist07:50:020
2745201994812,20cyclictest0-21swapper/010:35:180
2745201994718,9cyclictest2797667-21cat09:40:000
2745201994718,10cyclictest2842182-21cat11:50:010
2745201994718,10cyclictest2842182-21cat11:50:010
2745210994638,6cyclictest2829856-21kworker/u8:1+events_unbound11:13:222
2745201994617,10cyclictest2836591-21users11:30:250
2745201994614,10cyclictest0-21swapper/007:50:230
2745210994532,10cyclictest311ktimers/208:25:142
2745201994518,10cyclictest2853006-21cat12:20:190
2745214994437,4cyclictest2811186-21sendmail10:20:003
2745205994437,4cyclictest2828471-21cut11:10:011
2745205994429,11cyclictest231ktimers/107:25:131
2745205994418,22cyclictest0-21swapper/107:35:251
274520599441,38cyclictest2800961-21sh09:50:011
2745201994417,10cyclictest2773671-21tune2fs08:30:160
2745201994416,11cyclictest2780425-21fschecks_count08:50:160
2745201994416,11cyclictest2780425-21fschecks_count08:50:160
274520599438,30cyclictest0-21swapper/111:15:101
274520599433,33cyclictest2839920-21grep11:40:261
274520599432,5cyclictest2840638-21apt-get11:45:121
274520599432,5cyclictest2840638-21apt-get11:45:121
2745214994235,5cyclictest2764284-21kworker/u8:1+events_unbound08:12:523
2745205994232,5cyclictest2807790-21munin-plugin-st10:10:001
2745205994232,5cyclictest2807790-21munin-plugin-st10:09:591
2745205994228,9cyclictest231ktimers/107:10:131
274520599421,11cyclictest2776838-21latency_hist08:40:021
274520599420,39cyclictest0-21swapper/109:05:101
274520599412,35cyclictest2767431-21unixbench_multi08:10:261
274520599412,34cyclictest2820308-21cut10:45:161
274520599411,35cyclictest2823331-21cron10:54:591
274520599411,10cyclictest2852722-21grep12:20:171
274520599411,10cyclictest2809012-21grep10:10:241
274520599411,10cyclictest2797789-21apt-get09:40:111
274520599411,10cyclictest2780290-21apt-get08:50:141
274520599411,10cyclictest2780290-21apt-get08:50:141
2745201994121,14cyclictest2818699-21cut10:40:160
2745214994032,4cyclictest0-21swapper/311:20:013
2745214994030,7cyclictest2755982-21sendmail07:40:003
274520599402,9cyclictest2845079-21unixbench_singl11:55:231
274520599402,4cyclictest2813697-21/usr/sbin/munin10:25:221
274520599402,33cyclictest2750423-21grep07:20:261
274520599401,8cyclictest2845989-21fschecks_time12:00:181
274520599401,8cyclictest2778802-21fschecks_time08:45:151
274520599401,5cyclictest2771774-21apt-get08:25:151
274520599401,34cyclictest2819507-21grep10:40:261
274520599401,10cyclictest2847989-21grep12:05:251
274520599401,10cyclictest2790508-21sh09:20:011
2745210993930,7cyclictest2821264-21kworker/u8:0+events_unbound10:45:402
2745210993927,8cyclictest311ktimers/208:30:112
2745210993927,8cyclictest2764020-21grep08:00:282
2745210993917,5cyclictest131rcu_preempt11:00:272
274520599398,28cyclictest2828875-21/usr/sbin/munin11:10:161
274520599396,28cyclictest0-21swapper/107:45:271
274520599395,30cyclictest0-21swapper/109:25:161
2745205993928,7cyclictest2834815-21grep11:25:251
274520599392,32cyclictest2857025-21unixbench_singl12:30:261
274520599392,32cyclictest2806071-21cron10:05:001
274520599392,32cyclictest2769342-21grep08:15:261
274520599392,32cyclictest2749136-21cron07:20:011
274520599392,32cyclictest0-21swapper/112:20:001
274520599391,9cyclictest2791547-21sed09:20:251
274520599391,5cyclictest2811528-21/usr/sbin/munin10:20:151
274520599391,4cyclictest2824549-21/usr/sbin/munin10:55:251
274520599391,12cyclictest2788844-21cat09:15:011
2745201993921,14cyclictest2776181-21tail08:35:250
2745201993918,6cyclictest0-21swapper/009:25:240
2745201993917,9cyclictest2814762-21latency_hist10:30:010
2745201993914,9cyclictest0-21swapper/010:52:590
2745201993912,10cyclictest2801509-21mii-tool09:50:170
2745210993832,4cyclictest2749098-21kworker/u8:2+events_unbound07:37:452
2745210993830,4cyclictest2814615-21idleruntime-cro10:30:012
274521099380,18cyclictest2811197-21sendmail10:19:592
274520599383,4cyclictest2842571-21perl11:50:171
274520599383,31cyclictest2859145-21cron12:39:591
274520599382,32cyclictest0-21swapper/110:35:161
274520599382,31cyclictest2754250-21cron07:35:011
274520599382,31cyclictest164-21systemd-journal09:58:081
274520599381,9cyclictest2801881-21wc09:50:231
274520599381,6cyclictest2796067-21/usr/sbin/munin09:35:111
274520599381,3cyclictest2849160-21apt-get12:10:131
274520599381,3cyclictest2756344-21/usr/sbin/munin07:40:161
274520599381,33cyclictest2762309-21grep07:55:231
274520599381,11cyclictest2825822-21grep11:00:231
274520599380,5cyclictest2764736-21apt-get08:05:141
274520599380,3cyclictest2835516-21apt-get11:30:131
2745201993822,12cyclictest2752794-21taskset07:30:120
2745201993822,11cyclictest2834335-21grep11:25:200
2745201993818,15cyclictest2771953-21cut08:25:170
2745214993729,4cyclictest0-21swapper/310:35:003
2745214993727,6cyclictest0-21swapper/307:25:263
2745214993726,5cyclictest2778044-21kworker/u8:0+events_unbound08:42:573
2745210993729,5cyclictest2783466-21munin-plugin-st09:00:002
2745210993728,5cyclictest2753823-21unixbench_singl07:30:272
274520599373,3cyclictest2773581-21df_inode08:30:151
274520599371,7cyclictest2815848-21tail10:30:251
274520599371,6cyclictest2783877-21fschecks_count09:00:141
274520599371,5cyclictest2782131-21fschecks_count08:55:161
274520599371,3cyclictest2770911-21/usr/sbin/munin08:20:261
274520599371,3cyclictest2759723-21df_inode07:50:141
2745205993711,23cyclictest2837366-21cut11:35:171
2745201993726,8cyclictest2855360-21/usr/sbin/munin12:25:240
2745201993725,8cyclictest2845500-21cron11:59:590
2745201993723,10cyclictest2811960-21/usr/sbin/munin10:20:230
2745201993723,10cyclictest2806664-21/usr/sbin/munin10:05:190
2745201993723,10cyclictest2806664-21/usr/sbin/munin10:05:190
2745201993722,8cyclictest2769343-21grep08:15:270
2745201993720,14cyclictest2770235-21fschecks_count08:20:180
2745201993720,13cyclictest2831391-21grep11:15:250
2745201993720,11cyclictest2856140-21grep12:30:160
2745201993719,12cyclictest2839922-21tail11:40:260
2745201993718,5cyclictest2798236-21meminfo09:40:180
2745201993718,14cyclictest2790864-21df09:20:150
2745201993716,7cyclictest2767276-21threads08:10:260
2745214993623,9cyclictest391ktimers/307:10:133
2745210993618,5cyclictest131rcu_preempt10:58:182
274520599361,5cyclictest2764610-21latency_hist08:05:011
274520599360,5cyclictest2777290-21/usr/sbin/munin08:40:191
274520199369,23cyclictest0-21swapper/008:45:010
2745201993626,7cyclictest2846318-21ntpq12:00:230
2745201993625,7cyclictest2789020-21apt-get09:15:060
2745201993625,7cyclictest2782096-21/usr/sbin/munin08:55:140
2745201993622,8cyclictest2750426-21unixbench_singl07:20:270
2745201993622,10cyclictest2805287-21/usr/sbin/munin10:00:250
2745201993621,8cyclictest2820307-21grep10:45:160
2745201993621,11cyclictest2815520-21/usr/sbin/munin10:30:220
2745201993620,12cyclictest2785596-21fschecks_time09:05:160
2745201993620,11cyclictest2832454-21/usr/sbin/munin11:20:180
2745201993620,11cyclictest2803197-21if_eth109:55:170
2745201993619,14cyclictest2787728-21/usr/sbin/munin09:10:220
2745201993619,12cyclictest2859144-21cron12:40:000
2745201993618,14cyclictest2849390-21grep12:10:170
2745201993616,16cyclictest2829231-21ntpq11:10:210
2745201993611,12cyclictest0-21swapper/007:45:000
2745201993610,8cyclictest645-21runrttasks11:09:000
2745214993529,4cyclictest2853726-21kworker/u8:1+events_unbound12:28:393
2745214993525,7cyclictest0-21swapper/312:40:003
274520599351,3cyclictest2832720-21/usr/sbin/munin11:20:221
274520599351,10cyclictest2810429-21cut10:15:241
2745201993528,3cyclictest0-21swapper/009:05:000
2745201993523,8cyclictest2838678-21cron11:40:000
2745201993522,9cyclictest2764083-21unixbench_singl08:00:270
2745201993521,8cyclictest2778799-21fschecks_time08:45:150
2745201993519,11cyclictest2754794-21if_eth107:35:170
2745201993518,13cyclictest2843952-21latency_hist11:55:000
2745214993428,4cyclictest2749098-21kworker/u8:2+events_unbound07:32:453
2745214993427,4cyclictest2795625-21cron09:35:013
2745214993426,6cyclictest2771355-21kworker/u8:3+events_unbound08:37:563
2745214993425,5cyclictest0-21swapper/307:25:013
2745210993416,4cyclictest131rcu_preempt11:50:132
2745210993415,3cyclictest131rcu_preempt07:50:132
274520599343,27cyclictest2854447-21fschecks_count12:25:151
2745201993423,7cyclictest2823776-21fschecks_time10:55:150
2745201993421,10cyclictest2808064-21/usr/sbin/munin10:10:130
2745201993420,9cyclictest2749135-21cron07:20:020
2745201993420,9cyclictest0-21swapper/007:55:110
2745201993419,11cyclictest2751091-21/usr/sbin/munin07:25:120
2745201993418,11cyclictest2851075-21fschecks_time12:15:150
2745201993411,8cyclictest645-21runrttasks11:02:340
2745214993313,13cyclictest131rcu_preempt08:35:013
2745210993327,4cyclictest2771148-21kworker/u8:0+events_unbound08:22:542
2745210993325,4cyclictest0-21swapper/209:35:262
2745210993323,6cyclictest0-21swapper/209:20:162
2745210993317,5cyclictest2760733-21kworker/u8:2+events_unbound07:55:182
2745201993322,7cyclictest2799846-21uname09:45:180
2745201993319,10cyclictest2746629-21sshd07:12:410
2745214993224,6cyclictest2784938-21kworker/u8:1+events_unbound09:53:093
2745214993222,7cyclictest2804795-21fschecks_time10:00:173
2745214993218,10cyclictest391ktimers/309:05:123
2745210993226,4cyclictest2800592-21kworker/u8:3+events_unbound09:48:082
2745210993222,6cyclictest2815903-21grep10:30:252
2745210993211,12cyclictest131rcu_preempt12:35:192
2745214993123,6cyclictest2847450-21kworker/u8:2+events_unbound12:13:373
2745214993123,4cyclictest0-21swapper/310:55:263
2745214993114,7cyclictest131rcu_preempt11:50:203
2745214993113,4cyclictest0-21swapper/308:45:253
274521099317,12cyclictest131rcu_preempt11:10:012
2745210993124,5cyclictest2784938-21kworker/u8:1+events_unbound09:26:412
2745210993123,4cyclictest0-21swapper/208:50:262
2745210993123,4cyclictest0-21swapper/208:50:262
2745210993121,6cyclictest0-21swapper/210:40:012
2745210993111,4cyclictest131rcu_preempt11:45:132
2745210993111,4cyclictest131rcu_preempt11:45:122
2745214993022,5cyclictest0-21swapper/307:20:023
2745214993022,4cyclictest0-21swapper/310:08:103
2745214993022,4cyclictest0-21swapper/310:08:093
2745214993021,5cyclictest0-21swapper/307:50:173
2745214993020,6cyclictest0-21swapper/307:45:283
2745214993019,7cyclictest0-21swapper/311:25:013
2745214993016,8cyclictest131rcu_preempt10:45:003
2745214993016,7cyclictest131rcu_preempt12:35:013
2745214993011,11cyclictest2745192-21cyclictest10:00:013
274521099303,6cyclictest32-21ksoftirqd/212:00:262
2745210993024,4cyclictest2805887-21kworker/u8:1+events_unbound10:03:102
2745210993023,5cyclictest2847450-21kworker/u8:2+events_unbound12:27:412
2745210993021,5cyclictest0-21swapper/211:30:012
2745210993020,7cyclictest2776658-21sendmail08:40:002
2745210993018,9cyclictest2747138-21sed07:15:012
2745210993015,3cyclictest131rcu_preempt09:45:012
2745214992923,3cyclictest0-21swapper/307:40:263
2745214992920,6cyclictest0-21swapper/311:34:593
274521099297,3cyclictest131rcu_preempt11:30:252
274521099294,22cyclictest2778814-21cut08:45:162
2745210992923,4cyclictest2790313-21kworker/u8:3+events_unbound09:19:412
2745210992923,3cyclictest2752563-21kthreadd07:30:012
2745210992922,5cyclictest2746731-21kworker/u8:0+events_unbound07:42:472
2745210992921,4cyclictest0-21swapper/210:05:272
2745210992921,4cyclictest0-21swapper/210:05:272
2745210992914,5cyclictest131rcu_preempt09:10:262
2745210992913,5cyclictest131rcu_preempt08:10:112
274521099291,15cyclictest2852327-21cron12:20:012
274521099291,13cyclictest2768346-21/usr/sbin/munin08:15:242
2745210992910,10cyclictest0-21swapper/212:11:272
2745214992821,5cyclictest2771148-21kworker/u8:0+events_unbound08:26:403
2745214992821,4cyclictest0-21swapper/308:15:273
2745214992818,6cyclictest0-21swapper/308:05:273
2745214992814,8cyclictest131rcu_preempt09:35:203
2745214992814,7cyclictest131rcu_preempt09:25:253
2745214992812,6cyclictest131rcu_preempt11:35:123
274521099287,10cyclictest131rcu_preempt11:15:182
274521099286,12cyclictest32-21ksoftirqd/212:05:192
2745210992820,4cyclictest0-21swapper/212:20:272
2745210992819,5cyclictest2749152-21sh07:20:012
2745210992813,5cyclictest2781996-21kworker/u8:0+events_unbound09:07:092
2745210992813,5cyclictest2759010-21kworker/u8:1+events_unbound07:49:272
2745214992720,5cyclictest2824880-21kworker/u8:2+events_unbound11:00:243
2745214992720,4cyclictest2807600-21kworker/u8:2+events_unbound10:10:573
2745214992720,4cyclictest0-21swapper/310:45:263
2745214992719,6cyclictest2812572-21kworker/u8:3+events_unbound10:27:073
2745214992718,5cyclictest0-21swapper/311:10:003
2745214992717,7cyclictest2816658-21seq10:35:143
274521099279,9cyclictest0-21swapper/211:44:022
274521099274,5cyclictest2795692-21sed09:35:012
274521099273,8cyclictest32-21ksoftirqd/209:00:242
2745210992720,3cyclictest0-21swapper/209:50:212
2745210992715,7cyclictest2812422-21grep10:20:282
2745214992618,5cyclictest0-21swapper/308:50:263
2745214992618,5cyclictest0-21swapper/308:50:263
2745214992611,12cyclictest381rcuc/308:00:273
274521099266,11cyclictest0-21swapper/211:39:162
2745210992620,4cyclictest2807600-21kworker/u8:2+events_unbound10:12:452
2745210992612,4cyclictest2840243-21kworker/u8:2+events_unbound11:56:052
2745210992610,4cyclictest0-21swapper/210:40:112
274521499258,10cyclictest131rcu_preempt09:49:003
274521499256,10cyclictest40-21ksoftirqd/312:20:163
2745214992519,4cyclictest2840243-21kworker/u8:2+events_unbound11:47:313
2745214992519,4cyclictest2840243-21kworker/u8:2+events_unbound11:47:313
2745214992518,5cyclictest2771355-21kworker/u8:3+events_unbound08:58:103
2745214992517,5cyclictest0-21swapper/309:20:263
2745214992517,4cyclictest0-21swapper/309:00:153
274521499251,6cyclictest2823342-21sh10:55:003
2745214992514,7cyclictest2847217-21cron12:05:003
2745214992511,8cyclictest131rcu_preempt09:40:143
2745214992511,8cyclictest131rcu_preempt07:55:203
274521099256,3cyclictest2765463-21which08:05:252
274521099253,4cyclictest0-21swapper/207:20:262
2745210992518,5cyclictest2847450-21kworker/u8:2+events_unbound12:30:122
274521099251,7cyclictest32-21ksoftirqd/210:00:002
2745210992514,7cyclictest204-21dbus-daemon08:42:552
274521099251,3cyclictest2822499-21grep10:50:242
2745210992510,5cyclictest32-21ksoftirqd/211:25:012
2745214992418,4cyclictest2833529-21kworker/u8:1+events_unbound11:40:493
2745214992418,4cyclictest2828106-21kworker/u8:0+events_unbound11:10:103
2745214992416,5cyclictest0-21swapper/310:20:263
2745214992415,6cyclictest0-21swapper/309:15:173
2745214992411,7cyclictest131rcu_preempt12:05:223
274521499241,14cyclictest2845034-21grep11:55:223
2745214992315,4cyclictest0-21swapper/312:15:163
274521499231,4cyclictest0-21swapper/309:13:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional