You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-30 - 16:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Thu Apr 30, 2026 12:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2558753996357,4cyclictest2557939-21kworker/u8:2+events_unbound07:14:580
2558753995419,9cyclictest131rcu_preempt10:10:140
2558754995226,21cyclictest0-21swapper/111:10:011
2558754995118,4cyclictest0-21swapper/108:40:141
2558755995036,10cyclictest311ktimers/207:40:122
2558754994916,10cyclictest2558751-21cyclictest09:00:121
2558755994836,9cyclictest311ktimers/208:00:132
2558754994535,6cyclictest2562269-21grep07:15:251
2558755994428,12cyclictest0-21swapper/212:05:012
2558756994333,7cyclictest2602885-21sendmail09:20:003
255875599431,39cyclictest2561259-21cpu07:15:122
255875599431,26cyclictest2605542-21sendmail_mailtr09:25:242
2558753994336,4cyclictest2620950-21sh10:10:000
2558755994223,15cyclictest0-21swapper/209:05:252
2558754994233,4cyclictest0-21swapper/109:49:591
2558754994231,7cyclictest2602893-21sendmail09:20:011
2558753994233,5cyclictest2594345-21munin-plugin-st08:55:000
255875599411,37cyclictest2625054-21/usr/sbin/munin10:20:142
255875599411,35cyclictest2639049-21awk11:00:182
255875599411,35cyclictest2633942-21/usr/sbin/munin10:45:162
255875599411,35cyclictest2616121-21/usr/sbin/munin09:55:132
255875599411,34cyclictest2651007-21/usr/sbin/munin11:35:182
255875599411,34cyclictest2651007-21/usr/sbin/munin11:35:172
255875599411,34cyclictest2585333-21/usr/sbin/munin08:25:142
2558755994110,28cyclictest2566167-21date07:30:022
255875599410,39cyclictest2638229-21sshd10:56:502
2558753994134,4cyclictest0-21swapper/009:49:410
2558756994033,4cyclictest2564636-21latency_hist07:25:013
2558755994032,4cyclictest0-21swapper/207:45:152
255875599402,35cyclictest2592669-21/usr/sbin/munin08:45:202
255875599401,36cyclictest2669870-21apt-get12:30:112
255875599401,36cyclictest2611882-21/usr/sbin/munin09:45:162
255875599401,36cyclictest2610782-21/usr/sbin/munin09:40:262
255875599401,36cyclictest2608890-21/usr/sbin/munin09:35:212
255875599401,36cyclictest2569138-21/usr/sbin/munin07:35:242
255875599401,33cyclictest2621188-21apt-get10:10:152
255875599401,33cyclictest2574882-21apt-get07:55:112
255875599400,4cyclictest0-21swapper/211:40:102
255875599400,4cyclictest0-21swapper/209:30:112
255875599400,10cyclictest2626522-21apt-get10:25:122
255875599400,10cyclictest2626522-21apt-get10:25:122
2558754994033,4cyclictest2638514-21latency_hist11:00:001
2558753994027,9cyclictest2592008-21basename08:45:010
2558756993928,7cyclictest0-21swapper/309:40:013
255875599393,33cyclictest2632184-21irqstats10:40:172
255875599392,34cyclictest2656646-21/usr/sbin/munin11:50:252
255875599392,33cyclictest2628272-21/usr/sbin/munin10:30:132
255875599391,9cyclictest2599801-21df_inode09:10:142
255875599391,5cyclictest2620113-21pluginstate10:05:382
255875599391,4cyclictest0-21swapper/212:35:112
255875599391,4cyclictest0-21swapper/207:20:112
255875599391,35cyclictest2665138-21/usr/sbin/munin12:15:192
255875599391,35cyclictest2654157-21/usr/sbin/munin11:45:132
255875599391,35cyclictest2649432-21/usr/sbin/munin11:30:192
255875599391,35cyclictest2595009-21meminfo08:55:162
255875599391,35cyclictest2589834-21sshd08:35:322
255875599391,33cyclictest2642640-21/usr/sbin/munin11:10:202
255875599391,33cyclictest2590772-21/usr/sbin/munin08:40:152
255875599391,33cyclictest2587157-21diskstats08:30:142
255875599391,33cyclictest2578306-21grep08:05:132
255875599391,32cyclictest2668169-21/usr/sbin/munin12:25:152
255875599391,11cyclictest2601956-21ntp_states09:15:212
255875599391,11cyclictest2580342-21irqstats08:10:162
2558754993918,4cyclictest0-21swapper/112:35:251
2558756993830,4cyclictest0-21swapper/310:15:143
255875599381,4cyclictest0-21swapper/207:10:092
255875599381,34cyclictest2659012-21cron11:58:012
255875599381,34cyclictest2640832-21/usr/sbin/munin11:05:182
255875599381,34cyclictest2618329-21/usr/sbin/munin10:00:212
255875599381,34cyclictest2584413-21/usr/sbin/munin08:20:252
255875599381,34cyclictest2582028-21diskstats08:15:152
255875599381,34cyclictest2567164-21/usr/sbin/munin07:30:252
255875599381,33cyclictest2596375-21cstates09:00:132
255875599380,4cyclictest0-21swapper/211:15:112
255875399381,7cyclictest11-21ksoftirqd/009:00:130
2558756993729,5cyclictest2635093-21munin-plugin-st10:50:013
2558756993727,5cyclictest0-21swapper/308:45:013
255875599372,32cyclictest2573716-21/usr/sbin/munin07:50:232
255875599371,33cyclictest2630406-21/usr/sbin/munin10:35:162
255875599371,33cyclictest2623013-21/usr/sbin/munin10:15:152
255875599371,32cyclictest2614181-21sshd09:50:022
255875599371,32cyclictest2614181-21sshd09:50:022
255875599370,4cyclictest0-21swapper/211:25:122
2558754993727,5cyclictest0-21swapper/108:30:181
2558753993729,4cyclictest2666021-21sendmail12:20:000
255875599361,32cyclictest2666459-21apt-get12:20:062
255875599361,32cyclictest2645714-21/usr/sbin/munin11:20:132
255875599360,4cyclictest0-21swapper/212:10:132
2558753993627,7cyclictest2669632-21cron12:30:000
2558753993627,6cyclictest0-21swapper/010:55:010
255875599351,4cyclictest0-21swapper/209:20:192
2558755993514,17cyclictest0-21swapper/212:05:142
255875599351,31cyclictest2635412-21cat10:50:112
255875599351,29cyclictest629-21snmpd08:52:302
2558754993527,4cyclictest0-21swapper/110:34:591
2558753993527,4cyclictest0-21swapper/010:55:270
2558753993525,6cyclictest0-21swapper/012:40:000
2558756993426,5cyclictest0-21swapper/312:25:013
2558756993424,6cyclictest0-21swapper/309:05:013
2558756993423,8cyclictest2601172-21basename09:15:013
2558756993419,10cyclictest0-21swapper/311:30:003
2558754993425,5cyclictest0-21swapper/107:10:131
2558753993427,4cyclictest2645330-21sh11:20:010
2558753993426,4cyclictest0-21swapper/008:00:000
2558753993423,6cyclictest0-21swapper/008:20:010
2558756993325,4cyclictest0-21swapper/309:00:003
2558756993324,5cyclictest2641816-21kworker/u8:2+events_unbound11:10:113
2558754993321,8cyclictest2662178-21grep12:05:251
2558753993325,4cyclictest2579757-21cron08:10:010
2558756993224,4cyclictest0-21swapper/311:30:153
2558756993224,4cyclictest0-21swapper/308:30:153
2558756993222,6cyclictest0-21swapper/308:15:263
2558754993224,4cyclictest0-21swapper/112:25:261
255875399329,8cyclictest131rcu_preempt07:40:130
2558753993226,4cyclictest2624034-21kworker/u8:1+events_unbound11:25:570
2558753993222,6cyclictest0-21swapper/007:15:250
2558753993211,13cyclictest11-21ksoftirqd/010:15:190
2558756993124,3cyclictest0-21swapper/312:00:153
2558756993121,6cyclictest0-21swapper/308:20:263
2558754993123,4cyclictest0-21swapper/108:00:261
2558754993123,4cyclictest0-21swapper/107:35:241
2558753993124,5cyclictest2604808-21kworker/u8:1+events_unbound09:32:410
2558753993124,3cyclictest2602867-21kthreadd09:20:000
2558753993121,7cyclictest0-21swapper/008:25:000
255875399311,28cyclictest0-21swapper/011:05:110
2558756993022,4cyclictest2615827-21cron09:54:593
2558756993022,4cyclictest2615827-21cron09:54:593
2558756993022,4cyclictest0-21swapper/308:45:273
2558756993022,4cyclictest0-21swapper/308:00:253
2558756993021,5cyclictest0-21swapper/311:50:003
2558756993020,6cyclictest0-21swapper/310:30:253
2558754993022,5cyclictest2635080-21cron10:50:011
2558754993020,6cyclictest2626284-21sh10:25:001
2558754993019,7cyclictest0-21swapper/110:00:371
255875399304,4cyclictest131rcu_preempt12:00:110
2558753993023,4cyclictest0-21swapper/010:20:230
2558753993022,5cyclictest0-21swapper/012:05:250
2558753993020,6cyclictest0-21swapper/011:20:230
2558753993019,7cyclictest2615373-21grep09:50:240
2558753993019,7cyclictest2615373-21grep09:50:240
2558756992922,3cyclictest0-21swapper/309:55:253
2558756992920,6cyclictest0-21swapper/310:20:223
2558756992919,6cyclictest0-21swapper/312:15:003
2558754992922,4cyclictest0-21swapper/107:30:261
2558754992921,4cyclictest0-21swapper/111:35:271
2558754992921,4cyclictest0-21swapper/111:35:271
2558754992919,7cyclictest0-21swapper/111:49:591
2558753992923,3cyclictest0-21swapper/007:45:250
2558753992922,5cyclictest2612957-21kworker/u8:0+events_unbound10:34:420
2558753992922,5cyclictest2566545-21kworker/u8:3+events_unbound07:36:400
2558753992914,5cyclictest2612957-21kworker/u8:0+events_unbound10:49:130
2558753992912,14cyclictest11-21ksoftirqd/009:10:110
2558756992822,3cyclictest0-21swapper/307:20:013
2558756992820,4cyclictest0-21swapper/312:25:253
2558756992820,4cyclictest0-21swapper/309:30:333
2558756992819,4cyclictest0-21swapper/312:05:243
2558754992821,4cyclictest2590278-21kthreadd08:40:011
2558754992819,5cyclictest0-21swapper/109:10:141
2558754992816,8cyclictest2581467-21auditctl08:15:011
2558753992821,5cyclictest2607623-21kworker/u8:0+events_unbound09:37:490
2558753992821,4cyclictest2659187-21kthreadd12:00:000
2558753992821,4cyclictest0-21swapper/011:51:050
2558756992718,6cyclictest0-21swapper/311:39:593
2558756992718,6cyclictest0-21swapper/311:39:593
2558756992718,6cyclictest0-21swapper/308:10:243
2558756992718,6cyclictest0-21swapper/308:00:013
2558756992718,6cyclictest0-21swapper/307:55:013
2558756992717,6cyclictest0-21swapper/310:50:163
2558754992719,4cyclictest0-21swapper/107:50:261
2558753992721,3cyclictest0-21swapper/008:55:210
2558753992720,5cyclictest2624034-21kworker/u8:1+events_unbound11:00:200
2558753992720,4cyclictest0-21swapper/010:40:000
2558753992718,5cyclictest0-21swapper/010:00:000
2558753992717,3cyclictest2587139-21ls08:30:140
2558753992713,4cyclictest131rcu_preempt07:20:120
2558756992619,4cyclictest2627989-21sh10:30:003
2558756992619,4cyclictest2627989-21sh10:30:003
2558756992619,3cyclictest0-21swapper/311:15:153
2558756992618,4cyclictest0-21swapper/307:10:203
2558756992616,6cyclictest0-21swapper/312:15:233
2558754992618,5cyclictest53-21kcompactd012:20:021
2558754992618,5cyclictest0-21swapper/110:25:261
2558754992618,5cyclictest0-21swapper/110:25:251
2558754992616,6cyclictest2609219-21grep09:35:231
2558754992616,6cyclictest0-21swapper/111:10:261
2558754992616,6cyclictest0-21swapper/110:20:021
2558754992614,8cyclictest204-21dbus-daemon11:56:051
255875399262,4cyclictest131rcu_preempt11:45:120
2558753992619,5cyclictest2662821-21kworker/u8:3+events_unbound12:22:410
2558753992619,5cyclictest2612957-21kworker/u8:0+events_unbound10:28:360
2558753992619,5cyclictest2612957-21kworker/u8:0+events_unbound10:28:360
2558753992618,5cyclictest121ktimers/008:10:110
2558753992617,7cyclictest2662821-21kworker/u8:3+events_unbound12:11:480
255875399261,12cyclictest0-21swapper/008:35:200
2558756992516,6cyclictest0-21swapper/307:40:173
2558756992515,6cyclictest0-21swapper/309:25:003
2558754992517,4cyclictest0-21swapper/108:25:161
2558754992517,4cyclictest0-21swapper/108:25:001
2558754992516,4cyclictest0-21swapper/111:25:551
2558754992515,6cyclictest0-21swapper/108:20:001
2558754992512,10cyclictest231ktimers/110:05:261
255875399258,10cyclictest11-21ksoftirqd/009:05:220
2558753992518,5cyclictest2643864-21kworker/u8:3+events_unbound11:45:010
2558753992517,6cyclictest2562466-21kworker/u8:1+events_unbound08:02:150
2558753992517,6cyclictest2553885-21kworker/u8:0+events_unbound07:54:070
255875699242,14cyclictest131rcu_preempt07:30:123
2558756992418,3cyclictest2631602-21munin-plugin-st10:40:003
2558756992417,3cyclictest0-21swapper/309:25:243
2558756992416,6cyclictest2624034-21kworker/u8:1+events_unbound11:20:183
2558756992416,5cyclictest0-21swapper/307:50:013
2558756992413,6cyclictest0-21swapper/308:25:243
2558754992418,3cyclictest0-21swapper/110:35:231
2558754992416,5cyclictest0-21swapper/111:50:251
2558754992412,8cyclictest204-21dbus-daemon07:55:091
2558753992418,4cyclictest2562466-21kworker/u8:1+events_unbound07:25:230
2558753992417,5cyclictest2589591-21kworker/u8:2+events_unbound08:49:260
2558753992416,5cyclictest121ktimers/007:30:110
2558753992413,4cyclictest131rcu_preempt10:40:160
255875399241,19cyclictest0-21swapper/010:04:200
2558753992410,4cyclictest2562466-21kworker/u8:1+events_unbound08:25:490
2558756992317,4cyclictest2612957-21kworker/u8:0+events_unbound10:00:383
2558756992317,3cyclictest0-21swapper/309:49:503
2558756992316,5cyclictest145-21jbd2/mmcblk1p2-809:40:233
2558756992314,4cyclictest0-21swapper/311:00:013
2558756992313,6cyclictest2565658-21grep07:25:273
2558756992313,6cyclictest0-21swapper/311:50:233
2558754992317,3cyclictest0-21swapper/109:55:141
2558754992317,3cyclictest0-21swapper/107:20:161
2558754992316,4cyclictest231ktimers/107:30:011
2558754992316,3cyclictest0-21swapper/112:15:011
2558754992315,5cyclictest2614574-21fschecks_time09:50:151
2558754992315,5cyclictest2614574-21fschecks_time09:50:151
2558754992315,4cyclictest0-21swapper/108:55:231
2558754992314,6cyclictest2604808-21kworker/u8:1+events_unbound09:25:151
255875399236,10cyclictest11-21ksoftirqd/011:30:130
2558753992317,3cyclictest0-21swapper/011:40:000
2558753992317,3cyclictest0-21swapper/011:39:590
2558753992316,5cyclictest2641816-21kworker/u8:2+events_unbound11:11:400
2558753992316,5cyclictest2596734-21kworker/u8:2+events_unbound09:23:130
2558753992314,6cyclictest2670049-21tune2fs12:30:140
255875399231,3cyclictest131rcu_preempt09:40:130
2558756992216,4cyclictest2641816-21kworker/u8:2+events_unbound11:09:083
2558756992216,3cyclictest0-21swapper/310:45:003
255875699221,13cyclictest0-21swapper/312:30:113
2558754992215,4cyclictest2665103-21ntpq12:15:181
2558754992215,3cyclictest0-21swapper/108:45:191
2558754992214,5cyclictest0-21swapper/110:45:011
2558754992214,4cyclictest438-21cron09:45:001
255875499221,18cyclictest2603129-21taskset09:20:201
2558753992213,7cyclictest2593534-21kworker/u8:3+events_unbound09:25:250
2558756992115,3cyclictest0-21swapper/311:55:253
2558756992114,4cyclictest391ktimers/311:00:273
2558756992114,4cyclictest391ktimers/309:10:013
2558756992113,6cyclictest391ktimers/312:35:123
2558754992115,3cyclictest2649989-21unixbench_multi11:30:241
2558754992114,4cyclictest0-21swapper/107:40:261
2558754992112,5cyclictest2572949-21idleruntime-cro07:50:001
2558754992112,5cyclictest0-21swapper/111:00:161
2558754992111,7cyclictest2652826-21cat11:40:171
2558754992111,7cyclictest2645732-21cut11:20:131
2558756992014,3cyclictest0-21swapper/308:05:263
2558756992011,6cyclictest0-21swapper/310:10:273
2558754992014,3cyclictest0-21swapper/109:05:221
2558754992014,3cyclictest0-21swapper/108:10:011
2558754992012,5cyclictest231ktimers/112:00:191
2558754992012,5cyclictest231ktimers/108:55:011
2558754992012,5cyclictest0-21swapper/112:30:221
255875499201,15cyclictest2635452-21sort10:50:131
2558756991913,3cyclictest0-21swapper/307:35:233
2558754991912,5cyclictest231ktimers/109:30:171
2558754991911,4cyclictest2644021-21fschecks_count11:15:151
255875699182,12cyclictest1-21systemd08:50:243
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional