You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 18:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Dec 20, 2025 12:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3102251995525,3cyclictest0-21swapper/011:10:010
3102265995224,24cyclictest0-21swapper/312:00:013
3102260994934,11cyclictest311ktimers/210:05:142
3102265994840,5cyclictest3175260-21munin-plugin-st10:39:593
3102265994840,5cyclictest3175260-21munin-plugin-st10:39:593
3102256994838,7cyclictest3169676-21grep10:20:271
3102251994839,5cyclictest3212121-21cron12:25:010
3102251994838,6cyclictest3165268-21fschecks_time10:10:150
3102265994731,12cyclictest0-21swapper/307:10:253
3102265994617,25cyclictest0-21swapper/308:25:263
3102256994636,6cyclictest204-21dbus-daemon07:55:241
3102256994634,7cyclictest3157523-21grep09:45:261
3102251994639,4cyclictest3213837-21munin-plugin-st12:30:010
3102256994533,9cyclictest231ktimers/108:20:141
3102265994433,7cyclictest3146483-21fschecks_time09:15:173
3102251994436,4cyclictest3134135-21sendmail08:40:010
3102265994334,5cyclictest3208277-21cron12:15:003
3102265994314,24cyclictest0-21swapper/310:55:283
310226099431,9cyclictest3122215-21apt-get08:05:122
3102256994337,4cyclictest3187269-21kworker/u8:2+events_unbound12:11:011
3102265994212,25cyclictest3113451-21cat07:40:003
3102260994222,16cyclictest3165233-21tune2fs10:10:162
3102251994236,4cyclictest3161412-21munin-plugin-st10:00:010
3102251994227,10cyclictest121ktimers/011:55:120
3102260994122,15cyclictest0-21swapper/207:10:022
310226099411,11cyclictest3187481-21cat11:15:002
310226599407,7cyclictest3123241-21grep08:05:273
3102265994030,7cyclictest3110211-21fschecks_count07:30:183
3102265994030,7cyclictest3110211-21fschecks_count07:30:183
3102265994022,14cyclictest3144356-21auditctl09:10:013
310226599401,7cyclictest3161765-21df10:00:153
310226599401,10cyclictest3137889-21/usr/sbin/munin08:50:173
3102260994033,4cyclictest3121573-21unixbench_singl08:00:272
3102260994030,6cyclictest3139235-21auditctl08:55:012
3102260994030,5cyclictest0-21swapper/210:15:172
310226099401,9cyclictest3203790-21/usr/sbin/munin12:00:182
310226099401,9cyclictest3202261-21/usr/sbin/munin11:55:232
3102260994011,26cyclictest0-21swapper/211:55:012
310226099401,10cyclictest3177492-21/usr/sbin/munin10:45:162
310226099400,9cyclictest3145045-21/usr/sbin/munin09:10:192
3102256994031,5cyclictest0-21swapper/108:40:011
3102256994030,6cyclictest3194436-21auditctl11:35:001
3102251994030,6cyclictest3132017-21grep08:30:280
310226599393,8cyclictest3210025-21cron12:17:593
310226599393,8cyclictest3210025-21cron12:17:593
310226599392,3cyclictest3120516-21apt-get08:00:143
3102265993919,16cyclictest0-21swapper/310:10:153
310226599391,7cyclictest3204142-21/usr/sbin/munin12:00:233
310226599391,5cyclictest3156984-21meminfo09:45:183
3102265993914,21cyclictest0-21swapper/311:40:183
310226599391,11cyclictest3211675-21grep12:20:293
310226599391,10cyclictest3193537-21ntp_states11:30:223
310226599391,10cyclictest3105366-21/usr/sbin/munin07:15:233
3102265993910,26cyclictest3115395-21/usr/sbin/munin07:45:173
3102260993932,4cyclictest3120268-21munin-plugin-st08:00:012
310226099391,9cyclictest3155747-21/usr/sbin/munin09:40:282
310226099391,7cyclictest3131947-21unixbench_multi08:30:272
3102260993911,25cyclictest3134266-21latency_hist08:40:012
310226099391,11cyclictest3105755-21tail07:15:262
310226599382,9cyclictest3192307-21sed11:25:273
3102265993828,6cyclictest0-21swapper/310:50:553
310226599381,9cyclictest3170839-21memory10:25:213
310226599381,9cyclictest3109133-21/usr/sbin/munin07:25:283
310226599381,8cyclictest3187422-21basename11:15:013
310226599381,8cyclictest3183005-21/usr/sbin/munin11:00:253
310226599381,8cyclictest3133531-21grep08:35:273
3102265993814,21cyclictest0-21swapper/309:44:593
310226599381,11cyclictest3177332-21/usr/sbin/munin10:45:163
310226599381,11cyclictest3107516-21grep07:20:263
310226099389,25cyclictest3153256-21fschecks_count09:35:152
310226099389,25cyclictest3153256-21fschecks_count09:35:152
310226099383,6cyclictest3205454-21irqstats12:05:162
310226099383,4cyclictest3156628-21/usr/sbin/munin09:45:152
310226099382,10cyclictest3193972-21tail11:30:252
310226099381,9cyclictest3215884-21diskstats12:35:182
310226099381,9cyclictest3162095-21/usr/sbin/munin10:00:192
310226099381,7cyclictest3189734-21fschecks_count11:20:162
3102260993814,18cyclictest0-21swapper/207:15:032
3102260993813,20cyclictest3175450-21latency_hist10:40:012
3102260993813,20cyclictest3175450-21latency_hist10:40:012
310226099381,11cyclictest3148122-21df09:20:152
310226099381,11cyclictest3127901-21ntp_states08:20:232
310226099381,10cyclictest3180847-21/usr/sbin/munin10:55:192
3102251993828,6cyclictest0-21swapper/009:44:590
3102251993826,8cyclictest3176572-21grep10:40:280
3102251993826,8cyclictest3137119-21grep08:45:270
310226599373,4cyclictest3185105-21users11:05:263
310226599373,4cyclictest3176649-21sshd10:41:113
3102265993726,7cyclictest3161407-21cron10:00:013
310226599372,5cyclictest3136178-21df08:45:163
310226599371,9cyclictest3189844-21/usr/sbin/munin11:20:163
310226599371,8cyclictest3206094-21/usr/sbin/munin12:05:233
310226599371,8cyclictest3158685-21meminfo09:50:233
310226599371,8cyclictest3145624-21/usr/sbin/munin09:10:263
310226599371,8cyclictest3128319-21/usr/sbin/munin08:20:253
310226599371,8cyclictest3126386-21/usr/sbin/munin08:15:243
310226599371,7cyclictest3153790-21/usr/sbin/munin09:35:223
310226599371,7cyclictest3153790-21/usr/sbin/munin09:35:223
310226599371,7cyclictest3114147-21meminfo07:40:203
310226599371,6cyclictest3198624-21/usr/sbin/munin11:45:213
310226599371,6cyclictest3141375-21cut09:00:153
310226599371,5cyclictest3200386-21/usr/sbin/munin11:50:253
310226599371,5cyclictest3169283-21open_files10:20:243
3102265993711,23cyclictest3172086-21/usr/sbin/munin10:30:173
310226599371,11cyclictest3166946-21fschecks_time10:15:183
310226099377,3cyclictest0-21swapper/207:35:162
3102260993729,4cyclictest0-21swapper/208:40:162
3102260993726,6cyclictest0-21swapper/210:35:002
310226099372,5cyclictest3130160-21/usr/sbin/munin08:25:272
310226099371,9cyclictest3195118-21/usr/sbin/munin11:35:202
310226099371,9cyclictest3150057-21/usr/sbin/munin09:25:192
310226099371,9cyclictest3117222-21/usr/sbin/munin07:50:172
310226099371,9cyclictest3108923-21/usr/sbin/munin07:25:242
310226099371,8cyclictest3182516-21fschecks_time11:00:182
310226099371,8cyclictest3124052-21fschecks_count08:10:162
310226099371,8cyclictest3110232-21cut07:30:192
310226099371,8cyclictest3110232-21cut07:30:192
310226099371,6cyclictest3211145-21/usr/sbin/munin12:20:232
310226099371,6cyclictest3196507-21/usr/sbin/munin11:40:172
310226099371,6cyclictest3170145-21cron10:24:592
310226099371,6cyclictest3160382-21meminfo09:55:192
310226099371,11cyclictest3139577-21df08:55:162
310226099371,10cyclictest3184560-21/usr/sbin/munin11:05:202
310226099371,10cyclictest3136316-21/usr/sbin/munin08:45:182
3102256993728,5cyclictest3187658-21gpgv11:15:011
310226599363,5cyclictest3124033-21diskstats08:10:173
310226599363,4cyclictest3135845-21munin-run08:45:013
310226599362,4cyclictest3130949-21/usr/sbin/munin08:30:263
310226599361,9cyclictest3214327-21/usr/sbin/munin12:30:193
310226599361,9cyclictest3213121-21/usr/sbin/munin12:25:253
310226599361,9cyclictest3149882-21fschecks_count09:25:163
310226599361,9cyclictest3118793-21/usr/sbin/munin07:55:233
310226599361,8cyclictest3216718-21sed12:35:273
310226599361,8cyclictest3195661-21tail11:35:273
310226599361,6cyclictest3151603-21fschecks_time09:30:173
310226599361,6cyclictest3151603-21fschecks_time09:30:173
310226599361,6cyclictest3148342-21if_eth109:20:193
310226599361,6cyclictest3118386-21cron07:53:013
310226099362,7cyclictest3198617-21grep11:45:212
310226099361,9cyclictest3215009-21wc12:30:272
310226099361,9cyclictest3191624-21/usr/sbin/munin11:25:192
310226099361,8cyclictest3143341-21/usr/sbin/munin09:05:202
310226099361,7cyclictest3188294-21/usr/sbin/munin11:15:192
310226099361,7cyclictest3188294-21/usr/sbin/munin11:15:192
310226099361,7cyclictest3152008-21/usr/sbin/munin09:30:222
310226099361,7cyclictest3152008-21/usr/sbin/munin09:30:222
310226099361,6cyclictest3170681-21if_eth010:25:182
310226099361,6cyclictest3147755-21cron09:20:012
310226099361,6cyclictest3141782-21awk09:00:222
310226099361,5cyclictest3175624-21/usr/sbin/munin10:40:152
310226099361,5cyclictest3115522-21modprobe07:45:172
3102260993610,23cyclictest3115185-21latency_hist07:45:002
3102256993626,4cyclictest0-21swapper/110:40:001
3102256993626,4cyclictest0-21swapper/110:40:001
3102256993625,5cyclictest3150763-21grep09:25:271
310226599359,8cyclictest3188320-21sed11:15:213
310226599359,8cyclictest3188320-21sed11:15:213
310226599353,5cyclictest3140037-21ntp_states08:55:223
310226599351,5cyclictest3164391-21grep10:05:273
310226099351,8cyclictest3179438-21/usr/sbin/munin10:50:222
310226099351,7cyclictest3125797-21grep08:15:162
310226099351,7cyclictest3108067-21taskset07:24:232
310226099351,5cyclictest3209948-21taskset12:17:012
310226099351,5cyclictest3209948-21taskset12:17:012
310226099350,7cyclictest3213720-21taskset12:28:452
3102251993526,5cyclictest3216803-21unixbench_singl12:35:270
310226099341,7cyclictest3207860-21unixbench_singl12:10:262
310226099341,6cyclictest3159333-21seq09:50:412
3102256993426,4cyclictest0-21swapper/107:45:261
3102256993425,4cyclictest3199563-21munin-plugin-st11:50:011
3102251993427,3cyclictest0-21swapper/009:40:000
3102251993427,3cyclictest0-21swapper/009:39:590
3102251993423,8cyclictest3107651-21grep07:20:270
3102256993325,5cyclictest3164397-21unixbench_singl10:05:271
3102256993325,4cyclictest0-21swapper/107:20:271
3102256993324,7cyclictest3187269-21kworker/u8:2+events_unbound11:56:431
3102256993324,5cyclictest0-21swapper/108:55:181
3102256993323,7cyclictest231ktimers/112:00:121
3102256993320,9cyclictest3106220-21tr07:20:011
3102251993326,4cyclictest3208288-21kthreadd12:14:590
3102251993326,4cyclictest3171404-21sed10:25:260
3102251993325,4cyclictest3198279-21fschecks_time11:45:160
3102256993224,4cyclictest0-21swapper/107:40:011
3102256993218,10cyclictest231ktimers/110:45:111
3102251993224,4cyclictest0-21swapper/012:00:250
3102251993222,6cyclictest0-21swapper/010:05:260
3102256993122,5cyclictest0-21swapper/107:40:261
3102251993121,6cyclictest0-21swapper/012:15:160
3102251993121,6cyclictest0-21swapper/012:15:160
3102256993019,7cyclictest0-21swapper/108:15:251
3102251993024,4cyclictest3102242-21cyclictest10:45:120
3102251993020,6cyclictest3194017-21grep11:30:260
3102251993019,8cyclictest3173090-21grep10:30:250
3102256992919,7cyclictest3142245-21grep09:00:251
310225699290,3cyclictest0-21swapper/108:00:151
3102251992921,6cyclictest3168522-21dpkg10:20:020
3102251992921,4cyclictest3109438-21grep07:25:300
3102251992921,4cyclictest0-21swapper/009:15:010
3102251992914,5cyclictest121ktimers/007:45:020
3102251992914,11cyclictest3159767-21grep09:55:010
3102256992821,4cyclictest0-21swapper/110:00:251
310225199282,21cyclictest3127243-21latency_hist08:20:010
3102251992820,4cyclictest0-21swapper/010:50:270
3102251992819,6cyclictest0-21swapper/010:40:000
3102251992819,6cyclictest0-21swapper/010:39:590
3102251992819,5cyclictest0-21swapper/008:55:260
3102251992816,8cyclictest3113026-21grep07:35:260
3102256992719,5cyclictest3213405-21grep12:25:271
3102256992719,4cyclictest0-21swapper/111:00:281
3102256992718,6cyclictest3189364-21ls11:19:591
3102256992718,6cyclictest3189364-21ls11:19:591
310225199271,9cyclictest3128794-21cron08:25:000
3102251992719,4cyclictest0-21swapper/009:30:260
3102251992719,4cyclictest0-21swapper/009:30:260
310225199271,6cyclictest3129247-21munin-node08:25:130
3102256992620,3cyclictest0-21swapper/109:45:001
3102256992620,3cyclictest0-21swapper/107:15:021
3102256992618,5cyclictest3108556-21cut07:25:201
3102256992618,5cyclictest0-21swapper/112:35:281
3102256992618,5cyclictest0-21swapper/110:30:161
3102256992618,4cyclictest0-21swapper/111:25:271
3102256992618,4cyclictest0-21swapper/109:30:271
3102256992618,4cyclictest0-21swapper/109:30:271
3102256992616,6cyclictest0-21swapper/110:10:251
3102256992615,7cyclictest0-21swapper/109:39:591
3102256992615,7cyclictest0-21swapper/109:39:591
310225199263,7cyclictest3106200-21munin-run07:20:010
3102251992619,5cyclictest164-21systemd-journal08:54:390
3102251992616,7cyclictest3161859-21grep10:00:170
3102251992613,8cyclictest0-21swapper/011:50:290
310225699252,4cyclictest131rcu_preempt09:20:141
3102256992519,3cyclictest0-21swapper/108:30:161
3102256992517,6cyclictest3124930-21unixbench_multi08:10:271
3102256992517,5cyclictest0-21swapper/111:20:261
3102256992517,5cyclictest0-21swapper/107:30:281
3102256992517,5cyclictest0-21swapper/107:30:271
3102256992517,4cyclictest0-21swapper/112:25:011
3102256992516,7cyclictest3192382-21kworker/u8:0+events_unbound11:54:141
3102251992521,2cyclictest13550irq/42-30be0000.ethernet07:55:140
3102251992519,3cyclictest0-21swapper/012:06:010
3102251992518,4cyclictest3111116-21grep07:30:280
3102251992518,4cyclictest3111116-21grep07:30:270
3102251992518,4cyclictest0-21swapper/009:20:010
3102251992516,4cyclictest0-21swapper/008:10:270
3102251992514,8cyclictest3103880-21cron07:15:000
3102251992512,9cyclictest204-21dbus-daemon10:20:500
3102256992418,3cyclictest0-21swapper/110:30:001
3102256992418,3cyclictest0-21swapper/109:50:291
3102256992417,5cyclictest3130644-21kworker/u8:0+events_unbound08:42:141
3102256992416,5cyclictest0-21swapper/112:05:141
3102256992415,7cyclictest3196966-21ntpq11:40:231
3102256992415,5cyclictest0-21swapper/108:25:181
3102256992414,7cyclictest204-21dbus-daemon10:50:541
3102256992414,7cyclictest204-21dbus-daemon07:50:221
310225699240,4cyclictest131rcu_preempt08:45:131
310225199248,13cyclictest3183836-21latency_hist11:05:000
3102251992417,3cyclictest0-21swapper/011:10:250
310225199241,19cyclictest0-21swapper/011:42:100
310225199241,19cyclictest0-21swapper/011:16:460
310225199241,19cyclictest0-21swapper/011:16:460
310225199241,19cyclictest0-21swapper/009:24:280
310225199241,19cyclictest0-21swapper/008:01:370
310225199241,19cyclictest0-21swapper/007:46:150
310225199241,10cyclictest3150061-21uname09:25:190
310225199240,20cyclictest0-21swapper/009:08:520
3102256992317,3cyclictest0-21swapper/112:15:151
3102256992317,3cyclictest0-21swapper/112:15:151
3102256992316,3cyclictest0-21swapper/108:05:211
3102256992315,4cyclictest0-21swapper/111:40:011
3102256992312,7cyclictest3161424-21tr10:00:011
3102251992317,4cyclictest0-21swapper/008:05:270
3102251992317,2cyclictest0-21swapper/009:02:350
3102251992316,3cyclictest0-21swapper/011:24:170
3102251992316,3cyclictest0-21swapper/007:53:040
310225199231,18cyclictest0-21swapper/009:49:140
3102256992216,3cyclictest0-21swapper/110:15:171
3102256992215,4cyclictest3214603-21ntpq12:30:211
3102256992215,3cyclictest0-21swapper/110:55:231
3102256992213,7cyclictest3133768-21kworker/u8:3+events_unbound10:40:061
3102251992215,3cyclictest0-21swapper/011:38:410
310225199221,3cyclictest0-21swapper/010:58:260
3102251992212,7cyclictest3192770-21sed11:30:000
310225199221,19cyclictest0-21swapper/012:30:240
310225199221,17cyclictest0-21swapper/008:44:210
3102256992110,7cyclictest0-21swapper/109:20:001
3102256992014,3cyclictest0-21swapper/109:05:221
3102256991913,4cyclictest231ktimers/108:50:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional