You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 13:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Fri Dec 26, 2025 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28857719912960,1292cyclictest31134062sleep322:04:563
30171072690,64sleep02912016-21kworker/u16:4+efi_rts_wq20:50:140
2885771991916,1cyclictest0-21swapper/321:20:243
2885771991815,1cyclictest0-21swapper/320:10:003
288577199165,7cyclictest30480352sleep321:10:243
2885771991613,1cyclictest0-21swapper/323:50:193
288577199161,12cyclictest3223222-21taskset23:30:143
288577199155,8cyclictest3255082-21turbostat23:59:553
288577199155,7cyclictest3126280-21turbostat22:14:593
2885771991513,1cyclictest0-21swapper/323:37:083
2885771991513,1cyclictest0-21swapper/323:21:573
2885771991513,1cyclictest0-21swapper/320:55:123
2885771991513,1cyclictest0-21swapper/319:38:263
2885771991512,1cyclictest0-21swapper/323:03:183
2885771991512,1cyclictest0-21swapper/321:35:003
2885771991512,1cyclictest0-21swapper/319:40:233
2885771991512,1cyclictest0-21swapper/319:24:153
2885771991512,1cyclictest0-21swapper/300:35:153
288577199151,11cyclictest3209932-21taskset23:20:013
288577199151,11cyclictest2900862-21chrt19:19:563
288577199151,11cyclictest2886119-21taskset19:10:113
288577199151,10cyclictest3097270-21taskset21:50:183
288577199151,10cyclictest3029934-21taskset21:00:133
31897242140,2sleep00-21swapper/023:00:240
288577199144,7cyclictest3146890-21taskset22:30:163
2885771991412,1cyclictest0-21swapper/321:35:133
2885771991412,1cyclictest0-21swapper/320:48:533
2885771991412,1cyclictest0-21swapper/319:49:093
2885771991412,1cyclictest0-21swapper/300:05:113
2885771991412,0cyclictest0-21swapper/322:15:433
2885771991411,1cyclictest0-21swapper/323:29:543
2885771991411,1cyclictest0-21swapper/323:10:183
2885771991411,1cyclictest0-21swapper/300:16:523
288577199141,10cyclictest3299922-21chrt00:26:163
288577199141,10cyclictest3280658-21chrt00:10:403
288577199141,10cyclictest3261779-21taskset00:00:123
288577199141,10cyclictest3171749-21taskset22:50:153
288577199141,10cyclictest3164657-21taskset22:42:063
288577199141,10cyclictest3145449-21taskset22:29:083
288577199141,10cyclictest3139124-21turbostat22:25:003
288577199141,10cyclictest3093520-21taskset21:45:373
288577199141,10cyclictest3055040-21chrt21:16:083
288577199141,10cyclictest2971746-21chrt20:12:133
301798130,3rtkit-daemon3218246-21irqstats23:25:172
288577199133,7cyclictest29968902sleep320:30:253
288577199131,9cyclictest3293561-21taskset00:21:393
288577199131,9cyclictest3190788-21taskset23:05:023
288577199131,9cyclictest3170978-21chrt22:45:553
288577199131,9cyclictest3152385-21taskset22:35:133
288577199131,9cyclictest3036324-21taskset21:05:063
288577199131,9cyclictest3007366-21taskset20:40:183
288577199131,9cyclictest2990814-21chrt20:25:363
288577199131,9cyclictest2947320-21taskset19:55:133
288577199131,9cyclictest2945650-21taskset19:50:303
288577199131,9cyclictest2913673-21taskset19:26:223
288577199131,8cyclictest30170702sleep320:50:133
288577199131,10cyclictest2978024-21chrt20:15:463
2885771991310,1cyclictest0-21swapper/321:26:273
288577199130,11cyclictest2997817-21chrt20:35:013
288577199130,10cyclictest3300460-21taskset00:30:013
288577199130,10cyclictest3119593-21taskset22:07:013
288577199130,10cyclictest2984420-21taskset20:20:313
31767392121,3sleep10-21swapper/122:50:231
30363312121,7sleep03036364-21apt-get21:05:120
301798120,7rtkit-daemon3113650-21cat22:05:012
29146872120,4sleep02915681-21kernelversion19:30:160
288577199127,3cyclictest0-21swapper/321:55:193
288577199124,6cyclictest31830882sleep322:55:223
288577199124,6cyclictest2952967-21taskset20:00:033
288577199121,9cyclictest3236030-21chrt23:40:083
288577199121,8cyclictest2914200-21taskset19:30:023
2885771991210,1cyclictest0-21swapper/319:10:003
288577199120,9cyclictest3242433-21taskset23:45:013
288577199120,5cyclictest0-21swapper/321:40:173
31353932110,1sleep20-21swapper/222:20:182
32414672100,7sleep13241576-21find23:40:231
31448352101,7sleep20-21swapper/222:25:242
301798100,6rtkit-daemon636-21snmpd19:44:092
301798100,3rtkit-daemon3205-21sendmail-mta20:28:072
28803252100,7sleep12881223-21cut19:05:161
3244820291,6sleep03246926-21cut23:45:190
3242920291,5sleep20-21swapper/223:45:162
3148083290,6sleep03150164-21cut22:30:180
3132946290,1sleep00-21swapper/022:20:130
3120477290,6sleep13120819-21cut22:10:161
30179890,6rtkit-daemon3205-21sendmail-mta21:21:522
30179890,5rtkit-daemon448-21wpa_supplicant19:15:332
30179890,5rtkit-daemon447-21systemd-logind23:41:332
30179890,5rtkit-daemon3205-21sendmail-mta23:21:072
30179890,5rtkit-daemon2892494-21munin-node22:43:382
30179890,5rtkit-daemon2892494-21munin-node21:37:192
30179890,5rtkit-daemon0-21swapper/220:13:152
30179890,4rtkit-daemon636-21snmpd20:54:532
30179890,4rtkit-daemon3267080-21ntp_states00:00:202
30179890,4rtkit-daemon3171615-21grep22:50:142
30179890,4rtkit-daemon3067726-21sed21:25:262
30179890,4rtkit-daemon3047963-21needreboot21:10:232
30179890,4rtkit-daemon2926793-21idleruntime-cro19:40:002
30179890,3rtkit-daemon2892494-21munin-node21:08:152
3004290291,4sleep13004323-21apt-get20:40:131
2939878290,5sleep12940033-21diskstats19:50:131
2920628293,3sleep12920661-21apt-get19:35:141
3248924281,4sleep03249076-21df_inode23:50:160
3229780281,4sleep13229828-21fschecks_count23:35:141
3197680280,6sleep13198301-21irqrtprio23:10:181
3113704281,4sleep03113805-21cpuspeed_turbos22:05:140
3094118281,4sleep13094151-21apt-get21:50:131
3087876281,4sleep13088076-21hddtemp_smartct21:45:151
3068451281,3sleep03068484-21apt-get21:30:120
3036367281,4sleep13036516-21df_inode21:05:121
30179880,5rtkit-daemon638-21ntpd22:30:122
30179880,4rtkit-daemon667-21lldpd20:56:292
30179880,4rtkit-daemon638-21ntpd23:03:582
30179880,4rtkit-daemon638-21ntpd21:47:122
30179880,4rtkit-daemon636-21snmpd22:45:242
30179880,4rtkit-daemon636-21snmpd20:42:382
30179880,4rtkit-daemon636-21snmpd20:20:502
30179880,4rtkit-daemon636-21snmpd20:04:502
30179880,4rtkit-daemon636-21snmpd19:29:482
30179880,4rtkit-daemon492-21gmain00:16:492
30179880,4rtkit-daemon430-21avahi-daemon00:29:212
30179880,4rtkit-daemon3287698-21apt-get00:20:142
30179880,4rtkit-daemon3251740-21cut23:50:202
30179880,4rtkit-daemon3121782-21kthreadcore22:10:162
30179880,4rtkit-daemon3119510-21seq22:05:572
30179880,4rtkit-daemon3100532-21/usr/sbin/munin21:55:142
30179880,4rtkit-daemon2999984-21kthreadcore20:35:202
30179880,4rtkit-daemon2962536-21kthreadcore20:05:172
30179880,4rtkit-daemon2904-21cron19:09:002
30179880,4rtkit-daemon2892494-21munin-node23:56:032
30179880,4rtkit-daemon2892494-21munin-node22:18:432
30179880,4rtkit-daemon2892494-21munin-node21:30:032
30179880,4rtkit-daemon2892494-21munin-node19:21:432
30179880,4rtkit-daemon2885759-21cyclictest21:43:122
30179880,3rtkit-daemon2938630-21needreboot19:45:182
30179880,1rtkit-daemon0-21swapper/223:15:522
30179880,1rtkit-daemon0-21swapper/222:58:582
30179880,1rtkit-daemon0-21swapper/222:36:042
30179880,1rtkit-daemon0-21swapper/200:06:002
2999293280,6sleep13001030-21cut20:35:201
2997834281,3sleep02997867-21apt-get20:35:150
2986564280,1sleep12988621-21kthreadcore20:25:171
2978357281,4sleep02978386-21munin-run20:20:010
2888123280,5sleep02890210-21kthreadcore19:10:170
2884930281,4sleep02885147-21users19:05:230
3309497270,4sleep13311650-21grep00:35:211
3306928271,3sleep03307074-21df00:35:160
3246927270,4sleep13247624-21sed23:45:191
3202744270,4sleep23202999-21unixbench_multi23:10:272
3196397270,4sleep03196614-21users23:05:240
3192776271,4sleep23194828-21kthreadcore23:05:182
3179574271,4sleep13181594-21cut22:55:201
3158714270,4sleep03158869-21diskstats22:40:110
3131631270,4sleep13131767-21/usr/sbin/munin22:15:211
3115599270,4sleep13117646-21tr22:05:191
3094154271,4sleep23094306-21df_inode21:50:142
3067301271,3sleep03067359-21ntp_states21:25:240
3049187270,3sleep13049220-21apt-get21:15:151
3035265271,3sleep03035390-21python321:00:230
3023485271,2sleep03023518-21apt-get20:55:140
3019622270,4sleep13021794-21cut20:50:191
30179870,4rtkit-daemon636-21snmpd19:51:252
30179870,4rtkit-daemon636-21snmpd00:36:062
30179870,4rtkit-daemon3205-21sendmail-mta20:45:172
30179870,4rtkit-daemon3200908-21packagekitd23:37:392
30179870,4rtkit-daemon2892494-21munin-node00:10:102
30179870,3rtkit-daemon667-21lldpd20:30:432
30179870,3rtkit-daemon638-21ntpd19:56:382
30179870,3rtkit-daemon636-21snmpd23:33:382
30179870,3rtkit-daemon636-21snmpd19:31:372
30179870,3rtkit-daemon492-21gmain19:10:342
30179870,3rtkit-daemon3032174-21cat21:00:182
30179870,3rtkit-daemon2892494-21munin-node20:15:492
30179870,3rtkit-daemon2892494-21munin-node00:30:402
30179870,2rtkit-daemon636-21snmpd21:15:072
2953158270,4sleep12953185-21cut20:00:141
2901808270,4sleep12902469-21irqrtprio19:20:161
2892033271,4sleep1297-21systemd-journal19:11:381
3293714260,1sleep00-21swapper/000:23:380
3270758260,4sleep03272829-21kthreadcore00:05:220
3267235262,1sleep10-21swapper/100:00:231
3257019260,3sleep13259051-21cut23:55:181
3229108260,1sleep10-21swapper/123:32:021
3224716260,4sleep03226721-21cut23:30:210
3216534260,3sleep13216541-21turbostat.cron23:25:011
3209766260,1sleep00-21swapper/023:19:070
3152418260,3sleep03152617-21hddtemp_smartct22:35:150
3132668261,2sleep03132895-21latency_hist22:20:010
3106810260,3sleep03106734-21apt-get22:00:000
3089174260,4sleep03091094-21kthreadcore21:45:190
3076322260,1sleep00-21swapper/021:35:170
2991962260,4sleep02992902-21cut20:30:180
2985059261,2sleep02985205-21/usr/sbin/munin20:25:130
2980721260,3sleep12982836-21cut20:20:181
2953014260,3sleep02953157-21df20:00:120
2951744260,3sleep12951919-21timerwakeupswit19:55:211
2948572260,3sleep02950691-21cut19:55:160
2945999260,3sleep02946018-21munin-run19:55:000
2932304260,4sleep02932365-21ntpq19:40:220
2927148260,3sleep12927256-21diskstats19:40:151
2907796260,3sleep12907829-21apt-get19:25:121
3306291250,1sleep00-21swapper/000:30:350
3300881251,2sleep13301469-21ps00:30:161
3281701250,3sleep13282700-21sed00:15:171
3276294250,3sleep03277778-21cut00:10:190
3274579250,3sleep13274591-21latency_hist00:10:001
3267746250,1sleep00-21swapper/000:02:410
3261354250,1sleep00-21swapper/023:58:410
3254255251,2sleep12885759-21cyclictest23:50:251
3237851251,2sleep03236035-21/usr/sbin/munin23:40:180
3216351253,1sleep03203344-21kworker/0:1+kacpi_notify23:22:380
3178637250,2sleep00-21swapper/022:55:190
3165140250,2sleep10-21swapper/122:45:141
3158223250,1sleep10-21swapper/122:37:451
3140816250,3sleep03142317-21kthreadcore22:25:180
3138778250,1sleep10-21swapper/122:20:501
3105819251,2sleep13100532-21/usr/sbin/munin21:55:221
3100531250,2sleep00-21swapper/021:55:130
3083519250,3sleep03085598-21cut21:40:180
3068169250,1sleep10-21swapper/121:29:411
3061606250,1sleep00-21swapper/021:22:460
3049176250,1sleep00-21swapper/021:15:060
3042773250,2sleep10-21swapper/121:10:141
3029477250,3sleep10-21swapper/120:58:121
3016651250,1sleep10-21swapper/120:47:541
3010424250,2sleep01-21systemd20:45:000
2984656250,1sleep00-21swapper/020:23:330
2973682251,2sleep10-21swapper/120:15:211
2967379250,3sleep02969384-21kthreadcore20:10:190
2939455250,1sleep00-21swapper/019:48:190
2934202251,2sleep12814041-21kworker/u16:3+kvfree_rcu_reclaim19:45:151
2913741250,3sleep00-21swapper/019:27:160
2907420250,1sleep00-21swapper/019:23:270
2895533251,2sleep00-21swapper/019:15:180
3295166240,2sleep03296368-21grep00:25:180
3235440240,1sleep00-21swapper/023:35:580
3216785240,3sleep10-21swapper/123:25:091
3209673241,2sleep12885759-21cyclictest23:17:551
3171950240,2sleep03172089-21sed22:50:180
3162064240,2sleep10-21swapper/122:40:171
3108713240,2sleep10-21swapper/122:00:181
3099953240,3sleep00-21swapper/021:50:520
3085599240,1sleep10-21swapper/121:40:191
3069539240,2sleep13070690-21grep21:30:171
3045444241,1sleep00-21swapper/021:10:210
3036077240,2sleep13036185-21latency_hist21:05:011
3016785240,3sleep00-21swapper/020:49:380
2992903240,2sleep10-21swapper/120:30:191
2971963241,1sleep10-21swapper/120:15:011
2965235240,3sleep10-21swapper/120:05:591
2962162240,1sleep00-21swapper/020:05:180
2926094240,2sleep00-21swapper/019:35:250
2920236240,3sleep10-21swapper/119:33:181
3294259230,1sleep10-21swapper/100:25:151
3287656230,1sleep10-21swapper/100:20:061
3287134230,2sleep00-21swapper/000:16:480
3280738230,1sleep10-21swapper/100:11:451
3220058230,1sleep00-21swapper/023:25:200
3202582230,1sleep00-21swapper/023:10:250
3190836230,1sleep10-21swapper/123:05:121
3184604230,1sleep10-21swapper/123:00:161
3170177230,1sleep00-21swapper/022:45:210
3146054230,1sleep10-21swapper/122:30:151
3145207230,1sleep10-21swapper/122:26:021
3120276230,1sleep00-21swapper/022:10:150
3080761230,1sleep10-21swapper/121:36:461
3061095230,1sleep10-21swapper/121:20:241
2896429230,1sleep10-21swapper/119:15:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional