You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-17 - 14:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Tue Nov 17, 2026 12:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3059829997259,5cyclictest0-21swapper/010:05:300
3059830995242,7cyclictest3130836-21/usr/sbin/munin10:05:261
305983099492,38cyclictest3211231-21ssh12:15:331
3059829994630,14cyclictest3160699-21ssh10:55:010
3059831994536,5cyclictest2291007-21cups-browsed10:00:092
3059831994438,3cyclictest0-21swapper/211:25:012
3059830994435,6cyclictest489-21in:imuxsock11:50:011
3059830994335,5cyclictest3129879-21cron10:05:011
3059829994229,10cyclictest3157619-21cron10:50:010
3059829994229,10cyclictest3157619-21cron10:50:010
3059829994220,13cyclictest151ktimers/010:15:300
3059829994129,10cyclictest3210082-21cron12:15:010
3059831994032,5cyclictest3211097-21sshd12:15:272
3059831994032,5cyclictest3106042-21needreboot09:25:252
3059831994032,4cyclictest3114244-21kworker/u8:6-xprtiod10:05:352
3059831993933,3cyclictest0-21swapper/209:20:012
3059831993929,7cyclictest3080846-21sh08:20:022
3059830993931,5cyclictest3153082-21unixbench_singl10:40:391
3059830993926,10cyclictest3143701-21timerwakeupswit10:25:431
305982999399,24cyclictest3183519-21ssh11:30:350
3059831993832,3cyclictest0-21swapper/207:10:272
3059831993830,5cyclictest3161529-21latency10:55:252
3059831993830,5cyclictest3067825-21fschecks_count07:35:202
3059831993729,5cyclictest3112317-21ntp_kernel_err09:35:272
3059830993731,3cyclictest0-21swapper/112:30:351
3059830993730,4cyclictest3099935-21modprobe09:15:331
3059829993731,4cyclictest3222476-21systemd12:35:020
3059829993731,4cyclictest3065842-21systemd-run07:30:010
3059831993631,2cyclictest0-21swapper/212:30:412
3059831993628,5cyclictest3085323-21systemd-run08:35:012
3059831993627,6cyclictest420-21dbus-daemon09:00:012
3059831993627,6cyclictest3123703-21cron09:55:012
3059831993626,7cyclictest418-21avahi-daemon10:28:412
3059831993625,7cyclictest3091202-21unixbench_multi08:50:382
3059830993630,3cyclictest0-21swapper/109:35:021
3059830993629,3cyclictest0-21swapper/110:15:351
305982999363,26cyclictest3103005-21ssh09:20:280
305983199352,9cyclictest3095807-21diskmemload12:05:362
305983199352,9cyclictest3095807-21diskmemload12:05:362
3059831993529,3cyclictest0-21swapper/207:40:382
3059831993529,3cyclictest0-21swapper/207:40:382
3059831993527,5cyclictest3167045-21latency_hist11:05:022
3059831993526,6cyclictest3176204-21latency_hist11:20:022
3059830993527,5cyclictest3083839-21systemd08:30:021
3059830993526,6cyclictest3078625-21needreboot08:10:271
3059830993525,8cyclictest3089822-21sh08:50:011
3059829993526,6cyclictest3086806-21sendmail08:40:010
3059829993522,6cyclictest12550irq/32-eth012:15:280
305982999351,29cyclictest3109307-21ssh09:30:310
3059831993427,4cyclictest3187034-21unixbench_singl11:35:422
3059831993424,7cyclictest3193240-21unixbench_singl11:45:392
3059831993423,8cyclictest3225728-21latency_hist12:40:032
305983199341,7cyclictest171rcu_preempt12:20:352
3059831993411,19cyclictest3189637-21ssh11:40:312
3059830993427,4cyclictest826-21mta-sts-daemon08:20:011
305983199335,25cyclictest3201938-21ssh12:00:302
305983199335,25cyclictest3201938-21ssh12:00:302
305983199333,25cyclictest3183445-21ssh11:30:322
305983199333,25cyclictest3155564-21ssh10:45:292
305983199333,25cyclictest3155564-21ssh10:45:292
3059831993326,3cyclictest0-21swapper/210:52:452
3059831993323,6cyclictest3168190-21systemctl11:05:392
3059831993323,6cyclictest3111316-21cron09:35:012
305983199332,26cyclictest3115541-21sh09:40:302
3059830993325,5cyclictest3140445-21systemctl10:20:371
3059830993324,6cyclictest420-21dbus-daemon11:00:401
3059830993323,7cyclictest3186799-21switchtime11:35:411
305983099332,23cyclictest3103164-21ssh09:20:341
3059829993327,4cyclictest3098917-21cron09:15:010
3059829993326,5cyclictest3201850-21ssh12:00:270
3059829993326,5cyclictest3201850-21ssh12:00:270
3059831993227,2cyclictest0-21swapper/210:35:012
3059831993226,3cyclictest0-21swapper/208:25:012
3059831993226,2cyclictest0-21swapper/211:25:292
3059831993225,4cyclictest3085830-21fschecks_count08:35:222
3059831993225,4cyclictest3076350-21systemd08:05:022
3059831993224,5cyclictest3125345-21unixbench_singl09:55:442
3059831993224,5cyclictest3088332-21kworker/u8:1+xprtiod08:45:012
305983199322,25cyclictest269-21systemd-journal07:15:272
305983099323,21cyclictest3095807-21diskmemload09:40:351
3059830993222,8cyclictest3071127-21needreboot07:45:261
3059830993221,8cyclictest3122118-21timerwakeupswit09:50:391
3059829993228,2cyclictest0-21swapper/012:10:010
3059829993228,2cyclictest0-21swapper/012:10:010
3059829993226,4cyclictest3161678-21sshd10:55:270
3059829993225,5cyclictest3121805-21ssh09:50:350
3059829993225,5cyclictest2291007-21cups-browsed09:40:200
3059829993225,4cyclictest489-21in:imuxsock07:20:010
3059829993224,6cyclictest3174661-21/usr/sbin/munin11:15:390
3059829993218,4cyclictest151ktimers/011:45:320
305983199315,23cyclictest3149403-21ssh10:35:292
305983199313,23cyclictest3137122-21ssh10:15:312
3059831993125,3cyclictest0-21swapper/210:10:252
3059831993124,4cyclictest3196254-21unixbench_multi11:50:392
3059831993124,4cyclictest3055794-21kworker/u8:4-rpciod08:00:022
3059831993124,3cyclictest0-21swapper/210:25:012
3059831993122,6cyclictest3208057-21ntp_kernel_pll_12:10:302
3059831993122,5cyclictest3082836-21fschecks_count08:25:202
3059831993121,7cyclictest418-21avahi-daemon09:10:572
3059831993120,8cyclictest3065819-21latency_hist07:30:022
3059830993125,3cyclictest0-21swapper/110:50:021
3059830993125,3cyclictest0-21swapper/110:50:021
3059830993124,4cyclictest3225520-21cron12:40:011
3059830993124,4cyclictest3136210-21latency_hist10:15:031
3059830993123,5cyclictest3182966-21fschecks_time11:30:221
3059830993122,7cyclictest3198757-21rm11:55:271
3059830993122,7cyclictest3198757-21rm11:55:271
3059830993122,6cyclictest3060626-21needreboot07:10:261
3059830993121,8cyclictest3148372-21systemd-run10:35:021
3059830993121,7cyclictest3091567-21aten_r2power_cu08:55:181
3059829993126,3cyclictest3217912-21grep12:25:410
3059829993126,2cyclictest0-21swapper/012:00:010
3059829993126,2cyclictest0-21swapper/012:00:010
3059829993125,3cyclictest0-21swapper/011:20:300
3059829993124,4cyclictest3188861-21tail11:40:160
3059829993122,7cyclictest3145304-21munin-run10:30:020
3059829993122,4cyclictest3186806-21ssh11:35:410
305982999312,15cyclictest3180227-21ssh11:25:260
3059829993120,8cyclictest3105579-21aten_r2power_po09:25:180
3059831993023,4cyclictest3103600-21unixbench_multi09:20:412
3059831993023,3cyclictest0-21swapper/207:55:022
3059831993021,5cyclictest3117847-21/usr/sbin/munin09:45:342
3059831993015,11cyclictest418-21avahi-daemon09:00:292
305983099303,21cyclictest770-21ntpd12:10:271
305983099303,13cyclictest3095807-21diskmemload12:05:291
305983099303,13cyclictest3095807-21diskmemload12:05:291
3059830993023,5cyclictest3067316-21grep07:35:011
3059830993023,4cyclictest701-21cron10:55:011
3059830993023,4cyclictest3176885-21iwlist11:20:231
3059830993022,5cyclictest820-21mta-sts-daemon10:59:291
3059830993022,5cyclictest3095691-21sed09:05:391
3059830993022,5cyclictest2291007-21cups-browsed09:28:031
3059830993020,6cyclictest3083825-21kworker/u8:9+nfsiod09:49:411
305982999304,19cyclictest12550irq/32-eth010:20:320
3059829993025,3cyclictest3059828-21cyclictest10:10:310
3059829993025,2cyclictest0-21swapper/010:45:010
3059829993024,4cyclictest3094254-21head09:00:380
3059829993024,4cyclictest3076835-21fschecks_count08:05:230
3059829993022,5cyclictest3117732-21sh09:45:040
305983199299,14cyclictest420-21dbus-daemon08:15:022
305983199292,22cyclictest3152458-21ssh10:40:262
3059831992920,4cyclictest351ktimers/211:55:262
3059831992920,4cyclictest351ktimers/211:55:262
3059831992919,7cyclictest3171324-21switchtime11:10:382
305983199291,25cyclictest3076846-21cut08:05:232
3059830992924,2cyclictest0-21swapper/112:25:401
3059830992924,2cyclictest0-21swapper/109:40:011
3059830992924,2cyclictest0-21swapper/108:40:011
3059830992923,4cyclictest3059828-21cyclictest10:38:551
3059830992923,3cyclictest0-21swapper/111:15:391
3059830992923,3cyclictest0-21swapper/109:10:201
3059830992922,5cyclictest0-21swapper/108:00:011
305983099292,23cyclictest3167987-21ssh11:05:341
305983099292,22cyclictest3195683-21sshd11:50:271
3059830992921,5cyclictest3202494-21unixbench_singl12:00:401
3059830992921,5cyclictest3202494-21unixbench_singl12:00:401
3059830992920,6cyclictest3065842-21systemd-run07:30:011
3059830992919,7cyclictest3171332-21switchtime11:10:381
3059830992919,6cyclictest3059828-21cyclictest08:30:311
305983099291,23cyclictest3214181-21ssh12:20:271
3059829992923,4cyclictest3067305-21cron07:35:010
3059829992921,3cyclictest12550irq/32-eth012:20:270
3059829992917,10cyclictest820-21mta-sts-daemon08:25:220
3059831992819,6cyclictest3067330-21systemd-run07:35:012
3059831992814,11cyclictest3219464-21sed12:30:022
3059830992824,2cyclictest0-21swapper/109:05:011
3059830992822,3cyclictest0-21swapper/111:30:011
3059830992822,3cyclictest0-21swapper/109:55:441
3059830992819,6cyclictest826-21mta-sts-daemon07:50:311
3059830992818,7cyclictest0-21swapper/111:40:301
3059829992823,3cyclictest0-21swapper/010:05:010
3059829992822,3cyclictest0-21swapper/012:35:220
3059829992822,3cyclictest0-21swapper/007:20:270
3059829992821,5cyclictest2401363-21kworker/u8:0+xprtiod07:10:260
3059829992818,4cyclictest3088322-21basename08:45:010
3059831992717,6cyclictest1-21systemd09:10:012
3059831992715,5cyclictest828-21mta-sts-daemon07:45:342
305982999279,12cyclictest2291007-21cups-browsed08:15:340
3059829992722,3cyclictest827-21mta-sts-daemon07:55:280
3059829992721,4cyclictest3114429-21ssh09:40:010
3059829992721,4cyclictest2291007-21cups-browsed11:06:340
3059829992721,4cyclictest2291007-21cups-browsed08:54:250
3059829992720,5cyclictest3099367-21aten_r2power_po09:15:220
3059830992621,3cyclictest0-21swapper/107:35:381
3059830992618,5cyclictest3087342-21fschecks_count08:40:221
3059830992618,5cyclictest3062818-21munin-run07:20:011
3059829992620,4cyclictest3068810-21munin-run07:40:010
3059829992619,4cyclictest3164453-21grep11:00:250
3059829992619,4cyclictest151ktimers/009:55:340
3059829992618,6cyclictest0-21swapper/009:00:010
3059829992617,6cyclictest418-21avahi-daemon11:51:130
305982999261,18cyclictest3149484-21ssh10:35:330
305983199251,17cyclictest3063715-21modprobe07:20:272
3059830992518,4cyclictest826-21mta-sts-daemon08:00:321
3059830992517,5cyclictest3064353-21systemd-run07:25:011
3059829992519,4cyclictest828-21mta-sts-daemon08:45:310
3059829992518,4cyclictest445-21mta-sts-daemon07:10:020
3059829992515,7cyclictest191rcuc/009:05:300
3059831992418,2cyclictest0-21swapper/208:50:012
3059829992420,2cyclictest0-21swapper/010:35:010
3059829992419,3cyclictest828-21mta-sts-daemon07:42:430
3059829992419,3cyclictest828-21mta-sts-daemon07:42:430
3059829992419,3cyclictest826-21mta-sts-daemon08:33:060
3059829992418,3cyclictest3074785-21kworker/u8:9-xprtiod08:00:240
3059831992315,5cyclictest269-21systemd-journal07:10:022
3059830992318,2cyclictest0-21swapper/108:25:011
3059830992317,3cyclictest0-21swapper/108:55:011
3059830992317,3cyclictest0-21swapper/107:40:271
3059830992317,3cyclictest0-21swapper/107:40:271
305982999232,16cyclictest3071272-21ntp_states07:45:320
3059829992318,4cyclictest3059828-21cyclictest08:10:250
3059829992317,4cyclictest420-21dbus-daemon07:55:020
3059829992314,6cyclictest3082182-21grep08:20:410
305983099224,12cyclictest3077339-21ps08:05:361
3059829992217,3cyclictest3155566-21kworker/u8:10-xprtiod11:10:190
305983299202,12cyclictest0-21swapper/309:30:333
3059830991913,3cyclictest0-21swapper/107:10:011
305983299183,8cyclictest0-21swapper/310:35:323
305983299182,9cyclictest0-21swapper/312:35:343
305983299182,9cyclictest0-21swapper/311:25:263
305983299182,9cyclictest0-21swapper/309:15:363
305983299182,11cyclictest0-21swapper/308:35:293
305983299174,6cyclictest0-21swapper/311:30:333
305983299173,9cyclictest0-21swapper/309:50:353
305983299172,7cyclictest0-21swapper/312:05:293
305983299172,7cyclictest0-21swapper/312:05:293
305983299171,9cyclictest0-21swapper/312:25:283
305983299171,8cyclictest0-21swapper/311:00:353
305983299171,8cyclictest0-21swapper/308:15:293
305983299171,10cyclictest0-21swapper/309:25:323
305983299165,7cyclictest0-21swapper/310:00:363
305983299163,9cyclictest0-21swapper/309:35:333
305983299162,8cyclictest0-21swapper/312:30:323
305983299162,8cyclictest0-21swapper/312:10:183
305983299162,8cyclictest0-21swapper/311:20:273
305983299162,8cyclictest0-21swapper/310:45:363
305983299162,8cyclictest0-21swapper/310:45:363
305983299162,8cyclictest0-21swapper/309:45:273
305983299162,10cyclictest0-21swapper/312:00:323
305983299162,10cyclictest0-21swapper/312:00:323
305983299161,8cyclictest0-21swapper/310:55:283
305983299153,8cyclictest0-21swapper/311:40:313
305983299153,7cyclictest0-21swapper/311:45:283
305983299153,7cyclictest0-21swapper/311:05:373
305983299153,6cyclictest0-21swapper/311:10:273
305983299153,6cyclictest0-21swapper/310:05:273
305983299152,9cyclictest0-21swapper/310:15:313
305983299152,8cyclictest0-21swapper/312:15:273
305983299152,8cyclictest0-21swapper/310:40:273
305983299152,7cyclictest0-21swapper/310:30:363
305983299152,7cyclictest0-21swapper/310:20:283
305983299151,9cyclictest0-21swapper/309:20:323
305983299151,8cyclictest0-21swapper/312:20:333
305983299151,8cyclictest0-21swapper/308:50:293
305983299151,8cyclictest0-21swapper/307:40:273
305983299151,8cyclictest0-21swapper/307:40:273
305983299144,6cyclictest0-21swapper/311:55:323
305983299144,6cyclictest0-21swapper/311:55:323
305983299142,8cyclictest0-21swapper/308:55:293
305983299142,8cyclictest0-21swapper/307:10:273
305983299142,7cyclictest0-21swapper/311:15:253
305983299142,7cyclictest0-21swapper/309:55:313
305983299142,7cyclictest0-21swapper/309:40:273
305983299142,7cyclictest0-21swapper/307:15:273
305983299142,5cyclictest0-21swapper/308:20:263
305983299141,9cyclictest0-21swapper/310:10:323
305983299141,8cyclictest0-21swapper/311:50:333
305983299141,8cyclictest0-21swapper/310:25:313
305983299141,6cyclictest0-21swapper/308:45:293
305983299141,6cyclictest0-21swapper/307:55:303
305983299132,7cyclictest0-21swapper/310:50:213
305983299132,7cyclictest0-21swapper/309:10:263
305983299132,7cyclictest0-21swapper/307:20:273
305983299132,6cyclictest0-21swapper/311:35:343
305983299131,7cyclictest0-21swapper/307:35:273
305983299131,6cyclictest0-21swapper/309:05:283
305983299131,6cyclictest0-21swapper/308:00:293
305983299124,5cyclictest0-21swapper/307:45:293
305983299121,7cyclictest0-21swapper/309:00:243
305983299121,7cyclictest0-21swapper/308:40:283
305983299121,7cyclictest0-21swapper/308:25:333
305983299121,7cyclictest0-21swapper/308:05:323
305983299121,6cyclictest0-21swapper/308:30:283
305983299121,5cyclictest0-21swapper/307:50:223
305983299112,6cyclictest0-21swapper/307:30:243
305983299111,6cyclictest0-21swapper/307:25:323
305983299111,4cyclictest0-21swapper/308:15:023
30598329981,4cyclictest0-21swapper/307:10:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional