You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 00:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Wed Sep 16, 2026 12:42:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3179585996346,13cyclictest3343426-21cut12:40:011
3179585994840,4cyclictest0-21swapper/111:51:161
3179586994638,5cyclictest0-21swapper/209:21:162
3179586994638,5cyclictest0-21swapper/209:21:162
3179586994634,8cyclictest3285634-21/usr/sbin/munin11:05:022
3179586994634,8cyclictest3285634-21/usr/sbin/munin11:05:022
3179584994637,6cyclictest1002-21mta-sts-daemon10:10:520
3179584994637,6cyclictest1002-21mta-sts-daemon10:10:520
3179586994436,5cyclictest0-21swapper/210:00:012
3179585994436,5cyclictest3334322-21ssh12:25:011
3179585994434,5cyclictest0-21swapper/109:16:201
3179585994434,5cyclictest0-21swapper/109:16:201
3179586994336,3cyclictest0-21swapper/212:01:012
3179586994332,7cyclictest420-21avahi-daemon11:53:422
3179586994314,5cyclictest0-21swapper/208:21:142
3179584994330,11cyclictest3325176-21latency_hist12:10:000
317958499431,37cyclictest3311223-21ssh11:46:140
3179585994234,5cyclictest3209568-21grep08:50:011
3179584994233,6cyclictest2402979-21cups-browsed09:26:050
317958599411,30cyclictest3299086-21ssh11:26:141
3179586994034,3cyclictest0-21swapper/210:20:002
3179586994033,4cyclictest3179595-21systemd-run07:10:012
3179586994032,5cyclictest3233893-21cron09:40:002
3179586994032,4cyclictest0-21swapper/211:00:012
3179586994032,3cyclictest0-21swapper/210:46:172
3179586994031,5cyclictest3289236-21aten_r2power_cu11:11:022
317958699402,25cyclictest3219926-21ssh09:16:162
317958699402,25cyclictest3219926-21ssh09:16:162
3179585994032,5cyclictest3202096-21systemd-run08:25:011
3179585994031,6cyclictest3228585-21cpuspeed09:31:061
3179584994034,3cyclictest3181139-21latency_hist07:15:020
317958699393,27cyclictest3323397-21ssh12:06:132
317958699393,27cyclictest3247297-21ssh10:01:112
3179586993931,5cyclictest3328208-21cron12:15:002
3179586993931,5cyclictest3328208-21cron12:15:002
3179585993932,4cyclictest3282603-21cut11:00:011
3179585993931,5cyclictest3208098-21systemd-run08:45:011
3179585993929,7cyclictest3180950-21sed07:11:271
3179585993929,6cyclictest2402979-21cups-browsed11:16:161
3179584993920,13cyclictest151ktimers/008:16:130
3179586993830,5cyclictest3294801-21latency_hist11:20:012
3179586993830,5cyclictest3240777-21/usr/sbin/munin09:51:022
3179585993830,5cyclictest1-21systemd09:45:011
3179585993829,5cyclictest0-21swapper/111:01:181
3179585993829,5cyclictest0-21swapper/111:01:181
3179585993826,8cyclictest2402979-21cups-browsed07:46:131
3179584993824,3cyclictest0-21swapper/011:36:170
3179586993729,5cyclictest3218622-21munin-plugin-st09:15:012
3179586993729,3cyclictest0-21swapper/210:11:132
3179586993729,3cyclictest0-21swapper/210:11:132
3179586993728,6cyclictest420-21avahi-daemon10:45:022
3179586993728,6cyclictest3295927-21needreboot11:21:102
3179585993731,4cyclictest1000-21mta-sts-daemon09:55:111
3179585993731,3cyclictest0-21swapper/111:46:141
3179585993726,8cyclictest3197572-21/usr/sbin/munin08:10:011
317958499374,27cyclictest2402979-21cups-browsed12:21:140
3179584993729,4cyclictest1001-21mta-sts-daemon08:41:220
317958499372,26cyclictest3259554-21ssh10:21:150
3179584993710,16cyclictest151ktimers/008:11:150
317958699367,4cyclictest171rcu_preempt08:36:152
3179586993629,4cyclictest3179583-21cyclictest12:00:012
3179586993624,9cyclictest3210434-21ntp_kernel_pll_08:51:132
3179586993623,9cyclictest421-21dbus-daemon12:30:572
3179586993621,6cyclictest0-21swapper/210:08:172
317958699361,27cyclictest3238178-21ssh09:46:132
3179585993627,6cyclictest627-21lldpd10:48:001
3179585993626,7cyclictest2402979-21cups-browsed12:28:121
3179584993629,5cyclictest421-21dbus-daemon07:35:010
3179584993625,4cyclictest3220430-21unixbench_multi09:16:250
3179584993625,4cyclictest3220430-21unixbench_multi09:16:250
3179584993622,7cyclictest12650irq/32-eth007:51:160
3179584993622,7cyclictest12650irq/32-eth007:51:160
317958699353,4cyclictest171rcu_preempt10:51:112
3179586993524,6cyclictest0-21swapper/209:41:292
3179586993516,5cyclictest171rcu_preempt10:36:132
317958699350,6cyclictest171rcu_preempt08:26:112
3179585993528,3cyclictest0-21swapper/109:26:171
3179585993527,5cyclictest1000-21mta-sts-daemon10:38:361
3179585993525,5cyclictest0-21swapper/111:36:171
317958599351,25cyclictest3329435-21ssh12:16:121
3179584993529,3cyclictest0-21swapper/011:34:170
3179584993518,12cyclictest12650irq/32-eth012:31:130
3179586993428,3cyclictest0-21swapper/211:06:252
3179586993428,3cyclictest0-21swapper/211:06:252
3179586993427,4cyclictest3309995-21kworker/u8:9-xprtiod12:30:022
3179586993426,5cyclictest3306909-21munin-run11:40:012
3179586993426,5cyclictest3261464-21latency_hist10:25:022
3179585993426,5cyclictest3247553-21wc10:01:191
3179585993426,5cyclictest3212550-21idleruntime-cro09:00:011
3179584993428,4cyclictest3337334-21cron12:30:010
3179584993428,4cyclictest3276539-21systemd-run10:50:010
3179584993428,4cyclictest3270417-21ssh10:40:010
3179584993427,4cyclictest151ktimers/009:06:120
3179584993424,8cyclictest0-21swapper/011:15:000
3179584993424,4cyclictest3328251-21grep12:15:010
3179584993424,4cyclictest3328251-21grep12:15:010
3179586993325,5cyclictest3267385-21sh10:35:012
3179586993325,4cyclictest1000-21mta-sts-daemon11:25:112
3179586993322,7cyclictest3196095-21systemd-run08:05:012
3179586993322,7cyclictest3196095-21systemd-run08:05:012
3179585993326,4cyclictest3288657-21ssh11:10:001
3179585993326,4cyclictest3288657-21ssh11:10:001
3179585993325,5cyclictest3271292-21ssh10:41:071
3179585993325,5cyclictest3243179-21latency_hist09:55:021
3179585993325,5cyclictest2402979-21cups-browsed10:50:461
3179585993325,5cyclictest0-21swapper/111:21:251
3179585993320,8cyclictest3216954-21sh09:11:201
3179584993323,8cyclictest3295576-21cpuspeed11:21:040
3179584993322,8cyclictest0-21swapper/011:07:160
3179584993322,8cyclictest0-21swapper/011:07:160
3179584993321,9cyclictest0-21swapper/010:16:240
317958699326,15cyclictest1003-21mta-sts-daemon12:21:132
317958699323,7cyclictest171rcu_preempt08:31:152
3179586993225,4cyclictest3192934-21unixbench_multi07:51:222
3179586993225,4cyclictest3192934-21unixbench_multi07:51:222
3179585993225,5cyclictest421-21dbus-daemon08:00:011
3179585993225,5cyclictest421-21dbus-daemon08:00:011
3179585993222,7cyclictest2402979-21cups-browsed09:36:201
3179584993227,2cyclictest0-21swapper/011:55:010
3179584993227,2cyclictest0-21swapper/010:01:160
3179584993226,4cyclictest3307782-21fschecks_count11:41:060
3179584993225,4cyclictest421-21dbus-daemon11:30:010
3179584993224,5cyclictest421-21dbus-daemon10:56:170
317958499322,23cyclictest3250498-21ssh10:06:170
3179584993220,9cyclictest3209500-21unixbench_singl08:46:250
317958499321,24cyclictest3277724-21ssh10:51:100
3179586993125,3cyclictest0-21swapper/208:00:002
3179586993125,3cyclictest0-21swapper/208:00:002
3179586993125,3cyclictest0-21swapper/207:40:012
3179586993123,5cyclictest1-21systemd07:30:022
317958599313,21cyclictest3262556-21ssh10:26:121
3179585993124,3cyclictest0-21swapper/112:01:241
3179585993123,5cyclictest3267374-21ssh10:35:011
3179585993122,7cyclictest3289676-21kernelversion11:11:081
3179585993122,6cyclictest2402979-21cups-browsed11:41:151
3179585993121,7cyclictest1000-21mta-sts-daemon12:31:101
3179585993120,8cyclictest3317833-21unixbench_multi11:56:231
317958499314,24cyclictest3195507-21sshd08:01:160
317958499314,24cyclictest3195507-21sshd08:01:160
3179584993125,4cyclictest3188580-21sendmail07:40:010
3179584993125,4cyclictest3179645-21latency_hist07:10:020
3179584993124,4cyclictest3217389-21grep09:11:270
3179584993124,4cyclictest3214148-21latency_hist09:05:020
3179584993123,6cyclictest3293369-21timerandwakeup11:16:230
3179584993123,6cyclictest3264346-21idleruntime-cro10:30:010
3179584993123,5cyclictest3317405-21ssh11:56:170
3179584993123,5cyclictest0-21swapper/010:34:100
317958499312,23cyclictest3235265-21ssh09:41:180
3179584993120,9cyclictest3182446-21unixbench_multi07:16:230
3179584993119,9cyclictest3190071-21cron07:45:010
3179586993023,4cyclictest3191587-21kworker/u8:13-xprtiod07:50:012
3179586993018,8cyclictest421-21dbus-daemon07:45:012
317958599303,20cyclictest665-21snmpd09:01:141
3179585993025,2cyclictest0-21swapper/108:55:011
3179585993023,3cyclictest0-21swapper/111:31:141
3179585993023,3cyclictest0-21swapper/108:16:171
3179585993022,5cyclictest3206560-21cron08:40:011
3179585993022,4cyclictest3182741-21latency_hist07:20:021
317958599302,23cyclictest3250408-21rm10:06:131
3179585993021,3cyclictest0-21swapper/107:51:161
3179585993021,3cyclictest0-21swapper/107:51:161
3179585993018,9cyclictest3238020-21latency09:46:101
3179584993024,4cyclictest3284474-21grep11:01:270
3179584993024,4cyclictest3284474-21grep11:01:270
3179584993020,7cyclictest0-21swapper/008:35:010
3179586992924,2cyclictest0-21swapper/212:16:042
3179586992923,3cyclictest0-21swapper/208:20:012
3179586992922,4cyclictest3211968-21ntp_kernel_pll_08:56:142
3179586992922,4cyclictest3183609-21proc_pri07:21:182
3179586992922,3cyclictest0-21swapper/212:36:152
3179586992922,3cyclictest0-21swapper/211:41:182
3179586992922,3cyclictest0-21swapper/209:31:192
3179586992920,6cyclictest2402979-21cups-browsed08:12:502
3179585992924,2cyclictest0-21swapper/110:16:171
3179585992922,4cyclictest3204985-21unixbench_singl08:31:211
3179585992922,3cyclictest0-21swapper/112:06:041
317958599292,21cyclictest3222954-21ssh09:21:141
317958599292,21cyclictest3222954-21ssh09:21:141
3179585992921,5cyclictest3215501-21unixbench_singl09:06:231
317958599291,22cyclictest3198533-21sshd08:11:161
3179584992923,4cyclictest3240151-21latency_hist09:50:020
3179584992921,6cyclictest2402979-21cups-browsed10:40:140
3179584992921,5cyclictest421-21dbus-daemon12:36:160
3179584992920,7cyclictest3319784-21aten2.4-expect12:01:010
3179584992919,7cyclictest0-21swapper/007:56:150
3179584992919,7cyclictest0-21swapper/007:56:150
317958499291,23cyclictest3241215-21ntpq09:51:110
317958499290,25cyclictest3244486-21ssh09:56:210
3179586992820,5cyclictest3206882-21aten_r2power_en08:41:042
3179586992820,3cyclictest0-21swapper/210:26:112
317958699281,4cyclictest171rcu_preempt07:31:192
3179586992811,14cyclictest1000-21mta-sts-daemon08:06:172
317958599284,13cyclictest3215570-21diskmemload12:14:451
317958599284,13cyclictest3215570-21diskmemload12:14:451
3179585992822,3cyclictest0-21swapper/110:20:171
3179585992821,4cyclictest1001-21mta-sts-daemon10:14:401
3179585992821,4cyclictest1001-21mta-sts-daemon10:14:401
3179584992822,3cyclictest0-21swapper/008:30:010
3179584992821,4cyclictest3206055-21collect208:36:190
317958499281,22cyclictest3229078-21ssh09:31:170
317958699275,12cyclictest3225943-21ssh09:26:122
3179586992721,3cyclictest0-21swapper/207:20:012
3179586992720,4cyclictest1002-21mta-sts-daemon08:47:442
3179586992717,7cyclictest3312995-21cron11:50:012
3179585992719,6cyclictest3196002-21grep08:01:251
3179585992719,6cyclictest3196002-21grep08:01:251
3179584992721,4cyclictest623-21sshd09:39:080
3179584992721,3cyclictest0-21swapper/009:21:180
3179584992721,3cyclictest0-21swapper/009:21:180
3179584992719,6cyclictest12650irq/32-eth008:06:130
3179584992711,12cyclictest3329029-21df12:16:050
3179586992618,4cyclictest0-21swapper/211:31:122
3179585992620,3cyclictest0-21swapper/107:31:131
3179584992614,9cyclictest3202072-21cron08:25:010
3179585992518,4cyclictest3184451-21aten_r2power_po07:26:031
3179584992511,12cyclictest0-21swapper/008:56:090
317958699243,13cyclictest428-21mta-sts-daemon09:06:112
3179586992311,6cyclictest0-21swapper/207:11:262
3179585992316,4cyclictest3188572-21munin-plugin-st07:40:011
3179585992316,4cyclictest3182889-21aten_r2power_en07:21:011
3179584992317,4cyclictest2402979-21cups-browsed07:20:100
3179586992215,5cyclictest1001-21mta-sts-daemon09:05:022
3179585992217,2cyclictest0-21swapper/107:10:021
317958499222,14cyclictest3210537-21ntp_states08:51:190
3179584992215,4cyclictest3185497-21head07:26:240
317958599212,15cyclictest3203098-21ps08:26:191
3179585992116,2cyclictest0-21swapper/107:41:041
3179584992113,5cyclictest3191032-21ntpq07:46:150
317958799193,9cyclictest0-21swapper/310:41:173
317958799176,5cyclictest0-21swapper/312:31:133
317958799174,7cyclictest0-21swapper/312:21:193
317958799172,9cyclictest0-21swapper/311:36:173
317958799172,8cyclictest0-21swapper/309:56:163
317958799166,5cyclictest0-21swapper/312:36:163
317958799161,7cyclictest0-21swapper/311:16:143
317958799157,4cyclictest0-21swapper/308:20:013
317958799157,3cyclictest0-21swapper/307:21:103
317958799156,5cyclictest0-21swapper/311:06:163
317958799156,5cyclictest0-21swapper/311:06:163
317958799152,8cyclictest0-21swapper/312:11:163
317958799152,8cyclictest0-21swapper/312:11:163
317958799152,8cyclictest0-21swapper/309:16:203
317958799152,8cyclictest0-21swapper/309:16:203
317958799152,7cyclictest0-21swapper/310:56:113
317958799151,6cyclictest0-21swapper/307:36:133
317958799148,4cyclictest0-21swapper/310:26:113
317958799147,5cyclictest0-21swapper/307:31:173
317958799147,4cyclictest0-21swapper/309:06:183
317958799146,4cyclictest0-21swapper/311:26:023
317958799146,4cyclictest0-21swapper/310:36:163
317958799146,4cyclictest0-21swapper/310:06:183
317958799146,4cyclictest0-21swapper/309:46:203
317958799146,4cyclictest0-21swapper/309:41:093
317958799146,4cyclictest0-21swapper/308:11:113
317958799141,8cyclictest0-21swapper/309:51:093
317958799141,7cyclictest0-21swapper/311:51:143
317958799141,7cyclictest0-21swapper/311:11:143
317958799141,7cyclictest0-21swapper/310:11:053
317958799141,7cyclictest0-21swapper/310:11:053
317958799141,6cyclictest0-21swapper/307:56:143
317958799141,6cyclictest0-21swapper/307:56:143
317958799139,2cyclictest0-21swapper/307:10:013
317958799137,4cyclictest0-21swapper/308:56:243
317958799137,4cyclictest0-21swapper/308:21:123
317958799137,4cyclictest0-21swapper/307:20:013
317958799136,4cyclictest0-21swapper/312:26:113
317958799136,4cyclictest0-21swapper/312:01:113
317958799136,4cyclictest0-21swapper/311:56:003
317958799136,4cyclictest0-21swapper/311:41:033
317958799136,4cyclictest0-21swapper/311:21:023
317958799136,4cyclictest0-21swapper/310:51:103
317958799136,4cyclictest0-21swapper/310:46:173
317958799136,4cyclictest0-21swapper/310:21:093
317958799136,4cyclictest0-21swapper/310:16:153
317958799136,4cyclictest0-21swapper/309:21:243
317958799136,4cyclictest0-21swapper/309:21:243
317958799136,4cyclictest0-21swapper/309:11:093
317958799136,4cyclictest0-21swapper/308:41:243
317958799136,4cyclictest0-21swapper/308:36:253
317958799131,7cyclictest0-21swapper/311:31:083
317958799131,7cyclictest0-21swapper/310:31:143
317958799131,7cyclictest0-21swapper/310:01:103
317958799131,6cyclictest0-21swapper/307:41:103
317958799128,3cyclictest0-21swapper/309:26:023
317958799127,3cyclictest0-21swapper/311:46:233
317958799127,3cyclictest0-21swapper/311:01:203
317958799127,3cyclictest0-21swapper/311:01:203
317958799127,3cyclictest0-21swapper/307:51:093
317958799127,3cyclictest0-21swapper/307:51:093
317958799126,3cyclictest0-21swapper/309:30:373
317958799126,3cyclictest0-21swapper/308:46:033
317958799126,3cyclictest0-21swapper/307:46:013
317958799121,7cyclictest0-21swapper/312:06:123
317958799121,6cyclictest0-21swapper/309:36:023
317958799121,6cyclictest0-21swapper/308:26:143
317958799116,3cyclictest0-21swapper/309:01:023
317958799116,3cyclictest0-21swapper/308:51:033
317958799116,3cyclictest0-21swapper/308:31:163
317958799116,3cyclictest0-21swapper/308:06:023
317958799116,3cyclictest0-21swapper/307:11:113
317958799115,4cyclictest0-21swapper/312:16:063
317958799106,3cyclictest0-21swapper/308:00:023
317958799106,3cyclictest0-21swapper/308:00:023
317958799106,3cyclictest0-21swapper/307:26:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional