You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 23:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot4s.osadl.org (updated Sat May 16, 2026 12:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17163998037,9cyclictest21-21ksoftirqd/110:00:141
17178997637,29cyclictest35966irq/58-eth012:05:123
17178997637,29cyclictest35966irq/58-eth012:05:123
1715799633,49cyclictest7250-21ssh11:00:130
1715799595,42cyclictest19631-21ssh09:55:120
1716399565,7cyclictest131rcu_preempt09:35:151
1716399565,7cyclictest131rcu_preempt09:35:151
1717099553,32cyclictest14292-21ssh10:10:122
1717099553,29cyclictest15972-21ssh12:35:132
1716399524,6cyclictest131rcu_preempt08:15:141
1716399515,9cyclictest131rcu_preempt09:25:111
1715799505,8cyclictest131rcu_preempt07:55:140
1716399493,37cyclictest21616-21ssh10:50:141
1715799492,37cyclictest23459-21ssh11:45:130
1716399483,32cyclictest24988-21ssh09:40:131
1716399482,40cyclictest5338-21ssh10:05:151
1716399481,3cyclictest131rcu_preempt10:55:131
1717099452,9cyclictest0-21swapper/211:40:132
1717099434,35cyclictest27346irq/40-dwc2_hso11:55:132
1716399433,33cyclictest3534-21ssh09:10:151
1717099421,5cyclictest19874-21ssh11:25:122
1715799423,31cyclictest17943-21ssh12:00:110
1716399411,33cyclictest10841-21ssh11:20:151
17157994117,9cyclictest12-21ksoftirqd/010:54:480
17178994026,10cyclictest35966irq/58-eth011:15:123
1717099404,7cyclictest27346irq/40-dwc2_hso12:05:152
1717099404,7cyclictest27346irq/40-dwc2_hso12:05:142
1717099401,8cyclictest23830-21grep09:55:302
1717099392,32cyclictest0-21swapper/211:10:552
1717099392,24cyclictest18001-21ssh10:30:132
1717099392,24cyclictest18001-21ssh10:30:122
1717099391,9cyclictest10515-21kthreadcore10:25:202
1717099391,8cyclictest17320-21cut09:35:212
1717099391,8cyclictest17320-21cut09:35:212
1717099391,13cyclictest503-21latency_hist08:00:032
1717099391,12cyclictest25756-21cut08:25:202
1717099381,9cyclictest9343-21kthreadcore11:00:212
1717099381,9cyclictest32155-21latency_hist11:50:032
1717099381,8cyclictest3788-21fschecks_count10:40:172
1717099372,7cyclictest17057-21usage_Anybus12:15:302
1717099372,6cyclictest0-21swapper/208:44:482
1717099371,8cyclictest6955-21/usr/sbin/munin09:30:262
1717099371,8cyclictest27181-21wc10:15:282
1717099371,8cyclictest25309-21ntpq12:20:272
1717099371,8cyclictest10456-21ssh11:20:012
1717099371,6cyclictest17443-21fschecks_count07:10:162
1717099371,6cyclictest17443-21fschecks_count07:10:152
1717099370,6cyclictest9982-21kthreadcore12:30:222
1717899363,22cyclictest35966irq/58-eth011:10:113
1717899362,18cyclictest35966irq/58-eth012:25:133
1717099367,25cyclictest5484-21fschecks_count10:05:182
1717099361,8cyclictest21794-21irqcore08:55:182
1717099361,12cyclictest22149-21cut09:20:182
1717099361,10cyclictest30556-21ls10:35:242
1717099357,25cyclictest4653-21sh10:57:262
1717099354,4cyclictest4235-21fschecks_count07:30:172
1717099354,19cyclictest27346irq/40-dwc2_hso07:45:152
1717099353,9cyclictest0-21swapper/209:13:472
1717099351,9cyclictest32126-21irqcore07:25:172
1717099351,6cyclictest30727-21cut11:30:202
1717099351,17cyclictest16375-21wc09:15:292
1717099351,13cyclictest26576-21latency_hist12:05:022
1717099351,13cyclictest12695-21grep10:45:152
1717099351,12cyclictest5699-21fschecks_time11:35:182
1717099351,12cyclictest12180-21kthreadcore07:35:222
1717099351,11cyclictest32352-21ssh10:00:262
1716399352,29cyclictest1816-21ssh11:15:131
1716399352,21cyclictest32314-21ssh10:20:131
1716399351,23cyclictest3118-21diskmemload09:30:141
1715799354,21cyclictest3118-21diskmemload12:25:140
1715799352,25cyclictest13199-21cut08:10:210
1717099342,8cyclictest12684-21kthreadcore09:50:212
1717099341,9cyclictest26485-21irqcore09:00:182
1717099341,8cyclictest30766-21grep12:25:162
1717099341,8cyclictest26908-21/usr/sbin/munin07:20:262
1717099341,8cyclictest2468-21tr11:50:222
1717099341,8cyclictest10387-21fschecks_count08:10:162
1717099341,7cyclictest19770-21missed_timers11:05:232
1717099341,7cyclictest19770-21missed_timers11:05:232
1717099341,4cyclictest3274-21ssh09:10:022
1717099341,10cyclictest25269-21grep09:40:162
1717099341,10cyclictest16126-21kthreadcore07:40:182
1717099340,9cyclictest15437-21unixbench_multi08:45:272
1715799343,24cyclictest7064-21ssh12:30:140
1715799342,3cyclictest131rcu_preempt08:00:140
1717099331,9cyclictest3118-21diskmemload09:45:222
1717099331,8cyclictest5433-21ntpq08:35:262
1717099331,8cyclictest15537-21irqcore08:15:202
1717099331,7cyclictest32478-21fschecks_count10:20:162
1717099331,13cyclictest30221-21munin-run10:55:012
17157993326,4cyclictest151rcuc/011:55:120
17157993314,11cyclictest12-21ksoftirqd/012:35:140
1717899321,17cyclictest35966irq/58-eth010:05:153
1717099325,7cyclictest30633-21tune2fs09:25:152
1717099321,8cyclictest10794-21/usr/sbin/munin11:20:242
1715799323,23cyclictest23294-21ssh10:15:130
17157993213,17cyclictest151rcuc/009:25:110
1717899315,14cyclictest35966irq/58-eth011:20:123
1717099311,8cyclictest8029-21usage_EthcTask12:10:302
1717099311,8cyclictest16422-21/usr/sbin/munin08:50:252
1717099310,9cyclictest23852-21irqrtprio07:50:182
1717099310,5cyclictest22100-21sshd07:15:062
1716399314,18cyclictest21-21ksoftirqd/109:45:131
17157993121,6cyclictest151rcuc/011:40:130
17157993113,10cyclictest10614-21ssh09:50:120
1717899306,17cyclictest35966irq/58-eth011:55:113
17178993015,10cyclictest35966irq/58-eth011:40:143
1717099301,8cyclictest558-21ntp_kernel_pll_08:30:242
1717099301,7cyclictest23761-21unixbench_multi08:20:262
1717899293,20cyclictest35966irq/58-eth007:30:143
1717899291,21cyclictest35966irq/58-eth007:50:133
1717099293,17cyclictest27346irq/40-dwc2_hso08:00:142
1716399292,22cyclictest14507-21ssh11:40:151
1715799296,11cyclictest131rcu_preempt08:55:140
17157992922,5cyclictest12-21ksoftirqd/011:09:490
17157992922,5cyclictest12-21ksoftirqd/011:09:480
1715799292,21cyclictest11096-21ssh09:13:470
1716399282,19cyclictest13200-21tr08:10:221
17163992812,11cyclictest21-21ksoftirqd/112:04:001
1715799285,17cyclictest12-21ksoftirqd/007:40:100
1715799282,21cyclictest14311-21ssh10:10:130
1715799282,20cyclictest19257-21ssh09:17:480
1717899273,17cyclictest0-21swapper/312:34:593
1717899273,15cyclictest0-21swapper/308:10:213
1717899271,19cyclictest35966irq/58-eth010:25:113
1717099275,4cyclictest5621-21tune2fs08:05:182
1716399272,19cyclictest31975-21ssh11:12:491
1715799272,19cyclictest20212-21ssh10:48:480
1717899265,17cyclictest35966irq/58-eth010:15:123
1717899263,15cyclictest0-21swapper/310:40:143
1717899262,20cyclictest35966irq/58-eth010:30:143
1717899262,20cyclictest35966irq/58-eth010:30:133
17178992612,11cyclictest0-21swapper/311:30:203
1715799264,6cyclictest131rcu_preempt07:35:140
1715799263,14cyclictest5468-21ssh11:35:130
17157992619,4cyclictest12-21ksoftirqd/010:55:130
1717899253,11cyclictest0-21swapper/309:20:493
17178992514,8cyclictest33-21ksoftirqd/308:00:133
17178992514,6cyclictest35966irq/58-eth009:55:123
1716399252,16cyclictest8951-21ssh10:25:131
1715799253,15cyclictest32325-21ssh10:20:150
1715799252,18cyclictest26590-21ssh09:20:480
1717899243,16cyclictest35966irq/58-eth009:50:123
17178992414,6cyclictest35966irq/58-eth010:50:133
17178992411,7cyclictest35966irq/58-eth009:45:133
1716399248,11cyclictest21-21ksoftirqd/112:28:591
1715799249,9cyclictest151rcuc/009:40:130
1715799249,7cyclictest12-21ksoftirqd/010:06:470
1715799241,18cyclictest5496-21apt-get08:05:140
1717899238,9cyclictest35966irq/58-eth009:40:143
1717899238,10cyclictest35966irq/58-eth009:19:483
1717899234,11cyclictest35966irq/58-eth010:55:133
1716399231,18cyclictest12561-21ssh12:15:131
1716399231,17cyclictest19256-21sh09:17:481
1715799232,17cyclictest3118-21diskmemload10:40:140
1715799231,17cyclictest15066-21apt-get08:15:140
1717899223,11cyclictest0-21swapper/309:30:153
1717899222,3cyclictest0-21swapper/311:35:133
17178992218,2cyclictest0-21swapper/309:25:113
17178992213,6cyclictest0-21swapper/310:00:223
17178992211,8cyclictest35966irq/58-eth011:50:163
17178992211,8cyclictest35966irq/58-eth009:35:143
17178992211,8cyclictest35966irq/58-eth009:35:133
17178992210,4cyclictest35966irq/58-eth010:45:143
1716399227,9cyclictest26929-21ssh12:05:121
1716399227,9cyclictest26929-21ssh12:05:121
1716399222,14cyclictest548866ssh11:35:151
17163992210,9cyclictest31025-21ssh10:35:301
1715799223,10cyclictest151rcuc/009:30:120
1715799222,16cyclictest3118-21diskmemload11:50:140
1715799222,12cyclictest12-21ksoftirqd/007:45:160
1715799221,5cyclictest131rcu_preempt08:45:140
1715799221,4cyclictest5598-21ssh09:45:300
1715799221,17cyclictest5426-21ssh11:15:260
1715799221,15cyclictest3508-21ssh12:10:120
1717899219,7cyclictest0-21swapper/308:30:133
1717899218,9cyclictest35966irq/58-eth011:25:143
1717899213,12cyclictest0-21swapper/311:05:153
1717899213,12cyclictest0-21swapper/311:05:143
1717899211,16cyclictest0-21swapper/309:10:143
1716399217,5cyclictest20189-21timerwakeupswit08:50:271
1716399213,10cyclictest21-21ksoftirqd/107:35:141
1716399212,14cyclictest12365-21ssh12:31:061
1716399211,9cyclictest10962-21ntp_states11:00:261
1716399211,15cyclictest21623-21ssh12:20:161
1716399211,10cyclictest7277-21ntp_192.168.11410:40:251
1715799217,4cyclictest131rcu_preempt10:00:200
17157992114,4cyclictest12-21ksoftirqd/011:13:470
17157992113,5cyclictest0-21swapper/012:20:240
17157992113,4cyclictest12-21ksoftirqd/007:50:170
17157992113,4cyclictest12-21ksoftirqd/007:30:150
1715799211,17cyclictest12534-21sh12:15:130
17157992110,7cyclictest12-21ksoftirqd/011:30:240
1717899201,13cyclictest0-21swapper/307:25:213
1717899201,12cyclictest0-21swapper/312:15:133
1716399209,6cyclictest0-21swapper/110:45:471
1716399207,3cyclictest131rcu_preempt12:10:291
1716399206,11cyclictest16204-21cron08:50:011
1716399202,14cyclictest19414-21apt-get11:25:041
1716399201,2cyclictest0-21swapper/107:25:121
1716399201,16cyclictest23265-21apt-get10:15:111
17163992011,6cyclictest17522-21kthreadcore11:05:191
17163992011,6cyclictest17522-21kthreadcore11:05:191
1716399201,15cyclictest29097-21cut11:30:171
1716399201,14cyclictest18627-21cpuspeed07:45:151
1715799209,8cyclictest3209-21grep07:25:280
1715799205,3cyclictest11969-21kworker/0:110:28:200
17157992012,5cyclictest0-21swapper/010:30:140
17157992012,5cyclictest0-21swapper/010:30:140
1715799200,17cyclictest6614-21ls08:40:020
1717899199,6cyclictest0-21swapper/310:39:093
1717899193,11cyclictest0-21swapper/311:46:013
1717899193,11cyclictest0-21swapper/307:20:483
17178991912,5cyclictest0-21swapper/312:00:213
1717899191,13cyclictest0-21swapper/310:10:273
1717099191,10cyclictest17180-21latency_hist07:10:022
1716399194,12cyclictest12501-21wc11:55:221
1716399194,10cyclictest10194-21ls08:40:231
1716399191,9cyclictest1825-21kthreadcore08:00:191
1716399191,7cyclictest16682-21irqstats12:35:191
1716399191,5cyclictest23433-21apt-get11:45:131
17163991912,4cyclictest9350-21grep08:05:291
17163991912,4cyclictest20359-21kernelversion09:55:181
1716399191,15cyclictest30170-21irqrtprio08:30:191
1716399191,15cyclictest13417-21kthreadcore09:50:231
17163991910,6cyclictest25924-21grep07:15:271
1715799199,2cyclictest12-21ksoftirqd/011:29:350
1715799197,3cyclictest12-21ksoftirqd/009:36:200
1715799197,3cyclictest12-21ksoftirqd/009:36:190
1715799195,4cyclictest12-21ksoftirqd/012:07:520
1715799195,4cyclictest12-21ksoftirqd/012:07:510
1715799192,2cyclictest131rcu_preempt11:21:340
1715799191,15cyclictest31895-21ssh10:35:340
1715799190,14cyclictest10157-21missed_timers08:40:220
1717899189,7cyclictest0-21swapper/311:00:383
1717899186,7cyclictest0-21swapper/312:20:133
1717899183,10cyclictest0-21swapper/308:20:293
1717899182,11cyclictest0-21swapper/309:05:153
1717899182,11cyclictest0-21swapper/307:10:143
1717899182,11cyclictest0-21swapper/307:10:133
1717899182,10cyclictest0-21swapper/312:10:053
1717899182,10cyclictest0-21swapper/308:55:053
1717899182,10cyclictest0-21swapper/308:50:133
1717899182,10cyclictest0-21swapper/308:40:133
1717899182,10cyclictest0-21swapper/308:25:143
17178991811,4cyclictest0-21swapper/312:35:323
17178991811,4cyclictest0-21swapper/310:20:153
1717899181,13cyclictest0-21swapper/308:45:173
1717899181,13cyclictest0-21swapper/308:35:283
1717899181,13cyclictest0-21swapper/308:15:233
1716399186,9cyclictest20897-21cat07:10:261
1716399186,9cyclictest20897-21cat07:10:261
1716399181,8cyclictest7216-21kthreadcore07:30:231
1716399181,8cyclictest24858-21fschecks_count08:25:161
1716399181,14cyclictest314-21idleruntime-cro08:00:011
1716399181,14cyclictest25905-21cut09:00:011
1716399181,13cyclictest30983-21apt-get09:05:141
1715799188,7cyclictest12-21ksoftirqd/007:20:170
1715799187,3cyclictest12-21ksoftirqd/008:50:220
1715799183,10cyclictest0-21swapper/008:31:470
1717899172,10cyclictest0-21swapper/307:45:153
1717899172,10cyclictest0-21swapper/307:40:123
1717899171,13cyclictest0-21swapper/308:05:173
1717899171,13cyclictest0-21swapper/308:00:023
1716399179,4cyclictest22237-21kthreadcore09:20:201
1716399177,7cyclictest24892-21kthreadcore07:50:211
1716399171,12cyclictest930-21snmpd10:13:111
1716399171,12cyclictest13761-21apt-get07:40:101
1716399170,6cyclictest22111-21sed10:30:301
1716399170,6cyclictest22111-21sed10:30:301
1715799173,11cyclictest29332-21kthreadcore09:00:220
1715799172,10cyclictest0-21swapper/008:25:140
17157991711,4cyclictest0-21swapper/007:10:180
17157991711,4cyclictest0-21swapper/007:10:180
1715799171,12cyclictest26673-21munin-run07:20:010
1716399162,10cyclictest0-21swapper/108:35:141
1716399161,11cyclictest20018-21fschecks_count08:20:141
1716399161,10cyclictest32557-21cut11:50:181
1716399160,14cyclictest29140-21cut09:00:221
1715799168,5cyclictest24527-21wc08:25:010
17157991611,3cyclictest30972-21acpi09:05:140
1717899151,8cyclictest0-21swapper/309:00:233
1716399151,12cyclictest27312-21sed07:20:171
1716399151,10cyclictest17213-21grep07:10:011
1715799151,11cyclictest17174-21wc07:10:010
1717899142,8cyclictest0-21swapper/307:35:163
1717899131,9cyclictest0-21swapper/307:20:013
1717899111,7cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional