You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 22:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Thu Jun 11, 2026 12:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24334996155,4cyclictest35966irq/58-eth009:55:113
24334995744,7cyclictest35966irq/58-eth010:10:133
24334995436,10cyclictest35966irq/58-eth009:50:123
2433499503,36cyclictest35966irq/58-eth012:15:123
24334994738,6cyclictest35966irq/58-eth012:30:123
2433499435,23cyclictest35966irq/58-eth009:30:103
2433499433,25cyclictest35966irq/58-eth008:55:113
2433499372,20cyclictest35966irq/58-eth007:25:123
24334993623,8cyclictest35966irq/58-eth009:10:123
24334993618,11cyclictest35966irq/58-eth010:15:123
2433499360,20cyclictest35966irq/58-eth012:10:133
2433499336,17cyclictest0-21swapper/311:20:133
24334993314,9cyclictest0-21swapper/310:40:153
2431799330,26cyclictest28894-21ssh10:50:121
2433499323,21cyclictest0-21swapper/311:30:213
2431799321,23cyclictest5297-21ssh11:10:451
2433499316,11cyclictest0-21swapper/310:55:123
2433499316,11cyclictest0-21swapper/310:55:123
2433499312,14cyclictest35966irq/58-eth010:00:133
2431799311,21cyclictest25660-21ssh12:00:131
2431799310,19cyclictest0-21swapper/109:05:141
2430999312,22cyclictest7281-21ssh10:20:130
2433499292,17cyclictest35966irq/58-eth010:20:133
2431799291,21cyclictest15376-21kthreadcore11:35:211
2433499286,13cyclictest0-21swapper/311:10:133
2433499284,17cyclictest0-21swapper/309:45:133
2433499283,20cyclictest33-21ksoftirqd/312:35:133
2433499283,17cyclictest0-21swapper/312:09:213
2433499278,9cyclictest0-21swapper/310:30:133
2433499278,9cyclictest0-21swapper/310:30:133
2433499273,16cyclictest0-21swapper/312:28:213
2433499273,16cyclictest0-21swapper/312:28:213
2431799271,19cyclictest15849-21ssh10:40:371
24309992720,4cyclictest1917-21sh10:35:140
2433499266,10cyclictest35966irq/58-eth012:00:123
24334992610,8cyclictest0-21swapper/310:50:213
2432699261,7cyclictest2206366ssh10:45:202
2431799261,19cyclictest11494-21ssh12:26:211
2431799261,19cyclictest11494-21ssh12:26:211
2430999263,18cyclictest28882-21ssh10:50:110
2433499251,16cyclictest0-21swapper/311:50:123
2433499243,13cyclictest0-21swapper/311:40:213
2433499243,12cyclictest0-21swapper/310:25:133
2433499242,14cyclictest0-21swapper/308:10:123
2433499241,15cyclictest35966irq/58-eth007:50:153
2432699241,9cyclictest250866ssh09:22:152
24326992413,3cyclictest0-21swapper/209:30:112
2432699241,16cyclictest29736-21kthreadcore08:20:212
2432699241,16cyclictest24243-21kthreadcore09:35:202
2432699241,15cyclictest31262-21kthreadcore07:15:202
2432699240,9cyclictest131rcu_preempt12:05:152
2431799240,14cyclictest10097-21diskmemload10:15:181
24309992414,3cyclictest12-21ksoftirqd/012:05:190
24326992318,3cyclictest27-21ksoftirqd/212:35:132
2432699231,5cyclictest0-21swapper/211:01:472
2432699231,14cyclictest13838-21kthreadcore07:30:202
2431799231,15cyclictest18252-21ssh11:20:111
2430999231,7cyclictest15359-21kthreadcore11:35:210
2430999231,5cyclictest29253-21ntp_192.168.11412:00:240
2433499224,11cyclictest0-21swapper/311:55:113
2433499221,13cyclictest35966irq/58-eth008:20:133
2432699227,11cyclictest27688-21tail11:25:172
2432699222,5cyclictest27-21ksoftirqd/212:02:052
2432699222,4cyclictest27-21ksoftirqd/210:39:212
2432699222,17cyclictest23588-21grep12:35:022
2432699222,13cyclictest24265-21irqrtprio11:05:192
2432699222,12cyclictest16260-21sh10:05:252
2432699221,14cyclictest3511-21kthreadcore07:20:182
2432699221,13cyclictest11188-21ssh12:10:022
24326992210,5cyclictest20698-21sshd07:39:192
2431799225,11cyclictest21-21ksoftirqd/111:00:141
2431799221,15cyclictest6813-21cut11:30:211
2430999225,14cyclictest7618-21ssh11:50:120
2433499213,12cyclictest0-21swapper/310:45:483
24334992112,4cyclictest0-21swapper/309:25:143
2432699218,6cyclictest28102-21cron08:55:012
2432699214,10cyclictest87766lldpd08:41:402
2432699212,4cyclictest27-21ksoftirqd/212:16:002
2432699212,4cyclictest27-21ksoftirqd/210:42:182
2432699212,15cyclictest8961-21ssh09:45:132
2432699212,12cyclictest2888-21kthreadcore09:40:222
2432699211,18cyclictest2745-21cron07:55:002
2432699211,17cyclictest1877-21awk10:15:252
24326992110,3cyclictest16754-21grep11:55:142
2432699210,3cyclictest0-21swapper/209:11:552
2432699210,19cyclictest11106-21kthreadcore08:00:222
2431799216,10cyclictest30170-21ssh10:30:351
2431799216,10cyclictest30170-21ssh10:30:351
2431799211,15cyclictest22034-21ssh11:40:121
2431799211,14cyclictest30821-21memory11:25:211
2431799211,14cyclictest11179-21/usr/sbin/munin11:50:211
2431799211,13cyclictest23716-21kthreadcore12:15:221
2431799211,12cyclictest10097-21diskmemload11:07:241
2431799211,11cyclictest0-21swapper/110:25:121
2430999219,3cyclictest12-21ksoftirqd/010:45:200
2430999217,3cyclictest131rcu_preempt07:55:010
2430999213,15cyclictest23934-21ssh12:35:140
2430999211,16cyclictest20965-21apt-get07:40:110
2433499202,12cyclictest35966irq/58-eth011:05:133
24334992012,4cyclictest0-21swapper/310:05:123
2433499201,13cyclictest0-21swapper/311:15:163
2433499201,13cyclictest0-21swapper/307:20:263
2432699209,9cyclictest5872-21irqcore10:55:182
2432699209,9cyclictest5872-21irqcore10:55:172
2432699209,8cyclictest559-21kthreadcore11:45:202
2432699209,8cyclictest29135-21kthreadcore08:55:182
2432699209,3cyclictest27-21ksoftirqd/210:14:212
2432699209,3cyclictest27-21ksoftirqd/209:55:112
2432699208,9cyclictest16106-21ssh10:25:062
2432699208,5cyclictest25562-21sort10:30:162
2432699208,5cyclictest25562-21sort10:30:152
2432699205,8cyclictest27-21ksoftirqd/211:10:112
2432699202,6cyclictest0-21swapper/209:15:542
2432699202,15cyclictest6169-21kthreadcore07:55:222
2432699201,7cyclictest1698366ssh11:35:272
2432699201,6cyclictest1331066ssh11:51:312
2432699201,3cyclictest0-21swapper/211:17:422
2432699201,17cyclictest8177-21kthreadcore07:25:182
2432699201,16cyclictest22055-21cron08:15:012
2432699201,16cyclictest21080-21kthreadcore08:45:202
2432699201,12cyclictest9500-21irqcore08:35:182
2432699201,12cyclictest23968-21kthreadcore07:40:212
2432699201,11cyclictest7974-21cut10:20:182
2432699201,11cyclictest7319-21kthreadcore09:25:212
2432699201,11cyclictest17943-21/usr/sbin/munin09:50:252
2431799208,10cyclictest29797-21tr08:20:211
2431799205,6cyclictest11592-21kthreadcore09:10:191
2431799204,3cyclictest10097-21diskmemload09:16:301
2431799201,16cyclictest9156-21ls08:35:141
24317992011,6cyclictest5547-21ssh10:35:251
2431799201,16cyclictest22446-21cut08:15:151
2431799201,15cyclictest9315-21ssh11:15:131
2431799201,13cyclictest0-21swapper/110:07:471
2431799201,12cyclictest5819-21cut09:25:191
2431799201,11cyclictest10097-21diskmemload09:42:401
2431799201,11cyclictest0-21swapper/107:10:151
2430999204,13cyclictest3472-21memory09:40:230
2430999201,16cyclictest19125-21cut10:25:210
2430999201,15cyclictest23582-21ssh11:05:140
24309992010,3cyclictest12-21ksoftirqd/009:30:170
2433499195,7cyclictest0-21swapper/310:35:133
2433499193,9cyclictest0-21swapper/311:35:543
24334991912,5cyclictest0-21swapper/311:25:123
2433499191,14cyclictest0-21swapper/308:45:133
2433499191,11cyclictest0-21swapper/307:10:163
24334991910,6cyclictest0-21swapper/309:38:003
2432699199,8cyclictest5801-21sh12:25:042
2432699199,8cyclictest5801-21sh12:25:042
2432699199,8cyclictest21979-21/usr/sbin/munin11:40:232
2432699198,3cyclictest10097-21diskmemload10:03:272
2432699197,5cyclictest26368-21/usr/sbin/munin08:15:282
2432699196,6cyclictest27897-21/usr/sbin/munin07:10:232
2432699196,11cyclictest4372-21tail11:30:182
2432699192,10cyclictest27096-21kthreadcore07:45:202
2432699191,15cyclictest792-21kthreadcore08:25:192
2432699191,15cyclictest792-21kthreadcore08:25:192
2432699191,15cyclictest6337-21cut08:30:212
2432699191,14cyclictest5522-21apt-get09:05:142
2432699191,11cyclictest30602-21kthreadcore12:20:202
2432699190,6cyclictest131rcu_preempt11:21:222
2431799198,9cyclictest5854-21if_eth110:55:181
2431799198,9cyclictest5854-21if_eth110:55:171
2431799198,4cyclictest91-21pr/ttyS007:45:011
2431799193,3cyclictest1-21systemd07:35:081
2431799191,16cyclictest11556-21ls07:30:161
2431799191,13cyclictest26298-21ssh10:47:211
2431799191,10cyclictest10097-21diskmemload11:56:021
2431799190,14cyclictest7566-21ls10:20:161
2431799190,11cyclictest0-21swapper/109:21:491
2431799190,10cyclictest0-21swapper/112:21:231
2430999198,8cyclictest3525-21apt-get10:00:130
2430999195,3cyclictest10097-21diskmemload11:46:240
2430999193,13cyclictest28651-21ps08:55:170
2430999193,13cyclictest14070-21fschecks_time08:40:160
2430999192,13cyclictest23269-21ssh09:35:130
2430999192,13cyclictest17993-21ssh09:50:130
24309991913,4cyclictest28947-21if_eth109:20:170
24309991913,4cyclictest22410-21irqcore11:40:160
24309991913,3cyclictest25813-21cpu07:45:140
2430999191,14cyclictest20371-21ssh12:15:130
2430999191,14cyclictest17483-21apt-get08:10:110
24309991910,6cyclictest7523-21cut12:25:210
24309991910,6cyclictest7523-21cut12:25:210
2433499183,11cyclictest0-21swapper/311:46:213
2433499183,10cyclictest0-21swapper/311:00:503
2433499182,8cyclictest0-21swapper/312:20:193
2433499182,10cyclictest0-21swapper/308:25:143
2433499182,10cyclictest0-21swapper/308:25:133
2433499182,10cyclictest0-21swapper/308:15:133
2433499181,13cyclictest0-21swapper/309:15:253
24334991810,6cyclictest0-21swapper/309:20:113
2432699181,9cyclictest721-21apt-get09:00:142
2432699181,9cyclictest31190-21kthreadcore10:50:202
2432699181,14cyclictest12870-21fschecks_time08:05:152
2431799186,10cyclictest12085-21tr09:45:211
2431799182,12cyclictest7535-21apt-get08:00:031
2431799181,9cyclictest0-21swapper/112:33:091
2431799181,8cyclictest1048-21interrupts09:00:191
2431799181,7cyclictest10097-21diskmemload09:53:011
24317991811,5cyclictest31924-21sshd12:39:211
2431799181,14cyclictest26966-21ssh09:55:111
2431799181,14cyclictest14099-21grep08:40:161
2431799181,13cyclictest25309-21ssh10:10:261
2431799181,11cyclictest10333-21sh12:09:211
2430999189,7cyclictest9680-21interrupts11:15:180
2430999188,8cyclictest27357-21ps09:55:160
2430999188,5cyclictest3311-21tail07:55:170
2430999184,3cyclictest10097-21diskmemload10:30:430
2430999184,3cyclictest10097-21diskmemload10:30:430
2430999183,13cyclictest909-21fschecks_time09:00:160
2430999183,13cyclictest7142-21kthreadcore09:05:210
2430999183,13cyclictest13677-21munin-run08:40:010
2430999183,12cyclictest20827-21grep07:40:020
2430999183,12cyclictest10097-21diskmemload09:25:320
2430999182,13cyclictest8951-21ssh09:45:120
2430999182,13cyclictest29309-21ssh12:20:140
2430999182,12cyclictest12562-21ssh10:05:120
2430999181,9cyclictest11402-21cpuspeed07:30:130
24309991813,3cyclictest0-21swapper/010:10:130
2430999181,15cyclictest16593-21ssh11:55:110
24309991811,5cyclictest12-21ksoftirqd/009:10:270
24309991811,4cyclictest356-21fschecks_time11:10:150
2430999181,14cyclictest12664-21munin-run11:35:010
2430999181,13cyclictest23202-21ntp_states09:15:260
2433499172,10cyclictest0-21swapper/308:50:133
2433499172,10cyclictest0-21swapper/308:40:143
2433499172,10cyclictest0-21swapper/308:35:153
2433499172,10cyclictest0-21swapper/307:55:133
24334991711,4cyclictest0-21swapper/309:42:253
2433499171,13cyclictest0-21swapper/307:35:153
2433499171,11cyclictest0-21swapper/308:30:183
2432699171,8cyclictest24384-21latency_hist07:10:022
2431799179,6cyclictest6202-21cat07:20:281
2431799179,6cyclictest30690-21entropy07:50:161
2431799179,6cyclictest24108-21cut09:35:201
2431799176,7cyclictest0-21swapper/111:45:201
2431799175,4cyclictest0-21swapper/108:50:271
2431799171,4cyclictest131rcu_preempt08:25:161
2431799171,4cyclictest131rcu_preempt08:25:161
2431799171,13cyclictest3542-21ssh10:00:131
2431799171,12cyclictest11224-21ssh12:10:041
2431799171,11cyclictest28386-21cpuspeed08:55:131
2431799171,10cyclictest0-21swapper/109:34:361
24317991710,5cyclictest20165-21sshd08:10:201
2430999177,7cyclictest29297-21apt-get07:15:120
2430999174,11cyclictest12-21ksoftirqd/007:25:110
2430999172,7cyclictest1823766ssh10:43:290
2430999172,12cyclictest844-21munin-node08:15:130
2430999172,12cyclictest7535-21apt-get08:00:050
2430999171,8cyclictest31685-21latency_hist08:25:010
2430999171,13cyclictest3108-21ssh10:15:330
2430999171,13cyclictest30951-21ssh11:25:230
2430999171,13cyclictest10878-21apt-get12:10:040
24309991711,3cyclictest0-21swapper/010:55:130
24309991711,3cyclictest0-21swapper/010:55:130
24309991710,5cyclictest2304-21cut08:25:200
24309991710,5cyclictest2304-21cut08:25:200
24309991710,5cyclictest19792-21cron11:01:000
24309991710,4cyclictest18889-21sed11:20:170
2430999170,6cyclictest2217966ssh12:33:240
2433499162,10cyclictest0-21swapper/307:40:133
2431799161,7cyclictest25939-21fschecks_count07:45:151
2431799161,3cyclictest0-21swapper/108:30:171
24317991611,3cyclictest6615-21fschecks_count07:25:151
2431799160,13cyclictest3306-21cut07:55:171
2430999168,6cyclictest4835-21cut08:30:180
2430999167,7cyclictest29053-21cron07:15:010
2430999163,11cyclictest24820-21kthreadcore08:50:200
2430999162,12cyclictest2425-21kthreadcore07:20:170
2430999161,12cyclictest18705-21apt-get08:45:120
2433499152,10cyclictest0-21swapper/309:05:263
2433499151,11cyclictest0-21swapper/307:15:193
2431799158,5cyclictest12778-21awk08:05:131
2431799151,9cyclictest0-21swapper/108:45:121
2431799151,11cyclictest31780-21kthreadcore07:15:211
2430999159,4cyclictest16265-21sendmail_mailtr08:05:260
2433499141,7cyclictest0-21swapper/309:00:233
2433499141,10cyclictest0-21swapper/308:05:153
2431799146,5cyclictest0-21swapper/107:10:031
2430999142,10cyclictest24337-21latency_hist07:10:020
2433499138,3cyclictest0-21swapper/307:30:223
2433499132,8cyclictest0-21swapper/307:10:023
2433499132,7cyclictest0-21swapper/307:45:153
2433499122,6cyclictest0-21swapper/308:00:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional