You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 19:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Sun Jul 26, 2026 12:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29840997842,22cyclictest35966irq/58-eth011:35:143
2979999711,50cyclictest16677-21ssh10:40:160
2979999711,50cyclictest16677-21ssh10:40:150
29799997026,6cyclictest131rcu_preempt07:55:150
2979999621,42cyclictest2221-21ssh10:50:130
2983299604,29cyclictest681-21ssh11:25:132
2983299591,30cyclictest4315-21ssh11:45:132
2983299562,37cyclictest9160-21ssh10:00:142
2981799454,37cyclictest2765-21ssh12:20:131
2979999427,8cyclictest131rcu_preempt07:35:130
2984099412,26cyclictest35966irq/58-eth012:15:143
2979999405,31cyclictest9145-21ssh10:00:130
2979999401,34cyclictest27778-21ssh11:40:130
2983299394,18cyclictest930-21snmpd08:30:142
29817993923,13cyclictest21-21ksoftirqd/107:10:141
2983299381,19cyclictest28474-21kworker/u8:011:30:142
2981799385,19cyclictest18722-21ssh11:35:131
2981799383,30cyclictest22430-21ssh11:55:121
2981799382,29cyclictest24094-21ssh11:20:131
2984099362,21cyclictest35966irq/58-eth008:15:133
2983299362,18cyclictest2646-21rm10:14:092
2983299362,18cyclictest2646-21rm10:14:082
29817993616,12cyclictest29775-21cyclictest08:30:161
2979999367,23cyclictest29896-21ssh12:35:160
2979999364,26cyclictest24810-21kworker/u8:009:20:130
2979999364,26cyclictest24810-21kworker/u8:009:20:120
2979999363,29cyclictest31500-21ssh12:00:130
29799993616,5cyclictest131rcu_preempt08:35:140
2979999354,9cyclictest131rcu_preempt07:15:130
2983299343,9cyclictest0-21swapper/212:09:262
2979999343,25cyclictest25608-21ssh10:45:120
2979999342,27cyclictest20772-21ssh12:30:110
2979999342,26cyclictest29411-21ssh11:05:130
2979999342,24cyclictest16029-21ssh09:10:180
29799993421,11cyclictest12-21ksoftirqd/010:15:120
2984099331,22cyclictest35966irq/58-eth011:20:123
2984099331,22cyclictest35966irq/58-eth007:10:133
2983299331,24cyclictest13358-21ssh11:50:142
2979999332,21cyclictest32496-21ssh09:55:150
2984099325,15cyclictest35966irq/58-eth011:00:133
29840993215,9cyclictest35966irq/58-eth011:10:153
2983299325,13cyclictest11350-21ssh10:55:152
2981799322,21cyclictest20398-21ssh11:00:141
2979999325,21cyclictest12-21ksoftirqd/009:00:140
2983299318,18cyclictest27-21ksoftirqd/212:24:322
2983299313,17cyclictest27346irq/40-dwc2_hso11:35:142
2983299312,19cyclictest27346irq/40-dwc2_hso08:15:142
2981799315,16cyclictest73-21kswapd012:05:121
2981799312,23cyclictest11345-21ssh10:55:151
29817993111,9cyclictest19677-21ssh09:30:151
2984099302,15cyclictest35966irq/58-eth011:25:143
2984099302,15cyclictest35966irq/58-eth010:50:123
29840993018,7cyclictest35966irq/58-eth012:25:143
29840993018,7cyclictest35966irq/58-eth012:25:133
2983299303,8cyclictest0-21swapper/210:22:252
2983299302,21cyclictest27797-21ssh11:40:152
2983299302,20cyclictest2694-21ssh12:00:252
2981799302,20cyclictest24544-21tr10:25:261
2979999302,22cyclictest6573-21ssh10:34:140
2979999302,22cyclictest18195-21ssh10:05:130
2979999301,23cyclictest27158-21ssh10:10:130
2979999301,23cyclictest27158-21ssh10:10:120
2979999301,20cyclictest12-21ksoftirqd/009:05:110
2983299292,20cyclictest0-21swapper/207:20:142
2983299292,10cyclictest17911-21ssh09:28:252
2979999292,22cyclictest19377-21sh10:22:250
29799992916,10cyclictest19234-21cron09:30:010
2984099283,10cyclictest0-21swapper/311:50:153
29840992813,10cyclictest35966irq/58-eth009:10:193
2981799286,15cyclictest2250-21diskmemload10:50:141
2979999282,23cyclictest24543-21cut10:25:270
2979999282,22cyclictest16181-21ssh12:09:260
2979999280,22cyclictest26155-21ssh12:15:150
2984099278,13cyclictest0-21swapper/309:35:143
2984099271,16cyclictest35966irq/58-eth008:10:133
2984099271,16cyclictest35966irq/58-eth008:10:123
2983299279,3cyclictest131rcu_preempt07:55:152
2983299274,14cyclictest27346irq/40-dwc2_hso07:35:122
2983299273,15cyclictest27346irq/40-dwc2_hso12:10:112
2983299273,14cyclictest27346irq/40-dwc2_hso08:20:122
2983299272,7cyclictest930-21snmpd07:25:152
2983299272,20cyclictest0-21swapper/209:46:262
2983299272,20cyclictest0-21swapper/209:15:152
2981799273,15cyclictest201rcuc/111:30:131
2981799272,19cyclictest8844-21ssh11:29:251
2981799271,14cyclictest0-21swapper/111:50:151
2979999272,20cyclictest14347-21ssh09:45:130
2983299264,15cyclictest27346irq/40-dwc2_hso08:50:122
2983299262,19cyclictest5989-21ntpq10:50:272
2983299262,18cyclictest7437-21ssh10:15:262
2983299262,17cyclictest27346irq/40-dwc2_hso09:50:122
29832992618,5cyclictest23862-21ssh09:30:322
2983299261,19cyclictest31050-21ssh10:30:142
2981799262,19cyclictest16250-21ssh09:26:251
29817992613,3cyclictest131rcu_preempt10:45:141
29817992611,5cyclictest131rcu_preempt09:20:171
29817992611,5cyclictest131rcu_preempt09:20:171
2979999269,8cyclictest12-21ksoftirqd/009:30:140
2984099252,16cyclictest0-21swapper/309:25:143
2983299254,14cyclictest27346irq/40-dwc2_hso07:40:132
2983299253,17cyclictest0-21swapper/211:04:212
2983299252,18cyclictest29950-21ssh10:29:142
2983299252,18cyclictest26017-21ssh10:09:082
2983299251,19cyclictest16049-21ssh09:10:182
2981799258,7cyclictest21-21ksoftirqd/111:45:131
2981799254,18cyclictest3772-21ssh10:15:121
2979999252,18cyclictest5364-21ssh09:40:150
2984099242,11cyclictest0-21swapper/309:47:273
2984099241,14cyclictest0-21swapper/310:15:113
2983299246,12cyclictest27346irq/40-dwc2_hso07:50:132
2983299243,6cyclictest0-21swapper/209:23:562
2983299243,6cyclictest0-21swapper/209:23:552
2983299242,16cyclictest0-21swapper/211:55:052
2983299241,19cyclictest32596-21ssh12:17:272
2983299241,19cyclictest24735-21ssh10:44:272
2983299241,19cyclictest24735-21ssh10:44:262
2981799242,14cyclictest201rcuc/109:10:161
2981799241,19cyclictest15088-21ssh11:15:161
2979999243,17cyclictest12-21ksoftirqd/007:50:120
2984099233,13cyclictest0-21swapper/310:34:153
2983299234,12cyclictest27346irq/40-dwc2_hso08:35:142
2983299232,6cyclictest0-21swapper/209:44:032
2983299232,15cyclictest0-21swapper/212:25:152
2983299232,15cyclictest0-21swapper/212:25:142
29817992314,6cyclictest18449-21wc10:05:161
29817992313,7cyclictest21-21ksoftirqd/110:25:021
2981799231,15cyclictest29895-21sh12:35:161
2979999234,14cyclictest11803-21ssh12:25:140
2979999234,14cyclictest11803-21ssh12:25:130
2979999233,14cyclictest0-21swapper/011:55:130
2984099228,9cyclictest35966irq/58-eth012:35:163
2984099222,9cyclictest35966irq/58-eth009:30:143
2983299224,11cyclictest27346irq/40-dwc2_hso08:05:152
2983299222,10cyclictest3013-21ssh09:55:232
2983299221,9cyclictest24231-21kthreadcore08:10:202
2983299221,9cyclictest24231-21kthreadcore08:10:192
2983299221,11cyclictest73-21kswapd011:15:152
2983299221,10cyclictest897-21grep12:35:242
29817992212,7cyclictest14658-21cron11:15:001
29799992210,9cyclictest22878-21apt-get08:10:130
29799992210,9cyclictest22878-21apt-get08:10:120
29799992210,8cyclictest5552-21cat11:25:320
2984099213,12cyclictest0-21swapper/312:24:333
2984099213,12cyclictest0-21swapper/311:44:263
2984099213,12cyclictest0-21swapper/310:26:263
29840992112,5cyclictest0-21swapper/311:55:113
29840992110,8cyclictest0-21swapper/310:09:113
2983299214,13cyclictest20765-21sh12:30:122
2983299213,9cyclictest27513-21kthreadcore10:45:182
2983299212,9cyclictest6554-21kthreadcore08:25:212
2983299212,4cyclictest0-21swapper/210:35:132
2983299212,16cyclictest26555-21kthreadcore11:20:222
2983299211,11cyclictest29410-21sh11:05:132
2983299211,10cyclictest7049-21latency_hist07:20:022
29832992110,8cyclictest0-21swapper/207:45:162
2981799211,17cyclictest32431-21latency_hist08:20:011
2981799211,16cyclictest26407-21apt-get07:40:131
2981799211,16cyclictest23487-21diskmemload09:50:141
2979999219,7cyclictest0-21swapper/010:36:400
29799992114,5cyclictest0-21swapper/009:35:160
2979999210,17cyclictest1415-21find08:55:150
2984099209,9cyclictest0-21swapper/310:11:003
2984099209,9cyclictest0-21swapper/310:10:593
2984099209,9cyclictest0-21swapper/309:19:113
2984099203,12cyclictest0-21swapper/310:24:273
2984099201,13cyclictest0-21swapper/309:50:143
2984099201,12cyclictest0-21swapper/311:30:133
2983299201,9cyclictest20370-21kthreadcore08:40:182
2983299201,9cyclictest16469-21latency08:00:222
2983299201,4cyclictest28723-21ssh09:35:142
2983299201,13cyclictest24444-21cut08:45:152
2983299201,11cyclictest6453-21fschecks_time09:00:162
2983299201,10cyclictest14851-21head09:05:272
2983299200,16cyclictest21560-21cat07:35:022
2981799208,9cyclictest15165-21cut08:35:181
2981799202,14cyclictest16657-21ssh10:40:131
2981799202,14cyclictest16657-21ssh10:40:131
2981799202,11cyclictest844-21munin-node08:40:141
2981799201,7cyclictest29424-21cut09:35:181
2981799201,6cyclictest24934-21ssh12:30:301
29817992014,4cyclictest0-21swapper/107:30:111
29817992012,5cyclictest27743-21/usr/sbin/munin11:40:161
2981799201,15cyclictest18054-21sshd09:45:251
2981799201,15cyclictest15570-21diskmemload09:55:141
29817992010,7cyclictest28592-21ntpq09:15:251
29799992012,6cyclictest1-21systemd07:13:300
2979999201,15cyclictest13352-21ssh11:50:130
2984099198,6cyclictest0-21swapper/312:32:213
2984099193,11cyclictest0-21swapper/310:39:143
2984099193,11cyclictest0-21swapper/309:24:263
2984099193,11cyclictest0-21swapper/309:24:253
2984099192,11cyclictest0-21swapper/309:55:143
29840991912,4cyclictest0-21swapper/309:41:383
29840991911,5cyclictest35966irq/58-eth012:00:153
2984099191,15cyclictest0-21swapper/311:45:203
2984099191,12cyclictest0-21swapper/311:15:163
2984099191,12cyclictest0-21swapper/307:55:183
29840991910,6cyclictest0-21swapper/311:05:203
2983299192,8cyclictest7173-21ssh11:10:222
2983299192,8cyclictest30095-21fschecks_count07:10:152
2983299191,9cyclictest1917-21irqrtprio08:55:222
2981799196,10cyclictest15908-21grep12:25:321
2981799196,10cyclictest15908-21grep12:25:311
2981799195,11cyclictest5235-21kthreadcore07:50:211
2981799195,11cyclictest30995-21cut10:10:271
2981799195,11cyclictest30995-21cut10:10:261
2981799193,9cyclictest0-21swapper/110:34:151
2981799192,9cyclictest21613-21apt-get07:35:121
2981799192,11cyclictest13144-21ssh09:44:031
2981799191,8cyclictest16856-21switchtime08:00:281
29817991911,5cyclictest7511-21irqcore07:20:191
2981799191,14cyclictest32306-21apt-get08:20:051
2981799191,11cyclictest17100-21ssh12:10:141
29817991910,6cyclictest2614-21sshd11:06:271
2979999196,6cyclictest26456-21kthreadcore09:50:220
2979999194,12cyclictest32310-21munin-run08:20:020
2979999193,12cyclictest0-21swapper/011:20:120
2979999193,10cyclictest9121-21kthreadcore11:10:250
2979999192,13cyclictest17086-21ssh12:10:120
2979999191,6cyclictest32679-21switchtime08:50:270
29799991911,5cyclictest12098-21kthreadcore10:55:200
29799991911,5cyclictest10496-21kthreadcore11:30:190
2979999191,12cyclictest12-21ksoftirqd/008:05:140
2979999191,10cyclictest24832-21sed08:45:170
2979999190,12cyclictest16574-21latency_hist07:30:020
2984099182,10cyclictest0-21swapper/308:50:143
2984099182,10cyclictest0-21swapper/307:45:123
29840991811,5cyclictest321rcuc/310:00:143
29840991810,6cyclictest0-21swapper/312:05:223
29840991810,6cyclictest0-21swapper/310:58:403
29840991810,5cyclictest0-21swapper/310:41:253
29840991810,5cyclictest0-21swapper/310:41:243
2981799187,9cyclictest16221-21cron10:40:011
2981799184,11cyclictest25068-21kthreadcore08:45:171
2981799183,12cyclictest9787-21kthreadcore07:55:211
2981799181,14cyclictest32145-21irqrtprio12:00:191
2981799181,14cyclictest29333-21cut12:15:241
2981799181,13cyclictest14068-21ssh10:00:351
29817991810,6cyclictest12250-21wc07:25:161
2979999188,7cyclictest5983-21kthreadcore12:20:220
2979999181,4cyclictest0-21swapper/011:17:210
29799991811,4cyclictest4285-21acpi11:45:130
2979999181,14cyclictest21050-21sed11:00:200
29799991810,6cyclictest24339-21sshd11:36:260
2984099179,6cyclictest0-21swapper/310:47:003
2984099171,13cyclictest0-21swapper/308:25:173
2984099171,10cyclictest0-21swapper/312:10:243
2981799172,12cyclictest9599-21apt08:30:001
2981799172,10cyclictest0-21swapper/108:50:141
2981799171,14cyclictest18338-21irqcore08:05:181
2981799171,12cyclictest6760-21cut09:00:191
2981799171,12cyclictest11147-21fschecks_count09:05:141
2979999179,5cyclictest13964-21kthreadcore08:00:190
2979999178,6cyclictest25936-21cut09:15:190
2979999173,10cyclictest20453-21cat07:30:250
2979999172,11cyclictest0-21swapper/008:20:130
29799991712,3cyclictest5375-21irqcore08:25:190
2979999171,13cyclictest11801-21munin-run07:25:000
2979999171,10cyclictest24031-21latency_hist08:45:020
2979999170,11cyclictest14436-21latency_hist08:35:010
2984099169,4cyclictest0-21swapper/307:30:253
2984099161,12cyclictest0-21swapper/308:45:143
29840991610,4cyclictest0-21swapper/308:05:293
2981799164,9cyclictest2496-21fschecks_count07:15:151
2981799162,8cyclictest0-21swapper/107:45:121
2981799161,12cyclictest2385-21kthreadcore08:55:231
2981799161,12cyclictest22991-21fschecks_count08:10:161
2981799161,12cyclictest22991-21fschecks_count08:10:151
2979999168,5cyclictest26901-21grep07:40:180
2979999166,7cyclictest29961-21date07:10:020
2979999163,10cyclictest32326-21cut07:45:180
2983299151,11cyclictest29927-21latency_hist07:10:022
2981799151,10cyclictest29845-21latency_hist07:10:011
2984099149,3cyclictest0-21swapper/307:15:173
2984099148,4cyclictest0-21swapper/309:10:013
2984099142,9cyclictest0-21swapper/307:25:183
2984099142,8cyclictest0-21swapper/308:40:143
2984099142,10cyclictest0-21swapper/308:30:163
2984099141,7cyclictest0-21swapper/307:20:293
2984099141,10cyclictest0-21swapper/308:55:223
2984099138,3cyclictest0-21swapper/307:50:293
2984099138,3cyclictest0-21swapper/307:42:163
2984099138,3cyclictest0-21swapper/307:35:273
2984099131,9cyclictest0-21swapper/308:05:023
2984099113,6cyclictest0-21swapper/308:35:163
2984099111,8cyclictest0-21swapper/309:00:133
2984099111,7cyclictest0-21swapper/308:20:163
2984099111,7cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional