You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 11:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Tue Aug 18, 2026 00:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1047899644,31cyclictest23311-21ssh23:30:142
1047899542,38cyclictest15722-21ssh22:50:152
1047899522,31cyclictest32332-21ssh23:35:122
10487995123,23cyclictest35966irq/58-eth021:45:133
1047899513,29cyclictest0-21swapper/219:15:122
1047899505,31cyclictest6644-21ssh22:45:122
1047899505,31cyclictest6644-21ssh22:45:122
1047899481,34cyclictest930-21snmpd21:30:112
10478994718,22cyclictest7951-1kworker/u9:222:35:142
10487994525,8cyclictest35966irq/58-eth022:30:143
1045599452,35cyclictest32348-21ssh23:35:140
10478993819,7cyclictest0-21swapper/221:25:142
1047899372,18cyclictest29998-21ssh22:40:092
1045599371,29cyclictest27517-21ssh21:45:150
1047899361,29cyclictest9043-21ssh23:40:122
1047899356,17cyclictest27346irq/40-dwc2_hso20:35:132
10470993520,9cyclictest10454-21cyclictest19:50:101
1047899344,20cyclictest630-21Async09:36:312
1047899341,13cyclictest27-21ksoftirqd/219:10:132
1047099334,18cyclictest21-21ksoftirqd/123:55:151
1047099332,21cyclictest13249-21ssh21:55:151
1047099332,21cyclictest13249-21ssh21:55:151
1045599331,24cyclictest18473-21ssh21:40:150
1047899324,17cyclictest27346irq/40-dwc2_hso21:10:102
1045599324,20cyclictest10813-21ssh00:35:130
1045599323,24cyclictest21676-21ssh00:05:160
1047899315,16cyclictest27346irq/40-dwc2_hso00:00:122
1045599318,17cyclictest8459-21diskmemload00:32:410
1045599318,17cyclictest8459-21diskmemload00:32:410
1047899305,10cyclictest0-21swapper/221:15:142
1047899302,22cyclictest11999-21ssh22:30:152
1047099303,21cyclictest21656-21ssh00:05:151
1047899293,21cyclictest0-21swapper/222:08:092
1047899292,21cyclictest1355-21ssh23:00:142
1045599292,19cyclictest17036-21ssh22:15:100
1047899283,10cyclictest0-21swapper/200:22:402
1047099282,20cyclictest31181-21ssh22:57:291
10455992818,3cyclictest28632-21diskmemload22:50:010
10455992818,3cyclictest28632-21diskmemload22:50:000
1048799273,17cyclictest0-21swapper/322:57:283
10487992719,4cyclictest35966irq/58-eth022:25:153
10487992715,6cyclictest0-21swapper/323:15:113
1047899275,13cyclictest27346irq/40-dwc2_hso20:45:132
1047899274,16cyclictest27346irq/40-dwc2_hso19:40:142
1047899274,16cyclictest27346irq/40-dwc2_hso19:40:142
1047899272,19cyclictest0-21swapper/219:45:132
10470992716,7cyclictest21-21ksoftirqd/120:10:161
1047899264,17cyclictest27346irq/40-dwc2_hso21:20:142
1047899261,9cyclictest25107-21ssh23:48:082
1047899261,9cyclictest17078-21ssh22:15:122
1047099261,18cyclictest19449-21ssh23:10:131
1045599266,2cyclictest131rcu_preempt23:25:130
1045599261,18cyclictest14800-21ssh21:20:140
1048799253,14cyclictest0-21swapper/322:15:103
1047899252,17cyclictest536-21usb-storage21:00:042
1047899252,15cyclictest27346irq/40-dwc2_hso00:15:132
1047899252,13cyclictest30576-21ssh00:10:112
10478992513,3cyclictest9376-21apt-get21:35:132
1047899251,13cyclictest21911-21ssh22:00:012
1047899251,13cyclictest21911-21ssh22:00:012
1045599251,4cyclictest0-21swapper/019:10:140
1047899243,16cyclictest0-21swapper/223:08:092
1047899242,17cyclictest2330-21cut00:30:182
1047899242,17cyclictest2330-21cut00:30:182
1047899242,16cyclictest27346irq/40-dwc2_hso20:40:142
1047899242,13cyclictest27346irq/40-dwc2_hso20:20:152
1047899242,12cyclictest930-21snmpd22:25:152
10478992414,8cyclictest0-21swapper/223:10:162
10478992414,8cyclictest0-21swapper/222:20:142
10478992412,10cyclictest0-21swapper/219:25:192
1047899241,14cyclictest27527-21ssh21:45:152
1047099241,19cyclictest7146-21ssh00:15:121
1045599243,15cyclictest28632-21diskmemload23:55:140
1045599241,19cyclictest26239-21ssh22:20:150
1045599241,16cyclictest27060-21ssh23:50:130
10455992411,10cyclictest0-21swapper/023:15:100
1048799236,8cyclictest35966irq/58-eth023:05:123
1048799233,13cyclictest0-21swapper/323:35:143
10487992311,8cyclictest0-21swapper/321:30:233
1047899238,12cyclictest0-21swapper/223:55:292
1047899238,11cyclictest18955-21basename21:00:012
1047899235,5cyclictest27-21ksoftirqd/223:20:142
1047899232,6cyclictest0-21swapper/200:25:172
1047899232,4cyclictest131rcu_preempt21:05:152
10478992313,4cyclictest0-21swapper/222:00:332
1047899231,19cyclictest21697-21df19:55:152
1047899231,18cyclictest29994-21kthreadcore23:50:232
1047899231,12cyclictest28780-21grep22:55:292
1047899231,12cyclictest22457-21cut00:05:222
1047099235,7cyclictest3611-21ntp_kernel_pll_23:35:261
1047099232,16cyclictest28470-21ssh23:15:121
1045599233,9cyclictest12-21ksoftirqd/020:15:120
1045599231,18cyclictest4252-21grep21:50:140
1045599231,18cyclictest30795-21cut00:10:160
10487992210,9cyclictest0-21swapper/323:11:223
1047899229,5cyclictest30863-21sh23:15:202
1047899222,6cyclictest0-21swapper/222:10:092
1047899222,15cyclictest0-21swapper/223:29:082
1047899222,15cyclictest0-21swapper/221:40:092
1047899221,17cyclictest897-21kthreadcore20:05:202
1047899221,17cyclictest897-21kthreadcore20:05:192
1047099222,17cyclictest28632-21diskmemload00:32:411
1047099222,17cyclictest28632-21diskmemload00:32:401
10470992214,6cyclictest0-21swapper/121:20:231
10470992213,6cyclictest6593-21sshd21:32:081
1047099221,14cyclictest19326-21ssh22:50:261
1045599222,3cyclictest12-21ksoftirqd/021:00:150
1048799219,9cyclictest0-21swapper/323:42:373
1048799213,12cyclictest0-21swapper/300:32:413
1048799213,12cyclictest0-21swapper/300:32:413
10487992110,9cyclictest0-21swapper/321:15:083
1047899213,4cyclictest0-21swapper/220:50:152
1047899213,10cyclictest5340-21kthreadcore19:35:222
1047899212,14cyclictest27346irq/40-dwc2_hso20:15:132
1047899212,11cyclictest7483-21head20:10:312
10478992112,7cyclictest27-21ksoftirqd/219:20:152
1047899211,10cyclictest1-21systemd21:50:282
1047899211,10cyclictest10778-21/usr/sbin/munin00:35:252
1047099212,14cyclictest17035-21sh22:15:101
10470992112,6cyclictest0-21swapper/120:50:281
1045599215,3cyclictest131rcu_preempt19:25:010
1045599212,2cyclictest91-21pr/ttyS020:55:010
1045599211,15cyclictest25396-21uniq00:25:170
1045599211,15cyclictest23280-21find23:30:120
1045599211,15cyclictest10661-21ls23:05:150
1048799202,12cyclictest0-21swapper/300:24:093
10487992011,5cyclictest35966irq/58-eth022:50:153
1048799201,11cyclictest0-21swapper/300:35:133
10487992010,7cyclictest0-21swapper/323:33:443
1047899206,6cyclictest20606-21kthreadcore20:25:232
1047899206,11cyclictest23998-21kthreadcore20:30:202
1047899201,16cyclictest17160-21grep19:50:172
1047899201,11cyclictest1124-21grep19:30:272
1047099209,8cyclictest16689-21cron22:15:011
1047099202,14cyclictest18025-21ssh23:45:121
10470992014,4cyclictest10454-21cyclictest23:00:131
1045599209,8cyclictest24141-21df_inode21:05:160
1045599201,6cyclictest28632-21diskmemload22:50:320
1045599201,5cyclictest0-21swapper/022:40:020
10455992013,5cyclictest0-21swapper/023:20:130
1048799198,9cyclictest0-21swapper/323:57:113
1048799193,11cyclictest0-21swapper/322:41:093
1048799193,11cyclictest0-21swapper/322:14:093
1048799193,10cyclictest0-21swapper/322:35:093
1048799192,10cyclictest0-21swapper/319:50:133
10487991911,5cyclictest0-21swapper/322:45:313
10487991911,5cyclictest0-21swapper/322:45:313
1048799191,12cyclictest0-21swapper/320:30:023
10487991910,6cyclictest0-21swapper/323:22:503
10487991910,6cyclictest0-21swapper/322:23:343
1047099199,7cyclictest2227-21cat22:40:311
1047099196,9cyclictest0-21swapper/100:35:131
1047099193,14cyclictest23301-21ssh23:30:131
1047099193,14cyclictest15077-21usage_EthcTask19:10:311
1047099193,13cyclictest740-21usage_Anybus21:10:271
1047099193,13cyclictest6672-21ssh22:45:141
1047099193,13cyclictest6672-21ssh22:45:141
1047099193,13cyclictest2982-21ssh22:25:151
1047099193,13cyclictest17790-21munin-plugin-st20:25:011
1047099192,14cyclictest9403-21ssh21:35:151
1047099192,14cyclictest26231-21rm22:20:151
10470991912,4cyclictest31522-21fschecks_count22:05:161
10470991912,4cyclictest28632-21diskmemload22:00:191
10470991912,4cyclictest0-21swapper/121:00:291
1047099191,15cyclictest18511-21cpu21:40:151
10470991910,6cyclictest6161-21kthreadcore21:50:201
1045599197,9cyclictest10407-21cat21:15:330
1045599197,5cyclictest16765-21ps00:20:200
1045599192,14cyclictest18695-21kthreadcore19:50:200
1045599192,11cyclictest30899-21ssh22:57:090
1045599191,6cyclictest28632-21diskmemload22:05:260
1045599191,5cyclictest22746-21ps22:00:180
1045599191,3cyclictest0-21swapper/023:40:300
10455991912,5cyclictest13362-21irqstats00:00:180
1045599191,15cyclictest29018-21ssh21:10:110
1045599191,10cyclictest13637-21irqcore20:20:190
1045599190,4cyclictest91-21pr/ttyS020:45:020
1048799189,6cyclictest0-21swapper/321:50:133
1048799188,8cyclictest0-21swapper/322:06:503
1048799187,8cyclictest0-21swapper/321:14:133
1048799183,9cyclictest0-21swapper/300:05:163
1048799181,13cyclictest0-21swapper/320:45:293
1048799181,12cyclictest0-21swapper/321:45:013
10487991810,5cyclictest35966irq/58-eth023:25:153
1047899181,13cyclictest10564-21latency_hist19:10:022
1047099188,7cyclictest21800-21fschecks_time19:55:171
1047099184,11cyclictest17877-21netstat23:25:251
1047099183,12cyclictest30047-21kthreadcore20:35:211
1047099183,11cyclictest5741-21ssh21:15:151
1047099182,9cyclictest0-21swapper/121:45:141
1047099182,14cyclictest10371-21ssh23:05:121
1047099182,13cyclictest3356-21cron20:10:011
1047099182,13cyclictest3356-21cron20:10:011
1047099182,13cyclictest20979-21ssh22:35:141
1047099182,13cyclictest16843-21grep00:00:331
1047099182,12cyclictest11988-21ssh22:30:141
1047099181,7cyclictest616-21systemd-logind19:46:571
10470991811,5cyclictest27260-21kthreadcore00:25:261
1047099181,14cyclictest22924-21fschecks_count20:30:171
10470991811,4cyclictest0-21swapper/121:05:291
10470991810,6cyclictest26396-21tr21:25:241
1045599189,7cyclictest6596-21sshd21:32:090
1045599189,7cyclictest29734-21memory20:00:240
1045599189,7cyclictest17763-21ntp_192.168.11420:55:250
1045599181,13cyclictest21616-21apt-get19:55:130
1045599181,11cyclictest7398-21cut19:40:160
1045599181,11cyclictest7398-21cut19:40:150
1045599181,11cyclictest0-21swapper/019:30:110
10455991810,6cyclictest23822-21apt-get21:25:150
10455991810,5cyclictest8243-21wc22:10:150
1045599180,12cyclictest30876-21ls20:35:210
1048799179,6cyclictest0-21swapper/322:00:513
1048799179,6cyclictest0-21swapper/321:26:463
1048799179,6cyclictest0-21swapper/300:14:063
1048799179,6cyclictest0-21swapper/300:01:353
1048799179,5cyclictest35966irq/58-eth000:25:153
1048799178,4cyclictest0-21swapper/321:21:453
1048799172,11cyclictest0-21swapper/321:55:063
1048799172,11cyclictest0-21swapper/321:55:053
10487991711,4cyclictest0-21swapper/323:50:363
10487991710,4cyclictest35966irq/58-eth000:15:133
10487991710,4cyclictest0-21swapper/321:35:353
1047099179,6cyclictest9029-21apt23:40:121
1047099179,6cyclictest11728-21cat19:40:311
1047099179,6cyclictest11728-21cat19:40:301
1047099178,7cyclictest8494-21diskstats20:15:161
1047099178,6cyclictest30092-21df19:30:151
1047099178,6cyclictest17324-21kthreadcore20:55:231
1047099177,7cyclictest1-21systemd20:42:061
1047099172,12cyclictest27451-21irqcore23:50:191
10470991711,4cyclictest16503-21if_err_eth000:20:191
1047099171,13cyclictest26199-21kthreadcore19:25:201
1047099171,13cyclictest21731-21kthreadcore19:20:191
1047099171,12cyclictest5392-21fschecks_time23:20:161
1047099171,12cyclictest30573-21apt-get00:10:131
1045599179,6cyclictest24552-21cut20:30:210
1045599177,7cyclictest15586-21df19:15:140
1045599176,9cyclictest1-21systemd22:42:250
1045599173,11cyclictest9909-21irqcore21:35:210
1045599172,3cyclictest131rcu_preempt19:40:010
1045599171,3cyclictest131rcu_preempt23:50:020
1045599171,3cyclictest131rcu_preempt22:35:000
1045599171,13cyclictest25187-21apt-get19:25:140
1045599171,13cyclictest10751-21ntp_192.168.11400:15:240
1045599171,12cyclictest17003-21ssh21:55:300
1045599171,12cyclictest17003-21ssh21:55:300
1045599171,11cyclictest0-21swapper/019:45:120
1045599170,13cyclictest28159-21ls23:15:020
1048799168,3cyclictest0-21swapper/323:00:243
1048799161,12cyclictest0-21swapper/319:40:293
1048799161,12cyclictest0-21swapper/319:40:293
10487991610,4cyclictest0-21swapper/323:45:223
1047099169,5cyclictest5115-21irqcore20:45:181
1047099169,4cyclictest18338-21ps20:25:191
1047099161,12cyclictest28684-21kthreadcore20:00:211
10470991610,4cyclictest2477-21sh19:35:151
10470991610,4cyclictest0-21swapper/119:15:141
1045599162,11cyclictest18021-21apt-get20:25:140
1045599162,10cyclictest0-21swapper/020:10:160
1045599161,3cyclictest0-21swapper/023:02:400
1045599161,11cyclictest2464-21apt-get22:25:020
1048799159,3cyclictest0-21swapper/320:50:093
1048799153,7cyclictest35966irq/58-eth019:20:133
1047099151,11cyclictest10620-21latency_hist19:10:021
1045599151,11cyclictest6167-21tr20:45:210
1045599151,11cyclictest31322-21diskstats20:05:150
1045599151,11cyclictest31322-21diskstats20:05:150
1048799149,3cyclictest0-21swapper/320:23:113
1048799149,3cyclictest0-21swapper/319:55:163
1048799142,9cyclictest0-21swapper/320:10:013
1048799142,9cyclictest0-21swapper/320:10:003
1045599141,10cyclictest10454-21cyclictest19:10:020
1048799138,3cyclictest0-21swapper/320:41:493
1048799138,3cyclictest0-21swapper/320:10:133
1048799132,8cyclictest0-21swapper/320:17:033
1048799131,4cyclictest0-21swapper/319:35:213
1048799131,10cyclictest0-21swapper/320:55:213
1048799131,10cyclictest0-21swapper/319:45:223
1048799127,3cyclictest0-21swapper/319:28:093
1048799127,3cyclictest0-21swapper/319:10:313
1048799121,8cyclictest0-21swapper/321:05:293
1048799121,8cyclictest0-21swapper/320:00:173
1048799121,7cyclictest0-21swapper/320:30:293
1048799121,7cyclictest0-21swapper/319:15:203
1048799121,3cyclictest0-21swapper/319:30:193
1048799111,7cyclictest0-21swapper/321:00:183
1048799111,7cyclictest0-21swapper/320:35:173
1048799111,7cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional