You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 06:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot4s.osadl.org (updated Thu Sep 24, 2026 00:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1906199632,7cyclictest0-21swapper/120:40:131
19079995836,14cyclictest35966irq/58-eth020:50:163
1906199560,4cyclictest30491-21ssh22:00:141
1906199502,42cyclictest0-21swapper/119:40:131
1905399502,36cyclictest12311-21ssh21:50:150
1906199493,2cyclictest0-21swapper/122:15:141
1906199471,4cyclictest0-21swapper/119:55:131
1907999464,25cyclictest35966irq/58-eth000:15:123
1906199462,3cyclictest0-21swapper/121:00:111
1906199461,3cyclictest0-21swapper/120:50:141
1906199461,3cyclictest0-21swapper/120:20:141
19053994611,5cyclictest131rcu_preempt21:45:130
1907999456,27cyclictest35966irq/58-eth023:00:143
1906199454,27cyclictest16013-21ssh22:10:171
1906199451,2cyclictest0-21swapper/123:50:151
1905399454,37cyclictest31874-21ssh00:25:120
1907099441,33cyclictest12307-21ssh23:20:122
1906199441,4cyclictest0-21swapper/120:10:121
1906199422,3cyclictest0-21swapper/122:20:121
1906199421,9cyclictest0-21swapper/121:35:141
1906199421,3cyclictest0-21swapper/119:15:141
1905399424,33cyclictest21330-21ssh21:55:120
1905399423,30cyclictest10493-21ssh23:55:120
1907999414,23cyclictest35966irq/58-eth021:30:163
1907099413,20cyclictest30370-21ssh23:30:142
1907099411,35cyclictest31889-21ssh00:25:132
1906199412,2cyclictest0-21swapper/123:00:121
1906199411,3cyclictest0-21swapper/119:45:151
19053994124,8cyclictest12-21ksoftirqd/000:20:130
1907999403,23cyclictest35966irq/58-eth022:45:123
1906199402,2cyclictest1362-21apt-get19:25:121
1906199401,5cyclictest0-21swapper/121:05:141
1906199401,3cyclictest22931-21apt-get00:20:121
1907999394,24cyclictest35966irq/58-eth023:15:113
1907999392,22cyclictest35966irq/58-eth020:55:133
1906199391,4cyclictest17368-21ssh00:35:161
1906199391,3cyclictest0-21swapper/122:40:131
19053993928,9cyclictest0-21swapper/022:05:120
1907999381,34cyclictest0-21swapper/322:10:183
1907999381,34cyclictest0-21swapper/300:00:133
1907999381,32cyclictest0-21swapper/322:40:133
19070993822,3cyclictest0-21swapper/221:25:122
1906199381,4cyclictest17620-21ssh23:05:151
1906199381,3cyclictest0-21swapper/121:15:131
1906199381,3cyclictest0-21swapper/120:55:131
1906199380,5cyclictest28453-21apt-get00:05:151
1907999371,28cyclictest0-21swapper/319:50:133
1907099372,29cyclictest27939-21ssh22:34:432
1907099372,18cyclictest4661-21diskmemload22:19:432
19070993711,21cyclictest27-21ksoftirqd/222:02:442
19070993710,21cyclictest27-21ksoftirqd/223:45:122
1906199372,2cyclictest0-21swapper/121:10:151
1906199372,2cyclictest0-21swapper/121:10:141
1906199371,3cyclictest3250-21apt-get21:45:131
1906199371,3cyclictest0-21swapper/121:50:151
1906199371,3cyclictest0-21swapper/119:50:131
1906199370,5cyclictest31868-21apt-get00:25:131
1907999361,31cyclictest0-21swapper/321:10:153
1907999361,31cyclictest0-21swapper/321:10:143
1907099362,15cyclictest10485-21sh23:55:132
1906199361,3cyclictest0-21swapper/119:10:111
19053993615,12cyclictest630-21Async09:36:310
1907099353,25cyclictest1447-21ssh23:50:142
1907099353,21cyclictest27-21ksoftirqd/221:45:122
19070993524,9cyclictest25810-21ssh00:39:532
1906199351,11cyclictest10455-21memory22:05:231
1907999341,28cyclictest0-21swapper/320:10:113
1907099341,18cyclictest32003-21ssh22:55:102
1906199343,6cyclictest0-21swapper/122:45:131
1906199341,11cyclictest22028-21irqstats21:55:171
1907999334,19cyclictest35966irq/58-eth022:15:153
1907099333,11cyclictest27-21ksoftirqd/220:40:122
1906199336,24cyclictest4661-21diskmemload23:36:091
1906199335,24cyclictest30369-21grep20:25:271
1906199334,25cyclictest10902-21irqcore23:55:171
1906199333,2cyclictest0-21swapper/100:10:101
1906199332,7cyclictest23758-21grep22:30:301
1906199331,9cyclictest25542-21sed23:45:171
1906199331,8cyclictest8852-21sh21:30:191
1906199331,8cyclictest20134-21tr20:15:221
1906199331,7cyclictest30439-21kthreadcore19:20:191
1906199331,6cyclictest22553-21ssh00:20:011
1906199331,5cyclictest32146-21diskstats21:25:161
1907999324,19cyclictest35966irq/58-eth023:10:183
1907999322,23cyclictest0-21swapper/323:05:143
19079993215,11cyclictest0-21swapper/300:39:543
1907999321,26cyclictest35966irq/58-eth023:30:133
1907999321,25cyclictest0-21swapper/321:25:133
1907999321,24cyclictest0-21swapper/323:50:153
1907999321,23cyclictest0-21swapper/321:20:143
1907099323,18cyclictest27346irq/40-dwc2_hso19:45:152
19070993212,15cyclictest27-21ksoftirqd/220:50:142
19070993210,14cyclictest27-21ksoftirqd/220:20:142
1906199327,21cyclictest3159-21latency_hist23:15:011
1906199326,23cyclictest9195-21kthreadcore20:05:251
1906199322,3cyclictest30345-21apt-get23:30:111
1906199321,9cyclictest3442-21df23:15:141
1906199321,8cyclictest9756-21grep19:30:291
1906199321,7cyclictest25841-21kthreadcore21:20:231
1906199321,7cyclictest13805-21irqrtprio20:45:161
1906199321,7cyclictest12535-21sed00:30:291
1906199321,5cyclictest0-21swapper/122:55:111
1906199321,4cyclictest10953-21apt-get19:35:131
1906199321,2cyclictest0-21swapper/123:25:121
1906199321,10cyclictest23620-21sed22:50:211
1906199321,10cyclictest17196-21tr23:40:231
1906199321,10cyclictest17196-21tr23:40:221
1906199320,7cyclictest11895-21cut22:25:191
1906199320,6cyclictest3910-21fw_packets20:35:131
1906199320,4cyclictest2542-21apt-get20:00:131
1905399322,24cyclictest4931-21ssh00:10:100
1907999312,22cyclictest0-21swapper/321:05:133
1907999311,26cyclictest0-21swapper/323:45:103
1907099314,15cyclictest27346irq/40-dwc2_hso19:10:132
1907099314,14cyclictest27346irq/40-dwc2_hso19:35:122
1907099310,23cyclictest10578-21ssh22:25:132
1906199311,7cyclictest29110-21tr21:40:201
1906199311,6cyclictest21883-21kthreadcore00:00:211
1905399314,4cyclictest131rcu_preempt22:20:110
1907999305,19cyclictest0-21swapper/300:13:253
1907999302,22cyclictest0-21swapper/321:35:143
1907999302,21cyclictest0-21swapper/319:40:133
1907999302,17cyclictest35966irq/58-eth000:05:143
1907999301,23cyclictest0-21swapper/320:05:163
1907999301,22cyclictest0-21swapper/322:50:163
1907999301,19cyclictest35966irq/58-eth023:20:113
1907999300,27cyclictest0-21swapper/322:05:123
1907999300,23cyclictest0-21swapper/300:20:123
1907099301,13cyclictest1814366ssh23:40:242
1907099301,13cyclictest1814366ssh23:40:232
1906199301,6cyclictest322-21tr20:30:221
1906199301,5cyclictest31504-21cut22:35:221
1906199301,5cyclictest31504-21cut22:35:211
1906199301,2cyclictest0-21swapper/123:20:121
1905399304,14cyclictest6903-21ssh23:35:130
1905399302,23cyclictest13970-21ssh00:15:130
1905399302,22cyclictest19549-21ssh22:30:120
1905399302,19cyclictest23051-21ssh21:20:150
1905399301,23cyclictest8405-21ssh00:30:130
1907999291,24cyclictest0-21swapper/319:45:153
1907999291,24cyclictest0-21swapper/319:15:133
1907099293,8cyclictest28627-21kworker/2:019:20:122
1907099292,21cyclictest12236-21ssh00:13:252
1907099292,20cyclictest0-21swapper/219:25:132
1907099291,9cyclictest6305-21cut19:30:192
1907099291,17cyclictest27346irq/40-dwc2_hso00:00:112
1907999281,23cyclictest0-21swapper/319:10:123
1907099283,20cyclictest0-21swapper/222:47:422
1907099283,20cyclictest0-21swapper/200:20:132
1907099283,10cyclictest0-21swapper/200:34:552
1907099282,20cyclictest0-21swapper/220:30:152
1907099282,19cyclictest0-21swapper/219:15:152
1907099281,9cyclictest21324-21ssh21:55:112
19053992810,14cyclictest12-21ksoftirqd/000:00:130
1907999271,24cyclictest0-21swapper/322:25:123
1907999271,23cyclictest0-21swapper/322:55:113
1907999271,22cyclictest0-21swapper/322:20:123
1907999271,22cyclictest0-21swapper/321:40:113
1907999271,21cyclictest0-21swapper/321:15:143
1907999271,20cyclictest0-21swapper/300:30:123
1907099276,14cyclictest0-21swapper/222:05:122
1907099273,9cyclictest0-21swapper/222:24:432
1907099271,16cyclictest27346irq/40-dwc2_hso20:00:142
19053992716,6cyclictest11273-21sh22:25:190
1907999261,22cyclictest0-21swapper/323:40:313
1907999261,22cyclictest0-21swapper/323:40:313
1907999261,22cyclictest0-21swapper/300:25:133
1907999261,21cyclictest0-21swapper/323:40:013
1907999261,19cyclictest0-21swapper/319:55:133
1907099263,18cyclictest19052-21cyclictest19:40:142
1907099262,9cyclictest4460-21ssh22:39:442
1907099262,9cyclictest4460-21ssh22:39:432
1907099261,18cyclictest930-21snmpd23:25:122
1907099261,17cyclictest27346irq/40-dwc2_hso20:45:112
1905399262,18cyclictest899-21sh22:19:440
1907999251,21cyclictest0-21swapper/320:40:123
1907999251,21cyclictest0-21swapper/320:25:133
1907999251,20cyclictest0-21swapper/323:25:103
1907999251,20cyclictest0-21swapper/321:45:133
1907999251,20cyclictest0-21swapper/321:00:113
1907999251,20cyclictest0-21swapper/320:35:093
1907999251,20cyclictest0-21swapper/319:30:153
1907099253,15cyclictest27346irq/40-dwc2_hso20:15:132
1907099251,19cyclictest30543-21ssh21:23:442
1907099251,15cyclictest4661-21diskmemload00:05:152
1907099251,14cyclictest13969-21ssh00:15:132
1907099251,12cyclictest13644-21ls21:15:012
1907099251,12cyclictest13644-21ls21:15:002
1906199250,7cyclictest19123-21sed19:10:021
1905399251,18cyclictest26726-21sh23:10:180
1905399251,18cyclictest24890-21ssh23:45:130
1907999242,19cyclictest0-21swapper/322:30:143
1907999241,20cyclictest0-21swapper/323:55:133
1907999241,20cyclictest0-21swapper/322:00:143
1907999241,19cyclictest0-21swapper/319:25:113
1907999241,19cyclictest0-21swapper/319:20:133
1907999241,16cyclictest0-21swapper/320:20:113
1907099244,16cyclictest27346irq/40-dwc2_hso20:05:152
1907099243,15cyclictest27346irq/40-dwc2_hso22:50:172
1907099242,11cyclictest7839-21usage_EthcTask23:15:312
1907099241,14cyclictest1484666ssh21:50:262
1905399244,13cyclictest12-21ksoftirqd/022:50:180
1905399242,17cyclictest5149-21ssh22:40:140
1905399241,15cyclictest1089-1kworker/0:2H19:20:140
1907999231,19cyclictest0-21swapper/321:50:253
1907999231,19cyclictest0-21swapper/320:15:163
1907099237,13cyclictest5884-21grep22:40:202
1907099234,15cyclictest27346irq/40-dwc2_hso20:55:152
1907099233,15cyclictest0-21swapper/223:08:432
1907099233,14cyclictest27346irq/40-dwc2_hso20:10:132
1907099232,16cyclictest0-21swapper/222:14:442
1907099231,17cyclictest15761-21kthreadcore21:15:232
1907099231,13cyclictest9423-21tr23:00:202
1905399230,5cyclictest131rcu_preempt23:30:120
1907999221,18cyclictest0-21swapper/322:35:143
1907999221,18cyclictest0-21swapper/322:35:133
1907999221,18cyclictest0-21swapper/321:55:143
1907999221,18cyclictest0-21swapper/320:30:153
1907999221,18cyclictest0-21swapper/320:00:293
1907099222,16cyclictest0-21swapper/223:14:432
1907099221,16cyclictest12453-21ssh21:30:312
1905399223,11cyclictest0-21swapper/020:00:130
19053992211,7cyclictest0-21swapper/023:40:160
19053992211,7cyclictest0-21swapper/023:40:150
19053992210,3cyclictest131rcu_preempt21:10:010
1907999211,17cyclictest0-21swapper/320:45:143
1907099218,10cyclictest1567-21unixbench_multi19:55:282
1907099212,10cyclictest30412-21ssh21:40:262
1907099211,11cyclictest28314-21kthreadcore19:50:222
1907099211,10cyclictest8294-21kthreadcore23:35:212
1905399212,14cyclictest0-21swapper/022:03:430
1905399212,11cyclictest17594-21diskmemload23:05:120
1905399211,15cyclictest24077-21apt-get19:15:120
1905399211,15cyclictest20264-21missed_timers20:15:240
19053992110,8cyclictest8198-21basename21:30:010
19053992110,7cyclictest21407-21ntpq21:35:260
1905399210,17cyclictest8628-21rm23:00:130
1907999201,17cyclictest0-21swapper/319:35:133
1907099204,13cyclictest27206-21tail20:25:192
1907099202,15cyclictest30799-21kthreadcore21:00:202
1907099202,15cyclictest18382-21sed21:35:182
1907099202,14cyclictest27346irq/40-dwc2_hso20:35:122
1907099201,9cyclictest930-21snmpd21:05:202
1905399203,11cyclictest0-21swapper/019:50:120
1905399203,10cyclictest0-21swapper/020:25:130
1905399202,15cyclictest11108-21cut19:35:160
19053992013,5cyclictest0-21swapper/021:30:340
1905399201,15cyclictest26699-21apt-get21:40:120
1905399201,14cyclictest28593-21ssh22:35:140
1905399201,14cyclictest28593-21ssh22:35:130
1905399201,10cyclictest20879-21users22:10:360
19053992010,7cyclictest25956-21cat23:25:270
1905399200,16cyclictest7276-21ls23:15:270
1905399199,7cyclictest18571-21cut00:35:220
1905399199,7cyclictest15227-21cut23:20:210
1905399194,12cyclictest8611-21grep21:10:260
1905399194,12cyclictest8611-21grep21:10:250
1905399192,8cyclictest17883-21cron20:50:010
1905399192,12cyclictest19811-21kworker/u8:200:05:140
19053991911,6cyclictest6326-21sshd22:57:430
19053991911,6cyclictest13075-21cron20:45:000
1905399191,14cyclictest20576-21apt-get19:45:150
1905399191,13cyclictest27737-21apt-get21:00:110
1905399189,7cyclictest1425-21apt-get23:50:140
1905399184,8cyclictest0-21swapper/019:25:120
1905399181,11cyclictest10578-21latency20:05:260
1907999171,13cyclictest0-21swapper/319:10:023
1905399175,9cyclictest4074-21irqcore20:35:160
1905399172,12cyclictest19442-21tune2fs19:10:160
1905399172,10cyclictest0-21swapper/019:30:160
19053991711,4cyclictest0-21swapper/019:40:280
1905399171,12cyclictest14019-21sh21:15:130
1905399171,11cyclictest1034-21missed_timers19:55:230
19053991710,5cyclictest0-21swapper/020:25:000
1905399161,10cyclictest24777-21kthreadcore20:55:210
1905399161,10cyclictest19981-21kthreadcore20:50:220
1905399160,8cyclictest2328-21ntpq20:30:260
1905399159,4cyclictest1089-1kworker/0:2H20:10:140
1905399151,10cyclictest19141-21latency_hist19:10:010
1907099121,9cyclictest19008-21latency_hist19:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional