You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-02 - 05:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Sat May 02, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2293022910,2sleep122907-21munin-run04:30:521
2770521280,4sleep027707-21rt-features08:16:190
27842880,5sleep02315099cyclictest05:01:180
52482850,2sleep10-21swapper/105:10:531
285252760,4sleep128521-21ssh09:36:081
173992750,5sleep12315199cyclictest05:41:201
23150997227,7cyclictest0-21swapper/009:36:050
23150997223,26cyclictest14947-21sh08:40:530
23262710,2sleep10-21swapper/109:42:571
2315199714,15cyclictest7750irq/56-dwc_otg04:51:021
23150997158,6cyclictest0-21swapper/008:54:220
2315099713,13cyclictest9450irq/48-DMA09:12:250
23151997051,4cyclictest21-21rcuc/106:36:031
23151997012,12cyclictest0-21swapper/107:46:031
2315099707,39cyclictest0-21swapper/006:36:030
61992690,2sleep30-21swapper/307:13:213
47962690,2sleep30-21swapper/306:33:593
2315099691,43cyclictest0-21swapper/009:41:050
77032670,7sleep1221ktimersoftd/107:52:571
2315199673,6cyclictest7850irq/56-dwc_otg_06:31:061
23151996520,5cyclictest7704-21sh07:15:531
222102640,2sleep30-21swapper/309:27:533
2315099634,21cyclictest4718-21ls07:11:180
23150996315,7cyclictest0-21swapper/008:46:050
205202630,2sleep00-21swapper/005:51:130
2315099621,38cyclictest10991-21unixbench_singl07:56:200
2315099614,23cyclictest15130-21ls08:01:190
23150996126,10cyclictest101ktimersoftd/005:15:520
173192610,1sleep00-21swapper/008:42:400
2315199601,10cyclictest6992-21ssh08:31:031
2315099602,37cyclictest4256-21ssh09:46:030
23150995929,15cyclictest7750irq/56-dwc_otg04:40:520
2315199587,23cyclictest0-21swapper/106:01:051
23150995835,5cyclictest10629-21aten_rbpower_vo06:41:050
2315099582,38cyclictest0-21swapper/006:15:520
2315099581,29cyclictest28055-21grep04:41:160
23150995740,6cyclictest101ktimersoftd/009:56:020
23150995720,18cyclictest12897-21fschecks_time05:31:080
2315399568,13cyclictest0-21swapper/304:40:583
2315199562,7cyclictest7850irq/56-dwc_otg_07:31:041
23150995628,5cyclictest7750irq/56-dwc_otg07:35:590
23150995610,30cyclictest12374-21idleruntime-cro05:30:520
2315199557,29cyclictest0-21swapper/105:46:051
23150995536,5cyclictest7850irq/56-dwc_otg_07:41:060
23150995536,5cyclictest7850irq/56-dwc_otg_07:41:060
2315099553,23cyclictest0-21swapper/007:06:190
23150995531,11cyclictest101ktimersoftd/004:51:090
23150995530,8cyclictest7321-21apt09:10:520
23150995529,10cyclictest1584-21cron06:30:520
2315099551,34cyclictest1484-21kworker/0:208:28:280
2315099551,27cyclictest26422-21grep06:06:200
2315299543,11cyclictest0-21swapper/209:51:032
23150995448,4cyclictest101ktimersoftd/008:31:190
23150995432,14cyclictest101ktimersoftd/007:29:370
23150995424,8cyclictest20242-21aten_rbpower_vo09:26:120
2315199537,17cyclictest0-21swapper/105:56:041
2315199537,17cyclictest0-21swapper/105:56:041
23151995312,26cyclictest31822-21ssh07:06:051
2315099539,29cyclictest15078-21fschecks_count06:46:090
23150995331,6cyclictest7750irq/56-dwc_otg07:51:160
2315099531,35cyclictest8531-21tr09:51:060
2315399523,25cyclictest0-21swapper/305:01:033
23150995238,5cyclictest101ktimersoftd/004:56:170
2315099523,36cyclictest13-21rcuc/008:56:170
23150995223,14cyclictest7850irq/56-dwc_otg_08:21:110
166192520,2sleep30-21swapper/305:41:103
23150995124,12cyclictest10263-21ssh09:13:420
23150995118,19cyclictest101ktimersoftd/007:21:200
23150995116,24cyclictest0-21swapper/005:10:310
2315099511,47cyclictest101ktimersoftd/007:46:090
2315099511,27cyclictest25577-21systemd-journal07:20:520
23150995036,4cyclictest22508-21sh08:11:030
23150995029,9cyclictest101ktimersoftd/006:56:080
2315099501,28cyclictest29830-21sed04:46:190
2315099501,28cyclictest12958-21ssh09:16:200
2315099494,41cyclictest13-21rcuc/007:01:160
2315099494,41cyclictest13-21rcuc/007:01:160
23150994923,6cyclictest16877-21smartpower09:21:200
23150994923,3cyclictest0-21swapper/006:51:110
2315099492,27cyclictest0-21swapper/006:31:150
228222493,14sleep00-21swapper/004:30:070
2315199487,25cyclictest0-21swapper/105:51:051
2315099483,26cyclictest7850irq/56-dwc_otg_06:00:520
2315099483,26cyclictest7850irq/56-dwc_otg_06:00:520
23150994824,10cyclictest17777-21cron05:45:520
23150994822,13cyclictest101ktimersoftd/008:06:040
23150994821,4cyclictest0-21swapper/005:21:040
2315099481,26cyclictest0-21swapper/006:01:190
2315399472,8cyclictest0-21swapper/307:16:033
23153994717,6cyclictest61-21kswapd009:01:033
2315199477,28cyclictest0-21swapper/105:15:591
23150994730,9cyclictest0-21swapper/005:46:190
2315099471,32cyclictest0-21swapper/009:31:140
2315399467,25cyclictest0-21swapper/306:26:053
2315399462,9cyclictest27686-21ssh08:56:033
23152994622,4cyclictest15615-21fschecks_time08:41:102
23150994618,6cyclictest7850irq/56-dwc_otg_05:40:520
2315399456,22cyclictest32495-21ssh09:40:573
23153994512,9cyclictest7950irq/56-dwc_otg_07:46:043
2315299456,25cyclictest0-21swapper/209:06:062
2315199451,7cyclictest0-21swapper/106:06:051
23151994510,21cyclictest0-21swapper/108:16:051
23150994535,4cyclictest0-21swapper/009:05:110
23150994514,20cyclictest825-21dhclient04:33:420
2315399446,24cyclictest0-21swapper/306:21:063
23153994417,5cyclictest7850irq/56-dwc_otg_07:21:043
2315299447,25cyclictest0-21swapper/206:21:062
2315299447,25cyclictest0-21swapper/204:40:592
2315199448,18cyclictest917-21snmpd08:11:031
2315199444,20cyclictest0-21swapper/109:46:031
2315199442,5cyclictest0-21swapper/109:01:031
23150994417,9cyclictest0-21swapper/005:15:540
153342440,2sleep20-21swapper/208:01:232
2315399437,4cyclictest0-21swapper/304:36:033
2315399437,12cyclictest7950irq/56-dwc_otg_05:15:573
23152994314,5cyclictest10586-21latency_hist05:25:522
23151994319,5cyclictest5435-21ssh09:07:261
23151994318,4cyclictest7750irq/56-dwc_otg07:01:041
23151994318,4cyclictest7750irq/56-dwc_otg07:01:041
2315399422,10cyclictest7850irq/56-dwc_otg_08:41:043
2315299421,28cyclictest7850irq/56-dwc_otg_07:56:202
23151994226,10cyclictest97192sleep107:56:041
23151994222,4cyclictest1491850wget06:46:061
23151994217,4cyclictest0-21swapper/109:21:051
23150994220,12cyclictest0-21swapper/006:16:140
2315399417,5cyclictest7850irq/56-dwc_otg_07:10:533
2315399411,14cyclictest39-21ksoftirqd/309:33:433
2315299416,23cyclictest31837-21ssh09:01:052
2315299415,19cyclictest0-21swapper/206:11:052
23152994113,17cyclictest4386-21wget09:46:062
2315399408,4cyclictest24305-21/usr/sbin/munin08:51:143
2315399407,23cyclictest0-21swapper/307:51:053
2315399407,21cyclictest0-21swapper/306:41:043
23153994018,8cyclictest7750irq/56-dwc_otg05:46:143
23152994016,11cyclictest7850irq/56-dwc_otg_08:21:062
2315199409,13cyclictest28056-21grep04:41:161
23151994024,9cyclictest26562-21latency_hist04:40:531
2315399392,29cyclictest7950irq/56-dwc_otg_09:16:053
23153993917,6cyclictest7750irq/56-dwc_otg09:11:123
23153993912,9cyclictest7850irq/56-dwc_otg_09:36:123
23152993915,13cyclictest8235-21sh07:16:072
23151993913,10cyclictest5205-1kworker/u9:007:16:031
2315099396,23cyclictest0-21swapper/006:21:060
2315399389,13cyclictest0-21swapper/306:47:433
23153993827,6cyclictest7750irq/56-dwc_otg06:36:103
23153993814,8cyclictest2823-21apt-get08:26:033
2315299386,23cyclictest0-21swapper/207:51:052
2315299385,15cyclictest29372-21sh07:41:032
2315299385,15cyclictest29372-21sh07:41:032
23152993811,5cyclictest11957-21sh06:41:332
2315299381,13cyclictest0-21swapper/207:06:032
2315199385,21cyclictest11148-21ssh08:36:061
23151993813,14cyclictest0-21swapper/106:41:041
2315399377,27cyclictest0-21swapper/305:11:063
2315399377,24cyclictest0-21swapper/307:26:053
2315399374,17cyclictest10128-21ssh08:34:403
2315399374,16cyclictest10141-21ssh09:52:073
23153993717,4cyclictest7750irq/56-dwc_otg08:23:203
23153993715,4cyclictest7950irq/56-dwc_otg_04:51:143
23153993715,10cyclictest7950irq/56-dwc_otg_08:45:563
23153993713,10cyclictest7950irq/56-dwc_otg_07:32:143
2315399371,22cyclictest25047-21ssh07:35:583
2315399371,20cyclictest7850irq/56-dwc_otg_07:42:393
2315399371,20cyclictest7850irq/56-dwc_otg_07:42:393
2315299374,23cyclictest16604-21ls09:21:142
2315299371,29cyclictest0-21swapper/207:29:312
23152993711,4cyclictest0-21swapper/207:46:162
23152993710,8cyclictest31-21ksoftirqd/207:01:182
23152993710,8cyclictest31-21ksoftirqd/207:01:182
2315199372,6cyclictest7850irq/56-dwc_otg_08:41:041
23151993717,4cyclictest9530-21ssh09:51:191
23151993716,5cyclictest20191-21cut09:26:121
281182360,2sleep10-21swapper/107:39:161
2315399369,6cyclictest7850irq/56-dwc_otg_08:16:053
2315399367,22cyclictest0-21swapper/308:10:083
2315399365,14cyclictest15169-21sh09:58:463
2315399365,13cyclictest7950irq/56-dwc_otg_05:10:283
2315399363,4cyclictest7750irq/56-dwc_otg06:51:053
23153993614,11cyclictest381ktimersoftd/306:11:153
2315399361,24cyclictest25541-21cut06:06:103
2315299369,5cyclictest7950irq/56-dwc_otg_09:56:042
2315299367,16cyclictest7850irq/56-dwc_otg_07:25:522
2315299367,16cyclictest29-21rcuc/205:45:532
2315299363,6cyclictest31-21ksoftirqd/205:51:192
2315299363,4cyclictest7750irq/56-dwc_otg07:11:052
23152993626,7cyclictest18813-21latency_hist06:50:532
2315299361,24cyclictest11497-21cut08:36:102
2315199367,7cyclictest27500-21latency_hist08:55:531
2315199361,20cyclictest13717-21ssh09:56:191
2315399358,15cyclictest0-21swapper/306:16:053
2315399356,23cyclictest0-21swapper/305:36:053
2315399356,15cyclictest381ktimersoftd/304:56:193
23153993517,4cyclictest7950irq/56-dwc_otg_07:01:263
23153993517,4cyclictest7950irq/56-dwc_otg_07:01:263
23153993513,8cyclictest7850irq/56-dwc_otg_08:12:013
23152993514,5cyclictest29-21rcuc/209:16:192
2315299351,26cyclictest22869-21cut08:11:092
2315299351,20cyclictest23862-21latency_hist09:30:532
2315199358,5cyclictest7750irq/56-dwc_otg08:06:051
2315199355,8cyclictest19432-21ssh08:46:061
2315199355,20cyclictest12262-21ssh07:21:051
2315199354,22cyclictest7664-21ssh09:11:041
2315199352,8cyclictest0-21swapper/104:46:041
2315199352,4cyclictest7750irq/56-dwc_otg09:31:201
23151993522,9cyclictest31055-21ssh08:21:061
2315199351,18cyclictest7750irq/56-dwc_otg04:31:191
2315399348,12cyclictest381ktimersoftd/308:37:253
2315399344,15cyclictest7950irq/56-dwc_otg_09:08:083
2315399342,3cyclictest7850irq/56-dwc_otg_08:05:273
23153993412,6cyclictest7850irq/56-dwc_otg_06:58:533
23153993411,6cyclictest17670-21ssh09:22:083
2315299343,13cyclictest7850irq/56-dwc_otg_09:11:192
23152993422,4cyclictest23350-21latency_hist06:00:522
23152993422,4cyclictest23350-21latency_hist06:00:522
2315299342,24cyclictest0-21swapper/204:34:512
2315299342,20cyclictest0-21swapper/206:06:202
2315299342,18cyclictest0-21swapper/204:46:042
2315299341,23cyclictest28341-21missed_timers08:56:132
23152993411,6cyclictest31-21ksoftirqd/208:06:112
2315199349,5cyclictest7750irq/56-dwc_otg05:01:181
2315199343,15cyclictest7950irq/56-dwc_otg_09:00:531
23151993416,5cyclictest22008-21sh06:54:141
23151993412,6cyclictest221ktimersoftd/105:21:141
2315199340,18cyclictest0-21swapper/106:57:291
221542340,6sleep337-21rcuc/304:26:173
2315399337,5cyclictest7950irq/56-dwc_otg_04:50:523
2315399337,21cyclictest0-21swapper/304:31:063
2315399337,14cyclictest0-21swapper/309:46:193
2315399337,14cyclictest0-21swapper/305:51:053
2315399337,14cyclictest0-21swapper/305:31:053
2315299334,5cyclictest32213-21latency_hist09:40:522
2315299331,17cyclictest91750snmpd08:47:402
2315199335,15cyclictest1438-21latency_hist05:00:531
2315199333,26cyclictest30903-21cut06:21:091
23151993319,9cyclictest7950irq/56-dwc_otg_08:01:051
23151993316,4cyclictest12708-21aten_rbpower_vo05:31:061
23151993313,5cyclictest3766-21/usr/sbin/munin08:26:151
2315199331,22cyclictest17585-21timerwakeupswit07:26:191
23151993310,4cyclictest0-21swapper/106:11:071
2315399328,3cyclictest0-21swapper/305:21:053
2315399327,11cyclictest0-21swapper/307:56:053
23153993215,5cyclictest23209-21sh06:00:523
23153993215,5cyclictest23209-21sh06:00:523
2315299326,14cyclictest0-21swapper/206:26:052
2315299325,12cyclictest0-21swapper/207:31:042
2315299324,5cyclictest7850irq/56-dwc_otg_08:51:052
2315299324,20cyclictest7850irq/56-dwc_otg_08:16:232
2315299321,8cyclictest237922if_wlan006:56:102
2315199329,7cyclictest23-21ksoftirqd/107:41:101
2315199329,7cyclictest23-21ksoftirqd/107:41:101
2315199328,5cyclictest7750irq/56-dwc_otg06:16:091
2315199322,14cyclictest7750irq/56-dwc_otg05:11:101
2315299317,5cyclictest7950irq/56-dwc_otg_07:35:562
2315299317,13cyclictest7850irq/56-dwc_otg_09:33:462
2315299316,13cyclictest0-21swapper/205:06:042
2315299314,5cyclictest7850irq/56-dwc_otg_06:01:192
2315299312,6cyclictest0-21swapper/206:36:032
2315299312,5cyclictest7850irq/56-dwc_otg_06:51:092
2315299312,5cyclictest32572-21apt-get09:41:042
23152993125,5cyclictest31-21ksoftirqd/208:26:072
2315299312,20cyclictest0-21swapper/205:49:382
2315299311,5cyclictest30431-21runrttasks06:20:522
2315299311,19cyclictest7750irq/56-dwc_otg05:02:002
2315299311,13cyclictest7850irq/56-dwc_otg_06:34:522
2315299311,13cyclictest301ktimersoftd/208:31:162
2315199317,7cyclictest7850irq/56-dwc_otg_05:36:081
2315199312,5cyclictest32458-21/usr/sbin/munin06:26:131
23151993124,5cyclictest13797-21ssh09:17:371
2315299305,18cyclictest12868-21fschecks_count05:31:082
23152993022,5cyclictest25095-21grep04:36:052
2315299302,17cyclictest0-21swapper/205:26:122
23152993013,5cyclictest6113-21/usr/sbin/munin05:11:182
2315299301,22cyclictest0-21swapper/204:55:362
227972303,14sleep20-21swapper/204:29:492
2315399298,10cyclictest7950irq/56-dwc_otg_06:05:523
2315299296,13cyclictest7258-21wget05:16:052
2315299293,5cyclictest31-21ksoftirqd/204:56:112
2315299291,8cyclictest15578-21/usr/sbin/munin05:36:192
2315199294,5cyclictest7850irq/56-dwc_otg_05:26:121
2315399272,5cyclictest7950irq/56-dwc_otg_05:26:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional