You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-23 - 05:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Sat May 23, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
512225300,4sleep20-21swapper/219:05:302
580299821,44cyclictest0-21swapper/022:00:130
257912820,6sleep1580399cyclictest20:05:141
5804997518,5cyclictest30859-21cat00:00:212
580299755,39cyclictest13-21rcuc/000:05:140
580499725,13cyclictest8050irq/56-dwc_otg_22:55:152
5802997237,14cyclictest0-21swapper/021:45:170
5802997237,14cyclictest0-21swapper/021:45:170
580299723,13cyclictest11-21rcu_preempt20:00:120
5802997229,15cyclictest0-21swapper/021:20:130
580299721,37cyclictest0-21swapper/022:20:140
248582720,2sleep10-21swapper/123:14:311
254582710,2sleep20-21swapper/221:17:402
170792700,2sleep339-21ksoftirqd/323:44:003
170792700,2sleep339-21ksoftirqd/323:44:003
147582700,14sleep0101ktimersoftd/021:44:320
9772690,2sleep20-21swapper/222:05:472
580299696,42cyclictest0-21swapper/021:00:160
298192690,3sleep2580499cyclictest22:01:452
5805996815,14cyclictest13195-21systemd20:58:313
5805996723,23cyclictest13185-21ls22:20:303
580499674,15cyclictest7950irq/56-dwc_otg_23:40:192
580499674,15cyclictest7950irq/56-dwc_otg_23:40:192
5802996740,7cyclictest7950irq/56-dwc_otg_20:58:550
204602670,3sleep00-21swapper/022:30:090
5805996622,24cyclictest30894-21ssh22:03:413
580499662,8cyclictest29695-21uname22:40:262
5804996612,4cyclictest8197-21/usr/sbin/munin21:35:292
580299667,15cyclictest0-21swapper/023:40:090
580299667,15cyclictest0-21swapper/023:40:090
5802996618,14cyclictest0-21swapper/019:30:140
292522660,2sleep00-21swapper/020:15:030
580399651,8cyclictest13469-21kill20:58:431
108082650,1sleep30-21swapper/322:18:213
5805996421,18cyclictest29693-21processes22:40:263
580499644,6cyclictest0-21swapper/221:55:172
179762640,2sleep20-21swapper/222:26:092
179762640,2sleep20-21swapper/222:26:092
580399626,11cyclictest0-21swapper/121:25:101
580399621,9cyclictest11085-21wc19:25:021
580399621,9cyclictest11085-21wc19:25:021
5802996231,14cyclictest7950irq/56-dwc_otg_00:35:020
5805996125,23cyclictest12580-21ssh21:40:343
5805996122,23cyclictest16098-21taskset19:36:083
580499618,4cyclictest0-21swapper/221:31:302
5802996129,14cyclictest7950irq/56-dwc_otg_19:25:160
5802996116,8cyclictest0-21swapper/023:25:140
5805996025,19cyclictest29882-21diskstats23:20:183
5803996012,4cyclictest0-21swapper/123:30:151
580299606,17cyclictest8942-21sh22:55:130
5802996040,6cyclictest9450irq/48-DMA10:20:150
5802996040,6cyclictest9450irq/48-DMA10:20:150
5802996024,32cyclictest21807-21sh23:50:020
580299601,38cyclictest6662-21runrttasks00:10:200
5805995924,12cyclictest31047-21sed20:20:033
5805995924,12cyclictest31047-21sed20:20:033
5805995923,17cyclictest29981-21ssh23:59:513
580399598,4cyclictest0-21swapper/100:10:581
580399591,6cyclictest18986-21grep00:25:191
580399591,15cyclictest0-21swapper/100:35:181
5802995926,3cyclictest0-21swapper/023:55:130
580299591,31cyclictest5936-21tail22:50:300
5802995912,43cyclictest101ktimersoftd/022:15:020
5805995825,10cyclictest7950irq/56-dwc_otg_23:15:033
5805995824,12cyclictest18564-21cat21:10:033
5805995823,20cyclictest428-21ssh00:02:373
5802995813,17cyclictest9-21ksoftirqd/019:55:120
5805995727,12cyclictest18812-21ssh21:49:213
5805995727,12cyclictest18812-21ssh21:49:213
5805995726,19cyclictest27038-21sshd20:06:173
5805995725,13cyclictest8603-21apt-config22:55:033
5805995724,13cyclictest13702-21sed23:00:223
5802995752,3cyclictest0-21swapper/000:35:180
5805995623,13cyclictest19641-21ssh23:46:063
5805995622,14cyclictest8050irq/56-dwc_otg_00:39:123
5805995621,12cyclictest6017-21ssh22:12:113
580399569,6cyclictest0-21swapper/100:17:131
580399564,5cyclictest10913-21pluginstate21:40:021
580299565,32cyclictest8744-21grep19:15:300
5802995631,7cyclictest7950irq/56-dwc_otg_20:40:020
580299562,29cyclictest4076-21latency_hist20:35:020
580299561,30cyclictest2349-21latency_hist20:30:030
580299561,16cyclictest18435-21diskmemload22:42:480
5805995527,8cyclictest23182-21diskstats21:15:183
5805995527,12cyclictest7576-21if_wlan021:35:203
5805995526,9cyclictest0-21swapper/319:55:173
5805995525,11cyclictest12618-21ssh00:17:063
5805995524,19cyclictest23989-21ssh23:51:293
5805995524,18cyclictest2414-21ssh21:29:423
5805995524,16cyclictest20390-21ssh23:08:533
5805995522,11cyclictest0-21swapper/322:00:033
5803995514,4cyclictest10537-21/usr/sbin/munin20:50:431
5802995524,16cyclictest20858-21/usr/sbin/munin21:50:320
5802995524,14cyclictest7850irq/56-dwc_otg22:45:300
580299551,29cyclictest21331-21/usr/sbin/munin23:10:250
5805995430,10cyclictest28029-21ssh23:17:433
5805995429,11cyclictest13262-21/usr/sbin/munin19:30:173
5805995423,7cyclictest665-21apt-get20:25:153
5805995423,14cyclictest8103-21ssh00:11:263
5805995416,19cyclictest961-21/usr/sbin/munin22:45:203
580499546,3cyclictest8050irq/56-dwc_otg_21:53:532
580299541,33cyclictest13447-21munin-run23:40:030
5805995326,10cyclictest11262-21apt-get19:25:143
580399534,14cyclictest0-21swapper/122:09:291
580299532,25cyclictest0-21swapper/023:05:030
580299531,49cyclictest0-21swapper/023:30:160
580299531,32cyclictest0-21swapper/021:35:200
580599526,9cyclictest7850irq/56-dwc_otg22:55:133
5805995224,18cyclictest27338-21ssh22:37:553
5805995223,12cyclictest6706-21ssh21:34:563
5805995214,9cyclictest7950irq/56-dwc_otg_22:30:153
580299523,28cyclictest516-21latency_hist20:25:020
5802995224,4cyclictest8050irq/56-dwc_otg_21:30:200
580299521,8cyclictest17619-21ls19:40:290
580299521,31cyclictest20005-21grep00:25:300
580299521,31cyclictest11097-21ssh00:15:240
580299521,30cyclictest0-21swapper/000:00:130
5805995121,10cyclictest21394-21rm21:12:503
5805995120,13cyclictest5158-21ssh00:08:383
5805995119,12cyclictest7950irq/56-dwc_otg_00:25:153
5805995118,14cyclictest7380-21ssh23:31:333
580299513,29cyclictest141-21systemd-journal21:11:120
5802995124,7cyclictest15538-21switchtime00:20:280
580299512,27cyclictest16970-21/usr/sbin/munin22:25:220
580299512,27cyclictest16970-21/usr/sbin/munin22:25:220
580299512,24cyclictest0-21swapper/022:35:200
5802995118,22cyclictest17595-21fschecks_time23:05:200
5802995113,18cyclictest0-21swapper/022:15:180
580299511,27cyclictest31275-21aten_rbpower_cu21:25:150
580399501,22cyclictest6818-21rm22:51:581
580299502,29cyclictest9931-21df20:50:330
5802995022,7cyclictest7672-21idleruntime-cro20:45:020
5802995022,6cyclictest19553-21unixbench_multi19:45:290
5802995016,14cyclictest8198-21fschecks_time20:45:190
5802995016,14cyclictest8198-21fschecks_time20:45:190
580299501,30cyclictest32431-21if_eth022:05:210
5805994926,8cyclictest10043-21perl20:50:353
5805994920,11cyclictest24630-21ssh00:31:103
5805994919,11cyclictest17066-21ssh00:22:393
5805994919,11cyclictest0-21swapper/319:52:173
5805994917,13cyclictest29075-21chrt20:14:093
5805994915,14cyclictest7886-21taskset20:45:053
5805994915,14cyclictest7886-21taskset20:45:053
5805994914,10cyclictest0-21swapper/322:09:173
580399499,10cyclictest221ktimersoftd/121:58:061
580399498,6cyclictest0-21swapper/123:50:461
5803994915,6cyclictest8050irq/56-dwc_otg_23:20:261
5802994927,4cyclictest7950irq/56-dwc_otg_19:20:230
5802994927,4cyclictest7950irq/56-dwc_otg_19:20:230
5802994922,6cyclictest20947-21ntp_kernel_pll_19:50:240
52672493,15sleep00-21swapper/019:06:350
5805994821,15cyclictest0-21swapper/319:47:053
5805994818,13cyclictest27611-21rm21:20:223
5805994818,12cyclictest19537-21ssh22:28:593
5805994818,12cyclictest19537-21ssh22:28:593
5802994820,16cyclictest0-21swapper/023:53:290
5802994816,19cyclictest0-21swapper/021:15:270
5805994719,11cyclictest3921-21chrt20:33:333
5805994716,10cyclictest0-21swapper/320:39:103
5805994712,11cyclictest8050irq/56-dwc_otg_23:25:223
580399474,6cyclictest8050irq/56-dwc_otg_22:45:131
580299477,26cyclictest0-21swapper/019:10:150
5802994712,25cyclictest0-21swapper/023:20:160
5805994618,12cyclictest23962-21/usr/sbin/munin20:00:263
5805994617,15cyclictest18435-21diskmemload21:51:563
5805994614,17cyclictest8050irq/56-dwc_otg_19:41:213
580499464,3cyclictest0-21swapper/221:00:142
580299469,16cyclictest0-21swapper/023:20:020
5805994521,10cyclictest16349-21taskset21:01:403
5805994518,12cyclictest11864-21taskset23:37:123
5804994524,4cyclictest30914-21idleruntime-cro21:25:022
580299456,25cyclictest0-21swapper/020:05:160
5802994516,5cyclictest0-21swapper/019:40:020
580299451,5cyclictest18589-21latency_hist21:10:030
580499447,23cyclictest0-21swapper/220:00:152
5804994417,10cyclictest13490-21latency_hist23:40:032
580299443,21cyclictest0-21swapper/021:55:230
5805994329,11cyclictest7012-21ls20:40:273
580399435,8cyclictest8050irq/56-dwc_otg_00:30:141
255902430,2sleep10-21swapper/121:17:551
580599426,23cyclictest0-21swapper/319:20:163
580599426,23cyclictest0-21swapper/319:20:163
5805994216,9cyclictest8050irq/56-dwc_otg_20:22:353
580399421,33cyclictest0-21swapper/121:45:171
580399421,33cyclictest0-21swapper/121:45:171
5805994129,10cyclictest8966-21sshd19:17:083
5805994126,11cyclictest6202-21/usr/sbin/munin19:10:213
580499416,8cyclictest7850irq/56-dwc_otg00:30:122
5804994112,10cyclictest478-21dbus-daemon20:59:162
5803994118,7cyclictest31696-21grep00:00:311
5804994013,7cyclictest0-21swapper/223:12:412
580499401,27cyclictest6300-21ls20:40:162
5803994014,7cyclictest8638-21ssh22:15:241
5803994012,18cyclictest19777-21sh21:50:181
580499393,22cyclictest0-21swapper/200:25:162
5804993916,12cyclictest26564-21ssh23:55:182
5803993918,4cyclictest25838-21fschecks_time23:15:191
5803993911,12cyclictest0-21swapper/121:20:311
187462390,2sleep218747-21/usr/sbin/munin23:45:242
580499383,5cyclictest4077-21fschecks_count22:10:192
580499381,5cyclictest27907-21ssh00:35:232
580499381,27cyclictest17363-21ls21:05:212
580399382,4cyclictest7850irq/56-dwc_otg21:14:091
580399381,3cyclictest7950irq/56-dwc_otg_20:30:141
580399381,26cyclictest17166-21ls19:40:221
580499379,3cyclictest0-21swapper/221:40:152
580499375,27cyclictest8050irq/56-dwc_otg_23:50:142
580399376,7cyclictest1133-21runrttasks23:49:371
5803993711,5cyclictest0-21swapper/123:40:081
5803993711,5cyclictest0-21swapper/123:40:081
52632370,10sleep1221ktimersoftd/100:08:501
580499361,4cyclictest8050irq/56-dwc_otg_23:15:122
580399362,7cyclictest0-21swapper/122:01:181
580399362,4cyclictest0-21swapper/122:25:121
580399362,4cyclictest0-21swapper/122:25:121
5803993617,5cyclictest26406-21cpu23:55:151
5803993617,5cyclictest1775-21if_eth023:25:191
580399361,3cyclictest7850irq/56-dwc_otg20:40:131
5804993518,5cyclictest13065-21aten_rbpower_cu19:30:152
580399352,19cyclictest8050irq/56-dwc_otg_22:10:071
5803993518,10cyclictest0-21swapper/123:04:311
580399351,5cyclictest0-21swapper/119:50:131
5803993512,5cyclictest0-21swapper/122:35:231
580399351,20cyclictest25075-21kworker/u8:322:30:171
214952351,31sleep221501-21ssh21:13:022
580499349,5cyclictest31-21ksoftirqd/219:10:212
580499345,9cyclictest8050irq/56-dwc_otg_00:05:272
580499345,3cyclictest7850irq/56-dwc_otg20:45:122
580499345,3cyclictest7850irq/56-dwc_otg20:45:122
580499341,5cyclictest20255-21/usr/sbin/munin19:50:122
5804993413,12cyclictest219082chrt22:30:402
580399347,4cyclictest0-21swapper/122:40:321
580399346,6cyclictest7950irq/56-dwc_otg_20:20:281
580399344,4cyclictest7950irq/56-dwc_otg_22:55:151
580399343,15cyclictest8050irq/56-dwc_otg_19:35:141
580399342,5cyclictest18010-21head21:05:301
580399342,14cyclictest8050irq/56-dwc_otg_23:35:131
580399341,7cyclictest5276-21timerwakeupswit20:35:271
580399341,5cyclictest25550-21sh20:05:021
5803993410,9cyclictest0-21swapper/122:25:031
580499338,3cyclictest0-21swapper/221:28:292
580499334,6cyclictest7850irq/56-dwc_otg23:20:192
580499334,4cyclictest0-21swapper/223:30:212
580499333,6cyclictest7950irq/56-dwc_otg_23:05:142
5804993319,4cyclictest11727-21sh22:20:012
580499331,5cyclictest14683-21cut00:20:162
580499331,21cyclictest10241-21latency20:50:382
5804993311,4cyclictest0-21swapper/222:50:122
5804993310,4cyclictest16362-21switchtime21:45:302
5804993310,4cyclictest16362-21switchtime21:45:302
580399338,16cyclictest27843-21fschecks_count20:10:191
580399334,4cyclictest30526-21grep20:15:301
580399334,4cyclictest30526-21grep20:15:301
580399333,6cyclictest12133-21/usr/sbin/munin21:40:251
580399332,8cyclictest7950irq/56-dwc_otg_20:25:141
580399332,6cyclictest0-21swapper/123:06:091
53092332,24sleep10-21swapper/119:07:081
580499329,3cyclictest0-21swapper/222:20:132
580499328,6cyclictest1809-21grep22:45:302
580499327,4cyclictest0-21swapper/223:29:282
580499323,13cyclictest8050irq/56-dwc_otg_19:35:152
5804993224,6cyclictest747-21aten_rbpower_po20:25:162
580499321,5cyclictest1133-21runrttasks19:15:192
5804993213,5cyclictest1133-21runrttasks19:44:412
580499321,15cyclictest31308-21apt-get20:20:112
5804993210,6cyclictest10438-21timerwakeupswit19:20:292
5804993210,6cyclictest10438-21timerwakeupswit19:20:292
580399329,11cyclictest9550irq/80-mmc019:15:021
580399321,7cyclictest14824-21ssh00:20:181
5803993212,6cyclictest5734-21runrttasks21:33:111
580499312,7cyclictest8615-21sh00:12:222
580499311,6cyclictest25570-21ssh22:35:272
5804993116,8cyclictest18518-21wget19:45:152
580499311,19cyclictest10744-21grep00:15:202
580399313,4cyclictest0-21swapper/121:00:311
580399311,20cyclictest0-21swapper/120:45:221
580399311,20cyclictest0-21swapper/120:45:221
580399311,11cyclictest7752-21tr19:15:161
580499309,5cyclictest9550irq/80-mmc019:55:162
580499305,10cyclictest8050irq/56-dwc_otg_20:30:272
580499303,13cyclictest8050irq/56-dwc_otg_20:10:212
580499302,4cyclictest13075-21apt-get23:00:142
580399305,8cyclictest23834-21latency_hist20:00:021
580399305,18cyclictest0-21swapper/119:48:211
580399304,10cyclictest8050irq/56-dwc_otg_19:25:251
580399302,5cyclictest14152-21grep19:30:301
580499294,6cyclictest8050irq/56-dwc_otg_19:28:092
580499293,12cyclictest7950irq/56-dwc_otg_20:35:252
580499291,4cyclictest0-21swapper/220:15:272
580499291,4cyclictest0-21swapper/220:15:272
5804992710,4cyclictest301ktimersoftd/220:05:212
53432273,15sleep30-21swapper/319:07:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional