You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 16:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Fri May 01, 2026 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1778124980,5sleep30-21swapper/316:26:173
2784621050,2sleep10-21swapper/119:06:141
18766999214,45cyclictest7950irq/56-dwc_otg_21:26:061
18763999122,5cyclictest26392-21fschecks_count16:51:090
179372910,3sleep217898-21ssh21:31:092
18763998710,29cyclictest2944-21unixbench_multi21:51:190
177872840,4sleep09-21ksoftirqd/017:56:090
239052830,2sleep00-21swapper/020:20:410
262812790,12sleep27950irq/56-dwc_otg_19:05:072
316032730,2sleep20-21swapper/221:08:022
86252720,2sleep10-21swapper/121:20:131
86252720,2sleep10-21swapper/121:20:131
235892720,6sleep11876699cyclictest18:11:151
15802720,1sleep30-21swapper/319:52:423
1876699692,55cyclictest11410-21ssh18:46:171
103632680,2sleep00-21swapper/019:24:530
1876399671,49cyclictest0-21swapper/021:16:020
1876399671,49cyclictest0-21swapper/021:16:020
1876399663,43cyclictest0-21swapper/018:56:200
1876699655,20cyclictest16069-21ssh20:11:031
55202640,2sleep10-21swapper/119:18:341
1876699646,47cyclictest16618-21grep19:31:191
1876399643,44cyclictest0-21swapper/021:40:520
1876999632,28cyclictest7750irq/56-dwc_otg17:26:033
1876699638,5cyclictest7850irq/56-dwc_otg_21:51:191
1876699634,13cyclictest21414-21grep18:06:101
1876399632,45cyclictest30574-21grep21:06:210
1876399631,26cyclictest32562-21dpkg20:30:530
1876699629,5cyclictest7850irq/56-dwc_otg_21:03:281
1876699623,5cyclictest0-21swapper/117:01:161
1876699621,6cyclictest15248-21sort19:30:531
1876699621,6cyclictest15248-21sort19:30:531
1876399622,43cyclictest31631-21cron19:50:520
18763996222,10cyclictest0-21swapper/019:36:050
232432610,1sleep30-21swapper/321:36:413
1876699613,4cyclictest7750irq/56-dwc_otg20:43:261
1876699611,6cyclictest25240-21timerwakeupswit16:46:191
18766996110,41cyclictest7850irq/56-dwc_otg_18:05:481
1876399611,42cyclictest19940-21grep16:31:200
112642610,3sleep30-21swapper/319:26:053
112642610,3sleep30-21swapper/319:26:053
1876699605,40cyclictest0-21swapper/120:20:521
1876699602,7cyclictest19047-21grep16:31:091
1876699601,5cyclictest13784-21timerandwakeup20:46:181
18766996013,38cyclictest7750irq/56-dwc_otg19:01:161
1876399602,49cyclictest0-21swapper/017:36:180
1876699596,40cyclictest7950irq/56-dwc_otg_19:11:191
1876699593,5cyclictest30260-21processes21:06:181
1876699593,11cyclictest7950irq/56-dwc_otg_20:21:071
1876399598,31cyclictest0-21swapper/019:26:030
1876399598,31cyclictest0-21swapper/019:26:030
1876399592,43cyclictest16782-21sed17:51:180
18763995915,27cyclictest19530-21fschecks_count18:01:090
18763995832,14cyclictest9632-21ssh21:21:080
1876399582,33cyclictest0-21swapper/021:31:090
1876399581,45cyclictest29917-21latency_hist18:30:510
1876399581,42cyclictest8659-21aten_rbpower_en20:41:060
91012570,2sleep30-21swapper/319:22:353
1876699574,13cyclictest7850irq/56-dwc_otg_16:51:091
1876699571,6cyclictest11953-21ssh20:06:051
1876399571,43cyclictest883-21mktemp17:10:530
1876399571,43cyclictest883-21mktemp17:10:530
1876399571,41cyclictest1551-21unixbench_singl20:31:190
1876699567,4cyclictest0-21swapper/121:36:571
18766995616,37cyclictest2807-21latency_hist17:15:521
1876699561,4cyclictest0-21swapper/118:31:331
1876699561,13cyclictest0-21swapper/117:06:291
1876699561,13cyclictest0-21swapper/117:06:291
1876399561,44cyclictest0-21swapper/018:31:160
100602560,3sleep11876699cyclictest21:21:131
20462550,2sleep00-21swapper/018:36:020
1876699552,5cyclictest31977-21ssh21:47:291
1876699552,3cyclictest0-21swapper/116:43:251
1876699551,5cyclictest23062-21runrttasks20:57:431
1876699551,5cyclictest23062-21runrttasks20:57:431
1876699551,12cyclictest7750irq/56-dwc_otg19:00:001
228902540,5sleep01876399cyclictest20:57:250
228902540,5sleep01876399cyclictest20:57:250
1876699549,5cyclictest7850irq/56-dwc_otg_21:15:131
1876699545,7cyclictest7950irq/56-dwc_otg_16:56:101
1876699545,4cyclictest7950irq/56-dwc_otg_20:29:061
1876699542,12cyclictest7850irq/56-dwc_otg_19:51:231
18766995420,31cyclictest14585-21/usr/sbin/munin18:51:091
1876699541,3cyclictest0-21swapper/120:02:201
1876699541,13cyclictest25541-21ssh19:42:201
18763995424,5cyclictest7242-21grep21:56:190
1876399542,40cyclictest0-21swapper/021:26:080
18763995415,27cyclictest6391-21wget18:41:040
1876699532,3cyclictest0-21swapper/120:36:161
1876699531,8cyclictest27589-21unixbench_multi18:21:201
1876699531,8cyclictest27589-21unixbench_multi18:21:201
1876699531,3cyclictest7750irq/56-dwc_otg21:59:531
18766995310,40cyclictest7950irq/56-dwc_otg_18:45:521
18763995336,4cyclictest7850irq/56-dwc_otg_18:51:050
18763995331,5cyclictest7850irq/56-dwc_otg_19:41:160
18763995328,5cyclictest7750irq/56-dwc_otg17:00:520
1876399532,31cyclictest0-21swapper/017:35:530
1876399531,49cyclictest27241-21grep18:21:170
1876399531,49cyclictest27241-21grep18:21:170
1876399531,42cyclictest0-21swapper/018:46:090
1876399531,41cyclictest2661-21munin-run19:15:520
1876399531,35cyclictest22200-21grep18:06:200
18769995217,23cyclictest0-21swapper/318:26:063
1876699521,4cyclictest0-21swapper/119:56:471
1876699521,4cyclictest0-21swapper/119:36:091
1876699521,10cyclictest7850irq/56-dwc_otg_18:00:531
18763995240,5cyclictest7950irq/56-dwc_otg_20:55:520
18763995231,6cyclictest6644-21aten_rbpower_vo17:26:070
1876399522,14cyclictest0-21swapper/021:41:090
1876399522,14cyclictest0-21swapper/021:41:090
1876399521,37cyclictest30825-21ntp_states21:46:150
1876399521,36cyclictest0-21swapper/020:21:060
1876899513,6cyclictest7850irq/56-dwc_otg_16:41:022
1876699515,9cyclictest7950irq/56-dwc_otg_20:31:591
1876699511,6cyclictest0-21swapper/116:40:531
1876699511,5cyclictest0-21swapper/121:31:541
1876699510,3cyclictest7750irq/56-dwc_otg19:22:321
1876399516,26cyclictest0-21swapper/017:46:050
1876399511,40cyclictest0-21swapper/021:01:060
1876399511,39cyclictest0-21swapper/021:14:140
18763995110,8cyclictest0-21swapper/016:36:200
1876699501,5cyclictest28190-21perl19:46:091
1876699501,4cyclictest9550irq/80-mmc017:31:061
1876699501,3cyclictest0-21swapper/118:36:361
1876699501,3cyclictest0-21swapper/117:16:231
1876699501,10cyclictest18738-21chrt20:52:231
18766995010,4cyclictest135212chrt17:44:511
1876399505,16cyclictest7950irq/56-dwc_otg_20:11:030
1876399502,39cyclictest0-21swapper/017:04:570
1876399501,40cyclictest0-21swapper/019:06:580
1876399501,39cyclictest0-21swapper/020:36:090
1876399501,37cyclictest15933-21sort20:10:530
1876399501,36cyclictest0-21swapper/019:16:050
1876699496,4cyclictest7950irq/56-dwc_otg_21:42:501
1876699496,4cyclictest7950irq/56-dwc_otg_21:42:501
1876399494,26cyclictest13-21rcuc/017:16:090
18763994937,5cyclictest7850irq/56-dwc_otg_20:01:140
1876699482,5cyclictest0-21swapper/117:46:161
1876699481,15cyclictest0-21swapper/117:24:291
18763994831,4cyclictest7750irq/56-dwc_otg20:46:570
18763994828,12cyclictest3707-21cut19:56:040
1876399481,38cyclictest0-21swapper/019:31:060
1876399481,35cyclictest0-21swapper/019:01:110
181852483,12sleep00-21swapper/016:26:560
1876899477,25cyclictest0-21swapper/218:40:592
1876699471,3cyclictest0-21swapper/118:16:241
58252460,2sleep35826-21/usr/sbin/munin21:16:123
58252460,2sleep35826-21/usr/sbin/munin21:16:123
1876699467,24cyclictest0-21swapper/117:26:061
1876699461,4cyclictest0-21swapper/118:27:241
18763994624,4cyclictest1365-21grep17:11:080
1876399461,35cyclictest1838-21sh19:53:100
1876899456,24cyclictest0-21swapper/219:41:052
1876699457,34cyclictest16642-21timerwakeupswit17:51:171
1876699452,5cyclictest0-21swapper/117:39:561
18763994518,4cyclictest7950irq/56-dwc_otg_16:45:520
1876899446,24cyclictest0-21swapper/217:10:582
1876399444,26cyclictest0-21swapper/018:16:430
18763994425,2cyclictest0-21swapper/016:46:040
1876399441,30cyclictest25577-21systemd-journal18:14:490
18769994323,9cyclictest7793-21ssh20:01:033
1876899437,25cyclictest0-21swapper/216:51:052
1876399436,25cyclictest0-21swapper/017:21:050
1876999427,7cyclictest7850irq/56-dwc_otg_20:31:033
18769994234,6cyclictest363450/usr/sbin/munin19:56:123
1876999423,21cyclictest0-21swapper/318:56:033
1876899427,26cyclictest0-21swapper/216:36:062
1876899427,25cyclictest0-21swapper/221:01:052
1876899427,25cyclictest0-21swapper/216:46:052
1876899426,23cyclictest0-21swapper/221:11:052
1876899422,5cyclictest7950irq/56-dwc_otg_17:36:032
1876399421,32cyclictest0-21swapper/017:41:430
1876999415,25cyclictest27077-21ssh19:05:583
1876999413,23cyclictest0-21swapper/316:51:043
1876899417,24cyclictest0-21swapper/218:25:442
1876899417,24cyclictest0-21swapper/218:25:442
1876899415,21cyclictest32654-21ssh20:30:572
1876899411,7cyclictest31281-21ssh19:11:032
18769994014,5cyclictest23436-21latency_hist19:40:523
292712391,2sleep30-21swapper/319:46:353
1876899394,29cyclictest7950irq/56-dwc_otg_20:51:022
18768993916,12cyclictest20548-21latency_hist16:35:532
180512390,1sleep20-21swapper/219:33:492
132182390,1sleep20-21swapper/219:27:332
132182390,1sleep20-21swapper/219:27:332
1876999387,5cyclictest7750irq/56-dwc_otg17:11:043
1876999383,5cyclictest9298-21/usr/sbin/munin21:21:163
1876899382,28cyclictest7950irq/56-dwc_otg_18:51:042
18768993817,5cyclictest29508-21idleruntime-cro17:00:522
18769993712,5cyclictest24027-21idleruntime-cro20:20:523
18768993721,14cyclictest2951950ssh20:26:182
18768993714,5cyclictest6580-21aten_rbpower_en17:26:062
137582370,13sleep231-21ksoftirqd/221:26:102
1876999367,15cyclictest7950irq/56-dwc_otg_19:05:523
1876999364,7cyclictest7750irq/56-dwc_otg19:16:013
18769993620,10cyclictest18516-21sh20:52:003
1876999361,33cyclictest2668650rm19:44:263
1876899363,4cyclictest7750irq/56-dwc_otg20:36:062
18768993614,12cyclictest25635-21grep20:21:212
1876899361,23cyclictest24093-21ls20:20:532
1876999352,6cyclictest7950irq/56-dwc_otg_17:51:033
18769993516,5cyclictest30351-21fschecks_count21:46:093
18769993516,4cyclictest16839-21sh21:30:073
1876999351,25cyclictest14799-21timerandwakeup17:46:183
1876999351,15cyclictest7850irq/56-dwc_otg_18:01:183
1876999351,10cyclictest11008-21cut18:46:103
18769993510,6cyclictest7950irq/56-dwc_otg_21:31:193
18768993520,5cyclictest29019-21ssh21:44:382
18768993520,5cyclictest29019-21ssh21:44:382
18768993510,7cyclictest18755-21cyclictest21:46:482
177062356,16sleep20-21swapper/216:26:172
310652340,5sleep2301ktimersoftd/219:49:512
1876999349,11cyclictest0-21swapper/321:51:333
1876999347,14cyclictest0-21swapper/317:00:573
1876999343,14cyclictest7850irq/56-dwc_otg_20:10:183
1876999341,8cyclictest1067-21aten_rbpower_cu21:11:053
1876999341,6cyclictest0-21swapper/318:35:473
18769993416,4cyclictest31592-21fschecks_time19:11:073
18769993414,4cyclictest9992-21latency_hist22:00:533
18769993412,5cyclictest17451-21ssh18:54:073
1876899347,15cyclictest0-21swapper/219:51:032
1876899347,14cyclictest0-21swapper/217:21:052
1876899344,4cyclictest7750irq/56-dwc_otg18:26:062
18768993415,5cyclictest8417-21/usr/sbin/munin17:31:162
18768993415,5cyclictest301ktimersoftd/221:38:572
18768993413,5cyclictest14185-21fschecks_time17:46:092
18768993411,5cyclictest301ktimersoftd/220:41:112
1876899341,13cyclictest7950irq/56-dwc_otg_19:10:532
1876899340,24cyclictest0-21swapper/220:06:182
1876999333,4cyclictest6614-21fschecks_count18:41:073
18769993314,9cyclictest29910-21diskmemload18:38:443
1876999331,23cyclictest27364-21switchtime18:21:183
1876999331,23cyclictest27364-21switchtime18:21:183
1876999331,22cyclictest0-21swapper/320:39:343
1876999331,20cyclictest24978-21uniq18:16:083
18769993311,5cyclictest29910-21diskmemload19:32:123
1876899337,11cyclictest7850irq/56-dwc_otg_21:51:202
1876899336,6cyclictest7850irq/56-dwc_otg_18:05:522
18768993323,7cyclictest908-21runrttasks17:55:522
18768993315,4cyclictest3576-21sh18:36:412
1876899331,14cyclictest9581-21ssh21:21:082
18768993311,10cyclictest0-21swapper/220:49:122
86992320,2sleep20-21swapper/219:21:492
303022320,5sleep21876899cyclictest18:31:052
1876999325,15cyclictest7950irq/56-dwc_otg_17:30:583
1876999325,13cyclictest7950irq/56-dwc_otg_21:45:523
1876999325,13cyclictest7950irq/56-dwc_otg_21:45:523
18769993216,5cyclictest8773-21cpuspeed20:41:063
18769993214,9cyclictest908-21runrttasks20:56:483
18769993214,9cyclictest908-21runrttasks20:56:483
18769993210,5cyclictest24604-21sh20:21:093
1876899326,4cyclictest0-21swapper/221:20:532
1876899326,4cyclictest0-21swapper/221:20:532
1876899323,26cyclictest7950irq/56-dwc_otg_17:06:042
1876899323,26cyclictest7950irq/56-dwc_otg_17:06:042
18768993219,11cyclictest7950irq/56-dwc_otg_20:56:192
18768993219,11cyclictest7950irq/56-dwc_otg_20:56:192
1876899321,5cyclictest712650ssh21:56:192
18768993212,5cyclictest301ktimersoftd/220:12:432
18768993211,5cyclictest3871-21sort17:16:162
1876999317,5cyclictest7750irq/56-dwc_otg20:30:533
1876999312,17cyclictest0-21swapper/320:11:433
1876999312,14cyclictest0-21swapper/321:01:123
1876999311,6cyclictest7750irq/56-dwc_otg17:21:053
1876999311,5cyclictest12835-21basename20:46:053
1876899319,4cyclictest0-21swapper/219:17:302
1876899317,4cyclictest0-21swapper/218:48:342
18768993117,6cyclictest22504-21rm19:39:202
1876899311,14cyclictest7850irq/56-dwc_otg_18:11:102
1876999304,4cyclictest7750irq/56-dwc_otg18:11:163
1876999301,6cyclictest7950irq/56-dwc_otg_16:36:073
1876999301,5cyclictest7750irq/56-dwc_otg17:41:093
1876999301,24cyclictest7950irq/56-dwc_otg_21:06:043
1876999301,14cyclictest7950irq/56-dwc_otg_16:31:163
18769993010,13cyclictest11303-21grep17:36:203
1876899308,4cyclictest13174-21unixbench_multi17:41:202
1876899306,14cyclictest0-21swapper/217:56:052
1876899305,15cyclictest0-21swapper/218:06:062
1876899303,11cyclictest7950irq/56-dwc_otg_20:01:152
18768993023,5cyclictest5678-21ssh19:57:372
1876999297,5cyclictest7850irq/56-dwc_otg_18:10:523
18769992923,4cyclictest17542-21aten_rbpower_po17:56:063
1876999291,5cyclictest0-21swapper/317:06:363
1876999291,5cyclictest0-21swapper/317:06:363
18769992910,10cyclictest3576-21/usr/sbin/munin17:16:123
1876899291,12cyclictest20071-21ssh18:56:212
1876999282,18cyclictest0-21swapper/316:47:113
1876999281,5cyclictest7750irq/56-dwc_otg16:41:073
1876899288,7cyclictest7950irq/56-dwc_otg_18:19:502
1876999272,15cyclictest0-21swapper/316:57:223
18768992718,6cyclictest31576-21latency_hist17:05:532
174102266,8sleep10-21swapper/116:26:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional