You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 10:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sun May 03, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1293621780,4sleep32931199cyclictest08:32:583
61192870,2sleep20-21swapper/209:43:272
61192870,2sleep20-21swapper/209:43:272
2930699803,61cyclictest0-21swapper/004:41:060
170342800,2sleep20-21swapper/207:20:422
81272790,5sleep12930999cyclictest09:06:181
2931099792,5cyclictest10751-21ssh08:31:042
2930699781,25cyclictest30116-21ssh07:36:070
2930699781,25cyclictest30116-21ssh07:36:070
2930699768,28cyclictest0-21swapper/004:46:060
57252750,6sleep22931099cyclictest07:06:132
2930699757,46cyclictest0-21swapper/007:00:590
281322750,2sleep30-21swapper/304:26:143
270722740,2sleep127074-21ssh06:52:391
2931099732,55cyclictest0-21swapper/204:41:042
2931099724,53cyclictest7950irq/56-dwc_otg_08:30:532
29306997217,5cyclictest0-21swapper/009:41:040
29306997217,5cyclictest0-21swapper/009:41:040
2931099687,25cyclictest0-21swapper/205:26:062
2931099684,5cyclictest7850irq/56-dwc_otg_09:01:162
2931099681,56cyclictest1135-21ssh07:40:192
2931099681,56cyclictest1135-21ssh07:40:192
2931099679,26cyclictest7850irq/56-dwc_otg_05:46:022
171172670,2sleep30-21swapper/307:20:513
2931099669,41cyclictest30961-21latency_hist04:35:532
2930699662,31cyclictest0-21swapper/007:11:070
2931099652,5cyclictest0-21swapper/209:26:212
29310996510,43cyclictest16197-21ssh08:36:232
2931099648,46cyclictest3952-21ssh07:04:222
2931099644,6cyclictest7981-21/usr/sbin/munin06:31:092
2931099641,6cyclictest22007-21unixbench_multi06:46:202
2931099641,3cyclictest0-21swapper/209:22:032
29306996432,4cyclictest7850irq/56-dwc_otg_08:06:040
127332640,2sleep10-21swapper/108:32:361
2931099631,5cyclictest0-21swapper/209:10:532
29310996311,34cyclictest16509-21sh06:41:032
321032620,1sleep20-21swapper/206:59:162
2931099621,3cyclictest7750irq/56-dwc_otg07:26:112
29306996212,40cyclictest0-21swapper/005:46:030
2931099617,46cyclictest7666-21diskmemload09:34:412
2931099617,33cyclictest0-21swapper/207:58:412
2931099615,4cyclictest7950irq/56-dwc_otg_05:31:142
2931099615,36cyclictest7850irq/56-dwc_otg_07:22:582
2931099614,39cyclictest7850irq/56-dwc_otg_08:47:182
2931099614,39cyclictest7850irq/56-dwc_otg_08:47:182
2931099612,40cyclictest7950irq/56-dwc_otg_08:56:032
2931099611,6cyclictest26467-21latency_hist08:10:532
29310996114,44cyclictest22118-21ls05:40:532
2930699611,56cyclictest26042-21wget07:31:070
2931099609,37cyclictest0-21swapper/207:52:142
2931099602,42cyclictest7850irq/56-dwc_otg_05:05:542
2931099601,2cyclictest0-21swapper/208:01:102
126862600,1sleep20-21swapper/209:11:262
2931099599,35cyclictest0-21swapper/208:11:502
2931099597,38cyclictest7950irq/56-dwc_otg_09:51:222
2931099593,3cyclictest0-21swapper/208:24:162
2930699597,38cyclictest0-21swapper/005:16:190
2930699597,38cyclictest0-21swapper/005:16:190
2930699593,37cyclictest31711-21fschecks_count08:56:100
2931199581,10cyclictest7950irq/56-dwc_otg_05:41:033
2931099581,44cyclictest10115-21kernelversion05:06:142
2931099581,10cyclictest766650diskmemload09:39:132
2930699582,8cyclictest0-21swapper/005:36:030
52032570,2sleep00-21swapper/007:06:070
2931099576,42cyclictest7950irq/56-dwc_otg_07:45:372
2931099572,43cyclictest10943-21ssh07:12:042
29310995719,35cyclictest9410-21sh07:50:222
2931099571,5cyclictest20516-21taskset08:41:422
29306995727,22cyclictest0-21swapper/009:34:430
29306995720,2cyclictest0-21swapper/008:46:160
29306995720,2cyclictest0-21swapper/008:46:160
29306995711,18cyclictest0-21swapper/005:11:060
2931099563,39cyclictest7850irq/56-dwc_otg_06:21:142
29310995618,36cyclictest27244-21/usr/sbin/munin08:51:102
29306995630,4cyclictest8104-21fschecks_count05:01:100
2930699562,39cyclictest0-21swapper/006:11:210
2930699561,38cyclictest32338-21uniq09:36:110
2931099551,4cyclictest0-21swapper/207:31:582
2930699556,24cyclictest1804-21sh07:41:070
29306995528,15cyclictest7666-21diskmemload06:30:530
265502550,2sleep00-21swapper/005:51:150
2931099541,6cyclictest7786-21latency_hist05:00:542
2931099541,38cyclictest0-21swapper/206:40:462
2930699543,40cyclictest7608-21kworker/0:007:51:110
2930699542,43cyclictest0-21swapper/007:26:220
2930699542,25cyclictest0-21swapper/006:01:040
2930699541,44cyclictest0-21swapper/009:59:260
2930699541,41cyclictest0-21swapper/007:46:100
2930699541,40cyclictest14901-21aten_rbpower_cu08:36:050
2930699541,34cyclictest4053-21munin-run06:20:520
287152543,11sleep00-21swapper/004:26:400
2931099531,7cyclictest0-21swapper/204:54:512
2930999532,8cyclictest7950irq/56-dwc_otg_06:21:061
2930699533,17cyclictest28551-21grep08:51:220
29306995327,12cyclictest0-21swapper/006:36:200
29306995327,12cyclictest0-21swapper/004:38:560
2930699531,37cyclictest19563-21unixbench_singl08:01:200
29306995313,23cyclictest7245-21/usr/sbin/munin08:26:130
2931099523,7cyclictest7950irq/56-dwc_otg_09:46:102
2931099521,4cyclictest25832-21ssh06:51:152
2930699526,43cyclictest0-21swapper/006:56:070
2930699522,39cyclictest0-21swapper/006:53:530
29306995222,15cyclictest0-21swapper/005:31:050
2930699521,40cyclictest0-21swapper/007:59:590
2930699521,36cyclictest19602-21runrttasks09:21:060
2931099511,8cyclictest32395-21grep06:06:222
2931099511,37cyclictest15980-21ssh09:55:542
2930699516,30cyclictest0-21swapper/006:41:050
2930699513,28cyclictest17978-21unixbench_multi05:26:200
29306995131,4cyclictest31078-21ssh08:16:110
29306995126,10cyclictest0-21swapper/006:31:200
2930699512,25cyclictest0-21swapper/007:20:540
2930699511,37cyclictest16175-21sed05:21:200
2930699511,34cyclictest0-21swapper/008:11:200
237622510,2sleep30-21swapper/307:27:313
2931099504,4cyclictest7850irq/56-dwc_otg_08:19:192
2931099503,39cyclictest7850irq/56-dwc_otg_09:20:472
2931099503,39cyclictest7850irq/56-dwc_otg_09:20:472
2931099501,7cyclictest738-21aten_rbpower_po06:11:072
2931099501,7cyclictest31202-21wget04:36:072
2931099501,7cyclictest15149-21aten_rbpower_po05:21:062
2931099501,5cyclictest0-21swapper/205:11:152
2931099501,4cyclictest7950irq/56-dwc_otg_05:56:072
2930699509,19cyclictest0-21swapper/009:26:160
2930699502,36cyclictest0-21swapper/009:03:300
2930699501,36cyclictest0-21swapper/006:46:330
2931199497,24cyclictest0-21swapper/306:51:063
2931099495,5cyclictest13320-21grep05:16:072
2931099495,5cyclictest13320-21grep05:16:072
2931099492,5cyclictest0-21swapper/206:05:542
2931099491,7cyclictest4039-21latency_hist04:50:532
2931099491,7cyclictest2567-21aten_rbpower_po06:16:062
2930999497,25cyclictest0-21swapper/105:46:031
2930999496,8cyclictest7950irq/56-dwc_otg_09:16:051
2930999496,8cyclictest7950irq/56-dwc_otg_09:16:051
2930999493,16cyclictest0-21swapper/109:11:061
2930699494,24cyclictest0-21swapper/007:25:520
29306994929,10cyclictest0-21swapper/004:31:170
2930699492,36cyclictest0-21swapper/009:16:180
2930699492,36cyclictest0-21swapper/009:16:180
2930699492,34cyclictest0-21swapper/006:08:540
2930699492,33cyclictest0-21swapper/008:31:040
2930699491,35cyclictest5272-21grep04:51:210
2930699491,35cyclictest13077-21timerwakeupswit09:51:200
2930699491,27cyclictest0-21swapper/008:41:210
32572480,2sleep10-21swapper/107:41:391
2931199486,27cyclictest10048-21rm07:51:063
2931099487,36cyclictest0-21swapper/205:41:052
29306994828,5cyclictest7950irq/56-dwc_otg_08:21:130
2930699481,19cyclictest9052-21ssh09:07:190
2931099471,7cyclictest27522-21latency_hist05:55:532
2931099471,5cyclictest7850irq/56-dwc_otg_06:26:052
2930999477,25cyclictest0-21swapper/106:01:041
2930699472,36cyclictest0-21swapper/009:46:220
2930699472,34cyclictest0-21swapper/005:43:440
2930699471,37cyclictest0-21swapper/006:22:200
2931199467,25cyclictest0-21swapper/306:16:053
2931199467,25cyclictest0-21swapper/306:11:063
2930699461,42cyclictest0-21swapper/005:56:140
2930699461,32cyclictest0-21swapper/009:11:050
2931199457,24cyclictest0-21swapper/305:01:063
2930999452,8cyclictest7750irq/56-dwc_otg09:21:051
29309994519,10cyclictest7950irq/56-dwc_otg_09:56:051
2930699451,16cyclictest0-21swapper/005:00:530
2931199447,25cyclictest16529-21ssh06:41:053
29309994418,6cyclictest16564-21sh07:19:481
2930699441,23cyclictest0-21swapper/005:06:050
2930999437,6cyclictest7950irq/56-dwc_otg_06:46:061
2931199427,25cyclictest0-21swapper/305:46:033
2931199425,23cyclictest29226-21ssh06:56:073
2930999427,22cyclictest0-21swapper/105:36:051
2930999427,22cyclictest0-21swapper/105:31:051
2930999424,6cyclictest7750irq/56-dwc_otg05:21:061
2930999424,6cyclictest0-21swapper/107:56:041
29309994218,4cyclictest23-21ksoftirqd/107:11:231
2930999421,16cyclictest7950irq/56-dwc_otg_05:20:521
2930999421,16cyclictest7950irq/56-dwc_otg_05:20:521
2930999417,22cyclictest0-21swapper/106:11:061
2930999414,6cyclictest0-21swapper/106:41:051
29309994124,5cyclictest23-21ksoftirqd/108:10:531
294382400,2sleep129437-21df06:56:091
29311994025,4cyclictest7850irq/56-dwc_otg_07:56:043
29311994010,9cyclictest7850irq/56-dwc_otg_09:11:053
2930999405,20cyclictest7750irq/56-dwc_otg07:31:111
29309994016,5cyclictest7950irq/56-dwc_otg_08:21:051
29309994010,14cyclictest0-21swapper/106:40:341
8072390,2sleep30-21swapper/304:41:103
29311993915,6cyclictest442-21latency_hist06:10:523
2930999392,29cyclictest7950irq/56-dwc_otg_05:41:031
15712391,3sleep10-21swapper/109:37:431
59172380,1sleep10-21swapper/107:46:061
2931199387,22cyclictest0-21swapper/306:01:043
2931199386,4cyclictest14894-21sh06:38:383
2930999385,23cyclictest11981-21ssh09:51:061
29309993821,5cyclictest23915-21ntp_states08:46:151
29309993821,5cyclictest23915-21ntp_states08:46:151
29309993816,5cyclictest908-21runrttasks07:02:031
29309993816,4cyclictest7750irq/56-dwc_otg06:31:181
29309993810,9cyclictest0-21swapper/109:41:161
29309993810,9cyclictest0-21swapper/109:41:161
2931199376,19cyclictest0-21swapper/305:31:053
29311993717,5cyclictest10244-21sh07:11:213
29311993717,4cyclictest908-21runrttasks08:04:213
29311993715,14cyclictest3275-21sh08:21:153
2931199371,26cyclictest25664-21rm09:27:333
2931199371,22cyclictest7750irq/56-dwc_otg05:56:193
29311993711,17cyclictest0-21swapper/309:58:113
29309993719,7cyclictest28004-21netstat08:51:151
2930999371,27cyclictest0-21swapper/106:16:051
2930999371,25cyclictest0-21swapper/107:20:591
2931199366,19cyclictest0-21swapper/305:36:053
2931199361,5cyclictest7429-21/usr/sbin/munin08:26:163
2931199361,18cyclictest7950irq/56-dwc_otg_05:11:103
2930999369,5cyclictest7750irq/56-dwc_otg08:36:151
2930999364,5cyclictest21811-21ssh07:26:041
2930999363,4cyclictest0-21swapper/108:11:001
2930999362,21cyclictest7950irq/56-dwc_otg_07:36:191
2930999362,21cyclictest7950irq/56-dwc_otg_07:36:191
283602360,14sleep17950irq/56-dwc_otg_05:56:151
2931199354,18cyclictest0-21swapper/305:20:173
2931199354,18cyclictest0-21swapper/305:20:173
2931199351,5cyclictest17152-21apt-get07:20:593
29311993514,11cyclictest0-21swapper/306:32:543
29311993510,10cyclictest25577-21systemd-journal08:45:533
2930999356,3cyclictest0-21swapper/107:53:511
2930999354,4cyclictest7750irq/56-dwc_otg09:50:521
29309993510,8cyclictest0-21swapper/107:10:251
29309993510,4cyclictest0-21swapper/108:17:101
2931199346,15cyclictest0-21swapper/306:21:073
2931199342,24cyclictest0-21swapper/309:51:053
2931199342,10cyclictest7950irq/56-dwc_otg_05:21:063
29311993417,5cyclictest7850irq/56-dwc_otg_09:16:043
29311993417,5cyclictest7850irq/56-dwc_otg_09:16:043
2931199341,5cyclictest23128-21chrt08:46:023
2931199341,5cyclictest23128-21chrt08:46:023
2930999349,8cyclictest0-21swapper/108:02:221
2930999348,11cyclictest0-21swapper/109:31:141
2930999347,5cyclictest0-21swapper/109:29:201
2930999343,6cyclictest7850irq/56-dwc_otg_04:31:031
2930999342,5cyclictest0-21swapper/109:01:081
29309993411,4cyclictest7666-21diskmemload08:30:011
29311993313,11cyclictest4020-21seq09:01:173
2931199331,27cyclictest0-21swapper/304:52:433
29311993312,13cyclictest36722chrt04:48:183
2930999336,15cyclictest0-21swapper/105:01:061
2930999336,13cyclictest7950irq/56-dwc_otg_08:57:591
2930999333,14cyclictest7950irq/56-dwc_otg_05:26:101
29309993317,5cyclictest22872-21sed08:45:531
2931199328,4cyclictest7750irq/56-dwc_otg06:46:043
2931199327,14cyclictest0-21swapper/304:36:073
2931199325,12cyclictest7950irq/56-dwc_otg_09:06:203
29311993219,7cyclictest381ktimersoftd/309:46:053
29311993219,4cyclictest30702-21sh09:34:123
2931199321,26cyclictest0-21swapper/309:44:123
2931199321,26cyclictest0-21swapper/309:44:123
2931199321,26cyclictest0-21swapper/305:07:363
2931199321,26cyclictest0-21swapper/304:57:073
29311993211,15cyclictest0-21swapper/309:21:583
29309993211,10cyclictest949-21iwlist04:41:111
2931199318,17cyclictest381ktimersoftd/308:40:383
2931199317,14cyclictest0-21swapper/307:41:093
2931199316,14cyclictest0-21swapper/307:00:593
2931199315,5cyclictest6392-21grep07:06:213
2931199313,9cyclictest7850irq/56-dwc_otg_08:16:133
2931199311,5cyclictest7950irq/56-dwc_otg_08:11:123
2931199311,5cyclictest30908-21munin-run04:35:523
2931199311,4cyclictest7950irq/56-dwc_otg_09:00:533
2931199311,20cyclictest31074-21switchtime07:36:203
2931199311,20cyclictest31074-21switchtime07:36:203
2930999318,6cyclictest0-21swapper/105:11:091
2930999314,4cyclictest7850irq/56-dwc_otg_05:06:111
2930999314,4cyclictest7750irq/56-dwc_otg04:46:201
2930999314,13cyclictest7950irq/56-dwc_otg_06:06:121
2930999312,5cyclictest4123-21/usr/sbin/munin04:51:181
2931199301,8cyclictest25929-21grep05:51:073
2931199301,23cyclictest0-21swapper/309:38:513
2931199301,16cyclictest0-21swapper/308:06:073
2930999302,5cyclictest7850irq/56-dwc_otg_04:56:171
29309993020,5cyclictest0-21swapper/104:36:041
2930999301,18cyclictest0-21swapper/106:26:191
2796223011,9sleep128061-21/usr/sbin/munin04:26:131
2931199291,17cyclictest0-21swapper/307:32:053
2931199291,16cyclictest0-21swapper/305:26:073
2931199286,4cyclictest7850irq/56-dwc_otg_06:26:073
2931199286,17cyclictest6932-21ls07:46:193
2931199281,19cyclictest0-21swapper/308:51:343
2930999281,5cyclictest7750irq/56-dwc_otg05:51:211
287222273,15sleep20-21swapper/204:26:462
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional