You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 13:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Sat May 16, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1636321750,5sleep12293899cyclictest09:22:221
22937999945,36cyclictest7850irq/56-dwc_otg_08:41:110
2293799941,72cyclictest4159-21unixbench_multi09:46:300
84212900,2sleep20-21swapper/209:12:572
2293799861,25cyclictest13453-21tune2fs08:01:170
181212850,2sleep10-21swapper/105:46:141
22937998430,43cyclictest0-21swapper/007:41:280
62642820,2sleep00-21swapper/009:11:100
117492820,6sleep12293899cyclictest08:37:411
117492820,6sleep12293899cyclictest08:37:411
2293799815,64cyclictest0-21swapper/005:51:040
324912790,2sleep10-21swapper/108:24:001
2293799791,34cyclictest0-21swapper/007:16:110
2293799782,4cyclictest0-21swapper/009:41:110
22937997817,14cyclictest917-21snmpd07:22:020
131562780,5sleep32294099cyclictest08:01:113
2293799751,32cyclictest0-21swapper/009:29:560
22937997425,8cyclictest1684-21diskmemload09:21:000
2293799741,27cyclictest24992-21cut07:36:140
2293799741,21cyclictest19932-21chrt06:51:230
22937997411,5cyclictest30854-21aten_rbpower_po06:21:140
83772730,12sleep07950irq/56-dwc_otg_06:37:460
22937997320,4cyclictest8893-21aten_rbpower_vo05:21:140
2293799731,29cyclictest0-21swapper/008:21:000
22937997228,4cyclictest17885-21ssh07:26:280
2293799721,5cyclictest30435-21acpi09:01:090
2293799721,25cyclictest0-21swapper/007:02:230
2293799721,22cyclictest31086-21sed08:21:280
2293799721,19cyclictest8681-21idleruntime-cro07:56:000
22938997110,48cyclictest9100-21grep07:16:271
2293799711,34cyclictest0-21swapper/009:21:050
22937997113,12cyclictest14996-21wget06:46:130
2293999709,13cyclictest10206-21ssh06:40:562
2293799701,5cyclictest21195-21basename08:11:000
2293799701,26cyclictest24292-21ssh08:52:540
2293899692,48cyclictest0-21swapper/109:41:111
2293799692,23cyclictest0-21swapper/008:38:160
2293799692,23cyclictest0-21swapper/008:38:160
2293799691,32cyclictest0-21swapper/004:51:220
2293799691,29cyclictest0-21swapper/004:56:120
45742680,2sleep20-21swapper/207:51:002
2293899685,54cyclictest8941-21/usr/sbin/munin05:21:141
2293899683,4cyclictest1674-21kworker/u8:408:01:281
2293799681,33cyclictest0-21swapper/006:07:300
2293799681,33cyclictest0-21swapper/006:07:300
2293799681,29cyclictest3873-21cut07:11:130
2293799681,25cyclictest0-21swapper/006:31:180
2293799681,23cyclictest0-21swapper/007:10:520
2293799681,22cyclictest0-21swapper/004:46:160
2293799681,19cyclictest0-21swapper/008:35:050
22939996711,7cyclictest0-21swapper/209:16:262
2293899674,45cyclictest908-21runrttasks09:29:541
2293899673,56cyclictest13374-21ssh09:58:071
2293899673,55cyclictest7750irq/56-dwc_otg06:54:071
2293899672,54cyclictest0-21swapper/107:12:061
2293799672,21cyclictest0-21swapper/007:59:450
2293899665,46cyclictest7850irq/56-dwc_otg_07:40:591
2293899663,3cyclictest7950irq/56-dwc_otg_09:01:101
2293799662,20cyclictest0-21swapper/004:38:100
2293799661,31cyclictest0-21swapper/006:59:440
2293799661,26cyclictest0-21swapper/009:40:520
2293799661,25cyclictest0-21swapper/008:47:110
2293799661,21cyclictest0-21swapper/008:56:120
22939996515,5cyclictest21993-21sh09:29:552
2293899657,45cyclictest7750irq/56-dwc_otg07:35:501
2293899652,3cyclictest0-21swapper/109:37:211
2293799651,29cyclictest0-21swapper/007:33:060
2293799651,23cyclictest0-21swapper/006:13:170
2293999648,5cyclictest7950irq/56-dwc_otg_04:46:012
2293899642,55cyclictest7750irq/56-dwc_otg08:32:431
2293899641,55cyclictest28128-21ssh08:18:341
22938996412,38cyclictest24130-21unixbench_multi09:31:271
2293799643,17cyclictest0-21swapper/007:47:530
2293799642,42cyclictest3024-21awk05:05:590
2293799641,25cyclictest0-21swapper/008:29:000
2293799641,22cyclictest0-21swapper/009:35:130
22937996412,10cyclictest7850irq/56-dwc_otg_04:46:000
2293799631,25cyclictest0-21swapper/005:10:210
2293799631,20cyclictest23225-21ssh08:12:110
2293799631,20cyclictest23225-21ssh08:12:110
297362620,2sleep00-21swapper/006:16:240
2293899629,37cyclictest0-21swapper/108:56:241
22937996211,16cyclictest0-21swapper/006:43:040
2293899615,4cyclictest7950irq/56-dwc_otg_05:06:061
2293899614,46cyclictest3143-21ssh08:27:041
2293899612,51cyclictest0-21swapper/109:52:261
2293899611,50cyclictest14900-21ssh06:46:131
2293899611,46cyclictest5288-21ssh09:09:481
2293899611,46cyclictest5288-21ssh09:09:481
22940996012,12cyclictest17402-21ssh08:06:133
2293899607,39cyclictest7750irq/56-dwc_otg08:41:271
2293899606,42cyclictest31039-21ps04:51:241
2293899602,4cyclictest7750irq/56-dwc_otg05:51:281
2293899601,5cyclictest3700-21ntp_states09:46:241
2293899601,49cyclictest25830-21ssh08:55:431
2293899601,49cyclictest0-21swapper/107:22:491
2293899601,48cyclictest8224-21ssh09:12:351
2293899601,48cyclictest0-21swapper/106:36:401
2293899601,45cyclictest17009-21perl07:26:171
2293799601,26cyclictest0-21swapper/004:32:250
2293899592,47cyclictest2599-21ssh07:47:281
2293899592,44cyclictest30805-21cut06:21:141
2293899591,8cyclictest28610-21modprobe06:15:591
2293899591,47cyclictest28156-21awk04:46:001
2293899591,46cyclictest8775-21date07:56:001
2293899591,45cyclictest30261-21grep07:41:281
2293799595,8cyclictest0-21swapper/005:26:120
2293799592,33cyclictest0-21swapper/009:56:120
2293799591,25cyclictest16465-21fw_packets05:41:170
2293899586,44cyclictest7950irq/56-dwc_otg_08:47:081
2293899581,48cyclictest7750irq/56-dwc_otg04:46:161
2293899581,48cyclictest29778-21diskmemload07:02:511
2293899581,46cyclictest0-21swapper/108:15:421
2293899581,46cyclictest0-21swapper/108:15:421
2293899581,46cyclictest0-21swapper/108:08:501
2293899581,45cyclictest1936-21sh07:08:261
22937995837,6cyclictest7950irq/56-dwc_otg_05:36:280
2293799581,25cyclictest0-21swapper/009:54:580
2294099573,6cyclictest0-21swapper/305:41:103
2293899571,3cyclictest7750irq/56-dwc_otg06:16:211
2293899571,3cyclictest0-21swapper/109:19:281
2293899567,32cyclictest0-21swapper/107:59:431
2293899563,4cyclictest0-21swapper/106:56:241
2293899563,40cyclictest908-21runrttasks05:32:241
2293899562,39cyclictest5983-21ssh06:35:591
218902560,2sleep30-21swapper/306:53:593
2293999558,6cyclictest7950irq/56-dwc_otg_07:51:112
2293899555,41cyclictest7850irq/56-dwc_otg_06:43:071
2293899555,37cyclictest24746-21/usr/sbin/munin04:36:251
2293899551,43cyclictest0-21swapper/106:05:041
2293799551,30cyclictest0-21swapper/005:47:030
2293899542,40cyclictest0-21swapper/105:46:001
2293899532,5cyclictest0-21swapper/105:16:001
2293899531,4cyclictest0-21swapper/104:35:051
22937995325,16cyclictest6264-21grep05:11:280
2293899524,38cyclictest0-21swapper/106:26:571
2293899524,38cyclictest0-21swapper/106:26:571
2293899521,48cyclictest2543-21unixbench_multi05:01:261
273572510,2sleep3381ktimersoftd/308:17:103
2293899512,46cyclictest0-21swapper/105:56:151
2293799511,40cyclictest0-21swapper/006:01:470
2293799511,37cyclictest7467-21wc05:16:190
2293899501,7cyclictest32338-21fschecks_count04:56:141
2293899501,39cyclictest0-21swapper/105:16:041
2293799502,38cyclictest0-21swapper/009:10:520
2293799502,38cyclictest0-21swapper/009:10:520
2293799502,35cyclictest0-21swapper/005:34:490
2293999497,18cyclictest0-21swapper/208:41:132
22938994911,19cyclictest0-21swapper/105:26:121
2293999486,29cyclictest0-21swapper/206:06:112
2293999486,29cyclictest0-21swapper/206:06:112
2293899481,6cyclictest15071-21switchtime05:36:261
2293899481,5cyclictest25665-21/usr/sbin/munin06:06:161
2293899481,5cyclictest25665-21/usr/sbin/munin06:06:161
22939994727,10cyclictest917-21snmpd05:51:462
2294099466,25cyclictest0-21swapper/306:11:143
22937994633,5cyclictest1686-21cron06:31:000
22937994633,5cyclictest1686-21cron06:31:000
2294099452,4cyclictest0-21swapper/308:51:113
22940994520,6cyclictest31912-21ssh07:06:103
2293799452,27cyclictest0-21swapper/005:56:230
2249924527,12sleep00-21swapper/004:28:570
317282440,5sleep22293999cyclictest07:43:552
2294099447,23cyclictest0-21swapper/306:16:123
22939994417,11cyclictest7950irq/56-dwc_otg_08:21:122
2294099434,7cyclictest0-21swapper/307:01:123
2294099427,19cyclictest4892-21ssh07:51:133
2294099417,21cyclictest0-21swapper/309:26:053
22940994121,4cyclictest6421-21aten_rbpower_vo09:11:143
22940994116,6cyclictest12277-21sh07:21:103
2294099407,23cyclictest0-21swapper/306:21:053
2294099401,3cyclictest7950irq/56-dwc_otg_07:46:113
22939994019,4cyclictest14529-21/usr/sbin/munin09:21:282
2294099396,19cyclictest7950irq/56-dwc_otg_06:36:133
2294099394,3cyclictest0-21swapper/307:31:103
2294099391,28cyclictest3555-21ls09:46:223
2294099384,4cyclictest7750irq/56-dwc_otg08:22:153
22940993820,8cyclictest39-21ksoftirqd/305:56:193
2294099381,4cyclictest7850irq/56-dwc_otg_08:36:093
2294099381,4cyclictest7850irq/56-dwc_otg_08:36:093
22940993814,5cyclictest39-21ksoftirqd/306:46:003
2293999385,29cyclictest7950irq/56-dwc_otg_07:36:132
2293999385,24cyclictest3783-21ssh07:11:122
2293999384,4cyclictest7850irq/56-dwc_otg_05:21:162
2294099375,8cyclictest39-21ksoftirqd/305:50:593
2294099371,7cyclictest1292-21head06:26:273
2294099371,7cyclictest1292-21head06:26:273
22940993714,6cyclictest16774-21aten_rbpower_vo07:26:143
22940993714,11cyclictest8550-21basename05:20:593
2294099371,11cyclictest0-21swapper/309:55:513
2293999375,6cyclictest7950irq/56-dwc_otg_09:56:122
22939993718,4cyclictest7379-21if_eth005:16:182
22939993717,5cyclictest29578-21sh07:02:302
22939993715,9cyclictest7950irq/56-dwc_otg_08:31:142
2293999371,24cyclictest17610-21ls08:06:152
2294099365,24cyclictest9036-21ssh07:56:133
22940993618,4cyclictest14908-21aten_rbpower_cu06:46:133
22940993617,6cyclictest39-21ksoftirqd/304:51:283
22940993617,4cyclictest15212-21sh08:41:283
2294099361,21cyclictest0-21swapper/305:36:143
2293999367,6cyclictest7950irq/56-dwc_otg_07:21:002
2293999366,16cyclictest0-21swapper/208:04:072
2293999365,5cyclictest7850irq/56-dwc_otg_07:21:172
22939993616,12cyclictest14184-21/usr/sbin/munin05:36:182
2293999361,31cyclictest7950irq/56-dwc_otg_09:41:102
22939993612,4cyclictest23885-21cat04:31:262
134712360,2sleep20-21swapper/205:31:262
2294099359,5cyclictest7750irq/56-dwc_otg08:56:193
2294099357,24cyclictest0-21swapper/305:06:053
2294099357,14cyclictest7950irq/56-dwc_otg_07:11:133
2294099356,21cyclictest0-21swapper/308:11:123
2294099356,21cyclictest0-21swapper/308:11:123
2294099353,5cyclictest39-21ksoftirqd/309:41:003
2294099352,19cyclictest7850irq/56-dwc_otg_05:26:283
22940993515,7cyclictest0-21swapper/309:16:123
22940993511,14cyclictest37-21rcuc/307:41:133
2293999357,4cyclictest0-21swapper/208:26:242
2293999357,11cyclictest7850irq/56-dwc_otg_07:06:272
2293999352,6cyclictest0-21swapper/205:41:122
22939993512,4cyclictest8243-1kworker/u9:008:37:122
22939993512,4cyclictest8243-1kworker/u9:008:37:122
2294099348,12cyclictest0-21swapper/306:56:223
2294099343,7cyclictest7950irq/56-dwc_otg_08:46:113
2294099343,17cyclictest7750irq/56-dwc_otg07:16:173
2294099342,15cyclictest7850irq/56-dwc_otg_04:41:263
22940993416,6cyclictest12376-21/usr/sbin/munin05:31:173
22940993416,4cyclictest37-21rcuc/309:01:163
2294099341,23cyclictest31205-21ssh09:41:113
2294099341,16cyclictest7850irq/56-dwc_otg_09:26:003
22939993417,11cyclictest1684-21diskmemload08:52:562
2293999341,4cyclictest7850irq/56-dwc_otg_06:26:122
2293999341,4cyclictest7850irq/56-dwc_otg_06:26:122
2293999341,22cyclictest30108-21ls04:50:592
2293999341,20cyclictest21899-21cut05:56:152
2294099337,15cyclictest0-21swapper/309:56:143
22940993326,4cyclictest39-21ksoftirqd/306:31:193
2294099331,5cyclictest24930-21apt-get07:36:133
22940993310,4cyclictest0-21swapper/309:31:123
2293999335,5cyclictest9550irq/80-mmc007:56:242
22939993324,7cyclictest11157-21rm06:41:202
22939993317,5cyclictest30484-21latency_hist06:21:002
2293999331,5cyclictest7750irq/56-dwc_otg09:01:102
22939993310,10cyclictest0-21swapper/208:48:462
2294099326,13cyclictest7850irq/56-dwc_otg_06:06:123
2294099326,13cyclictest7850irq/56-dwc_otg_06:06:123
22940993214,4cyclictest37-21rcuc/305:24:043
22940993214,4cyclictest24978-21entropy04:36:173
22940993212,4cyclictest0-21swapper/308:33:183
2294099320,21cyclictest0-21swapper/308:26:103
2293999329,4cyclictest7950irq/56-dwc_otg_09:31:202
2293999326,9cyclictest7950irq/56-dwc_otg_06:51:272
2293999325,4cyclictest7850irq/56-dwc_otg_05:50:592
2293999324,6cyclictest7750irq/56-dwc_otg04:36:172
2293999321,23cyclictest0-21swapper/206:21:172
262922310,1sleep20-21swapper/208:16:202
2294099317,14cyclictest0-21swapper/305:51:053
2294099311,7cyclictest2615-21grep05:01:263
2294099311,18cyclictest7850irq/56-dwc_otg_09:08:573
2294099311,18cyclictest7850irq/56-dwc_otg_09:08:573
2294099311,10cyclictest28748-21sort04:46:163
2293999317,6cyclictest9450irq/48-DMA09:12:252
2293999317,5cyclictest7850irq/56-dwc_otg_05:11:282
2293999312,5cyclictest27042-21/usr/sbin/munin06:11:232
2293999311,5cyclictest6720-21sh09:50:592
22939993111,4cyclictest27879-21sh08:56:552
22939993110,4cyclictest0-21swapper/209:36:132
22939993110,3cyclictest0-21swapper/206:48:492
2294099303,5cyclictest7950irq/56-dwc_otg_06:01:183
2293999307,5cyclictest7850irq/56-dwc_otg_06:01:212
2293999305,11cyclictest0-21swapper/209:06:192
2293999305,11cyclictest0-21swapper/209:06:192
22939993013,7cyclictest0-21swapper/206:56:232
2293999301,19cyclictest0-21swapper/204:51:112
22939993010,3cyclictest0-21swapper/208:13:502
22939993010,3cyclictest0-21swapper/208:13:502
2294099296,5cyclictest7850irq/56-dwc_otg_05:11:143
2294099291,22cyclictest23289-21uniq04:31:173
2293999296,14cyclictest0-21swapper/209:51:112
2293999292,3cyclictest0-21swapper/207:31:102
2293999291,17cyclictest1684-21diskmemload06:31:032
2293999291,12cyclictest7950irq/56-dwc_otg_05:01:202
2294099281,5cyclictest7950irq/56-dwc_otg_05:01:003
2293999286,4cyclictest0-21swapper/207:26:142
2293999282,12cyclictest12256-21ls05:31:002
226142283,15sleep10-21swapper/104:30:271
224402264,15sleep30-21swapper/304:28:113
213242264,12sleep20-21swapper/204:26:162
2293999251,4cyclictest7950irq/56-dwc_otg_04:56:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional