You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 09:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Mon May 04, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3148721820,6sleep1359699cyclictest08:08:051
41772920,2sleep0359599cyclictest09:32:350
93912890,6sleep2359799cyclictest09:00:522
93912890,6sleep2359799cyclictest09:00:522
156582880,2sleep00-21swapper/008:28:170
156582880,2sleep00-21swapper/008:28:170
134802750,5sleep1359699cyclictest06:26:151
3595997416,10cyclictest0-21swapper/007:31:040
288182740,5sleep1359699cyclictest06:46:201
156832720,2sleep20-21swapper/209:07:042
359599712,51cyclictest0-21swapper/006:41:030
3595997011,47cyclictest18639-21unixbench_multi08:31:210
172202680,2sleep317184-21ssh07:51:123
359599636,40cyclictest0-21swapper/008:21:130
3595996343,7cyclictest7850irq/56-dwc_otg_07:21:210
3595996319,33cyclictest9450irq/48-DMA09:12:250
359599631,42cyclictest8296-21timerandwakeup04:41:190
359599631,42cyclictest8296-21timerandwakeup04:41:190
3595996210,32cyclictest26391-21aten_rbpower_cu09:21:070
359599614,38cyclictest6633-21unixbench_multi04:36:210
359599612,36cyclictest0-21swapper/009:56:080
359599612,36cyclictest0-21swapper/009:56:080
3595996122,17cyclictest0-21swapper/006:06:220
3595996118,26cyclictest908-21runrttasks08:45:190
359599611,51cyclictest0-21swapper/009:41:110
359599611,47cyclictest0-21swapper/009:36:220
3595996025,14cyclictest7850irq/56-dwc_otg_07:11:100
359599602,44cyclictest0-21swapper/007:51:080
3595996020,37cyclictest10753-21processes09:01:200
359599601,50cyclictest18863-21cut09:51:070
251622600,2sleep10-21swapper/109:19:191
359599593,36cyclictest0-21swapper/009:06:060
359599592,42cyclictest0-21swapper/007:48:510
359599591,46cyclictest0-21swapper/009:20:530
359599591,44cyclictest7670-21ssh07:00:530
359599591,41cyclictest30233-21sed05:41:210
3595995813,33cyclictest0-21swapper/007:16:140
3595995723,20cyclictest0-21swapper/006:34:420
359599571,47cyclictest0-21swapper/006:46:190
359599571,41cyclictest30354-21ssh08:46:130
359699563,5cyclictest7750irq/56-dwc_otg07:31:041
3595995632,4cyclictest0-21swapper/008:01:200
359599562,38cyclictest1115-21sh08:11:080
359599561,30cyclictest8766-21unixbench_singl06:11:220
359599555,34cyclictest15155-21kernelversion09:46:120
3595995532,13cyclictest5048-21grep06:01:200
359599552,42cyclictest0-21swapper/005:36:220
359599551,45cyclictest0-21swapper/005:25:500
359599551,36cyclictest8327-21cat07:40:530
3595995439,6cyclictest12368-21cron07:45:530
3595995435,10cyclictest0-21swapper/006:20:540
3595995430,13cyclictest0-21swapper/005:20:530
359599541,45cyclictest0-21swapper/008:20:540
359599541,44cyclictest0-21swapper/005:34:400
359599533,4cyclictest0-21swapper/004:56:050
3595995333,5cyclictest6138-21ssh08:56:140
3595995333,5cyclictest6138-21ssh08:56:140
359599532,39cyclictest0-21swapper/008:37:310
359599532,38cyclictest0-21swapper/009:26:250
359599532,38cyclictest0-21swapper/009:26:250
359599531,30cyclictest21751-21ssh07:56:170
359599524,25cyclictest18162-21aten_rbpower_en09:11:070
359599522,35cyclictest15978-21kworker/0:005:05:240
359599521,43cyclictest0-21swapper/005:56:190
359599521,43cyclictest0-21swapper/005:56:190
359599521,41cyclictest0-21swapper/007:02:020
359599521,38cyclictest19793-21cat05:15:540
359599521,37cyclictest0-21swapper/005:50:460
3595995213,4cyclictest15930-21sh07:10:540
3595995213,4cyclictest15930-21sh07:10:540
85002510,2sleep30-21swapper/306:11:193
3595995130,6cyclictest446-21ls05:51:080
359599512,35cyclictest0-21swapper/008:52:390
359599511,47cyclictest0-21swapper/004:51:110
3595995111,20cyclictest908-21runrttasks07:26:090
359599501,41cyclictest29581-21fschecks_time08:06:110
359599501,36cyclictest0-21swapper/006:54:370
268342490,6sleep1359699cyclictest06:44:591
359599481,40cyclictest0-21swapper/006:36:160
359599479,23cyclictest0-21swapper/006:26:180
3595994732,4cyclictest9833-21awk04:46:150
3595994718,16cyclictest5250-21latency_hist04:35:530
359899467,24cyclictest0-21swapper/305:16:003
359599462,34cyclictest0-21swapper/006:24:360
3596994519,18cyclictest7750irq/56-dwc_otg09:06:061
359799441,7cyclictest0-21swapper/205:16:052
359799436,5cyclictest7750irq/56-dwc_otg08:51:102
359699437,23cyclictest0-21swapper/106:11:071
359699437,23cyclictest0-21swapper/104:31:051
359699437,22cyclictest0-21swapper/105:16:001
359699432,10cyclictest7750irq/56-dwc_otg09:56:061
359699432,10cyclictest7750irq/56-dwc_otg09:56:061
359699431,20cyclictest0-21swapper/106:56:081
359599431,33cyclictest0-21swapper/005:26:210
29752432,35sleep00-21swapper/004:26:250
192522430,7sleep2359799cyclictest07:14:272
89972420,3sleep339-21ksoftirqd/309:00:093
89972420,3sleep339-21ksoftirqd/309:00:093
359799425,7cyclictest7850irq/56-dwc_otg_04:41:042
359799425,7cyclictest7850irq/56-dwc_otg_04:41:042
3596994210,24cyclictest0-21swapper/106:35:191
3598994121,10cyclictest1658450ssh06:31:573
359799411,7cyclictest30543-21ssh07:27:252
155752410,1sleep10-21swapper/107:10:151
155752410,1sleep10-21swapper/107:10:151
3598994025,10cyclictest37-21rcuc/308:46:043
359899401,28cyclictest0-21swapper/308:24:093
359799408,4cyclictest0-21swapper/206:48:382
3597994010,15cyclictest14004-21sed07:46:202
359699407,5cyclictest7850irq/56-dwc_otg_08:56:081
359699407,5cyclictest7850irq/56-dwc_otg_08:56:081
359699403,5cyclictest7750irq/56-dwc_otg07:21:051
359699403,16cyclictest19084-21tune2fs09:51:111
3596994011,6cyclictest1920-21sh06:53:151
359899397,24cyclictest0-21swapper/309:36:063
3598993916,4cyclictest26857-21cat09:21:133
3598993915,5cyclictest20314-21timerwakeupswit06:36:203
3597993918,4cyclictest14275-21cron09:45:532
359699392,19cyclictest14501-21grep08:26:221
359699392,19cyclictest14501-21grep08:26:221
3596993913,4cyclictest1106-21swap05:51:191
359899389,16cyclictest0-21swapper/306:05:583
3598993822,9cyclictest26434-21ssh06:44:163
3598993821,10cyclictest24014-21ssh07:20:363
3598993820,5cyclictest22320-21sh09:55:283
359899381,4cyclictest7950irq/56-dwc_otg_08:06:073
3598993813,12cyclictest7950irq/56-dwc_otg_08:01:173
3597993818,4cyclictest5393-21tune2fs08:16:102
359699388,14cyclictest7950irq/56-dwc_otg_06:10:531
3596993820,4cyclictest29874-21aten_rbpower_en08:46:071
3596993818,5cyclictest10586-21ssh07:03:421
3596993816,6cyclictest5328-21processes07:36:181
3596993815,4cyclictest6622-21fschecks_count09:36:101
359699381,24cyclictest13834-21ls09:05:541
3596993810,4cyclictest0-21swapper/107:41:201
359899374,28cyclictest7950irq/56-dwc_otg_04:36:053
3598993718,8cyclictest14878-21ssh07:47:543
3598993717,5cyclictest24809-21fschecks_count07:21:103
3598993716,5cyclictest30840-21fschecks_time09:26:113
3598993716,5cyclictest30840-21fschecks_time09:26:113
359899371,24cyclictest0-21swapper/308:30:533
359899371,24cyclictest0-21swapper/308:30:533
359799377,25cyclictest0-21swapper/205:26:042
359799376,6cyclictest26372-21grep08:01:232
359799375,23cyclictest31-21ksoftirqd/206:56:082
3597993727,6cyclictest301ktimersoftd/209:26:052
3597993727,6cyclictest301ktimersoftd/209:26:052
3597993719,15cyclictest7950irq/56-dwc_otg_07:01:072
359799371,5cyclictest7950irq/56-dwc_otg_08:31:052
3597993713,7cyclictest29-21rcuc/209:51:382
359799371,22cyclictest29203-21/usr/sbin/munin08:06:192
3597993710,4cyclictest29-21rcuc/206:01:182
359699379,4cyclictest0-21swapper/108:13:151
359699379,4cyclictest0-21swapper/107:13:361
359699378,4cyclictest0-21swapper/108:23:401
359699378,4cyclictest0-21swapper/106:40:381
3596993719,5cyclictest14745-21aten_rbpower_vo09:46:071
3596993711,4cyclictest0-21swapper/107:51:161
149752370,4sleep214977-21aten_rbpower_cu06:31:072
359899369,15cyclictest0-21swapper/304:31:053
359899367,14cyclictest0-21swapper/308:51:063
3598993617,4cyclictest10449-21seq04:47:403
359799368,6cyclictest7950irq/56-dwc_otg_08:41:062
359799367,25cyclictest0-21swapper/209:01:012
359799366,6cyclictest7750irq/56-dwc_otg05:01:152
359799364,5cyclictest3498-21latency_hist06:55:542
359799362,7cyclictest7750irq/56-dwc_otg04:51:222
359799362,20cyclictest16455-21aten_rbpower_po05:06:072
3597993613,6cyclictest29-21rcuc/206:26:072
359699369,4cyclictest0-21swapper/108:42:151
359699364,6cyclictest2786-21sh08:51:221
359699361,22cyclictest23848-21ls05:26:061
359899353,10cyclictest7850irq/56-dwc_otg_09:31:153
359899352,11cyclictest0-21swapper/305:09:203
3598993514,4cyclictest381ktimersoftd/307:12:523
3598993513,6cyclictest14593-21diskmemload09:12:443
3598993511,4cyclictest16131-21latency_hist05:05:533
359799354,12cyclictest7850irq/56-dwc_otg_08:11:182
359799353,5cyclictest4136-21cron07:35:542
359799353,4cyclictest7750irq/56-dwc_otg09:46:032
359699358,4cyclictest0-21swapper/107:16:351
359699357,4cyclictest0-21swapper/108:16:171
359699355,11cyclictest0-21swapper/109:35:331
3596993514,4cyclictest30269-21latency_hist09:25:541
3596993510,4cyclictest18088-21/usr/sbin/munin09:11:231
25392356,18sleep12603-21/usr/sbin/munin04:26:181
359899347,18cyclictest0-21swapper/308:40:453
3598993423,8cyclictest10999-21latency_hist06:20:543
3598993418,9cyclictest2629-21ssh08:12:053
359899341,27cyclictest0-21swapper/307:07:003
359899341,27cyclictest0-21swapper/307:07:003
359799349,5cyclictest7750irq/56-dwc_otg06:41:122
359799347,23cyclictest0-21swapper/205:41:072
359799344,4cyclictest0-21swapper/205:21:062
359799343,17cyclictest7950irq/56-dwc_otg_08:46:072
359799342,14cyclictest7850irq/56-dwc_otg_09:36:212
3597993417,5cyclictest12370-21sh07:06:092
3597993417,5cyclictest12370-21sh07:06:092
359699347,14cyclictest0-21swapper/107:48:261
359699346,6cyclictest7750irq/56-dwc_otg09:41:161
359699345,5cyclictest7850irq/56-dwc_otg_06:05:531
359899337,18cyclictest5457-21munin-plugin-st06:05:533
359899336,14cyclictest0-21swapper/307:26:073
359899335,16cyclictest0-21swapper/309:45:053
3598993312,6cyclictest7540-21sh07:00:403
359899331,26cyclictest0-21swapper/308:19:593
359899331,20cyclictest0-21swapper/305:46:113
359899331,17cyclictest0-21swapper/304:43:313
359899331,17cyclictest0-21swapper/304:43:313
359799337,5cyclictest7950irq/56-dwc_otg_04:31:092
359799337,22cyclictest0-21swapper/205:36:072
359799334,12cyclictest7850irq/56-dwc_otg_09:56:122
359799334,12cyclictest7850irq/56-dwc_otg_09:56:122
3597993326,5cyclictest26681-21sh09:21:112
359799331,6cyclictest14211-21grep08:26:192
359799331,6cyclictest14211-21grep08:26:192
359799331,5cyclictest7750irq/56-dwc_otg07:55:542
359799331,4cyclictest7950irq/56-dwc_otg_08:36:062
359799331,22cyclictest22543-21uniq09:16:112
359799331,22cyclictest21168-21ls07:56:092
359799331,14cyclictest7750irq/56-dwc_otg05:15:532
3597993310,4cyclictest0-21swapper/209:31:082
359699337,8cyclictest7850irq/56-dwc_otg_08:01:161
3596993325,6cyclictest18328-21ssh08:31:181
3596993318,4cyclictest30296-21sh07:26:581
3596993314,9cyclictest6200-21ntp_kernel_pll_04:36:161
3596993312,4cyclictest2322-21fschecks_count05:56:111
3596993312,4cyclictest2322-21fschecks_count05:56:111
96142320,2sleep10-21swapper/104:46:121
359899328,5cyclictest9550irq/80-mmc005:15:533
359899327,4cyclictest7850irq/56-dwc_otg_07:43:483
3598993216,13cyclictest802250ssh07:01:073
3598993215,9cyclictest25315-21sh09:19:373
3598993211,7cyclictest7950irq/56-dwc_otg_09:46:213
359799322,14cyclictest7850irq/56-dwc_otg_09:15:532
359799321,13cyclictest7850irq/56-dwc_otg_05:46:192
359699321,7cyclictest20918-21ssh07:56:001
3596993213,4cyclictest29468-21idleruntime05:41:111
359699321,19cyclictest21617-21wget08:36:081
359899316,9cyclictest7750irq/56-dwc_otg06:46:083
359899316,9cyclictest0-21swapper/305:35:543
359899316,16cyclictest0-21swapper/308:35:443
359899315,5cyclictest7850irq/56-dwc_otg_05:30:533
359899312,5cyclictest7850irq/56-dwc_otg_07:56:213
359799313,16cyclictest0-21swapper/207:19:122
3597993115,8cyclictest5837-21ssh07:36:272
359799311,21cyclictest20132-21ssh06:36:192
359799311,10cyclictest0-21swapper/206:21:032
359699313,5cyclictest7850irq/56-dwc_otg_05:40:531
359699312,13cyclictest7950irq/56-dwc_otg_05:50:541
359699311,8cyclictest10954-21/usr/sbin/munin04:51:241
100812310,5sleep3359899cyclictest09:01:103
359899308,4cyclictest0-21swapper/309:06:053
359899304,4cyclictest26832-21sh08:41:203
359899303,4cyclictest7850irq/56-dwc_otg_06:51:143
359899302,4cyclictest7850irq/56-dwc_otg_07:37:323
359899302,24cyclictest7950irq/56-dwc_otg_05:51:053
359799307,15cyclictest0-21swapper/206:05:592
359799306,4cyclictest7750irq/56-dwc_otg04:56:172
359799306,15cyclictest0-21swapper/204:35:592
359799302,17cyclictest0-21swapper/207:42:122
3597993013,4cyclictest25816-21/usr/sbin/munin07:21:212
359699306,11cyclictest7850irq/56-dwc_otg_05:35:531
359699305,12cyclictest7950irq/56-dwc_otg_04:56:131
359699303,5cyclictest7950irq/56-dwc_otg_06:16:161
359699303,4cyclictest7850irq/56-dwc_otg_05:05:531
359699302,15cyclictest7950irq/56-dwc_otg_09:26:091
359699302,15cyclictest7950irq/56-dwc_otg_09:26:091
359699301,5cyclictest7750irq/56-dwc_otg05:06:071
359899294,4cyclictest7850irq/56-dwc_otg_04:51:153
3598992915,4cyclictest1722-21ssh07:31:303
3598992912,8cyclictest908-21runrttasks05:25:413
359899291,12cyclictest7950irq/56-dwc_otg_05:42:323
359799295,6cyclictest7850irq/56-dwc_otg_05:31:212
359799294,5cyclictest7950irq/56-dwc_otg_06:16:172
359799294,15cyclictest9760-21latency08:21:142
359799291,24cyclictest9170-21latency_hist06:15:542
359699294,4cyclictest7950irq/56-dwc_otg_06:21:201
3598992821,5cyclictest23331-21if_err_eth009:56:133
3598992821,5cyclictest23331-21if_err_eth009:56:133
359899281,9cyclictest0-21swapper/305:58:573
359899281,9cyclictest0-21swapper/305:58:573
3598992814,5cyclictest12043-21smartpower06:21:173
359899281,21cyclictest0-21swapper/304:58:553
359799282,18cyclictest0-21swapper/205:53:292
359899274,10cyclictest0-21swapper/306:26:223
359799271,8cyclictest0-21swapper/205:55:552
359799271,8cyclictest0-21swapper/205:55:552
359799271,4cyclictest7850irq/56-dwc_otg_04:46:132
359699271,15cyclictest0-21swapper/105:15:251
29722272,15sleep20-21swapper/204:26:232
359899261,8cyclictest27729-21if_wlan005:36:133
24692264,14sleep32480-21ntp_states04:26:163
359699253,4cyclictest8586-21runrttasks04:41:561
359699253,4cyclictest8586-21runrttasks04:41:561
359699252,4cyclictest22548-21ntp_kernel_pll_05:21:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional