You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 11:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Sun Dec 07, 2025 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1124923380,5sleep00-21swapper/019:05:400
1230599876,23cyclictest16766-21ssh22:30:190
133162820,6sleep11230699cyclictest20:40:431
133162820,6sleep11230699cyclictest20:40:431
89142810,4sleep013-21rcuc/022:19:410
144742800,2sleep10-21swapper/121:41:131
170672760,2sleep20-21swapper/222:30:302
1230599742,46cyclictest16271-21fschecks_time19:20:320
1230599731,47cyclictest31067-21munin-plugin-st22:50:130
1230599712,29cyclictest10460-21dpkg20:35:140
98402670,2sleep00-21swapper/023:49:180
1230699674,7cyclictest0-21swapper/100:25:301
1230699674,7cyclictest0-21swapper/100:25:301
199852660,2sleep10-21swapper/123:18:321
1230699663,15cyclictest7950irq/56-dwc_otg_00:00:331
1230699663,15cyclictest7950irq/56-dwc_otg_00:00:331
1230699657,6cyclictest7950irq/56-dwc_otg_23:45:321
1230599651,46cyclictest30462-21wget20:00:300
1230599641,43cyclictest32271-21unixbench_multi22:05:460
12305996330,7cyclictest7950irq/56-dwc_otg_23:30:250
1230599632,44cyclictest27332-21latency_hist22:00:140
1230599632,44cyclictest0-21swapper/019:30:130
1230599631,45cyclictest2326-21basename22:55:140
1230699626,13cyclictest17746-21ssh22:30:401
1230599623,10cyclictest2131-21sh21:25:270
1230599622,40cyclictest30792-21ssh22:05:140
1230599612,44cyclictest12043-21kworker/u8:421:10:420
1230599612,43cyclictest15190-21unixbench-2d19:15:410
1230599612,43cyclictest15190-21unixbench-2d19:15:410
222202600,6sleep312304-21cyclictest23:20:433
222202600,6sleep312304-21cyclictest23:20:433
199802600,5sleep119978-21grep21:50:151
199802600,5sleep119978-21grep21:50:151
1230699602,10cyclictest1120-21runrttasks19:21:591
12306996020,37cyclictest7950irq/56-dwc_otg_23:05:251
1230599608,25cyclictest0-21swapper/000:20:400
1230599602,7cyclictest9352-21ssh21:35:250
1230599601,32cyclictest7480-21ssh00:30:150
107052600,5sleep00-21swapper/022:20:450
1230599598,36cyclictest0-21swapper/019:40:270
1230599592,35cyclictest0-21swapper/022:40:420
1230599592,35cyclictest0-21swapper/022:40:420
1230599591,40cyclictest0-21swapper/020:45:360
1230599591,38cyclictest0-21swapper/019:35:360
1230699587,16cyclictest0-21swapper/119:45:291
1230599589,27cyclictest27925-21unixbench_singl19:50:430
12305995840,10cyclictest0-21swapper/023:40:310
12305995825,8cyclictest7850irq/56-dwc_otg_23:25:240
1230599582,39cyclictest13-21rcuc/020:10:150
1230599582,39cyclictest0-21swapper/021:05:140
1230599581,35cyclictest13400-21latency_hist23:10:140
1230699576,11cyclictest20199-21ssh21:50:271
12305995719,5cyclictest7950irq/56-dwc_otg_23:55:140
12305995714,25cyclictest16128-21aten_rbpower_cu20:50:300
1230599571,36cyclictest7413-21dpkg00:30:150
1230599571,36cyclictest7413-21dpkg00:30:150
1230599561,9cyclictest25648-21ssh00:10:270
1230599561,37cyclictest2603-21rm22:55:250
1230599561,30cyclictest4149-21processes20:15:400
1230699552,6cyclictest0-21swapper/123:25:241
1230599558,31cyclictest29754-21sort00:15:340
1230599552,38cyclictest0-21swapper/022:25:370
125702540,6sleep21230799cyclictest20:40:322
125702540,6sleep21230799cyclictest20:40:322
1230699541,4cyclictest9450irq/48-DMA09:28:481
1230599544,10cyclictest0-21swapper/021:40:280
1230599542,5cyclictest9876-21latency_hist23:05:150
1230599542,35cyclictest0-21swapper/022:35:420
12306995311,15cyclictest7750irq/56-dwc_otg23:50:261
1230599539,25cyclictest31231-21ssh21:20:310
12305995330,4cyclictest7950irq/56-dwc_otg_21:30:290
12305995312,24cyclictest2652-21grep20:10:460
12305995312,24cyclictest2652-21grep20:10:460
12307995227,5cyclictest7950irq/56-dwc_otg_00:25:312
12307995227,5cyclictest7950irq/56-dwc_otg_00:25:312
1230599521,37cyclictest13258-21ps20:40:420
1230599521,37cyclictest13258-21ps20:40:420
1230599521,27cyclictest0-21swapper/023:35:170
268622510,2sleep30-21swapper/321:15:143
245342510,2sleep20-21swapper/222:40:362
245342510,2sleep20-21swapper/222:40:362
1230699514,14cyclictest0-21swapper/100:10:451
12305995127,7cyclictest7035-21aten_rbpower_en20:25:280
1230599512,33cyclictest0-21swapper/022:15:090
1230599511,32cyclictest5511-21tune2fs20:20:320
1230999506,28cyclictest7546-21chrt00:30:203
1230699504,9cyclictest0-21swapper/122:35:251
1230599502,32cyclictest0-21swapper/023:11:250
1230599502,25cyclictest0-21swapper/021:54:100
1230599502,25cyclictest0-21swapper/000:37:350
12305995016,4cyclictest0-21swapper/020:55:290
1230599501,35cyclictest0-21swapper/021:15:370
1230599501,14cyclictest0-21swapper/023:21:430
1230599501,14cyclictest0-21swapper/023:21:430
1230799498,13cyclictest21842-21/usr/sbin/munin00:05:402
1230599499,21cyclictest20923-21latency_hist23:20:150
12305994936,5cyclictest7850irq/56-dwc_otg_19:50:140
1230599492,33cyclictest0-21swapper/000:03:400
1230599492,33cyclictest0-21swapper/000:03:400
1230599492,23cyclictest0-21swapper/023:55:450
12305994910,26cyclictest20672-21unixbench_multi19:30:430
214142480,2sleep2301ktimersoftd/222:35:412
12305994810,27cyclictest9-21ksoftirqd/000:05:420
1230799471,8cyclictest0-21swapper/223:50:272
12307994715,11cyclictest7950irq/56-dwc_otg_22:55:342
12305994710,17cyclictest7950irq/56-dwc_otg_21:10:140
1230799467,26cyclictest0-21swapper/223:35:202
1230699468,5cyclictest7950irq/56-dwc_otg_20:50:281
1230699467,24cyclictest0-21swapper/119:15:271
1230699467,24cyclictest0-21swapper/119:15:271
12305994613,30cyclictest292622chrt19:55:370
1230999452,27cyclictest7950irq/56-dwc_otg_00:25:143
1230699457,25cyclictest0-21swapper/100:30:291
1230699456,29cyclictest1120-21runrttasks21:00:291
1230699453,11cyclictest0-21swapper/123:30:251
1230699451,23cyclictest2396-21ssh23:38:591
1230999447,24cyclictest0-21swapper/320:10:323
1230999447,24cyclictest0-21swapper/320:10:323
1230799447,24cyclictest0-21swapper/220:50:302
12307994421,4cyclictest7950irq/56-dwc_otg_23:40:372
1230699443,9cyclictest0-21swapper/100:15:281
12306994427,4cyclictest7950irq/56-dwc_otg_20:50:141
1230599442,24cyclictest0-21swapper/021:47:000
1230599442,24cyclictest0-21swapper/021:47:000
12309994319,5cyclictest30625-21unixbench-2d00:15:453
1230799437,24cyclictest0-21swapper/223:05:282
1230799436,11cyclictest24739-21users21:10:462
1230799431,5cyclictest0-21swapper/222:45:252
12307994312,23cyclictest0-21swapper/220:35:282
1230699431,3cyclictest0-21swapper/100:35:271
12305994318,16cyclictest0-21swapper/019:10:190
284912420,1sleep30-21swapper/321:15:513
1230999424,23cyclictest0-21swapper/320:35:203
1230799427,26cyclictest0-21swapper/221:20:272
1230799427,25cyclictest0-21swapper/221:05:292
1230799427,24cyclictest0-21swapper/223:55:272
12307994216,9cyclictest7850irq/56-dwc_otg_21:40:422
12307994214,12cyclictest7750irq/56-dwc_otg19:50:372
12307994214,11cyclictest7950irq/56-dwc_otg_23:45:552
12307994213,11cyclictest7850irq/56-dwc_otg_21:26:562
12307994211,11cyclictest7850irq/56-dwc_otg_23:34:362
1230599422,20cyclictest0-21swapper/020:35:150
113242425,27sleep111406-21timerandwakeup19:05:421
1230999417,25cyclictest0-21swapper/322:10:313
1230999417,24cyclictest0-21swapper/300:00:283
1230999417,24cyclictest0-21swapper/300:00:283
1230999416,20cyclictest0-21swapper/320:20:283
1230999414,9cyclictest39-21ksoftirqd/322:30:393
1230999412,14cyclictest0-21swapper/321:05:263
12309994116,21cyclictest0-21swapper/323:15:313
1230799417,24cyclictest0-21swapper/220:10:322
1230799417,24cyclictest0-21swapper/220:10:322
12307994119,9cyclictest7750irq/56-dwc_otg00:11:202
12307994112,11cyclictest31358-21grep22:05:332
12306994117,7cyclictest0-21swapper/119:25:341
12306994113,6cyclictest5922-21aten_rbpower_en22:15:291
1230999403,3cyclictest7950irq/56-dwc_otg_22:35:423
12309994013,6cyclictest7750irq/56-dwc_otg19:35:423
1230999401,12cyclictest0-21swapper/323:55:253
1230799408,18cyclictest7950irq/56-dwc_otg_21:35:322
1230799407,25cyclictest0-21swapper/223:15:312
1230799407,23cyclictest0-21swapper/219:30:292
1230799405,26cyclictest7950irq/56-dwc_otg_23:00:432
12307994017,6cyclictest7750irq/56-dwc_otg22:02:442
12307994016,8cyclictest7850irq/56-dwc_otg_23:20:362
12307994016,8cyclictest7850irq/56-dwc_otg_23:20:362
12307994014,4cyclictest9065-21fschecks_time20:30:342
1230699406,25cyclictest0-21swapper/122:40:291
1230699406,25cyclictest0-21swapper/122:40:291
1230699406,22cyclictest0-21swapper/121:25:281
12306994013,15cyclictest0-21swapper/120:35:191
281282390,2sleep30-21swapper/300:13:213
231702390,5sleep31230999cyclictest19:40:273
1230999396,24cyclictest0-21swapper/321:20:273
1230999396,21cyclictest0-21swapper/319:20:283
12309993917,4cyclictest14365-21ssh00:40:153
1230999391,27cyclictest14042-21ls19:15:153
1230999391,23cyclictest39-21ksoftirqd/321:05:143
1230999391,11cyclictest381ktimersoftd/322:05:303
1230799398,10cyclictest32369-21cat20:05:292
1230799397,23cyclictest0-21swapper/200:00:282
1230799397,23cyclictest0-21swapper/200:00:282
12307993920,4cyclictest7950irq/56-dwc_otg_21:18:402
1230699393,6cyclictest5232-21wget20:20:281
12306993920,5cyclictest13384-21fschecks_count22:25:341
1230999386,6cyclictest39-21ksoftirqd/322:00:143
1230999386,5cyclictest13925-21ls23:10:303
12309993818,5cyclictest11533-21sh21:37:483
1230999381,21cyclictest8716-21ls20:30:143
12309993810,15cyclictest39-21ksoftirqd/323:40:133
1230799388,22cyclictest0-21swapper/219:20:282
1230799386,22cyclictest0-21swapper/222:10:312
12307993820,4cyclictest7950irq/56-dwc_otg_19:16:532
12307993820,4cyclictest7950irq/56-dwc_otg_19:16:532
1230699382,23cyclictest0-21swapper/122:21:211
12306993819,6cyclictest23538-21/usr/sbin/munin21:10:311
1230699381,8cyclictest0-21swapper/122:45:261
1230699381,25cyclictest3365-21ls22:10:491
12306993810,5cyclictest0-21swapper/123:55:251
1230999377,21cyclictest0-21swapper/319:30:293
1230999375,5cyclictest39-21ksoftirqd/300:25:443
1230999375,5cyclictest39-21ksoftirqd/300:25:443
12309993718,5cyclictest16581-21cp22:30:143
1230799377,15cyclictest7850irq/56-dwc_otg_00:30:322
1230799377,13cyclictest29-21rcuc/223:26:122
1230799375,20cyclictest29380-21ssh00:15:202
12307993718,4cyclictest528650wget20:20:292
12307993715,7cyclictest7950irq/56-dwc_otg_00:39:572
1230799371,20cyclictest8533-21latency_hist20:30:142
1230699376,20cyclictest31454-21ssh22:50:281
12306993727,6cyclictest221ktimersoftd/119:35:261
1230999367,4cyclictest7850irq/56-dwc_otg_23:05:303
1230999367,15cyclictest0-21swapper/323:25:263
1230999367,15cyclictest0-21swapper/319:50:293
12309993619,10cyclictest30009-21ssh22:48:013
12309993615,4cyclictest0-21swapper/321:45:333
12309993615,4cyclictest0-21swapper/321:45:333
1230799367,24cyclictest0-21swapper/220:55:292
1230799366,11cyclictest7850irq/56-dwc_otg_21:32:242
1230799365,10cyclictest0-21swapper/221:48:412
1230799365,10cyclictest0-21swapper/221:48:412
12307993617,6cyclictest7850irq/56-dwc_otg_21:59:582
12307993616,7cyclictest7850irq/56-dwc_otg_22:25:122
12307993612,4cyclictest7850irq/56-dwc_otg_22:25:342
319892350,2sleep30-21swapper/320:05:143
1230999357,5cyclictest39-21ksoftirqd/321:40:383
1230999354,6cyclictest30749-21latency_hist22:05:143
12309993529,4cyclictest12537-21aten_rbpower_cu20:40:313
12309993529,4cyclictest12537-21aten_rbpower_cu20:40:313
12309993522,10cyclictest7950irq/56-dwc_otg_22:42:353
12309993522,10cyclictest7950irq/56-dwc_otg_22:42:353
1230999352,13cyclictest7750irq/56-dwc_otg20:35:153
12309993512,5cyclictest7750irq/56-dwc_otg23:45:143
1230799351,7cyclictest7950irq/56-dwc_otg_20:15:282
12307993513,5cyclictest595250wget22:15:292
1230699359,24cyclictest0-21swapper/123:20:291
1230699359,24cyclictest0-21swapper/123:20:291
1230699357,14cyclictest7950irq/56-dwc_otg_23:15:141
1230699354,23cyclictest0-21swapper/122:05:281
1230699353,7cyclictest7750irq/56-dwc_otg21:15:321
1230699352,16cyclictest7950irq/56-dwc_otg_19:50:431
1230999349,14cyclictest0-21swapper/322:20:123
1230999347,7cyclictest7750irq/56-dwc_otg21:25:443
1230999342,5cyclictest2609-21ssh22:55:253
12309993423,8cyclictest10936-21fschecks_count23:50:333
12309993415,4cyclictest1120-21runrttasks19:55:343
12309993412,8cyclictest39-21ksoftirqd/300:05:343
1230799347,15cyclictest0-21swapper/219:55:282
12307993414,10cyclictest7850irq/56-dwc_otg_21:52:012
1230699344,14cyclictest7950irq/56-dwc_otg_21:05:431
1230699343,5cyclictest0-21swapper/123:40:391
12306993412,7cyclictest0-21swapper/122:55:261
1230699341,22cyclictest28085-21missed_timers22:00:371
1230999338,16cyclictest26526-21sh19:50:143
1230999337,14cyclictest0-21swapper/320:50:303
1230999335,17cyclictest39-21ksoftirqd/323:01:273
12309993313,9cyclictest23096-21diskmemload22:25:153
1230999331,26cyclictest0-21swapper/322:53:343
1230799338,4cyclictest0-21swapper/223:10:262
1230799337,15cyclictest0-21swapper/219:35:282
1230799335,13cyclictest31-21ksoftirqd/222:53:052
12307993313,8cyclictest7950irq/56-dwc_otg_00:22:382
1230699334,7cyclictest0-21swapper/121:35:261
1230699334,5cyclictest0-21swapper/121:58:161
1230699332,6cyclictest7750irq/56-dwc_otg00:06:341
1230699332,20cyclictest0-21swapper/121:20:271
12306993319,3cyclictest0-21swapper/120:00:411
12306993315,5cyclictest163350wget20:10:321
12306993315,5cyclictest163350wget20:10:321
1230999321,20cyclictest31813-21ssh23:35:143
1230999321,17cyclictest0-21swapper/321:30:333
1230799327,22cyclictest0-21swapper/220:45:302
1230799322,9cyclictest24254-21unixbench_multi19:40:442
1230699329,13cyclictest0-21swapper/123:05:011
12306993222,7cyclictest24725-21sh19:45:141
12306993217,4cyclictest28678-21aten_rbpower_vo19:55:291
117822320,24sleep20-21swapper/219:07:042
1230999313,12cyclictest39-21ksoftirqd/321:50:393
12309993114,9cyclictest39-21ksoftirqd/320:05:293
12309993111,5cyclictest19049-21taskset19:27:083
1230699319,12cyclictest7950irq/56-dwc_otg_20:25:421
1230699315,4cyclictest7750irq/56-dwc_otg00:20:331
12306993113,5cyclictest1120-21runrttasks19:12:061
12306993112,13cyclictest0-21swapper/121:32:171
119302312,23sleep30-21swapper/319:09:003
1230999307,14cyclictest15899-21latency_hist20:50:143
1230999304,17cyclictest0-21swapper/320:18:573
1230999301,21cyclictest0-21swapper/323:46:103
1230799301,5cyclictest0-21swapper/221:00:342
1230699301,7cyclictest7750irq/56-dwc_otg21:00:141
12307992914,4cyclictest12598-21fschecks_count19:10:312
1230699294,5cyclictest0-21swapper/119:30:271
1230699291,19cyclictest0-21swapper/120:20:141
1230999287,12cyclictest7850irq/56-dwc_otg_19:15:413
1230999287,12cyclictest7850irq/56-dwc_otg_19:15:413
1230699281,3cyclictest0-21swapper/120:05:361
1230799277,5cyclictest7950irq/56-dwc_otg_19:45:362
1230799271,7cyclictest7950irq/56-dwc_otg_19:25:392
1230999261,22cyclictest18515-21missed_timers20:55:373
1230799262,13cyclictest7950irq/56-dwc_otg_20:00:342
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional