You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 17:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sat Aug 01, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20442991422,104cyclictest0-21swapper/011:45:360
20442991392,110cyclictest0-21swapper/012:20:460
20442991252,7cyclictest0-21swapper/010:25:570
20442991172,6cyclictest0-21swapper/009:45:450
20442991063,81cyclictest0-21swapper/009:11:000
20442991043,91cyclictest15194-21chrt11:25:560
20442991043,91cyclictest15194-21chrt11:25:560
204429910424,45cyclictest0-21swapper/010:35:340
20442991033,6cyclictest0-21swapper/011:05:540
20442999737,24cyclictest0-21swapper/008:15:410
20442999737,24cyclictest0-21swapper/008:15:410
2044299972,9cyclictest26453-21ls11:00:490
2044299961,7cyclictest125-21systemd-journal09:10:270
292722940,5sleep12044399cyclictest09:45:561
24412930,1sleep00-21swapper/010:31:450
24412930,1sleep00-21swapper/010:31:450
33062920,6sleep22044499cyclictest11:11:412
20442999220,43cyclictest0-21swapper/012:15:580
2044299901,9cyclictest24522-21ssh09:40:450
211812890,1sleep20-21swapper/211:34:032
20443998738,23cyclictest27841-21irqstats12:20:481
20442998620,36cyclictest16532-21missed_timers09:30:500
20442998620,36cyclictest16532-21missed_timers09:30:500
20442998511,60cyclictest22210-21date07:15:280
20443998433,23cyclictest24090-21kworker/u8:312:15:571
2044299837,43cyclictest0-21swapper/008:10:420
2044299829,50cyclictest0-21swapper/010:45:550
2044399813,11cyclictest0-21swapper/111:05:521
20442998013,57cyclictest11010-21idleruntime-cro12:40:270
20442998013,57cyclictest11010-21idleruntime-cro12:40:270
2044599795,44cyclictest0-21swapper/311:25:553
2044599795,44cyclictest0-21swapper/311:25:553
20442997914,51cyclictest12038-21ssh10:05:250
20443997824,17cyclictest8050irq/56-dwc_otg_11:25:551
20443997824,17cyclictest8050irq/56-dwc_otg_11:25:551
20445997712,17cyclictest39-21ksoftirqd/310:25:573
20443997714,20cyclictest31957-21unixbench_singl11:45:581
2044299776,47cyclictest0-21swapper/012:00:380
20442997711,53cyclictest8263-21grep08:05:450
172652770,5sleep22044499cyclictest09:31:042
172652770,5sleep22044499cyclictest09:31:042
268712760,6sleep12044399cyclictest08:55:521
2044299761,9cyclictest28224-21grep07:30:480
2044299761,58cyclictest32446-21ssh12:25:550
20442997613,45cyclictest22815-21ssh11:35:470
20442997613,44cyclictest7815-21ssh11:55:570
2044299751,9cyclictest6222-21latency_hist11:55:280
2044299751,9cyclictest6222-21latency_hist11:55:280
2044299751,54cyclictest0-21swapper/010:05:540
2044299751,54cyclictest0-21swapper/010:05:540
20442997515,43cyclictest8050irq/56-dwc_otg_08:05:270
20442997513,51cyclictest19645-21ssh10:14:110
2044299751,11cyclictest0-21swapper/010:50:450
2044299747,52cyclictest0-21swapper/009:54:240
2044299741,12cyclictest20500-21latency_hist08:40:280
20443997314,39cyclictest0-21swapper/110:25:551
20443997242,25cyclictest16594-21ls09:30:501
20443997242,25cyclictest16594-21ls09:30:501
20443997223,25cyclictest667-21ssh09:10:581
20442997214,44cyclictest2164-21latency11:10:500
2044299719,48cyclictest0-21swapper/010:00:210
2044299718,50cyclictest6355-21chrt09:18:460
20442997119,30cyclictest0-21swapper/010:25:270
2044299711,54cyclictest24586-21latency07:20:460
20443997022,23cyclictest0-21swapper/111:00:501
2044299701,54cyclictest23854-21cron07:20:270
2044299691,52cyclictest13175-21sed10:45:280
2044599689,24cyclictest37-21rcuc/312:20:453
20445996831,17cyclictest727-21runrttasks09:11:003
20443996839,22cyclictest14120-21open_files10:45:521
2044299684,38cyclictest0-21swapper/011:16:200
2044299681,48cyclictest0-21swapper/009:04:560
20442996814,39cyclictest0-21swapper/007:25:420
20442996814,39cyclictest0-21swapper/007:25:420
2044299679,39cyclictest0-21swapper/012:10:390
20445996623,10cyclictest7950irq/56-dwc_otg_10:45:543
2044299669,44cyclictest0-21swapper/009:38:030
2044299667,4cyclictest0-21swapper/012:34:280
2044599654,40cyclictest8050irq/56-dwc_otg_09:45:483
2044399654,14cyclictest0-21swapper/107:25:391
2044399654,14cyclictest0-21swapper/107:25:391
2044299659,41cyclictest0-21swapper/011:32:370
2044299658,45cyclictest0-21swapper/011:22:520
20442996517,34cyclictest8050irq/56-dwc_otg_09:21:310
265502640,2sleep30-21swapper/309:42:523
2044599642,36cyclictest7950irq/56-dwc_otg_12:15:563
20443996418,13cyclictest6177-21munin-run11:55:281
20443996418,13cyclictest6177-21munin-run11:55:281
2044299644,46cyclictest8050irq/56-dwc_otg_08:00:270
2044299642,8cyclictest0-21swapper/008:46:090
2044299642,8cyclictest0-21swapper/008:46:090
2044299641,4cyclictest22715-21grep10:55:560
20442996412,38cyclictest8050irq/56-dwc_otg_08:35:270
2044499639,13cyclictest26537-21ssh11:00:522
20444996317,28cyclictest7950irq/56-dwc_otg_10:45:522
2044299637,43cyclictest21537-21cut08:40:520
2044299631,49cyclictest18218-21sh12:09:360
2044299631,49cyclictest18218-21sh12:09:360
2044299621,49cyclictest0-21swapper/007:49:440
20442996210,5cyclictest0-21swapper/009:30:080
20444996119,19cyclictest301ktimersoftd/212:20:482
2044299619,41cyclictest0-21swapper/008:26:580
2044299613,42cyclictest21225-21ssh10:15:480
184862610,2sleep10-21swapper/112:10:051
184862610,2sleep10-21swapper/112:10:051
20443996024,13cyclictest7850irq/56-dwc_otg11:55:341
20443996010,40cyclictest7850irq/56-dwc_otg12:30:401
2044299601,44cyclictest0-21swapper/008:56:460
20445995910,29cyclictest7950irq/56-dwc_otg_11:05:523
20444995913,9cyclictest8050irq/56-dwc_otg_12:15:562
20444995911,21cyclictest30666-21ntp_states11:05:522
2044299591,8cyclictest0-21swapper/011:41:490
20443995822,11cyclictest10881-21ssh09:24:291
20443995816,28cyclictest23882-21rm10:19:191
2044299589,5cyclictest14655-21chrt08:21:340
2044599577,32cyclictest7850irq/56-dwc_otg11:45:583
2044499573,14cyclictest30250-21apt-get11:45:322
20443995721,19cyclictest28432-21/usr/sbin/munin07:30:521
20443995716,19cyclictest23108-21ssh11:35:511
20443995714,23cyclictest24778-21sed09:40:471
2044299578,44cyclictest0-21swapper/007:50:500
237382560,2sleep20-21swapper/210:19:032
20443995616,19cyclictest28068-21ssh11:41:291
20443995611,24cyclictest3957-21taskset07:54:421
2044299561,44cyclictest0-21swapper/007:41:290
20442995614,32cyclictest0-21swapper/008:51:210
20443995525,12cyclictest6748-21ssh10:36:511
20443995517,23cyclictest7762-21if_eth012:35:461
20443995517,23cyclictest7762-21if_eth012:35:461
20443995517,17cyclictest21333-21/usr/sbin/munin08:40:491
20442995540,5cyclictest0-21swapper/007:35:410
2044599544,31cyclictest16598-21sh09:30:513
2044599544,31cyclictest16598-21sh09:30:513
2044499548,14cyclictest28546-21ssh09:45:442
20444995412,18cyclictest8050irq/56-dwc_otg_11:25:542
20444995412,18cyclictest8050irq/56-dwc_otg_11:25:542
20443995417,12cyclictest4949-21ssh09:16:141
20443995414,22cyclictest4186-21ssh11:13:171
20443995412,25cyclictest8050irq/56-dwc_otg_10:05:541
20443995412,25cyclictest8050irq/56-dwc_otg_10:05:541
20443995327,12cyclictest1448-21ntp_states10:30:501
20443995327,12cyclictest1448-21ntp_states10:30:501
20443995315,22cyclictest17411-21ssh10:50:361
20443995313,21cyclictest23277-21ssh10:56:351
20445995210,25cyclictest381ktimersoftd/311:00:513
20443995221,12cyclictest13336-21ssh11:24:491
20443995215,23cyclictest7333-21ssh11:16:271
20443995213,27cyclictest0-21swapper/108:45:541
20443995213,27cyclictest0-21swapper/108:45:541
20444995113,17cyclictest7950irq/56-dwc_otg_10:25:552
2044399519,22cyclictest0-21swapper/109:57:531
20443995124,17cyclictest10287-21wc08:10:481
2044399512,10cyclictest0-21swapper/108:30:421
20443995119,23cyclictest21726-21ssh09:36:381
20443995114,14cyclictest31436-21latency_hist09:10:271
20443995019,20cyclictest32345-21processes12:25:541
20443995017,13cyclictest24299-21awk07:20:411
20443995017,12cyclictest19255-21ls11:30:541
20443995016,21cyclictest20670-21latency_hist08:40:281
20443995016,18cyclictest12151-21ssh12:01:051
20443995010,13cyclictest0-21swapper/109:05:091
2044499493,27cyclictest0-21swapper/209:10:582
2044499493,22cyclictest7950irq/56-dwc_otg_08:15:422
2044499493,22cyclictest7950irq/56-dwc_otg_08:15:422
2044399498,26cyclictest0-21swapper/107:40:441
2044399498,25cyclictest8198-21sh08:05:441
20443994919,18cyclictest11840-21rm10:43:241
2044399491,8cyclictest12510-21timerandwakeup08:15:531
2044399491,8cyclictest12510-21timerandwakeup08:15:531
2044399489,19cyclictest0-21swapper/107:15:281
20443994814,21cyclictest13869-21runrttasks09:27:231
20443994814,19cyclictest0-21swapper/110:21:111
2044399478,23cyclictest8050irq/56-dwc_otg_09:55:051
199322476,35sleep00-21swapper/007:07:180
2044399464,27cyclictest7850irq/56-dwc_otg07:15:271
20443994619,9cyclictest0-21swapper/112:15:271
20443994616,12cyclictest18297-21rm10:11:431
20443994613,13cyclictest8242-21rm10:00:381
2044599457,24cyclictest0-21swapper/308:50:413
2044599451,3cyclictest0-21swapper/308:25:413
2044499457,22cyclictest0-21swapper/208:50:412
2044499451,30cyclictest8050irq/56-dwc_otg_08:45:402
2044499451,30cyclictest8050irq/56-dwc_otg_08:45:402
2044399454,4cyclictest0-21swapper/107:45:401
2044399447,19cyclictest0-21swapper/108:00:411
2044399446,21cyclictest0-21swapper/108:50:381
2044499431,7cyclictest0-21swapper/210:05:382
2044499431,7cyclictest0-21swapper/210:05:382
2044499431,19cyclictest7850irq/56-dwc_otg09:00:392
2044399439,12cyclictest0-21swapper/108:27:091
2044599428,13cyclictest61-21kswapd010:00:403
20444994217,13cyclictest0-21swapper/207:55:392
20444994215,9cyclictest22851-21munin-plugin-st12:15:272
2044399423,2cyclictest0-21swapper/107:35:391
2044599411,5cyclictest2016-21ssh11:10:483
2044399416,25cyclictest0-21swapper/107:55:321
20443993913,11cyclictest7850irq/56-dwc_otg08:21:321
2044599384,3cyclictest0-21swapper/311:20:393
2044599384,15cyclictest8050irq/56-dwc_otg_10:40:283
2044599382,21cyclictest0-21swapper/308:45:273
2044599381,24cyclictest0-21swapper/309:53:583
20445993810,13cyclictest8050irq/56-dwc_otg_10:15:443
20444993823,5cyclictest19757-21rm10:14:232
2044499382,17cyclictest0-21swapper/209:58:442
2044499381,28cyclictest22831-21grep07:15:472
2044499381,23cyclictest7741-21latency_hist08:05:282
2044599375,15cyclictest7950irq/56-dwc_otg_11:40:453
20445993717,4cyclictest31368-21aten_rbpower_en07:40:443
20445993715,5cyclictest730-21sh12:26:413
2044599371,22cyclictest11352-21latency_hist08:15:283
2044499371,12cyclictest7950irq/56-dwc_otg_10:40:422
281622361,29sleep20-21swapper/207:30:492
2044599368,18cyclictest0-21swapper/309:58:313
2044599361,6cyclictest7950irq/56-dwc_otg_12:30:503
2044499367,4cyclictest8050irq/56-dwc_otg_11:15:522
2044499366,17cyclictest17546-21ssh12:08:222
2044499366,17cyclictest17546-21ssh12:08:222
288452350,3sleep328809-21ssh10:25:283
263172351,30sleep30-21swapper/307:25:473
263172351,30sleep30-21swapper/307:25:473
2044499358,20cyclictest8050irq/56-dwc_otg_07:50:462
2044499357,14cyclictest0-21swapper/208:25:412
2044499355,13cyclictest8050irq/56-dwc_otg_12:35:422
2044499355,13cyclictest8050irq/56-dwc_otg_12:35:422
2044499352,8cyclictest8050irq/56-dwc_otg_08:10:402
2044499351,19cyclictest7950irq/56-dwc_otg_08:30:502
2044499351,17cyclictest22114-21latency_hist07:15:272
2044499351,16cyclictest0-21swapper/207:35:412
2044499351,15cyclictest460-21taskset07:45:272
2044499351,15cyclictest18199-21ssh10:50:522
92862340,3sleep20-21swapper/210:00:552
39792340,4sleep320441-21cyclictest09:15:473
2044599347,17cyclictest0-21swapper/308:30:423
2044599346,5cyclictest8050irq/56-dwc_otg_12:15:273
2044599346,25cyclictest0-21swapper/311:30:413
2044599346,12cyclictest8050irq/56-dwc_otg_11:55:553
20445993427,5cyclictest16445-21rm12:06:233
20445993427,5cyclictest16445-21rm12:06:233
2044599341,16cyclictest9811-21ssh10:40:493
20445993410,17cyclictest0-21swapper/311:53:553
20445993410,17cyclictest0-21swapper/311:53:553
2044499346,4cyclictest8050irq/56-dwc_otg_10:35:502
20444993415,11cyclictest7133-21latency_hist12:35:282
20444993413,5cyclictest7850irq/56-dwc_otg11:55:502
2044499341,17cyclictest20034-21unixbench_multi08:35:552
20444993411,4cyclictest619450http11:55:282
20444993411,4cyclictest619450http11:55:282
26542330,2sleep30-21swapper/310:32:083
26542330,2sleep30-21swapper/310:32:083
2044599337,14cyclictest0-21swapper/307:55:393
2044599336,11cyclictest8050irq/56-dwc_otg_09:35:303
2044599335,6cyclictest37-21rcuc/311:15:533
2044599335,13cyclictest8050irq/56-dwc_otg_08:20:483
2044599332,19cyclictest0-21swapper/307:35:273
20445993315,4cyclictest30636-21unixbench_singl07:35:563
2044599331,4cyclictest7850irq/56-dwc_otg08:15:443
2044599331,4cyclictest7850irq/56-dwc_otg08:15:443
2044599331,4cyclictest0-21swapper/309:20:433
2044599331,22cyclictest0-21swapper/309:25:403
2044499339,4cyclictest0-21swapper/211:36:352
2044499333,19cyclictest22446-21grep08:45:282
2044499331,25cyclictest0-21swapper/208:07:172
2044499331,15cyclictest0-21swapper/209:38:312
190822336,12sleep20-21swapper/207:05:472
150772330,2sleep30-21swapper/310:08:253
150772330,2sleep30-21swapper/310:08:253
2044599326,4cyclictest8050irq/56-dwc_otg_12:35:453
2044599326,4cyclictest8050irq/56-dwc_otg_12:35:453
2044599323,20cyclictest0-21swapper/307:20:453
20445993217,4cyclictest14531-21sh12:05:273
2044499329,4cyclictest0-21swapper/211:20:492
2044499327,6cyclictest8050irq/56-dwc_otg_10:30:442
2044499327,6cyclictest8050irq/56-dwc_otg_10:30:442
2044499326,4cyclictest0-21swapper/209:10:272
2044499322,17cyclictest0-21swapper/212:28:232
20444993213,4cyclictest14393-21sh09:28:222
2044599315,4cyclictest8050irq/56-dwc_otg_10:10:433
2044599314,13cyclictest31477-21rm09:10:283
2044599311,20cyclictest22929-21ssh11:35:493
2044599311,19cyclictest8050irq/56-dwc_otg_08:59:493
2044499318,15cyclictest1085-21timerwakeupswit09:50:552
2044499312,9cyclictest0-21swapper/207:20:432
2044499312,14cyclictest0-21swapper/211:44:362
2044499311,21cyclictest0-21swapper/209:19:222
2044499311,20cyclictest0-21swapper/209:40:412
2044499311,18cyclictest0-21swapper/210:23:192
20444993111,5cyclictest0-21swapper/212:00:442
2044499311,10cyclictest27317-21grep08:55:562
2044599307,9cyclictest8050irq/56-dwc_otg_07:50:473
2044599306,11cyclictest8050irq/56-dwc_otg_08:00:563
2044599302,9cyclictest0-21swapper/310:55:433
20445993010,4cyclictest0-21swapper/310:51:183
2044499303,14cyclictest8050irq/56-dwc_otg_07:25:472
2044499303,14cyclictest8050irq/56-dwc_otg_07:25:472
2044499301,16cyclictest0-21swapper/210:57:342
2044599297,4cyclictest0-21swapper/308:35:553
2044599293,5cyclictest7950irq/56-dwc_otg_08:45:443
2044599293,5cyclictest7950irq/56-dwc_otg_08:45:443
2044499293,15cyclictest10311-21ssh09:23:272
2044499291,19cyclictest0-21swapper/208:21:182
2044599286,5cyclictest7950irq/56-dwc_otg_09:00:533
2044599282,10cyclictest22099-21latency_hist07:15:273
2044499281,4cyclictest8050irq/56-dwc_otg_07:45:522
185612283,13sleep10-21swapper/107:05:291
2044599272,13cyclictest0-21swapper/307:45:293
2044599271,3cyclictest0-21swapper/308:05:423
2044599265,4cyclictest8050irq/56-dwc_otg_07:15:373
186132263,14sleep30-21swapper/307:05:353
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional